2024-09-10T23:43:59.425 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T23:43:59.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T23:43:59.555 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899810 branch: wip-hemanth-testing-2024-09-10-0723 description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: hyelloji@redhat.com first_in_suite: false job_id: '7899810' kernel: flavor: default kdb: 1 sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/v18.2.0 ' name: hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-hemanth-testing-2024-09-10-0723 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: mon pg warn min per osd: 0 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-hemanth-testing-2024-09-10-0723 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 owner: scheduled_hyelloji@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 6190 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 sleep_before_teardown: 0 subset: 479/1024 suite: fs suite_branch: wip-hemanth-testing-2024-09-10-0723 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 targets: smithi111.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBArY0lid4xfxZ71zAkm3MNX/zDNS9rxK2IiE3xMDVZNNIziODuPGsVDKdt5s+sVuVAlKx7X1tZw/ymyysVQC1vU= smithi203.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCSJAjp4S/nCQC5hLN0sePGkfFV5ByKkFuSbumin9DXb3uyfIkySOQqOkL14h2AP7nXlZU+Yyhzz19dApHG9x5g= tasks: - install: exclude_packages: - ceph-volume tag: v18.2.0 - print: '**** done install task...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.io/ceph/ceph:v18.2.0 roleless: true - print: '**** done end installing v18.2.0 cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_16:59:47 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: hyelloji verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-10T23:43:59.555 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa; will attempt to use it 2024-09-10T23:43:59.556 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks 2024-09-10T23:43:59.556 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T23:43:59.558 INFO:teuthology.task.internal:Checking packages... 2024-09-10T23:43:59.579 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f219c476cb4f26fc5719c661c0323719a45cb30' 2024-09-10T23:43:59.579 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T23:43:59.579 INFO:teuthology.packaging:ref: None 2024-09-10T23:43:59.579 INFO:teuthology.packaging:tag: None 2024-09-10T23:43:59.579 INFO:teuthology.packaging:branch: wip-hemanth-testing-2024-09-10-0723 2024-09-10T23:43:59.580 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:43:59.580 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-hemanth-testing-2024-09-10-0723 2024-09-10T23:43:59.731 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4854.g8f219c47 2024-09-10T23:43:59.733 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T23:43:59.740 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T23:43:59.740 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T23:43:59.762 INFO:teuthology.task.internal:Saving configuration 2024-09-10T23:43:59.781 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T23:43:59.786 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T23:43:59.817 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899810', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 23:38:29.916725', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBArY0lid4xfxZ71zAkm3MNX/zDNS9rxK2IiE3xMDVZNNIziODuPGsVDKdt5s+sVuVAlKx7X1tZw/ymyysVQC1vU='} 2024-09-10T23:43:59.847 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899810', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 23:38:29.918649', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCSJAjp4S/nCQC5hLN0sePGkfFV5ByKkFuSbumin9DXb3uyfIkySOQqOkL14h2AP7nXlZU+Yyhzz19dApHG9x5g='} 2024-09-10T23:43:59.847 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T23:43:59.853 INFO:teuthology.task.internal:roles: ubuntu@smithi111.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-10T23:43:59.854 INFO:teuthology.task.internal:roles: ubuntu@smithi203.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-10T23:43:59.854 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T23:43:59.944 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9d98277be0>, signals=[15]) 2024-09-10T23:43:59.945 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T23:43:59.951 INFO:teuthology.task.internal:Opening connections... 2024-09-10T23:43:59.951 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi111.front.sepia.ceph.com 2024-09-10T23:43:59.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:44:00.033 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi203.front.sepia.ceph.com 2024-09-10T23:44:00.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:44:00.114 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T23:44:00.120 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2024-09-10T23:44:00.138 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2024-09-10T23:44:00.138 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2024-09-10T23:44:00.195 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream" 2024-09-10T23:44:00.196 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="9" 2024-09-10T23:44:00.196 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos" 2024-09-10T23:44:00.196 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora" 2024-09-10T23:44:00.196 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="9" 2024-09-10T23:44:00.196 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el9" 2024-09-10T23:44:00.196 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T23:44:00.196 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31" 2024-09-10T23:44:00.196 INFO:teuthology.orchestra.run.smithi111.stdout:LOGO="fedora-logo-icon" 2024-09-10T23:44:00.196 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T23:44:00.196 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/" 2024-09-10T23:44:00.196 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T23:44:00.196 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T23:44:00.196 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T23:44:00.197 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2024-09-10T23:44:00.222 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2024-09-10T23:44:00.240 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2024-09-10T23:44:00.240 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2024-09-10T23:44:00.297 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2024-09-10T23:44:00.297 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="9" 2024-09-10T23:44:00.297 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2024-09-10T23:44:00.297 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2024-09-10T23:44:00.297 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="9" 2024-09-10T23:44:00.297 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el9" 2024-09-10T23:44:00.297 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T23:44:00.297 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2024-09-10T23:44:00.297 INFO:teuthology.orchestra.run.smithi203.stdout:LOGO="fedora-logo-icon" 2024-09-10T23:44:00.298 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T23:44:00.298 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2024-09-10T23:44:00.298 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T23:44:00.298 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T23:44:00.298 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T23:44:00.298 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2024-09-10T23:44:00.330 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T23:44:00.339 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T23:44:00.361 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T23:44:00.362 DEBUG:teuthology.orchestra.run.smithi111:> test '!' -e /home/ubuntu/cephtest 2024-09-10T23:44:00.364 DEBUG:teuthology.orchestra.run.smithi203:> test '!' -e /home/ubuntu/cephtest 2024-09-10T23:44:00.381 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T23:44:00.386 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T23:44:00.386 DEBUG:teuthology.orchestra.run.smithi111:> test -z $(ls -A /var/lib/ceph) 2024-09-10T23:44:00.421 DEBUG:teuthology.orchestra.run.smithi203:> test -z $(ls -A /var/lib/ceph) 2024-09-10T23:44:00.519 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T23:44:00.580 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T23:44:00.593 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'} 2024-09-10T23:44:00.594 INFO:teuthology.task.kernel:config {'host.a': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}, 'host.b': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}}, timeout 300 2024-09-10T23:44:00.594 DEBUG:teuthology.orchestra.run.smithi111:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T23:44:00.594 DEBUG:teuthology.orchestra.run.smithi203:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T23:44:00.611 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:44:00.611 DEBUG:teuthology.task.kernel:sha1 for host.a is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:44:00.611 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-10T23:44:00.611 DEBUG:teuthology.orchestra.run.smithi111:> uname -r 2024-09-10T23:44:00.612 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:44:00.612 DEBUG:teuthology.task.kernel:sha1 for host.b is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:44:00.612 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-10T23:44:00.613 DEBUG:teuthology.orchestra.run.smithi203:> uname -r 2024-09-10T23:44:00.668 INFO:teuthology.orchestra.run.smithi111.stdout:5.14.0-503.el9.x86_64 2024-09-10T23:44:00.669 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:44:00.669 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-10T23:44:00.669 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:44:00.681 INFO:teuthology.orchestra.run.smithi203.stdout:5.14.0-503.el9.x86_64 2024-09-10T23:44:00.681 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:44:00.681 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-10T23:44:00.681 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:44:00.821 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum upgrade -y linux-firmware 2024-09-10T23:44:00.825 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum upgrade -y linux-firmware 2024-09-10T23:44:03.093 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-10T23:44:03.302 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-10T23:44:05.203 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-10T23:44:05.660 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 9 - AppStream 14 MB/s | 20 MB 00:01 2024-09-10T23:44:10.162 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - CRB 5.7 MB/s | 6.5 MB 00:01 2024-09-10T23:44:11.846 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-10T23:44:12.666 INFO:teuthology.orchestra.run.smithi203.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-10T23:44:12.753 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 9 - CRB 2.0 MB/s | 6.5 MB 00:03 2024-09-10T23:44:14.320 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 9 - Extras packages 91 kB/s | 19 kB 00:00 2024-09-10T23:44:15.174 INFO:teuthology.orchestra.run.smithi111.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-10T23:44:18.164 INFO:teuthology.orchestra.run.smithi203.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-10T23:44:20.266 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-10T23:44:20.267 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-09-10T23:44:20.267 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-10T23:44:20.366 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on host.b... 2024-09-10T23:44:20.366 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:44:20.516 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-10T23:44:20.517 DEBUG:teuthology.orchestra.run.smithi203:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-10T23:44:20.519 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi203.front.sepia.ceph.com to complete... 2024-09-10T23:44:20.605 INFO:teuthology.orchestra.run.smithi111.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-10T23:44:22.737 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-10T23:44:22.738 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-09-10T23:44:22.738 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-10T23:44:22.853 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on host.a... 2024-09-10T23:44:22.853 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:44:23.000 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-10T23:44:23.000 DEBUG:teuthology.orchestra.run.smithi111:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-10T23:44:23.003 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi111.front.sepia.ceph.com to complete... 2024-09-10T23:44:30.757 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-10 23:44:30 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-10T23:44:30.757 INFO:teuthology.orchestra.run.smithi203.stderr:FINISHED --2024-09-10 23:44:30-- 2024-09-10T23:44:30.758 INFO:teuthology.orchestra.run.smithi203.stderr:Total wall clock time: 10s 2024-09-10T23:44:30.758 INFO:teuthology.orchestra.run.smithi203.stderr:Downloaded: 1 files, 343M in 9.9s (34.5 MB/s) 2024-09-10T23:44:30.760 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on host.b... 2024-09-10T23:44:30.761 DEBUG:teuthology.orchestra.run.smithi203:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-10T23:44:32.887 INFO:teuthology.orchestra.run.smithi203.stdout:Verifying... ######################################## 2024-09-10T23:44:33.119 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing... ######################################## 2024-09-10T23:44:33.232 INFO:teuthology.orchestra.run.smithi203.stdout:Updating / installing... 2024-09-10T23:44:33.447 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10 23:44:33 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-10T23:44:33.448 INFO:teuthology.orchestra.run.smithi111.stderr:FINISHED --2024-09-10 23:44:33-- 2024-09-10T23:44:33.448 INFO:teuthology.orchestra.run.smithi111.stderr:Total wall clock time: 10s 2024-09-10T23:44:33.448 INFO:teuthology.orchestra.run.smithi111.stderr:Downloaded: 1 files, 343M in 10s (33.9 MB/s) 2024-09-10T23:44:33.450 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on host.a... 2024-09-10T23:44:33.450 DEBUG:teuthology.orchestra.run.smithi111:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-10T23:44:35.562 INFO:teuthology.orchestra.run.smithi111.stdout:Verifying... ######################################## 2024-09-10T23:44:35.770 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing... ######################################## 2024-09-10T23:44:35.879 INFO:teuthology.orchestra.run.smithi111.stdout:Updating / installing... 2024-09-10T23:44:41.296 INFO:teuthology.orchestra.run.smithi203.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-10T23:44:43.888 INFO:teuthology.orchestra.run.smithi111.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-10T23:45:22.245 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi203.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-10T23:45:22.245 DEBUG:teuthology.orchestra.run.smithi203:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-10T23:45:22.343 INFO:teuthology.orchestra.run.smithi203.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:45:22.343 INFO:teuthology.orchestra.run.smithi203.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:45:22.343 INFO:teuthology.orchestra.run.smithi203.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:45:22.343 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:45:22.344 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-10T23:45:22.344 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-10T23:45:22.344 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-10T23:45:22.344 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-10T23:45:22.344 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-10T23:45:22.344 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-10T23:45:22.344 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-10T23:45:22.345 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-10T23:45:22.345 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-10T23:45:22.345 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-10T23:45:22.345 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-10T23:45:22.345 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-10T23:45:22.345 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-10T23:45:22.346 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-10T23:45:22.346 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-10T23:45:22.346 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-10T23:45:22.347 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-10T23:45:22.347 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-10T23:45:22.347 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-10T23:45:22.348 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-10T23:45:22.348 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-10T23:45:22.348 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-10T23:45:22.348 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-10T23:45:22.348 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-10T23:45:22.348 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-10T23:45:22.348 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-10T23:45:22.349 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-10T23:45:22.349 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-10T23:45:22.349 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-10T23:45:22.349 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-10T23:45:22.349 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-10T23:45:22.349 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-10T23:45:22.349 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-10T23:45:22.349 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-10T23:45:22.349 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-10T23:45:22.349 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-10T23:45:22.349 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-10T23:45:22.350 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-10T23:45:22.350 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-10T23:45:22.350 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-10T23:45:22.350 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-10T23:45:22.350 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-10T23:45:22.350 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-10T23:45:22.350 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-10T23:45:22.350 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-10T23:45:22.350 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-10T23:45:22.350 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-10T23:45:22.350 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-10T23:45:22.350 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-10T23:45:22.350 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-10T23:45:22.351 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-10T23:45:22.351 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-10T23:45:22.351 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-10T23:45:22.351 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-10T23:45:22.351 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-10T23:45:22.351 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-10T23:45:22.351 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-10T23:45:22.351 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-10T23:45:22.351 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-10T23:45:22.351 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-10T23:45:22.351 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-10T23:45:22.351 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-10T23:45:22.351 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-10T23:45:22.352 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-10T23:45:22.352 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-10T23:45:22.352 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-10T23:45:22.352 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-10T23:45:22.352 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-10T23:45:22.352 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-10T23:45:22.352 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-10T23:45:22.352 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-10T23:45:22.352 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-10T23:45:22.352 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-10T23:45:22.352 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-10T23:45:22.352 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-10T23:45:22.352 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-10T23:45:22.352 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-10T23:45:22.353 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-10T23:45:22.353 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-10T23:45:22.353 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-10T23:45:22.353 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-10T23:45:22.353 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-10T23:45:22.353 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-10T23:45:22.353 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-10T23:45:22.353 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-10T23:45:22.353 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-10T23:45:22.353 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-10T23:45:22.353 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-10T23:45:22.353 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-10T23:45:22.353 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-10T23:45:22.353 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-10T23:45:22.354 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-10T23:45:22.354 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-10T23:45:22.354 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-10T23:45:22.354 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-10T23:45:22.354 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-10T23:45:22.354 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-10T23:45:22.354 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-10T23:45:22.354 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-10T23:45:22.354 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-10T23:45:22.354 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-10T23:45:22.354 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-10T23:45:22.354 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-10T23:45:22.354 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-10T23:45:22.355 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-10T23:45:22.355 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-10T23:45:22.355 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-10T23:45:22.355 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-10T23:45:22.355 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-10T23:45:22.355 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-10T23:45:22.355 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-10T23:45:22.355 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-10T23:45:22.355 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-10T23:45:22.355 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-10T23:45:22.355 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-10T23:45:22.355 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-10T23:45:22.356 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-10T23:45:22.356 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-10T23:45:22.356 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-10T23:45:22.356 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-10T23:45:22.356 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-10T23:45:22.356 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-10T23:45:22.356 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-10T23:45:22.356 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-10T23:45:22.356 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-10T23:45:22.356 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-10T23:45:22.356 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-10T23:45:22.356 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-10T23:45:22.357 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-10T23:45:22.357 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-10T23:45:22.357 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-10T23:45:22.357 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-10T23:45:22.357 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-10T23:45:22.357 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-10T23:45:22.357 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-10T23:45:22.357 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-10T23:45:22.357 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-10T23:45:22.357 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-10T23:45:22.357 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-10T23:45:22.357 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-10T23:45:22.357 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-10T23:45:22.358 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-10T23:45:22.358 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-10T23:45:22.358 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-10T23:45:22.358 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-10T23:45:22.358 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-10T23:45:22.358 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-10T23:45:22.358 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-10T23:45:22.358 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-10T23:45:22.358 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-10T23:45:22.358 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-10T23:45:22.358 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-10T23:45:22.358 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-10T23:45:22.358 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-10T23:45:22.358 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-10T23:45:22.359 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-10T23:45:22.359 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-10T23:45:22.359 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-10T23:45:22.359 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-10T23:45:22.359 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-10T23:45:22.359 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-10T23:45:22.359 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-10T23:45:22.359 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-10T23:45:22.359 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-10T23:45:22.359 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-10T23:45:22.359 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-10T23:45:22.359 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-10T23:45:22.360 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-10T23:45:22.360 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-10T23:45:22.360 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-10T23:45:22.360 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-10T23:45:22.360 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-10T23:45:22.360 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-10T23:45:22.360 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-10T23:45:22.360 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-10T23:45:22.360 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-10T23:45:22.360 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-10T23:45:22.360 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-10T23:45:22.360 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-10T23:45:22.360 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-10T23:45:22.361 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-10T23:45:22.361 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-10T23:45:22.361 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-10T23:45:22.361 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-10T23:45:22.361 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-10T23:45:22.361 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-10T23:45:22.361 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-10T23:45:22.361 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-10T23:45:22.361 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-10T23:45:22.361 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-10T23:45:22.361 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-10T23:45:22.361 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-10T23:45:22.361 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-10T23:45:22.362 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-10T23:45:22.362 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-10T23:45:22.362 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-10T23:45:22.362 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-10T23:45:22.362 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-10T23:45:22.362 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-10T23:45:22.362 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-10T23:45:22.362 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-10T23:45:22.362 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-10T23:45:22.362 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-10T23:45:22.362 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-10T23:45:22.362 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-10T23:45:22.362 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-10T23:45:22.362 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-10T23:45:22.363 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-10T23:45:22.363 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-10T23:45:22.363 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-10T23:45:22.363 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-10T23:45:22.363 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-10T23:45:22.363 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-10T23:45:22.363 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-10T23:45:22.363 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-10T23:45:22.363 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-10T23:45:22.363 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-10T23:45:22.363 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-10T23:45:22.363 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-10T23:45:22.363 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-10T23:45:22.364 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-10T23:45:22.364 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-10T23:45:22.364 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-10T23:45:22.364 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-10T23:45:22.364 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-10T23:45:22.364 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-10T23:45:22.364 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-10T23:45:22.364 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-10T23:45:22.364 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-10T23:45:22.364 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-10T23:45:22.364 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-10T23:45:22.364 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-10T23:45:22.364 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-10T23:45:22.364 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-10T23:45:22.365 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-10T23:45:22.365 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-10T23:45:22.365 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-10T23:45:22.365 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-10T23:45:22.365 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-10T23:45:22.365 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-10T23:45:22.365 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-10T23:45:22.365 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-10T23:45:22.365 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-10T23:45:22.365 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-10T23:45:22.365 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-10T23:45:22.365 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-10T23:45:22.365 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-10T23:45:22.366 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-10T23:45:22.366 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-10T23:45:22.366 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-10T23:45:22.366 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-10T23:45:22.366 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-10T23:45:22.366 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-10T23:45:22.366 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-10T23:45:22.366 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-10T23:45:22.366 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-10T23:45:22.366 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-10T23:45:22.366 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-10T23:45:22.366 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-10T23:45:22.366 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-10T23:45:22.366 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-10T23:45:22.367 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-10T23:45:22.367 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-10T23:45:22.367 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-10T23:45:22.367 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-10T23:45:22.367 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-10T23:45:22.367 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-10T23:45:22.367 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-10T23:45:22.367 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-10T23:45:22.367 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-10T23:45:22.367 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-10T23:45:22.367 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-10T23:45:22.367 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-10T23:45:22.367 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-10T23:45:22.367 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-10T23:45:22.368 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-10T23:45:22.368 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-10T23:45:22.368 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-10T23:45:22.368 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-10T23:45:22.368 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-10T23:45:22.368 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-10T23:45:22.368 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-10T23:45:22.368 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-10T23:45:22.368 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-10T23:45:22.368 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-10T23:45:22.368 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-10T23:45:22.368 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-10T23:45:22.368 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-10T23:45:22.368 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-10T23:45:22.369 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-10T23:45:22.369 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-10T23:45:22.369 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-10T23:45:22.369 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-10T23:45:22.369 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-10T23:45:22.369 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-10T23:45:22.369 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-10T23:45:22.369 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-10T23:45:22.369 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-10T23:45:22.369 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-10T23:45:22.369 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-10T23:45:22.369 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-10T23:45:22.369 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-10T23:45:22.369 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-10T23:45:22.370 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-10T23:45:22.370 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-10T23:45:22.370 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-10T23:45:22.370 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-10T23:45:22.370 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-10T23:45:22.370 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-10T23:45:22.370 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-10T23:45:22.370 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-10T23:45:22.370 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-10T23:45:22.370 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-10T23:45:22.370 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-10T23:45:22.370 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-10T23:45:22.370 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-10T23:45:22.370 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-10T23:45:22.370 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-10T23:45:22.371 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-10T23:45:22.371 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-10T23:45:22.371 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-10T23:45:22.371 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-10T23:45:22.371 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-10T23:45:22.371 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-10T23:45:22.371 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-10T23:45:22.371 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-10T23:45:22.371 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-10T23:45:22.371 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-10T23:45:22.371 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-10T23:45:22.371 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-10T23:45:22.371 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-10T23:45:22.371 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-10T23:45:22.371 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-10T23:45:22.372 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-10T23:45:22.372 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-10T23:45:22.372 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-10T23:45:22.372 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-10T23:45:22.372 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-10T23:45:22.372 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-10T23:45:22.372 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-10T23:45:22.372 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-10T23:45:22.372 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-10T23:45:22.372 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-10T23:45:22.372 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-10T23:45:22.372 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-10T23:45:22.372 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-10T23:45:22.373 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-10T23:45:22.373 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-10T23:45:22.373 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-10T23:45:22.373 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-10T23:45:22.373 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-10T23:45:22.373 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-10T23:45:22.373 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-10T23:45:22.373 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-10T23:45:22.373 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-10T23:45:22.373 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-10T23:45:22.373 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-10T23:45:22.373 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-10T23:45:22.373 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-10T23:45:22.373 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-10T23:45:22.374 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-10T23:45:22.374 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-10T23:45:22.374 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-10T23:45:22.374 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-10T23:45:22.374 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-10T23:45:22.374 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-10T23:45:22.374 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-10T23:45:22.374 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-10T23:45:22.374 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-10T23:45:22.374 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-10T23:45:22.374 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-10T23:45:22.374 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-10T23:45:22.374 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-10T23:45:22.375 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-10T23:45:22.375 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-10T23:45:22.375 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-10T23:45:22.375 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-10T23:45:22.375 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-10T23:45:22.375 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-10T23:45:22.375 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-10T23:45:22.375 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-10T23:45:22.375 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-10T23:45:22.375 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-10T23:45:22.375 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-10T23:45:22.375 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-10T23:45:22.375 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-10T23:45:22.375 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-10T23:45:22.376 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-10T23:45:22.376 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-10T23:45:22.376 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-10T23:45:22.376 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-10T23:45:22.376 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-10T23:45:22.376 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-10T23:45:22.376 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-10T23:45:22.376 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-10T23:45:22.376 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-10T23:45:22.376 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-10T23:45:22.376 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-10T23:45:22.376 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-10T23:45:22.376 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-10T23:45:22.377 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-10T23:45:22.377 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-10T23:45:22.377 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-10T23:45:22.377 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-10T23:45:22.377 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-10T23:45:22.377 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-10T23:45:22.377 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-10T23:45:22.377 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-10T23:45:22.377 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-10T23:45:22.377 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-10T23:45:22.377 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-10T23:45:22.377 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-10T23:45:22.377 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-10T23:45:22.377 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-10T23:45:22.378 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-10T23:45:22.378 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-10T23:45:22.378 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-10T23:45:22.378 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-10T23:45:22.378 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-10T23:45:22.378 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-10T23:45:22.378 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-10T23:45:22.378 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-10T23:45:22.378 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-10T23:45:22.378 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-10T23:45:22.378 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-10T23:45:22.378 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-10T23:45:22.378 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-10T23:45:22.378 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-10T23:45:22.378 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-10T23:45:22.378 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-10T23:45:22.379 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-10T23:45:22.379 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-10T23:45:22.379 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-10T23:45:22.379 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-10T23:45:22.379 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-10T23:45:22.379 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-10T23:45:22.379 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-10T23:45:22.379 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-10T23:45:22.379 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-10T23:45:22.379 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-10T23:45:22.379 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-10T23:45:22.379 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-10T23:45:22.379 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-10T23:45:22.379 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-10T23:45:22.379 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-10T23:45:22.380 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-10T23:45:22.380 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-10T23:45:22.380 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-10T23:45:22.380 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-10T23:45:22.380 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-10T23:45:22.380 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-10T23:45:22.380 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-10T23:45:22.380 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-10T23:45:22.380 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-10T23:45:22.380 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-10T23:45:22.380 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-10T23:45:22.380 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-10T23:45:22.380 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-10T23:45:22.380 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-10T23:45:22.381 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-10T23:45:22.381 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-10T23:45:22.381 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-10T23:45:22.381 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-10T23:45:22.381 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-10T23:45:22.381 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-10T23:45:22.381 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-10T23:45:22.381 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-10T23:45:22.381 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-10T23:45:22.381 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-10T23:45:22.381 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-10T23:45:22.381 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-10T23:45:22.381 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-10T23:45:22.382 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-10T23:45:22.382 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-10T23:45:22.382 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-10T23:45:22.382 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-10T23:45:22.382 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-10T23:45:22.382 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-10T23:45:22.382 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-10T23:45:22.382 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-10T23:45:22.382 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-10T23:45:22.382 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-10T23:45:22.382 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-10T23:45:22.382 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-10T23:45:22.382 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-10T23:45:22.382 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-10T23:45:22.383 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-10T23:45:22.383 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-10T23:45:22.383 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-10T23:45:22.383 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-10T23:45:22.383 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-10T23:45:22.383 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-10T23:45:22.383 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-10T23:45:22.383 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-10T23:45:22.383 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-10T23:45:22.383 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-10T23:45:22.383 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-10T23:45:22.383 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-10T23:45:22.383 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-10T23:45:22.384 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-10T23:45:22.384 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-10T23:45:22.384 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-10T23:45:22.384 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-10T23:45:22.384 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-10T23:45:22.384 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-10T23:45:22.384 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-10T23:45:22.384 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-10T23:45:22.384 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-10T23:45:22.384 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-10T23:45:22.384 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-10T23:45:22.384 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-10T23:45:22.384 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-10T23:45:22.384 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-10T23:45:22.385 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-10T23:45:22.385 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-10T23:45:22.385 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-10T23:45:22.385 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-10T23:45:22.385 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-10T23:45:22.385 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-10T23:45:22.385 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-10T23:45:22.385 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-10T23:45:22.385 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-10T23:45:22.385 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-10T23:45:22.385 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-10T23:45:22.385 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-10T23:45:22.385 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-10T23:45:22.386 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-10T23:45:22.386 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-10T23:45:22.386 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-10T23:45:22.386 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-10T23:45:22.386 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-10T23:45:22.386 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-10T23:45:22.386 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-10T23:45:22.386 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-10T23:45:22.386 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-10T23:45:22.386 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-10T23:45:22.386 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-10T23:45:22.386 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-10T23:45:22.386 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-10T23:45:22.387 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-10T23:45:22.387 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-10T23:45:22.387 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-10T23:45:22.387 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-10T23:45:22.387 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-10T23:45:22.387 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-10T23:45:22.387 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-10T23:45:22.387 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-10T23:45:22.387 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-10T23:45:22.387 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-10T23:45:22.387 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-10T23:45:22.387 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-10T23:45:22.387 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-10T23:45:22.388 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-10T23:45:22.388 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-10T23:45:22.388 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-10T23:45:22.388 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-10T23:45:22.388 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-10T23:45:22.388 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-10T23:45:22.388 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-10T23:45:22.388 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-10T23:45:22.388 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-10T23:45:22.388 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-10T23:45:22.388 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-10T23:45:22.388 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-10T23:45:22.388 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-10T23:45:22.389 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-10T23:45:22.389 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-10T23:45:22.389 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-10T23:45:22.389 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-10T23:45:22.389 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-10T23:45:22.389 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-10T23:45:22.389 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-10T23:45:22.389 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-10T23:45:22.389 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-10T23:45:22.389 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-10T23:45:22.389 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-10T23:45:22.389 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-10T23:45:22.389 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-10T23:45:22.390 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-10T23:45:22.390 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-10T23:45:22.390 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-10T23:45:22.390 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-10T23:45:22.390 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-10T23:45:22.390 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-10T23:45:22.390 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-10T23:45:22.390 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-10T23:45:22.390 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-10T23:45:22.390 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-10T23:45:22.390 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-10T23:45:22.390 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-10T23:45:22.390 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-10T23:45:22.391 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-10T23:45:22.391 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-10T23:45:22.391 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-10T23:45:22.391 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-10T23:45:22.391 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-10T23:45:22.391 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-10T23:45:22.391 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-10T23:45:22.391 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-10T23:45:22.391 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-10T23:45:22.391 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-10T23:45:22.391 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-10T23:45:22.391 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-10T23:45:22.391 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-10T23:45:22.392 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-10T23:45:22.392 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-10T23:45:22.392 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-10T23:45:22.392 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-10T23:45:22.392 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-10T23:45:22.392 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-10T23:45:22.392 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-10T23:45:22.392 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-10T23:45:22.392 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-10T23:45:22.392 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-10T23:45:22.392 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-10T23:45:22.392 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-10T23:45:22.392 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-10T23:45:22.392 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-10T23:45:22.393 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-10T23:45:22.393 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-10T23:45:22.393 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-10T23:45:22.393 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-10T23:45:22.393 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-10T23:45:22.393 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-10T23:45:22.393 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-10T23:45:22.393 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-10T23:45:22.393 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-10T23:45:22.393 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-10T23:45:22.393 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-10T23:45:22.393 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-10T23:45:22.393 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-10T23:45:22.394 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-10T23:45:22.394 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-10T23:45:22.394 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-10T23:45:22.394 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-10T23:45:22.394 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-10T23:45:22.394 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-10T23:45:22.394 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-10T23:45:22.394 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-10T23:45:22.394 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-10T23:45:22.394 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-10T23:45:22.394 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-10T23:45:22.394 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-10T23:45:22.394 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-10T23:45:22.394 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-10T23:45:22.395 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-10T23:45:22.395 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-10T23:45:22.395 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-10T23:45:22.395 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-10T23:45:22.395 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-10T23:45:22.395 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-10T23:45:22.395 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-10T23:45:22.395 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-10T23:45:22.395 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-10T23:45:22.395 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-10T23:45:22.395 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-10T23:45:22.395 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-10T23:45:22.395 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-10T23:45:22.395 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-10T23:45:22.396 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-10T23:45:22.396 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-10T23:45:22.396 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-10T23:45:22.396 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-10T23:45:22.396 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-10T23:45:22.396 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-10T23:45:22.396 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-10T23:45:22.396 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-10T23:45:22.396 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-10T23:45:22.396 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-10T23:45:22.396 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-10T23:45:22.396 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-10T23:45:22.397 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-10T23:45:22.397 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-10T23:45:22.397 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-10T23:45:22.397 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-10T23:45:22.397 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-10T23:45:22.397 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-10T23:45:22.397 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-10T23:45:22.397 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-10T23:45:22.397 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-10T23:45:22.397 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-10T23:45:22.397 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-10T23:45:22.397 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-10T23:45:22.397 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-10T23:45:22.398 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-10T23:45:22.398 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-10T23:45:22.398 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-10T23:45:22.398 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-10T23:45:22.398 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-10T23:45:22.398 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-10T23:45:22.398 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-10T23:45:22.398 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-10T23:45:22.398 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-10T23:45:22.398 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-10T23:45:22.398 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-10T23:45:22.398 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-10T23:45:22.398 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-10T23:45:22.399 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-10T23:45:22.399 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-10T23:45:22.399 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-10T23:45:22.399 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-10T23:45:22.399 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-10T23:45:22.399 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-10T23:45:22.399 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-10T23:45:22.399 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-10T23:45:22.399 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-10T23:45:22.399 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-10T23:45:22.399 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-10T23:45:22.399 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-10T23:45:22.399 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-10T23:45:22.400 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-10T23:45:22.400 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-10T23:45:22.400 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-10T23:45:22.400 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-10T23:45:22.400 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-10T23:45:22.400 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-10T23:45:22.400 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-10T23:45:22.400 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-10T23:45:22.400 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-10T23:45:22.400 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-10T23:45:22.400 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-10T23:45:22.400 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-10T23:45:22.400 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-10T23:45:22.400 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-10T23:45:22.401 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-10T23:45:22.401 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-10T23:45:22.401 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-10T23:45:22.401 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-10T23:45:22.401 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-10T23:45:22.401 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-10T23:45:22.401 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-10T23:45:22.401 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-10T23:45:22.401 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-10T23:45:22.401 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-10T23:45:22.401 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-10T23:45:22.401 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-10T23:45:22.401 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-10T23:45:22.401 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-10T23:45:22.401 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-10T23:45:22.402 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-10T23:45:22.402 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-10T23:45:22.402 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-10T23:45:22.402 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-10T23:45:22.402 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-10T23:45:22.402 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-10T23:45:22.402 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-10T23:45:22.402 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-10T23:45:22.402 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-10T23:45:22.402 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-10T23:45:22.402 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-10T23:45:22.402 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-10T23:45:22.402 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-10T23:45:22.403 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-10T23:45:22.403 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-10T23:45:22.403 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-10T23:45:22.403 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-10T23:45:22.403 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-10T23:45:22.403 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-10T23:45:22.403 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-10T23:45:22.403 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-10T23:45:22.403 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-10T23:45:22.403 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-10T23:45:22.403 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-10T23:45:22.403 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-10T23:45:22.403 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-10T23:45:22.403 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-10T23:45:22.404 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-10T23:45:22.404 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-10T23:45:22.404 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-10T23:45:22.404 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-10T23:45:22.404 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-10T23:45:22.404 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-10T23:45:22.404 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-10T23:45:22.404 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-10T23:45:22.404 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-10T23:45:22.404 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-10T23:45:22.404 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-10T23:45:22.404 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-10T23:45:22.404 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-10T23:45:22.404 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-10T23:45:22.404 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-10T23:45:22.405 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-10T23:45:22.405 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-10T23:45:22.405 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-10T23:45:22.405 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-10T23:45:22.405 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-10T23:45:22.405 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-10T23:45:22.405 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-10T23:45:22.405 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-10T23:45:22.405 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-10T23:45:22.405 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-10T23:45:22.405 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-10T23:45:22.405 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-10T23:45:22.405 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-10T23:45:22.405 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-10T23:45:22.406 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-10T23:45:22.406 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-10T23:45:22.406 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-10T23:45:22.406 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-10T23:45:22.406 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-10T23:45:22.406 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-10T23:45:22.406 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-10T23:45:22.406 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-10T23:45:22.406 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-10T23:45:22.406 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-10T23:45:22.406 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-10T23:45:22.406 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-10T23:45:22.406 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-10T23:45:22.406 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-10T23:45:22.407 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-10T23:45:22.407 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-10T23:45:22.407 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-10T23:45:22.407 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-10T23:45:22.407 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-10T23:45:22.407 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-10T23:45:22.407 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-10T23:45:22.407 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-10T23:45:22.407 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-10T23:45:22.407 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-10T23:45:22.407 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-10T23:45:22.407 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-10T23:45:22.408 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-10T23:45:22.408 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-10T23:45:22.408 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-10T23:45:22.408 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-10T23:45:22.408 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-10T23:45:22.408 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-10T23:45:22.408 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-10T23:45:22.408 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-10T23:45:22.408 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-10T23:45:22.408 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-10T23:45:22.408 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-10T23:45:22.408 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-10T23:45:22.408 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-10T23:45:22.409 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-10T23:45:22.409 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-10T23:45:22.409 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-10T23:45:22.409 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-10T23:45:22.409 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-10T23:45:22.409 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-10T23:45:22.409 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-10T23:45:22.409 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-10T23:45:22.409 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-10T23:45:22.409 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-10T23:45:22.409 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-10T23:45:22.409 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-10T23:45:22.409 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-10T23:45:22.409 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-10T23:45:22.410 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-10T23:45:22.410 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-10T23:45:22.410 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-10T23:45:22.410 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-10T23:45:22.410 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-10T23:45:22.410 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-10T23:45:22.410 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-10T23:45:22.410 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-10T23:45:22.410 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-10T23:45:22.410 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-10T23:45:22.410 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-10T23:45:22.410 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-10T23:45:22.410 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-10T23:45:22.410 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-10T23:45:22.411 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-10T23:45:22.411 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-10T23:45:22.411 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-10T23:45:22.411 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-10T23:45:22.411 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-10T23:45:22.411 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-10T23:45:22.411 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-10T23:45:22.411 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-10T23:45:22.411 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-10T23:45:22.411 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-10T23:45:22.411 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-10T23:45:22.411 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-10T23:45:22.411 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-10T23:45:22.412 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-10T23:45:22.412 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-10T23:45:22.412 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-10T23:45:22.412 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-10T23:45:22.412 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-10T23:45:22.412 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-10T23:45:22.412 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-10T23:45:22.412 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-10T23:45:22.412 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-10T23:45:22.412 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-10T23:45:22.412 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-10T23:45:22.412 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-10T23:45:22.412 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-10T23:45:22.412 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-10T23:45:22.413 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-10T23:45:22.413 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-10T23:45:22.413 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-10T23:45:22.413 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-10T23:45:22.413 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-10T23:45:22.413 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-10T23:45:22.413 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-10T23:45:22.413 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-10T23:45:22.413 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-10T23:45:22.413 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-10T23:45:22.413 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-10T23:45:22.413 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-10T23:45:22.413 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-10T23:45:22.414 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-10T23:45:22.414 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-10T23:45:22.414 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-10T23:45:22.414 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-10T23:45:22.414 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-10T23:45:22.414 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-10T23:45:22.414 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-10T23:45:22.414 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-10T23:45:22.414 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-10T23:45:22.414 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-10T23:45:22.414 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-10T23:45:22.414 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-10T23:45:22.414 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-10T23:45:22.414 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-10T23:45:22.414 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-10T23:45:22.415 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-10T23:45:22.415 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-10T23:45:22.415 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-10T23:45:22.415 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-10T23:45:22.415 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-10T23:45:22.415 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-10T23:45:22.415 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-10T23:45:22.415 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-10T23:45:22.415 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-10T23:45:22.415 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-10T23:45:22.415 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-10T23:45:22.415 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-10T23:45:22.415 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-10T23:45:22.416 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-10T23:45:22.416 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-10T23:45:22.416 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-10T23:45:22.416 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-10T23:45:22.416 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-10T23:45:22.416 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-10T23:45:22.416 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-10T23:45:22.416 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-10T23:45:22.416 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-10T23:45:22.416 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-10T23:45:22.416 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-10T23:45:22.416 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-10T23:45:22.416 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-10T23:45:22.417 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-10T23:45:22.417 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-10T23:45:22.417 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-10T23:45:22.417 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-10T23:45:22.417 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-10T23:45:22.417 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-10T23:45:22.417 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-10T23:45:22.417 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-10T23:45:22.417 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-10T23:45:22.417 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-10T23:45:22.417 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-10T23:45:22.417 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-10T23:45:22.417 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-10T23:45:22.418 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-10T23:45:22.418 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-10T23:45:22.418 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-10T23:45:22.418 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-10T23:45:22.418 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-10T23:45:22.418 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-10T23:45:22.418 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-10T23:45:22.418 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-10T23:45:22.418 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-10T23:45:22.418 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-10T23:45:22.418 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-10T23:45:22.418 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-10T23:45:22.418 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-10T23:45:22.418 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-10T23:45:22.419 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-10T23:45:22.419 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-10T23:45:22.419 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-10T23:45:22.419 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-10T23:45:22.419 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-10T23:45:22.419 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-10T23:45:22.419 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-10T23:45:22.419 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-10T23:45:22.419 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-10T23:45:22.419 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-10T23:45:22.419 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-10T23:45:22.419 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-10T23:45:22.419 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-10T23:45:22.419 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-10T23:45:22.420 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-10T23:45:22.420 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-10T23:45:22.420 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-10T23:45:22.420 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-10T23:45:22.420 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-10T23:45:22.420 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-10T23:45:22.420 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-10T23:45:22.420 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-10T23:45:22.420 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-10T23:45:22.420 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-10T23:45:22.420 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-10T23:45:22.420 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-10T23:45:22.420 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-10T23:45:22.421 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-10T23:45:22.421 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-10T23:45:22.421 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-10T23:45:22.421 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-10T23:45:22.421 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-10T23:45:22.421 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-10T23:45:22.421 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-10T23:45:22.421 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-10T23:45:22.421 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-10T23:45:22.421 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-10T23:45:22.421 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-10T23:45:22.421 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-10T23:45:22.421 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-10T23:45:22.422 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-10T23:45:22.422 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-10T23:45:22.422 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-10T23:45:22.422 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-10T23:45:22.422 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-10T23:45:22.422 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-10T23:45:22.422 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-10T23:45:22.422 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-10T23:45:22.422 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-10T23:45:22.422 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-10T23:45:22.422 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-10T23:45:22.422 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-10T23:45:22.422 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-10T23:45:22.423 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-10T23:45:22.423 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-10T23:45:22.423 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-10T23:45:22.423 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-10T23:45:22.423 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-10T23:45:22.423 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-10T23:45:22.423 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-10T23:45:22.423 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-10T23:45:22.423 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-10T23:45:22.423 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-10T23:45:22.423 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-10T23:45:22.423 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-10T23:45:22.424 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-10T23:45:22.424 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-10T23:45:22.424 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-10T23:45:22.424 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-10T23:45:22.424 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-10T23:45:22.424 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-10T23:45:22.424 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-10T23:45:22.424 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-10T23:45:22.424 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-10T23:45:22.424 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-10T23:45:22.424 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-10T23:45:22.424 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-10T23:45:22.424 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-10T23:45:22.424 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-10T23:45:22.425 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-10T23:45:22.425 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-10T23:45:22.425 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-10T23:45:22.425 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-10T23:45:22.425 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-10T23:45:22.425 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-10T23:45:22.425 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-10T23:45:22.425 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-10T23:45:22.425 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-10T23:45:22.425 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-10T23:45:22.425 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-10T23:45:22.425 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-10T23:45:22.425 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-10T23:45:22.426 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-10T23:45:22.426 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-10T23:45:22.426 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-10T23:45:22.426 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-10T23:45:22.426 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-10T23:45:22.426 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-10T23:45:22.426 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-10T23:45:22.426 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-10T23:45:22.426 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-10T23:45:22.426 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-10T23:45:22.426 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-10T23:45:22.426 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-10T23:45:22.426 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-10T23:45:22.427 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-10T23:45:22.427 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-10T23:45:22.427 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-10T23:45:22.427 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-10T23:45:22.427 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-10T23:45:22.427 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-10T23:45:22.427 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-10T23:45:22.427 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-10T23:45:22.427 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-10T23:45:22.427 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-10T23:45:22.427 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-10T23:45:22.427 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-10T23:45:22.427 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-10T23:45:22.428 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-10T23:45:22.428 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-10T23:45:22.428 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-10T23:45:22.428 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-10T23:45:22.428 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-10T23:45:22.428 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-10T23:45:22.428 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-10T23:45:22.428 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-10T23:45:22.428 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-10T23:45:22.428 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-10T23:45:22.428 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-10T23:45:22.428 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-10T23:45:22.428 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-10T23:45:22.428 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-10T23:45:22.429 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-10T23:45:22.429 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-10T23:45:22.429 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-10T23:45:22.429 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-10T23:45:22.429 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-10T23:45:22.429 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-10T23:45:22.429 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-10T23:45:22.429 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-10T23:45:22.429 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-10T23:45:22.429 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-10T23:45:22.429 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-10T23:45:22.429 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-10T23:45:22.429 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-10T23:45:22.430 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-10T23:45:22.430 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-10T23:45:22.430 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-10T23:45:22.430 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-10T23:45:22.430 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-10T23:45:22.430 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-10T23:45:22.430 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-10T23:45:22.430 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-10T23:45:22.430 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-10T23:45:22.430 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-10T23:45:22.430 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-10T23:45:22.430 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-10T23:45:22.430 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-10T23:45:22.431 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-10T23:45:22.431 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-10T23:45:22.431 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-10T23:45:22.431 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-10T23:45:22.431 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-10T23:45:22.431 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-10T23:45:22.431 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-10T23:45:22.431 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-10T23:45:22.431 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-10T23:45:22.431 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-10T23:45:22.431 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-10T23:45:22.431 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-10T23:45:22.431 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-10T23:45:22.432 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-10T23:45:22.432 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-10T23:45:22.432 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-10T23:45:22.432 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-10T23:45:22.432 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-10T23:45:22.432 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-10T23:45:22.432 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-10T23:45:22.432 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-10T23:45:22.432 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-10T23:45:22.432 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-10T23:45:22.432 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-10T23:45:22.432 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-10T23:45:22.432 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-10T23:45:22.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-10T23:45:22.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-10T23:45:22.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-10T23:45:22.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-10T23:45:22.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-10T23:45:22.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-10T23:45:22.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-10T23:45:22.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-10T23:45:22.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-10T23:45:22.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-10T23:45:22.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-10T23:45:22.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-10T23:45:22.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-10T23:45:22.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-10T23:45:22.434 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-10T23:45:22.434 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-10T23:45:22.434 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-10T23:45:22.434 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-10T23:45:22.434 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-10T23:45:22.434 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-10T23:45:22.434 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-10T23:45:22.434 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-10T23:45:22.434 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-10T23:45:22.434 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-10T23:45:22.434 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-10T23:45:22.434 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-10T23:45:22.434 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-10T23:45:22.435 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-10T23:45:22.435 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-10T23:45:22.435 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-10T23:45:22.435 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-10T23:45:22.435 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-10T23:45:22.435 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-10T23:45:22.435 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-10T23:45:22.435 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-10T23:45:22.435 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-10T23:45:22.435 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-10T23:45:22.435 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-10T23:45:22.435 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-10T23:45:22.435 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-10T23:45:22.436 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-10T23:45:22.436 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-10T23:45:22.436 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-10T23:45:22.436 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-10T23:45:22.436 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-10T23:45:22.436 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-10T23:45:22.436 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-10T23:45:22.436 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-10T23:45:22.436 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-10T23:45:22.436 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-10T23:45:22.436 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-10T23:45:22.436 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-10T23:45:22.436 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-10T23:45:22.437 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-10T23:45:22.437 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-10T23:45:22.437 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-10T23:45:22.437 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-10T23:45:22.437 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-10T23:45:22.437 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-10T23:45:22.437 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-10T23:45:22.437 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-10T23:45:22.437 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-10T23:45:22.437 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-10T23:45:22.437 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-10T23:45:22.437 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-10T23:45:22.437 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-10T23:45:22.438 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-10T23:45:22.438 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-10T23:45:22.438 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-10T23:45:22.438 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-10T23:45:22.438 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-10T23:45:22.438 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-10T23:45:22.438 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-10T23:45:22.438 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-10T23:45:22.438 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-10T23:45:22.438 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-10T23:45:22.438 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-10T23:45:22.438 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-10T23:45:22.439 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-10T23:45:22.439 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-10T23:45:22.439 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-10T23:45:22.439 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-10T23:45:22.439 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-10T23:45:22.439 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-10T23:45:22.439 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-10T23:45:22.439 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-10T23:45:22.439 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-10T23:45:22.439 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-10T23:45:22.439 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-10T23:45:22.439 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-10T23:45:22.439 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-10T23:45:22.440 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-10T23:45:22.440 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-10T23:45:22.440 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-10T23:45:22.440 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-10T23:45:22.440 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-10T23:45:22.440 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-10T23:45:22.440 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-10T23:45:22.440 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-10T23:45:22.440 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-10T23:45:22.440 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-10T23:45:22.440 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-10T23:45:22.440 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-10T23:45:22.441 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-10T23:45:22.441 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-10T23:45:22.441 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-10T23:45:22.441 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-10T23:45:22.441 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-10T23:45:22.441 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-10T23:45:22.441 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-10T23:45:22.441 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-10T23:45:22.441 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-10T23:45:22.441 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-10T23:45:22.441 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-10T23:45:22.441 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-10T23:45:22.441 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-10T23:45:22.442 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-10T23:45:22.442 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-10T23:45:22.442 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-10T23:45:22.442 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-10T23:45:22.442 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-10T23:45:22.442 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-10T23:45:22.442 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-10T23:45:22.442 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-10T23:45:22.442 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-10T23:45:22.442 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-10T23:45:22.442 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-10T23:45:22.442 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-10T23:45:22.442 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-10T23:45:22.442 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-10T23:45:22.442 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-10T23:45:22.443 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-10T23:45:22.443 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-10T23:45:22.443 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-10T23:45:22.443 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-10T23:45:22.443 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-10T23:45:22.443 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-10T23:45:22.443 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-10T23:45:22.443 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-10T23:45:22.443 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-10T23:45:22.443 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-10T23:45:22.443 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-10T23:45:22.443 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-10T23:45:22.443 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-10T23:45:22.443 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-10T23:45:22.444 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-10T23:45:22.444 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-10T23:45:22.444 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-10T23:45:22.444 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-10T23:45:22.444 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-10T23:45:22.444 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-10T23:45:22.444 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-10T23:45:22.444 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-10T23:45:22.444 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-10T23:45:22.444 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-10T23:45:22.444 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-10T23:45:22.444 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-10T23:45:22.444 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-10T23:45:22.444 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-10T23:45:22.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-10T23:45:22.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-10T23:45:22.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-10T23:45:22.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-10T23:45:22.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-10T23:45:22.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-10T23:45:22.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-10T23:45:22.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-10T23:45:22.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-10T23:45:22.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-10T23:45:22.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-10T23:45:22.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-10T23:45:22.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-10T23:45:22.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-10T23:45:22.446 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-10T23:45:22.446 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-10T23:45:22.446 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-10T23:45:22.446 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-10T23:45:22.446 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-10T23:45:22.446 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-10T23:45:22.446 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-10T23:45:22.446 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-10T23:45:22.446 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-10T23:45:22.446 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-10T23:45:22.446 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-10T23:45:22.446 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-10T23:45:22.447 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-10T23:45:22.447 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-10T23:45:22.447 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-10T23:45:22.447 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-10T23:45:22.447 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-10T23:45:22.447 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-10T23:45:22.447 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-10T23:45:22.447 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-10T23:45:22.447 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-10T23:45:22.447 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-10T23:45:22.447 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-10T23:45:22.447 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-10T23:45:22.447 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-10T23:45:22.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-10T23:45:22.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-10T23:45:22.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-10T23:45:22.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-10T23:45:22.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-10T23:45:22.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-10T23:45:22.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-10T23:45:22.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-10T23:45:22.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-10T23:45:22.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-10T23:45:22.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-10T23:45:22.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-10T23:45:22.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-10T23:45:22.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-10T23:45:22.449 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-10T23:45:22.449 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-10T23:45:22.449 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-10T23:45:22.449 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-10T23:45:22.449 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-10T23:45:22.449 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-10T23:45:22.449 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-10T23:45:22.449 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-10T23:45:22.449 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-10T23:45:22.449 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-10T23:45:22.449 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-10T23:45:22.449 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-10T23:45:22.449 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-10T23:45:22.450 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-10T23:45:22.450 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-10T23:45:22.450 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-10T23:45:22.450 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-10T23:45:22.450 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-10T23:45:22.450 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-10T23:45:22.450 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-10T23:45:22.450 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-10T23:45:22.450 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-10T23:45:22.450 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-10T23:45:22.450 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-10T23:45:22.450 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-10T23:45:22.450 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-10T23:45:22.451 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-10T23:45:22.451 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-10T23:45:22.451 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-10T23:45:22.451 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-10T23:45:22.451 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-10T23:45:22.451 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-10T23:45:22.451 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-10T23:45:22.451 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-10T23:45:22.451 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-10T23:45:22.451 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-10T23:45:22.451 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-10T23:45:22.451 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-10T23:45:22.451 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-10T23:45:22.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-10T23:45:22.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-10T23:45:22.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-10T23:45:22.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-10T23:45:22.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-10T23:45:22.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-10T23:45:22.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-10T23:45:22.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-10T23:45:22.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-10T23:45:22.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-10T23:45:22.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-10T23:45:22.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-10T23:45:22.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-10T23:45:22.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-10T23:45:22.453 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-10T23:45:22.453 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-10T23:45:22.453 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-10T23:45:22.453 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-10T23:45:22.453 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-10T23:45:22.453 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-10T23:45:22.453 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-10T23:45:22.453 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-10T23:45:22.453 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-10T23:45:22.453 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-10T23:45:22.453 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-10T23:45:22.453 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-10T23:45:22.453 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-10T23:45:22.454 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-10T23:45:22.454 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-10T23:45:22.454 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-10T23:45:22.454 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-10T23:45:22.454 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-10T23:45:22.454 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-10T23:45:22.454 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-10T23:45:22.454 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-10T23:45:22.454 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-10T23:45:22.454 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-10T23:45:22.454 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-10T23:45:22.454 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-10T23:45:22.454 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-10T23:45:22.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-10T23:45:22.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-10T23:45:22.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-10T23:45:22.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-10T23:45:22.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-10T23:45:22.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-10T23:45:22.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-10T23:45:22.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-10T23:45:22.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-10T23:45:22.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-10T23:45:22.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-10T23:45:22.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-10T23:45:22.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-10T23:45:22.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-10T23:45:22.456 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-10T23:45:22.456 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-10T23:45:22.456 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-10T23:45:22.456 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-10T23:45:22.456 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-10T23:45:22.456 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-10T23:45:22.456 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-10T23:45:22.456 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-10T23:45:22.456 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-10T23:45:22.456 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-10T23:45:22.456 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-10T23:45:22.456 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-10T23:45:22.456 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-10T23:45:22.457 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-10T23:45:22.457 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-10T23:45:22.457 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-10T23:45:22.457 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-10T23:45:22.457 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-10T23:45:22.457 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-10T23:45:22.457 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-10T23:45:22.457 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-10T23:45:22.457 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-10T23:45:22.457 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-10T23:45:22.457 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-10T23:45:22.457 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-10T23:45:22.457 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-10T23:45:22.458 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-10T23:45:22.458 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-10T23:45:22.458 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-10T23:45:22.458 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-10T23:45:22.458 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-10T23:45:22.458 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-10T23:45:22.458 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-10T23:45:22.458 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-10T23:45:22.458 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-10T23:45:22.458 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-10T23:45:22.458 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-10T23:45:22.458 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-10T23:45:22.458 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-10T23:45:22.458 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-10T23:45:22.459 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-10T23:45:22.459 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-10T23:45:22.459 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-10T23:45:22.459 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-10T23:45:22.459 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-10T23:45:22.459 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-10T23:45:22.459 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-10T23:45:22.459 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-10T23:45:22.459 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-10T23:45:22.459 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-10T23:45:22.459 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-10T23:45:22.459 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-10T23:45:22.459 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-10T23:45:22.460 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-10T23:45:22.460 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-10T23:45:22.460 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-10T23:45:22.460 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-10T23:45:22.460 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-10T23:45:22.460 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-10T23:45:22.460 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-10T23:45:22.460 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-10T23:45:22.460 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-10T23:45:22.460 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-10T23:45:22.460 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-10T23:45:22.460 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-10T23:45:22.460 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-10T23:45:22.461 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-10T23:45:22.461 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-10T23:45:22.461 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-10T23:45:22.461 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-10T23:45:22.461 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-10T23:45:22.461 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-10T23:45:22.461 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-10T23:45:22.461 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-10T23:45:22.461 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-10T23:45:22.461 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-10T23:45:22.461 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-10T23:45:22.461 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-10T23:45:22.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-10T23:45:22.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-10T23:45:22.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-10T23:45:22.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-10T23:45:22.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-10T23:45:22.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-10T23:45:22.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-10T23:45:22.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-10T23:45:22.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-10T23:45:22.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-10T23:45:22.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-10T23:45:22.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-10T23:45:22.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-10T23:45:22.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-10T23:45:22.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-10T23:45:22.463 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-10T23:45:22.463 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-10T23:45:22.463 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-10T23:45:22.463 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-10T23:45:22.463 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-10T23:45:22.463 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-10T23:45:22.463 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-10T23:45:22.463 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-10T23:45:22.463 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-10T23:45:22.463 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-10T23:45:22.463 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-10T23:45:22.463 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-10T23:45:22.463 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-10T23:45:22.463 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-10T23:45:22.464 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-10T23:45:22.464 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-10T23:45:22.464 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-10T23:45:22.464 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-10T23:45:22.464 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-10T23:45:22.464 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-10T23:45:22.464 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-10T23:45:22.464 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-10T23:45:22.464 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-10T23:45:22.464 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-10T23:45:22.464 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-10T23:45:22.464 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-10T23:45:22.465 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-10T23:45:22.465 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-10T23:45:22.465 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-10T23:45:22.465 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-10T23:45:22.465 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-10T23:45:22.465 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-10T23:45:22.465 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-10T23:45:22.465 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-10T23:45:22.465 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-10T23:45:22.465 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-10T23:45:22.465 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-10T23:45:22.465 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-10T23:45:22.465 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-10T23:45:22.466 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-10T23:45:22.466 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-10T23:45:22.466 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-10T23:45:22.466 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-10T23:45:22.466 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-10T23:45:22.466 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-10T23:45:22.466 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-10T23:45:22.466 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-10T23:45:22.466 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-10T23:45:22.466 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-10T23:45:22.466 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-10T23:45:22.466 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-10T23:45:22.466 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-10T23:45:22.466 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-10T23:45:22.467 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-10T23:45:22.467 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-10T23:45:22.467 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-10T23:45:22.467 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-10T23:45:22.467 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-10T23:45:22.467 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-10T23:45:22.467 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-10T23:45:22.467 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-10T23:45:22.467 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-10T23:45:22.467 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-10T23:45:22.467 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-10T23:45:22.467 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-10T23:45:22.467 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-10T23:45:22.467 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-10T23:45:22.468 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-10T23:45:22.468 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-10T23:45:22.468 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-10T23:45:22.468 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-10T23:45:22.468 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-10T23:45:22.468 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-10T23:45:22.468 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-10T23:45:22.468 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-10T23:45:22.468 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-10T23:45:22.468 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-10T23:45:22.468 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-10T23:45:22.468 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-10T23:45:22.468 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-10T23:45:22.469 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-10T23:45:22.469 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-10T23:45:22.469 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-10T23:45:22.469 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-10T23:45:22.469 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-10T23:45:22.469 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-10T23:45:22.469 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-10T23:45:22.469 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-10T23:45:22.469 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-10T23:45:22.469 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-10T23:45:22.469 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-10T23:45:22.469 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-10T23:45:22.469 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-10T23:45:22.469 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-10T23:45:22.470 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-10T23:45:22.470 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-10T23:45:22.470 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-10T23:45:22.470 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-10T23:45:22.470 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-10T23:45:22.470 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-10T23:45:22.470 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-10T23:45:22.470 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-10T23:45:22.470 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-10T23:45:22.470 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-10T23:45:22.470 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-10T23:45:22.470 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-10T23:45:22.470 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-10T23:45:22.470 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-10T23:45:22.470 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-10T23:45:22.471 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-10T23:45:22.471 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-10T23:45:22.471 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-10T23:45:22.471 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-10T23:45:22.471 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-10T23:45:22.471 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-10T23:45:22.471 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-10T23:45:22.471 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-10T23:45:22.471 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-10T23:45:22.471 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-10T23:45:22.471 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-10T23:45:22.471 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-10T23:45:22.471 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-10T23:45:22.471 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-10T23:45:22.472 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-10T23:45:22.472 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-10T23:45:22.472 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-10T23:45:22.472 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-10T23:45:22.472 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-10T23:45:22.472 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-10T23:45:22.472 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-10T23:45:22.472 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-10T23:45:22.472 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-10T23:45:22.472 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-10T23:45:22.472 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-10T23:45:22.472 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-10T23:45:22.472 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-10T23:45:22.473 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-10T23:45:22.473 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-10T23:45:22.473 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-10T23:45:22.473 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-10T23:45:22.473 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-10T23:45:22.473 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-10T23:45:22.473 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-10T23:45:22.473 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-10T23:45:22.473 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-10T23:45:22.473 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-10T23:45:22.473 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-10T23:45:22.473 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-10T23:45:22.473 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-10T23:45:22.473 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-10T23:45:22.474 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-10T23:45:22.474 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-10T23:45:22.474 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-10T23:45:22.474 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-10T23:45:22.474 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-10T23:45:22.474 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-10T23:45:22.474 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-10T23:45:22.474 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-10T23:45:22.474 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-10T23:45:22.474 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-10T23:45:22.474 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-10T23:45:22.474 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-10T23:45:22.474 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-10T23:45:22.474 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-10T23:45:22.475 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-10T23:45:22.475 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-10T23:45:22.475 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-10T23:45:22.475 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-10T23:45:22.475 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-10T23:45:22.475 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-10T23:45:22.475 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-10T23:45:22.475 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-10T23:45:22.475 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-10T23:45:22.475 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-10T23:45:22.475 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-10T23:45:22.475 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-10T23:45:22.475 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-10T23:45:22.475 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-10T23:45:22.475 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-10T23:45:22.476 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-10T23:45:22.476 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-10T23:45:22.476 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-10T23:45:22.476 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-10T23:45:22.476 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-10T23:45:22.476 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-10T23:45:22.476 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-10T23:45:22.476 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-10T23:45:22.476 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-10T23:45:22.476 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-10T23:45:22.476 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-10T23:45:22.476 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-10T23:45:22.476 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-10T23:45:22.477 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-10T23:45:22.477 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-10T23:45:22.477 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-10T23:45:22.477 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-10T23:45:22.477 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-10T23:45:22.477 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-10T23:45:22.477 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-10T23:45:22.477 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-10T23:45:22.477 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-10T23:45:22.477 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-10T23:45:22.477 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-10T23:45:22.477 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-10T23:45:22.477 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-10T23:45:22.478 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-10T23:45:22.478 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-10T23:45:22.478 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-10T23:45:22.478 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-10T23:45:22.478 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-10T23:45:22.478 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-10T23:45:22.478 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-10T23:45:22.478 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-10T23:45:22.478 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-10T23:45:22.478 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-10T23:45:22.478 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-10T23:45:22.478 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-10T23:45:22.478 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-10T23:45:22.478 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-10T23:45:22.479 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-10T23:45:22.479 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-10T23:45:22.479 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-10T23:45:22.479 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-10T23:45:22.479 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-10T23:45:22.479 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-10T23:45:22.479 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-10T23:45:22.479 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-10T23:45:22.479 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-10T23:45:22.479 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-10T23:45:22.479 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-10T23:45:22.479 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-10T23:45:22.479 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-10T23:45:22.479 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-10T23:45:22.479 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-10T23:45:22.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-10T23:45:22.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-10T23:45:22.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-10T23:45:22.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-10T23:45:22.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-10T23:45:22.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-10T23:45:22.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-10T23:45:22.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-10T23:45:22.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-10T23:45:22.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-10T23:45:22.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-10T23:45:22.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-10T23:45:22.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-10T23:45:22.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-10T23:45:22.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-10T23:45:22.481 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-10T23:45:22.481 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-10T23:45:22.481 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-10T23:45:22.481 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-10T23:45:22.481 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-10T23:45:22.481 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-10T23:45:22.481 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-10T23:45:22.481 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-10T23:45:22.481 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-10T23:45:22.481 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-10T23:45:22.481 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-10T23:45:22.481 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-10T23:45:22.481 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-10T23:45:22.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-10T23:45:22.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-10T23:45:22.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-10T23:45:22.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-10T23:45:22.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-10T23:45:22.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-10T23:45:22.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-10T23:45:22.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-10T23:45:22.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-10T23:45:22.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-10T23:45:22.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-10T23:45:22.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-10T23:45:22.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-10T23:45:22.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-10T23:45:22.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-10T23:45:22.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-10T23:45:22.483 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-10T23:45:22.483 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-10T23:45:22.483 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-10T23:45:22.483 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-10T23:45:22.483 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-10T23:45:22.483 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-10T23:45:22.483 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-10T23:45:22.483 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-10T23:45:22.483 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-10T23:45:22.483 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-10T23:45:22.483 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-10T23:45:22.483 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-10T23:45:22.483 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-10T23:45:22.484 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-10T23:45:22.484 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-10T23:45:22.484 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-10T23:45:22.484 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-10T23:45:22.484 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-10T23:45:22.484 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-10T23:45:22.484 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-10T23:45:22.484 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-10T23:45:22.484 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-10T23:45:22.484 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-10T23:45:22.484 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-10T23:45:22.484 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-10T23:45:22.484 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-10T23:45:22.485 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-10T23:45:22.485 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-10T23:45:22.485 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-10T23:45:22.485 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-10T23:45:22.485 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-10T23:45:22.485 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-10T23:45:22.485 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-10T23:45:22.485 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-10T23:45:22.485 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-10T23:45:22.485 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-10T23:45:22.485 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-10T23:45:22.485 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-10T23:45:22.485 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-10T23:45:22.486 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-10T23:45:22.486 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-10T23:45:22.486 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-10T23:45:22.486 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-10T23:45:22.486 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-10T23:45:22.486 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-10T23:45:22.486 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-10T23:45:22.486 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-10T23:45:22.486 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-10T23:45:22.486 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-10T23:45:22.486 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-10T23:45:22.486 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-10T23:45:22.487 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-10T23:45:22.487 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-10T23:45:22.487 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-10T23:45:22.487 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-10T23:45:22.487 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-10T23:45:22.487 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-10T23:45:22.487 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-10T23:45:22.487 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-10T23:45:22.487 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-10T23:45:22.487 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-10T23:45:22.487 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-10T23:45:22.487 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-10T23:45:22.487 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-10T23:45:22.488 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-10T23:45:22.488 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-10T23:45:22.488 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-10T23:45:22.488 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-10T23:45:22.488 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-10T23:45:22.488 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-10T23:45:22.488 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-10T23:45:22.488 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-10T23:45:22.488 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-10T23:45:22.488 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-10T23:45:22.488 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-10T23:45:22.488 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-10T23:45:22.489 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-10T23:45:22.489 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-10T23:45:22.489 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-10T23:45:22.489 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-10T23:45:22.489 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-10T23:45:22.489 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-10T23:45:22.489 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-10T23:45:22.489 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-10T23:45:22.489 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-10T23:45:22.489 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-10T23:45:22.489 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-10T23:45:22.490 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-10T23:45:22.490 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-10T23:45:22.490 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-10T23:45:22.490 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-10T23:45:22.490 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-10T23:45:22.490 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-10T23:45:22.490 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-10T23:45:22.490 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-10T23:45:22.490 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-10T23:45:22.490 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-10T23:45:22.490 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-10T23:45:22.490 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-10T23:45:22.491 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-10T23:45:22.491 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-10T23:45:22.491 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-10T23:45:22.491 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-10T23:45:22.491 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-10T23:45:22.491 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-10T23:45:22.491 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-10T23:45:22.491 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-10T23:45:22.491 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-10T23:45:22.491 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-10T23:45:22.491 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-10T23:45:22.491 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-10T23:45:22.491 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-10T23:45:22.491 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-10T23:45:22.492 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-10T23:45:22.492 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-10T23:45:22.492 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-10T23:45:22.492 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-10T23:45:22.492 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-10T23:45:22.492 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-10T23:45:22.492 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-10T23:45:22.492 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T23:45:22.496 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:45:22.496 DEBUG:teuthology.orchestra.run.smithi203:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-10T23:45:22.520 INFO:teuthology.orchestra.run.smithi203.stdout:postinstall scriptlet (using /bin/sh): 2024-09-10T23:45:22.520 INFO:teuthology.orchestra.run.smithi203.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T23:45:22.520 INFO:teuthology.orchestra.run.smithi203.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T23:45:22.520 INFO:teuthology.orchestra.run.smithi203.stdout:fi 2024-09-10T23:45:22.520 INFO:teuthology.orchestra.run.smithi203.stdout:for file in vmlinuz System.map config; do 2024-09-10T23:45:22.520 INFO:teuthology.orchestra.run.smithi203.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-10T23:45:22.520 INFO:teuthology.orchestra.run.smithi203.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T23:45:22.521 INFO:teuthology.orchestra.run.smithi203.stdout: fi 2024-09-10T23:45:22.521 INFO:teuthology.orchestra.run.smithi203.stdout:done 2024-09-10T23:45:22.521 INFO:teuthology.orchestra.run.smithi203.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-10T23:45:22.521 INFO:teuthology.orchestra.run.smithi203.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-10T23:45:22.521 INFO:teuthology.orchestra.run.smithi203.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T23:45:22.521 INFO:teuthology.orchestra.run.smithi203.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T23:45:22.521 INFO:teuthology.orchestra.run.smithi203.stdout:fi 2024-09-10T23:45:22.521 INFO:teuthology.orchestra.run.smithi203.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-10T23:45:22.521 INFO:teuthology.orchestra.run.smithi203.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:45:22.521 INFO:teuthology.orchestra.run.smithi203.stdout:fi 2024-09-10T23:45:22.521 INFO:teuthology.orchestra.run.smithi203.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-10T23:45:22.521 INFO:teuthology.orchestra.run.smithi203.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T23:45:22.521 INFO:teuthology.orchestra.run.smithi203.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:45:22.522 INFO:teuthology.orchestra.run.smithi203.stdout:fi 2024-09-10T23:45:22.522 DEBUG:teuthology.orchestra.run.smithi203:> sudo rpm -qi grub2-tools 2024-09-10T23:45:22.597 INFO:teuthology.orchestra.run.smithi203.stdout:Name : grub2-tools 2024-09-10T23:45:22.597 INFO:teuthology.orchestra.run.smithi203.stdout:Epoch : 1 2024-09-10T23:45:22.597 INFO:teuthology.orchestra.run.smithi203.stdout:Version : 2.06 2024-09-10T23:45:22.597 INFO:teuthology.orchestra.run.smithi203.stdout:Release : 82.el9 2024-09-10T23:45:22.597 INFO:teuthology.orchestra.run.smithi203.stdout:Architecture: x86_64 2024-09-10T23:45:22.597 INFO:teuthology.orchestra.run.smithi203.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T23:45:22.597 INFO:teuthology.orchestra.run.smithi203.stdout:Group : Unspecified 2024-09-10T23:45:22.597 INFO:teuthology.orchestra.run.smithi203.stdout:Size : 8274670 2024-09-10T23:45:22.598 INFO:teuthology.orchestra.run.smithi203.stdout:License : GPLv3+ 2024-09-10T23:45:22.598 INFO:teuthology.orchestra.run.smithi203.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T23:45:22.598 INFO:teuthology.orchestra.run.smithi203.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T23:45:22.598 INFO:teuthology.orchestra.run.smithi203.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T23:45:22.598 INFO:teuthology.orchestra.run.smithi203.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T23:45:22.598 INFO:teuthology.orchestra.run.smithi203.stdout:Packager : builder@centos.org 2024-09-10T23:45:22.598 INFO:teuthology.orchestra.run.smithi203.stdout:Vendor : CentOS 2024-09-10T23:45:22.598 INFO:teuthology.orchestra.run.smithi203.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T23:45:22.598 INFO:teuthology.orchestra.run.smithi203.stdout:Summary : Support tools for GRUB. 2024-09-10T23:45:22.598 INFO:teuthology.orchestra.run.smithi203.stdout:Description : 2024-09-10T23:45:22.598 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:45:22.598 INFO:teuthology.orchestra.run.smithi203.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T23:45:22.598 INFO:teuthology.orchestra.run.smithi203.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T23:45:22.599 INFO:teuthology.orchestra.run.smithi203.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T23:45:22.599 INFO:teuthology.orchestra.run.smithi203.stdout:hardware devices. 2024-09-10T23:45:22.599 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:45:22.599 INFO:teuthology.orchestra.run.smithi203.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T23:45:22.600 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T23:45:22.600 INFO:teuthology.task.kernel:Updating grub on smithi203 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:45:22.600 DEBUG:teuthology.orchestra.run.smithi203:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T23:45:23.228 INFO:teuthology.orchestra.run.smithi203.stderr:Generating grub configuration file ... 2024-09-10T23:45:23.828 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi111.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-10T23:45:23.828 DEBUG:teuthology.orchestra.run.smithi111:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-10T23:45:23.919 INFO:teuthology.orchestra.run.smithi111.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:45:23.919 INFO:teuthology.orchestra.run.smithi111.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:45:23.919 INFO:teuthology.orchestra.run.smithi111.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:45:23.919 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:45:23.919 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-10T23:45:23.919 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-10T23:45:23.919 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-10T23:45:23.919 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-10T23:45:23.920 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-10T23:45:23.920 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-10T23:45:23.920 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-10T23:45:23.920 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-10T23:45:23.920 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-10T23:45:23.920 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-10T23:45:23.920 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-10T23:45:23.920 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-10T23:45:23.920 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-10T23:45:23.920 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-10T23:45:23.920 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-10T23:45:23.920 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-10T23:45:23.920 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-10T23:45:23.921 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-10T23:45:23.921 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-10T23:45:23.921 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-10T23:45:23.921 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-10T23:45:23.921 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-10T23:45:23.921 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-10T23:45:23.921 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-10T23:45:23.921 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-10T23:45:23.921 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-10T23:45:23.921 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-10T23:45:23.921 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-10T23:45:23.921 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-10T23:45:23.921 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-10T23:45:23.922 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-10T23:45:23.922 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-10T23:45:23.922 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-10T23:45:23.922 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-10T23:45:23.922 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-10T23:45:23.922 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-10T23:45:23.922 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-10T23:45:23.922 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-10T23:45:23.922 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-10T23:45:23.922 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-10T23:45:23.922 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-10T23:45:23.922 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-10T23:45:23.922 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-10T23:45:23.922 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-10T23:45:23.923 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-10T23:45:23.923 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-10T23:45:23.923 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-10T23:45:23.923 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-10T23:45:23.923 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-10T23:45:23.923 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-10T23:45:23.923 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-10T23:45:23.923 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-10T23:45:23.923 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-10T23:45:23.923 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-10T23:45:23.923 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-10T23:45:23.923 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-10T23:45:23.923 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-10T23:45:23.924 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-10T23:45:23.924 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-10T23:45:23.924 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-10T23:45:23.924 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-10T23:45:23.924 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-10T23:45:23.924 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-10T23:45:23.924 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-10T23:45:23.924 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-10T23:45:23.924 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-10T23:45:23.924 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-10T23:45:23.924 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-10T23:45:23.924 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-10T23:45:23.924 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-10T23:45:23.925 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-10T23:45:23.925 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-10T23:45:23.925 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-10T23:45:23.925 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-10T23:45:23.925 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-10T23:45:23.925 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-10T23:45:23.925 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-10T23:45:23.925 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-10T23:45:23.925 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-10T23:45:23.925 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-10T23:45:23.925 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-10T23:45:23.925 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-10T23:45:23.925 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-10T23:45:23.926 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-10T23:45:23.926 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-10T23:45:23.926 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-10T23:45:23.926 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-10T23:45:23.926 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-10T23:45:23.926 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-10T23:45:23.926 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-10T23:45:23.926 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-10T23:45:23.926 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-10T23:45:23.926 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-10T23:45:23.926 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-10T23:45:23.926 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-10T23:45:23.926 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-10T23:45:23.926 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-10T23:45:23.927 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-10T23:45:23.927 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-10T23:45:23.927 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-10T23:45:23.927 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-10T23:45:23.927 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-10T23:45:23.927 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-10T23:45:23.927 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-10T23:45:23.927 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-10T23:45:23.927 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-10T23:45:23.927 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-10T23:45:23.927 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-10T23:45:23.927 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-10T23:45:23.927 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-10T23:45:23.927 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-10T23:45:23.927 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-10T23:45:23.928 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-10T23:45:23.928 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-10T23:45:23.928 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-10T23:45:23.928 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-10T23:45:23.928 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-10T23:45:23.928 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-10T23:45:23.928 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-10T23:45:23.928 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-10T23:45:23.928 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-10T23:45:23.928 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-10T23:45:23.928 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-10T23:45:23.928 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-10T23:45:23.928 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-10T23:45:23.929 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-10T23:45:23.929 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-10T23:45:23.929 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-10T23:45:23.929 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-10T23:45:23.929 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-10T23:45:23.929 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-10T23:45:23.929 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-10T23:45:23.929 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-10T23:45:23.929 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-10T23:45:23.929 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-10T23:45:23.929 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-10T23:45:23.929 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-10T23:45:23.929 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-10T23:45:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-10T23:45:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-10T23:45:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-10T23:45:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-10T23:45:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-10T23:45:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-10T23:45:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-10T23:45:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-10T23:45:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-10T23:45:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-10T23:45:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-10T23:45:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-10T23:45:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-10T23:45:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-10T23:45:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-10T23:45:23.931 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-10T23:45:23.931 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-10T23:45:23.931 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-10T23:45:23.931 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-10T23:45:23.931 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-10T23:45:23.931 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-10T23:45:23.931 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-10T23:45:23.931 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-10T23:45:23.931 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-10T23:45:23.931 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-10T23:45:23.931 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-10T23:45:23.931 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-10T23:45:23.931 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-10T23:45:23.931 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-10T23:45:23.932 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-10T23:45:23.932 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-10T23:45:23.932 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-10T23:45:23.932 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-10T23:45:23.932 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-10T23:45:23.932 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-10T23:45:23.932 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-10T23:45:23.932 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-10T23:45:23.932 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-10T23:45:23.932 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-10T23:45:23.932 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-10T23:45:23.932 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-10T23:45:23.932 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-10T23:45:23.933 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-10T23:45:23.933 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-10T23:45:23.933 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-10T23:45:23.933 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-10T23:45:23.933 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-10T23:45:23.933 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-10T23:45:23.933 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-10T23:45:23.933 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-10T23:45:23.933 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-10T23:45:23.933 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-10T23:45:23.933 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-10T23:45:23.933 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-10T23:45:23.933 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-10T23:45:23.933 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-10T23:45:23.934 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-10T23:45:23.934 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-10T23:45:23.934 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-10T23:45:23.934 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-10T23:45:23.934 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-10T23:45:23.934 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-10T23:45:23.934 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-10T23:45:23.934 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-10T23:45:23.934 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-10T23:45:23.934 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-10T23:45:23.934 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-10T23:45:23.934 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-10T23:45:23.934 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-10T23:45:23.934 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-10T23:45:23.935 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-10T23:45:23.935 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-10T23:45:23.935 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-10T23:45:23.935 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-10T23:45:23.935 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-10T23:45:23.935 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-10T23:45:23.935 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-10T23:45:23.935 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-10T23:45:23.935 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-10T23:45:23.935 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-10T23:45:23.935 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-10T23:45:23.935 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-10T23:45:23.935 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-10T23:45:23.935 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-10T23:45:23.936 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-10T23:45:23.936 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-10T23:45:23.936 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-10T23:45:23.936 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-10T23:45:23.936 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-10T23:45:23.936 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-10T23:45:23.936 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-10T23:45:23.936 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-10T23:45:23.936 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-10T23:45:23.936 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-10T23:45:23.936 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-10T23:45:23.936 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-10T23:45:23.937 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-10T23:45:23.937 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-10T23:45:23.937 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-10T23:45:23.937 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-10T23:45:23.937 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-10T23:45:23.937 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-10T23:45:23.937 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-10T23:45:23.937 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-10T23:45:23.937 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-10T23:45:23.937 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-10T23:45:23.937 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-10T23:45:23.937 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-10T23:45:23.937 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-10T23:45:23.937 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-10T23:45:23.938 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-10T23:45:23.938 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-10T23:45:23.938 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-10T23:45:23.938 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-10T23:45:23.938 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-10T23:45:23.938 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-10T23:45:23.938 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-10T23:45:23.938 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-10T23:45:23.938 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-10T23:45:23.938 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-10T23:45:23.938 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-10T23:45:23.938 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-10T23:45:23.938 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-10T23:45:23.938 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-10T23:45:23.939 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-10T23:45:23.939 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-10T23:45:23.939 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-10T23:45:23.939 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-10T23:45:23.939 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-10T23:45:23.939 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-10T23:45:23.939 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-10T23:45:23.939 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-10T23:45:23.939 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-10T23:45:23.939 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-10T23:45:23.939 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-10T23:45:23.939 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-10T23:45:23.939 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-10T23:45:23.939 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-10T23:45:23.940 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-10T23:45:23.940 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-10T23:45:23.940 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-10T23:45:23.940 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-10T23:45:23.940 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-10T23:45:23.940 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-10T23:45:23.940 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-10T23:45:23.940 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-10T23:45:23.940 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-10T23:45:23.940 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-10T23:45:23.940 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-10T23:45:23.940 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-10T23:45:23.940 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-10T23:45:23.940 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-10T23:45:23.941 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-10T23:45:23.941 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-10T23:45:23.941 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-10T23:45:23.941 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-10T23:45:23.941 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-10T23:45:23.941 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-10T23:45:23.941 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-10T23:45:23.941 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-10T23:45:23.941 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-10T23:45:23.941 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-10T23:45:23.941 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-10T23:45:23.941 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-10T23:45:23.941 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-10T23:45:23.941 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-10T23:45:23.942 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-10T23:45:23.942 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-10T23:45:23.942 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-10T23:45:23.942 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-10T23:45:23.942 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-10T23:45:23.942 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-10T23:45:23.942 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-10T23:45:23.942 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-10T23:45:23.942 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-10T23:45:23.942 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-10T23:45:23.942 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-10T23:45:23.942 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-10T23:45:23.942 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-10T23:45:23.942 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-10T23:45:23.943 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-10T23:45:23.943 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-10T23:45:23.943 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-10T23:45:23.943 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-10T23:45:23.943 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-10T23:45:23.943 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-10T23:45:23.943 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-10T23:45:23.943 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-10T23:45:23.943 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-10T23:45:23.943 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-10T23:45:23.943 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-10T23:45:23.943 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-10T23:45:23.943 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-10T23:45:23.943 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-10T23:45:23.944 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-10T23:45:23.944 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-10T23:45:23.944 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-10T23:45:23.944 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-10T23:45:23.944 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-10T23:45:23.944 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-10T23:45:23.944 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-10T23:45:23.944 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-10T23:45:23.944 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-10T23:45:23.944 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-10T23:45:23.944 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-10T23:45:23.944 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-10T23:45:23.945 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-10T23:45:23.945 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-10T23:45:23.945 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-10T23:45:23.945 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-10T23:45:23.945 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-10T23:45:23.945 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-10T23:45:23.945 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-10T23:45:23.945 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-10T23:45:23.945 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-10T23:45:23.945 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-10T23:45:23.945 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-10T23:45:23.945 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-10T23:45:23.945 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-10T23:45:23.946 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-10T23:45:23.946 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-10T23:45:23.946 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-10T23:45:23.946 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-10T23:45:23.946 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-10T23:45:23.946 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-10T23:45:23.946 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-10T23:45:23.946 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-10T23:45:23.946 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-10T23:45:23.946 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-10T23:45:23.946 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-10T23:45:23.946 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-10T23:45:23.946 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-10T23:45:23.946 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-10T23:45:23.947 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-10T23:45:23.947 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-10T23:45:23.947 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-10T23:45:23.947 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-10T23:45:23.947 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-10T23:45:23.947 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-10T23:45:23.947 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-10T23:45:23.947 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-10T23:45:23.947 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-10T23:45:23.947 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-10T23:45:23.947 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-10T23:45:23.947 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-10T23:45:23.947 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-10T23:45:23.947 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-10T23:45:23.948 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-10T23:45:23.948 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-10T23:45:23.948 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-10T23:45:23.948 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-10T23:45:23.948 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-10T23:45:23.948 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-10T23:45:23.948 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-10T23:45:23.948 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-10T23:45:23.948 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-10T23:45:23.948 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-10T23:45:23.948 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-10T23:45:23.948 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-10T23:45:23.948 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-10T23:45:23.948 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-10T23:45:23.949 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-10T23:45:23.949 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-10T23:45:23.949 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-10T23:45:23.949 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-10T23:45:23.949 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-10T23:45:23.949 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-10T23:45:23.949 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-10T23:45:23.949 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-10T23:45:23.949 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-10T23:45:23.949 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-10T23:45:23.949 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-10T23:45:23.949 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-10T23:45:23.949 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-10T23:45:23.949 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-10T23:45:23.950 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-10T23:45:23.950 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-10T23:45:23.950 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-10T23:45:23.950 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-10T23:45:23.950 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-10T23:45:23.950 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-10T23:45:23.950 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-10T23:45:23.950 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-10T23:45:23.950 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-10T23:45:23.950 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-10T23:45:23.950 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-10T23:45:23.950 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-10T23:45:23.950 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-10T23:45:23.950 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-10T23:45:23.951 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-10T23:45:23.951 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-10T23:45:23.951 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-10T23:45:23.951 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-10T23:45:23.951 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-10T23:45:23.951 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-10T23:45:23.951 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-10T23:45:23.951 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-10T23:45:23.951 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-10T23:45:23.951 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-10T23:45:23.951 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-10T23:45:23.951 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-10T23:45:23.951 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-10T23:45:23.951 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-10T23:45:23.952 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-10T23:45:23.952 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-10T23:45:23.952 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-10T23:45:23.952 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-10T23:45:23.952 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-10T23:45:23.952 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-10T23:45:23.952 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-10T23:45:23.952 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-10T23:45:23.952 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-10T23:45:23.952 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-10T23:45:23.952 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-10T23:45:23.952 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-10T23:45:23.952 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-10T23:45:23.952 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-10T23:45:23.953 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-10T23:45:23.953 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-10T23:45:23.953 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-10T23:45:23.953 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-10T23:45:23.953 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-10T23:45:23.953 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-10T23:45:23.953 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-10T23:45:23.953 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-10T23:45:23.953 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-10T23:45:23.953 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-10T23:45:23.953 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-10T23:45:23.953 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-10T23:45:23.953 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-10T23:45:23.954 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-10T23:45:23.954 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-10T23:45:23.954 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-10T23:45:23.954 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-10T23:45:23.954 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-10T23:45:23.954 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-10T23:45:23.954 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-10T23:45:23.954 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-10T23:45:23.954 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-10T23:45:23.954 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-10T23:45:23.954 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-10T23:45:23.954 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-10T23:45:23.954 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-10T23:45:23.954 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-10T23:45:23.954 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-10T23:45:23.955 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-10T23:45:23.955 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-10T23:45:23.955 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-10T23:45:23.955 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-10T23:45:23.955 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-10T23:45:23.955 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-10T23:45:23.955 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-10T23:45:23.955 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-10T23:45:23.955 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-10T23:45:23.955 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-10T23:45:23.955 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-10T23:45:23.955 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-10T23:45:23.955 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-10T23:45:23.955 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-10T23:45:23.956 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-10T23:45:23.956 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-10T23:45:23.956 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-10T23:45:23.956 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-10T23:45:23.956 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-10T23:45:23.956 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-10T23:45:23.956 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-10T23:45:23.956 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-10T23:45:23.956 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-10T23:45:23.956 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-10T23:45:23.956 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-10T23:45:23.956 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-10T23:45:23.956 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-10T23:45:23.957 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-10T23:45:23.957 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-10T23:45:23.957 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-10T23:45:23.957 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-10T23:45:23.957 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-10T23:45:23.957 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-10T23:45:23.957 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-10T23:45:23.957 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-10T23:45:23.957 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-10T23:45:23.957 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-10T23:45:23.957 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-10T23:45:23.957 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-10T23:45:23.957 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-10T23:45:23.958 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-10T23:45:23.958 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-10T23:45:23.958 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-10T23:45:23.958 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-10T23:45:23.958 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-10T23:45:23.958 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-10T23:45:23.958 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-10T23:45:23.958 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-10T23:45:23.958 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-10T23:45:23.958 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-10T23:45:23.958 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-10T23:45:23.958 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-10T23:45:23.958 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-10T23:45:23.958 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-10T23:45:23.959 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-10T23:45:23.959 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-10T23:45:23.959 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-10T23:45:23.959 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-10T23:45:23.959 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-10T23:45:23.959 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-10T23:45:23.959 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-10T23:45:23.959 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-10T23:45:23.959 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-10T23:45:23.959 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-10T23:45:23.959 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-10T23:45:23.959 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-10T23:45:23.959 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-10T23:45:23.959 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-10T23:45:23.960 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-10T23:45:23.960 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-10T23:45:23.960 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-10T23:45:23.960 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-10T23:45:23.960 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-10T23:45:23.960 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-10T23:45:23.960 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-10T23:45:23.960 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-10T23:45:23.960 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-10T23:45:23.960 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-10T23:45:23.960 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-10T23:45:23.960 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-10T23:45:23.960 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-10T23:45:23.960 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-10T23:45:23.961 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-10T23:45:23.961 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-10T23:45:23.961 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-10T23:45:23.961 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-10T23:45:23.961 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-10T23:45:23.961 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-10T23:45:23.961 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-10T23:45:23.961 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-10T23:45:23.961 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-10T23:45:23.961 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-10T23:45:23.961 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-10T23:45:23.961 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-10T23:45:23.961 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-10T23:45:23.962 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-10T23:45:23.962 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-10T23:45:23.962 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-10T23:45:23.962 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-10T23:45:23.962 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-10T23:45:23.962 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-10T23:45:23.962 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-10T23:45:23.962 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-10T23:45:23.962 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-10T23:45:23.962 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-10T23:45:23.962 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-10T23:45:23.962 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-10T23:45:23.962 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-10T23:45:23.962 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-10T23:45:23.963 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-10T23:45:23.963 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-10T23:45:23.963 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-10T23:45:23.963 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-10T23:45:23.963 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-10T23:45:23.963 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-10T23:45:23.963 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-10T23:45:23.963 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-10T23:45:23.963 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-10T23:45:23.963 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-10T23:45:23.963 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-10T23:45:23.963 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-10T23:45:23.963 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-10T23:45:23.964 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-10T23:45:23.964 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-10T23:45:23.964 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-10T23:45:23.964 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-10T23:45:23.964 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-10T23:45:23.964 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-10T23:45:23.964 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-10T23:45:23.964 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-10T23:45:23.964 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-10T23:45:23.964 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-10T23:45:23.964 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-10T23:45:23.964 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-10T23:45:23.964 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-10T23:45:23.964 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-10T23:45:23.965 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-10T23:45:23.965 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-10T23:45:23.965 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-10T23:45:23.965 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-10T23:45:23.965 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-10T23:45:23.965 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-10T23:45:23.965 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-10T23:45:23.965 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-10T23:45:23.965 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-10T23:45:23.965 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-10T23:45:23.965 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-10T23:45:23.965 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-10T23:45:23.965 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-10T23:45:23.965 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-10T23:45:23.966 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-10T23:45:23.966 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-10T23:45:23.966 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-10T23:45:23.966 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-10T23:45:23.966 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-10T23:45:23.966 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-10T23:45:23.966 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-10T23:45:23.966 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-10T23:45:23.966 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-10T23:45:23.966 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-10T23:45:23.966 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-10T23:45:23.966 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-10T23:45:23.966 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-10T23:45:23.966 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-10T23:45:23.967 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-10T23:45:23.967 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-10T23:45:23.967 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-10T23:45:23.967 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-10T23:45:23.967 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-10T23:45:23.967 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-10T23:45:23.967 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-10T23:45:23.967 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-10T23:45:23.967 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-10T23:45:23.967 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-10T23:45:23.967 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-10T23:45:23.967 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-10T23:45:23.967 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-10T23:45:23.967 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-10T23:45:23.967 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-10T23:45:23.968 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-10T23:45:23.968 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-10T23:45:23.968 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-10T23:45:23.968 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-10T23:45:23.968 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-10T23:45:23.968 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-10T23:45:23.968 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-10T23:45:23.968 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-10T23:45:23.968 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-10T23:45:23.968 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-10T23:45:23.968 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-10T23:45:23.968 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-10T23:45:23.968 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-10T23:45:23.968 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-10T23:45:23.969 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-10T23:45:23.969 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-10T23:45:23.969 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-10T23:45:23.969 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-10T23:45:23.969 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-10T23:45:23.969 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-10T23:45:23.969 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-10T23:45:23.969 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-10T23:45:23.969 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-10T23:45:23.969 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-10T23:45:23.969 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-10T23:45:23.969 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-10T23:45:23.969 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-10T23:45:23.969 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-10T23:45:23.970 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-10T23:45:23.970 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-10T23:45:23.970 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-10T23:45:23.970 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-10T23:45:23.970 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-10T23:45:23.970 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-10T23:45:23.970 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-10T23:45:23.970 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-10T23:45:23.970 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-10T23:45:23.970 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-10T23:45:23.970 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-10T23:45:23.970 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-10T23:45:23.970 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-10T23:45:23.970 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-10T23:45:23.971 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-10T23:45:23.971 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-10T23:45:23.971 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-10T23:45:23.971 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-10T23:45:23.971 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-10T23:45:23.971 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-10T23:45:23.971 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-10T23:45:23.971 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-10T23:45:23.971 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-10T23:45:23.971 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-10T23:45:23.971 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-10T23:45:23.971 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-10T23:45:23.971 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-10T23:45:23.971 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-10T23:45:23.971 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-10T23:45:23.972 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-10T23:45:23.972 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-10T23:45:23.972 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-10T23:45:23.972 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-10T23:45:23.972 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-10T23:45:23.972 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-10T23:45:23.972 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-10T23:45:23.972 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-10T23:45:23.972 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-10T23:45:23.972 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-10T23:45:23.972 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-10T23:45:23.972 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-10T23:45:23.972 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-10T23:45:23.972 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-10T23:45:23.972 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-10T23:45:23.973 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-10T23:45:23.973 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-10T23:45:23.973 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-10T23:45:23.973 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-10T23:45:23.973 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-10T23:45:23.973 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-10T23:45:23.973 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-10T23:45:23.973 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-10T23:45:23.973 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-10T23:45:23.973 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-10T23:45:23.973 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-10T23:45:23.973 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-10T23:45:23.973 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-10T23:45:23.973 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-10T23:45:23.974 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-10T23:45:23.974 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-10T23:45:23.974 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-10T23:45:23.974 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-10T23:45:23.974 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-10T23:45:23.974 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-10T23:45:23.974 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-10T23:45:23.974 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-10T23:45:23.974 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-10T23:45:23.974 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-10T23:45:23.974 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-10T23:45:23.974 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-10T23:45:23.974 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-10T23:45:23.974 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-10T23:45:23.975 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-10T23:45:23.975 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-10T23:45:23.975 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-10T23:45:23.975 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-10T23:45:23.975 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-10T23:45:23.975 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-10T23:45:23.975 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-10T23:45:23.975 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-10T23:45:23.975 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-10T23:45:23.975 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-10T23:45:23.975 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-10T23:45:23.975 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-10T23:45:23.975 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-10T23:45:23.975 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-10T23:45:23.976 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-10T23:45:23.976 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-10T23:45:23.976 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-10T23:45:23.976 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-10T23:45:23.976 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-10T23:45:23.976 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-10T23:45:23.976 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-10T23:45:23.976 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-10T23:45:23.976 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-10T23:45:23.976 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-10T23:45:23.976 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-10T23:45:23.976 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-10T23:45:23.976 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-10T23:45:23.977 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-10T23:45:23.977 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-10T23:45:23.977 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-10T23:45:23.977 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-10T23:45:23.977 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-10T23:45:23.977 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-10T23:45:23.977 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-10T23:45:23.977 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-10T23:45:23.977 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-10T23:45:23.977 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-10T23:45:23.977 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-10T23:45:23.977 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-10T23:45:23.977 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-10T23:45:23.978 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-10T23:45:23.978 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-10T23:45:23.978 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-10T23:45:23.978 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-10T23:45:23.978 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-10T23:45:23.978 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-10T23:45:23.978 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-10T23:45:23.978 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-10T23:45:23.978 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-10T23:45:23.978 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-10T23:45:23.978 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-10T23:45:23.978 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-10T23:45:23.978 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-10T23:45:23.978 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-10T23:45:23.979 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-10T23:45:23.979 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-10T23:45:23.979 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-10T23:45:23.979 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-10T23:45:23.979 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-10T23:45:23.979 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-10T23:45:23.979 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-10T23:45:23.979 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-10T23:45:23.979 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-10T23:45:23.979 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-10T23:45:23.979 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-10T23:45:23.979 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-10T23:45:23.979 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-10T23:45:23.979 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-10T23:45:23.980 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-10T23:45:23.980 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-10T23:45:23.980 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-10T23:45:23.980 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-10T23:45:23.980 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-10T23:45:23.980 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-10T23:45:23.980 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-10T23:45:23.980 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-10T23:45:23.980 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-10T23:45:23.980 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-10T23:45:23.980 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-10T23:45:23.980 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-10T23:45:23.980 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-10T23:45:23.980 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-10T23:45:23.981 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-10T23:45:23.981 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-10T23:45:23.981 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-10T23:45:23.981 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-10T23:45:23.981 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-10T23:45:23.981 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-10T23:45:23.981 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-10T23:45:23.981 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-10T23:45:23.981 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-10T23:45:23.981 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-10T23:45:23.981 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-10T23:45:23.981 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-10T23:45:23.981 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-10T23:45:23.981 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-10T23:45:23.981 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-10T23:45:23.982 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-10T23:45:23.982 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-10T23:45:23.982 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-10T23:45:23.982 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-10T23:45:23.982 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-10T23:45:23.982 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-10T23:45:23.982 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-10T23:45:23.982 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-10T23:45:23.982 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-10T23:45:23.982 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-10T23:45:23.982 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-10T23:45:23.982 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-10T23:45:23.982 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-10T23:45:23.982 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-10T23:45:23.982 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-10T23:45:23.983 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-10T23:45:23.983 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-10T23:45:23.983 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-10T23:45:23.983 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-10T23:45:23.983 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-10T23:45:23.983 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-10T23:45:23.983 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-10T23:45:23.983 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-10T23:45:23.983 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-10T23:45:23.983 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-10T23:45:23.983 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-10T23:45:23.983 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-10T23:45:23.983 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-10T23:45:23.983 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-10T23:45:23.984 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-10T23:45:23.984 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-10T23:45:23.984 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-10T23:45:23.984 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-10T23:45:23.984 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-10T23:45:23.984 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-10T23:45:23.984 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-10T23:45:23.984 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-10T23:45:23.984 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-10T23:45:23.984 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-10T23:45:23.984 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-10T23:45:23.984 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-10T23:45:23.984 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-10T23:45:23.985 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-10T23:45:23.985 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-10T23:45:23.985 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-10T23:45:23.985 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-10T23:45:23.985 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-10T23:45:23.985 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-10T23:45:23.985 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-10T23:45:23.985 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-10T23:45:23.985 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-10T23:45:23.985 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-10T23:45:23.985 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-10T23:45:23.985 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-10T23:45:23.985 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-10T23:45:23.985 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-10T23:45:23.985 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-10T23:45:23.986 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-10T23:45:23.986 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-10T23:45:23.986 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-10T23:45:23.986 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-10T23:45:23.986 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-10T23:45:23.986 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-10T23:45:23.986 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-10T23:45:23.986 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-10T23:45:23.986 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-10T23:45:23.986 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-10T23:45:23.986 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-10T23:45:23.986 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-10T23:45:23.986 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-10T23:45:23.986 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-10T23:45:23.986 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-10T23:45:23.987 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-10T23:45:23.987 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-10T23:45:23.987 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-10T23:45:23.987 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-10T23:45:23.987 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-10T23:45:23.987 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-10T23:45:23.987 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-10T23:45:23.987 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-10T23:45:23.987 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-10T23:45:23.987 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-10T23:45:23.987 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-10T23:45:23.987 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-10T23:45:23.987 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-10T23:45:23.987 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-10T23:45:23.987 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-10T23:45:23.988 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-10T23:45:23.988 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-10T23:45:23.988 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-10T23:45:23.988 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-10T23:45:23.988 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-10T23:45:23.988 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-10T23:45:23.988 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-10T23:45:23.988 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-10T23:45:23.988 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-10T23:45:23.988 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-10T23:45:23.988 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-10T23:45:23.988 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-10T23:45:23.988 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-10T23:45:23.988 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-10T23:45:23.989 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-10T23:45:23.989 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-10T23:45:23.989 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-10T23:45:23.989 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-10T23:45:23.989 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-10T23:45:23.989 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-10T23:45:23.989 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-10T23:45:23.989 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-10T23:45:23.989 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-10T23:45:23.989 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-10T23:45:23.989 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-10T23:45:23.989 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-10T23:45:23.989 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-10T23:45:23.989 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-10T23:45:23.989 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-10T23:45:23.990 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-10T23:45:23.990 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-10T23:45:23.990 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-10T23:45:23.990 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-10T23:45:23.990 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-10T23:45:23.990 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-10T23:45:23.990 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-10T23:45:23.990 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-10T23:45:23.990 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-10T23:45:23.990 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-10T23:45:23.990 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-10T23:45:23.990 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-10T23:45:23.990 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-10T23:45:23.990 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-10T23:45:23.990 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-10T23:45:23.991 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-10T23:45:23.991 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-10T23:45:23.991 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-10T23:45:23.991 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-10T23:45:23.991 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-10T23:45:23.991 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-10T23:45:23.991 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-10T23:45:23.991 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-10T23:45:23.991 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-10T23:45:23.991 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-10T23:45:23.991 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-10T23:45:23.991 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-10T23:45:23.992 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-10T23:45:23.992 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-10T23:45:23.992 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-10T23:45:23.992 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-10T23:45:23.992 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-10T23:45:23.992 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-10T23:45:23.992 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-10T23:45:23.992 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-10T23:45:23.992 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-10T23:45:23.992 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-10T23:45:23.992 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-10T23:45:23.992 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-10T23:45:23.993 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-10T23:45:23.993 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-10T23:45:23.993 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-10T23:45:23.993 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-10T23:45:23.993 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-10T23:45:23.993 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-10T23:45:23.993 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-10T23:45:23.993 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-10T23:45:23.993 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-10T23:45:23.993 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-10T23:45:23.993 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-10T23:45:23.993 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-10T23:45:23.993 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-10T23:45:23.994 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-10T23:45:23.994 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-10T23:45:23.994 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-10T23:45:23.994 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-10T23:45:23.994 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-10T23:45:23.994 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-10T23:45:23.994 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-10T23:45:23.994 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-10T23:45:23.994 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-10T23:45:23.994 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-10T23:45:23.994 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-10T23:45:23.994 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-10T23:45:23.994 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-10T23:45:23.994 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-10T23:45:23.995 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-10T23:45:23.995 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-10T23:45:23.995 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-10T23:45:23.995 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-10T23:45:23.995 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-10T23:45:23.995 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-10T23:45:23.995 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-10T23:45:23.995 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-10T23:45:23.995 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-10T23:45:23.995 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-10T23:45:23.995 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-10T23:45:23.995 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-10T23:45:23.995 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-10T23:45:23.995 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-10T23:45:23.996 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-10T23:45:23.996 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-10T23:45:23.996 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-10T23:45:23.996 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-10T23:45:23.996 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-10T23:45:23.996 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-10T23:45:23.996 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-10T23:45:23.996 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-10T23:45:23.996 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-10T23:45:23.996 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-10T23:45:23.996 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-10T23:45:23.996 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-10T23:45:23.996 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-10T23:45:23.997 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-10T23:45:23.997 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-10T23:45:23.997 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-10T23:45:23.997 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-10T23:45:23.997 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-10T23:45:23.997 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-10T23:45:23.997 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-10T23:45:23.997 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-10T23:45:23.997 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-10T23:45:23.997 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-10T23:45:23.997 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-10T23:45:23.997 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-10T23:45:23.997 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-10T23:45:23.998 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-10T23:45:23.998 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-10T23:45:23.998 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-10T23:45:23.998 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-10T23:45:23.998 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-10T23:45:23.998 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-10T23:45:23.998 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-10T23:45:23.998 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-10T23:45:23.998 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-10T23:45:23.998 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-10T23:45:23.998 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-10T23:45:23.998 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-10T23:45:23.998 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-10T23:45:23.999 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-10T23:45:23.999 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-10T23:45:23.999 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-10T23:45:23.999 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-10T23:45:23.999 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-10T23:45:23.999 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-10T23:45:23.999 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-10T23:45:23.999 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-10T23:45:23.999 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-10T23:45:23.999 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-10T23:45:23.999 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-10T23:45:23.999 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-10T23:45:23.999 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-10T23:45:23.999 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-10T23:45:24.000 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-10T23:45:24.000 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-10T23:45:24.000 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-10T23:45:24.000 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-10T23:45:24.000 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-10T23:45:24.000 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-10T23:45:24.000 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-10T23:45:24.000 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-10T23:45:24.000 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-10T23:45:24.000 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-10T23:45:24.000 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-10T23:45:24.000 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-10T23:45:24.000 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-10T23:45:24.001 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-10T23:45:24.001 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-10T23:45:24.001 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-10T23:45:24.001 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-10T23:45:24.001 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-10T23:45:24.001 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-10T23:45:24.001 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-10T23:45:24.001 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-10T23:45:24.001 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-10T23:45:24.001 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-10T23:45:24.001 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-10T23:45:24.001 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-10T23:45:24.001 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-10T23:45:24.002 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-10T23:45:24.002 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-10T23:45:24.002 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-10T23:45:24.002 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-10T23:45:24.002 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-10T23:45:24.002 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-10T23:45:24.002 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-10T23:45:24.002 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-10T23:45:24.002 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-10T23:45:24.002 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-10T23:45:24.002 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-10T23:45:24.002 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-10T23:45:24.002 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-10T23:45:24.002 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-10T23:45:24.003 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-10T23:45:24.003 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-10T23:45:24.003 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-10T23:45:24.003 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-10T23:45:24.003 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-10T23:45:24.003 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-10T23:45:24.003 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-10T23:45:24.003 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-10T23:45:24.003 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-10T23:45:24.003 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-10T23:45:24.003 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-10T23:45:24.003 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-10T23:45:24.003 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-10T23:45:24.004 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-10T23:45:24.004 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-10T23:45:24.004 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-10T23:45:24.004 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-10T23:45:24.004 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-10T23:45:24.004 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-10T23:45:24.004 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-10T23:45:24.004 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-10T23:45:24.004 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-10T23:45:24.004 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-10T23:45:24.004 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-10T23:45:24.004 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-10T23:45:24.004 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-10T23:45:24.005 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-10T23:45:24.005 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-10T23:45:24.005 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-10T23:45:24.005 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-10T23:45:24.005 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-10T23:45:24.005 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-10T23:45:24.005 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-10T23:45:24.005 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-10T23:45:24.005 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-10T23:45:24.005 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-10T23:45:24.005 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-10T23:45:24.005 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-10T23:45:24.005 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-10T23:45:24.005 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-10T23:45:24.006 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-10T23:45:24.006 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-10T23:45:24.006 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-10T23:45:24.006 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-10T23:45:24.006 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-10T23:45:24.006 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-10T23:45:24.006 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-10T23:45:24.006 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-10T23:45:24.006 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-10T23:45:24.006 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-10T23:45:24.006 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-10T23:45:24.006 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-10T23:45:24.006 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-10T23:45:24.006 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-10T23:45:24.007 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-10T23:45:24.007 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-10T23:45:24.007 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-10T23:45:24.007 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-10T23:45:24.007 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-10T23:45:24.007 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-10T23:45:24.007 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-10T23:45:24.007 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-10T23:45:24.007 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-10T23:45:24.007 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-10T23:45:24.007 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-10T23:45:24.007 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-10T23:45:24.007 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-10T23:45:24.007 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-10T23:45:24.008 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-10T23:45:24.008 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-10T23:45:24.008 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-10T23:45:24.008 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-10T23:45:24.008 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-10T23:45:24.008 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-10T23:45:24.008 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-10T23:45:24.008 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-10T23:45:24.008 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-10T23:45:24.008 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-10T23:45:24.008 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-10T23:45:24.008 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-10T23:45:24.008 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-10T23:45:24.009 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-10T23:45:24.009 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-10T23:45:24.009 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-10T23:45:24.009 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-10T23:45:24.009 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-10T23:45:24.009 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-10T23:45:24.009 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-10T23:45:24.009 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-10T23:45:24.009 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-10T23:45:24.009 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-10T23:45:24.009 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-10T23:45:24.009 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-10T23:45:24.009 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-10T23:45:24.009 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-10T23:45:24.009 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-10T23:45:24.010 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-10T23:45:24.010 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-10T23:45:24.010 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-10T23:45:24.010 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-10T23:45:24.010 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-10T23:45:24.010 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-10T23:45:24.010 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-10T23:45:24.010 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-10T23:45:24.010 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-10T23:45:24.010 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-10T23:45:24.010 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-10T23:45:24.010 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-10T23:45:24.010 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-10T23:45:24.010 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-10T23:45:24.011 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-10T23:45:24.011 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-10T23:45:24.011 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-10T23:45:24.011 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-10T23:45:24.011 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-10T23:45:24.011 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-10T23:45:24.011 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-10T23:45:24.011 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-10T23:45:24.011 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-10T23:45:24.011 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-10T23:45:24.011 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-10T23:45:24.011 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-10T23:45:24.011 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-10T23:45:24.012 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-10T23:45:24.012 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-10T23:45:24.012 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-10T23:45:24.012 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-10T23:45:24.012 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-10T23:45:24.012 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-10T23:45:24.012 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-10T23:45:24.012 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-10T23:45:24.012 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-10T23:45:24.012 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-10T23:45:24.012 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-10T23:45:24.012 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-10T23:45:24.012 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-10T23:45:24.012 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-10T23:45:24.013 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-10T23:45:24.013 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-10T23:45:24.013 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-10T23:45:24.013 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-10T23:45:24.013 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-10T23:45:24.013 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-10T23:45:24.013 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-10T23:45:24.013 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-10T23:45:24.013 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-10T23:45:24.013 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-10T23:45:24.013 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-10T23:45:24.013 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-10T23:45:24.013 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-10T23:45:24.013 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-10T23:45:24.014 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-10T23:45:24.014 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-10T23:45:24.014 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-10T23:45:24.014 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-10T23:45:24.014 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-10T23:45:24.014 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-10T23:45:24.014 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-10T23:45:24.014 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-10T23:45:24.014 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-10T23:45:24.014 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-10T23:45:24.014 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-10T23:45:24.014 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-10T23:45:24.014 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-10T23:45:24.014 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-10T23:45:24.015 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-10T23:45:24.015 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-10T23:45:24.015 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-10T23:45:24.015 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-10T23:45:24.015 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-10T23:45:24.015 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-10T23:45:24.015 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-10T23:45:24.015 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-10T23:45:24.015 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-10T23:45:24.015 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-10T23:45:24.015 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-10T23:45:24.015 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-10T23:45:24.015 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-10T23:45:24.015 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-10T23:45:24.015 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-10T23:45:24.016 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-10T23:45:24.016 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-10T23:45:24.016 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-10T23:45:24.016 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-10T23:45:24.016 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-10T23:45:24.016 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-10T23:45:24.016 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-10T23:45:24.016 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-10T23:45:24.016 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-10T23:45:24.016 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-10T23:45:24.016 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-10T23:45:24.016 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-10T23:45:24.016 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-10T23:45:24.017 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-10T23:45:24.017 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-10T23:45:24.017 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-10T23:45:24.017 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-10T23:45:24.017 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-10T23:45:24.017 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-10T23:45:24.017 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-10T23:45:24.017 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-10T23:45:24.017 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-10T23:45:24.017 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-10T23:45:24.017 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-10T23:45:24.017 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-10T23:45:24.017 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-10T23:45:24.017 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-10T23:45:24.018 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-10T23:45:24.018 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-10T23:45:24.018 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-10T23:45:24.018 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-10T23:45:24.018 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-10T23:45:24.018 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-10T23:45:24.018 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-10T23:45:24.018 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-10T23:45:24.018 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-10T23:45:24.018 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-10T23:45:24.018 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-10T23:45:24.018 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-10T23:45:24.018 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-10T23:45:24.018 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-10T23:45:24.019 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-10T23:45:24.019 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-10T23:45:24.019 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-10T23:45:24.019 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-10T23:45:24.019 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-10T23:45:24.019 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-10T23:45:24.019 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-10T23:45:24.019 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-10T23:45:24.019 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-10T23:45:24.019 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-10T23:45:24.019 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-10T23:45:24.019 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-10T23:45:24.019 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-10T23:45:24.020 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-10T23:45:24.020 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-10T23:45:24.020 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-10T23:45:24.020 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-10T23:45:24.020 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-10T23:45:24.020 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-10T23:45:24.020 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-10T23:45:24.020 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-10T23:45:24.020 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-10T23:45:24.020 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-10T23:45:24.020 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-10T23:45:24.020 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-10T23:45:24.020 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-10T23:45:24.021 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-10T23:45:24.021 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-10T23:45:24.021 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-10T23:45:24.021 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-10T23:45:24.021 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-10T23:45:24.021 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-10T23:45:24.021 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-10T23:45:24.021 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-10T23:45:24.021 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-10T23:45:24.021 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-10T23:45:24.021 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-10T23:45:24.021 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-10T23:45:24.021 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-10T23:45:24.021 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-10T23:45:24.022 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-10T23:45:24.022 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-10T23:45:24.022 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-10T23:45:24.022 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-10T23:45:24.022 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-10T23:45:24.022 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-10T23:45:24.022 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-10T23:45:24.022 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-10T23:45:24.022 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-10T23:45:24.022 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-10T23:45:24.022 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-10T23:45:24.022 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-10T23:45:24.022 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-10T23:45:24.022 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-10T23:45:24.022 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-10T23:45:24.023 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-10T23:45:24.023 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-10T23:45:24.023 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-10T23:45:24.023 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-10T23:45:24.023 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-10T23:45:24.023 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-10T23:45:24.023 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-10T23:45:24.023 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-10T23:45:24.023 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-10T23:45:24.023 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-10T23:45:24.023 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-10T23:45:24.023 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-10T23:45:24.023 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-10T23:45:24.023 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-10T23:45:24.024 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-10T23:45:24.024 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-10T23:45:24.024 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-10T23:45:24.024 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-10T23:45:24.024 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-10T23:45:24.024 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-10T23:45:24.024 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-10T23:45:24.024 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-10T23:45:24.024 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-10T23:45:24.024 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-10T23:45:24.024 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-10T23:45:24.024 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-10T23:45:24.024 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-10T23:45:24.024 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-10T23:45:24.025 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-10T23:45:24.025 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-10T23:45:24.025 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-10T23:45:24.025 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-10T23:45:24.025 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-10T23:45:24.025 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-10T23:45:24.025 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-10T23:45:24.025 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-10T23:45:24.025 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-10T23:45:24.025 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-10T23:45:24.025 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-10T23:45:24.025 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-10T23:45:24.025 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-10T23:45:24.025 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-10T23:45:24.026 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-10T23:45:24.026 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-10T23:45:24.026 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-10T23:45:24.026 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-10T23:45:24.026 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-10T23:45:24.026 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-10T23:45:24.026 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-10T23:45:24.026 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-10T23:45:24.026 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-10T23:45:24.026 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-10T23:45:24.026 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-10T23:45:24.026 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-10T23:45:24.026 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-10T23:45:24.026 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-10T23:45:24.027 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-10T23:45:24.027 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-10T23:45:24.027 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-10T23:45:24.027 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-10T23:45:24.027 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-10T23:45:24.027 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-10T23:45:24.027 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-10T23:45:24.027 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-10T23:45:24.027 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-10T23:45:24.027 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-10T23:45:24.027 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-10T23:45:24.027 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-10T23:45:24.027 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-10T23:45:24.027 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-10T23:45:24.028 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-10T23:45:24.028 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-10T23:45:24.028 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-10T23:45:24.028 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-10T23:45:24.028 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-10T23:45:24.028 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-10T23:45:24.028 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-10T23:45:24.028 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-10T23:45:24.028 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-10T23:45:24.028 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-10T23:45:24.028 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-10T23:45:24.028 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-10T23:45:24.028 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-10T23:45:24.028 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-10T23:45:24.028 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-10T23:45:24.029 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-10T23:45:24.029 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-10T23:45:24.029 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-10T23:45:24.029 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-10T23:45:24.029 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-10T23:45:24.029 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-10T23:45:24.029 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-10T23:45:24.029 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-10T23:45:24.029 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-10T23:45:24.029 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-10T23:45:24.029 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-10T23:45:24.029 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-10T23:45:24.029 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-10T23:45:24.029 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-10T23:45:24.030 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-10T23:45:24.030 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-10T23:45:24.030 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-10T23:45:24.030 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-10T23:45:24.030 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-10T23:45:24.030 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-10T23:45:24.030 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-10T23:45:24.030 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-10T23:45:24.030 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-10T23:45:24.030 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-10T23:45:24.030 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-10T23:45:24.030 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-10T23:45:24.030 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-10T23:45:24.030 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-10T23:45:24.030 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-10T23:45:24.031 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-10T23:45:24.031 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-10T23:45:24.031 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-10T23:45:24.031 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-10T23:45:24.031 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-10T23:45:24.031 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-10T23:45:24.031 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-10T23:45:24.031 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-10T23:45:24.031 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-10T23:45:24.031 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-10T23:45:24.031 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-10T23:45:24.031 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-10T23:45:24.031 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-10T23:45:24.032 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-10T23:45:24.032 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-10T23:45:24.032 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-10T23:45:24.032 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-10T23:45:24.032 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-10T23:45:24.032 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-10T23:45:24.032 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-10T23:45:24.032 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-10T23:45:24.032 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-10T23:45:24.032 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-10T23:45:24.032 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-10T23:45:24.032 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-10T23:45:24.033 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-10T23:45:24.033 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-10T23:45:24.033 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-10T23:45:24.033 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-10T23:45:24.033 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-10T23:45:24.033 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-10T23:45:24.033 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-10T23:45:24.033 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-10T23:45:24.033 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-10T23:45:24.033 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-10T23:45:24.033 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-10T23:45:24.033 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-10T23:45:24.033 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-10T23:45:24.033 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-10T23:45:24.034 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-10T23:45:24.034 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-10T23:45:24.034 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-10T23:45:24.034 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-10T23:45:24.034 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-10T23:45:24.034 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-10T23:45:24.034 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-10T23:45:24.034 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-10T23:45:24.034 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-10T23:45:24.034 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-10T23:45:24.034 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-10T23:45:24.034 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-10T23:45:24.034 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-10T23:45:24.034 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-10T23:45:24.035 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-10T23:45:24.035 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-10T23:45:24.035 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-10T23:45:24.035 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-10T23:45:24.035 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-10T23:45:24.035 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-10T23:45:24.035 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-10T23:45:24.035 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-10T23:45:24.035 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-10T23:45:24.035 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-10T23:45:24.035 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-10T23:45:24.035 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-10T23:45:24.035 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-10T23:45:24.036 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-10T23:45:24.036 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-10T23:45:24.036 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-10T23:45:24.036 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-10T23:45:24.036 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-10T23:45:24.036 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-10T23:45:24.036 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-10T23:45:24.036 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-10T23:45:24.036 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-10T23:45:24.036 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-10T23:45:24.036 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-10T23:45:24.036 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-10T23:45:24.036 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-10T23:45:24.037 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-10T23:45:24.037 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-10T23:45:24.037 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-10T23:45:24.037 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-10T23:45:24.037 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-10T23:45:24.037 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-10T23:45:24.037 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-10T23:45:24.037 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-10T23:45:24.037 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-10T23:45:24.037 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-10T23:45:24.037 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-10T23:45:24.037 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-10T23:45:24.037 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-10T23:45:24.037 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-10T23:45:24.038 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-10T23:45:24.038 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-10T23:45:24.038 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-10T23:45:24.038 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-10T23:45:24.038 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-10T23:45:24.038 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-10T23:45:24.038 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-10T23:45:24.038 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-10T23:45:24.038 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-10T23:45:24.038 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-10T23:45:24.038 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-10T23:45:24.038 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-10T23:45:24.038 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-10T23:45:24.038 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-10T23:45:24.039 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-10T23:45:24.039 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-10T23:45:24.039 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-10T23:45:24.039 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-10T23:45:24.039 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-10T23:45:24.039 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-10T23:45:24.039 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-10T23:45:24.039 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-10T23:45:24.039 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-10T23:45:24.039 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-10T23:45:24.039 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-10T23:45:24.039 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-10T23:45:24.039 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-10T23:45:24.039 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-10T23:45:24.039 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-10T23:45:24.040 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-10T23:45:24.040 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-10T23:45:24.040 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-10T23:45:24.040 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-10T23:45:24.040 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-10T23:45:24.040 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-10T23:45:24.040 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-10T23:45:24.040 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-10T23:45:24.040 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-10T23:45:24.040 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-10T23:45:24.040 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-10T23:45:24.040 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-10T23:45:24.040 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-10T23:45:24.040 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-10T23:45:24.041 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-10T23:45:24.041 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-10T23:45:24.041 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-10T23:45:24.041 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-10T23:45:24.041 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-10T23:45:24.041 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-10T23:45:24.041 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-10T23:45:24.041 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-10T23:45:24.041 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-10T23:45:24.041 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-10T23:45:24.041 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-10T23:45:24.041 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-10T23:45:24.041 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-10T23:45:24.041 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-10T23:45:24.041 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-10T23:45:24.042 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-10T23:45:24.042 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-10T23:45:24.042 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-10T23:45:24.042 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-10T23:45:24.042 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-10T23:45:24.042 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-10T23:45:24.042 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-10T23:45:24.042 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-10T23:45:24.042 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-10T23:45:24.042 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-10T23:45:24.042 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-10T23:45:24.042 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-10T23:45:24.042 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-10T23:45:24.042 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-10T23:45:24.043 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-10T23:45:24.043 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-10T23:45:24.043 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-10T23:45:24.043 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-10T23:45:24.043 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-10T23:45:24.043 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-10T23:45:24.043 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-10T23:45:24.043 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-10T23:45:24.043 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-10T23:45:24.043 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-10T23:45:24.043 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-10T23:45:24.043 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-10T23:45:24.043 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-10T23:45:24.044 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-10T23:45:24.044 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-10T23:45:24.044 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-10T23:45:24.044 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-10T23:45:24.044 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-10T23:45:24.044 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-10T23:45:24.044 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-10T23:45:24.044 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-10T23:45:24.044 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-10T23:45:24.044 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-10T23:45:24.044 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-10T23:45:24.044 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-10T23:45:24.044 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-10T23:45:24.045 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-10T23:45:24.045 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-10T23:45:24.045 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-10T23:45:24.045 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-10T23:45:24.045 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-10T23:45:24.045 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-10T23:45:24.045 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-10T23:45:24.045 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-10T23:45:24.045 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-10T23:45:24.045 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-10T23:45:24.045 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-10T23:45:24.045 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-10T23:45:24.045 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-10T23:45:24.045 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-10T23:45:24.046 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-10T23:45:24.046 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-10T23:45:24.046 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-10T23:45:24.046 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-10T23:45:24.046 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-10T23:45:24.046 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-10T23:45:24.046 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-10T23:45:24.046 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-10T23:45:24.046 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-10T23:45:24.046 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-10T23:45:24.046 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-10T23:45:24.046 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-10T23:45:24.046 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-10T23:45:24.046 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-10T23:45:24.047 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-10T23:45:24.047 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-10T23:45:24.047 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-10T23:45:24.047 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-10T23:45:24.047 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-10T23:45:24.047 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-10T23:45:24.047 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-10T23:45:24.047 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-10T23:45:24.047 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-10T23:45:24.047 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-10T23:45:24.047 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-10T23:45:24.047 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-10T23:45:24.047 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-10T23:45:24.047 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-10T23:45:24.047 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-10T23:45:24.048 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-10T23:45:24.048 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-10T23:45:24.048 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-10T23:45:24.048 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-10T23:45:24.048 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-10T23:45:24.048 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-10T23:45:24.048 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-10T23:45:24.048 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-10T23:45:24.048 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-10T23:45:24.048 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-10T23:45:24.048 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-10T23:45:24.048 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-10T23:45:24.048 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-10T23:45:24.048 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-10T23:45:24.049 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-10T23:45:24.049 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-10T23:45:24.049 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-10T23:45:24.049 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-10T23:45:24.049 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-10T23:45:24.049 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-10T23:45:24.049 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-10T23:45:24.049 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-10T23:45:24.049 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-10T23:45:24.049 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-10T23:45:24.049 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-10T23:45:24.049 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-10T23:45:24.049 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-10T23:45:24.049 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-10T23:45:24.050 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-10T23:45:24.050 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-10T23:45:24.050 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-10T23:45:24.050 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-10T23:45:24.050 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-10T23:45:24.050 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-10T23:45:24.050 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-10T23:45:24.050 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-10T23:45:24.050 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-10T23:45:24.050 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-10T23:45:24.050 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-10T23:45:24.050 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-10T23:45:24.050 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-10T23:45:24.050 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-10T23:45:24.051 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-10T23:45:24.051 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-10T23:45:24.051 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-10T23:45:24.051 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-10T23:45:24.051 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-10T23:45:24.051 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-10T23:45:24.051 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-10T23:45:24.051 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-10T23:45:24.051 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-10T23:45:24.051 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-10T23:45:24.051 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-10T23:45:24.051 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-10T23:45:24.051 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-10T23:45:24.051 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-10T23:45:24.051 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-10T23:45:24.052 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-10T23:45:24.052 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-10T23:45:24.052 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-10T23:45:24.052 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-10T23:45:24.052 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-10T23:45:24.052 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-10T23:45:24.052 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-10T23:45:24.052 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-10T23:45:24.052 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-10T23:45:24.052 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-10T23:45:24.052 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-10T23:45:24.052 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-10T23:45:24.052 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-10T23:45:24.053 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-10T23:45:24.053 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-10T23:45:24.053 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-10T23:45:24.053 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-10T23:45:24.053 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-10T23:45:24.053 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-10T23:45:24.053 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-10T23:45:24.053 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-10T23:45:24.053 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-10T23:45:24.053 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-10T23:45:24.053 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-10T23:45:24.053 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-10T23:45:24.053 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-10T23:45:24.053 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-10T23:45:24.054 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-10T23:45:24.054 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-10T23:45:24.054 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-10T23:45:24.054 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-10T23:45:24.054 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-10T23:45:24.054 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-10T23:45:24.054 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-10T23:45:24.054 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-10T23:45:24.054 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-10T23:45:24.054 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-10T23:45:24.054 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-10T23:45:24.054 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-10T23:45:24.054 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-10T23:45:24.054 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-10T23:45:24.055 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-10T23:45:24.055 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-10T23:45:24.055 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-10T23:45:24.055 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-10T23:45:24.055 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-10T23:45:24.055 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-10T23:45:24.055 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-10T23:45:24.055 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-10T23:45:24.055 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-10T23:45:24.055 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-10T23:45:24.055 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-10T23:45:24.055 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-10T23:45:24.055 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-10T23:45:24.056 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-10T23:45:24.056 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-10T23:45:24.056 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-10T23:45:24.056 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-10T23:45:24.056 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-10T23:45:24.056 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-10T23:45:24.056 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-10T23:45:24.056 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-10T23:45:24.056 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-10T23:45:24.056 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-10T23:45:24.056 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-10T23:45:24.056 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-10T23:45:24.056 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-10T23:45:24.056 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-10T23:45:24.057 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-10T23:45:24.057 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-10T23:45:24.057 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-10T23:45:24.057 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-10T23:45:24.057 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-10T23:45:24.057 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-10T23:45:24.057 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-10T23:45:24.057 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-10T23:45:24.057 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-10T23:45:24.057 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-10T23:45:24.057 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-10T23:45:24.057 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-10T23:45:24.057 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-10T23:45:24.058 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-10T23:45:24.058 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-10T23:45:24.058 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-10T23:45:24.058 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-10T23:45:24.058 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-10T23:45:24.058 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-10T23:45:24.058 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-10T23:45:24.058 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-10T23:45:24.058 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-10T23:45:24.058 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-10T23:45:24.058 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-10T23:45:24.058 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-10T23:45:24.058 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-10T23:45:24.058 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-10T23:45:24.059 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-10T23:45:24.059 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-10T23:45:24.059 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-10T23:45:24.059 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-10T23:45:24.059 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-10T23:45:24.059 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-10T23:45:24.059 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-10T23:45:24.059 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-10T23:45:24.059 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-10T23:45:24.059 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-10T23:45:24.059 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-10T23:45:24.059 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-10T23:45:24.059 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-10T23:45:24.060 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-10T23:45:24.060 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-10T23:45:24.060 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-10T23:45:24.060 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-10T23:45:24.060 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-10T23:45:24.060 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-10T23:45:24.060 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-10T23:45:24.060 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-10T23:45:24.060 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-10T23:45:24.060 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-10T23:45:24.060 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-10T23:45:24.060 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-10T23:45:24.060 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-10T23:45:24.060 INFO:teuthology.orchestra.run.smithi111.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T23:45:24.064 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:45:24.064 DEBUG:teuthology.orchestra.run.smithi111:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-10T23:45:24.088 INFO:teuthology.orchestra.run.smithi111.stdout:postinstall scriptlet (using /bin/sh): 2024-09-10T23:45:24.088 INFO:teuthology.orchestra.run.smithi111.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T23:45:24.088 INFO:teuthology.orchestra.run.smithi111.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T23:45:24.089 INFO:teuthology.orchestra.run.smithi111.stdout:fi 2024-09-10T23:45:24.089 INFO:teuthology.orchestra.run.smithi111.stdout:for file in vmlinuz System.map config; do 2024-09-10T23:45:24.089 INFO:teuthology.orchestra.run.smithi111.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-10T23:45:24.089 INFO:teuthology.orchestra.run.smithi111.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T23:45:24.089 INFO:teuthology.orchestra.run.smithi111.stdout: fi 2024-09-10T23:45:24.089 INFO:teuthology.orchestra.run.smithi111.stdout:done 2024-09-10T23:45:24.089 INFO:teuthology.orchestra.run.smithi111.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-10T23:45:24.089 INFO:teuthology.orchestra.run.smithi111.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-10T23:45:24.089 INFO:teuthology.orchestra.run.smithi111.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T23:45:24.089 INFO:teuthology.orchestra.run.smithi111.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T23:45:24.089 INFO:teuthology.orchestra.run.smithi111.stdout:fi 2024-09-10T23:45:24.089 INFO:teuthology.orchestra.run.smithi111.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-10T23:45:24.089 INFO:teuthology.orchestra.run.smithi111.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:45:24.089 INFO:teuthology.orchestra.run.smithi111.stdout:fi 2024-09-10T23:45:24.090 INFO:teuthology.orchestra.run.smithi111.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-10T23:45:24.090 INFO:teuthology.orchestra.run.smithi111.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T23:45:24.090 INFO:teuthology.orchestra.run.smithi111.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:45:24.090 INFO:teuthology.orchestra.run.smithi111.stdout:fi 2024-09-10T23:45:24.091 DEBUG:teuthology.orchestra.run.smithi111:> sudo rpm -qi grub2-tools 2024-09-10T23:45:24.175 INFO:teuthology.orchestra.run.smithi111.stdout:Name : grub2-tools 2024-09-10T23:45:24.176 INFO:teuthology.orchestra.run.smithi111.stdout:Epoch : 1 2024-09-10T23:45:24.176 INFO:teuthology.orchestra.run.smithi111.stdout:Version : 2.06 2024-09-10T23:45:24.176 INFO:teuthology.orchestra.run.smithi111.stdout:Release : 82.el9 2024-09-10T23:45:24.176 INFO:teuthology.orchestra.run.smithi111.stdout:Architecture: x86_64 2024-09-10T23:45:24.176 INFO:teuthology.orchestra.run.smithi111.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T23:45:24.176 INFO:teuthology.orchestra.run.smithi111.stdout:Group : Unspecified 2024-09-10T23:45:24.176 INFO:teuthology.orchestra.run.smithi111.stdout:Size : 8274670 2024-09-10T23:45:24.176 INFO:teuthology.orchestra.run.smithi111.stdout:License : GPLv3+ 2024-09-10T23:45:24.176 INFO:teuthology.orchestra.run.smithi111.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T23:45:24.176 INFO:teuthology.orchestra.run.smithi111.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T23:45:24.176 INFO:teuthology.orchestra.run.smithi111.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T23:45:24.176 INFO:teuthology.orchestra.run.smithi111.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T23:45:24.176 INFO:teuthology.orchestra.run.smithi111.stdout:Packager : builder@centos.org 2024-09-10T23:45:24.176 INFO:teuthology.orchestra.run.smithi111.stdout:Vendor : CentOS 2024-09-10T23:45:24.177 INFO:teuthology.orchestra.run.smithi111.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T23:45:24.177 INFO:teuthology.orchestra.run.smithi111.stdout:Summary : Support tools for GRUB. 2024-09-10T23:45:24.177 INFO:teuthology.orchestra.run.smithi111.stdout:Description : 2024-09-10T23:45:24.177 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:45:24.177 INFO:teuthology.orchestra.run.smithi111.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T23:45:24.177 INFO:teuthology.orchestra.run.smithi111.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T23:45:24.177 INFO:teuthology.orchestra.run.smithi111.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T23:45:24.177 INFO:teuthology.orchestra.run.smithi111.stdout:hardware devices. 2024-09-10T23:45:24.177 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:45:24.177 INFO:teuthology.orchestra.run.smithi111.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T23:45:24.178 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T23:45:24.178 INFO:teuthology.task.kernel:Updating grub on smithi111 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:45:24.178 DEBUG:teuthology.orchestra.run.smithi111:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T23:45:24.644 INFO:teuthology.orchestra.run.smithi203.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T23:45:24.671 INFO:teuthology.orchestra.run.smithi203.stderr:done 2024-09-10T23:45:24.673 DEBUG:teuthology.orchestra.run.smithi203:> mktemp 2024-09-10T23:45:24.688 INFO:teuthology.orchestra.run.smithi203.stdout:/tmp/tmp.mflju1nahb 2024-09-10T23:45:24.688 DEBUG:teuthology.orchestra.run.smithi203:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.mflju1nahb 2024-09-10T23:45:24.745 INFO:teuthology.orchestra.run.smithi111.stderr:Generating grub configuration file ... 2024-09-10T23:45:24.755 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0666 /tmp/tmp.mflju1nahb 2024-09-10T23:45:24.892 DEBUG:teuthology.orchestra.remote:smithi203:/tmp/tmp.mflju1nahb is 6KB 2024-09-10T23:45:24.940 DEBUG:teuthology.orchestra.run.smithi203:> rm -fr /tmp/tmp.mflju1nahb 2024-09-10T23:45:24.955 DEBUG:teuthology.orchestra.run.smithi203:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T23:45:25.017 INFO:teuthology.orchestra.run.smithi203.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T23:45:25.017 INFO:teuthology.orchestra.run.smithi203.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T23:45:25.017 INFO:teuthology.orchestra.run.smithi203.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T23:45:25.017 INFO:teuthology.orchestra.run.smithi203.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-10T23:45:25.019 DEBUG:teuthology.orchestra.run.smithi203:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:45:25.185 DEBUG:teuthology.orchestra.run.smithi203:> sudo shutdown -r now 2024-09-10T23:45:26.110 INFO:teuthology.orchestra.run.smithi111.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T23:45:26.147 INFO:teuthology.orchestra.run.smithi111.stderr:done 2024-09-10T23:45:26.149 DEBUG:teuthology.orchestra.run.smithi111:> mktemp 2024-09-10T23:45:26.165 INFO:teuthology.orchestra.run.smithi111.stdout:/tmp/tmp.9HYxB27vyY 2024-09-10T23:45:26.165 DEBUG:teuthology.orchestra.run.smithi111:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.9HYxB27vyY 2024-09-10T23:45:26.233 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0666 /tmp/tmp.9HYxB27vyY 2024-09-10T23:45:26.370 DEBUG:teuthology.orchestra.remote:smithi111:/tmp/tmp.9HYxB27vyY is 6KB 2024-09-10T23:45:26.418 DEBUG:teuthology.orchestra.run.smithi111:> rm -fr /tmp/tmp.9HYxB27vyY 2024-09-10T23:45:26.433 DEBUG:teuthology.orchestra.run.smithi111:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T23:45:26.496 INFO:teuthology.orchestra.run.smithi111.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T23:45:26.496 INFO:teuthology.orchestra.run.smithi111.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T23:45:26.496 INFO:teuthology.orchestra.run.smithi111.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T23:45:26.496 INFO:teuthology.orchestra.run.smithi111.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-10T23:45:26.497 DEBUG:teuthology.orchestra.run.smithi111:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:45:26.645 DEBUG:teuthology.orchestra.run.smithi111:> sudo shutdown -r now 2024-09-10T23:45:55.217 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-10T23:45:55.217 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-10T23:45:55.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:45:56.663 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-10T23:45:56.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-10T23:45:56.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:46:29.821 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-09-10T23:46:31.361 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-09-10T23:46:38.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-10T23:46:38.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:46:40.364 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-10T23:46:40.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:46:43.453 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-09-10T23:46:55.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-10T23:46:55.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:46:57.217 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-09-10T23:47:09.229 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-10T23:47:09.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:47:11.740 DEBUG:teuthology.orchestra.run.smithi203:> true 2024-09-10T23:47:12.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-10T23:47:12.300 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-10T23:47:12.300 DEBUG:teuthology.orchestra.run.smithi203:> uname -r 2024-09-10T23:47:12.336 INFO:teuthology.orchestra.run.smithi203.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:47:12.336 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:47:12.336 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T23:47:12.336 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T23:47:13.337 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-10T23:47:13.337 DEBUG:teuthology.orchestra.run.smithi203:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T23:47:13.474 INFO:teuthology.orchestra.run.smithi203.stdout:ttyS1 2024-09-10T23:47:13.496 DEBUG:teuthology.parallel:result is None 2024-09-10T23:47:27.378 DEBUG:teuthology.orchestra.run.smithi111:> true 2024-09-10T23:47:28.019 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-10T23:47:28.019 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-10T23:47:28.020 DEBUG:teuthology.orchestra.run.smithi111:> uname -r 2024-09-10T23:47:28.053 INFO:teuthology.orchestra.run.smithi111.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:47:28.053 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:47:28.053 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T23:47:28.053 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T23:47:29.054 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-10T23:47:29.054 DEBUG:teuthology.orchestra.run.smithi111:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T23:47:29.215 INFO:teuthology.orchestra.run.smithi111.stdout:ttyS1 2024-09-10T23:47:29.249 DEBUG:teuthology.parallel:result is None 2024-09-10T23:47:29.249 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T23:47:29.257 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T23:47:29.257 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T23:47:29.261 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T23:47:29.303 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T23:47:29.309 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T23:47:29.338 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T23:47:29.339 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T23:47:29.343 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T23:47:29.395 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T23:47:29.401 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T23:47:29.401 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T23:47:29.405 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T23:47:29.461 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:47:29.483 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:47:29.489 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:47:29.512 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:47:29.516 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T23:47:29.523 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T23:47:29.523 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T23:47:29.527 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T23:47:29.583 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T23:47:29.592 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T23:47:29.592 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T23:47:29.596 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T23:47:29.630 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:47:29.737 DEBUG:teuthology.orchestra.run.smithi111:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:47:29.816 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:47:29.888 DEBUG:teuthology.orchestra.run.smithi111:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:47:29.950 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-10T23:47:29.950 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T23:47:30.005 DEBUG:teuthology.orchestra.run.smithi203:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:47:30.077 DEBUG:teuthology.orchestra.run.smithi203:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:47:30.150 DEBUG:teuthology.orchestra.run.smithi203:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:47:30.220 DEBUG:teuthology.orchestra.run.smithi203:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:47:30.283 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-10T23:47:30.283 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T23:47:30.337 DEBUG:teuthology.orchestra.run.smithi111:> sudo service rsyslog restart 2024-09-10T23:47:30.341 DEBUG:teuthology.orchestra.run.smithi203:> sudo service rsyslog restart 2024-09-10T23:47:30.435 INFO:teuthology.orchestra.run.smithi111.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:47:30.469 INFO:teuthology.orchestra.run.smithi203.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:47:30.851 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T23:47:30.859 INFO:teuthology.task.internal:Starting timer... 2024-09-10T23:47:30.860 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T23:47:30.901 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T23:47:30.933 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-10T23:47:30.933 DEBUG:teuthology.orchestra.run.smithi111:> sudo service auditd rotate 2024-09-10T23:47:31.032 INFO:teuthology.orchestra.run.smithi111.stdout:Rotating logs: 2024-09-10T23:47:31.036 DEBUG:teuthology.orchestra.run.smithi203:> sudo service auditd rotate 2024-09-10T23:47:31.137 INFO:teuthology.orchestra.run.smithi203.stdout:Rotating logs: 2024-09-10T23:47:31.140 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T23:47:31.140 DEBUG:teuthology.orchestra.run.smithi111:> /usr/sbin/getenforce 2024-09-10T23:47:31.194 INFO:teuthology.orchestra.run.smithi111.stdout:Permissive 2024-09-10T23:47:31.195 DEBUG:teuthology.orchestra.run.smithi203:> /usr/sbin/getenforce 2024-09-10T23:47:31.232 INFO:teuthology.orchestra.run.smithi203.stdout:Permissive 2024-09-10T23:47:31.232 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi111.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi203.front.sepia.ceph.com': 'permissive'} 2024-09-10T23:47:31.232 DEBUG:teuthology.orchestra.run.smithi111:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T23:47:31.288 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:47:31.288 DEBUG:teuthology.orchestra.run.smithi203:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T23:47:31.344 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:47:31.345 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T23:47:31.345 DEBUG:teuthology.orchestra.run.smithi111:> sudo /usr/sbin/setenforce permissive 2024-09-10T23:47:31.410 DEBUG:teuthology.orchestra.run.smithi203:> sudo /usr/sbin/setenforce permissive 2024-09-10T23:47:31.482 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T23:47:31.491 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-10T23:47:31.494 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-10T23:47:31.647 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T23:47:31.658 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T23:47:31.659 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi111.front.sepia.ceph.com,smithi203.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T23:52:12.196 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi111.front.sepia.ceph.com'), Remote(name='ubuntu@smithi203.front.sepia.ceph.com')] 2024-09-10T23:52:12.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-10T23:52:12.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:52:12.300 DEBUG:teuthology.orchestra.run.smithi111:> true 2024-09-10T23:52:12.415 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-10T23:52:12.415 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-10T23:52:12.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:52:12.507 DEBUG:teuthology.orchestra.run.smithi203:> true 2024-09-10T23:52:12.615 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-10T23:52:12.615 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T23:52:12.626 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T23:52:12.626 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T23:52:12.626 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:52:12.631 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T23:52:12.631 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:52:12.686 INFO:teuthology.orchestra.run.smithi111.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T23:52:12.714 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T23:52:12.715 INFO:teuthology.orchestra.run.smithi111.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T23:52:12.744 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T23:52:12.767 INFO:teuthology.orchestra.run.smithi111.stderr:sudo: ntpd: command not found 2024-09-10T23:52:12.791 INFO:teuthology.orchestra.run.smithi111.stdout:506 Cannot talk to daemon 2024-09-10T23:52:12.794 INFO:teuthology.orchestra.run.smithi203.stderr:sudo: ntpd: command not found 2024-09-10T23:52:12.819 INFO:teuthology.orchestra.run.smithi203.stdout:506 Cannot talk to daemon 2024-09-10T23:52:12.820 INFO:teuthology.orchestra.run.smithi111.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T23:52:12.849 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T23:52:12.850 INFO:teuthology.orchestra.run.smithi111.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T23:52:12.879 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T23:52:12.944 INFO:teuthology.orchestra.run.smithi111.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:52:12.951 INFO:teuthology.orchestra.run.smithi111.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:52:12.951 INFO:teuthology.orchestra.run.smithi111.stdout:=============================================================================== 2024-09-10T23:52:12.951 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:52:12.951 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:52:12.951 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:52:12.951 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:52:12.978 INFO:teuthology.orchestra.run.smithi203.stderr:bash: line 1: ntpq: command not found 2024-09-10T23:52:12.985 INFO:teuthology.orchestra.run.smithi203.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T23:52:12.985 INFO:teuthology.orchestra.run.smithi203.stdout:=============================================================================== 2024-09-10T23:52:12.985 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:52:12.986 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:52:12.986 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:52:12.986 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T23:52:12.987 INFO:teuthology.run_tasks:Running task install... 2024-09-10T23:52:12.995 DEBUG:teuthology.task.install:project ceph 2024-09-10T23:52:12.995 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}} 2024-09-10T23:52:12.996 DEBUG:teuthology.task.install:config {'exclude_packages': ['ceph-volume'], 'tag': 'v18.2.0', 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'} 2024-09-10T23:52:12.996 INFO:teuthology.task.install:Using flavor: default 2024-09-10T23:52:13.003 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T23:52:13.004 INFO:teuthology.task.install:extra packages: [] 2024-09-10T23:52:13.004 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': 'v18.2.0', 'wait_for_package': False} 2024-09-10T23:52:13.005 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-10T23:52:13.005 INFO:teuthology.packaging:ref: None 2024-09-10T23:52:13.005 INFO:teuthology.packaging:tag: v18.2.0 2024-09-10T23:52:13.005 INFO:teuthology.packaging:branch: None 2024-09-10T23:52:13.005 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:52:13.176 DEBUG:teuthology.repo_utils:git ls-remote https://github.com/ceph/ceph-ci v18.2.0^{} -> 5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-10T23:52:13.177 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-10T23:52:13.179 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': 'v18.2.0', 'wait_for_package': False} 2024-09-10T23:52:13.179 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-10T23:52:13.179 INFO:teuthology.packaging:ref: None 2024-09-10T23:52:13.179 INFO:teuthology.packaging:tag: v18.2.0 2024-09-10T23:52:13.179 INFO:teuthology.packaging:branch: None 2024-09-10T23:52:13.179 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:52:13.179 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-10T23:52:13.335 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/ 2024-09-10T23:52:13.336 INFO:teuthology.task.install.rpm:Package version is 18.2.0-0 2024-09-10T23:52:13.353 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/ 2024-09-10T23:52:13.353 INFO:teuthology.task.install.rpm:Package version is 18.2.0-0 2024-09-10T23:52:13.401 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T23:52:13.401 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-10T23:52:13.401 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T23:52:13.407 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T23:52:13.407 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-10T23:52:13.407 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T23:52:13.458 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-10T23:52:13.458 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-10T23:52:13.458 INFO:teuthology.packaging:ref: None 2024-09-10T23:52:13.458 INFO:teuthology.packaging:tag: v18.2.0 2024-09-10T23:52:13.458 INFO:teuthology.packaging:branch: None 2024-09-10T23:52:13.458 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:52:13.458 DEBUG:teuthology.orchestra.run.smithi111:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T23:52:13.463 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-10T23:52:13.464 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-10T23:52:13.464 INFO:teuthology.packaging:ref: None 2024-09-10T23:52:13.464 INFO:teuthology.packaging:tag: v18.2.0 2024-09-10T23:52:13.464 INFO:teuthology.packaging:branch: None 2024-09-10T23:52:13.464 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:52:13.464 DEBUG:teuthology.orchestra.run.smithi203:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T23:52:13.555 DEBUG:teuthology.orchestra.run.smithi111:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T23:52:13.561 DEBUG:teuthology.orchestra.run.smithi203:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T23:52:13.633 DEBUG:teuthology.orchestra.run.smithi111:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T23:52:13.640 DEBUG:teuthology.orchestra.run.smithi203:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T23:52:13.688 INFO:teuthology.orchestra.run.smithi111.stdout:check_obsoletes = 1 2024-09-10T23:52:13.691 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum clean all 2024-09-10T23:52:13.695 INFO:teuthology.orchestra.run.smithi203.stdout:check_obsoletes = 1 2024-09-10T23:52:13.698 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum clean all 2024-09-10T23:52:13.954 INFO:teuthology.orchestra.run.smithi111.stdout:45 files removed 2024-09-10T23:52:13.966 INFO:teuthology.orchestra.run.smithi203.stdout:45 files removed 2024-09-10T23:52:13.988 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-radosgw 2024-09-10T23:52:13.999 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-radosgw 2024-09-10T23:52:14.501 INFO:teuthology.orchestra.run.smithi203.stdout:ceph packages for x86_64 736 kB/s | 76 kB 00:00 2024-09-10T23:52:14.527 INFO:teuthology.orchestra.run.smithi111.stdout:ceph packages for x86_64 521 kB/s | 76 kB 00:00 2024-09-10T23:52:14.641 INFO:teuthology.orchestra.run.smithi203.stdout:ceph noarch packages 98 kB/s | 9.3 kB 00:00 2024-09-10T23:52:14.652 INFO:teuthology.orchestra.run.smithi111.stdout:ceph noarch packages 120 kB/s | 9.3 kB 00:00 2024-09-10T23:52:14.786 INFO:teuthology.orchestra.run.smithi111.stdout:ceph source packages 22 kB/s | 2.2 kB 00:00 2024-09-10T23:52:14.884 INFO:teuthology.orchestra.run.smithi203.stdout:ceph source packages 11 kB/s | 2.2 kB 00:00 2024-09-10T23:52:15.684 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-10T23:52:17.370 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 9 - BaseOS 3.2 MB/s | 8.2 MB 00:02 2024-09-10T23:52:19.588 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:01 2024-09-10T23:52:20.377 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - AppStream 5.7 MB/s | 20 MB 00:03 2024-09-10T23:52:24.022 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-10T23:52:25.565 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 9 - Extras packages 78 kB/s | 19 kB 00:00 2024-09-10T23:52:26.178 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.5 MB 00:01 2024-09-10T23:52:26.869 INFO:teuthology.orchestra.run.smithi111.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-10T23:52:27.912 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-10T23:52:28.817 INFO:teuthology.orchestra.run.smithi203.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-10T23:52:33.183 INFO:teuthology.orchestra.run.smithi111.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-10T23:52:35.214 INFO:teuthology.orchestra.run.smithi203.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-10T23:52:35.719 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-10T23:52:35.747 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:52:35.747 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2024-09-10T23:52:35.747 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:52:35.747 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-10T23:52:35.747 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-radosgw x86_64 2:18.2.0-0.el9 ceph 7.6 M 2024-09-10T23:52:35.747 INFO:teuthology.orchestra.run.smithi111.stdout:Upgrading: 2024-09-10T23:52:35.748 INFO:teuthology.orchestra.run.smithi111.stdout: librados2 x86_64 2:18.2.0-0.el9 ceph 3.3 M 2024-09-10T23:52:35.748 INFO:teuthology.orchestra.run.smithi111.stdout: librbd1 x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-09-10T23:52:35.748 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-09-10T23:52:35.748 INFO:teuthology.orchestra.run.smithi111.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T23:52:35.748 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-base x86_64 2:18.2.0-0.el9 ceph 5.2 M 2024-09-10T23:52:35.748 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-common x86_64 2:18.2.0-0.el9 ceph 18 M 2024-09-10T23:52:35.748 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-selinux x86_64 2:18.2.0-0.el9 ceph 24 k 2024-09-10T23:52:35.748 INFO:teuthology.orchestra.run.smithi111.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-10T23:52:35.748 INFO:teuthology.orchestra.run.smithi111.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T23:52:35.748 INFO:teuthology.orchestra.run.smithi111.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T23:52:35.748 INFO:teuthology.orchestra.run.smithi111.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T23:52:35.748 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs2 x86_64 2:18.2.0-0.el9 ceph 653 k 2024-09-10T23:52:35.748 INFO:teuthology.orchestra.run.smithi111.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T23:52:35.749 INFO:teuthology.orchestra.run.smithi111.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T23:52:35.749 INFO:teuthology.orchestra.run.smithi111.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T23:52:35.749 INFO:teuthology.orchestra.run.smithi111.stdout: libradosstriper1 x86_64 2:18.2.0-0.el9 ceph 474 k 2024-09-10T23:52:35.749 INFO:teuthology.orchestra.run.smithi111.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T23:52:35.749 INFO:teuthology.orchestra.run.smithi111.stdout: librgw2 x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-09-10T23:52:35.749 INFO:teuthology.orchestra.run.smithi111.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T23:52:35.749 INFO:teuthology.orchestra.run.smithi111.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T23:52:35.749 INFO:teuthology.orchestra.run.smithi111.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T23:52:35.749 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-argparse x86_64 2:18.2.0-0.el9 ceph 45 k 2024-09-10T23:52:35.749 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-common x86_64 2:18.2.0-0.el9 ceph 119 k 2024-09-10T23:52:35.749 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cephfs x86_64 2:18.2.0-0.el9 ceph 155 k 2024-09-10T23:52:35.749 INFO:teuthology.orchestra.run.smithi111.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T23:52:35.749 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rados x86_64 2:18.2.0-0.el9 ceph 321 k 2024-09-10T23:52:35.749 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rbd x86_64 2:18.2.0-0.el9 ceph 297 k 2024-09-10T23:52:35.750 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rgw x86_64 2:18.2.0-0.el9 ceph 99 k 2024-09-10T23:52:35.750 INFO:teuthology.orchestra.run.smithi111.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T23:52:35.750 INFO:teuthology.orchestra.run.smithi111.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T23:52:35.750 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:52:35.750 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-10T23:52:35.750 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:52:35.750 INFO:teuthology.orchestra.run.smithi111.stdout:Install 28 Packages 2024-09-10T23:52:35.750 INFO:teuthology.orchestra.run.smithi111.stdout:Upgrade 2 Packages 2024-09-10T23:52:35.750 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:52:35.751 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 53 M 2024-09-10T23:52:35.751 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-10T23:52:36.378 INFO:teuthology.orchestra.run.smithi111.stdout:(1/30): ceph-base-18.2.0-0.el9.x86_64.rpm 30 MB/s | 5.2 MB 00:00 2024-09-10T23:52:36.411 INFO:teuthology.orchestra.run.smithi111.stdout:(2/30): ceph-selinux-18.2.0-0.el9.x86_64.rpm 765 kB/s | 24 kB 00:00 2024-09-10T23:52:36.452 INFO:teuthology.orchestra.run.smithi111.stdout:(3/30): libcephfs2-18.2.0-0.el9.x86_64.rpm 15 MB/s | 653 kB 00:00 2024-09-10T23:52:36.485 INFO:teuthology.orchestra.run.smithi111.stdout:(4/30): libradosstriper1-18.2.0-0.el9.x86_64.rp 14 MB/s | 474 kB 00:00 2024-09-10T23:52:36.627 INFO:teuthology.orchestra.run.smithi111.stdout:(5/30): librgw2-18.2.0-0.el9.x86_64.rpm 31 MB/s | 4.4 MB 00:00 2024-09-10T23:52:36.652 INFO:teuthology.orchestra.run.smithi111.stdout:(6/30): python3-ceph-argparse-18.2.0-0.el9.x86_ 1.8 MB/s | 45 kB 00:00 2024-09-10T23:52:36.678 INFO:teuthology.orchestra.run.smithi111.stdout:(7/30): python3-ceph-common-18.2.0-0.el9.x86_64 4.7 MB/s | 119 kB 00:00 2024-09-10T23:52:36.778 INFO:teuthology.orchestra.run.smithi111.stdout:(8/30): ceph-radosgw-18.2.0-0.el9.x86_64.rpm 13 MB/s | 7.6 MB 00:00 2024-09-10T23:52:36.803 INFO:teuthology.orchestra.run.smithi111.stdout:(9/30): python3-cephfs-18.2.0-0.el9.x86_64.rpm 1.2 MB/s | 155 kB 00:00 2024-09-10T23:52:36.837 INFO:teuthology.orchestra.run.smithi111.stdout:(10/30): python3-rados-18.2.0-0.el9.x86_64.rpm 5.4 MB/s | 321 kB 00:00 2024-09-10T23:52:36.862 INFO:teuthology.orchestra.run.smithi111.stdout:(11/30): python3-rbd-18.2.0-0.el9.x86_64.rpm 4.9 MB/s | 297 kB 00:00 2024-09-10T23:52:36.887 INFO:teuthology.orchestra.run.smithi111.stdout:(12/30): python3-rgw-18.2.0-0.el9.x86_64.rpm 1.9 MB/s | 99 kB 00:00 2024-09-10T23:52:37.113 INFO:teuthology.orchestra.run.smithi111.stdout:(13/30): ceph-common-18.2.0-0.el9.x86_64.rpm 20 MB/s | 18 MB 00:00 2024-09-10T23:52:37.163 INFO:teuthology.orchestra.run.smithi111.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 356 kB/s | 107 kB 00:00 2024-09-10T23:52:37.197 INFO:teuthology.orchestra.run.smithi111.stdout:(15/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 518 kB/s | 160 kB 00:00 2024-09-10T23:52:37.283 INFO:teuthology.orchestra.run.smithi111.stdout:(16/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 268 kB/s | 45 kB 00:00 2024-09-10T23:52:37.308 INFO:teuthology.orchestra.run.smithi111.stdout:(17/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-10T23:52:37.342 INFO:teuthology.orchestra.run.smithi111.stdout:(18/30): librdkafka-1.6.1-102.el9.x86_64.rpm 3.6 MB/s | 662 kB 00:00 2024-09-10T23:52:37.375 INFO:teuthology.orchestra.run.smithi111.stdout:(19/30): python3-prettytable-0.7.2-27.el9.noarc 458 kB/s | 42 kB 00:00 2024-09-10T23:52:37.425 INFO:teuthology.orchestra.run.smithi111.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 948 kB/s | 111 kB 00:00 2024-09-10T23:52:37.451 INFO:teuthology.orchestra.run.smithi111.stdout:(21/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-10T23:52:37.476 INFO:teuthology.orchestra.run.smithi111.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T23:52:37.502 INFO:teuthology.orchestra.run.smithi111.stdout:(23/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 2.0 MB/s | 309 kB 00:00 2024-09-10T23:52:37.527 INFO:teuthology.orchestra.run.smithi111.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-10T23:52:37.560 INFO:teuthology.orchestra.run.smithi111.stdout:(25/30): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2024-09-10T23:52:37.602 INFO:teuthology.orchestra.run.smithi111.stdout:(26/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-10T23:52:37.678 INFO:teuthology.orchestra.run.smithi111.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-10T23:52:37.743 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-10T23:52:37.744 INFO:teuthology.orchestra.run.smithi111.stdout:(28/30): librados2-18.2.0-0.el9.x86_64.rpm 23 MB/s | 3.3 MB 00:00 2024-09-10T23:52:37.757 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:52:37.757 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-09-10T23:52:37.757 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:52:37.758 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-10T23:52:37.758 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-radosgw x86_64 2:18.2.0-0.el9 ceph 7.6 M 2024-09-10T23:52:37.758 INFO:teuthology.orchestra.run.smithi203.stdout:Upgrading: 2024-09-10T23:52:37.758 INFO:teuthology.orchestra.run.smithi203.stdout: librados2 x86_64 2:18.2.0-0.el9 ceph 3.3 M 2024-09-10T23:52:37.758 INFO:teuthology.orchestra.run.smithi203.stdout: librbd1 x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-09-10T23:52:37.758 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-09-10T23:52:37.758 INFO:teuthology.orchestra.run.smithi203.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T23:52:37.758 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-base x86_64 2:18.2.0-0.el9 ceph 5.2 M 2024-09-10T23:52:37.758 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-common x86_64 2:18.2.0-0.el9 ceph 18 M 2024-09-10T23:52:37.758 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-selinux x86_64 2:18.2.0-0.el9 ceph 24 k 2024-09-10T23:52:37.758 INFO:teuthology.orchestra.run.smithi203.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-10T23:52:37.758 INFO:teuthology.orchestra.run.smithi203.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T23:52:37.758 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T23:52:37.759 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T23:52:37.759 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs2 x86_64 2:18.2.0-0.el9 ceph 653 k 2024-09-10T23:52:37.759 INFO:teuthology.orchestra.run.smithi203.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T23:52:37.759 INFO:teuthology.orchestra.run.smithi203.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T23:52:37.759 INFO:teuthology.orchestra.run.smithi203.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T23:52:37.759 INFO:teuthology.orchestra.run.smithi203.stdout: libradosstriper1 x86_64 2:18.2.0-0.el9 ceph 474 k 2024-09-10T23:52:37.759 INFO:teuthology.orchestra.run.smithi203.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T23:52:37.759 INFO:teuthology.orchestra.run.smithi203.stdout: librgw2 x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-09-10T23:52:37.759 INFO:teuthology.orchestra.run.smithi203.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T23:52:37.759 INFO:teuthology.orchestra.run.smithi203.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T23:52:37.759 INFO:teuthology.orchestra.run.smithi203.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T23:52:37.759 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-argparse x86_64 2:18.2.0-0.el9 ceph 45 k 2024-09-10T23:52:37.759 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-common x86_64 2:18.2.0-0.el9 ceph 119 k 2024-09-10T23:52:37.760 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cephfs x86_64 2:18.2.0-0.el9 ceph 155 k 2024-09-10T23:52:37.760 INFO:teuthology.orchestra.run.smithi203.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T23:52:37.760 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rados x86_64 2:18.2.0-0.el9 ceph 321 k 2024-09-10T23:52:37.760 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rbd x86_64 2:18.2.0-0.el9 ceph 297 k 2024-09-10T23:52:37.760 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rgw x86_64 2:18.2.0-0.el9 ceph 99 k 2024-09-10T23:52:37.760 INFO:teuthology.orchestra.run.smithi203.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T23:52:37.760 INFO:teuthology.orchestra.run.smithi203.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T23:52:37.760 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:52:37.760 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-10T23:52:37.760 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:52:37.760 INFO:teuthology.orchestra.run.smithi203.stdout:Install 28 Packages 2024-09-10T23:52:37.760 INFO:teuthology.orchestra.run.smithi203.stdout:Upgrade 2 Packages 2024-09-10T23:52:37.760 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:52:37.761 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 53 M 2024-09-10T23:52:37.761 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-10T23:52:37.811 INFO:teuthology.orchestra.run.smithi111.stdout:(29/30): librbd1-18.2.0-0.el9.x86_64.rpm 22 MB/s | 3.0 MB 00:00 2024-09-10T23:52:37.878 INFO:teuthology.orchestra.run.smithi111.stdout:(30/30): libarrow-9.0.0-11.el9.x86_64.rpm 9.0 MB/s | 4.4 MB 00:00 2024-09-10T23:52:37.883 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:52:37.883 INFO:teuthology.orchestra.run.smithi111.stdout:Total 25 MB/s | 53 MB 00:02 2024-09-10T23:52:38.020 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-10T23:52:38.062 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-10T23:52:38.062 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-10T23:52:38.091 INFO:teuthology.orchestra.run.smithi203.stdout:(1/30): ceph-base-18.2.0-0.el9.x86_64.rpm 27 MB/s | 5.2 MB 00:00 2024-09-10T23:52:38.116 INFO:teuthology.orchestra.run.smithi203.stdout:(2/30): ceph-selinux-18.2.0-0.el9.x86_64.rpm 981 kB/s | 24 kB 00:00 2024-09-10T23:52:38.150 INFO:teuthology.orchestra.run.smithi203.stdout:(3/30): libcephfs2-18.2.0-0.el9.x86_64.rpm 19 MB/s | 653 kB 00:00 2024-09-10T23:52:38.183 INFO:teuthology.orchestra.run.smithi203.stdout:(4/30): libradosstriper1-18.2.0-0.el9.x86_64.rp 14 MB/s | 474 kB 00:00 2024-09-10T23:52:38.292 INFO:teuthology.orchestra.run.smithi203.stdout:(5/30): ceph-radosgw-18.2.0-0.el9.x86_64.rpm 19 MB/s | 7.6 MB 00:00 2024-09-10T23:52:38.317 INFO:teuthology.orchestra.run.smithi203.stdout:(6/30): python3-ceph-argparse-18.2.0-0.el9.x86_ 1.8 MB/s | 45 kB 00:00 2024-09-10T23:52:38.342 INFO:teuthology.orchestra.run.smithi203.stdout:(7/30): python3-ceph-common-18.2.0-0.el9.x86_64 4.7 MB/s | 119 kB 00:00 2024-09-10T23:52:38.368 INFO:teuthology.orchestra.run.smithi203.stdout:(8/30): python3-cephfs-18.2.0-0.el9.x86_64.rpm 6.1 MB/s | 155 kB 00:00 2024-09-10T23:52:38.402 INFO:teuthology.orchestra.run.smithi203.stdout:(9/30): python3-rados-18.2.0-0.el9.x86_64.rpm 9.4 MB/s | 321 kB 00:00 2024-09-10T23:52:38.435 INFO:teuthology.orchestra.run.smithi203.stdout:(10/30): python3-rbd-18.2.0-0.el9.x86_64.rpm 8.8 MB/s | 297 kB 00:00 2024-09-10T23:52:38.461 INFO:teuthology.orchestra.run.smithi203.stdout:(11/30): python3-rgw-18.2.0-0.el9.x86_64.rpm 3.9 MB/s | 99 kB 00:00 2024-09-10T23:52:38.594 INFO:teuthology.orchestra.run.smithi203.stdout:(12/30): librgw2-18.2.0-0.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-10T23:52:38.701 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-10T23:52:38.702 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-10T23:52:38.845 INFO:teuthology.orchestra.run.smithi203.stdout:(13/30): ceph-common-18.2.0-0.el9.x86_64.rpm 19 MB/s | 18 MB 00:00 2024-09-10T23:52:38.961 INFO:teuthology.orchestra.run.smithi203.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 213 kB/s | 107 kB 00:00 2024-09-10T23:52:39.220 INFO:teuthology.orchestra.run.smithi203.stdout:(15/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 121 kB/s | 45 kB 00:00 2024-09-10T23:52:39.305 INFO:teuthology.orchestra.run.smithi203.stdout:(16/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 226 kB/s | 160 kB 00:00 2024-09-10T23:52:39.346 INFO:teuthology.orchestra.run.smithi203.stdout:(17/30): librdkafka-1.6.1-102.el9.x86_64.rpm 1.7 MB/s | 662 kB 00:00 2024-09-10T23:52:39.396 INFO:teuthology.orchestra.run.smithi203.stdout:(18/30): fmt-8.1.1-5.el9.x86_64.rpm 2.2 MB/s | 111 kB 00:00 2024-09-10T23:52:39.422 INFO:teuthology.orchestra.run.smithi203.stdout:(19/30): python3-prettytable-0.7.2-27.el9.noarc 360 kB/s | 42 kB 00:00 2024-09-10T23:52:39.464 INFO:teuthology.orchestra.run.smithi203.stdout:(20/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 4.5 MB/s | 309 kB 00:00 2024-09-10T23:52:39.489 INFO:teuthology.orchestra.run.smithi203.stdout:(21/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-10T23:52:39.514 INFO:teuthology.orchestra.run.smithi203.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T23:52:39.540 INFO:teuthology.orchestra.run.smithi203.stdout:(23/30): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-10T23:52:39.590 INFO:teuthology.orchestra.run.smithi203.stdout:(24/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-10T23:52:39.624 INFO:teuthology.orchestra.run.smithi203.stdout:(25/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 725 kB/s | 292 kB 00:00 2024-09-10T23:52:39.666 INFO:teuthology.orchestra.run.smithi203.stdout:(26/30): re2-20211101-20.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-10T23:52:39.774 INFO:teuthology.orchestra.run.smithi203.stdout:(27/30): librados2-18.2.0-0.el9.x86_64.rpm 31 MB/s | 3.3 MB 00:00 2024-09-10T23:52:39.850 INFO:teuthology.orchestra.run.smithi203.stdout:(28/30): thrift-0.15.0-2.el9.x86_64.rpm 7.0 MB/s | 1.6 MB 00:00 2024-09-10T23:52:39.925 INFO:teuthology.orchestra.run.smithi203.stdout:(29/30): librbd1-18.2.0-0.el9.x86_64.rpm 20 MB/s | 3.0 MB 00:00 2024-09-10T23:52:40.000 INFO:teuthology.orchestra.run.smithi203.stdout:(30/30): libarrow-9.0.0-11.el9.x86_64.rpm 7.6 MB/s | 4.4 MB 00:00 2024-09-10T23:52:40.004 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:52:40.004 INFO:teuthology.orchestra.run.smithi203.stdout:Total 24 MB/s | 53 MB 00:02 2024-09-10T23:52:40.145 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-10T23:52:40.149 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-10T23:52:40.188 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-10T23:52:40.188 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-10T23:52:40.267 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-09-10T23:52:40.301 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-09-10T23:52:40.365 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-09-10T23:52:40.717 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-09-10T23:52:40.824 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : librados2-2:18.2.0-0.el9.x86_64 5/32 2024-09-10T23:52:40.876 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-10T23:52:40.877 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-10T23:52:40.995 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librados2-2:18.2.0-0.el9.x86_64 5/32 2024-09-10T23:52:41.082 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-rados-2:18.2.0-0.el9.x86_64 6/32 2024-09-10T23:52:41.109 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-09-10T23:52:41.224 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-09-10T23:52:41.259 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-09-10T23:52:41.304 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 9/32 2024-09-10T23:52:41.371 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-09-10T23:52:41.403 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-09-10T23:52:41.539 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-09-10T23:52:41.683 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/32 2024-09-10T23:52:41.720 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-09-10T23:52:41.764 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-09-10T23:52:41.792 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-09-10T23:52:41.820 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-09-10T23:52:41.856 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-09-10T23:52:41.889 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-09-10T23:52:42.224 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-09-10T23:52:42.275 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-09-10T23:52:42.349 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-10T23:52:42.420 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-09-10T23:52:42.449 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-rbd-2:18.2.0-0.el9.x86_64 21/32 2024-09-10T23:52:42.476 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-09-10T23:52:42.496 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-09-10T23:52:42.514 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-09-10T23:52:42.580 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-09-10T23:52:42.918 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-09-10T23:52:42.928 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-09-10T23:52:42.953 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-09-10T23:52:43.044 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-09-10T23:52:43.068 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : librados2-2:18.2.0-0.el9.x86_64 5/32 2024-09-10T23:52:43.125 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-rgw-2:18.2.0-0.el9.x86_64 25/32 2024-09-10T23:52:43.156 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-ceph-common-2:18.2.0-0.el9.x86_64 26/32 2024-09-10T23:52:43.184 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librados2-2:18.2.0-0.el9.x86_64 5/32 2024-09-10T23:52:43.272 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rados-2:18.2.0-0.el9.x86_64 6/32 2024-09-10T23:52:43.298 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-09-10T23:52:43.380 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-09-10T23:52:43.415 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-09-10T23:52:43.460 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 9/32 2024-09-10T23:52:43.527 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-09-10T23:52:43.559 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-09-10T23:52:43.628 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-09-10T23:52:43.801 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/32 2024-09-10T23:52:43.835 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-09-10T23:52:43.879 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-09-10T23:52:43.907 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-09-10T23:52:43.935 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-09-10T23:52:43.971 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-09-10T23:52:44.004 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-09-10T23:52:44.329 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-09-10T23:52:44.374 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-09-10T23:52:44.478 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-09-10T23:52:44.523 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rbd-2:18.2.0-0.el9.x86_64 21/32 2024-09-10T23:52:44.579 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-09-10T23:52:45.012 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-09-10T23:52:45.044 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-09-10T23:52:45.118 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-09-10T23:52:45.199 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rgw-2:18.2.0-0.el9.x86_64 25/32 2024-09-10T23:52:45.229 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ceph-common-2:18.2.0-0.el9.x86_64 26/32 2024-09-10T23:52:45.538 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-10T23:52:45.594 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-10T23:52:46.218 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-10T23:52:46.264 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-09-10T23:52:46.409 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-09-10T23:52:46.409 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T23:52:46.409 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T23:52:46.409 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:52:46.457 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-09-10T23:52:47.513 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-10T23:52:47.560 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-10T23:52:48.231 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-10T23:52:48.281 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-09-10T23:52:48.416 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-09-10T23:52:48.417 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T23:52:48.417 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T23:52:48.417 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:52:48.449 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-09-10T23:52:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-09-10T23:52:57.472 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /sys 2024-09-10T23:52:57.472 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /proc 2024-09-10T23:52:57.472 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /mnt 2024-09-10T23:52:57.472 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /var/tmp 2024-09-10T23:52:57.472 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /home 2024-09-10T23:52:57.472 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /root 2024-09-10T23:52:57.472 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /tmp 2024-09-10T23:52:57.472 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:52:58.291 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-09-10T23:52:58.344 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-09-10T23:52:58.344 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:52:58.344 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T23:52:58.344 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:52:58.344 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:52:58.344 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:52:58.349 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-10T23:52:58.519 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-10T23:52:58.519 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-10T23:52:59.845 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-09-10T23:52:59.845 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /sys 2024-09-10T23:52:59.846 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /proc 2024-09-10T23:52:59.846 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /mnt 2024-09-10T23:52:59.846 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /var/tmp 2024-09-10T23:52:59.846 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /home 2024-09-10T23:52:59.846 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /root 2024-09-10T23:52:59.847 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /tmp 2024-09-10T23:52:59.847 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:00.003 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-10T23:53:00.003 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-base-2:18.2.0-0.el9.x86_64 1/32 2024-09-10T23:53:00.003 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-common-2:18.2.0-0.el9.x86_64 2/32 2024-09-10T23:53:00.003 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-radosgw-2:18.2.0-0.el9.x86_64 3/32 2024-09-10T23:53:00.004 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-selinux-2:18.2.0-0.el9.x86_64 4/32 2024-09-10T23:53:00.004 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libcephfs2-2:18.2.0-0.el9.x86_64 5/32 2024-09-10T23:53:00.004 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libradosstriper1-2:18.2.0-0.el9.x86_64 6/32 2024-09-10T23:53:00.004 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librgw2-2:18.2.0-0.el9.x86_64 7/32 2024-09-10T23:53:00.004 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 8/32 2024-09-10T23:53:00.004 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-ceph-common-2:18.2.0-0.el9.x86_64 9/32 2024-09-10T23:53:00.004 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-09-10T23:53:00.004 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rados-2:18.2.0-0.el9.x86_64 11/32 2024-09-10T23:53:00.004 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rbd-2:18.2.0-0.el9.x86_64 12/32 2024-09-10T23:53:00.004 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rgw-2:18.2.0-0.el9.x86_64 13/32 2024-09-10T23:53:00.004 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-09-10T23:53:00.004 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-09-10T23:53:00.004 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-09-10T23:53:00.005 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-09-10T23:53:00.005 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-09-10T23:53:00.005 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-09-10T23:53:00.005 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-09-10T23:53:00.005 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-09-10T23:53:00.005 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-09-10T23:53:00.005 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-09-10T23:53:00.005 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-09-10T23:53:00.005 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-09-10T23:53:00.005 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-09-10T23:53:00.005 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : re2-1:20211101-20.el9.x86_64 27/32 2024-09-10T23:53:00.005 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-09-10T23:53:00.005 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librados2-2:18.2.0-0.el9.x86_64 29/32 2024-09-10T23:53:00.006 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-09-10T23:53:00.006 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librbd1-2:18.2.0-0.el9.x86_64 31/32 2024-09-10T23:53:00.689 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-09-10T23:53:00.689 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:00.689 INFO:teuthology.orchestra.run.smithi111.stdout:Upgraded: 2024-09-10T23:53:00.689 INFO:teuthology.orchestra.run.smithi111.stdout: librados2-2:18.2.0-0.el9.x86_64 librbd1-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:00.689 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-10T23:53:00.689 INFO:teuthology.orchestra.run.smithi111.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T23:53:00.689 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-base-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:00.690 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-common-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:00.690 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-radosgw-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:00.690 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-selinux-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:00.690 INFO:teuthology.orchestra.run.smithi111.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-10T23:53:00.690 INFO:teuthology.orchestra.run.smithi111.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T23:53:00.690 INFO:teuthology.orchestra.run.smithi111.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T23:53:00.690 INFO:teuthology.orchestra.run.smithi111.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T23:53:00.690 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs2-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:00.690 INFO:teuthology.orchestra.run.smithi111.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T23:53:00.690 INFO:teuthology.orchestra.run.smithi111.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T23:53:00.690 INFO:teuthology.orchestra.run.smithi111.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T23:53:00.690 INFO:teuthology.orchestra.run.smithi111.stdout: libradosstriper1-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:00.690 INFO:teuthology.orchestra.run.smithi111.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T23:53:00.691 INFO:teuthology.orchestra.run.smithi111.stdout: librgw2-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:00.691 INFO:teuthology.orchestra.run.smithi111.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T23:53:00.691 INFO:teuthology.orchestra.run.smithi111.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T23:53:00.691 INFO:teuthology.orchestra.run.smithi111.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T23:53:00.691 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-argparse-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:00.691 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-common-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:00.691 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cephfs-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:00.691 INFO:teuthology.orchestra.run.smithi111.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T23:53:00.691 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rados-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:00.691 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rbd-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:00.691 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rgw-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:00.691 INFO:teuthology.orchestra.run.smithi111.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T23:53:00.691 INFO:teuthology.orchestra.run.smithi111.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T23:53:00.691 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:00.692 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-10T23:53:00.693 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-09-10T23:53:00.749 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-09-10T23:53:00.749 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:53:00.749 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T23:53:00.749 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:53:00.749 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:53:00.749 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:00.754 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-10T23:53:00.862 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-10T23:53:00.863 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-10T23:53:01.172 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-test 2024-09-10T23:53:01.940 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:00:28 ago on Tue 10 Sep 2024 11:52:33 PM UTC. 2024-09-10T23:53:02.085 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-10T23:53:02.086 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:53:02.086 INFO:teuthology.orchestra.run.smithi111.stdout: Package Architecture Version Repository Size 2024-09-10T23:53:02.086 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:53:02.087 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-10T23:53:02.087 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-test x86_64 2:18.2.0-0.el9 ceph 40 M 2024-09-10T23:53:02.087 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-09-10T23:53:02.087 INFO:teuthology.orchestra.run.smithi111.stdout: libcephsqlite x86_64 2:18.2.0-0.el9 ceph 161 k 2024-09-10T23:53:02.087 INFO:teuthology.orchestra.run.smithi111.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T23:53:02.087 INFO:teuthology.orchestra.run.smithi111.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T23:53:02.087 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:02.087 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-10T23:53:02.087 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:53:02.087 INFO:teuthology.orchestra.run.smithi111.stdout:Install 4 Packages 2024-09-10T23:53:02.088 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:02.088 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 40 M 2024-09-10T23:53:02.088 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 165 M 2024-09-10T23:53:02.088 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-10T23:53:02.219 INFO:teuthology.orchestra.run.smithi111.stdout:(1/4): libcephsqlite-18.2.0-0.el9.x86_64.rpm 1.5 MB/s | 161 kB 00:00 2024-09-10T23:53:02.291 INFO:teuthology.orchestra.run.smithi111.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.7 MB/s | 304 kB 00:00 2024-09-10T23:53:02.311 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-10T23:53:02.311 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-base-2:18.2.0-0.el9.x86_64 1/32 2024-09-10T23:53:02.311 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-common-2:18.2.0-0.el9.x86_64 2/32 2024-09-10T23:53:02.311 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-radosgw-2:18.2.0-0.el9.x86_64 3/32 2024-09-10T23:53:02.311 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-selinux-2:18.2.0-0.el9.x86_64 4/32 2024-09-10T23:53:02.311 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephfs2-2:18.2.0-0.el9.x86_64 5/32 2024-09-10T23:53:02.311 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libradosstriper1-2:18.2.0-0.el9.x86_64 6/32 2024-09-10T23:53:02.311 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librgw2-2:18.2.0-0.el9.x86_64 7/32 2024-09-10T23:53:02.311 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 8/32 2024-09-10T23:53:02.311 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ceph-common-2:18.2.0-0.el9.x86_64 9/32 2024-09-10T23:53:02.311 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-09-10T23:53:02.311 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rados-2:18.2.0-0.el9.x86_64 11/32 2024-09-10T23:53:02.311 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rbd-2:18.2.0-0.el9.x86_64 12/32 2024-09-10T23:53:02.312 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rgw-2:18.2.0-0.el9.x86_64 13/32 2024-09-10T23:53:02.312 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-09-10T23:53:02.312 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-09-10T23:53:02.312 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-09-10T23:53:02.312 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-09-10T23:53:02.312 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-09-10T23:53:02.312 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-09-10T23:53:02.312 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-09-10T23:53:02.312 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-09-10T23:53:02.312 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-09-10T23:53:02.312 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-09-10T23:53:02.312 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-09-10T23:53:02.312 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-09-10T23:53:02.313 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-09-10T23:53:02.313 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : re2-1:20211101-20.el9.x86_64 27/32 2024-09-10T23:53:02.313 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-09-10T23:53:02.313 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados2-2:18.2.0-0.el9.x86_64 29/32 2024-09-10T23:53:02.313 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-09-10T23:53:02.313 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librbd1-2:18.2.0-0.el9.x86_64 31/32 2024-09-10T23:53:02.316 INFO:teuthology.orchestra.run.smithi111.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 657 kB/s | 64 kB 00:00 2024-09-10T23:53:02.833 INFO:teuthology.orchestra.run.smithi111.stdout:(4/4): ceph-test-18.2.0-0.el9.x86_64.rpm 55 MB/s | 40 MB 00:00 2024-09-10T23:53:02.836 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:53:02.836 INFO:teuthology.orchestra.run.smithi111.stdout:Total 54 MB/s | 40 MB 00:00 2024-09-10T23:53:02.886 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-10T23:53:02.909 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-10T23:53:02.909 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-10T23:53:03.010 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-09-10T23:53:03.010 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:03.011 INFO:teuthology.orchestra.run.smithi203.stdout:Upgraded: 2024-09-10T23:53:03.011 INFO:teuthology.orchestra.run.smithi203.stdout: librados2-2:18.2.0-0.el9.x86_64 librbd1-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:03.011 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-10T23:53:03.011 INFO:teuthology.orchestra.run.smithi203.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T23:53:03.011 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-base-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:03.011 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-common-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:03.011 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-radosgw-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:03.011 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-selinux-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:03.011 INFO:teuthology.orchestra.run.smithi203.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-10T23:53:03.011 INFO:teuthology.orchestra.run.smithi203.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T23:53:03.011 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T23:53:03.012 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T23:53:03.012 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs2-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:03.012 INFO:teuthology.orchestra.run.smithi203.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T23:53:03.012 INFO:teuthology.orchestra.run.smithi203.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T23:53:03.012 INFO:teuthology.orchestra.run.smithi203.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T23:53:03.012 INFO:teuthology.orchestra.run.smithi203.stdout: libradosstriper1-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:03.012 INFO:teuthology.orchestra.run.smithi203.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T23:53:03.012 INFO:teuthology.orchestra.run.smithi203.stdout: librgw2-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:03.012 INFO:teuthology.orchestra.run.smithi203.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T23:53:03.012 INFO:teuthology.orchestra.run.smithi203.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T23:53:03.012 INFO:teuthology.orchestra.run.smithi203.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T23:53:03.012 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-argparse-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:03.013 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-common-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:03.013 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cephfs-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:03.013 INFO:teuthology.orchestra.run.smithi203.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T23:53:03.013 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rados-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:03.013 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rbd-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:03.013 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rgw-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:03.013 INFO:teuthology.orchestra.run.smithi203.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T23:53:03.013 INFO:teuthology.orchestra.run.smithi203.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T23:53:03.013 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:03.013 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-10T23:53:03.279 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-10T23:53:03.280 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-10T23:53:03.376 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-test 2024-09-10T23:53:03.804 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-10T23:53:03.929 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-10T23:53:03.975 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-10T23:53:04.002 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libcephsqlite-2:18.2.0-0.el9.x86_64 3/4 2024-09-10T23:53:04.148 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:00:29 ago on Tue 10 Sep 2024 11:52:35 PM UTC. 2024-09-10T23:53:04.291 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-10T23:53:04.292 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:53:04.292 INFO:teuthology.orchestra.run.smithi203.stdout: Package Architecture Version Repository Size 2024-09-10T23:53:04.292 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:53:04.292 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-10T23:53:04.292 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-test x86_64 2:18.2.0-0.el9 ceph 40 M 2024-09-10T23:53:04.292 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-09-10T23:53:04.292 INFO:teuthology.orchestra.run.smithi203.stdout: libcephsqlite x86_64 2:18.2.0-0.el9 ceph 161 k 2024-09-10T23:53:04.292 INFO:teuthology.orchestra.run.smithi203.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T23:53:04.293 INFO:teuthology.orchestra.run.smithi203.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T23:53:04.293 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:04.293 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-10T23:53:04.293 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:53:04.293 INFO:teuthology.orchestra.run.smithi203.stdout:Install 4 Packages 2024-09-10T23:53:04.293 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:04.293 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 40 M 2024-09-10T23:53:04.294 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 165 M 2024-09-10T23:53:04.294 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-10T23:53:04.611 INFO:teuthology.orchestra.run.smithi203.stdout:(1/4): libcephsqlite-18.2.0-0.el9.x86_64.rpm 2.6 MB/s | 161 kB 00:00 2024-09-10T23:53:04.720 INFO:teuthology.orchestra.run.smithi203.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.8 MB/s | 304 kB 00:00 2024-09-10T23:53:04.745 INFO:teuthology.orchestra.run.smithi203.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 478 kB/s | 64 kB 00:00 2024-09-10T23:53:05.320 INFO:teuthology.orchestra.run.smithi203.stdout:(4/4): ceph-test-18.2.0-0.el9.x86_64.rpm 51 MB/s | 40 MB 00:00 2024-09-10T23:53:05.322 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:53:05.323 INFO:teuthology.orchestra.run.smithi203.stdout:Total 39 MB/s | 40 MB 00:01 2024-09-10T23:53:05.371 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-10T23:53:05.394 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-10T23:53:05.394 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-10T23:53:05.764 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-10T23:53:05.765 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-10T23:53:06.295 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-10T23:53:06.387 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-10T23:53:06.438 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-10T23:53:06.464 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephsqlite-2:18.2.0-0.el9.x86_64 3/4 2024-09-10T23:53:08.033 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libcephsqlite-2:18.2.0-0.el9.x86_64 3/4 2024-09-10T23:53:08.111 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-test-2:18.2.0-0.el9.x86_64 4/4 2024-09-10T23:53:10.267 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-test-2:18.2.0-0.el9.x86_64 4/4 2024-09-10T23:53:10.267 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-test-2:18.2.0-0.el9.x86_64 1/4 2024-09-10T23:53:10.267 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libcephsqlite-2:18.2.0-0.el9.x86_64 2/4 2024-09-10T23:53:10.267 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-10T23:53:10.494 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libcephsqlite-2:18.2.0-0.el9.x86_64 3/4 2024-09-10T23:53:10.536 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-10T23:53:10.536 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:10.536 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-10T23:53:10.536 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-test-2:18.2.0-0.el9.x86_64 libcephsqlite-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:10.536 INFO:teuthology.orchestra.run.smithi111.stdout: socat-1.7.4.1-6.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T23:53:10.536 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:10.536 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-10T23:53:10.597 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-test-2:18.2.0-0.el9.x86_64 4/4 2024-09-10T23:53:10.861 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph 2024-09-10T23:53:11.614 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:00:38 ago on Tue 10 Sep 2024 11:52:33 PM UTC. 2024-09-10T23:53:11.759 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-10T23:53:11.762 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:53:11.762 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2024-09-10T23:53:11.762 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:53:11.762 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-10T23:53:11.762 INFO:teuthology.orchestra.run.smithi111.stdout: ceph x86_64 2:18.2.0-0.el9 ceph 6.4 k 2024-09-10T23:53:11.762 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-09-10T23:53:11.762 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mds x86_64 2:18.2.0-0.el9 ceph 2.1 M 2024-09-10T23:53:11.763 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr x86_64 2:18.2.0-0.el9 ceph 1.4 M 2024-09-10T23:53:11.763 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-modules-core noarch 2:18.2.0-0.el9 ceph-noarch 240 k 2024-09-10T23:53:11.763 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mon x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-09-10T23:53:11.763 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-osd x86_64 2:18.2.0-0.el9 ceph 18 M 2024-09-10T23:53:11.763 INFO:teuthology.orchestra.run.smithi111.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T23:53:11.763 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T23:53:11.763 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T23:53:11.763 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T23:53:11.763 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T23:53:11.763 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T23:53:11.763 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T23:53:11.763 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T23:53:11.763 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T23:53:11.764 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T23:53:11.764 INFO:teuthology.orchestra.run.smithi111.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T23:53:11.764 INFO:teuthology.orchestra.run.smithi111.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T23:53:11.764 INFO:teuthology.orchestra.run.smithi111.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T23:53:11.764 INFO:teuthology.orchestra.run.smithi111.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T23:53:11.764 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T23:53:11.764 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T23:53:11.764 INFO:teuthology.orchestra.run.smithi111.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T23:53:11.764 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T23:53:11.764 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T23:53:11.764 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T23:53:11.764 INFO:teuthology.orchestra.run.smithi111.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T23:53:11.765 INFO:teuthology.orchestra.run.smithi111.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T23:53:11.765 INFO:teuthology.orchestra.run.smithi111.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T23:53:11.765 INFO:teuthology.orchestra.run.smithi111.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T23:53:11.765 INFO:teuthology.orchestra.run.smithi111.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T23:53:11.765 INFO:teuthology.orchestra.run.smithi111.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T23:53:11.765 INFO:teuthology.orchestra.run.smithi111.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T23:53:11.765 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:11.765 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-10T23:53:11.765 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:53:11.765 INFO:teuthology.orchestra.run.smithi111.stdout:Install 33 Packages 2024-09-10T23:53:11.766 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:11.766 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 30 M 2024-09-10T23:53:11.766 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 109 M 2024-09-10T23:53:11.766 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-10T23:53:12.066 INFO:teuthology.orchestra.run.smithi111.stdout:(1/33): ceph-18.2.0-0.el9.x86_64.rpm 108 kB/s | 6.4 kB 00:00 2024-09-10T23:53:12.130 INFO:teuthology.orchestra.run.smithi111.stdout:(2/33): ceph-mgr-18.2.0-0.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-09-10T23:53:12.180 INFO:teuthology.orchestra.run.smithi111.stdout:(3/33): ceph-mds-18.2.0-0.el9.x86_64.rpm 12 MB/s | 2.1 MB 00:00 2024-09-10T23:53:12.214 INFO:teuthology.orchestra.run.smithi111.stdout:(4/33): ceph-mgr-modules-core-18.2.0-0.el9.noar 7.0 MB/s | 240 kB 00:00 2024-09-10T23:53:12.331 INFO:teuthology.orchestra.run.smithi111.stdout:(5/33): ceph-mon-18.2.0-0.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-09-10T23:53:12.598 INFO:teuthology.orchestra.run.smithi111.stdout:(6/33): ceph-osd-18.2.0-0.el9.x86_64.rpm 38 MB/s | 18 MB 00:00 2024-09-10T23:53:12.681 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-test-2:18.2.0-0.el9.x86_64 4/4 2024-09-10T23:53:12.681 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-test-2:18.2.0-0.el9.x86_64 1/4 2024-09-10T23:53:12.681 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephsqlite-2:18.2.0-0.el9.x86_64 2/4 2024-09-10T23:53:12.684 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-10T23:53:12.960 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-10T23:53:12.960 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:12.960 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-10T23:53:12.960 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-test-2:18.2.0-0.el9.x86_64 libcephsqlite-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:12.960 INFO:teuthology.orchestra.run.smithi203.stdout: socat-1.7.4.1-6.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T23:53:12.960 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:12.960 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-10T23:53:13.174 INFO:teuthology.orchestra.run.smithi111.stdout:(7/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 264 kB/s | 253 kB 00:00 2024-09-10T23:53:13.282 INFO:teuthology.orchestra.run.smithi111.stdout:(8/33): python3-ply-3.11-14.el9.noarch.rpm 158 kB/s | 106 kB 00:00 2024-09-10T23:53:13.343 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph 2024-09-10T23:53:13.607 INFO:teuthology.orchestra.run.smithi111.stdout:(9/33): python3-cryptography-36.0.1-4.el9.x86_6 984 kB/s | 1.2 MB 00:01 2024-09-10T23:53:13.966 INFO:teuthology.orchestra.run.smithi111.stdout:(10/33): python3-pycparser-2.20-6.el9.noarch.rp 171 kB/s | 135 kB 00:00 2024-09-10T23:53:14.033 INFO:teuthology.orchestra.run.smithi111.stdout:(11/33): python3-requests-2.25.1-8.el9.noarch.r 166 kB/s | 125 kB 00:00 2024-09-10T23:53:14.104 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:00:39 ago on Tue 10 Sep 2024 11:52:35 PM UTC. 2024-09-10T23:53:14.133 INFO:teuthology.orchestra.run.smithi111.stdout:(12/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.0 MB/s | 172 kB 00:00 2024-09-10T23:53:14.158 INFO:teuthology.orchestra.run.smithi111.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 278 kB/s | 35 kB 00:00 2024-09-10T23:53:14.184 INFO:teuthology.orchestra.run.smithi111.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-10T23:53:14.226 INFO:teuthology.orchestra.run.smithi111.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 625 kB/s | 42 kB 00:00 2024-09-10T23:53:14.252 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-10T23:53:14.254 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:53:14.254 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-09-10T23:53:14.254 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:53:14.254 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-10T23:53:14.254 INFO:teuthology.orchestra.run.smithi203.stdout: ceph x86_64 2:18.2.0-0.el9 ceph 6.4 k 2024-09-10T23:53:14.254 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-09-10T23:53:14.254 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mds x86_64 2:18.2.0-0.el9 ceph 2.1 M 2024-09-10T23:53:14.255 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr x86_64 2:18.2.0-0.el9 ceph 1.4 M 2024-09-10T23:53:14.255 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-modules-core noarch 2:18.2.0-0.el9 ceph-noarch 240 k 2024-09-10T23:53:14.255 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mon x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-09-10T23:53:14.255 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-osd x86_64 2:18.2.0-0.el9 ceph 18 M 2024-09-10T23:53:14.255 INFO:teuthology.orchestra.run.smithi203.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T23:53:14.255 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T23:53:14.255 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T23:53:14.255 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T23:53:14.255 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T23:53:14.255 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T23:53:14.255 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T23:53:14.255 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T23:53:14.255 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T23:53:14.256 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T23:53:14.256 INFO:teuthology.orchestra.run.smithi203.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T23:53:14.256 INFO:teuthology.orchestra.run.smithi203.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T23:53:14.256 INFO:teuthology.orchestra.run.smithi203.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T23:53:14.256 INFO:teuthology.orchestra.run.smithi203.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T23:53:14.256 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T23:53:14.256 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T23:53:14.256 INFO:teuthology.orchestra.run.smithi203.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T23:53:14.256 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T23:53:14.256 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T23:53:14.256 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T23:53:14.256 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T23:53:14.256 INFO:teuthology.orchestra.run.smithi203.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T23:53:14.256 INFO:teuthology.orchestra.run.smithi203.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T23:53:14.257 INFO:teuthology.orchestra.run.smithi203.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T23:53:14.257 INFO:teuthology.orchestra.run.smithi203.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T23:53:14.257 INFO:teuthology.orchestra.run.smithi203.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T23:53:14.257 INFO:teuthology.orchestra.run.smithi203.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T23:53:14.257 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:14.257 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-10T23:53:14.257 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:53:14.257 INFO:teuthology.orchestra.run.smithi203.stdout:Install 33 Packages 2024-09-10T23:53:14.257 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:14.258 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 30 M 2024-09-10T23:53:14.258 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 109 M 2024-09-10T23:53:14.258 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-10T23:53:14.268 INFO:teuthology.orchestra.run.smithi111.stdout:(16/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 522 kB/s | 43 kB 00:00 2024-09-10T23:53:14.309 INFO:teuthology.orchestra.run.smithi111.stdout:(17/33): python3-cherrypy-18.6.1-2.el9.noarch.r 8.9 MB/s | 358 kB 00:00 2024-09-10T23:53:14.335 INFO:teuthology.orchestra.run.smithi111.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 429 kB/s | 11 kB 00:00 2024-09-10T23:53:14.360 INFO:teuthology.orchestra.run.smithi111.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-10T23:53:14.394 INFO:teuthology.orchestra.run.smithi111.stdout:(20/33): python3-urllib3-1.26.5-6.el9.noarch.rp 274 kB/s | 215 kB 00:00 2024-09-10T23:53:14.419 INFO:teuthology.orchestra.run.smithi111.stdout:(21/33): python3-jaraco-classes-3.2.1-5.el9.noa 211 kB/s | 18 kB 00:00 2024-09-10T23:53:14.444 INFO:teuthology.orchestra.run.smithi111.stdout:(22/33): python3-jaraco-collections-3.0.0-8.el9 281 kB/s | 23 kB 00:00 2024-09-10T23:53:14.461 INFO:teuthology.orchestra.run.smithi111.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 626 kB/s | 20 kB 00:00 2024-09-10T23:53:14.478 INFO:teuthology.orchestra.run.smithi111.stdout:(24/33): python3-jaraco-functools-3.5.0-2.el9.n 231 kB/s | 19 kB 00:00 2024-09-10T23:53:14.495 INFO:teuthology.orchestra.run.smithi111.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 952 kB/s | 46 kB 00:00 2024-09-10T23:53:14.520 INFO:teuthology.orchestra.run.smithi111.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 1.3 MB/s | 79 kB 00:00 2024-09-10T23:53:14.537 INFO:teuthology.orchestra.run.smithi111.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 394 kB/s | 16 kB 00:00 2024-09-10T23:53:14.562 INFO:teuthology.orchestra.run.smithi111.stdout:(28/33): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-10T23:53:14.587 INFO:teuthology.orchestra.run.smithi111.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-10T23:53:14.613 INFO:teuthology.orchestra.run.smithi111.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-09-10T23:53:14.638 INFO:teuthology.orchestra.run.smithi111.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 808 kB/s | 20 kB 00:00 2024-09-10T23:53:14.663 INFO:teuthology.orchestra.run.smithi111.stdout:(32/33): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-10T23:53:14.688 INFO:teuthology.orchestra.run.smithi111.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-10T23:53:14.694 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:53:14.694 INFO:teuthology.orchestra.run.smithi111.stdout:Total 10 MB/s | 30 MB 00:02 2024-09-10T23:53:14.799 INFO:teuthology.orchestra.run.smithi203.stdout:(1/33): ceph-18.2.0-0.el9.x86_64.rpm 86 kB/s | 6.4 kB 00:00 2024-09-10T23:53:14.858 INFO:teuthology.orchestra.run.smithi203.stdout:(2/33): ceph-mgr-18.2.0-0.el9.x86_64.rpm 11 MB/s | 1.4 MB 00:00 2024-09-10T23:53:14.908 INFO:teuthology.orchestra.run.smithi203.stdout:(3/33): ceph-mds-18.2.0-0.el9.x86_64.rpm 11 MB/s | 2.1 MB 00:00 2024-09-10T23:53:14.918 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-10T23:53:14.942 INFO:teuthology.orchestra.run.smithi203.stdout:(4/33): ceph-mgr-modules-core-18.2.0-0.el9.noar 7.0 MB/s | 240 kB 00:00 2024-09-10T23:53:14.962 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-10T23:53:14.962 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-10T23:53:15.059 INFO:teuthology.orchestra.run.smithi203.stdout:(5/33): ceph-mon-18.2.0-0.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-09-10T23:53:15.342 INFO:teuthology.orchestra.run.smithi203.stdout:(6/33): ceph-osd-18.2.0-0.el9.x86_64.rpm 36 MB/s | 18 MB 00:00 2024-09-10T23:53:15.367 INFO:teuthology.orchestra.run.smithi203.stdout:(7/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 595 kB/s | 253 kB 00:00 2024-09-10T23:53:15.396 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-10T23:53:15.397 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-10T23:53:15.426 INFO:teuthology.orchestra.run.smithi203.stdout:(8/33): python3-pycparser-2.20-6.el9.noarch.rpm 2.3 MB/s | 135 kB 00:00 2024-09-10T23:53:15.476 INFO:teuthology.orchestra.run.smithi203.stdout:(9/33): python3-cryptography-36.0.1-4.el9.x86_6 2.9 MB/s | 1.2 MB 00:00 2024-09-10T23:53:15.502 INFO:teuthology.orchestra.run.smithi203.stdout:(10/33): python3-ply-3.11-14.el9.noarch.rpm 670 kB/s | 106 kB 00:00 2024-09-10T23:53:15.519 INFO:teuthology.orchestra.run.smithi203.stdout:(11/33): python3-requests-2.25.1-8.el9.noarch.r 1.3 MB/s | 125 kB 00:00 2024-09-10T23:53:15.544 INFO:teuthology.orchestra.run.smithi203.stdout:(12/33): python3-urllib3-1.26.5-6.el9.noarch.rp 3.1 MB/s | 215 kB 00:00 2024-09-10T23:53:15.627 INFO:teuthology.orchestra.run.smithi203.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 320 kB/s | 35 kB 00:00 2024-09-10T23:53:15.669 INFO:teuthology.orchestra.run.smithi203.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 408 kB/s | 51 kB 00:00 2024-09-10T23:53:15.687 INFO:teuthology.orchestra.run.smithi203.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 709 kB/s | 42 kB 00:00 2024-09-10T23:53:15.724 INFO:teuthology.orchestra.run.smithi203.stdout:(16/33): python3-mako-1.1.4-6.el9.noarch.rpm 776 kB/s | 172 kB 00:00 2024-09-10T23:53:15.783 INFO:teuthology.orchestra.run.smithi203.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 385 kB/s | 43 kB 00:00 2024-09-10T23:53:15.808 INFO:teuthology.orchestra.run.smithi203.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 464 kB/s | 11 kB 00:00 2024-09-10T23:53:15.834 INFO:teuthology.orchestra.run.smithi203.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 715 kB/s | 18 kB 00:00 2024-09-10T23:53:15.859 INFO:teuthology.orchestra.run.smithi203.stdout:(20/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.0 MB/s | 172 kB 00:00 2024-09-10T23:53:15.876 INFO:teuthology.orchestra.run.smithi203.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 553 kB/s | 23 kB 00:00 2024-09-10T23:53:15.893 INFO:teuthology.orchestra.run.smithi203.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 584 kB/s | 19 kB 00:00 2024-09-10T23:53:15.909 INFO:teuthology.orchestra.run.smithi203.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 588 kB/s | 20 kB 00:00 2024-09-10T23:53:15.927 INFO:teuthology.orchestra.run.smithi203.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 1.3 MB/s | 46 kB 00:00 2024-09-10T23:53:15.952 INFO:teuthology.orchestra.run.smithi203.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.8 MB/s | 79 kB 00:00 2024-09-10T23:53:15.977 INFO:teuthology.orchestra.run.smithi203.stdout:(26/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.5 MB/s | 358 kB 00:00 2024-09-10T23:53:15.994 INFO:teuthology.orchestra.run.smithi203.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 394 kB/s | 16 kB 00:00 2024-09-10T23:53:16.011 INFO:teuthology.orchestra.run.smithi203.stdout:(28/33): python3-tempora-5.0.0-2.el9.noarch.rpm 2.1 MB/s | 36 kB 00:00 2024-09-10T23:53:16.036 INFO:teuthology.orchestra.run.smithi203.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-09-10T23:53:16.062 INFO:teuthology.orchestra.run.smithi203.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-09-10T23:53:16.079 INFO:teuthology.orchestra.run.smithi203.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2024-09-10T23:53:16.104 INFO:teuthology.orchestra.run.smithi203.stdout:(32/33): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-10T23:53:16.137 INFO:teuthology.orchestra.run.smithi203.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.1 MB/s | 427 kB 00:00 2024-09-10T23:53:16.142 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:53:16.142 INFO:teuthology.orchestra.run.smithi203.stdout:Total 16 MB/s | 30 MB 00:01 2024-09-10T23:53:16.362 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-10T23:53:16.406 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-10T23:53:16.406 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-10T23:53:16.837 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-10T23:53:16.864 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-10T23:53:16.865 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-10T23:53:16.925 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-09-10T23:53:16.968 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-09-10T23:53:17.017 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-09-10T23:53:17.121 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-09-10T23:53:17.240 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-09-10T23:53:17.296 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/33 2024-09-10T23:53:17.339 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-09-10T23:53:17.384 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-09-10T23:53:17.436 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-09-10T23:53:17.469 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-09-10T23:53:17.511 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-09-10T23:53:17.555 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-09-10T23:53:17.587 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-09-10T23:53:17.627 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-09-10T23:53:17.727 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-09-10T23:53:17.907 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-09-10T23:53:18.004 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-09-10T23:53:18.115 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-09-10T23:53:18.169 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-09-10T23:53:18.229 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-09-10T23:53:18.262 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-10T23:53:18.292 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-09-10T23:53:18.325 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-09-10T23:53:18.367 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-09-10T23:53:18.408 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-09-10T23:53:18.514 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-09-10T23:53:18.518 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-09-10T23:53:18.581 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-09-10T23:53:18.615 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-09-10T23:53:18.666 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-09-10T23:53:18.672 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/33 2024-09-10T23:53:18.714 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-09-10T23:53:18.751 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-09-10T23:53:18.776 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-09-10T23:53:18.785 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-09-10T23:53:18.813 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-09-10T23:53:18.819 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-09-10T23:53:18.879 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-09-10T23:53:18.938 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-09-10T23:53:18.953 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-09-10T23:53:18.970 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-09-10T23:53:19.009 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-09-10T23:53:19.111 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-09-10T23:53:19.138 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 28/33 2024-09-10T23:53:19.171 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-09-10T23:53:19.224 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-09-10T23:53:19.224 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:53:19.224 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T23:53:19.224 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:53:19.225 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:53:19.225 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:19.285 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-09-10T23:53:19.386 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-09-10T23:53:19.450 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-09-10T23:53:19.494 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-09-10T23:53:19.571 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-09-10T23:53:19.636 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-09-10T23:53:19.865 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-09-10T23:53:19.924 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-09-10T23:53:20.012 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-09-10T23:53:20.119 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-09-10T23:53:20.180 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-09-10T23:53:20.332 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-09-10T23:53:20.514 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 28/33 2024-09-10T23:53:20.547 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-09-10T23:53:20.600 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-09-10T23:53:20.600 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:53:20.600 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T23:53:20.600 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:53:20.600 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T23:53:20.601 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:20.931 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-09-10T23:53:20.990 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-09-10T23:53:20.990 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:53:20.990 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T23:53:20.990 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:53:20.990 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:53:20.991 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:21.482 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-09-10T23:53:21.532 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-09-10T23:53:21.532 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:53:21.533 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T23:53:21.533 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:53:21.533 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:53:21.533 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:21.765 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-09-10T23:53:21.817 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-09-10T23:53:21.817 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:53:21.817 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T23:53:21.817 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:53:21.817 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:53:21.818 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:21.905 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-2:18.2.0-0.el9.x86_64 33/33 2024-09-10T23:53:22.021 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-2:18.2.0-0.el9.x86_64 33/33 2024-09-10T23:53:22.021 INFO:teuthology.orchestra.run.smithi111.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-10T23:53:22.021 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:22.308 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-09-10T23:53:22.368 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-09-10T23:53:22.368 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:53:22.369 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T23:53:22.369 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:53:22.369 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T23:53:22.369 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:22.859 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-09-10T23:53:22.909 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-09-10T23:53:22.909 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:53:22.910 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T23:53:22.910 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:53:22.910 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T23:53:22.910 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:23.134 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-09-10T23:53:23.185 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-09-10T23:53:23.185 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:53:23.185 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T23:53:23.185 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:53:23.186 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T23:53:23.186 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:23.248 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-2:18.2.0-0.el9.x86_64 33/33 2024-09-10T23:53:23.386 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-2:18.2.0-0.el9.x86_64 33/33 2024-09-10T23:53:23.387 INFO:teuthology.orchestra.run.smithi203.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-10T23:53:23.387 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:23.813 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-2:18.2.0-0.el9.x86_64 1/33 2024-09-10T23:53:23.814 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mds-2:18.2.0-0.el9.x86_64 2/33 2024-09-10T23:53:23.814 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-2:18.2.0-0.el9.x86_64 3/33 2024-09-10T23:53:23.814 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mon-2:18.2.0-0.el9.x86_64 4/33 2024-09-10T23:53:23.814 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-osd-2:18.2.0-0.el9.x86_64 5/33 2024-09-10T23:53:23.816 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 6/33 2024-09-10T23:53:23.817 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-09-10T23:53:23.817 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-09-10T23:53:23.817 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-09-10T23:53:23.817 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-09-10T23:53:23.817 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-09-10T23:53:23.817 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-09-10T23:53:23.817 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-09-10T23:53:23.817 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-09-10T23:53:23.817 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-09-10T23:53:23.817 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-09-10T23:53:23.817 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-09-10T23:53:23.817 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-09-10T23:53:23.817 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-09-10T23:53:23.818 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-09-10T23:53:23.818 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-09-10T23:53:23.818 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-09-10T23:53:23.818 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-09-10T23:53:23.818 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-09-10T23:53:23.818 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-09-10T23:53:23.818 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-09-10T23:53:23.818 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-09-10T23:53:23.818 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-09-10T23:53:23.818 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-09-10T23:53:23.818 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-09-10T23:53:23.818 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 31/33 2024-09-10T23:53:23.818 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-09-10T23:53:25.152 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-09-10T23:53:25.153 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:25.153 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-10T23:53:25.153 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:25.153 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mds-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:25.153 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:25.153 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 2024-09-10T23:53:25.153 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mon-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:25.153 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-osd-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:25.153 INFO:teuthology.orchestra.run.smithi111.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T23:53:25.153 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T23:53:25.153 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T23:53:25.153 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T23:53:25.153 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T23:53:25.154 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T23:53:25.154 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T23:53:25.154 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T23:53:25.154 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T23:53:25.154 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T23:53:25.154 INFO:teuthology.orchestra.run.smithi111.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T23:53:25.154 INFO:teuthology.orchestra.run.smithi111.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T23:53:25.154 INFO:teuthology.orchestra.run.smithi111.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T23:53:25.154 INFO:teuthology.orchestra.run.smithi111.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T23:53:25.154 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T23:53:25.154 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T23:53:25.154 INFO:teuthology.orchestra.run.smithi111.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T23:53:25.154 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T23:53:25.154 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T23:53:25.155 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T23:53:25.155 INFO:teuthology.orchestra.run.smithi111.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T23:53:25.155 INFO:teuthology.orchestra.run.smithi111.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T23:53:25.155 INFO:teuthology.orchestra.run.smithi111.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T23:53:25.155 INFO:teuthology.orchestra.run.smithi111.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T23:53:25.155 INFO:teuthology.orchestra.run.smithi111.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T23:53:25.155 INFO:teuthology.orchestra.run.smithi111.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T23:53:25.155 INFO:teuthology.orchestra.run.smithi111.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T23:53:25.155 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:25.155 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-10T23:53:25.230 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-2:18.2.0-0.el9.x86_64 1/33 2024-09-10T23:53:25.230 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mds-2:18.2.0-0.el9.x86_64 2/33 2024-09-10T23:53:25.230 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-2:18.2.0-0.el9.x86_64 3/33 2024-09-10T23:53:25.230 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mon-2:18.2.0-0.el9.x86_64 4/33 2024-09-10T23:53:25.230 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-osd-2:18.2.0-0.el9.x86_64 5/33 2024-09-10T23:53:25.230 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 6/33 2024-09-10T23:53:25.230 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-09-10T23:53:25.230 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-09-10T23:53:25.230 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-09-10T23:53:25.230 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-09-10T23:53:25.230 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-09-10T23:53:25.231 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-09-10T23:53:25.231 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-09-10T23:53:25.231 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-09-10T23:53:25.231 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-09-10T23:53:25.231 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-09-10T23:53:25.231 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-09-10T23:53:25.231 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-09-10T23:53:25.231 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-09-10T23:53:25.231 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-09-10T23:53:25.231 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-09-10T23:53:25.231 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-09-10T23:53:25.231 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-09-10T23:53:25.231 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-09-10T23:53:25.231 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-09-10T23:53:25.232 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-09-10T23:53:25.232 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-09-10T23:53:25.233 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-09-10T23:53:25.233 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-09-10T23:53:25.233 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-09-10T23:53:25.233 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 31/33 2024-09-10T23:53:25.233 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-09-10T23:53:25.559 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-base 2024-09-10T23:53:26.215 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-09-10T23:53:26.215 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:26.215 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-10T23:53:26.215 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:26.215 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mds-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:26.215 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:26.215 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 2024-09-10T23:53:26.216 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mon-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:26.216 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-osd-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:26.216 INFO:teuthology.orchestra.run.smithi203.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T23:53:26.216 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T23:53:26.216 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T23:53:26.216 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T23:53:26.216 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T23:53:26.216 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T23:53:26.216 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T23:53:26.216 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T23:53:26.216 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T23:53:26.216 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T23:53:26.217 INFO:teuthology.orchestra.run.smithi203.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T23:53:26.217 INFO:teuthology.orchestra.run.smithi203.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T23:53:26.217 INFO:teuthology.orchestra.run.smithi203.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T23:53:26.217 INFO:teuthology.orchestra.run.smithi203.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T23:53:26.217 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T23:53:26.217 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T23:53:26.217 INFO:teuthology.orchestra.run.smithi203.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T23:53:26.217 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T23:53:26.217 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T23:53:26.217 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T23:53:26.217 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T23:53:26.217 INFO:teuthology.orchestra.run.smithi203.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T23:53:26.217 INFO:teuthology.orchestra.run.smithi203.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T23:53:26.218 INFO:teuthology.orchestra.run.smithi203.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T23:53:26.218 INFO:teuthology.orchestra.run.smithi203.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T23:53:26.218 INFO:teuthology.orchestra.run.smithi203.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T23:53:26.218 INFO:teuthology.orchestra.run.smithi203.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T23:53:26.218 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:26.218 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-10T23:53:26.333 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:00:53 ago on Tue 10 Sep 2024 11:52:33 PM UTC. 2024-09-10T23:53:26.428 INFO:teuthology.orchestra.run.smithi111.stdout:Package ceph-base-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T23:53:26.470 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-10T23:53:26.471 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-09-10T23:53:26.471 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-10T23:53:26.553 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install cephadm 2024-09-10T23:53:26.607 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-base 2024-09-10T23:53:27.302 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:00:54 ago on Tue 10 Sep 2024 11:52:33 PM UTC. 2024-09-10T23:53:27.365 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:00:52 ago on Tue 10 Sep 2024 11:52:35 PM UTC. 2024-09-10T23:53:27.439 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-10T23:53:27.440 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:53:27.440 INFO:teuthology.orchestra.run.smithi111.stdout: Package Architecture Version Repository Size 2024-09-10T23:53:27.440 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:53:27.440 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-10T23:53:27.440 INFO:teuthology.orchestra.run.smithi111.stdout: cephadm noarch 2:18.2.0-0.el9 ceph-noarch 209 k 2024-09-10T23:53:27.440 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:27.440 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-10T23:53:27.440 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:53:27.440 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2024-09-10T23:53:27.441 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:27.441 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 209 k 2024-09-10T23:53:27.441 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 200 k 2024-09-10T23:53:27.441 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-10T23:53:27.461 INFO:teuthology.orchestra.run.smithi203.stdout:Package ceph-base-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T23:53:27.503 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-10T23:53:27.505 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-09-10T23:53:27.505 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-10T23:53:27.530 INFO:teuthology.orchestra.run.smithi111.stdout:cephadm-18.2.0-0.el9.noarch.rpm 2.3 MB/s | 209 kB 00:00 2024-09-10T23:53:27.531 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:53:27.531 INFO:teuthology.orchestra.run.smithi111.stdout:Total 2.2 MB/s | 209 kB 00:00 2024-09-10T23:53:27.531 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-10T23:53:27.538 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-10T23:53:27.538 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-10T23:53:27.541 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-10T23:53:27.541 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-10T23:53:27.598 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install cephadm 2024-09-10T23:53:27.614 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-10T23:53:28.343 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:00:53 ago on Tue 10 Sep 2024 11:52:35 PM UTC. 2024-09-10T23:53:28.411 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-10T23:53:28.481 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-10T23:53:28.481 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:53:28.482 INFO:teuthology.orchestra.run.smithi203.stdout: Package Architecture Version Repository Size 2024-09-10T23:53:28.482 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:53:28.482 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-10T23:53:28.482 INFO:teuthology.orchestra.run.smithi203.stdout: cephadm noarch 2:18.2.0-0.el9 ceph-noarch 209 k 2024-09-10T23:53:28.482 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:28.482 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-10T23:53:28.482 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:53:28.482 INFO:teuthology.orchestra.run.smithi203.stdout:Install 1 Package 2024-09-10T23:53:28.482 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:28.483 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 209 k 2024-09-10T23:53:28.483 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 200 k 2024-09-10T23:53:28.483 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-10T23:53:28.501 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-10T23:53:28.543 INFO:teuthology.orchestra.run.smithi203.stdout:cephadm-18.2.0-0.el9.noarch.rpm 3.4 MB/s | 209 kB 00:00 2024-09-10T23:53:28.544 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:53:28.544 INFO:teuthology.orchestra.run.smithi203.stdout:Total 3.3 MB/s | 209 kB 00:00 2024-09-10T23:53:28.544 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-10T23:53:28.551 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-10T23:53:28.551 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-10T23:53:28.553 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-10T23:53:28.554 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-10T23:53:28.627 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-10T23:53:28.868 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-10T23:53:29.184 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-10T23:53:29.184 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:29.184 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-10T23:53:29.184 INFO:teuthology.orchestra.run.smithi111.stdout: cephadm-2:18.2.0-0.el9.noarch 2024-09-10T23:53:29.184 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:29.184 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-10T23:53:29.307 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-10T23:53:29.414 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-10T23:53:29.513 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-immutable-object-cache 2024-09-10T23:53:29.816 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-10T23:53:30.046 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-10T23:53:30.046 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:30.046 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-10T23:53:30.047 INFO:teuthology.orchestra.run.smithi203.stdout: cephadm-2:18.2.0-0.el9.noarch 2024-09-10T23:53:30.047 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:30.047 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-10T23:53:30.296 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:00:57 ago on Tue 10 Sep 2024 11:52:33 PM UTC. 2024-09-10T23:53:30.325 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-immutable-object-cache 2024-09-10T23:53:30.442 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-10T23:53:30.442 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:53:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repo Size 2024-09-10T23:53:30.442 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:53:30.442 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-10T23:53:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-0.el9 ceph 142 k 2024-09-10T23:53:30.442 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:30.443 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-10T23:53:30.443 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:53:30.443 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2024-09-10T23:53:30.443 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:30.443 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 142 k 2024-09-10T23:53:30.443 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 399 k 2024-09-10T23:53:30.443 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-10T23:53:30.496 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-immutable-object-cache-18.2.0-0.el9.x86_64 2.7 MB/s | 142 kB 00:00 2024-09-10T23:53:30.496 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:53:30.497 INFO:teuthology.orchestra.run.smithi111.stdout:Total 2.6 MB/s | 142 kB 00:00 2024-09-10T23:53:30.497 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-10T23:53:30.505 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-10T23:53:30.505 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-10T23:53:30.571 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-10T23:53:30.572 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-10T23:53:30.752 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-10T23:53:30.865 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:53:30.916 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:53:30.916 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:53:30.917 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T23:53:30.917 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:31.097 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:00:56 ago on Tue 10 Sep 2024 11:52:35 PM UTC. 2024-09-10T23:53:31.236 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-10T23:53:31.236 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:53:31.236 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repo Size 2024-09-10T23:53:31.236 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:53:31.237 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-10T23:53:31.237 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-0.el9 ceph 142 k 2024-09-10T23:53:31.237 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:31.237 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-10T23:53:31.237 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:53:31.237 INFO:teuthology.orchestra.run.smithi203.stdout:Install 1 Package 2024-09-10T23:53:31.237 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:31.238 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 142 k 2024-09-10T23:53:31.238 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 399 k 2024-09-10T23:53:31.238 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-10T23:53:31.284 INFO:teuthology.orchestra.run.smithi203.stdout:ceph-immutable-object-cache-18.2.0-0.el9.x86_64 3.0 MB/s | 142 kB 00:00 2024-09-10T23:53:31.285 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:53:31.285 INFO:teuthology.orchestra.run.smithi203.stdout:Total 2.9 MB/s | 142 kB 00:00 2024-09-10T23:53:31.285 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-10T23:53:31.294 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-10T23:53:31.294 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-10T23:53:31.359 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-10T23:53:31.360 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-10T23:53:31.560 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-10T23:53:31.635 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:53:31.685 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:53:31.685 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:53:31.685 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T23:53:31.685 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:32.034 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:53:32.034 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:32.034 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-10T23:53:32.034 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:32.034 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:32.034 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-10T23:53:32.330 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-mgr 2024-09-10T23:53:32.807 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:53:32.807 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:32.807 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-10T23:53:32.807 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 2024-09-10T23:53:32.807 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:32.807 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-10T23:53:33.076 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-mgr 2024-09-10T23:53:33.107 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:00 ago on Tue 10 Sep 2024 11:52:33 PM UTC. 2024-09-10T23:53:33.204 INFO:teuthology.orchestra.run.smithi111.stdout:Package ceph-mgr-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T23:53:33.248 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-10T23:53:33.249 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-09-10T23:53:33.249 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-10T23:53:33.345 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-mgr-dashboard 2024-09-10T23:53:33.850 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:00:58 ago on Tue 10 Sep 2024 11:52:35 PM UTC. 2024-09-10T23:53:33.947 INFO:teuthology.orchestra.run.smithi203.stdout:Package ceph-mgr-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T23:53:33.991 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-10T23:53:33.992 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-09-10T23:53:33.992 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-10T23:53:34.088 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-mgr-dashboard 2024-09-10T23:53:34.089 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:01 ago on Tue 10 Sep 2024 11:52:33 PM UTC. 2024-09-10T23:53:34.226 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-10T23:53:34.227 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:53:34.227 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2024-09-10T23:53:34.227 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:53:34.228 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-10T23:53:34.228 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-dashboard noarch 2:18.2.0-0.el9 ceph-noarch 1.7 M 2024-09-10T23:53:34.228 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-09-10T23:53:34.228 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-grafana-dashboards noarch 2:18.2.0-0.el9 ceph-noarch 23 k 2024-09-10T23:53:34.228 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-prometheus-alerts noarch 2:18.2.0-0.el9 ceph-noarch 15 k 2024-09-10T23:53:34.228 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-10T23:53:34.228 INFO:teuthology.orchestra.run.smithi111.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T23:53:34.228 INFO:teuthology.orchestra.run.smithi111.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T23:53:34.228 INFO:teuthology.orchestra.run.smithi111.stdout:Installing weak dependencies: 2024-09-10T23:53:34.228 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-10T23:53:34.228 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:34.228 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-10T23:53:34.228 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:53:34.229 INFO:teuthology.orchestra.run.smithi111.stdout:Install 7 Packages 2024-09-10T23:53:34.229 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:34.229 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 2.0 M 2024-09-10T23:53:34.229 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 8.1 M 2024-09-10T23:53:34.229 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-10T23:53:34.486 INFO:teuthology.orchestra.run.smithi111.stdout:(1/7): ceph-grafana-dashboards-18.2.0-0.el9.noa 244 kB/s | 23 kB 00:00 2024-09-10T23:53:34.502 INFO:teuthology.orchestra.run.smithi111.stdout:(2/7): ceph-prometheus-alerts-18.2.0-0.el9.noar 132 kB/s | 15 kB 00:00 2024-09-10T23:53:34.552 INFO:teuthology.orchestra.run.smithi111.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 136 kB/s | 9.0 kB 00:00 2024-09-10T23:53:34.578 INFO:teuthology.orchestra.run.smithi111.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-10T23:53:34.603 INFO:teuthology.orchestra.run.smithi111.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 406 kB/s | 41 kB 00:00 2024-09-10T23:53:34.628 INFO:teuthology.orchestra.run.smithi111.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-10T23:53:34.670 INFO:teuthology.orchestra.run.smithi111.stdout:(7/7): ceph-mgr-dashboard-18.2.0-0.el9.noarch.r 6.1 MB/s | 1.7 MB 00:00 2024-09-10T23:53:34.674 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:53:34.674 INFO:teuthology.orchestra.run.smithi111.stdout:Total 4.5 MB/s | 2.0 MB 00:00 2024-09-10T23:53:34.674 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-10T23:53:34.684 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-10T23:53:34.684 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-10T23:53:34.778 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-10T23:53:34.779 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-10T23:53:34.837 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:00:59 ago on Tue 10 Sep 2024 11:52:35 PM UTC. 2024-09-10T23:53:34.976 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-10T23:53:34.977 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:53:34.977 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-09-10T23:53:34.977 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:53:34.978 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-10T23:53:34.978 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-dashboard noarch 2:18.2.0-0.el9 ceph-noarch 1.7 M 2024-09-10T23:53:34.978 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-09-10T23:53:34.978 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-grafana-dashboards noarch 2:18.2.0-0.el9 ceph-noarch 23 k 2024-09-10T23:53:34.978 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-prometheus-alerts noarch 2:18.2.0-0.el9 ceph-noarch 15 k 2024-09-10T23:53:34.978 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-10T23:53:34.978 INFO:teuthology.orchestra.run.smithi203.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T23:53:34.978 INFO:teuthology.orchestra.run.smithi203.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T23:53:34.978 INFO:teuthology.orchestra.run.smithi203.stdout:Installing weak dependencies: 2024-09-10T23:53:34.978 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-10T23:53:34.979 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:34.979 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-10T23:53:34.979 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:53:34.979 INFO:teuthology.orchestra.run.smithi203.stdout:Install 7 Packages 2024-09-10T23:53:34.979 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:34.979 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 2.0 M 2024-09-10T23:53:34.979 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 8.1 M 2024-09-10T23:53:34.980 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-10T23:53:35.083 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-10T23:53:35.163 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-10T23:53:35.199 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-10T23:53:35.258 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-10T23:53:35.268 INFO:teuthology.orchestra.run.smithi203.stdout:(1/7): ceph-prometheus-alerts-18.2.0-0.el9.noar 149 kB/s | 15 kB 00:00 2024-09-10T23:53:35.293 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-10T23:53:35.298 INFO:teuthology.orchestra.run.smithi203.stdout:(2/7): ceph-grafana-dashboards-18.2.0-0.el9.noa 181 kB/s | 23 kB 00:00 2024-09-10T23:53:35.322 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 5/7 2024-09-10T23:53:35.349 INFO:teuthology.orchestra.run.smithi203.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 113 kB/s | 9.0 kB 00:00 2024-09-10T23:53:35.374 INFO:teuthology.orchestra.run.smithi203.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-10T23:53:35.399 INFO:teuthology.orchestra.run.smithi203.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 406 kB/s | 41 kB 00:00 2024-09-10T23:53:35.424 INFO:teuthology.orchestra.run.smithi203.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-10T23:53:35.466 INFO:teuthology.orchestra.run.smithi203.stdout:(7/7): ceph-mgr-dashboard-18.2.0-0.el9.noarch.r 5.7 MB/s | 1.7 MB 00:00 2024-09-10T23:53:35.470 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:53:35.470 INFO:teuthology.orchestra.run.smithi203.stdout:Total 4.1 MB/s | 2.0 MB 00:00 2024-09-10T23:53:35.470 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-10T23:53:35.480 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-10T23:53:35.480 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-10T23:53:35.571 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 6/7 2024-09-10T23:53:35.577 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-10T23:53:35.578 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-10T23:53:35.607 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-09-10T23:53:35.901 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-10T23:53:35.968 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-10T23:53:36.004 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-10T23:53:36.062 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-10T23:53:36.097 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-10T23:53:36.127 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 5/7 2024-09-10T23:53:36.247 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-09-10T23:53:36.247 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 1/7 2024-09-10T23:53:36.247 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2/7 2024-09-10T23:53:36.248 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 3/7 2024-09-10T23:53:36.248 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-10T23:53:36.248 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-10T23:53:36.248 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-10T23:53:36.375 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 6/7 2024-09-10T23:53:36.412 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-09-10T23:53:36.551 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-10T23:53:36.551 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:36.551 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-10T23:53:36.551 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 2024-09-10T23:53:36.551 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2024-09-10T23:53:36.551 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 2024-09-10T23:53:36.551 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-10T23:53:36.551 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-10T23:53:36.551 INFO:teuthology.orchestra.run.smithi111.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T23:53:36.551 INFO:teuthology.orchestra.run.smithi111.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T23:53:36.551 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:36.551 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-10T23:53:36.857 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-10T23:53:37.053 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-09-10T23:53:37.053 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 1/7 2024-09-10T23:53:37.053 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2/7 2024-09-10T23:53:37.053 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 3/7 2024-09-10T23:53:37.053 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-10T23:53:37.053 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-10T23:53:37.053 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-10T23:53:37.339 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-10T23:53:37.339 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:37.339 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-10T23:53:37.339 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 2024-09-10T23:53:37.339 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2024-09-10T23:53:37.339 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 2024-09-10T23:53:37.339 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-10T23:53:37.339 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-10T23:53:37.339 INFO:teuthology.orchestra.run.smithi203.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T23:53:37.340 INFO:teuthology.orchestra.run.smithi203.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T23:53:37.340 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:37.340 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-10T23:53:37.600 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-10T23:53:37.616 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:04 ago on Tue 10 Sep 2024 11:52:33 PM UTC. 2024-09-10T23:53:37.757 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-10T23:53:37.758 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:53:37.758 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2024-09-10T23:53:37.758 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:53:37.758 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-10T23:53:37.758 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-0.el9 ceph-noarch 7.4 M 2024-09-10T23:53:37.758 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-09-10T23:53:37.758 INFO:teuthology.orchestra.run.smithi111.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T23:53:37.759 INFO:teuthology.orchestra.run.smithi111.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T23:53:37.759 INFO:teuthology.orchestra.run.smithi111.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T23:53:37.759 INFO:teuthology.orchestra.run.smithi111.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T23:53:37.759 INFO:teuthology.orchestra.run.smithi111.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T23:53:37.759 INFO:teuthology.orchestra.run.smithi111.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T23:53:37.759 INFO:teuthology.orchestra.run.smithi111.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T23:53:37.759 INFO:teuthology.orchestra.run.smithi111.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T23:53:37.759 INFO:teuthology.orchestra.run.smithi111.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T23:53:37.759 INFO:teuthology.orchestra.run.smithi111.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T23:53:37.759 INFO:teuthology.orchestra.run.smithi111.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T23:53:37.759 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:37.759 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-10T23:53:37.759 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:53:37.759 INFO:teuthology.orchestra.run.smithi111.stdout:Install 12 Packages 2024-09-10T23:53:37.760 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:37.760 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 38 M 2024-09-10T23:53:37.760 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 212 M 2024-09-10T23:53:37.760 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-10T23:53:38.177 INFO:teuthology.orchestra.run.smithi111.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.0-0. 38 MB/s | 7.4 MB 00:00 2024-09-10T23:53:38.294 INFO:teuthology.orchestra.run.smithi111.stdout:(2/12): libquadmath-11.5.0-2.el9.x86_64.rpm 616 kB/s | 191 kB 00:00 2024-09-10T23:53:38.351 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:03 ago on Tue 10 Sep 2024 11:52:35 PM UTC. 2024-09-10T23:53:38.403 INFO:teuthology.orchestra.run.smithi111.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 1.9 MB/s | 801 kB 00:00 2024-09-10T23:53:38.490 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-10T23:53:38.491 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:53:38.491 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-09-10T23:53:38.491 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:53:38.492 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-10T23:53:38.492 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-0.el9 ceph-noarch 7.4 M 2024-09-10T23:53:38.492 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-09-10T23:53:38.492 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T23:53:38.492 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T23:53:38.492 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T23:53:38.493 INFO:teuthology.orchestra.run.smithi203.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T23:53:38.493 INFO:teuthology.orchestra.run.smithi203.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T23:53:38.493 INFO:teuthology.orchestra.run.smithi203.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T23:53:38.493 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T23:53:38.493 INFO:teuthology.orchestra.run.smithi203.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T23:53:38.493 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T23:53:38.493 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T23:53:38.493 INFO:teuthology.orchestra.run.smithi203.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T23:53:38.494 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:38.494 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-10T23:53:38.494 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:53:38.494 INFO:teuthology.orchestra.run.smithi203.stdout:Install 12 Packages 2024-09-10T23:53:38.494 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:38.495 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 38 M 2024-09-10T23:53:38.495 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 212 M 2024-09-10T23:53:38.495 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-10T23:53:38.594 INFO:teuthology.orchestra.run.smithi111.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 78 kB/s | 33 kB 00:00 2024-09-10T23:53:38.669 INFO:teuthology.orchestra.run.smithi111.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 68 kB/s | 18 kB 00:00 2024-09-10T23:53:38.862 INFO:teuthology.orchestra.run.smithi111.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 144 kB/s | 38 kB 00:00 2024-09-10T23:53:38.974 INFO:teuthology.orchestra.run.smithi203.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.0-0. 43 MB/s | 7.4 MB 00:00 2024-09-10T23:53:39.016 INFO:teuthology.orchestra.run.smithi203.stdout:(2/12): libquadmath-11.5.0-2.el9.x86_64.rpm 892 kB/s | 191 kB 00:00 2024-09-10T23:53:39.066 INFO:teuthology.orchestra.run.smithi203.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.0 MB/s | 801 kB 00:00 2024-09-10T23:53:39.117 INFO:teuthology.orchestra.run.smithi203.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 231 kB/s | 33 kB 00:00 2024-09-10T23:53:39.167 INFO:teuthology.orchestra.run.smithi203.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 771 kB/s | 38 kB 00:00 2024-09-10T23:53:39.200 INFO:teuthology.orchestra.run.smithi203.stdout:(6/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 136 kB/s | 18 kB 00:00 2024-09-10T23:53:39.212 INFO:teuthology.orchestra.run.smithi111.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.3 MB/s | 3.0 MB 00:00 2024-09-10T23:53:39.351 INFO:teuthology.orchestra.run.smithi203.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-09-10T23:53:39.485 INFO:teuthology.orchestra.run.smithi203.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 16 MB/s | 4.9 MB 00:00 2024-09-10T23:53:39.529 INFO:teuthology.orchestra.run.smithi111.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 5.8 MB/s | 4.9 MB 00:00 2024-09-10T23:53:39.552 INFO:teuthology.orchestra.run.smithi203.stdout:(9/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 5.6 MB/s | 3.0 MB 00:00 2024-09-10T23:53:39.554 INFO:teuthology.orchestra.run.smithi111.stdout:(9/12): python3-devel-3.9.19-8.el9.x86_64.rpm 354 kB/s | 245 kB 00:00 2024-09-10T23:53:39.577 INFO:teuthology.orchestra.run.smithi203.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.7 MB/s | 250 kB 00:00 2024-09-10T23:53:39.677 INFO:teuthology.orchestra.run.smithi203.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-09-10T23:53:39.986 INFO:teuthology.orchestra.run.smithi203.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 38 MB/s | 16 MB 00:00 2024-09-10T23:53:39.986 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:53:39.986 INFO:teuthology.orchestra.run.smithi203.stdout:Total 26 MB/s | 38 MB 00:01 2024-09-10T23:53:40.079 INFO:teuthology.orchestra.run.smithi111.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.9 MB/s | 5.1 MB 00:00 2024-09-10T23:53:40.104 INFO:teuthology.orchestra.run.smithi111.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 436 kB/s | 250 kB 00:00 2024-09-10T23:53:40.462 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-10T23:53:40.493 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-10T23:53:40.494 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-10T23:53:40.980 INFO:teuthology.orchestra.run.smithi111.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-10T23:53:40.981 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:53:40.981 INFO:teuthology.orchestra.run.smithi111.stdout:Total 12 MB/s | 38 MB 00:03 2024-09-10T23:53:41.043 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-10T23:53:41.044 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-10T23:53:41.464 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-10T23:53:41.495 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-10T23:53:41.495 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-10T23:53:41.871 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-10T23:53:41.952 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-10T23:53:41.996 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-10T23:53:42.035 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-10T23:53:42.035 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-10T23:53:42.108 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-10T23:53:42.153 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-10T23:53:42.391 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-10T23:53:42.435 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-10T23:53:42.545 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-10T23:53:42.828 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-10T23:53:42.925 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-10T23:53:42.973 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-10T23:53:43.086 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-10T23:53:43.138 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-10T23:53:43.363 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-10T23:53:43.371 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-10T23:53:43.404 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-10T23:53:43.505 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-10T23:53:43.510 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-10T23:53:44.309 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-10T23:53:44.447 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-10T23:53:45.052 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-10T23:53:45.992 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-10T23:53:46.230 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-10T23:53:46.261 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-09-10T23:53:47.145 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-10T23:53:47.177 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-09-10T23:53:48.822 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-09-10T23:53:48.823 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 1/12 2024-09-10T23:53:48.823 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-10T23:53:48.823 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-10T23:53:48.823 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-10T23:53:48.823 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-10T23:53:48.823 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-10T23:53:48.823 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-10T23:53:48.823 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-10T23:53:48.823 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-10T23:53:48.823 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-10T23:53:48.823 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-10T23:53:49.194 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-10T23:53:49.195 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:49.195 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-10T23:53:49.195 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarch 2024-09-10T23:53:49.195 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T23:53:49.195 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T23:53:49.195 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T23:53:49.195 INFO:teuthology.orchestra.run.smithi203.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T23:53:49.195 INFO:teuthology.orchestra.run.smithi203.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T23:53:49.195 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T23:53:49.195 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T23:53:49.195 INFO:teuthology.orchestra.run.smithi203.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T23:53:49.195 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T23:53:49.196 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T23:53:49.196 INFO:teuthology.orchestra.run.smithi203.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T23:53:49.196 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:49.196 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-10T23:53:49.561 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-mgr-rook 2024-09-10T23:53:49.809 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-09-10T23:53:49.809 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 1/12 2024-09-10T23:53:49.809 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-10T23:53:49.809 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-10T23:53:49.809 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-10T23:53:49.809 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-10T23:53:49.810 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-10T23:53:49.810 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-10T23:53:49.810 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-10T23:53:49.810 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-10T23:53:49.810 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-10T23:53:49.810 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-10T23:53:50.252 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-10T23:53:50.252 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:50.252 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-10T23:53:50.252 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarch 2024-09-10T23:53:50.253 INFO:teuthology.orchestra.run.smithi111.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T23:53:50.253 INFO:teuthology.orchestra.run.smithi111.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T23:53:50.253 INFO:teuthology.orchestra.run.smithi111.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T23:53:50.253 INFO:teuthology.orchestra.run.smithi111.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T23:53:50.253 INFO:teuthology.orchestra.run.smithi111.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T23:53:50.253 INFO:teuthology.orchestra.run.smithi111.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T23:53:50.253 INFO:teuthology.orchestra.run.smithi111.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T23:53:50.253 INFO:teuthology.orchestra.run.smithi111.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T23:53:50.253 INFO:teuthology.orchestra.run.smithi111.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T23:53:50.253 INFO:teuthology.orchestra.run.smithi111.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T23:53:50.253 INFO:teuthology.orchestra.run.smithi111.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T23:53:50.253 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:50.253 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-10T23:53:50.341 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:15 ago on Tue 10 Sep 2024 11:52:35 PM UTC. 2024-09-10T23:53:50.480 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-10T23:53:50.482 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:53:50.482 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-09-10T23:53:50.482 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:53:50.482 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-10T23:53:50.482 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-rook noarch 2:18.2.0-0.el9 ceph-noarch 47 k 2024-09-10T23:53:50.482 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-09-10T23:53:50.482 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T23:53:50.482 INFO:teuthology.orchestra.run.smithi203.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T23:53:50.482 INFO:teuthology.orchestra.run.smithi203.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T23:53:50.482 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T23:53:50.483 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T23:53:50.483 INFO:teuthology.orchestra.run.smithi203.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T23:53:50.483 INFO:teuthology.orchestra.run.smithi203.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T23:53:50.483 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T23:53:50.483 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T23:53:50.483 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T23:53:50.483 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T23:53:50.483 INFO:teuthology.orchestra.run.smithi203.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T23:53:50.483 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:50.483 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-10T23:53:50.483 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:53:50.483 INFO:teuthology.orchestra.run.smithi203.stdout:Install 13 Packages 2024-09-10T23:53:50.483 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:50.484 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 2.2 M 2024-09-10T23:53:50.484 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 26 M 2024-09-10T23:53:50.484 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-10T23:53:50.655 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-mgr-rook 2024-09-10T23:53:50.956 INFO:teuthology.orchestra.run.smithi203.stdout:(1/13): ceph-mgr-rook-18.2.0-0.el9.noarch.rpm 901 kB/s | 47 kB 00:00 2024-09-10T23:53:51.066 INFO:teuthology.orchestra.run.smithi203.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 159 kB/s | 26 kB 00:00 2024-09-10T23:53:51.108 INFO:teuthology.orchestra.run.smithi203.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 94 kB/s | 19 kB 00:00 2024-09-10T23:53:51.206 INFO:teuthology.orchestra.run.smithi203.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-10T23:53:51.265 INFO:teuthology.orchestra.run.smithi203.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 718 kB/s | 222 kB 00:00 2024-09-10T23:53:51.308 INFO:teuthology.orchestra.run.smithi203.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 527 kB/s | 54 kB 00:00 2024-09-10T23:53:51.332 INFO:teuthology.orchestra.run.smithi203.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.2 MB/s | 279 kB 00:00 2024-09-10T23:53:51.408 INFO:teuthology.orchestra.run.smithi203.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 227 kB/s | 32 kB 00:00 2024-09-10T23:53:51.437 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:18 ago on Tue 10 Sep 2024 11:52:33 PM UTC. 2024-09-10T23:53:51.450 INFO:teuthology.orchestra.run.smithi203.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 99 kB/s | 14 kB 00:00 2024-09-10T23:53:51.492 INFO:teuthology.orchestra.run.smithi203.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-09-10T23:53:51.517 INFO:teuthology.orchestra.run.smithi203.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.3 MB/s | 220 kB 00:00 2024-09-10T23:53:51.542 INFO:teuthology.orchestra.run.smithi203.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-10T23:53:51.576 INFO:teuthology.orchestra.run.smithi203.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.2 MB/s | 1.0 MB 00:00 2024-09-10T23:53:51.578 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-10T23:53:51.579 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:53:51.579 INFO:teuthology.orchestra.run.smithi203.stdout:Total 2.0 MB/s | 2.2 MB 00:01 2024-09-10T23:53:51.580 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:53:51.580 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2024-09-10T23:53:51.580 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:53:51.580 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-10T23:53:51.580 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-rook noarch 2:18.2.0-0.el9 ceph-noarch 47 k 2024-09-10T23:53:51.580 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-09-10T23:53:51.580 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T23:53:51.581 INFO:teuthology.orchestra.run.smithi111.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T23:53:51.581 INFO:teuthology.orchestra.run.smithi111.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T23:53:51.581 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T23:53:51.581 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T23:53:51.581 INFO:teuthology.orchestra.run.smithi111.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T23:53:51.581 INFO:teuthology.orchestra.run.smithi111.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T23:53:51.581 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T23:53:51.581 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T23:53:51.581 INFO:teuthology.orchestra.run.smithi111.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T23:53:51.581 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T23:53:51.581 INFO:teuthology.orchestra.run.smithi111.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T23:53:51.581 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:51.581 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-10T23:53:51.582 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:53:51.582 INFO:teuthology.orchestra.run.smithi111.stdout:Install 13 Packages 2024-09-10T23:53:51.582 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:51.582 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 2.2 M 2024-09-10T23:53:51.582 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 26 M 2024-09-10T23:53:51.582 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-10T23:53:51.711 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-10T23:53:51.730 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-10T23:53:51.730 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-10T23:53:51.853 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-10T23:53:51.853 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-10T23:53:51.928 INFO:teuthology.orchestra.run.smithi111.stdout:(1/13): ceph-mgr-rook-18.2.0-0.el9.noarch.rpm 1.0 MB/s | 47 kB 00:00 2024-09-10T23:53:52.144 INFO:teuthology.orchestra.run.smithi111.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 73 kB/s | 19 kB 00:00 2024-09-10T23:53:52.169 INFO:teuthology.orchestra.run.smithi111.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 89 kB/s | 26 kB 00:00 2024-09-10T23:53:52.419 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-10T23:53:52.420 INFO:teuthology.orchestra.run.smithi111.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 452 kB/s | 222 kB 00:00 2024-09-10T23:53:52.562 INFO:teuthology.orchestra.run.smithi111.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 381 kB/s | 159 kB 00:00 2024-09-10T23:53:52.637 INFO:teuthology.orchestra.run.smithi111.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 429 kB/s | 32 kB 00:00 2024-09-10T23:53:52.662 INFO:teuthology.orchestra.run.smithi111.stdout:(7/13): python3-certifi-2023.05.07-4.el9.noarch 574 kB/s | 14 kB 00:00 2024-09-10T23:53:52.679 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-10T23:53:52.696 INFO:teuthology.orchestra.run.smithi111.stdout:(8/13): python3-google-auth-2.34.0-1.el9.noarch 6.5 MB/s | 220 kB 00:00 2024-09-10T23:53:52.733 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-10T23:53:52.754 INFO:teuthology.orchestra.run.smithi111.stdout:(9/13): python3-kubernetes-26.1.0-2.el9.noarch. 18 MB/s | 1.0 MB 00:00 2024-09-10T23:53:52.780 INFO:teuthology.orchestra.run.smithi111.stdout:(10/13): python3-requests-oauthlib-1.3.0-12.el9 149 kB/s | 54 kB 00:00 2024-09-10T23:53:52.798 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-10T23:53:52.805 INFO:teuthology.orchestra.run.smithi111.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-10T23:53:52.839 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-10T23:53:52.847 INFO:teuthology.orchestra.run.smithi111.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.3 MB/s | 90 kB 00:00 2024-09-10T23:53:52.882 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-10T23:53:52.890 INFO:teuthology.orchestra.run.smithi111.stdout:(13/13): python3-pyasn1-modules-0.4.8-6.el9.noa 387 kB/s | 279 kB 00:00 2024-09-10T23:53:52.892 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:53:52.893 INFO:teuthology.orchestra.run.smithi111.stdout:Total 1.7 MB/s | 2.2 MB 00:01 2024-09-10T23:53:52.997 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-10T23:53:53.020 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-10T23:53:53.039 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-10T23:53:53.039 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-10T23:53:53.127 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-10T23:53:53.158 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-10T23:53:53.159 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-10T23:53:53.185 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-10T23:53:53.712 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-10T23:53:53.925 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-10T23:53:53.988 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-10T23:53:54.048 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-10T23:53:54.053 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-10T23:53:54.105 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-10T23:53:54.118 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-10T23:53:54.139 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-10T23:53:54.169 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-10T23:53:54.186 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-10T23:53:54.215 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-09-10T23:53:54.286 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-10T23:53:54.423 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-10T23:53:54.489 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-10T23:53:55.127 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-09-10T23:53:55.127 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-rook-2:18.2.0-0.el9.noarch 1/13 2024-09-10T23:53:55.127 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-10T23:53:55.127 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-10T23:53:55.127 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-10T23:53:55.127 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-10T23:53:55.127 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-10T23:53:55.127 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-10T23:53:55.127 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-10T23:53:55.128 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-10T23:53:55.128 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-10T23:53:55.128 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-10T23:53:55.128 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-10T23:53:55.359 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-10T23:53:55.425 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-10T23:53:55.467 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-10T23:53:55.479 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-10T23:53:55.479 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:55.479 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-10T23:53:55.479 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-rook-2:18.2.0-0.el9.noarch 2024-09-10T23:53:55.479 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T23:53:55.479 INFO:teuthology.orchestra.run.smithi203.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T23:53:55.479 INFO:teuthology.orchestra.run.smithi203.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T23:53:55.480 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T23:53:55.480 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T23:53:55.480 INFO:teuthology.orchestra.run.smithi203.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T23:53:55.480 INFO:teuthology.orchestra.run.smithi203.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T23:53:55.480 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T23:53:55.480 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T23:53:55.480 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T23:53:55.480 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T23:53:55.480 INFO:teuthology.orchestra.run.smithi203.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T23:53:55.480 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:55.480 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-10T23:53:55.523 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-10T23:53:55.552 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-09-10T23:53:55.789 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-mgr-cephadm 2024-09-10T23:53:56.448 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-09-10T23:53:56.449 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-rook-2:18.2.0-0.el9.noarch 1/13 2024-09-10T23:53:56.449 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-10T23:53:56.449 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-10T23:53:56.449 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-10T23:53:56.449 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-10T23:53:56.449 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-10T23:53:56.449 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-10T23:53:56.449 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-10T23:53:56.449 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-10T23:53:56.449 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-10T23:53:56.449 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-10T23:53:56.449 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-10T23:53:56.543 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:21 ago on Tue 10 Sep 2024 11:52:35 PM UTC. 2024-09-10T23:53:56.683 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-10T23:53:56.684 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:53:56.684 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-09-10T23:53:56.684 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:53:56.684 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-10T23:53:56.685 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-cephadm noarch 2:18.2.0-0.el9 ceph-noarch 127 k 2024-09-10T23:53:56.685 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-09-10T23:53:56.685 INFO:teuthology.orchestra.run.smithi203.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T23:53:56.685 INFO:teuthology.orchestra.run.smithi203.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T23:53:56.685 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T23:53:56.685 INFO:teuthology.orchestra.run.smithi203.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T23:53:56.685 INFO:teuthology.orchestra.run.smithi203.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T23:53:56.685 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:56.685 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-10T23:53:56.685 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:53:56.685 INFO:teuthology.orchestra.run.smithi203.stdout:Install 6 Packages 2024-09-10T23:53:56.685 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:53:56.686 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 7.0 M 2024-09-10T23:53:56.686 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 33 M 2024-09-10T23:53:56.686 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-10T23:53:56.822 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-10T23:53:56.822 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:56.822 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-10T23:53:56.822 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-rook-2:18.2.0-0.el9.noarch 2024-09-10T23:53:56.822 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T23:53:56.822 INFO:teuthology.orchestra.run.smithi111.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T23:53:56.822 INFO:teuthology.orchestra.run.smithi111.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T23:53:56.822 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T23:53:56.822 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T23:53:56.822 INFO:teuthology.orchestra.run.smithi111.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T23:53:56.822 INFO:teuthology.orchestra.run.smithi111.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T23:53:56.823 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T23:53:56.823 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T23:53:56.823 INFO:teuthology.orchestra.run.smithi111.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T23:53:56.823 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T23:53:56.823 INFO:teuthology.orchestra.run.smithi111.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T23:53:56.823 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:56.823 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-10T23:53:56.855 INFO:teuthology.orchestra.run.smithi203.stdout:(1/6): ceph-mgr-cephadm-18.2.0-0.el9.noarch.rpm 2.2 MB/s | 127 kB 00:00 2024-09-10T23:53:56.914 INFO:teuthology.orchestra.run.smithi203.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-09-10T23:53:56.973 INFO:teuthology.orchestra.run.smithi203.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 987 kB/s | 58 kB 00:00 2024-09-10T23:53:57.025 INFO:teuthology.orchestra.run.smithi203.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 1.4 MB/s | 74 kB 00:00 2024-09-10T23:53:57.057 INFO:teuthology.orchestra.run.smithi203.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 965 kB/s | 248 kB 00:00 2024-09-10T23:53:57.110 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-mgr-cephadm 2024-09-10T23:53:57.872 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:24 ago on Tue 10 Sep 2024 11:52:33 PM UTC. 2024-09-10T23:53:58.011 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-10T23:53:58.011 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:53:58.011 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2024-09-10T23:53:58.011 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:53:58.012 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-10T23:53:58.012 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-cephadm noarch 2:18.2.0-0.el9 ceph-noarch 127 k 2024-09-10T23:53:58.012 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-09-10T23:53:58.012 INFO:teuthology.orchestra.run.smithi111.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T23:53:58.012 INFO:teuthology.orchestra.run.smithi111.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T23:53:58.012 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T23:53:58.012 INFO:teuthology.orchestra.run.smithi111.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T23:53:58.012 INFO:teuthology.orchestra.run.smithi111.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T23:53:58.012 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:58.012 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-10T23:53:58.012 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:53:58.012 INFO:teuthology.orchestra.run.smithi111.stdout:Install 6 Packages 2024-09-10T23:53:58.013 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:53:58.013 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 7.0 M 2024-09-10T23:53:58.013 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 33 M 2024-09-10T23:53:58.013 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-10T23:53:58.666 INFO:teuthology.orchestra.run.smithi111.stdout:(1/6): ceph-mgr-cephadm-18.2.0-0.el9.noarch.rpm 1.5 MB/s | 127 kB 00:00 2024-09-10T23:53:58.733 INFO:teuthology.orchestra.run.smithi111.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 8.1 MB/s | 548 kB 00:00 2024-09-10T23:53:58.759 INFO:teuthology.orchestra.run.smithi111.stdout:(3/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.4 MB/s | 248 kB 00:00 2024-09-10T23:53:58.782 INFO:teuthology.orchestra.run.smithi203.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 3.0 MB/s | 6.0 MB 00:01 2024-09-10T23:53:58.783 INFO:teuthology.orchestra.run.smithi111.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-10T23:53:58.784 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:53:58.784 INFO:teuthology.orchestra.run.smithi203.stdout:Total 3.3 MB/s | 7.0 MB 00:02 2024-09-10T23:53:58.826 INFO:teuthology.orchestra.run.smithi111.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.1 MB/s | 74 kB 00:00 2024-09-10T23:53:58.882 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-10T23:53:58.896 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-10T23:53:58.896 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-10T23:53:59.001 INFO:teuthology.orchestra.run.smithi111.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-09-10T23:53:59.003 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:53:59.003 INFO:teuthology.orchestra.run.smithi111.stdout:Total 7.1 MB/s | 7.0 MB 00:00 2024-09-10T23:53:59.017 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-10T23:53:59.017 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-10T23:53:59.098 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-10T23:53:59.112 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-10T23:53:59.112 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-10T23:53:59.234 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-10T23:53:59.234 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-10T23:53:59.363 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-10T23:53:59.558 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-10T23:53:59.608 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-10T23:53:59.671 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-10T23:53:59.801 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-10T23:53:59.865 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-10T23:54:00.309 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-10T23:54:00.405 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-10T23:54:00.479 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-10T23:54:00.505 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-09-10T23:54:00.505 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-10T23:54:00.608 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-10T23:54:00.688 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-10T23:54:00.715 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-09-10T23:54:01.441 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-09-10T23:54:01.441 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 1/6 2024-09-10T23:54:01.441 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-10T23:54:01.441 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-10T23:54:01.441 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-10T23:54:01.441 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-10T23:54:01.544 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-09-10T23:54:01.544 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 1/6 2024-09-10T23:54:01.544 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-10T23:54:01.544 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-10T23:54:01.544 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-10T23:54:01.544 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-10T23:54:01.751 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-10T23:54:01.752 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:54:01.752 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-10T23:54:01.752 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 2024-09-10T23:54:01.752 INFO:teuthology.orchestra.run.smithi203.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T23:54:01.752 INFO:teuthology.orchestra.run.smithi203.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T23:54:01.752 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T23:54:01.752 INFO:teuthology.orchestra.run.smithi203.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T23:54:01.752 INFO:teuthology.orchestra.run.smithi203.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T23:54:01.752 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:54:01.752 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-10T23:54:01.835 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-10T23:54:01.836 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:54:01.836 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-10T23:54:01.836 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 2024-09-10T23:54:01.836 INFO:teuthology.orchestra.run.smithi111.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T23:54:01.836 INFO:teuthology.orchestra.run.smithi111.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T23:54:01.836 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T23:54:01.836 INFO:teuthology.orchestra.run.smithi111.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T23:54:01.836 INFO:teuthology.orchestra.run.smithi111.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T23:54:01.836 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:54:01.836 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-10T23:54:02.039 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-fuse 2024-09-10T23:54:02.140 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-fuse 2024-09-10T23:54:02.789 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:27 ago on Tue 10 Sep 2024 11:52:35 PM UTC. 2024-09-10T23:54:02.897 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:29 ago on Tue 10 Sep 2024 11:52:33 PM UTC. 2024-09-10T23:54:02.935 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-10T23:54:02.935 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:54:02.935 INFO:teuthology.orchestra.run.smithi203.stdout: Package Architecture Version Repository Size 2024-09-10T23:54:02.935 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:54:02.935 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-10T23:54:02.935 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-fuse x86_64 2:18.2.0-0.el9 ceph 835 k 2024-09-10T23:54:02.936 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-09-10T23:54:02.936 INFO:teuthology.orchestra.run.smithi203.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T23:54:02.936 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:54:02.936 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-10T23:54:02.936 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:54:02.936 INFO:teuthology.orchestra.run.smithi203.stdout:Install 2 Packages 2024-09-10T23:54:02.936 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:54:02.937 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 914 k 2024-09-10T23:54:02.937 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 2.7 M 2024-09-10T23:54:02.937 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-10T23:54:03.042 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-10T23:54:03.043 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:54:03.043 INFO:teuthology.orchestra.run.smithi111.stdout: Package Architecture Version Repository Size 2024-09-10T23:54:03.043 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:54:03.043 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-10T23:54:03.043 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-fuse x86_64 2:18.2.0-0.el9 ceph 835 k 2024-09-10T23:54:03.043 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-09-10T23:54:03.043 INFO:teuthology.orchestra.run.smithi111.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T23:54:03.044 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:54:03.044 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-10T23:54:03.044 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:54:03.044 INFO:teuthology.orchestra.run.smithi111.stdout:Install 2 Packages 2024-09-10T23:54:03.044 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:54:03.044 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 914 k 2024-09-10T23:54:03.044 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 2.7 M 2024-09-10T23:54:03.045 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-10T23:54:03.061 INFO:teuthology.orchestra.run.smithi203.stdout:(1/2): ceph-fuse-18.2.0-0.el9.x86_64.rpm 11 MB/s | 835 kB 00:00 2024-09-10T23:54:03.145 INFO:teuthology.orchestra.run.smithi111.stdout:(1/2): ceph-fuse-18.2.0-0.el9.x86_64.rpm 11 MB/s | 835 kB 00:00 2024-09-10T23:54:03.170 INFO:teuthology.orchestra.run.smithi111.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 799 kB/s | 80 kB 00:00 2024-09-10T23:54:03.170 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:54:03.171 INFO:teuthology.orchestra.run.smithi111.stdout:Total 7.0 MB/s | 914 kB 00:00 2024-09-10T23:54:03.193 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-10T23:54:03.203 INFO:teuthology.orchestra.run.smithi203.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 375 kB/s | 80 kB 00:00 2024-09-10T23:54:03.203 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:54:03.204 INFO:teuthology.orchestra.run.smithi203.stdout:Total 3.3 MB/s | 914 kB 00:00 2024-09-10T23:54:03.226 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-10T23:54:03.226 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-10T23:54:03.227 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-10T23:54:03.260 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-10T23:54:03.260 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-10T23:54:03.323 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-10T23:54:03.324 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-10T23:54:03.358 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-10T23:54:03.358 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-10T23:54:03.524 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-10T23:54:03.568 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-10T23:54:03.708 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-10T23:54:03.717 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-10T23:54:03.777 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-09-10T23:54:03.785 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-09-10T23:54:04.684 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-09-10T23:54:04.684 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-fuse-2:18.2.0-0.el9.x86_64 1/2 2024-09-10T23:54:04.689 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-09-10T23:54:04.689 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-fuse-2:18.2.0-0.el9.x86_64 1/2 2024-09-10T23:54:04.974 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-10T23:54:04.974 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:54:04.974 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-10T23:54:04.975 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-fuse-2:18.2.0-0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-10T23:54:04.975 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:54:04.975 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-10T23:54:05.004 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-10T23:54:05.004 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:54:05.004 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-10T23:54:05.004 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-fuse-2:18.2.0-0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-10T23:54:05.004 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:54:05.004 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-10T23:54:05.330 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install librados-devel 2024-09-10T23:54:05.363 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install librados-devel 2024-09-10T23:54:06.096 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:33 ago on Tue 10 Sep 2024 11:52:33 PM UTC. 2024-09-10T23:54:06.146 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:31 ago on Tue 10 Sep 2024 11:52:35 PM UTC. 2024-09-10T23:54:06.234 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-10T23:54:06.235 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:54:06.235 INFO:teuthology.orchestra.run.smithi111.stdout: Package Architecture Version Repository Size 2024-09-10T23:54:06.235 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:54:06.235 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-10T23:54:06.235 INFO:teuthology.orchestra.run.smithi111.stdout: librados-devel x86_64 2:18.2.0-0.el9 ceph 126 k 2024-09-10T23:54:06.235 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:54:06.235 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-10T23:54:06.235 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:54:06.236 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2024-09-10T23:54:06.236 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:54:06.236 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 126 k 2024-09-10T23:54:06.236 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 456 k 2024-09-10T23:54:06.236 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-10T23:54:06.284 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-10T23:54:06.286 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:54:06.286 INFO:teuthology.orchestra.run.smithi203.stdout: Package Architecture Version Repository Size 2024-09-10T23:54:06.286 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:54:06.286 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-10T23:54:06.286 INFO:teuthology.orchestra.run.smithi203.stdout: librados-devel x86_64 2:18.2.0-0.el9 ceph 126 k 2024-09-10T23:54:06.286 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:54:06.286 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-10T23:54:06.287 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:54:06.287 INFO:teuthology.orchestra.run.smithi203.stdout:Install 1 Package 2024-09-10T23:54:06.287 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:54:06.287 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 126 k 2024-09-10T23:54:06.287 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 456 k 2024-09-10T23:54:06.287 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-10T23:54:06.300 INFO:teuthology.orchestra.run.smithi111.stdout:librados-devel-18.2.0-0.el9.x86_64.rpm 2.0 MB/s | 126 kB 00:00 2024-09-10T23:54:06.300 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:54:06.301 INFO:teuthology.orchestra.run.smithi111.stdout:Total 1.9 MB/s | 126 kB 00:00 2024-09-10T23:54:06.301 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-10T23:54:06.308 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-10T23:54:06.308 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-10T23:54:06.335 INFO:teuthology.orchestra.run.smithi203.stdout:librados-devel-18.2.0-0.el9.x86_64.rpm 2.6 MB/s | 126 kB 00:00 2024-09-10T23:54:06.335 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:54:06.336 INFO:teuthology.orchestra.run.smithi203.stdout:Total 2.5 MB/s | 126 kB 00:00 2024-09-10T23:54:06.336 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-10T23:54:06.342 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-10T23:54:06.342 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-10T23:54:06.380 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-10T23:54:06.380 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-10T23:54:06.413 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-10T23:54:06.414 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-10T23:54:06.546 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-10T23:54:06.579 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-10T23:54:06.680 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:06.681 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:07.221 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:07.257 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:07.509 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:07.509 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:54:07.509 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-10T23:54:07.509 INFO:teuthology.orchestra.run.smithi203.stdout: librados-devel-2:18.2.0-0.el9.x86_64 2024-09-10T23:54:07.509 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:54:07.509 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-10T23:54:07.511 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:07.511 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:54:07.512 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-10T23:54:07.512 INFO:teuthology.orchestra.run.smithi111.stdout: librados-devel-2:18.2.0-0.el9.x86_64 2024-09-10T23:54:07.512 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:54:07.512 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-10T23:54:07.792 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install libcephfs2 2024-09-10T23:54:07.822 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install libcephfs2 2024-09-10T23:54:08.565 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:35 ago on Tue 10 Sep 2024 11:52:33 PM UTC. 2024-09-10T23:54:08.597 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:33 ago on Tue 10 Sep 2024 11:52:35 PM UTC. 2024-09-10T23:54:08.669 INFO:teuthology.orchestra.run.smithi111.stdout:Package libcephfs2-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T23:54:08.698 INFO:teuthology.orchestra.run.smithi203.stdout:Package libcephfs2-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T23:54:08.713 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-10T23:54:08.715 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-09-10T23:54:08.715 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-10T23:54:08.741 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-10T23:54:08.743 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-09-10T23:54:08.743 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-10T23:54:08.796 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install libcephfs-devel 2024-09-10T23:54:08.834 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install libcephfs-devel 2024-09-10T23:54:09.541 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:36 ago on Tue 10 Sep 2024 11:52:33 PM UTC. 2024-09-10T23:54:09.592 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:34 ago on Tue 10 Sep 2024 11:52:35 PM UTC. 2024-09-10T23:54:09.681 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-10T23:54:09.682 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:54:09.682 INFO:teuthology.orchestra.run.smithi111.stdout: Package Architecture Version Repository Size 2024-09-10T23:54:09.682 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:54:09.682 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-10T23:54:09.682 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs-devel x86_64 2:18.2.0-0.el9 ceph 30 k 2024-09-10T23:54:09.682 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:54:09.682 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-10T23:54:09.682 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:54:09.682 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2024-09-10T23:54:09.682 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:54:09.682 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 30 k 2024-09-10T23:54:09.682 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 137 k 2024-09-10T23:54:09.683 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-10T23:54:09.735 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-10T23:54:09.736 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:54:09.736 INFO:teuthology.orchestra.run.smithi203.stdout: Package Architecture Version Repository Size 2024-09-10T23:54:09.736 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:54:09.736 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-10T23:54:09.736 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs-devel x86_64 2:18.2.0-0.el9 ceph 30 k 2024-09-10T23:54:09.736 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:54:09.737 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-10T23:54:09.737 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:54:09.737 INFO:teuthology.orchestra.run.smithi203.stdout:Install 1 Package 2024-09-10T23:54:09.737 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:54:09.737 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 30 k 2024-09-10T23:54:09.737 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 137 k 2024-09-10T23:54:09.738 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-10T23:54:09.753 INFO:teuthology.orchestra.run.smithi111.stdout:libcephfs-devel-18.2.0-0.el9.x86_64.rpm 432 kB/s | 30 kB 00:00 2024-09-10T23:54:09.754 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:54:09.754 INFO:teuthology.orchestra.run.smithi111.stdout:Total 422 kB/s | 30 kB 00:00 2024-09-10T23:54:09.754 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-10T23:54:09.759 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-10T23:54:09.759 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-10T23:54:09.780 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-10T23:54:09.780 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-10T23:54:09.790 INFO:teuthology.orchestra.run.smithi203.stdout:libcephfs-devel-18.2.0-0.el9.x86_64.rpm 582 kB/s | 30 kB 00:00 2024-09-10T23:54:09.791 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:54:09.791 INFO:teuthology.orchestra.run.smithi203.stdout:Total 563 kB/s | 30 kB 00:00 2024-09-10T23:54:09.791 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-10T23:54:09.796 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-10T23:54:09.796 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-10T23:54:09.817 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-10T23:54:09.817 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-10T23:54:09.871 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-10T23:54:09.912 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-10T23:54:10.037 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:10.058 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:10.500 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:10.507 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:10.751 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:10.751 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:54:10.751 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-10T23:54:10.751 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs-devel-2:18.2.0-0.el9.x86_64 2024-09-10T23:54:10.751 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:54:10.751 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-10T23:54:10.759 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:10.759 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:54:10.759 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-10T23:54:10.759 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs-devel-2:18.2.0-0.el9.x86_64 2024-09-10T23:54:10.759 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:54:10.759 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-10T23:54:10.975 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install librados2 2024-09-10T23:54:10.990 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install librados2 2024-09-10T23:54:11.716 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:36 ago on Tue 10 Sep 2024 11:52:35 PM UTC. 2024-09-10T23:54:11.729 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:38 ago on Tue 10 Sep 2024 11:52:33 PM UTC. 2024-09-10T23:54:11.817 INFO:teuthology.orchestra.run.smithi203.stdout:Package librados2-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T23:54:11.830 INFO:teuthology.orchestra.run.smithi111.stdout:Package librados2-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T23:54:11.860 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-10T23:54:11.861 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-09-10T23:54:11.861 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-10T23:54:11.873 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-10T23:54:11.874 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-09-10T23:54:11.874 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-10T23:54:11.952 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install librbd1 2024-09-10T23:54:11.953 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install librbd1 2024-09-10T23:54:12.691 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:39 ago on Tue 10 Sep 2024 11:52:33 PM UTC. 2024-09-10T23:54:12.699 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:37 ago on Tue 10 Sep 2024 11:52:35 PM UTC. 2024-09-10T23:54:12.792 INFO:teuthology.orchestra.run.smithi111.stdout:Package librbd1-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T23:54:12.801 INFO:teuthology.orchestra.run.smithi203.stdout:Package librbd1-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T23:54:12.836 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-10T23:54:12.837 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-09-10T23:54:12.837 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-10T23:54:12.844 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-10T23:54:12.846 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-09-10T23:54:12.846 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-10T23:54:12.930 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install python3-rados 2024-09-10T23:54:12.939 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install python3-rados 2024-09-10T23:54:13.672 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:40 ago on Tue 10 Sep 2024 11:52:33 PM UTC. 2024-09-10T23:54:13.683 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:38 ago on Tue 10 Sep 2024 11:52:35 PM UTC. 2024-09-10T23:54:13.769 INFO:teuthology.orchestra.run.smithi111.stdout:Package python3-rados-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T23:54:13.782 INFO:teuthology.orchestra.run.smithi203.stdout:Package python3-rados-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T23:54:13.812 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-10T23:54:13.813 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-09-10T23:54:13.814 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-10T23:54:13.827 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-10T23:54:13.828 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-09-10T23:54:13.828 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-10T23:54:13.897 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install python3-rgw 2024-09-10T23:54:13.927 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install python3-rgw 2024-09-10T23:54:14.635 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:41 ago on Tue 10 Sep 2024 11:52:33 PM UTC. 2024-09-10T23:54:14.672 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:39 ago on Tue 10 Sep 2024 11:52:35 PM UTC. 2024-09-10T23:54:14.731 INFO:teuthology.orchestra.run.smithi111.stdout:Package python3-rgw-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T23:54:14.771 INFO:teuthology.orchestra.run.smithi203.stdout:Package python3-rgw-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T23:54:14.775 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-10T23:54:14.776 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-09-10T23:54:14.776 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-10T23:54:14.815 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-10T23:54:14.816 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-09-10T23:54:14.816 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-10T23:54:14.860 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install python3-cephfs 2024-09-10T23:54:14.911 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install python3-cephfs 2024-09-10T23:54:15.609 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:42 ago on Tue 10 Sep 2024 11:52:33 PM UTC. 2024-09-10T23:54:15.663 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:40 ago on Tue 10 Sep 2024 11:52:35 PM UTC. 2024-09-10T23:54:15.700 INFO:teuthology.orchestra.run.smithi111.stdout:Package python3-cephfs-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T23:54:15.744 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-10T23:54:15.745 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-09-10T23:54:15.745 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-10T23:54:15.761 INFO:teuthology.orchestra.run.smithi203.stdout:Package python3-cephfs-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T23:54:15.804 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-10T23:54:15.805 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-09-10T23:54:15.805 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-10T23:54:15.830 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install python3-rbd 2024-09-10T23:54:15.898 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install python3-rbd 2024-09-10T23:54:16.584 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:43 ago on Tue 10 Sep 2024 11:52:33 PM UTC. 2024-09-10T23:54:16.674 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:41 ago on Tue 10 Sep 2024 11:52:35 PM UTC. 2024-09-10T23:54:16.681 INFO:teuthology.orchestra.run.smithi111.stdout:Package python3-rbd-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T23:54:16.726 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-10T23:54:16.727 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-09-10T23:54:16.727 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-10T23:54:16.782 INFO:teuthology.orchestra.run.smithi203.stdout:Package python3-rbd-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T23:54:16.819 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install rbd-fuse 2024-09-10T23:54:16.828 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-10T23:54:16.829 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-09-10T23:54:16.829 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-10T23:54:16.923 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install rbd-fuse 2024-09-10T23:54:17.553 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:44 ago on Tue 10 Sep 2024 11:52:33 PM UTC. 2024-09-10T23:54:17.668 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:42 ago on Tue 10 Sep 2024 11:52:35 PM UTC. 2024-09-10T23:54:17.697 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-10T23:54:17.698 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:54:17.698 INFO:teuthology.orchestra.run.smithi111.stdout: Package Architecture Version Repository Size 2024-09-10T23:54:17.698 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:54:17.698 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-10T23:54:17.698 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-fuse x86_64 2:18.2.0-0.el9 ceph 86 k 2024-09-10T23:54:17.698 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:54:17.698 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-10T23:54:17.698 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:54:17.698 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2024-09-10T23:54:17.698 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:54:17.699 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 86 k 2024-09-10T23:54:17.699 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 230 k 2024-09-10T23:54:17.699 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-10T23:54:17.789 INFO:teuthology.orchestra.run.smithi111.stdout:rbd-fuse-18.2.0-0.el9.x86_64.rpm 944 kB/s | 86 kB 00:00 2024-09-10T23:54:17.790 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:54:17.790 INFO:teuthology.orchestra.run.smithi111.stdout:Total 927 kB/s | 86 kB 00:00 2024-09-10T23:54:17.790 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-10T23:54:17.799 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-10T23:54:17.799 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-10T23:54:17.812 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-10T23:54:17.813 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:54:17.813 INFO:teuthology.orchestra.run.smithi203.stdout: Package Architecture Version Repository Size 2024-09-10T23:54:17.813 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:54:17.813 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-10T23:54:17.813 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-fuse x86_64 2:18.2.0-0.el9 ceph 86 k 2024-09-10T23:54:17.813 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:54:17.813 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-10T23:54:17.814 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:54:17.814 INFO:teuthology.orchestra.run.smithi203.stdout:Install 1 Package 2024-09-10T23:54:17.814 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:54:17.814 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 86 k 2024-09-10T23:54:17.814 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 230 k 2024-09-10T23:54:17.814 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-10T23:54:17.868 INFO:teuthology.orchestra.run.smithi203.stdout:rbd-fuse-18.2.0-0.el9.x86_64.rpm 1.6 MB/s | 86 kB 00:00 2024-09-10T23:54:17.869 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:54:17.869 INFO:teuthology.orchestra.run.smithi203.stdout:Total 1.5 MB/s | 86 kB 00:00 2024-09-10T23:54:17.869 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-10T23:54:17.871 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-10T23:54:17.871 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-10T23:54:17.878 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-10T23:54:17.878 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-10T23:54:17.951 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-10T23:54:17.952 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-10T23:54:18.032 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-10T23:54:18.125 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-10T23:54:18.160 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:18.215 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:18.632 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:18.655 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:18.908 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:18.908 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:54:18.909 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-10T23:54:18.909 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-fuse-2:18.2.0-0.el9.x86_64 2024-09-10T23:54:18.909 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:54:18.909 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-10T23:54:18.933 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:18.933 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:54:18.933 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-10T23:54:18.933 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-fuse-2:18.2.0-0.el9.x86_64 2024-09-10T23:54:18.934 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:54:18.934 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-10T23:54:19.209 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install rbd-mirror 2024-09-10T23:54:19.211 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install rbd-mirror 2024-09-10T23:54:19.966 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:44 ago on Tue 10 Sep 2024 11:52:35 PM UTC. 2024-09-10T23:54:19.979 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:46 ago on Tue 10 Sep 2024 11:52:33 PM UTC. 2024-09-10T23:54:20.116 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-10T23:54:20.117 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:54:20.117 INFO:teuthology.orchestra.run.smithi203.stdout: Package Architecture Version Repository Size 2024-09-10T23:54:20.117 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:54:20.118 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-10T23:54:20.118 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-mirror x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-09-10T23:54:20.118 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:54:20.118 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-10T23:54:20.118 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:54:20.118 INFO:teuthology.orchestra.run.smithi203.stdout:Install 1 Package 2024-09-10T23:54:20.118 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:54:20.118 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 3.0 M 2024-09-10T23:54:20.118 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 12 M 2024-09-10T23:54:20.118 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-10T23:54:20.122 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-10T23:54:20.123 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:54:20.123 INFO:teuthology.orchestra.run.smithi111.stdout: Package Architecture Version Repository Size 2024-09-10T23:54:20.123 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:54:20.123 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-10T23:54:20.123 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-mirror x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-09-10T23:54:20.123 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:54:20.123 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-10T23:54:20.123 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:54:20.123 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2024-09-10T23:54:20.123 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:54:20.124 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 3.0 M 2024-09-10T23:54:20.124 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 12 M 2024-09-10T23:54:20.124 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-10T23:54:20.224 INFO:teuthology.orchestra.run.smithi203.stdout:rbd-mirror-18.2.0-0.el9.x86_64.rpm 28 MB/s | 3.0 MB 00:00 2024-09-10T23:54:20.225 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:54:20.225 INFO:teuthology.orchestra.run.smithi203.stdout:Total 28 MB/s | 3.0 MB 00:00 2024-09-10T23:54:20.226 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-10T23:54:20.234 INFO:teuthology.orchestra.run.smithi111.stdout:rbd-mirror-18.2.0-0.el9.x86_64.rpm 27 MB/s | 3.0 MB 00:00 2024-09-10T23:54:20.235 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:54:20.235 INFO:teuthology.orchestra.run.smithi111.stdout:Total 27 MB/s | 3.0 MB 00:00 2024-09-10T23:54:20.235 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-10T23:54:20.236 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-10T23:54:20.236 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-10T23:54:20.245 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-10T23:54:20.246 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-10T23:54:20.327 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-10T23:54:20.327 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-10T23:54:20.334 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-10T23:54:20.334 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-10T23:54:20.780 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-10T23:54:20.796 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-10T23:54:20.867 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:20.893 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:20.920 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:20.920 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:54:20.920 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T23:54:20.920 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:54:20.920 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:54:20.920 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:54:20.945 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:20.946 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T23:54:20.946 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T23:54:20.946 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:54:20.946 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T23:54:20.946 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:54:22.218 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:22.218 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:54:22.218 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-10T23:54:22.218 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-mirror-2:18.2.0-0.el9.x86_64 2024-09-10T23:54:22.218 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:54:22.218 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-10T23:54:22.229 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:22.229 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:54:22.229 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-10T23:54:22.230 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-mirror-2:18.2.0-0.el9.x86_64 2024-09-10T23:54:22.230 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:54:22.230 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-10T23:54:22.518 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install rbd-nbd 2024-09-10T23:54:22.535 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install rbd-nbd 2024-09-10T23:54:23.289 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:48 ago on Tue 10 Sep 2024 11:52:35 PM UTC. 2024-09-10T23:54:23.307 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:50 ago on Tue 10 Sep 2024 11:52:33 PM UTC. 2024-09-10T23:54:23.434 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-10T23:54:23.435 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:54:23.435 INFO:teuthology.orchestra.run.smithi203.stdout: Package Architecture Version Repository Size 2024-09-10T23:54:23.435 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:54:23.435 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-10T23:54:23.435 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-nbd x86_64 2:18.2.0-0.el9 ceph 169 k 2024-09-10T23:54:23.435 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:54:23.435 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-10T23:54:23.435 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-10T23:54:23.436 INFO:teuthology.orchestra.run.smithi203.stdout:Install 1 Package 2024-09-10T23:54:23.436 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:54:23.436 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 169 k 2024-09-10T23:54:23.436 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 490 k 2024-09-10T23:54:23.436 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-10T23:54:23.451 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-10T23:54:23.452 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:54:23.452 INFO:teuthology.orchestra.run.smithi111.stdout: Package Architecture Version Repository Size 2024-09-10T23:54:23.452 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:54:23.452 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-10T23:54:23.452 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-nbd x86_64 2:18.2.0-0.el9 ceph 169 k 2024-09-10T23:54:23.452 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:54:23.452 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-10T23:54:23.452 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-10T23:54:23.453 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2024-09-10T23:54:23.453 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:54:23.453 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 169 k 2024-09-10T23:54:23.453 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 490 k 2024-09-10T23:54:23.453 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-10T23:54:23.489 INFO:teuthology.orchestra.run.smithi203.stdout:rbd-nbd-18.2.0-0.el9.x86_64.rpm 3.2 MB/s | 169 kB 00:00 2024-09-10T23:54:23.490 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:54:23.490 INFO:teuthology.orchestra.run.smithi203.stdout:Total 3.1 MB/s | 169 kB 00:00 2024-09-10T23:54:23.490 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-10T23:54:23.499 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-10T23:54:23.499 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-10T23:54:23.513 INFO:teuthology.orchestra.run.smithi111.stdout:rbd-nbd-18.2.0-0.el9.x86_64.rpm 2.8 MB/s | 169 kB 00:00 2024-09-10T23:54:23.514 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:54:23.514 INFO:teuthology.orchestra.run.smithi111.stdout:Total 2.7 MB/s | 169 kB 00:00 2024-09-10T23:54:23.514 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-10T23:54:23.523 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-10T23:54:23.524 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-10T23:54:23.574 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-10T23:54:23.575 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-10T23:54:23.597 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-10T23:54:23.597 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-10T23:54:23.742 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-10T23:54:23.758 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-10T23:54:23.854 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:23.885 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:24.367 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:24.438 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:24.687 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:24.687 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:54:24.687 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-10T23:54:24.688 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-nbd-2:18.2.0-0.el9.x86_64 2024-09-10T23:54:24.688 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:54:24.688 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-10T23:54:24.785 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T23:54:24.785 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:54:24.785 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-10T23:54:24.785 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-nbd-2:18.2.0-0.el9.x86_64 2024-09-10T23:54:24.785 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:54:24.785 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-10T23:54:24.987 DEBUG:teuthology.parallel:result is None 2024-09-10T23:54:25.102 DEBUG:teuthology.parallel:result is None 2024-09-10T23:54:25.103 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-10T23:54:25.103 INFO:teuthology.packaging:ref: None 2024-09-10T23:54:25.103 INFO:teuthology.packaging:tag: v18.2.0 2024-09-10T23:54:25.103 INFO:teuthology.packaging:branch: None 2024-09-10T23:54:25.103 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:54:25.103 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-10T23:54:25.258 DEBUG:teuthology.orchestra.run.smithi111:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T23:54:25.302 INFO:teuthology.orchestra.run.smithi111.stdout:18.2.0-0.el9 2024-09-10T23:54:25.302 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-0.el9 2024-09-10T23:54:25.303 INFO:teuthology.task.install:The correct ceph version 18.2.0-0 is installed. 2024-09-10T23:54:25.305 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-10T23:54:25.305 INFO:teuthology.packaging:ref: None 2024-09-10T23:54:25.305 INFO:teuthology.packaging:tag: v18.2.0 2024-09-10T23:54:25.305 INFO:teuthology.packaging:branch: None 2024-09-10T23:54:25.305 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:54:25.305 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-10T23:54:25.452 DEBUG:teuthology.orchestra.run.smithi203:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T23:54:25.501 INFO:teuthology.orchestra.run.smithi203.stdout:18.2.0-0.el9 2024-09-10T23:54:25.501 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-0.el9 2024-09-10T23:54:25.502 INFO:teuthology.task.install:The correct ceph version 18.2.0-0 is installed. 2024-09-10T23:54:25.503 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T23:54:25.504 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-10T23:54:25.504 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T23:54:25.560 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-10T23:54:25.560 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T23:54:25.619 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T23:54:25.619 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-10T23:54:25.619 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T23:54:25.674 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T23:54:25.770 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-10T23:54:25.771 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T23:54:25.866 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T23:54:25.963 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T23:54:25.963 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-10T23:54:25.963 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T23:54:26.020 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T23:54:26.114 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-10T23:54:26.114 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T23:54:26.169 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T23:54:26.265 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T23:54:26.266 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-10T23:54:26.266 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T23:54:26.321 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T23:54:26.416 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-10T23:54:26.416 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T23:54:26.471 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T23:54:26.565 INFO:teuthology.run_tasks:Running task print... 2024-09-10T23:54:26.575 INFO:teuthology.task.print:**** done install task... 2024-09-10T23:54:26.575 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-10T23:54:26.706 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'global': {'mon pg warn min per osd': 0}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}}, 'image': 'quay.io/ceph/ceph:v18.2.0', 'roleless': True, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'} 2024-09-10T23:54:26.706 INFO:tasks.cephadm:Cluster image is quay.io/ceph/ceph:v18.2.0 2024-09-10T23:54:26.706 INFO:tasks.cephadm:Cluster fsid is 03107fbe-6fd0-11ef-bcea-c7b262605968 2024-09-10T23:54:26.707 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-10T23:54:26.707 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-10T23:54:26.707 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi111': '172.21.15.111', 'mon.smithi203': '172.21.15.203'} 2024-09-10T23:54:26.707 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-10T23:54:26.707 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname $(hostname -s) 2024-09-10T23:54:26.764 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname $(hostname -s) 2024-09-10T23:54:26.821 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for reef 2024-09-10T23:54:26.821 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:54:26.980 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82938/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4854-g8f219c47', 'node_name': '172.21.2.8+braggi08', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4854.g8f219c47'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-10 09:27:13.215997', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-hemanth-testing-2024-09-10-0723', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-10T23:54:27.250 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref reef, sha1 7a853b1706d076d58e0da7a5d3b9b9eb36276880 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=reef 2024-09-10T23:54:27.252 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/reef/7a853b1706d076d58e0da7a5d3b9b9eb36276880/centos/9/x86_64/flavors/default/cephadm 2024-09-10T23:54:27.252 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/reef/7a853b1706d076d58e0da7a5d3b9b9eb36276880/centos/9/x86_64/flavors/default/cephadm 2024-09-10T23:54:27.252 DEBUG:teuthology.orchestra.run.smithi111:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef/7a853b1706d076d58e0da7a5d3b9b9eb36276880/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T23:54:27.615 INFO:teuthology.orchestra.run.smithi111.stdout:-rw-r--r--. 1 ubuntu ubuntu 217225 Sep 10 23:54 /home/ubuntu/cephtest/cephadm 2024-09-10T23:54:27.615 DEBUG:teuthology.orchestra.run.smithi203:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef/7a853b1706d076d58e0da7a5d3b9b9eb36276880/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T23:54:27.987 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r--. 1 ubuntu ubuntu 217225 Sep 10 23:54 /home/ubuntu/cephtest/cephadm 2024-09-10T23:54:27.988 DEBUG:teuthology.orchestra.run.smithi111:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T23:54:28.028 DEBUG:teuthology.orchestra.run.smithi203:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T23:54:28.079 INFO:tasks.cephadm:Pulling image quay.io/ceph/ceph:v18.2.0 on all hosts... 2024-09-10T23:54:28.079 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 pull 2024-09-10T23:54:28.083 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 pull 2024-09-10T23:54:29.921 INFO:teuthology.orchestra.run.smithi111.stderr:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-09-10T23:54:29.951 INFO:teuthology.orchestra.run.smithi203.stderr:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-09-10T23:54:46.486 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-10T23:54:46.486 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-09-10T23:54:46.486 INFO:teuthology.orchestra.run.smithi111.stdout: "image_id": "dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946", 2024-09-10T23:54:46.486 INFO:teuthology.orchestra.run.smithi111.stdout: "repo_digests": [ 2024-09-10T23:54:46.486 INFO:teuthology.orchestra.run.smithi111.stdout: "quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007", 2024-09-10T23:54:46.486 INFO:teuthology.orchestra.run.smithi111.stdout: "quay.io/ceph/ceph@sha256:d58cf65589d0abf9d5261cd46fb62be3bfb29098febc78c0fcdf116a15274d27" 2024-09-10T23:54:46.487 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-10T23:54:46.487 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-10T23:54:46.952 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-10T23:54:46.952 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-09-10T23:54:46.952 INFO:teuthology.orchestra.run.smithi203.stdout: "image_id": "dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946", 2024-09-10T23:54:46.953 INFO:teuthology.orchestra.run.smithi203.stdout: "repo_digests": [ 2024-09-10T23:54:46.953 INFO:teuthology.orchestra.run.smithi203.stdout: "quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007", 2024-09-10T23:54:46.953 INFO:teuthology.orchestra.run.smithi203.stdout: "quay.io/ceph/ceph@sha256:d58cf65589d0abf9d5261cd46fb62be3bfb29098febc78c0fcdf116a15274d27" 2024-09-10T23:54:46.953 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-10T23:54:46.953 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-10T23:54:46.975 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /etc/ceph 2024-09-10T23:54:47.033 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /etc/ceph 2024-09-10T23:54:47.091 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 777 /etc/ceph 2024-09-10T23:54:47.146 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 777 /etc/ceph 2024-09-10T23:54:47.201 INFO:tasks.cephadm:Writing seed config... 2024-09-10T23:54:47.202 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-10T23:54:47.203 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-10T23:54:47.203 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-10T23:54:47.203 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-10T23:54:47.203 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-10T23:54:47.203 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-10T23:54:47.203 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-10T23:54:47.203 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-10T23:54:47.203 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-10T23:54:47.203 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-10T23:54:47.203 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-10T23:54:47.203 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-10T23:54:47.204 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-10T23:54:47.204 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-10T23:54:47.204 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-10T23:54:47.204 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-10T23:54:47.204 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-10T23:54:47.204 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-10T23:54:47.204 INFO:tasks.cephadm: override: [mgr] client mount timeout = 30 2024-09-10T23:54:47.204 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-10T23:54:47.204 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-10T23:54:47.204 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-10T23:54:47.204 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-10T23:54:47.205 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-10T23:54:47.205 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-10T23:54:47.205 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-10T23:54:47.205 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-10T23:54:47.206 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-10T23:54:47.240 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 03107fbe-6fd0-11ef-bcea-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false client mount timeout = 30 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-10T23:54:47.241 DEBUG:teuthology.orchestra.run.smithi111:mon.smithi111> sudo journalctl -f -n 0 -u ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@mon.smithi111.service 2024-09-10T23:54:47.284 INFO:tasks.cephadm:Bootstrapping... 2024-09-10T23:54:47.285 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 -v bootstrap --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.111 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:54:47.484 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:54:47.484 INFO:teuthology.orchestra.run.smithi111.stdout:cephadm ['--image', 'quay.io/ceph/ceph:v18.2.0', '-v', 'bootstrap', '--fsid', '03107fbe-6fd0-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.111', '--skip-admin-label'] 2024-09-10T23:54:47.528 INFO:teuthology.orchestra.run.smithi111.stdout:/bin/podman: stdout 5.2.2 2024-09-10T23:54:47.529 INFO:teuthology.orchestra.run.smithi111.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-10T23:54:47.529 INFO:teuthology.orchestra.run.smithi111.stdout:Verifying podman|docker is present... 2024-09-10T23:54:47.572 INFO:teuthology.orchestra.run.smithi111.stdout:/bin/podman: stdout 5.2.2 2024-09-10T23:54:47.572 INFO:teuthology.orchestra.run.smithi111.stdout:Verifying lvm2 is present... 2024-09-10T23:54:47.572 INFO:teuthology.orchestra.run.smithi111.stdout:Verifying time synchronization is in place... 2024-09-10T23:54:47.585 INFO:teuthology.orchestra.run.smithi111.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T23:54:47.586 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T23:54:47.598 INFO:teuthology.orchestra.run.smithi111.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T23:54:47.598 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stdout inactive 2024-09-10T23:54:47.611 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stdout enabled 2024-09-10T23:54:47.624 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stdout active 2024-09-10T23:54:47.624 INFO:teuthology.orchestra.run.smithi111.stdout:Unit chronyd.service is enabled and running 2024-09-10T23:54:47.624 INFO:teuthology.orchestra.run.smithi111.stdout:Repeating the final host check... 2024-09-10T23:54:47.667 INFO:teuthology.orchestra.run.smithi111.stdout:/bin/podman: stdout 5.2.2 2024-09-10T23:54:47.667 INFO:teuthology.orchestra.run.smithi111.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-10T23:54:47.667 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl is present 2024-09-10T23:54:47.667 INFO:teuthology.orchestra.run.smithi111.stdout:lvcreate is present 2024-09-10T23:54:47.680 INFO:teuthology.orchestra.run.smithi111.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T23:54:47.680 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T23:54:47.692 INFO:teuthology.orchestra.run.smithi111.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T23:54:47.692 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stdout inactive 2024-09-10T23:54:47.705 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stdout enabled 2024-09-10T23:54:47.717 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stdout active 2024-09-10T23:54:47.718 INFO:teuthology.orchestra.run.smithi111.stdout:Unit chronyd.service is enabled and running 2024-09-10T23:54:47.718 INFO:teuthology.orchestra.run.smithi111.stdout:Host looks OK 2024-09-10T23:54:47.718 INFO:teuthology.orchestra.run.smithi111.stdout:Cluster fsid: 03107fbe-6fd0-11ef-bcea-c7b262605968 2024-09-10T23:54:47.718 INFO:teuthology.orchestra.run.smithi111.stdout:Acquiring lock 140618532753520 on /run/cephadm/03107fbe-6fd0-11ef-bcea-c7b262605968.lock 2024-09-10T23:54:47.718 INFO:teuthology.orchestra.run.smithi111.stdout:Lock 140618532753520 acquired on /run/cephadm/03107fbe-6fd0-11ef-bcea-c7b262605968.lock 2024-09-10T23:54:47.719 INFO:teuthology.orchestra.run.smithi111.stdout:Verifying IP 172.21.15.111 port 3300 ... 2024-09-10T23:54:47.719 INFO:teuthology.orchestra.run.smithi111.stdout:Verifying IP 172.21.15.111 port 6789 ... 2024-09-10T23:54:47.719 INFO:teuthology.orchestra.run.smithi111.stdout:Base mon IP(s) is [172.21.15.111:3300, 172.21.15.111:6789], mon addrv is [v2:172.21.15.111:3300,v1:172.21.15.111:6789] 2024-09-10T23:54:47.725 INFO:teuthology.orchestra.run.smithi111.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.111 metric 100 2024-09-10T23:54:47.725 INFO:teuthology.orchestra.run.smithi111.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.111 metric 100 2024-09-10T23:54:47.731 INFO:teuthology.orchestra.run.smithi111.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-10T23:54:47.732 INFO:teuthology.orchestra.run.smithi111.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-10T23:54:47.732 INFO:teuthology.orchestra.run.smithi111.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-10T23:54:47.739 INFO:teuthology.orchestra.run.smithi111.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-10T23:54:47.739 INFO:teuthology.orchestra.run.smithi111.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-10T23:54:47.739 INFO:teuthology.orchestra.run.smithi111.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T23:54:47.739 INFO:teuthology.orchestra.run.smithi111.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-10T23:54:47.739 INFO:teuthology.orchestra.run.smithi111.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:cc2f/64 scope link noprefixroute 2024-09-10T23:54:47.740 INFO:teuthology.orchestra.run.smithi111.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T23:54:47.740 INFO:teuthology.orchestra.run.smithi111.stdout:Mon IP `172.21.15.111` is in CIDR network `172.21.0.0/20` 2024-09-10T23:54:47.740 INFO:teuthology.orchestra.run.smithi111.stdout:Mon IP `172.21.15.111` is in CIDR network `172.21.0.0/20` 2024-09-10T23:54:47.740 INFO:teuthology.orchestra.run.smithi111.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-10T23:54:47.740 INFO:teuthology.orchestra.run.smithi111.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-10T23:54:47.741 INFO:teuthology.orchestra.run.smithi111.stdout:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-09-10T23:54:48.538 INFO:teuthology.orchestra.run.smithi111.stdout:/bin/podman: stdout dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 2024-09-10T23:54:48.539 INFO:teuthology.orchestra.run.smithi111.stdout:/bin/podman: stderr Trying to pull quay.io/ceph/ceph:v18.2.0... 2024-09-10T23:54:48.539 INFO:teuthology.orchestra.run.smithi111.stdout:/bin/podman: stderr Getting image source signatures 2024-09-10T23:54:48.539 INFO:teuthology.orchestra.run.smithi111.stdout:/bin/podman: stderr Copying blob sha256:3bd20aeff60302f668275dc2005d10679ae56492967a3a5a54fd3dde85333aec 2024-09-10T23:54:48.539 INFO:teuthology.orchestra.run.smithi111.stdout:/bin/podman: stderr Copying blob sha256:46af8f5390d4e94fc57efb422ccb97bb53dfe5b948546bfc191b46557eb2dbd9 2024-09-10T23:54:48.539 INFO:teuthology.orchestra.run.smithi111.stdout:/bin/podman: stderr Copying config sha256:dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 2024-09-10T23:54:48.539 INFO:teuthology.orchestra.run.smithi111.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-10T23:54:49.583 INFO:teuthology.orchestra.run.smithi111.stdout:ceph: stdout ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable) 2024-09-10T23:54:49.583 INFO:teuthology.orchestra.run.smithi111.stdout:Ceph version: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable) 2024-09-10T23:54:49.584 INFO:teuthology.orchestra.run.smithi111.stdout:Extracting ceph user uid/gid from container image... 2024-09-10T23:54:50.673 INFO:teuthology.orchestra.run.smithi111.stdout:stat: stdout 167 167 2024-09-10T23:54:50.673 INFO:teuthology.orchestra.run.smithi111.stdout:Creating initial keys... 2024-09-10T23:54:51.728 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph-authtool: stdout AQBL3OBm4JdUAxAAQMQ9vpltT1fpKoU0Brq7Tg== 2024-09-10T23:54:52.677 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph-authtool: stdout AQBM3OBmYtm5BBAAHmijBoofj2CMuV/C2jsxFQ== 2024-09-10T23:54:53.566 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph-authtool: stdout AQBN3OBm322KARAATUNGxn/TfHDanE9ssR7VBw== 2024-09-10T23:54:53.567 INFO:teuthology.orchestra.run.smithi111.stdout:Creating initial monmap... 2024-09-10T23:54:54.665 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T23:54:54.665 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-09-10T23:54:54.665 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 03107fbe-6fd0-11ef-bcea-c7b262605968 2024-09-10T23:54:54.665 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T23:54:54.666 INFO:teuthology.orchestra.run.smithi111.stdout:monmaptool for smithi111 [v2:172.21.15.111:3300,v1:172.21.15.111:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T23:54:54.666 INFO:teuthology.orchestra.run.smithi111.stdout:setting min_mon_release = pacific 2024-09-10T23:54:54.666 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/monmaptool: set fsid to 03107fbe-6fd0-11ef-bcea-c7b262605968 2024-09-10T23:54:54.666 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T23:54:54.666 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:54:54.666 INFO:teuthology.orchestra.run.smithi111.stdout:Creating mon... 2024-09-10T23:54:55.645 INFO:teuthology.orchestra.run.smithi111.stdout:create mon.smithi111 on 2024-09-10T23:54:55.960 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-10T23:54:56.182 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-10T23:54:56.447 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-03107fbe-6fd0-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-03107fbe-6fd0-11ef-bcea-c7b262605968.target. 2024-09-10T23:54:56.447 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-03107fbe-6fd0-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-03107fbe-6fd0-11ef-bcea-c7b262605968.target. 2024-09-10T23:54:56.775 INFO:teuthology.orchestra.run.smithi111.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@mon.smithi111 2024-09-10T23:54:56.775 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stderr Failed to reset failed state of unit ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@mon.smithi111.service: Unit ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@mon.smithi111.service not loaded. 2024-09-10T23:54:57.043 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-03107fbe-6fd0-11ef-bcea-c7b262605968.target.wants/ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@mon.smithi111.service → /etc/systemd/system/ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@.service. 2024-09-10T23:54:57.669 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:54:57 smithi111 podman[27156]: 2024-09-10 23:54:57.607839725 +0000 UTC m=+0.317951618 container start d983e18f2ded50235fde316ad5fc62592a461eeaceab7e1124eec639ce4cb327 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi111, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.29.1) 2024-09-10T23:54:57.696 INFO:teuthology.orchestra.run.smithi111.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T23:54:57.696 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stdout disabled 2024-09-10T23:54:57.709 INFO:teuthology.orchestra.run.smithi111.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T23:54:57.709 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stdout inactive 2024-09-10T23:54:57.709 INFO:teuthology.orchestra.run.smithi111.stdout:firewalld.service is not enabled 2024-09-10T23:54:57.709 INFO:teuthology.orchestra.run.smithi111.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T23:54:57.709 INFO:teuthology.orchestra.run.smithi111.stdout:Waiting for mon to start... 2024-09-10T23:54:57.709 INFO:teuthology.orchestra.run.smithi111.stdout:Waiting for mon... 2024-09-10T23:54:57.984 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:54:57 smithi111 bash[27156]: d983e18f2ded50235fde316ad5fc62592a461eeaceab7e1124eec639ce4cb327 2024-09-10T23:54:57.984 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:54:57 smithi111 ceph-mon[27175]: mkfs 03107fbe-6fd0-11ef-bcea-c7b262605968 2024-09-10T23:54:57.984 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:54:57 smithi111 systemd[1]: Started Ceph mon.smithi111 for 03107fbe-6fd0-11ef-bcea-c7b262605968. 2024-09-10T23:54:57.984 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:54:57 smithi111 ceph-mon[27175]: mon.smithi111 is new leader, mons smithi111 in quorum (ranks 0) 2024-09-10T23:54:59.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:54:58 smithi111 ceph-mon[27175]: mon.smithi111 is new leader, mons smithi111 in quorum (ranks 0) 2024-09-10T23:54:59.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:54:58 smithi111 ceph-mon[27175]: monmap e1: 1 mons at {smithi111=[v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0]} removed_ranks: {} 2024-09-10T23:54:59.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:54:58 smithi111 ceph-mon[27175]: fsmap 2024-09-10T23:54:59.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:54:58 smithi111 ceph-mon[27175]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T23:54:59.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:54:58 smithi111 ceph-mon[27175]: mgrmap e1: no daemons active 2024-09-10T23:54:59.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:54:58 smithi111 ceph-mon[27175]: from='client.? 172.21.15.111:0/3268255138' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-10T23:54:59.472 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout cluster: 2024-09-10T23:54:59.473 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout id: 03107fbe-6fd0-11ef-bcea-c7b262605968 2024-09-10T23:54:59.474 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-10T23:54:59.474 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 2024-09-10T23:54:59.474 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout services: 2024-09-10T23:54:59.474 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi111 (age 0.654875s) 2024-09-10T23:54:59.474 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-10T23:54:59.474 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-10T23:54:59.474 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 2024-09-10T23:54:59.474 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout data: 2024-09-10T23:54:59.474 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-10T23:54:59.474 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-10T23:54:59.474 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-10T23:54:59.474 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout pgs: 2024-09-10T23:54:59.474 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 2024-09-10T23:54:59.474 INFO:teuthology.orchestra.run.smithi111.stdout:mon is available 2024-09-10T23:54:59.475 INFO:teuthology.orchestra.run.smithi111.stdout:Assimilating anything we can from ceph.conf... 2024-09-10T23:55:00.343 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:00 smithi111 ceph-mon[27175]: from='client.? 172.21.15.111:0/13590491' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-10T23:55:00.343 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:00 smithi111 ceph-mon[27175]: from='client.? 172.21.15.111:0/13590491' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-10T23:55:00.578 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 2024-09-10T23:55:00.578 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T23:55:00.578 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout fsid = 03107fbe-6fd0-11ef-bcea-c7b262605968 2024-09-10T23:55:00.578 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.111:3300,v1:172.21.15.111:6789] 2024-09-10T23:55:00.578 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T23:55:00.578 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T23:55:00.578 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T23:55:00.578 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T23:55:00.579 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 2024-09-10T23:55:00.579 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T23:55:00.579 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T23:55:00.579 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 2024-09-10T23:55:00.579 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T23:55:00.579 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T23:55:00.579 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T23:55:00.579 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T23:55:00.579 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T23:55:00.579 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T23:55:00.579 INFO:teuthology.orchestra.run.smithi111.stdout:Generating new minimal ceph.conf... 2024-09-10T23:55:01.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:01 smithi111 ceph-mon[27175]: from='client.? 172.21.15.111:0/1922761871' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:55:01.715 INFO:teuthology.orchestra.run.smithi111.stdout:Restarting the monitor... 2024-09-10T23:55:02.050 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:01 smithi111 systemd[1]: Stopping Ceph mon.smithi111 for 03107fbe-6fd0-11ef-bcea-c7b262605968... 2024-09-10T23:55:02.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:02 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi111[27171]: 2024-09-10T23:55:02.047+0000 7fb353800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi111 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T23:55:02.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:02 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi111[27171]: 2024-09-10T23:55:02.047+0000 7fb353800700 -1 mon.smithi111@0(leader) e1 *** Got Signal Terminated *** 2024-09-10T23:55:02.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:02 smithi111 podman[27420]: 2024-09-10 23:55:02.130966983 +0000 UTC m=+0.188445851 container died d983e18f2ded50235fde316ad5fc62592a461eeaceab7e1124eec639ce4cb327 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi111, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-09-10T23:55:02.790 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:02 smithi111 podman[27420]: 2024-09-10 23:55:02.536481804 +0000 UTC m=+0.593960676 container cleanup d983e18f2ded50235fde316ad5fc62592a461eeaceab7e1124eec639ce4cb327 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi111, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, io.buildah.version=1.29.1) 2024-09-10T23:55:02.790 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:02 smithi111 bash[27420]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi111 2024-09-10T23:55:03.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:02 smithi111 podman[27432]: 2024-09-10 23:55:02.780636134 +0000 UTC m=+0.639656120 container remove d983e18f2ded50235fde316ad5fc62592a461eeaceab7e1124eec639ce4cb327 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi111, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0, RELEASE=HEAD) 2024-09-10T23:55:03.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:02 smithi111 systemd[1]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@mon.smithi111.service: Deactivated successfully. 2024-09-10T23:55:03.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:02 smithi111 systemd[1]: Stopped Ceph mon.smithi111 for 03107fbe-6fd0-11ef-bcea-c7b262605968. 2024-09-10T23:55:03.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:02 smithi111 systemd[1]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@mon.smithi111.service: Consumed 1.211s CPU time. 2024-09-10T23:55:03.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:02 smithi111 systemd[1]: Starting Ceph mon.smithi111 for 03107fbe-6fd0-11ef-bcea-c7b262605968... 2024-09-10T23:55:03.543 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 podman[27521]: 2024-09-10 23:55:03.164979993 +0000 UTC m=+0.027505276 image pull dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 quay.io/ceph/ceph:v18.2.0 2024-09-10T23:55:03.543 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 podman[27521]: 2024-09-10 23:55:03.263177436 +0000 UTC m=+0.125702704 container create 2596322539fbebec35395882f8c23c49273317b131e36ae9e25152fddf6858a9 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi111, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, RELEASE=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-10T23:55:03.543 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 podman[27521]: 2024-09-10 23:55:03.498920445 +0000 UTC m=+0.361445733 container init 2596322539fbebec35395882f8c23c49273317b131e36ae9e25152fddf6858a9 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi111, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD) 2024-09-10T23:55:03.543 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 podman[27521]: 2024-09-10 23:55:03.505572632 +0000 UTC m=+0.368097906 container start 2596322539fbebec35395882f8c23c49273317b131e36ae9e25152fddf6858a9 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi111, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.0, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, RELEASE=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-10T23:55:03.600 INFO:teuthology.orchestra.run.smithi111.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-10T23:55:03.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T23:55:03.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable), process ceph-mon, pid 2 2024-09-10T23:55:03.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: pidfile_write: ignore empty --pid-file 2024-09-10T23:55:03.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: load: jerasure load: lrc 2024-09-10T23:55:03.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: RocksDB version: 7.9.2 2024-09-10T23:55:03.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Git sha 0 2024-09-10T23:55:03.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Compile date 2023-08-03 19:21:13 2024-09-10T23:55:03.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: DB SUMMARY 2024-09-10T23:55:03.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: DB Session ID: 6VVCXTF6KCETRBWUAK3B 2024-09-10T23:55:03.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: CURRENT file: CURRENT 2024-09-10T23:55:03.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T23:55:03.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-10T23:55:03.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi111/store.db dir, Total Num: 1, files: 000008.sst 2024-09-10T23:55:03.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi111/store.db: 000009.log size: 90906 ; 2024-09-10T23:55:03.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.error_if_exists: 0 2024-09-10T23:55:03.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.create_if_missing: 0 2024-09-10T23:55:03.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.paranoid_checks: 1 2024-09-10T23:55:03.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T23:55:03.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T23:55:03.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T23:55:03.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.env: 0x5580b8218720 2024-09-10T23:55:03.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T23:55:03.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.info_log: 0x5580c0aab2c0 2024-09-10T23:55:03.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T23:55:03.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.statistics: (nil) 2024-09-10T23:55:03.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.use_fsync: 0 2024-09-10T23:55:03.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.max_log_file_size: 0 2024-09-10T23:55:03.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T23:55:03.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T23:55:03.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T23:55:03.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T23:55:03.906 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.allow_fallocate: 1 2024-09-10T23:55:03.906 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T23:55:03.906 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T23:55:03.906 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.use_direct_reads: 0 2024-09-10T23:55:03.906 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T23:55:03.906 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T23:55:03.906 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.db_log_dir: 2024-09-10T23:55:03.906 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.wal_dir: 2024-09-10T23:55:03.906 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T23:55:03.906 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T23:55:03.906 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T23:55:03.906 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T23:55:03.906 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T23:55:03.907 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T23:55:03.907 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T23:55:03.907 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T23:55:03.907 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.write_buffer_manager: 0x5580bfd3a5a0 2024-09-10T23:55:03.907 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T23:55:03.907 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T23:55:03.907 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T23:55:03.907 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T23:55:03.907 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T23:55:03.907 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T23:55:03.907 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T23:55:03.907 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T23:55:03.907 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.unordered_write: 0 2024-09-10T23:55:03.908 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T23:55:03.908 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T23:55:03.908 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T23:55:03.908 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T23:55:03.908 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.row_cache: None 2024-09-10T23:55:03.908 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.wal_filter: None 2024-09-10T23:55:03.908 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T23:55:03.908 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T23:55:03.908 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.two_write_queues: 0 2024-09-10T23:55:03.908 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T23:55:03.908 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.wal_compression: 0 2024-09-10T23:55:03.908 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.atomic_flush: 0 2024-09-10T23:55:03.908 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T23:55:03.909 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T23:55:03.909 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T23:55:03.909 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.log_readahead_size: 0 2024-09-10T23:55:03.909 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T23:55:03.909 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T23:55:03.909 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T23:55:03.909 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T23:55:03.909 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T23:55:03.909 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T23:55:03.909 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T23:55:03.910 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.max_background_jobs: 2 2024-09-10T23:55:03.911 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.max_background_compactions: -1 2024-09-10T23:55:03.911 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.max_subcompactions: 1 2024-09-10T23:55:03.911 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T23:55:03.911 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T23:55:03.911 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T23:55:03.911 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T23:55:03.911 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T23:55:03.911 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T23:55:03.911 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T23:55:03.911 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T23:55:03.911 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.max_open_files: -1 2024-09-10T23:55:03.911 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T23:55:03.912 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T23:55:03.912 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T23:55:03.912 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T23:55:03.912 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.max_background_flushes: -1 2024-09-10T23:55:03.912 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Compression algorithms supported: 2024-09-10T23:55:03.912 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T23:55:03.912 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: kZSTD supported: 0 2024-09-10T23:55:03.912 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: kXpressCompression supported: 0 2024-09-10T23:55:03.912 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T23:55:03.912 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: kZlibCompression supported: 1 2024-09-10T23:55:03.912 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: kSnappyCompression supported: 1 2024-09-10T23:55:03.912 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: kLZ4Compression supported: 1 2024-09-10T23:55:03.912 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: kBZip2Compression supported: 0 2024-09-10T23:55:03.913 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T23:55:03.913 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T23:55:03.913 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi111/store.db/MANIFEST-000010 2024-09-10T23:55:03.913 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T23:55:03.913 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T23:55:03.913 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.merge_operator: 2024-09-10T23:55:03.913 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.compaction_filter: None 2024-09-10T23:55:03.913 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T23:55:03.913 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T23:55:03.913 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T23:55:03.913 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T23:55:03.913 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5580c0aab3c0) 2024-09-10T23:55:03.913 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: cache_index_and_filter_blocks: 1 2024-09-10T23:55:03.914 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T23:55:03.914 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T23:55:03.914 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: pin_top_level_index_and_filter: 1 2024-09-10T23:55:03.914 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: index_type: 0 2024-09-10T23:55:03.914 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: data_block_index_type: 0 2024-09-10T23:55:03.914 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: index_shortening: 1 2024-09-10T23:55:03.914 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T23:55:03.914 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: checksum: 4 2024-09-10T23:55:03.914 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: no_block_cache: 0 2024-09-10T23:55:03.914 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_cache: 0x5580bfdbd350 2024-09-10T23:55:03.914 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_cache_name: BinnedLRUCache 2024-09-10T23:55:03.914 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_cache_options: 2024-09-10T23:55:03.914 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: capacity : 536870912 2024-09-10T23:55:03.914 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: num_shard_bits : 4 2024-09-10T23:55:03.915 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: strict_capacity_limit : 0 2024-09-10T23:55:03.915 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: high_pri_pool_ratio: 0.000 2024-09-10T23:55:03.915 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_cache_compressed: (nil) 2024-09-10T23:55:03.915 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: persistent_cache: (nil) 2024-09-10T23:55:03.915 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_size: 4096 2024-09-10T23:55:03.915 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_size_deviation: 10 2024-09-10T23:55:03.915 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_restart_interval: 16 2024-09-10T23:55:03.915 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: index_block_restart_interval: 1 2024-09-10T23:55:03.915 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: metadata_block_size: 4096 2024-09-10T23:55:03.915 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: partition_filters: 0 2024-09-10T23:55:03.915 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: use_delta_encoding: 1 2024-09-10T23:55:03.915 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: filter_policy: bloomfilter 2024-09-10T23:55:03.915 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: whole_key_filtering: 1 2024-09-10T23:55:03.915 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: verify_compression: 0 2024-09-10T23:55:03.916 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: read_amp_bytes_per_bit: 0 2024-09-10T23:55:03.916 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: format_version: 5 2024-09-10T23:55:03.916 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: enable_index_compression: 1 2024-09-10T23:55:03.916 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_align: 0 2024-09-10T23:55:03.916 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: max_auto_readahead_size: 262144 2024-09-10T23:55:03.916 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: prepopulate_block_cache: 0 2024-09-10T23:55:03.916 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: initial_auto_readahead_size: 8192 2024-09-10T23:55:03.916 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T23:55:03.917 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T23:55:03.917 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T23:55:03.917 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.compression: NoCompression 2024-09-10T23:55:03.917 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T23:55:03.917 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T23:55:03.917 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T23:55:03.917 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.num_levels: 7 2024-09-10T23:55:03.917 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T23:55:03.917 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T23:55:03.917 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T23:55:03.917 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T23:55:03.917 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T23:55:03.917 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T23:55:03.917 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T23:55:03.918 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T23:55:03.918 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T23:55:03.918 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T23:55:03.918 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T23:55:03.918 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T23:55:03.918 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T23:55:03.918 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T23:55:03.918 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T23:55:03.918 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T23:55:03.918 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T23:55:03.918 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T23:55:03.918 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T23:55:03.918 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T23:55:03.918 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T23:55:03.919 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T23:55:03.919 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T23:55:03.919 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T23:55:03.919 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T23:55:03.919 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T23:55:03.919 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T23:55:03.919 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T23:55:03.919 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T23:55:03.919 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T23:55:03.919 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T23:55:03.919 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T23:55:03.919 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T23:55:03.919 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T23:55:03.920 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T23:55:03.920 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T23:55:03.920 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T23:55:03.920 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T23:55:03.920 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T23:55:03.920 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T23:55:03.920 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T23:55:03.920 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T23:55:03.920 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T23:55:03.920 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T23:55:03.920 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T23:55:03.920 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T23:55:03.920 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T23:55:03.921 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T23:55:03.921 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T23:55:03.921 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T23:55:03.921 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T23:55:03.921 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T23:55:03.921 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T23:55:03.921 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.table_properties_collectors: 2024-09-10T23:55:03.921 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.inplace_update_support: 0 2024-09-10T23:55:03.921 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T23:55:03.921 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T23:55:03.921 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T23:55:03.921 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T23:55:03.921 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.bloom_locality: 0 2024-09-10T23:55:03.922 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.max_successive_merges: 0 2024-09-10T23:55:03.922 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T23:55:03.922 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T23:55:03.922 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T23:55:03.922 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T23:55:03.922 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.ttl: 2592000 2024-09-10T23:55:03.922 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T23:55:03.922 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T23:55:03.922 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T23:55:03.922 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.enable_blob_files: false 2024-09-10T23:55:03.922 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.min_blob_size: 0 2024-09-10T23:55:03.922 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T23:55:03.922 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T23:55:03.922 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T23:55:03.923 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T23:55:03.923 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T23:55:03.923 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T23:55:03.923 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T23:55:03.923 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T23:55:03.923 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi111/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-10T23:55:03.923 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-10T23:55:03.923 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 0f834ef2-4257-44fa-a3e6-aac58d62ef12 2024-09-10T23:55:03.923 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726012503551231, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-10T23:55:03.923 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-10T23:55:03.923 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726012503553102, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 86915, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 282, "table_properties": {"data_size": 84996, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11738, "raw_average_key_size": 48, "raw_value_size": 78466, "raw_average_value_size": 325, "num_data_blocks": 11, "num_entries": 241, "num_filter_entries": 241, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726012503, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "0f834ef2-4257-44fa-a3e6-aac58d62ef12", "db_session_id": "6VVCXTF6KCETRBWUAK3B", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-10T23:55:03.923 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726012503553248, "job": 1, "event": "recovery_finished"} 2024-09-10T23:55:03.923 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-10T23:55:03.924 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi111/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T23:55:03.924 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5580bfe5a000 2024-09-10T23:55:03.924 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: DB pointer 0x5580bfe46000 2024-09-10T23:55:03.924 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T23:55:03.924 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T23:55:03.924 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ** DB Stats ** 2024-09-10T23:55:03.924 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T23:55:03.924 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T23:55:03.924 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T23:55:03.924 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T23:55:03.924 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T23:55:03.924 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T23:55:03.924 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T23:55:03.925 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-10T23:55:03.925 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ** Compaction Stats [default] ** 2024-09-10T23:55:03.925 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T23:55:03.925 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T23:55:03.925 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: L0 2/0 86.75 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 63.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:55:03.925 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Sum 2/0 86.75 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 63.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:55:03.925 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 63.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:55:03.925 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-10T23:55:03.925 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ** Compaction Stats [default] ** 2024-09-10T23:55:03.925 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T23:55:03.925 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T23:55:03.925 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 63.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T23:55:03.925 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-10T23:55:03.926 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T23:55:03.926 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-10T23:55:03.926 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T23:55:03.926 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T23:55:03.926 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T23:55:03.926 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T23:55:03.926 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T23:55:03.926 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T23:55:03.926 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Cumulative compaction: 0.00 GB write, 14.42 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T23:55:03.926 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Interval compaction: 0.00 GB write, 14.42 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T23:55:03.926 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T23:55:03.926 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Block cache BinnedLRUCache@0x5580bfdbd350#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-10T23:55:03.926 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-10T23:55:03.927 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-10T23:55:03.927 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T23:55:03.927 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: starting mon.smithi111 rank 0 at public addrs [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] at bind addrs [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi111 fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 2024-09-10T23:55:03.927 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: mon.smithi111@-1(???) e1 preinit fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 2024-09-10T23:55:03.927 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: mon.smithi111@-1(???).mds e1 new map 2024-09-10T23:55:03.927 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: mon.smithi111@-1(???).mds e1 print_map 2024-09-10T23:55:03.927 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: e1 2024-09-10T23:55:03.927 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T23:55:03.927 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T23:55:03.927 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: legacy client fscid: -1 2024-09-10T23:55:03.927 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-10T23:55:03.927 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: No filesystems configured 2024-09-10T23:55:03.927 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: mon.smithi111@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T23:55:03.927 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: mon.smithi111@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:55:03.928 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: mon.smithi111@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:55:03.928 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: mon.smithi111@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:55:03.928 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: mon.smithi111@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-10T23:55:03.928 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: expand_channel_meta expand map: {default=false} 2024-09-10T23:55:03.928 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: expand_channel_meta from 'false' to 'false' 2024-09-10T23:55:03.928 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: expand_channel_meta expanded map: {default=false} 2024-09-10T23:55:03.928 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: expand_channel_meta expand map: {default=info} 2024-09-10T23:55:03.928 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: expand_channel_meta from 'info' to 'info' 2024-09-10T23:55:03.928 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: expand_channel_meta expanded map: {default=info} 2024-09-10T23:55:03.928 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: expand_channel_meta expand map: {default=daemon} 2024-09-10T23:55:03.928 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: expand_channel_meta from 'daemon' to 'daemon' 2024-09-10T23:55:03.928 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: expand_channel_meta expanded map: {default=daemon} 2024-09-10T23:55:03.928 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: expand_channel_meta expand map: {default=debug} 2024-09-10T23:55:03.928 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: expand_channel_meta from 'debug' to 'debug' 2024-09-10T23:55:03.929 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: expand_channel_meta expanded map: {default=debug} 2024-09-10T23:55:03.929 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 bash[27521]: 2596322539fbebec35395882f8c23c49273317b131e36ae9e25152fddf6858a9 2024-09-10T23:55:03.929 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 systemd[1]: Started Ceph mon.smithi111 for 03107fbe-6fd0-11ef-bcea-c7b262605968. 2024-09-10T23:55:03.929 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: mon.smithi111 is new leader, mons smithi111 in quorum (ranks 0) 2024-09-10T23:55:03.929 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: monmap e1: 1 mons at {smithi111=[v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0]} removed_ranks: {} 2024-09-10T23:55:03.929 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: fsmap 2024-09-10T23:55:03.929 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T23:55:03.929 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:03 smithi111 ceph-mon[27539]: mgrmap e1: no daemons active 2024-09-10T23:55:05.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:05 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/1164997051' entity='client.admin' 2024-09-10T23:55:11.533 INFO:teuthology.orchestra.run.smithi111.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-10T23:55:11.558 INFO:teuthology.orchestra.run.smithi111.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:55:11.558 INFO:teuthology.orchestra.run.smithi111.stdout:Creating mgr... 2024-09-10T23:55:11.558 INFO:teuthology.orchestra.run.smithi111.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-10T23:55:11.559 INFO:teuthology.orchestra.run.smithi111.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-10T23:55:11.559 INFO:teuthology.orchestra.run.smithi111.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-10T23:55:11.915 INFO:teuthology.orchestra.run.smithi111.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@mgr.smithi111.ypucji 2024-09-10T23:55:11.915 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stderr Failed to reset failed state of unit ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@mgr.smithi111.ypucji.service: Unit ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@mgr.smithi111.ypucji.service not loaded. 2024-09-10T23:55:12.135 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-03107fbe-6fd0-11ef-bcea-c7b262605968.target.wants/ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@mgr.smithi111.ypucji.service → /etc/systemd/system/ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@.service. 2024-09-10T23:55:12.791 INFO:teuthology.orchestra.run.smithi111.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T23:55:12.792 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stdout disabled 2024-09-10T23:55:12.805 INFO:teuthology.orchestra.run.smithi111.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T23:55:12.805 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stdout inactive 2024-09-10T23:55:12.805 INFO:teuthology.orchestra.run.smithi111.stdout:firewalld.service is not enabled 2024-09-10T23:55:12.805 INFO:teuthology.orchestra.run.smithi111.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T23:55:12.822 INFO:teuthology.orchestra.run.smithi111.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T23:55:12.822 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stdout disabled 2024-09-10T23:55:12.836 INFO:teuthology.orchestra.run.smithi111.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T23:55:12.836 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stdout inactive 2024-09-10T23:55:12.836 INFO:teuthology.orchestra.run.smithi111.stdout:firewalld.service is not enabled 2024-09-10T23:55:12.836 INFO:teuthology.orchestra.run.smithi111.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-10T23:55:12.836 INFO:teuthology.orchestra.run.smithi111.stdout:Waiting for mgr to start... 2024-09-10T23:55:12.836 INFO:teuthology.orchestra.run.smithi111.stdout:Waiting for mgr... 2024-09-10T23:55:13.736 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:13 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/646294437' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T23:55:13.990 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 2024-09-10T23:55:13.990 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:55:13.990 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "fsid": "03107fbe-6fd0-11ef-bcea-c7b262605968", 2024-09-10T23:55:13.990 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T23:55:13.991 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T23:55:13.991 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T23:55:13.991 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T23:55:13.991 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:55:13.991 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T23:55:13.991 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T23:55:13.991 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 0 2024-09-10T23:55:13.991 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:55:13.991 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T23:55:13.992 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "smithi111" 2024-09-10T23:55:13.992 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:55:13.992 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-10T23:55:13.992 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T23:55:13.992 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:55:13.992 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-10T23:55:13.992 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T23:55:13.992 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:55:13.992 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T23:55:13.992 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:55:13.992 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T23:55:13.992 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T23:55:13.992 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T23:55:13.993 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T23:55:13.993 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T23:55:13.993 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T23:55:13.993 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:55:13.993 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T23:55:13.993 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T23:55:13.993 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T23:55:13.993 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T23:55:13.993 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T23:55:13.993 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T23:55:13.993 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T23:55:13.993 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T23:55:13.993 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T23:55:13.993 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:55:13.994 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T23:55:13.994 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:55:13.994 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T23:55:13.994 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T23:55:13.994 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:55:13.994 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T23:55:13.994 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T23:55:13.994 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T23:55:13.994 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T23:55:13.994 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T23:55:13.994 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T23:55:13.994 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T23:55:13.994 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:55:13.994 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:55:13.995 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:55:13.995 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T23:55:13.995 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:55:13.995 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T23:54:57.671146+0000", 2024-09-10T23:55:13.995 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:55:13.995 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:55:13.995 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T23:55:13.995 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:55:13.995 INFO:teuthology.orchestra.run.smithi111.stdout:mgr not available, waiting (1/15)... 2024-09-10T23:55:16.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:16 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/1425206579' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T23:55:17.202 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 2024-09-10T23:55:17.203 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:55:17.203 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "fsid": "03107fbe-6fd0-11ef-bcea-c7b262605968", 2024-09-10T23:55:17.203 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T23:55:17.203 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T23:55:17.203 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T23:55:17.203 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T23:55:17.203 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:55:17.203 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T23:55:17.203 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T23:55:17.203 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 0 2024-09-10T23:55:17.203 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:55:17.203 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T23:55:17.204 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "smithi111" 2024-09-10T23:55:17.204 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:55:17.204 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "quorum_age": 13, 2024-09-10T23:55:17.204 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T23:55:17.204 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:55:17.204 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-10T23:55:17.204 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T23:55:17.204 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:55:17.204 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T23:55:17.204 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:55:17.204 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T23:55:17.204 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T23:55:17.204 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T23:55:17.204 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T23:55:17.208 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T23:55:17.208 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T23:55:17.208 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:55:17.208 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T23:55:17.208 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T23:55:17.208 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T23:55:17.208 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T23:55:17.208 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T23:55:17.208 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T23:55:17.208 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T23:55:17.208 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T23:55:17.209 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T23:55:17.209 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:55:17.209 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T23:55:17.209 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:55:17.209 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T23:55:17.209 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T23:55:17.209 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:55:17.209 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T23:55:17.209 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T23:55:17.209 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T23:55:17.209 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T23:55:17.209 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T23:55:17.209 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T23:55:17.209 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T23:55:17.209 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:55:17.210 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:55:17.210 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:55:17.210 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T23:55:17.210 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:55:17.210 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T23:54:57.671146+0000", 2024-09-10T23:55:17.210 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:55:17.210 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:55:17.210 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T23:55:17.210 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:55:17.210 INFO:teuthology.orchestra.run.smithi111.stdout:mgr not available, waiting (2/15)... 2024-09-10T23:55:20.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:19 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/1152430907' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T23:55:20.433 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 2024-09-10T23:55:20.434 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:55:20.434 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "fsid": "03107fbe-6fd0-11ef-bcea-c7b262605968", 2024-09-10T23:55:20.434 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T23:55:20.434 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T23:55:20.434 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T23:55:20.434 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T23:55:20.434 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:55:20.434 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T23:55:20.434 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T23:55:20.434 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 0 2024-09-10T23:55:20.434 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:55:20.434 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T23:55:20.434 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "smithi111" 2024-09-10T23:55:20.435 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:55:20.435 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "quorum_age": 16, 2024-09-10T23:55:20.435 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T23:55:20.435 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:55:20.435 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-10T23:55:20.435 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T23:55:20.435 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:55:20.435 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T23:55:20.435 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:55:20.435 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T23:55:20.435 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T23:55:20.435 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T23:55:20.435 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T23:55:20.436 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T23:55:20.436 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T23:55:20.436 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:55:20.436 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T23:55:20.436 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T23:55:20.436 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T23:55:20.436 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T23:55:20.436 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T23:55:20.436 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T23:55:20.436 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T23:55:20.436 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T23:55:20.436 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T23:55:20.436 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:55:20.436 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T23:55:20.437 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:55:20.437 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T23:55:20.437 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T23:55:20.437 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:55:20.437 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T23:55:20.437 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T23:55:20.437 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T23:55:20.437 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T23:55:20.437 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T23:55:20.437 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T23:55:20.437 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T23:55:20.437 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:55:20.437 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:55:20.437 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:55:20.438 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T23:55:20.438 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:55:20.438 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T23:54:57.671146+0000", 2024-09-10T23:55:20.438 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:55:20.438 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:55:20.438 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T23:55:20.438 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:55:20.438 INFO:teuthology.orchestra.run.smithi111.stdout:mgr not available, waiting (3/15)... 2024-09-10T23:55:21.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:21 smithi111 ceph-mon[27539]: Activating manager daemon smithi111.ypucji 2024-09-10T23:55:21.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:21 smithi111 ceph-mon[27539]: mgrmap e2: smithi111.ypucji(active, starting, since 0.00406855s) 2024-09-10T23:55:21.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:21 smithi111 ceph-mon[27539]: from='mgr.14100 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T23:55:21.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:21 smithi111 ceph-mon[27539]: from='mgr.14100 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T23:55:21.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:21 smithi111 ceph-mon[27539]: from='mgr.14100 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T23:55:21.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:21 smithi111 ceph-mon[27539]: from='mgr.14100 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-10T23:55:21.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:21 smithi111 ceph-mon[27539]: from='mgr.14100 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mgr metadata", "who": "smithi111.ypucji", "id": "smithi111.ypucji"}]: dispatch 2024-09-10T23:55:21.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:21 smithi111 ceph-mon[27539]: Manager daemon smithi111.ypucji is now available 2024-09-10T23:55:21.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:21 smithi111 ceph-mon[27539]: from='mgr.14100 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.ypucji/mirror_snapshot_schedule"}]: dispatch 2024-09-10T23:55:21.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:21 smithi111 ceph-mon[27539]: from='mgr.14100 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.ypucji/trash_purge_schedule"}]: dispatch 2024-09-10T23:55:21.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:21 smithi111 ceph-mon[27539]: from='mgr.14100 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:55:21.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:21 smithi111 ceph-mon[27539]: from='mgr.14100 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:55:21.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:21 smithi111 ceph-mon[27539]: from='mgr.14100 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:55:23.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:23 smithi111 ceph-mon[27539]: mgrmap e3: smithi111.ypucji(active, since 1.00998s) 2024-09-10T23:55:23.929 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 2024-09-10T23:55:23.929 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:55:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "fsid": "03107fbe-6fd0-11ef-bcea-c7b262605968", 2024-09-10T23:55:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T23:55:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T23:55:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T23:55:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T23:55:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:55:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T23:55:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T23:55:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 0 2024-09-10T23:55:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:55:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T23:55:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "smithi111" 2024-09-10T23:55:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:55:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "quorum_age": 19, 2024-09-10T23:55:23.930 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T23:55:23.931 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:55:23.931 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-10T23:55:23.931 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T23:55:23.931 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:55:23.931 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T23:55:23.931 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:55:23.931 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T23:55:23.931 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T23:55:23.931 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T23:55:23.931 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T23:55:23.935 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T23:55:23.935 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T23:55:23.935 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:55:23.935 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T23:55:23.935 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T23:55:23.935 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T23:55:23.935 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T23:55:23.935 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T23:55:23.935 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T23:55:23.935 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T23:55:23.935 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T23:55:23.935 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T23:55:23.936 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:55:23.936 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T23:55:23.936 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:55:23.936 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T23:55:23.936 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T23:55:23.936 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:55:23.936 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T23:55:23.936 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T23:55:23.936 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T23:55:23.936 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T23:55:23.936 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T23:55:23.936 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T23:55:23.936 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T23:55:23.936 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout ], 2024-09-10T23:55:23.937 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:55:23.937 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:55:23.937 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T23:55:23.937 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T23:55:23.937 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T23:54:57.671146+0000", 2024-09-10T23:55:23.937 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T23:55:23.937 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-10T23:55:23.937 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T23:55:23.937 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:55:23.937 INFO:teuthology.orchestra.run.smithi111.stdout:mgr is available 2024-09-10T23:55:24.648 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:24 smithi111 ceph-mon[27539]: mgrmap e4: smithi111.ypucji(active, since 2s) 2024-09-10T23:55:24.648 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:24 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/2740311433' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T23:55:25.227 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:25 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/3975230214' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-10T23:55:25.233 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 2024-09-10T23:55:25.234 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T23:55:25.234 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout fsid = 03107fbe-6fd0-11ef-bcea-c7b262605968 2024-09-10T23:55:25.234 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T23:55:25.234 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T23:55:25.234 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T23:55:25.234 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T23:55:25.234 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 2024-09-10T23:55:25.234 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T23:55:25.234 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T23:55:25.234 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 2024-09-10T23:55:25.234 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T23:55:25.234 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T23:55:25.234 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T23:55:25.234 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T23:55:25.235 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T23:55:25.235 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T23:55:25.235 INFO:teuthology.orchestra.run.smithi111.stdout:Enabling cephadm module... 2024-09-10T23:55:26.447 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:26 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/909127982' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-10T23:55:27.286 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:27 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/909127982' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-10T23:55:27.287 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:27 smithi111 ceph-mon[27539]: mgrmap e5: smithi111.ypucji(active, since 5s) 2024-09-10T23:55:28.384 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:28 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/1416612941' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-10T23:55:28.390 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:55:28.390 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-10T23:55:28.390 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T23:55:28.390 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "active_name": "smithi111.ypucji", 2024-09-10T23:55:28.390 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T23:55:28.390 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:55:28.390 INFO:teuthology.orchestra.run.smithi111.stdout:Waiting for the mgr to restart... 2024-09-10T23:55:28.390 INFO:teuthology.orchestra.run.smithi111.stdout:Waiting for mgr epoch 5... 2024-09-10T23:55:34.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:34 smithi111 ceph-mon[27539]: Active manager daemon smithi111.ypucji restarted 2024-09-10T23:55:34.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:34 smithi111 ceph-mon[27539]: Activating manager daemon smithi111.ypucji 2024-09-10T23:55:34.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:34 smithi111 ceph-mon[27539]: osdmap e2: 0 total, 0 up, 0 in 2024-09-10T23:55:34.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:34 smithi111 ceph-mon[27539]: mgrmap e6: smithi111.ypucji(active, starting, since 0.00396914s) 2024-09-10T23:55:34.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:34 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-10T23:55:34.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:34 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mgr metadata", "who": "smithi111.ypucji", "id": "smithi111.ypucji"}]: dispatch 2024-09-10T23:55:34.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:34 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T23:55:34.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:34 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T23:55:34.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:34 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T23:55:34.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:34 smithi111 ceph-mon[27539]: Manager daemon smithi111.ypucji is now available 2024-09-10T23:55:34.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:34 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:55:34.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:34 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:55:34.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:34 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T23:55:34.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:34 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T23:55:34.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:34 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T23:55:35.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:35 smithi111 ceph-mon[27539]: Found migration_current of "None". Setting to last migration. 2024-09-10T23:55:35.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:35 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.ypucji/mirror_snapshot_schedule"}]: dispatch 2024-09-10T23:55:35.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:35 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.ypucji/trash_purge_schedule"}]: dispatch 2024-09-10T23:55:35.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:35 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:55:35.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:35 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:55:35.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:35 smithi111 ceph-mon[27539]: mgrmap e7: smithi111.ypucji(active, since 1.0072s) 2024-09-10T23:55:36.185 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:55:36.186 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-10T23:55:36.186 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T23:55:36.186 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:55:36.186 INFO:teuthology.orchestra.run.smithi111.stdout:mgr epoch 5 is available 2024-09-10T23:55:36.186 INFO:teuthology.orchestra.run.smithi111.stdout:Setting orchestrator backend to cephadm... 2024-09-10T23:55:36.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:36 smithi111 ceph-mon[27539]: [10/Sep/2024:23:55:35] ENGINE Bus STARTING 2024-09-10T23:55:36.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:36 smithi111 ceph-mon[27539]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-10T23:55:36.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:36 smithi111 ceph-mon[27539]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-10T23:55:36.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:36 smithi111 ceph-mon[27539]: [10/Sep/2024:23:55:35] ENGINE Serving on http://172.21.15.111:8765 2024-09-10T23:55:36.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:36 smithi111 ceph-mon[27539]: [10/Sep/2024:23:55:35] ENGINE Serving on https://172.21.15.111:7150 2024-09-10T23:55:36.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:36 smithi111 ceph-mon[27539]: [10/Sep/2024:23:55:35] ENGINE Bus STARTED 2024-09-10T23:55:36.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:36 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T23:55:37.821 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:37 smithi111 ceph-mon[27539]: mgrmap e8: smithi111.ypucji(active, since 2s) 2024-09-10T23:55:37.821 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:37 smithi111 ceph-mon[27539]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:55:37.821 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:37 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:55:37.821 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:37 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T23:55:38.937 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-10T23:55:38.937 INFO:teuthology.orchestra.run.smithi111.stdout:Generating ssh key... 2024-09-10T23:55:39.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:39 smithi111 ceph-mon[27539]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:55:41.388 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:41 smithi111 ceph-mon[27539]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:55:41.388 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:41 smithi111 ceph-mon[27539]: Generating ssh key... 2024-09-10T23:55:41.388 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:41 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:55:41.389 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:41 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:55:42.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:42 smithi111 ceph-mon[27539]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:55:45.389 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3rM/ZBODmm503/gXlZWHmGPhE9x2p3cPH+iCnNNS8uSN52cXZsEDALtgGFGRQsQddbFmj2cquLLN6kC+eL4cn94437IyK4pa58/l3WRyJeGxs4bptWk9z4zaQJ4CfeSYLNysZ17sFM14mkK673gc3fH6eVLMM1hnO6L50JfWYlTgA0wMXZjPmp1RzhzDRJrXOmqR1V5ALcfQNkyVofjm1E3OAvp6rm/YhuTczyTQUihXWgaa5HmWEUTt/QxfKQALPLrmpIML92JtSYHPZqcibCYK7xzM+PFuRTUHLioYcPRH1ZYl3NxG/HZqOhn9AHdvcxjMzq4JFQo9vVnqcD1zeDYCOaTCLmK0gc9fUzV1bbTCmtRb3h3v2rrlmJF89MR4edoJfOMltgkvFBhPOT2Q1wf8n3WlG+KoUlZtLRHQlRpxzIpyD8t4dUWLl01cEJj66nUqpV2KAR3irhX9ByyxaOQ9nkcRDBhC/v6jIPE8Jj6fTffP+fshAe70+3AmGw+0= ceph-03107fbe-6fd0-11ef-bcea-c7b262605968 2024-09-10T23:55:45.390 INFO:teuthology.orchestra.run.smithi111.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-10T23:55:45.390 INFO:teuthology.orchestra.run.smithi111.stdout:Adding key to root@localhost authorized_keys... 2024-09-10T23:55:45.399 INFO:teuthology.orchestra.run.smithi111.stdout:Adding host smithi111... 2024-09-10T23:55:46.389 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:46 smithi111 ceph-mon[27539]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi111", "addr": "172.21.15.111", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:55:47.602 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:47 smithi111 ceph-mon[27539]: Deploying cephadm binary to smithi111 2024-09-10T23:55:49.737 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout Added host 'smithi111' with addr '172.21.15.111' 2024-09-10T23:55:49.737 INFO:teuthology.orchestra.run.smithi111.stdout:Deploying mon service with default placement... 2024-09-10T23:55:50.266 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:50 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:55:50.266 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:50 smithi111 ceph-mon[27539]: Added host smithi111 2024-09-10T23:55:50.266 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:50 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T23:55:51.523 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-10T23:55:51.523 INFO:teuthology.orchestra.run.smithi111.stdout:Deploying mgr service with default placement... 2024-09-10T23:55:51.660 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:51 smithi111 ceph-mon[27539]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:55:51.660 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:51 smithi111 ceph-mon[27539]: Saving service mon spec with placement count:5 2024-09-10T23:55:51.660 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:51 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:55:53.062 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-10T23:55:53.062 INFO:teuthology.orchestra.run.smithi111.stdout:Deploying crash service with default placement... 2024-09-10T23:55:53.522 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:53 smithi111 ceph-mon[27539]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:55:53.522 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:53 smithi111 ceph-mon[27539]: Saving service mgr spec with placement count:2 2024-09-10T23:55:53.522 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:53 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:55:53.522 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:53 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:55:53.522 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:53 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:55:55.145 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:54 smithi111 ceph-mon[27539]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:55:55.145 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:54 smithi111 ceph-mon[27539]: Saving service crash spec with placement * 2024-09-10T23:55:55.145 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:54 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:55:55.145 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:54 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:55:55.150 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-10T23:55:55.150 INFO:teuthology.orchestra.run.smithi111.stdout:Deploying ceph-exporter service with default placement... 2024-09-10T23:55:56.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:55 smithi111 ceph-mon[27539]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:55:56.599 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-09-10T23:55:56.599 INFO:teuthology.orchestra.run.smithi111.stdout:Deploying prometheus service with default placement... 2024-09-10T23:55:57.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:56 smithi111 ceph-mon[27539]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:55:57.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:56 smithi111 ceph-mon[27539]: Saving service ceph-exporter spec with placement * 2024-09-10T23:55:57.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:56 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:55:57.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:56 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:55:58.360 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:58 smithi111 ceph-mon[27539]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:55:58.360 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:58 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:55:58.804 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-10T23:55:58.805 INFO:teuthology.orchestra.run.smithi111.stdout:Deploying grafana service with default placement... 2024-09-10T23:55:59.566 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:59 smithi111 ceph-mon[27539]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:55:59.567 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:55:59 smithi111 ceph-mon[27539]: Saving service prometheus spec with placement count:1 2024-09-10T23:56:00.210 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-10T23:56:00.211 INFO:teuthology.orchestra.run.smithi111.stdout:Deploying node-exporter service with default placement... 2024-09-10T23:56:00.473 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:00 smithi111 ceph-mon[27539]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:56:00.473 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:00 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:01.519 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:01 smithi111 ceph-mon[27539]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:01.520 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:01 smithi111 ceph-mon[27539]: Saving service grafana spec with placement count:1 2024-09-10T23:56:01.520 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:01 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:01.526 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-10T23:56:01.526 INFO:teuthology.orchestra.run.smithi111.stdout:Deploying alertmanager service with default placement... 2024-09-10T23:56:02.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:02 smithi111 ceph-mon[27539]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:56:02.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:02 smithi111 ceph-mon[27539]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:02.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:02 smithi111 ceph-mon[27539]: Saving service node-exporter spec with placement * 2024-09-10T23:56:02.913 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-10T23:56:03.614 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:03 smithi111 ceph-mon[27539]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:03.614 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:03 smithi111 ceph-mon[27539]: Saving service alertmanager spec with placement count:1 2024-09-10T23:56:03.614 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:03 smithi111 ceph-mon[27539]: from='mgr.14120 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:04.444 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:04 smithi111 ceph-mon[27539]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:56:04.445 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:04 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/4279037693' entity='client.admin' 2024-09-10T23:56:05.445 INFO:teuthology.orchestra.run.smithi111.stdout:Enabling the dashboard module... 2024-09-10T23:56:06.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:05 smithi111 ceph-mon[27539]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:56:06.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:05 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/3029306061' entity='client.admin' 2024-09-10T23:56:07.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:06 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/2604419594' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-10T23:56:08.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:07 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/2604419594' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-10T23:56:08.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:07 smithi111 ceph-mon[27539]: mgrmap e9: smithi111.ypucji(active, since 32s) 2024-09-10T23:56:08.997 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:08 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/3579110191' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-10T23:56:09.077 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:56:09.077 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-10T23:56:09.078 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T23:56:09.078 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "active_name": "smithi111.ypucji", 2024-09-10T23:56:09.078 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T23:56:09.078 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:56:09.078 INFO:teuthology.orchestra.run.smithi111.stdout:Waiting for the mgr to restart... 2024-09-10T23:56:09.078 INFO:teuthology.orchestra.run.smithi111.stdout:Waiting for mgr epoch 9... 2024-09-10T23:56:15.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:15 smithi111 ceph-mon[27539]: Active manager daemon smithi111.ypucji restarted 2024-09-10T23:56:15.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:15 smithi111 ceph-mon[27539]: Activating manager daemon smithi111.ypucji 2024-09-10T23:56:15.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:15 smithi111 ceph-mon[27539]: osdmap e3: 0 total, 0 up, 0 in 2024-09-10T23:56:15.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:15 smithi111 ceph-mon[27539]: mgrmap e10: smithi111.ypucji(active, starting, since 0.0037155s) 2024-09-10T23:56:15.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:15 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-10T23:56:15.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:15 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mgr metadata", "who": "smithi111.ypucji", "id": "smithi111.ypucji"}]: dispatch 2024-09-10T23:56:15.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:15 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T23:56:15.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:15 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T23:56:15.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:15 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T23:56:15.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:15 smithi111 ceph-mon[27539]: Manager daemon smithi111.ypucji is now available 2024-09-10T23:56:15.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:15 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T23:56:15.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:15 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T23:56:16.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:16 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.ypucji/mirror_snapshot_schedule"}]: dispatch 2024-09-10T23:56:16.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:16 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.ypucji/trash_purge_schedule"}]: dispatch 2024-09-10T23:56:16.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:16 smithi111 ceph-mon[27539]: mgrmap e11: smithi111.ypucji(active, since 1.00687s) 2024-09-10T23:56:17.652 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout { 2024-09-10T23:56:17.653 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-10T23:56:17.653 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T23:56:17.653 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout } 2024-09-10T23:56:17.653 INFO:teuthology.orchestra.run.smithi111.stdout:mgr epoch 9 is available 2024-09-10T23:56:17.653 INFO:teuthology.orchestra.run.smithi111.stdout:Generating a dashboard self-signed certificate... 2024-09-10T23:56:17.865 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:17 smithi111 ceph-mon[27539]: [10/Sep/2024:23:56:16] ENGINE Bus STARTING 2024-09-10T23:56:17.865 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:17 smithi111 ceph-mon[27539]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-10T23:56:17.865 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:17 smithi111 ceph-mon[27539]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-10T23:56:17.865 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:17 smithi111 ceph-mon[27539]: [10/Sep/2024:23:56:16] ENGINE Serving on https://172.21.15.111:7150 2024-09-10T23:56:17.865 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:17 smithi111 ceph-mon[27539]: [10/Sep/2024:23:56:16] ENGINE Serving on http://172.21.15.111:8765 2024-09-10T23:56:17.865 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:17 smithi111 ceph-mon[27539]: [10/Sep/2024:23:56:16] ENGINE Bus STARTED 2024-09-10T23:56:17.865 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:17 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:19.117 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-10T23:56:19.117 INFO:teuthology.orchestra.run.smithi111.stdout:Creating initial admin user... 2024-09-10T23:56:19.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:19 smithi111 ceph-mon[27539]: mgrmap e12: smithi111.ypucji(active, since 2s) 2024-09-10T23:56:19.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:19 smithi111 ceph-mon[27539]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:19.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:19 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:19.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:19 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:19.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:19 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:20.648 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:20 smithi111 ceph-mon[27539]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:20.649 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:20 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:21.452 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$0BcMwoxEEUeisIQC6twpu.FIn7KCAqSVxSRYHkgm1Q3iTxWe.S40G", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726012580, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-10T23:56:21.452 INFO:teuthology.orchestra.run.smithi111.stdout:Fetching dashboard port number... 2024-09-10T23:56:22.878 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:22 smithi111 ceph-mon[27539]: mgrmap e13: smithi111.ypucji(active, since 6s) 2024-09-10T23:56:22.878 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:22 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/2681539373' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-10T23:56:22.885 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 8443 2024-09-10T23:56:22.905 INFO:teuthology.orchestra.run.smithi111.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T23:56:22.906 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stdout disabled 2024-09-10T23:56:22.920 INFO:teuthology.orchestra.run.smithi111.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T23:56:22.920 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stdout inactive 2024-09-10T23:56:22.920 INFO:teuthology.orchestra.run.smithi111.stdout:firewalld.service is not enabled 2024-09-10T23:56:22.920 INFO:teuthology.orchestra.run.smithi111.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-10T23:56:22.923 INFO:teuthology.orchestra.run.smithi111.stdout:Ceph Dashboard is now available at: 2024-09-10T23:56:22.923 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:56:22.923 INFO:teuthology.orchestra.run.smithi111.stdout: URL: https://smithi111.front.sepia.ceph.com:8443/ 2024-09-10T23:56:22.923 INFO:teuthology.orchestra.run.smithi111.stdout: User: admin 2024-09-10T23:56:22.923 INFO:teuthology.orchestra.run.smithi111.stdout: Password: ece5h3s8e3 2024-09-10T23:56:22.923 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:56:22.923 INFO:teuthology.orchestra.run.smithi111.stdout:Saving cluster configuration to /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config directory 2024-09-10T23:56:22.924 INFO:teuthology.orchestra.run.smithi111.stdout:Enabling autotune for osd_memory_target 2024-09-10T23:56:25.797 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-10T23:56:25.798 INFO:teuthology.orchestra.run.smithi111.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-10T23:56:25.798 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:56:25.798 INFO:teuthology.orchestra.run.smithi111.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-10T23:56:25.798 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:56:25.798 INFO:teuthology.orchestra.run.smithi111.stdout:Or, if you are only running a single cluster on this host: 2024-09-10T23:56:25.798 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:56:25.798 INFO:teuthology.orchestra.run.smithi111.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-10T23:56:25.798 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:56:25.798 INFO:teuthology.orchestra.run.smithi111.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-10T23:56:25.798 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:56:25.798 INFO:teuthology.orchestra.run.smithi111.stdout: ceph telemetry on 2024-09-10T23:56:25.799 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:56:25.799 INFO:teuthology.orchestra.run.smithi111.stdout:For more information see: 2024-09-10T23:56:25.799 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:56:25.799 INFO:teuthology.orchestra.run.smithi111.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-10T23:56:25.799 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:56:25.799 INFO:teuthology.orchestra.run.smithi111.stdout:Bootstrap complete. 2024-09-10T23:56:25.848 INFO:tasks.cephadm:Fetching config... 2024-09-10T23:56:25.858 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-10T23:56:25.858 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-10T23:56:25.894 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-10T23:56:25.895 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-10T23:56:25.895 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-10T23:56:25.970 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-10T23:56:25.970 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-10T23:56:25.970 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/keyring of=/dev/stdout 2024-09-10T23:56:26.067 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-10T23:56:26.067 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-10T23:56:26.067 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-10T23:56:26.143 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-10T23:56:26.143 DEBUG:teuthology.orchestra.run.smithi111:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3rM/ZBODmm503/gXlZWHmGPhE9x2p3cPH+iCnNNS8uSN52cXZsEDALtgGFGRQsQddbFmj2cquLLN6kC+eL4cn94437IyK4pa58/l3WRyJeGxs4bptWk9z4zaQJ4CfeSYLNysZ17sFM14mkK673gc3fH6eVLMM1hnO6L50JfWYlTgA0wMXZjPmp1RzhzDRJrXOmqR1V5ALcfQNkyVofjm1E3OAvp6rm/YhuTczyTQUihXWgaa5HmWEUTt/QxfKQALPLrmpIML92JtSYHPZqcibCYK7xzM+PFuRTUHLioYcPRH1ZYl3NxG/HZqOhn9AHdvcxjMzq4JFQo9vVnqcD1zeDYCOaTCLmK0gc9fUzV1bbTCmtRb3h3v2rrlmJF89MR4edoJfOMltgkvFBhPOT2Q1wf8n3WlG+KoUlZtLRHQlRpxzIpyD8t4dUWLl01cEJj66nUqpV2KAR3irhX9ByyxaOQ9nkcRDBhC/v6jIPE8Jj6fTffP+fshAe70+3AmGw+0= ceph-03107fbe-6fd0-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T23:56:26.267 INFO:teuthology.orchestra.run.smithi111.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3rM/ZBODmm503/gXlZWHmGPhE9x2p3cPH+iCnNNS8uSN52cXZsEDALtgGFGRQsQddbFmj2cquLLN6kC+eL4cn94437IyK4pa58/l3WRyJeGxs4bptWk9z4zaQJ4CfeSYLNysZ17sFM14mkK673gc3fH6eVLMM1hnO6L50JfWYlTgA0wMXZjPmp1RzhzDRJrXOmqR1V5ALcfQNkyVofjm1E3OAvp6rm/YhuTczyTQUihXWgaa5HmWEUTt/QxfKQALPLrmpIML92JtSYHPZqcibCYK7xzM+PFuRTUHLioYcPRH1ZYl3NxG/HZqOhn9AHdvcxjMzq4JFQo9vVnqcD1zeDYCOaTCLmK0gc9fUzV1bbTCmtRb3h3v2rrlmJF89MR4edoJfOMltgkvFBhPOT2Q1wf8n3WlG+KoUlZtLRHQlRpxzIpyD8t4dUWLl01cEJj66nUqpV2KAR3irhX9ByyxaOQ9nkcRDBhC/v6jIPE8Jj6fTffP+fshAe70+3AmGw+0= ceph-03107fbe-6fd0-11ef-bcea-c7b262605968 2024-09-10T23:56:26.293 DEBUG:teuthology.orchestra.run.smithi203:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3rM/ZBODmm503/gXlZWHmGPhE9x2p3cPH+iCnNNS8uSN52cXZsEDALtgGFGRQsQddbFmj2cquLLN6kC+eL4cn94437IyK4pa58/l3WRyJeGxs4bptWk9z4zaQJ4CfeSYLNysZ17sFM14mkK673gc3fH6eVLMM1hnO6L50JfWYlTgA0wMXZjPmp1RzhzDRJrXOmqR1V5ALcfQNkyVofjm1E3OAvp6rm/YhuTczyTQUihXWgaa5HmWEUTt/QxfKQALPLrmpIML92JtSYHPZqcibCYK7xzM+PFuRTUHLioYcPRH1ZYl3NxG/HZqOhn9AHdvcxjMzq4JFQo9vVnqcD1zeDYCOaTCLmK0gc9fUzV1bbTCmtRb3h3v2rrlmJF89MR4edoJfOMltgkvFBhPOT2Q1wf8n3WlG+KoUlZtLRHQlRpxzIpyD8t4dUWLl01cEJj66nUqpV2KAR3irhX9ByyxaOQ9nkcRDBhC/v6jIPE8Jj6fTffP+fshAe70+3AmGw+0= ceph-03107fbe-6fd0-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T23:56:26.361 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:26 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/560878728' entity='client.admin' 2024-09-10T23:56:26.381 INFO:teuthology.orchestra.run.smithi203.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3rM/ZBODmm503/gXlZWHmGPhE9x2p3cPH+iCnNNS8uSN52cXZsEDALtgGFGRQsQddbFmj2cquLLN6kC+eL4cn94437IyK4pa58/l3WRyJeGxs4bptWk9z4zaQJ4CfeSYLNysZ17sFM14mkK673gc3fH6eVLMM1hnO6L50JfWYlTgA0wMXZjPmp1RzhzDRJrXOmqR1V5ALcfQNkyVofjm1E3OAvp6rm/YhuTczyTQUihXWgaa5HmWEUTt/QxfKQALPLrmpIML92JtSYHPZqcibCYK7xzM+PFuRTUHLioYcPRH1ZYl3NxG/HZqOhn9AHdvcxjMzq4JFQo9vVnqcD1zeDYCOaTCLmK0gc9fUzV1bbTCmtRb3h3v2rrlmJF89MR4edoJfOMltgkvFBhPOT2Q1wf8n3WlG+KoUlZtLRHQlRpxzIpyD8t4dUWLl01cEJj66nUqpV2KAR3irhX9ByyxaOQ9nkcRDBhC/v6jIPE8Jj6fTffP+fshAe70+3AmGw+0= ceph-03107fbe-6fd0-11ef-bcea-c7b262605968 2024-09-10T23:56:26.407 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-10T23:56:26.712 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-10T23:56:29.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:29 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:29.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:29 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:29.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:29 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "who": "osd/host:smithi111", "name": "osd_memory_target"}]: dispatch 2024-09-10T23:56:29.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:29 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:29.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:29 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi111", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-10T23:56:29.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:29 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi111", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-10T23:56:29.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:29 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:56:29.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:29 smithi111 ceph-mon[27539]: Deploying daemon ceph-exporter.smithi111 on smithi111 2024-09-10T23:56:29.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:29 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/2140810748' entity='client.admin' 2024-09-10T23:56:30.286 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-10T23:56:30.287 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-10T23:56:30.993 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-10T23:56:34.238 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi203 2024-09-10T23:56:34.238 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-10T23:56:34.238 DEBUG:teuthology.orchestra.run.smithi203:> dd of=/etc/ceph/ceph.conf 2024-09-10T23:56:34.271 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:34 smithi111 ceph-mon[27539]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:34.271 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:34 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:34.278 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-10T23:56:34.278 DEBUG:teuthology.orchestra.run.smithi203:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:56:34.356 INFO:tasks.cephadm:Adding host smithi203 to orchestrator... 2024-09-10T23:56:34.356 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph orch host add smithi203 2024-09-10T23:56:35.081 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-10T23:56:36.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:36 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:36.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:36 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:36.220 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:36 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:36.220 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:36 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:36.220 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:36 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi111", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T23:56:36.220 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:36 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi111", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-10T23:56:36.220 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:36 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:56:36.220 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:36 smithi111 ceph-mon[27539]: Deploying daemon crash.smithi111 on smithi111 2024-09-10T23:56:36.220 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:36 smithi111 ceph-mon[27539]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:56:36.220 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:36 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:38.636 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:38 smithi111 ceph-mon[27539]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:56:40.027 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:39 smithi111 ceph-mon[27539]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi203", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:40.027 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:39 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:40.027 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:39 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:40.027 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:39 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:40.027 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:39 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:40.027 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:39 smithi111 ceph-mon[27539]: Deploying daemon node-exporter.smithi111 on smithi111 2024-09-10T23:56:41.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:40 smithi111 ceph-mon[27539]: Deploying cephadm binary to smithi203 2024-09-10T23:56:41.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:40 smithi111 ceph-mon[27539]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:56:41.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:40 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:41.500 INFO:teuthology.orchestra.run.smithi111.stdout:Added host 'smithi203' with addr '172.21.15.203' 2024-09-10T23:56:42.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:42 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:42.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:42 smithi111 ceph-mon[27539]: Added host smithi203 2024-09-10T23:56:42.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:42 smithi111 ceph-mon[27539]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:56:43.105 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T23:56:43.556 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-10T23:56:44.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:44 smithi111 ceph-mon[27539]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:56:44.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:44 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:44.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:44 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:44.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:44 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:44.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:44 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:44.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:44 smithi111 ceph-mon[27539]: Deploying daemon alertmanager.smithi111 on smithi111 2024-09-10T23:56:45.537 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:56:45.537 INFO:teuthology.orchestra.run.smithi111.stdout:[{"addr": "172.21.15.111", "hostname": "smithi111", "labels": [], "status": ""}, {"addr": "172.21.15.203", "hostname": "smithi203", "labels": [], "status": ""}] 2024-09-10T23:56:46.829 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:46 smithi111 ceph-mon[27539]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:56:46.830 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:46 smithi111 ceph-mon[27539]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T23:56:46.830 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:46 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:46.861 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-10T23:56:46.861 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-10T23:56:47.201 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-10T23:56:48.766 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:48 smithi111 ceph-mon[27539]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:56:50.901 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:50 smithi111 ceph-mon[27539]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:56:52.595 INFO:teuthology.orchestra.run.smithi111.stderr:adjusted tunables profile to default 2024-09-10T23:56:52.714 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:52 smithi111 ceph-mon[27539]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:56:52.714 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:52 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/841461382' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-10T23:56:53.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:53 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/841461382' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T23:56:53.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:53 smithi111 ceph-mon[27539]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T23:56:54.227 INFO:tasks.cephadm:Adding mon.smithi111 on smithi111 2024-09-10T23:56:54.228 INFO:tasks.cephadm:Adding mon.smithi203 on smithi203 2024-09-10T23:56:54.228 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph orch apply mon '2;smithi111:172.21.15.111=smithi111;smithi203:172.21.15.203=smithi203' 2024-09-10T23:56:54.540 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:56:54.637 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:56:54.809 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:54 smithi111 ceph-mon[27539]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:56:56.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:56 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:56.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:56 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:56.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:56 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:56.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:56 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:56.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:56 smithi111 ceph-mon[27539]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-10T23:56:56.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:56 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:56.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:56 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:56.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:56 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-10T23:56:56.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:56 smithi111 ceph-mon[27539]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-10T23:56:56.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:56 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:56.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:56 smithi111 ceph-mon[27539]: Deploying daemon grafana.smithi111 on smithi111 2024-09-10T23:56:56.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:56 smithi111 ceph-mon[27539]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:56:56.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:56 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:56.734 INFO:teuthology.orchestra.run.smithi203.stdout:Scheduled mon update... 2024-09-10T23:56:57.670 DEBUG:teuthology.orchestra.run.smithi203:mon.smithi203> sudo journalctl -f -n 0 -u ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@mon.smithi203.service 2024-09-10T23:56:57.674 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T23:56:57.674 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:56:58.035 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:56:58.142 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:56:58.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:57 smithi111 ceph-mon[27539]: from='client.14197 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi111:172.21.15.111=smithi111;smithi203:172.21.15.203=smithi203", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:56:58.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:57 smithi111 ceph-mon[27539]: Saving service mon spec with placement smithi111:172.21.15.111=smithi111;smithi203:172.21.15.203=smithi203;count:2 2024-09-10T23:56:58.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:57 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:56:59.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:56:58 smithi111 ceph-mon[27539]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:57:00.235 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:57:00.235 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"03107fbe-6fd0-11ef-bcea-c7b262605968","modified":"2024-09-10T23:54:53.955794Z","created":"2024-09-10T23:54:53.955794Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T23:57:00.237 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-09-10T23:57:01.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:00 smithi111 ceph-mon[27539]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:57:01.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:00 smithi111 ceph-mon[27539]: from='client.? 172.21.15.203:0/909148607' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T23:57:01.798 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T23:57:01.798 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:57:02.110 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:57:02.197 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:57:03.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:02 smithi111 ceph-mon[27539]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:57:04.105 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:57:04.106 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"03107fbe-6fd0-11ef-bcea-c7b262605968","modified":"2024-09-10T23:54:53.955794Z","created":"2024-09-10T23:54:53.955794Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T23:57:04.108 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-09-10T23:57:05.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:04 smithi111 ceph-mon[27539]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:57:05.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:04 smithi111 ceph-mon[27539]: from='client.? 172.21.15.203:0/3326696811' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T23:57:05.771 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T23:57:05.771 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:57:06.067 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:57:06.154 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:57:07.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:06 smithi111 ceph-mon[27539]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:57:08.250 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:57:08.250 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"03107fbe-6fd0-11ef-bcea-c7b262605968","modified":"2024-09-10T23:54:53.955794Z","created":"2024-09-10T23:54:53.955794Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T23:57:08.252 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-09-10T23:57:09.020 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:08 smithi111 ceph-mon[27539]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:57:09.020 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:08 smithi111 ceph-mon[27539]: from='client.? 172.21.15.203:0/514863365' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T23:57:09.905 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T23:57:09.906 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:57:10.217 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:57:10.311 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:57:11.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:10 smithi111 ceph-mon[27539]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:57:11.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:10 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:11.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:10 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:11.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:10 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:11.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:10 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:11.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:10 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:11.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:10 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:11.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:10 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:12.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:11 smithi111 ceph-mon[27539]: Deploying daemon prometheus.smithi111 on smithi111 2024-09-10T23:57:12.229 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:57:12.229 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"03107fbe-6fd0-11ef-bcea-c7b262605968","modified":"2024-09-10T23:54:53.955794Z","created":"2024-09-10T23:54:53.955794Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T23:57:12.232 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-09-10T23:57:13.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:12 smithi111 ceph-mon[27539]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:57:13.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:12 smithi111 ceph-mon[27539]: from='client.? 172.21.15.203:0/648031607' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T23:57:13.873 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T23:57:13.874 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:57:14.179 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:57:14.264 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:57:15.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:14 smithi111 ceph-mon[27539]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:57:16.294 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:57:16.294 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"03107fbe-6fd0-11ef-bcea-c7b262605968","modified":"2024-09-10T23:54:53.955794Z","created":"2024-09-10T23:54:53.955794Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T23:57:16.297 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-09-10T23:57:17.075 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:16 smithi111 ceph-mon[27539]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:57:17.075 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:16 smithi111 ceph-mon[27539]: from='client.? 172.21.15.203:0/554023992' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T23:57:17.972 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T23:57:17.973 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:57:18.276 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:57:18.361 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:57:19.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:18 smithi111 ceph-mon[27539]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:57:20.397 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:57:20.397 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"03107fbe-6fd0-11ef-bcea-c7b262605968","modified":"2024-09-10T23:54:53.955794Z","created":"2024-09-10T23:54:53.955794Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T23:57:20.400 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-09-10T23:57:20.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:20 smithi111 ceph-mon[27539]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:57:20.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:20 smithi111 ceph-mon[27539]: from='client.? 172.21.15.203:0/76360260' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T23:57:22.068 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T23:57:22.069 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:57:22.367 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:22 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:22.367 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:22 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:22.367 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:22 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:22.367 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:22 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-10T23:57:22.367 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:22 smithi111 ceph-mon[27539]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:57:22.385 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:57:22.472 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:57:23.322 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:23 smithi111 ceph-mon[27539]: from='mgr.14164 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-10T23:57:23.322 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:23 smithi111 ceph-mon[27539]: mgrmap e14: smithi111.ypucji(active, since 66s) 2024-09-10T23:57:24.425 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:57:24.425 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"03107fbe-6fd0-11ef-bcea-c7b262605968","modified":"2024-09-10T23:54:53.955794Z","created":"2024-09-10T23:54:53.955794Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T23:57:24.427 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-09-10T23:57:24.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:24 smithi111 ceph-mon[27539]: from='client.? 172.21.15.203:0/2461772472' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T23:57:26.065 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T23:57:26.065 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:57:26.381 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:57:26.470 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:57:28.392 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:57:28.398 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"03107fbe-6fd0-11ef-bcea-c7b262605968","modified":"2024-09-10T23:54:53.955794Z","created":"2024-09-10T23:54:53.955794Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T23:57:28.399 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-09-10T23:57:28.613 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:28 smithi111 ceph-mon[27539]: from='client.? 172.21.15.203:0/1378437731' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T23:57:30.022 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T23:57:30.023 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:57:30.334 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:57:30.422 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:57:30.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:30 smithi111 ceph-mon[27539]: Active manager daemon smithi111.ypucji restarted 2024-09-10T23:57:30.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:30 smithi111 ceph-mon[27539]: Activating manager daemon smithi111.ypucji 2024-09-10T23:57:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:30 smithi111 ceph-mon[27539]: osdmap e5: 0 total, 0 up, 0 in 2024-09-10T23:57:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:30 smithi111 ceph-mon[27539]: mgrmap e15: smithi111.ypucji(active, starting, since 0.00358249s) 2024-09-10T23:57:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:30 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-10T23:57:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:30 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mgr metadata", "who": "smithi111.ypucji", "id": "smithi111.ypucji"}]: dispatch 2024-09-10T23:57:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:30 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T23:57:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:30 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T23:57:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:30 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T23:57:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:30 smithi111 ceph-mon[27539]: Manager daemon smithi111.ypucji is now available 2024-09-10T23:57:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:30 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T23:57:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:30 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T23:57:31.924 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:31 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:31.924 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:31 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T23:57:31.924 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:31 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.ypucji/mirror_snapshot_schedule"}]: dispatch 2024-09-10T23:57:31.924 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:31 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.ypucji/trash_purge_schedule"}]: dispatch 2024-09-10T23:57:31.924 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:31 smithi111 ceph-mon[27539]: [10/Sep/2024:23:57:31] ENGINE Bus STARTING 2024-09-10T23:57:31.925 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:31 smithi111 ceph-mon[27539]: [10/Sep/2024:23:57:31] ENGINE Serving on http://172.21.15.111:8765 2024-09-10T23:57:31.925 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:31 smithi111 ceph-mon[27539]: mgrmap e16: smithi111.ypucji(active, since 1.00722s) 2024-09-10T23:57:32.511 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:57:32.511 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"03107fbe-6fd0-11ef-bcea-c7b262605968","modified":"2024-09-10T23:54:53.955794Z","created":"2024-09-10T23:54:53.955794Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T23:57:32.514 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-09-10T23:57:33.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:32 smithi111 ceph-mon[27539]: [10/Sep/2024:23:57:31] ENGINE Serving on https://172.21.15.111:7150 2024-09-10T23:57:33.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:32 smithi111 ceph-mon[27539]: [10/Sep/2024:23:57:31] ENGINE Bus STARTED 2024-09-10T23:57:33.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:32 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:33.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:32 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:33.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:32 smithi111 ceph-mon[27539]: from='client.? 172.21.15.203:0/1245637644' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T23:57:34.218 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T23:57:34.218 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:57:34.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:34 smithi111 ceph-mon[27539]: mgrmap e17: smithi111.ypucji(active, since 2s) 2024-09-10T23:57:34.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:34 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:35.323 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:57:35.417 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:57:37.969 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:57:37.969 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"03107fbe-6fd0-11ef-bcea-c7b262605968","modified":"2024-09-10T23:54:53.955794Z","created":"2024-09-10T23:54:53.955794Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T23:57:37.971 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-09-10T23:57:38.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:38 smithi111 ceph-mon[27539]: from='client.? 172.21.15.203:0/1600299983' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T23:57:39.597 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:39 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:39.597 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:39 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:39.597 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:39 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:39.597 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:39 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:39.597 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:39 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "who": "osd/host:smithi203", "name": "osd_memory_target"}]: dispatch 2024-09-10T23:57:39.897 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T23:57:39.897 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:57:40.213 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:57:40.300 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T23:57:41.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:40 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:41.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:40 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:42.524 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:57:42.525 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"03107fbe-6fd0-11ef-bcea-c7b262605968","modified":"2024-09-10T23:54:53.955794Z","created":"2024-09-10T23:54:53.955794Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T23:57:42.525 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-09-10T23:57:42.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:42 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:42.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:42 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:42.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:42 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "who": "osd/host:smithi111", "name": "osd_memory_target"}]: dispatch 2024-09-10T23:57:42.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:42 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:57:42.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:42 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T23:57:42.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:42 smithi111 ceph-mon[27539]: Updating smithi111:/etc/ceph/ceph.conf 2024-09-10T23:57:42.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:42 smithi111 ceph-mon[27539]: Updating smithi203:/etc/ceph/ceph.conf 2024-09-10T23:57:43.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:43 smithi111 ceph-mon[27539]: Updating smithi203:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:57:43.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:43 smithi111 ceph-mon[27539]: Updating smithi111:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:57:43.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:43 smithi111 ceph-mon[27539]: Updating smithi111:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:57:43.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:43 smithi111 ceph-mon[27539]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:57:43.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:43 smithi111 ceph-mon[27539]: from='client.? 172.21.15.203:0/274855097' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T23:57:44.484 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T23:57:44.484 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:57:44.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:44 smithi111 ceph-mon[27539]: Updating smithi111:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:57:44.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:44 smithi111 ceph-mon[27539]: Updating smithi203:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T23:57:44.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:44 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:44.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:44 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:44.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:44 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:44.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:44 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:44.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:44 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:44.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:44 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi203", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-10T23:57:44.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:44 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi203", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-10T23:57:44.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:44 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:57:45.011 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:57:45.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:45 smithi111 ceph-mon[27539]: Deploying daemon ceph-exporter.smithi203 on smithi203 2024-09-10T23:57:46.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:46 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T23:57:47.606 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:57:47.607 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"03107fbe-6fd0-11ef-bcea-c7b262605968","modified":"2024-09-10T23:54:53.955794Z","created":"2024-09-10T23:54:53.955794Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T23:57:47.609 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-09-10T23:57:48.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:48 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:48.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:48 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:48.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:48 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:48.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:48 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:48.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:48 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi203", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T23:57:48.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:48 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi203", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-10T23:57:48.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:48 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:57:48.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:48 smithi111 ceph-mon[27539]: Deploying daemon crash.smithi203 on smithi203 2024-09-10T23:57:48.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:48 smithi111 ceph-mon[27539]: from='client.? 172.21.15.203:0/505273098' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T23:57:49.437 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T23:57:49.438 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:57:49.868 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:57:52.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:51 smithi111 ceph-mon[27539]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:57:52.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:51 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:52.302 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:57:52.302 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"03107fbe-6fd0-11ef-bcea-c7b262605968","modified":"2024-09-10T23:54:53.955794Z","created":"2024-09-10T23:54:53.955794Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T23:57:52.305 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-09-10T23:57:53.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:52 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:53.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:52 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:53.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:52 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:53.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:52 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:53.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:52 smithi111 ceph-mon[27539]: Deploying daemon node-exporter.smithi203 on smithi203 2024-09-10T23:57:53.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:52 smithi111 ceph-mon[27539]: from='client.? 172.21.15.203:0/358827515' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T23:57:54.034 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T23:57:54.034 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:57:54.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:53 smithi111 ceph-mon[27539]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:57:54.373 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:57:56.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:55 smithi111 ceph-mon[27539]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:57:56.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:55 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:57.529 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:57:57.529 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"03107fbe-6fd0-11ef-bcea-c7b262605968","modified":"2024-09-10T23:54:53.955794Z","created":"2024-09-10T23:54:53.955794Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T23:57:57.532 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-09-10T23:57:58.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:57 smithi111 ceph-mon[27539]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:57:58.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:57 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:58.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:57 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:58.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:57 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:58.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:57 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:57:58.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:57 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi203.smuspl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T23:57:58.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:57 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi203.smuspl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T23:57:58.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:57 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T23:57:58.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:57 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:57:58.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:57 smithi111 ceph-mon[27539]: from='client.? 172.21.15.203:0/1343481523' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T23:57:59.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:58 smithi111 ceph-mon[27539]: Deploying daemon mgr.smithi203.smuspl on smithi203 2024-09-10T23:57:59.286 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T23:57:59.286 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:57:59.753 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:58:00.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:57:59 smithi111 ceph-mon[27539]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:02.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:01 smithi111 ceph-mon[27539]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:02.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:01 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T23:58:02.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:01 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:02.436 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:58:02.436 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"03107fbe-6fd0-11ef-bcea-c7b262605968","modified":"2024-09-10T23:54:53.955794Z","created":"2024-09-10T23:54:53.955794Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T23:58:02.438 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-09-10T23:58:03.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:02 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:03.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:02 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:03.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:02 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:03.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:02 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:03.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:02 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T23:58:03.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:02 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:58:03.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:02 smithi111 ceph-mon[27539]: Deploying daemon mon.smithi203 on smithi203 2024-09-10T23:58:03.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:02 smithi111 ceph-mon[27539]: from='client.? 172.21.15.203:0/4051177153' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T23:58:04.143 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T23:58:04.143 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:58:04.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:04 smithi111 ceph-mon[27539]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:05.702 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi203/config 2024-09-10T23:58:06.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:06 smithi111 ceph-mon[27539]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:06.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:06 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:07.633 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:07 smithi203 podman[33177]: 2024-09-10 23:58:07.499077908 +0000 UTC m=+0.030731228 image pull dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007 2024-09-10T23:58:07.969 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:07 smithi203 podman[33177]: 2024-09-10 23:58:07.851124326 +0000 UTC m=+0.382777633 container create ff8eb7ca85eafd04498a9e408b270389595b792e4184a3f36eac8a4a7b36c3c6 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi203, org.label-schema.vendor=CentOS, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-09-10T23:58:08.087 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:58:08.087 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"03107fbe-6fd0-11ef-bcea-c7b262605968","modified":"2024-09-10T23:54:53.955794Z","created":"2024-09-10T23:54:53.955794Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T23:58:08.090 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-09-10T23:58:08.282 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 podman[33177]: 2024-09-10 23:58:08.053832986 +0000 UTC m=+0.585486306 container init ff8eb7ca85eafd04498a9e408b270389595b792e4184a3f36eac8a4a7b36c3c6 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi203, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20231212, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-10T23:58:08.282 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 podman[33177]: 2024-09-10 23:58:08.061445831 +0000 UTC m=+0.593099138 container start ff8eb7ca85eafd04498a9e408b270389595b792e4184a3f36eac8a4a7b36c3c6 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi203, org.label-schema.build-date=20231212, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, org.label-schema.license=GPLv2, RELEASE=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-09-10T23:58:08.282 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T23:58:08.282 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable), process ceph-mon, pid 2 2024-09-10T23:58:08.282 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: pidfile_write: ignore empty --pid-file 2024-09-10T23:58:08.283 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: load: jerasure load: lrc 2024-09-10T23:58:08.283 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: RocksDB version: 7.9.2 2024-09-10T23:58:08.283 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Git sha 0 2024-09-10T23:58:08.283 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Compile date 2023-08-03 19:21:13 2024-09-10T23:58:08.283 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: DB SUMMARY 2024-09-10T23:58:08.283 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: DB Session ID: AFGWDS1ALMYRBS4NKHAN 2024-09-10T23:58:08.283 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: CURRENT file: CURRENT 2024-09-10T23:58:08.283 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T23:58:08.283 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-10T23:58:08.283 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi203/store.db dir, Total Num: 0, files: 2024-09-10T23:58:08.284 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi203/store.db: 000004.log size: 511 ; 2024-09-10T23:58:08.284 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.error_if_exists: 0 2024-09-10T23:58:08.284 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.create_if_missing: 0 2024-09-10T23:58:08.284 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.paranoid_checks: 1 2024-09-10T23:58:08.284 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T23:58:08.284 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T23:58:08.284 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T23:58:08.284 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.env: 0x5652e324f720 2024-09-10T23:58:08.284 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T23:58:08.284 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.info_log: 0x565318eb12c0 2024-09-10T23:58:08.284 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T23:58:08.285 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.statistics: (nil) 2024-09-10T23:58:08.285 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.use_fsync: 0 2024-09-10T23:58:08.285 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.max_log_file_size: 0 2024-09-10T23:58:08.285 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T23:58:08.285 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T23:58:08.285 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T23:58:08.285 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T23:58:08.285 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.allow_fallocate: 1 2024-09-10T23:58:08.285 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T23:58:08.285 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T23:58:08.285 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.use_direct_reads: 0 2024-09-10T23:58:08.285 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T23:58:08.286 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T23:58:08.286 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.db_log_dir: 2024-09-10T23:58:08.286 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.wal_dir: 2024-09-10T23:58:08.286 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T23:58:08.286 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T23:58:08.286 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T23:58:08.286 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T23:58:08.286 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T23:58:08.286 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T23:58:08.286 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T23:58:08.286 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T23:58:08.286 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.write_buffer_manager: 0x5653181223c0 2024-09-10T23:58:08.286 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T23:58:08.287 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T23:58:08.287 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T23:58:08.287 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T23:58:08.287 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T23:58:08.287 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T23:58:08.287 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T23:58:08.287 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T23:58:08.287 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.unordered_write: 0 2024-09-10T23:58:08.287 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T23:58:08.287 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T23:58:08.287 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T23:58:08.287 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T23:58:08.287 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.row_cache: None 2024-09-10T23:58:08.287 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.wal_filter: None 2024-09-10T23:58:08.287 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T23:58:08.289 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T23:58:08.289 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.two_write_queues: 0 2024-09-10T23:58:08.289 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T23:58:08.289 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.wal_compression: 0 2024-09-10T23:58:08.289 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.atomic_flush: 0 2024-09-10T23:58:08.289 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T23:58:08.289 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T23:58:08.289 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T23:58:08.289 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.log_readahead_size: 0 2024-09-10T23:58:08.290 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T23:58:08.290 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T23:58:08.290 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T23:58:08.290 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T23:58:08.290 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T23:58:08.290 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T23:58:08.290 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T23:58:08.290 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.max_background_jobs: 2 2024-09-10T23:58:08.290 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.max_background_compactions: -1 2024-09-10T23:58:08.290 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.max_subcompactions: 1 2024-09-10T23:58:08.290 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T23:58:08.290 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T23:58:08.291 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T23:58:08.291 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T23:58:08.291 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T23:58:08.291 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T23:58:08.291 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T23:58:08.291 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T23:58:08.291 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.max_open_files: -1 2024-09-10T23:58:08.291 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T23:58:08.291 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T23:58:08.291 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T23:58:08.291 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T23:58:08.291 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.max_background_flushes: -1 2024-09-10T23:58:08.291 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Compression algorithms supported: 2024-09-10T23:58:08.291 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T23:58:08.292 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: kZSTD supported: 0 2024-09-10T23:58:08.292 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: kXpressCompression supported: 0 2024-09-10T23:58:08.292 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T23:58:08.292 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: kZlibCompression supported: 1 2024-09-10T23:58:08.292 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: kSnappyCompression supported: 1 2024-09-10T23:58:08.292 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: kLZ4Compression supported: 1 2024-09-10T23:58:08.292 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: kBZip2Compression supported: 0 2024-09-10T23:58:08.292 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T23:58:08.292 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T23:58:08.292 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi203/store.db/MANIFEST-000005 2024-09-10T23:58:08.292 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T23:58:08.292 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T23:58:08.292 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.merge_operator: 2024-09-10T23:58:08.292 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.compaction_filter: None 2024-09-10T23:58:08.293 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T23:58:08.293 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T23:58:08.293 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T23:58:08.293 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T23:58:08.293 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x565318eb13c0) 2024-09-10T23:58:08.293 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: cache_index_and_filter_blocks: 1 2024-09-10T23:58:08.293 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T23:58:08.293 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T23:58:08.293 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: pin_top_level_index_and_filter: 1 2024-09-10T23:58:08.293 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: index_type: 0 2024-09-10T23:58:08.293 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: data_block_index_type: 0 2024-09-10T23:58:08.293 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: index_shortening: 1 2024-09-10T23:58:08.293 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T23:58:08.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: checksum: 4 2024-09-10T23:58:08.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: no_block_cache: 0 2024-09-10T23:58:08.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_cache: 0x5653181c3350 2024-09-10T23:58:08.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_cache_name: BinnedLRUCache 2024-09-10T23:58:08.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_cache_options: 2024-09-10T23:58:08.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: capacity : 536870912 2024-09-10T23:58:08.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: num_shard_bits : 4 2024-09-10T23:58:08.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: strict_capacity_limit : 0 2024-09-10T23:58:08.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: high_pri_pool_ratio: 0.000 2024-09-10T23:58:08.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_cache_compressed: (nil) 2024-09-10T23:58:08.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: persistent_cache: (nil) 2024-09-10T23:58:08.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_size: 4096 2024-09-10T23:58:08.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_size_deviation: 10 2024-09-10T23:58:08.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_restart_interval: 16 2024-09-10T23:58:08.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: index_block_restart_interval: 1 2024-09-10T23:58:08.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: metadata_block_size: 4096 2024-09-10T23:58:08.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: partition_filters: 0 2024-09-10T23:58:08.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: use_delta_encoding: 1 2024-09-10T23:58:08.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: filter_policy: bloomfilter 2024-09-10T23:58:08.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: whole_key_filtering: 1 2024-09-10T23:58:08.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: verify_compression: 0 2024-09-10T23:58:08.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: read_amp_bytes_per_bit: 0 2024-09-10T23:58:08.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: format_version: 5 2024-09-10T23:58:08.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: enable_index_compression: 1 2024-09-10T23:58:08.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_align: 0 2024-09-10T23:58:08.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: max_auto_readahead_size: 262144 2024-09-10T23:58:08.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: prepopulate_block_cache: 0 2024-09-10T23:58:08.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: initial_auto_readahead_size: 8192 2024-09-10T23:58:08.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T23:58:08.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T23:58:08.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T23:58:08.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.compression: NoCompression 2024-09-10T23:58:08.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T23:58:08.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T23:58:08.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T23:58:08.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.num_levels: 7 2024-09-10T23:58:08.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T23:58:08.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T23:58:08.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T23:58:08.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T23:58:08.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T23:58:08.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T23:58:08.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T23:58:08.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T23:58:08.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T23:58:08.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T23:58:08.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T23:58:08.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T23:58:08.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T23:58:08.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T23:58:08.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T23:58:08.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T23:58:08.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T23:58:08.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T23:58:08.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T23:58:08.298 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T23:58:08.298 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T23:58:08.298 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T23:58:08.298 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T23:58:08.298 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T23:58:08.298 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T23:58:08.298 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T23:58:08.298 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T23:58:08.298 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T23:58:08.298 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T23:58:08.298 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T23:58:08.298 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T23:58:08.298 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T23:58:08.298 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T23:58:08.298 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T23:58:08.299 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T23:58:08.299 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T23:58:08.299 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T23:58:08.299 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T23:58:08.299 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T23:58:08.299 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T23:58:08.299 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T23:58:08.299 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T23:58:08.299 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T23:58:08.299 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T23:58:08.299 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T23:58:08.299 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T23:58:08.299 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T23:58:08.299 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T23:58:08.300 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T23:58:08.300 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T23:58:08.300 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T23:58:08.300 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T23:58:08.300 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T23:58:08.300 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.table_properties_collectors: 2024-09-10T23:58:08.300 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.inplace_update_support: 0 2024-09-10T23:58:08.300 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T23:58:08.300 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T23:58:08.300 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T23:58:08.300 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T23:58:08.300 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.bloom_locality: 0 2024-09-10T23:58:08.300 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.max_successive_merges: 0 2024-09-10T23:58:08.301 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T23:58:08.301 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T23:58:08.301 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T23:58:08.301 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T23:58:08.301 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.ttl: 2592000 2024-09-10T23:58:08.301 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T23:58:08.301 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T23:58:08.301 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T23:58:08.301 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.enable_blob_files: false 2024-09-10T23:58:08.301 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.min_blob_size: 0 2024-09-10T23:58:08.301 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T23:58:08.301 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T23:58:08.301 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T23:58:08.301 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T23:58:08.302 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T23:58:08.302 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T23:58:08.302 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T23:58:08.302 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T23:58:08.302 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi203/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-10T23:58:08.302 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-10T23:58:08.302 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d29fcba7-47d2-4735-8a81-a3f61f0aa350 2024-09-10T23:58:08.302 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726012688110507, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-10T23:58:08.302 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-10T23:58:08.302 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726012688112278, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726012688, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d29fcba7-47d2-4735-8a81-a3f61f0aa350", "db_session_id": "AFGWDS1ALMYRBS4NKHAN", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-10T23:58:08.302 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726012688112595, "job": 1, "event": "recovery_finished"} 2024-09-10T23:58:08.302 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-10T23:58:08.302 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi203/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T23:58:08.302 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x565318260000 2024-09-10T23:58:08.302 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: DB pointer 0x56531824c000 2024-09-10T23:58:08.303 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T23:58:08.303 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T23:58:08.303 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: ** DB Stats ** 2024-09-10T23:58:08.303 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T23:58:08.303 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T23:58:08.303 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T23:58:08.303 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T23:58:08.303 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T23:58:08.303 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T23:58:08.303 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T23:58:08.303 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-09-10T23:58:08.303 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: ** Compaction Stats [default] ** 2024-09-10T23:58:08.303 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T23:58:08.303 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T23:58:08.304 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.9 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-10T23:58:08.304 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.9 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-10T23:58:08.304 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.9 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-10T23:58:08.304 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-09-10T23:58:08.304 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: ** Compaction Stats [default] ** 2024-09-10T23:58:08.304 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T23:58:08.304 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T23:58:08.304 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.9 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-10T23:58:08.304 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-09-10T23:58:08.304 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T23:58:08.304 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-09-10T23:58:08.304 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T23:58:08.304 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T23:58:08.304 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T23:58:08.305 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T23:58:08.305 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T23:58:08.305 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T23:58:08.305 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Cumulative compaction: 0.00 GB write, 0.18 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T23:58:08.305 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Interval compaction: 0.00 GB write, 0.18 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T23:58:08.305 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T23:58:08.305 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Block cache BinnedLRUCache@0x5653181c3350#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-09-10T23:58:08.305 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-10T23:58:08.305 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-09-10T23:58:08.305 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T23:58:08.305 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: mon.smithi203 does not exist in monmap, will attempt to join an existing cluster 2024-09-10T23:58:08.305 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: using public_addr v2:172.21.15.203:0/0 -> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-10T23:58:08.305 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: starting mon.smithi203 rank -1 at public addrs [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] at bind addrs [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi203 fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 2024-09-10T23:58:08.306 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: mon.smithi203@-1(???) e0 preinit fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 2024-09-10T23:58:08.306 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 bash[33177]: ff8eb7ca85eafd04498a9e408b270389595b792e4184a3f36eac8a4a7b36c3c6 2024-09-10T23:58:08.306 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: mon.smithi203@-1(synchronizing).mds e1 new map 2024-09-10T23:58:08.306 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: mon.smithi203@-1(synchronizing).mds e1 print_map 2024-09-10T23:58:08.306 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: e1 2024-09-10T23:58:08.306 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T23:58:08.306 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T23:58:08.306 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: legacy client fscid: -1 2024-09-10T23:58:08.306 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-09-10T23:58:08.306 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: No filesystems configured 2024-09-10T23:58:08.306 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: mon.smithi203@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-10T23:58:08.306 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: mon.smithi203@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-10T23:58:08.306 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: mon.smithi203@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-10T23:58:08.307 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: mon.smithi203@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-10T23:58:08.307 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: mon.smithi203@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-10T23:58:08.307 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: mon.smithi203@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-10T23:58:08.307 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: mon.smithi203@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-09-10T23:58:08.307 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: mon.smithi203@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T23:58:08.307 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: mon.smithi203@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:58:08.307 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: mon.smithi203@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:58:08.307 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: mon.smithi203@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T23:58:08.307 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:08.307 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:08.307 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T23:58:08.307 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:08.307 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:08.307 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:08.308 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:08.308 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:08.308 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T23:58:08.308 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:58:08.308 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: Deploying daemon mon.smithi203 on smithi203 2024-09-10T23:58:08.308 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: from='client.? 172.21.15.203:0/4051177153' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T23:58:08.308 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:08.308 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:08.308 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:08.308 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:08.308 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 systemd[1]: Started Ceph mon.smithi203 for 03107fbe-6fd0-11ef-bcea-c7b262605968. 2024-09-10T23:58:08.308 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: mon.smithi203@-1(synchronizing).paxosservice(auth 1..8) refresh upgraded, format 0 -> 3 2024-09-10T23:58:08.308 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: mon.smithi203@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete,mon_cluster_log_to_file 2024-09-10T23:58:08.308 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: expand_channel_meta expand map: {default=false} 2024-09-10T23:58:08.308 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: expand_channel_meta from 'false' to 'false' 2024-09-10T23:58:08.309 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: expand_channel_meta expanded map: {default=false} 2024-09-10T23:58:08.309 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: expand_channel_meta expand map: {default=info} 2024-09-10T23:58:08.309 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: expand_channel_meta from 'info' to 'info' 2024-09-10T23:58:08.309 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: expand_channel_meta expanded map: {default=info} 2024-09-10T23:58:08.309 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: expand_channel_meta expand map: {default=daemon} 2024-09-10T23:58:08.309 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: expand_channel_meta from 'daemon' to 'daemon' 2024-09-10T23:58:08.309 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: expand_channel_meta expanded map: {default=daemon} 2024-09-10T23:58:08.309 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: expand_channel_meta expand map: {default=debug} 2024-09-10T23:58:08.309 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: expand_channel_meta from 'debug' to 'debug' 2024-09-10T23:58:08.309 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:08 smithi203 ceph-mon[33225]: expand_channel_meta expanded map: {default=debug} 2024-09-10T23:58:08.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:08 smithi111 ceph-mon[27539]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:09.936 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T23:58:09.936 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T23:58:10.266 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi203/config 2024-09-10T23:58:13.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:13 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-10T23:58:13.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:13 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-09-10T23:58:13.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:13 smithi203 ceph-mon[33225]: mon.smithi111 calling monitor election 2024-09-10T23:58:13.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:13 smithi203 ceph-mon[33225]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:13.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:13 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-09-10T23:58:13.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:13 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-09-10T23:58:13.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:13 smithi203 ceph-mon[33225]: mon.smithi203 calling monitor election 2024-09-10T23:58:13.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:13 smithi203 ceph-mon[33225]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:13.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:13 smithi203 ceph-mon[33225]: from='mgr.? 172.21.15.203:0/3822505223' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.smuspl/crt"}]: dispatch 2024-09-10T23:58:13.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:13 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-09-10T23:58:13.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:13 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-09-10T23:58:13.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:13 smithi203 ceph-mon[33225]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:13.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:13 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-09-10T23:58:13.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:13 smithi203 ceph-mon[33225]: mon.smithi111 is new leader, mons smithi111,smithi203 in quorum (ranks 0,1) 2024-09-10T23:58:13.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:13 smithi203 ceph-mon[33225]: monmap e2: 2 mons at {smithi111=[v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0],smithi203=[v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0]} removed_ranks: {} 2024-09-10T23:58:13.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:13 smithi203 ceph-mon[33225]: fsmap 2024-09-10T23:58:13.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:13 smithi203 ceph-mon[33225]: osdmap e5: 0 total, 0 up, 0 in 2024-09-10T23:58:13.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:13 smithi203 ceph-mon[33225]: mgrmap e17: smithi111.ypucji(active, since 42s) 2024-09-10T23:58:13.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:13 smithi203 ceph-mon[33225]: Standby manager daemon smithi203.smuspl started 2024-09-10T23:58:13.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:13 smithi203 ceph-mon[33225]: from='mgr.? 172.21.15.203:0/3822505223' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T23:58:13.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:13 smithi203 ceph-mon[33225]: overall HEALTH_OK 2024-09-10T23:58:13.547 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:13 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:13.547 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:13 smithi203 ceph-mon[33225]: from='mgr.? 172.21.15.203:0/3822505223' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.smuspl/key"}]: dispatch 2024-09-10T23:58:13.547 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:13 smithi203 ceph-mon[33225]: from='mgr.? 172.21.15.203:0/3822505223' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T23:58:13.547 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:13 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:13.547 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:13 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:13.547 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:13 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:13.547 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:13 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:13.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:13 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-10T23:58:13.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:13 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-09-10T23:58:13.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:13 smithi111 ceph-mon[27539]: mon.smithi111 calling monitor election 2024-09-10T23:58:13.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:13 smithi111 ceph-mon[27539]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:13.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:13 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-09-10T23:58:13.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:13 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-09-10T23:58:13.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:13 smithi111 ceph-mon[27539]: mon.smithi203 calling monitor election 2024-09-10T23:58:13.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:13 smithi111 ceph-mon[27539]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:13.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:13 smithi111 ceph-mon[27539]: from='mgr.? 172.21.15.203:0/3822505223' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.smuspl/crt"}]: dispatch 2024-09-10T23:58:13.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:13 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-09-10T23:58:13.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:13 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-09-10T23:58:13.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:13 smithi111 ceph-mon[27539]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:13.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:13 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-09-10T23:58:13.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:13 smithi111 ceph-mon[27539]: mon.smithi111 is new leader, mons smithi111,smithi203 in quorum (ranks 0,1) 2024-09-10T23:58:13.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:13 smithi111 ceph-mon[27539]: monmap e2: 2 mons at {smithi111=[v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0],smithi203=[v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0]} removed_ranks: {} 2024-09-10T23:58:13.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:13 smithi111 ceph-mon[27539]: fsmap 2024-09-10T23:58:13.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:13 smithi111 ceph-mon[27539]: osdmap e5: 0 total, 0 up, 0 in 2024-09-10T23:58:13.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:13 smithi111 ceph-mon[27539]: mgrmap e17: smithi111.ypucji(active, since 42s) 2024-09-10T23:58:13.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:13 smithi111 ceph-mon[27539]: Standby manager daemon smithi203.smuspl started 2024-09-10T23:58:13.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:13 smithi111 ceph-mon[27539]: from='mgr.? 172.21.15.203:0/3822505223' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T23:58:13.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:13 smithi111 ceph-mon[27539]: overall HEALTH_OK 2024-09-10T23:58:13.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:13 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:13.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:13 smithi111 ceph-mon[27539]: from='mgr.? 172.21.15.203:0/3822505223' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.smuspl/key"}]: dispatch 2024-09-10T23:58:13.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:13 smithi111 ceph-mon[27539]: from='mgr.? 172.21.15.203:0/3822505223' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T23:58:13.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:13 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:13.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:13 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:13.655 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:13 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:13.655 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:13 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:13.751 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-10T23:58:13.751 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":2,"fsid":"03107fbe-6fd0-11ef-bcea-c7b262605968","modified":"2024-09-10T23:58:08.159111Z","created":"2024-09-10T23:54:53.955794Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi203","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:3300","nonce":0},{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T23:58:13.755 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 2 2024-09-10T23:58:14.415 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:14 smithi203 ceph-mon[33225]: mgrmap e18: smithi111.ypucji(active, since 42s), standbys: smithi203.smuspl 2024-09-10T23:58:14.415 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:14 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mgr metadata", "who": "smithi203.smuspl", "id": "smithi203.smuspl"}]: dispatch 2024-09-10T23:58:14.415 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:14 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T23:58:14.415 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:14 smithi203 ceph-mon[33225]: from='client.? 172.21.15.203:0/1642518975' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T23:58:14.415 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:14 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-09-10T23:58:14.448 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-10T23:58:14.449 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-10T23:58:14.504 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:14 smithi111 ceph-mon[27539]: mgrmap e18: smithi111.ypucji(active, since 42s), standbys: smithi203.smuspl 2024-09-10T23:58:14.504 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:14 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mgr metadata", "who": "smithi203.smuspl", "id": "smithi203.smuspl"}]: dispatch 2024-09-10T23:58:14.504 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:14 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T23:58:14.504 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:14 smithi111 ceph-mon[27539]: from='client.? 172.21.15.203:0/1642518975' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T23:58:14.504 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:14 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-09-10T23:58:14.775 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-10T23:58:15.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:15 smithi203 ceph-mon[33225]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:15.546 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:15 smithi111 ceph-mon[27539]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:16.320 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:16 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T23:58:16.320 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:16 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:16.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:16 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T23:58:16.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:16 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:16.678 INFO:teuthology.orchestra.run.smithi111.stdout:# minimal ceph.conf for 03107fbe-6fd0-11ef-bcea-c7b262605968 2024-09-10T23:58:16.678 INFO:teuthology.orchestra.run.smithi111.stdout:[global] 2024-09-10T23:58:16.678 INFO:teuthology.orchestra.run.smithi111.stdout: fsid = 03107fbe-6fd0-11ef-bcea-c7b262605968 2024-09-10T23:58:16.678 INFO:teuthology.orchestra.run.smithi111.stdout: mon_host = [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-10T23:58:17.406 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-10T23:58:17.407 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-10T23:58:17.407 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T23:58:17.467 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-10T23:58:17.467 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:58:17.563 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-10T23:58:17.563 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T23:58:17.611 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:17 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:17.611 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:17 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:17.612 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:17 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:58:17.612 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:17 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T23:58:17.612 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:17 smithi203 ceph-mon[33225]: Updating smithi111:/etc/ceph/ceph.conf 2024-09-10T23:58:17.612 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:17 smithi203 ceph-mon[33225]: Updating smithi203:/etc/ceph/ceph.conf 2024-09-10T23:58:17.612 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:17 smithi203 ceph-mon[33225]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:17.612 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:17 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/1438187063' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:58:17.612 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:17 smithi203 ceph-mon[33225]: Updating smithi203:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:58:17.612 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:17 smithi203 ceph-mon[33225]: Updating smithi111:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:58:17.622 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-10T23:58:17.622 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T23:58:17.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:17 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:17.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:17 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:17.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:17 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:58:17.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:17 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T23:58:17.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:17 smithi111 ceph-mon[27539]: Updating smithi111:/etc/ceph/ceph.conf 2024-09-10T23:58:17.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:17 smithi111 ceph-mon[27539]: Updating smithi203:/etc/ceph/ceph.conf 2024-09-10T23:58:17.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:17 smithi111 ceph-mon[27539]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:17.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:17 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/1438187063' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:58:17.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:17 smithi111 ceph-mon[27539]: Updating smithi203:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:58:17.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:17 smithi111 ceph-mon[27539]: Updating smithi111:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T23:58:17.718 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-10T23:58:17.718 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-09-10T23:58:17.722 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-10T23:58:17.722 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph config set client debug_client 20 2024-09-10T23:58:17.767 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-10T23:58:17.767 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph config set client debug_ms 1 2024-09-10T23:58:17.814 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-10T23:58:17.814 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-09-10T23:58:17.859 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-10T23:58:17.860 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-09-10T23:58:17.908 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-10T23:58:17.908 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph config set mds debug_mds 20 2024-09-10T23:58:17.955 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-10T23:58:17.956 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-09-10T23:58:18.008 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-10T23:58:18.009 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph config set mds debug_ms 2 2024-09-10T23:58:18.061 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-10T23:58:18.061 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-09-10T23:58:18.111 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-10T23:58:18.111 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-09-10T23:58:18.161 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-10T23:58:18.162 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-09-10T23:58:18.200 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-10T23:58:18.207 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-10T23:58:18.207 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-09-10T23:58:18.268 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-10T23:58:18.268 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-09-10T23:58:18.321 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-10T23:58:18.321 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-09-10T23:58:18.379 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-10T23:58:18.380 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-09-10T23:58:18.398 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-10T23:58:18.410 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-10T23:58:18.410 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-09-10T23:58:18.464 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-10T23:58:18.464 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-09-10T23:58:18.512 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-10T23:58:18.512 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-09-10T23:58:18.568 DEBUG:tasks.cephadm:set 18 configs 2024-09-10T23:58:18.568 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.0', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '03107fbe-6fd0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi111') 2024-09-10T23:58:18.569 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:18 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:18.569 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:18 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:18.569 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:18 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:18.569 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:18 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:18.569 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:18 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:18.569 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:18 smithi111 ceph-mon[27539]: Reconfiguring mon.smithi111 (unknown last config time)... 2024-09-10T23:58:18.569 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:18 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T23:58:18.569 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:18 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T23:58:18.569 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:18 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:58:18.569 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:18 smithi111 ceph-mon[27539]: Reconfiguring daemon mon.smithi111 on smithi111 2024-09-10T23:58:18.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:18 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:18.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:18 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:18.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:18 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:18.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:18 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:18.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:18 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:18.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:18 smithi203 ceph-mon[33225]: Reconfiguring mon.smithi111 (unknown last config time)... 2024-09-10T23:58:18.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:18 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T23:58:18.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:18 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T23:58:18.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:18 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:58:18.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:18 smithi203 ceph-mon[33225]: Reconfiguring daemon mon.smithi111 on smithi111 2024-09-10T23:58:19.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:19 smithi111 ceph-mon[27539]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:20.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:19 smithi203 ceph-mon[33225]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:21.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:21 smithi111 ceph-mon[27539]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:22.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:21 smithi203 ceph-mon[33225]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:22.181 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-10T23:58:22.183 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-10T23:58:22.426 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-10T23:58:22.456 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-10T23:58:22.466 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-10T23:58:22.471 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-10T23:58:22.476 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-10T23:58:23.039 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:22 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/123546385' entity='client.admin' 2024-09-10T23:58:23.039 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:22 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:23.039 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:22 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:23.039 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:22 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi111.ypucji", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T23:58:23.039 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:22 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T23:58:23.039 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:22 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:58:23.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:22 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/123546385' entity='client.admin' 2024-09-10T23:58:23.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:22 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:23.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:22 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:23.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:22 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi111.ypucji", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T23:58:23.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:22 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T23:58:23.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:22 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:58:23.338 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-10T23:58:23.338 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-10T23:58:23.342 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-10T23:58:23.373 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.0', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '03107fbe-6fd0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi111') 2024-09-10T23:58:23.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:23 smithi111 ceph-mon[27539]: Reconfiguring mgr.smithi111.ypucji (unknown last config time)... 2024-09-10T23:58:23.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:23 smithi111 ceph-mon[27539]: Reconfiguring daemon mgr.smithi111.ypucji on smithi111 2024-09-10T23:58:23.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:23 smithi111 ceph-mon[27539]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:23.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:23 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/2409746852' entity='client.admin' 2024-09-10T23:58:24.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:23 smithi203 ceph-mon[33225]: Reconfiguring mgr.smithi111.ypucji (unknown last config time)... 2024-09-10T23:58:24.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:23 smithi203 ceph-mon[33225]: Reconfiguring daemon mgr.smithi111.ypucji on smithi111 2024-09-10T23:58:24.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:23 smithi203 ceph-mon[33225]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:24.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:23 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/2409746852' entity='client.admin' 2024-09-10T23:58:24.929 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.0', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '03107fbe-6fd0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi111') 2024-09-10T23:58:26.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:25 smithi203 ceph-mon[33225]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:26.058 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:25 smithi111 ceph-mon[27539]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:28.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:27 smithi203 ceph-mon[33225]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:28.123 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:27 smithi111 ceph-mon[27539]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:29.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:29 smithi111 ceph-mon[27539]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:30.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:29 smithi203 ceph-mon[33225]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:31.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:30 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T23:58:31.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:30 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T23:58:31.822 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:31 smithi111 ceph-mon[27539]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:32.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:31 smithi203 ceph-mon[33225]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:33.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:32 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/2918582313' entity='client.admin' 2024-09-10T23:58:33.321 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:32 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/2918582313' entity='client.admin' 2024-09-10T23:58:33.582 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-10T23:58:33.583 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-10T23:58:33.583 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-10T23:58:33.583 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-10T23:58:34.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:33 smithi111 ceph-mon[27539]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:34.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:33 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:34.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:33 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:34.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:33 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi111", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-10T23:58:34.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:33 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:58:34.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:33 smithi203 ceph-mon[33225]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:34.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:33 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:34.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:33 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:34.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:33 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi111", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-10T23:58:34.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:33 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:58:34.964 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:34 smithi111 ceph-mon[27539]: Reconfiguring ceph-exporter.smithi111 (monmap changed)... 2024-09-10T23:58:34.964 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:34 smithi111 ceph-mon[27539]: Reconfiguring daemon ceph-exporter.smithi111 on smithi111 2024-09-10T23:58:34.964 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:34 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/4206627873' entity='client.admin' 2024-09-10T23:58:35.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:34 smithi203 ceph-mon[33225]: Reconfiguring ceph-exporter.smithi111 (monmap changed)... 2024-09-10T23:58:35.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:34 smithi203 ceph-mon[33225]: Reconfiguring daemon ceph-exporter.smithi111 on smithi111 2024-09-10T23:58:35.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:34 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/4206627873' entity='client.admin' 2024-09-10T23:58:36.009 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:35 smithi111 ceph-mon[27539]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:36.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:35 smithi203 ceph-mon[33225]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:37.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.747+0000 7f67ad600700 1 -- 172.21.15.111:0/1917038526 <== mon.0 v2:172.21.15.111:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v15)=0 v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7f679c0600b0 con 0x7f67b01011a0 2024-09-10T23:58:37.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.750+0000 7f67b5e00700 1 -- 172.21.15.111:0/1917038526 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f679806c610 msgr2=0x7f679806eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:37.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.750+0000 7f67b5e00700 1 --2- 172.21.15.111:0/1917038526 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f679806c610 0x7f679806eac0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f67a4005950 tx=0x7f67a40058e0 comp rx=0 tx=0).stop 2024-09-10T23:58:37.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.750+0000 7f67b5e00700 1 -- 172.21.15.111:0/1917038526 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f67b01011a0 msgr2=0x7f67b0073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:37.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.750+0000 7f67b5e00700 1 --2- 172.21.15.111:0/1917038526 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f67b01011a0 0x7f67b0073140 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f679c005b40 tx=0x7f679c005750 comp rx=0 tx=0).stop 2024-09-10T23:58:37.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.750+0000 7f67b5e00700 1 -- 172.21.15.111:0/1917038526 shutdown_connections 2024-09-10T23:58:37.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.750+0000 7f67b5e00700 1 --2- 172.21.15.111:0/1917038526 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f679806c610 0x7f679806eac0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:37.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.750+0000 7f67b5e00700 1 --2- 172.21.15.111:0/1917038526 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67b00fffa0 0x7f67b0074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:37.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.750+0000 7f67b5e00700 1 --2- 172.21.15.111:0/1917038526 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f67b01011a0 0x7f67b0073140 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:37.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.750+0000 7f67b5e00700 1 -- 172.21.15.111:0/1917038526 >> 172.21.15.111:0/1917038526 conn(0x7f67b00fb510 msgr2=0x7f67b01043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:37.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.750+0000 7f67b5e00700 1 -- 172.21.15.111:0/1917038526 shutdown_connections 2024-09-10T23:58:37.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.750+0000 7f67b5e00700 1 -- 172.21.15.111:0/1917038526 wait complete. 2024-09-10T23:58:38.204 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:37 smithi111 ceph-mon[27539]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:38.204 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:37 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/1917038526' entity='client.admin' 2024-09-10T23:58:38.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:37 smithi203 ceph-mon[33225]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:38.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:37 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/1917038526' entity='client.admin' 2024-09-10T23:58:39.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.988+0000 7faed3a00700 1 -- 172.21.15.111:0/1568893001 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faecc073750 msgr2=0x7faecc073bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:39.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.988+0000 7faed3a00700 1 --2- 172.21.15.111:0/1568893001 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faecc073750 0x7faecc073bc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7faeb8009910 tx=0x7faeb8009c20 comp rx=0 tx=0).stop 2024-09-10T23:58:39.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.988+0000 7faed3a00700 1 -- 172.21.15.111:0/1568893001 shutdown_connections 2024-09-10T23:58:39.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.988+0000 7faed3a00700 1 --2- 172.21.15.111:0/1568893001 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faecc073750 0x7faecc073bc0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:39.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.988+0000 7faed3a00700 1 --2- 172.21.15.111:0/1568893001 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faecc074d20 0x7faecc073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:39.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.988+0000 7faed3a00700 1 -- 172.21.15.111:0/1568893001 >> 172.21.15.111:0/1568893001 conn(0x7faecc0fb6e0 msgr2=0x7faecc0fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:39.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.988+0000 7faed3a00700 1 -- 172.21.15.111:0/1568893001 shutdown_connections 2024-09-10T23:58:39.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.988+0000 7faed3a00700 1 -- 172.21.15.111:0/1568893001 wait complete. 2024-09-10T23:58:39.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.989+0000 7faed3a00700 1 Processor -- start 2024-09-10T23:58:39.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.989+0000 7faed3a00700 1 -- start start 2024-09-10T23:58:39.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.989+0000 7faed3a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faecc073750 0x7faecc197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:39.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.989+0000 7faed3a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faecc074d20 0x7faecc198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:39.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.989+0000 7faed3a00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc198620 con 0x7faecc073750 2024-09-10T23:58:39.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.989+0000 7faed3a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc198760 con 0x7faecc074d20 2024-09-10T23:58:39.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.990+0000 7faed1000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faecc073750 0x7faecc197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:39.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.990+0000 7faed1000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faecc073750 0x7faecc197ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:54712/0 (socket says 172.21.15.111:54712) 2024-09-10T23:58:39.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.990+0000 7faed1000700 1 -- 172.21.15.111:0/3739744465 learned_addr learned my addr 172.21.15.111:0/3739744465 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-10T23:58:39.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.990+0000 7faecbe00700 1 --2- 172.21.15.111:0/3739744465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faecc074d20 0x7faecc198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:39.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.990+0000 7faed1000700 1 -- 172.21.15.111:0/3739744465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faecc074d20 msgr2=0x7faecc198000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:39.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.990+0000 7faed1000700 1 --2- 172.21.15.111:0/3739744465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faecc074d20 0x7faecc198000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:39.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.990+0000 7faed1000700 1 -- 172.21.15.111:0/3739744465 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb80095f0 con 0x7faecc073750 2024-09-10T23:58:39.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.990+0000 7faed1000700 1 --2- 172.21.15.111:0/3739744465 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faecc073750 0x7faecc197ac0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faec000d8d0 tx=0x7faec000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:39.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.991+0000 7faec9600700 1 -- 172.21.15.111:0/3739744465 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faec00098a0 con 0x7faecc073750 2024-09-10T23:58:39.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.991+0000 7faec9600700 1 -- 172.21.15.111:0/3739744465 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faec0009e90 con 0x7faecc073750 2024-09-10T23:58:39.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.991+0000 7faed3a00700 1 -- 172.21.15.111:0/3739744465 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faecc19d210 con 0x7faecc073750 2024-09-10T23:58:39.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.991+0000 7faec9600700 1 -- 172.21.15.111:0/3739744465 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faec000f5f0 con 0x7faecc073750 2024-09-10T23:58:39.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.991+0000 7faed3a00700 1 -- 172.21.15.111:0/3739744465 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faecc19d7e0 con 0x7faecc073750 2024-09-10T23:58:39.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.992+0000 7faed3a00700 1 -- 172.21.15.111:0/3739744465 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faecc10ad70 con 0x7faecc073750 2024-09-10T23:58:39.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.993+0000 7faec9600700 1 -- 172.21.15.111:0/3739744465 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) v1 ==== 89860+0+0 (secure 0 0 0) 0x7faec0010460 con 0x7faecc073750 2024-09-10T23:58:39.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.993+0000 7faec9600700 1 --2- 172.21.15.111:0/3739744465 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7faeb406c610 0x7faeb406eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:39.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.994+0000 7faec9600700 1 -- 172.21.15.111:0/3739744465 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7faec008a480 con 0x7faecc073750 2024-09-10T23:58:39.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.994+0000 7faecbe00700 1 --2- 172.21.15.111:0/3739744465 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7faeb406c610 0x7faeb406eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:39.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.994+0000 7faecbe00700 1 --2- 172.21.15.111:0/3739744465 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7faeb406c610 0x7faeb406eac0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7faeb8006010 tx=0x7faeb8005ea0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:39.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:37.998+0000 7faec9600700 1 -- 172.21.15.111:0/3739744465 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7faec0059800 con 0x7faecc073750 2024-09-10T23:58:39.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:38.202+0000 7faed3a00700 1 -- 172.21.15.111:0/3739744465 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) v1 -- 0x7faecc10af00 con 0x7faecc073750 2024-09-10T23:58:39.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:38.206+0000 7faec9600700 1 -- 172.21.15.111:0/3739744465 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v16)=0 v16) v1 ==== 117+0+0 (secure 0 0 0) 0x7faec00160b0 con 0x7faecc073750 2024-09-10T23:58:39.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:38.209+0000 7faed3a00700 1 -- 172.21.15.111:0/3739744465 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7faeb406c610 msgr2=0x7faeb406eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:39.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:38.209+0000 7faed3a00700 1 --2- 172.21.15.111:0/3739744465 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7faeb406c610 0x7faeb406eac0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7faeb8006010 tx=0x7faeb8005ea0 comp rx=0 tx=0).stop 2024-09-10T23:58:39.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:38.209+0000 7faed3a00700 1 -- 172.21.15.111:0/3739744465 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faecc073750 msgr2=0x7faecc197ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:39.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:38.209+0000 7faed3a00700 1 --2- 172.21.15.111:0/3739744465 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faecc073750 0x7faecc197ac0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faec000d8d0 tx=0x7faec000dbe0 comp rx=0 tx=0).stop 2024-09-10T23:58:39.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:38.209+0000 7faed3a00700 1 -- 172.21.15.111:0/3739744465 shutdown_connections 2024-09-10T23:58:39.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:38.209+0000 7faed3a00700 1 --2- 172.21.15.111:0/3739744465 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7faeb406c610 0x7faeb406eac0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:39.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:38.209+0000 7faed3a00700 1 --2- 172.21.15.111:0/3739744465 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faecc073750 0x7faecc197ac0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:39.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:38.209+0000 7faed3a00700 1 --2- 172.21.15.111:0/3739744465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faecc074d20 0x7faecc198000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:39.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:38.209+0000 7faed3a00700 1 -- 172.21.15.111:0/3739744465 >> 172.21.15.111:0/3739744465 conn(0x7faecc0fb6e0 msgr2=0x7faecc105fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:39.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:38.209+0000 7faed3a00700 1 -- 172.21.15.111:0/3739744465 shutdown_connections 2024-09-10T23:58:39.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:38.209+0000 7faed3a00700 1 -- 172.21.15.111:0/3739744465 wait complete. 2024-09-10T23:58:39.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:39 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/3739744465' entity='client.admin' 2024-09-10T23:58:39.627 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:39 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/3739744465' entity='client.admin' 2024-09-10T23:58:40.523 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:40 smithi111 ceph-mon[27539]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:40.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:40 smithi203 ceph-mon[33225]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:40.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.577+0000 7f8374200700 1 -- 172.21.15.111:0/2679456540 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f836c100150 msgr2=0x7f836c100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:40.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.577+0000 7f8374200700 1 --2- 172.21.15.111:0/2679456540 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f836c100150 0x7f836c100560 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8360009910 tx=0x7f8360009c20 comp rx=0 tx=0).stop 2024-09-10T23:58:40.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.578+0000 7f8374200700 1 -- 172.21.15.111:0/2679456540 shutdown_connections 2024-09-10T23:58:40.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.578+0000 7f8374200700 1 --2- 172.21.15.111:0/2679456540 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f836c101350 0x7f836c1017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:40.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.578+0000 7f8374200700 1 --2- 172.21.15.111:0/2679456540 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f836c100150 0x7f836c100560 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:40.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.578+0000 7f8374200700 1 -- 172.21.15.111:0/2679456540 >> 172.21.15.111:0/2679456540 conn(0x7f836c0fb6e0 msgr2=0x7f836c0fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:40.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.578+0000 7f8374200700 1 -- 172.21.15.111:0/2679456540 shutdown_connections 2024-09-10T23:58:40.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.578+0000 7f8374200700 1 -- 172.21.15.111:0/2679456540 wait complete. 2024-09-10T23:58:40.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.579+0000 7f8374200700 1 Processor -- start 2024-09-10T23:58:40.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.579+0000 7f8374200700 1 -- start start 2024-09-10T23:58:40.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.579+0000 7f8374200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f836c100150 0x7f836c197bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:40.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.579+0000 7f8374200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f836c101350 0x7f836c198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:40.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.579+0000 7f8374200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c198720 con 0x7f836c101350 2024-09-10T23:58:40.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.579+0000 7f8374200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c198860 con 0x7f836c100150 2024-09-10T23:58:40.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.579+0000 7f8370e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f836c101350 0x7f836c198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:40.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.579+0000 7f8370e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f836c101350 0x7f836c198100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:54728/0 (socket says 172.21.15.111:54728) 2024-09-10T23:58:40.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.579+0000 7f8370e00700 1 -- 172.21.15.111:0/2034682718 learned_addr learned my addr 172.21.15.111:0/2034682718 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-10T23:58:40.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.580+0000 7f8371800700 1 --2- 172.21.15.111:0/2034682718 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f836c100150 0x7f836c197bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:40.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.580+0000 7f8370e00700 1 -- 172.21.15.111:0/2034682718 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f836c100150 msgr2=0x7f836c197bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:40.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.580+0000 7f8370e00700 1 --2- 172.21.15.111:0/2034682718 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f836c100150 0x7f836c197bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:40.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.580+0000 7f8370e00700 1 -- 172.21.15.111:0/2034682718 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83600095f0 con 0x7f836c101350 2024-09-10T23:58:40.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.580+0000 7f8370e00700 1 --2- 172.21.15.111:0/2034682718 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f836c101350 0x7f836c198100 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f835800b4b0 tx=0x7f835800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:40.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.580+0000 7f836a000700 1 -- 172.21.15.111:0/2034682718 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8358011800 con 0x7f836c101350 2024-09-10T23:58:40.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.580+0000 7f836a000700 1 -- 172.21.15.111:0/2034682718 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8358011df0 con 0x7f836c101350 2024-09-10T23:58:40.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.580+0000 7f8374200700 1 -- 172.21.15.111:0/2034682718 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f836c19d310 con 0x7f836c101350 2024-09-10T23:58:40.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.580+0000 7f836a000700 1 -- 172.21.15.111:0/2034682718 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8358010e40 con 0x7f836c101350 2024-09-10T23:58:40.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.580+0000 7f8374200700 1 -- 172.21.15.111:0/2034682718 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f836c19d8e0 con 0x7f836c101350 2024-09-10T23:58:40.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.581+0000 7f8374200700 1 -- 172.21.15.111:0/2034682718 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f836c105430 con 0x7f836c101350 2024-09-10T23:58:40.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.582+0000 7f836a000700 1 -- 172.21.15.111:0/2034682718 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) v1 ==== 89860+0+0 (secure 0 0 0) 0x7f8358011960 con 0x7f836c101350 2024-09-10T23:58:40.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.583+0000 7f836a000700 1 --2- 172.21.15.111:0/2034682718 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f835406c610 0x7f835406eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:40.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.583+0000 7f836a000700 1 -- 172.21.15.111:0/2034682718 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f835808a260 con 0x7f836c101350 2024-09-10T23:58:40.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.584+0000 7f8371800700 1 --2- 172.21.15.111:0/2034682718 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f835406c610 0x7f835406eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:40.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.584+0000 7f8371800700 1 --2- 172.21.15.111:0/2034682718 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f835406c610 0x7f835406eac0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8360006010 tx=0x7f836000b540 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:40.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.588+0000 7f836a000700 1 -- 172.21.15.111:0/2034682718 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8358059540 con 0x7f836c101350 2024-09-10T23:58:40.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.792+0000 7f8374200700 1 -- 172.21.15.111:0/2034682718 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) v1 -- 0x7f836c02cc30 con 0x7f836c101350 2024-09-10T23:58:40.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.796+0000 7f836a000700 1 -- 172.21.15.111:0/2034682718 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v17)=0 v17) v1 ==== 125+0+0 (secure 0 0 0) 0x7f83580150c0 con 0x7f836c101350 2024-09-10T23:58:40.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.799+0000 7f8374200700 1 -- 172.21.15.111:0/2034682718 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f835406c610 msgr2=0x7f835406eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:40.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.799+0000 7f8374200700 1 --2- 172.21.15.111:0/2034682718 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f835406c610 0x7f835406eac0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8360006010 tx=0x7f836000b540 comp rx=0 tx=0).stop 2024-09-10T23:58:40.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.799+0000 7f8374200700 1 -- 172.21.15.111:0/2034682718 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f836c101350 msgr2=0x7f836c198100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:40.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.799+0000 7f8374200700 1 --2- 172.21.15.111:0/2034682718 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f836c101350 0x7f836c198100 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f835800b4b0 tx=0x7f835800b870 comp rx=0 tx=0).stop 2024-09-10T23:58:40.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.799+0000 7f8374200700 1 -- 172.21.15.111:0/2034682718 shutdown_connections 2024-09-10T23:58:40.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.799+0000 7f8374200700 1 --2- 172.21.15.111:0/2034682718 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f835406c610 0x7f835406eac0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:40.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.799+0000 7f8374200700 1 --2- 172.21.15.111:0/2034682718 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f836c100150 0x7f836c197bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:40.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.799+0000 7f8374200700 1 --2- 172.21.15.111:0/2034682718 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f836c101350 0x7f836c198100 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:40.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.799+0000 7f8374200700 1 -- 172.21.15.111:0/2034682718 >> 172.21.15.111:0/2034682718 conn(0x7f836c0fb6e0 msgr2=0x7f836c102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:40.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.799+0000 7f8374200700 1 -- 172.21.15.111:0/2034682718 shutdown_connections 2024-09-10T23:58:40.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:40.799+0000 7f8374200700 1 -- 172.21.15.111:0/2034682718 wait complete. 2024-09-10T23:58:42.099 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-10T23:58:42.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:41 smithi111 ceph-mon[27539]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:42.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:41 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/2034682718' entity='client.admin' 2024-09-10T23:58:42.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:41 smithi203 ceph-mon[33225]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:42.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:41 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/2034682718' entity='client.admin' 2024-09-10T23:58:43.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.736+0000 7fb028400700 1 -- 172.21.15.111:0/3739464340 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb020103520 msgr2=0x7fb020105900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:43.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.736+0000 7fb028400700 1 --2- 172.21.15.111:0/3739464340 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb020103520 0x7fb020105900 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb00c009910 tx=0x7fb00c009c20 comp rx=0 tx=0).stop 2024-09-10T23:58:43.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.736+0000 7fb028400700 1 -- 172.21.15.111:0/3739464340 shutdown_connections 2024-09-10T23:58:43.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.736+0000 7fb028400700 1 --2- 172.21.15.111:0/3739464340 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb020103520 0x7fb020105900 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:43.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.736+0000 7fb028400700 1 --2- 172.21.15.111:0/3739464340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb020100c00 0x7fb020102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:43.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.736+0000 7fb028400700 1 -- 172.21.15.111:0/3739464340 >> 172.21.15.111:0/3739464340 conn(0x7fb0200fa600 msgr2=0x7fb0200fca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:43.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.736+0000 7fb028400700 1 -- 172.21.15.111:0/3739464340 shutdown_connections 2024-09-10T23:58:43.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.736+0000 7fb028400700 1 -- 172.21.15.111:0/3739464340 wait complete. 2024-09-10T23:58:43.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.737+0000 7fb028400700 1 Processor -- start 2024-09-10T23:58:43.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.737+0000 7fb028400700 1 -- start start 2024-09-10T23:58:43.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.737+0000 7fb028400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb020100c00 0x7fb020195890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:43.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.737+0000 7fb028400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb020103520 0x7fb020195dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:43.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.737+0000 7fb028400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0201963f0 con 0x7fb020100c00 2024-09-10T23:58:43.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.737+0000 7fb028400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb020196530 con 0x7fb020103520 2024-09-10T23:58:43.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.738+0000 7fb025a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb020100c00 0x7fb020195890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:43.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.738+0000 7fb025a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb020100c00 0x7fb020195890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:54748/0 (socket says 172.21.15.111:54748) 2024-09-10T23:58:43.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.738+0000 7fb025a00700 1 -- 172.21.15.111:0/2423343920 learned_addr learned my addr 172.21.15.111:0/2423343920 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-10T23:58:43.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.738+0000 7fb025000700 1 --2- 172.21.15.111:0/2423343920 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb020103520 0x7fb020195dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:43.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.738+0000 7fb025a00700 1 -- 172.21.15.111:0/2423343920 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb020103520 msgr2=0x7fb020195dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:43.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.738+0000 7fb025a00700 1 --2- 172.21.15.111:0/2423343920 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb020103520 0x7fb020195dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:43.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.738+0000 7fb025a00700 1 -- 172.21.15.111:0/2423343920 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00c0095f0 con 0x7fb020100c00 2024-09-10T23:58:43.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.739+0000 7fb025a00700 1 --2- 172.21.15.111:0/2423343920 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb020100c00 0x7fb020195890 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb01400c8a0 tx=0x7fb01400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:43.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.739+0000 7fb01e000700 1 -- 172.21.15.111:0/2423343920 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0140078e0 con 0x7fb020100c00 2024-09-10T23:58:43.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.739+0000 7fb01e000700 1 -- 172.21.15.111:0/2423343920 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb01400f450 con 0x7fb020100c00 2024-09-10T23:58:43.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.739+0000 7fb028400700 1 -- 172.21.15.111:0/2423343920 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02019afe0 con 0x7fb020100c00 2024-09-10T23:58:43.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.739+0000 7fb01e000700 1 -- 172.21.15.111:0/2423343920 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb01400e5e0 con 0x7fb020100c00 2024-09-10T23:58:43.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.739+0000 7fb028400700 1 -- 172.21.15.111:0/2423343920 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02019b520 con 0x7fb020100c00 2024-09-10T23:58:43.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.740+0000 7fb028400700 1 -- 172.21.15.111:0/2423343920 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb02018fa00 con 0x7fb020100c00 2024-09-10T23:58:43.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.741+0000 7fb01e000700 1 -- 172.21.15.111:0/2423343920 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) v1 ==== 89860+0+0 (secure 0 0 0) 0x7fb01400f5c0 con 0x7fb020100c00 2024-09-10T23:58:43.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.742+0000 7fb01e000700 1 --2- 172.21.15.111:0/2423343920 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb00806c600 0x7fb00806eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:43.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.742+0000 7fb01e000700 1 -- 172.21.15.111:0/2423343920 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7fb01408a2a0 con 0x7fb020100c00 2024-09-10T23:58:43.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.742+0000 7fb025000700 1 --2- 172.21.15.111:0/2423343920 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb00806c600 0x7fb00806eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:43.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.743+0000 7fb025000700 1 --2- 172.21.15.111:0/2423343920 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb00806c600 0x7fb00806eab0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb00c005090 tx=0x7fb00c005960 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:43.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.747+0000 7fb01e000700 1 -- 172.21.15.111:0/2423343920 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb014059600 con 0x7fb020100c00 2024-09-10T23:58:43.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.944+0000 7fd676600700 1 -- 172.21.15.111:0/1886359407 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd670101350 msgr2=0x7fd6701017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:43.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.944+0000 7fd676600700 1 --2- 172.21.15.111:0/1886359407 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd670101350 0x7fd6701017a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd65c009910 tx=0x7fd65c009c20 comp rx=0 tx=0).stop 2024-09-10T23:58:43.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.944+0000 7fd676600700 1 -- 172.21.15.111:0/1886359407 shutdown_connections 2024-09-10T23:58:43.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.944+0000 7fd676600700 1 --2- 172.21.15.111:0/1886359407 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd670101350 0x7fd6701017a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:43.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.944+0000 7fd676600700 1 --2- 172.21.15.111:0/1886359407 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd670100150 0x7fd670100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:43.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.944+0000 7fd676600700 1 -- 172.21.15.111:0/1886359407 >> 172.21.15.111:0/1886359407 conn(0x7fd6700fb6e0 msgr2=0x7fd6700fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:43.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.944+0000 7fd676600700 1 -- 172.21.15.111:0/1886359407 shutdown_connections 2024-09-10T23:58:43.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.944+0000 7fd676600700 1 -- 172.21.15.111:0/1886359407 wait complete. 2024-09-10T23:58:43.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.945+0000 7fd676600700 1 Processor -- start 2024-09-10T23:58:43.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.945+0000 7fd676600700 1 -- start start 2024-09-10T23:58:43.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.946+0000 7fd676600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd670100150 0x7fd670197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:43.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.946+0000 7fd676600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd670101350 0x7fd670197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:43.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.946+0000 7fd676600700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd670198600 con 0x7fd670100150 2024-09-10T23:58:43.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.946+0000 7fd676600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd670198740 con 0x7fd670101350 2024-09-10T23:58:43.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.946+0000 7fd66f400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd670100150 0x7fd670197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:43.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.946+0000 7fd66f400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd670100150 0x7fd670197aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:54768/0 (socket says 172.21.15.111:54768) 2024-09-10T23:58:43.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.946+0000 7fd66f400700 1 -- 172.21.15.111:0/2031119234 learned_addr learned my addr 172.21.15.111:0/2031119234 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-10T23:58:43.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.946+0000 7fd66ea00700 1 --2- 172.21.15.111:0/2031119234 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd670101350 0x7fd670197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:43.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.947+0000 7fd66f400700 1 -- 172.21.15.111:0/2031119234 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd670101350 msgr2=0x7fd670197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:43.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.947+0000 7fd66f400700 1 --2- 172.21.15.111:0/2031119234 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd670101350 0x7fd670197fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:43.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.947+0000 7fd66f400700 1 -- 172.21.15.111:0/2031119234 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65c0095f0 con 0x7fd670100150 2024-09-10T23:58:43.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.947+0000 7fd66f400700 1 --2- 172.21.15.111:0/2031119234 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd670100150 0x7fd670197aa0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd66000e8f0 tx=0x7fd66000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:43.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.947+0000 7fd667e00700 1 -- 172.21.15.111:0/2031119234 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd660009790 con 0x7fd670100150 2024-09-10T23:58:43.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.947+0000 7fd667e00700 1 -- 172.21.15.111:0/2031119234 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd66000c810 con 0x7fd670100150 2024-09-10T23:58:43.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.947+0000 7fd676600700 1 -- 172.21.15.111:0/2031119234 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd67019d1f0 con 0x7fd670100150 2024-09-10T23:58:43.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.947+0000 7fd667e00700 1 -- 172.21.15.111:0/2031119234 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd660003c20 con 0x7fd670100150 2024-09-10T23:58:43.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.947+0000 7fd676600700 1 -- 172.21.15.111:0/2031119234 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67019d7c0 con 0x7fd670100150 2024-09-10T23:58:43.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.948+0000 7fd676600700 1 -- 172.21.15.111:0/2031119234 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd670105430 con 0x7fd670100150 2024-09-10T23:58:43.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.949+0000 7fd667e00700 1 -- 172.21.15.111:0/2031119234 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) v1 ==== 89860+0+0 (secure 0 0 0) 0x7fd66000c980 con 0x7fd670100150 2024-09-10T23:58:43.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.950+0000 7fd667e00700 1 --2- 172.21.15.111:0/2031119234 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd65406c600 0x7fd65406eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:43.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.950+0000 7fd667e00700 1 -- 172.21.15.111:0/2031119234 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7fd660014070 con 0x7fd670100150 2024-09-10T23:58:43.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.951+0000 7fd66ea00700 1 --2- 172.21.15.111:0/2031119234 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd65406c600 0x7fd65406eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:43.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.951+0000 7fd66ea00700 1 --2- 172.21.15.111:0/2031119234 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd65406c600 0x7fd65406eab0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd65c00b5e0 tx=0x7fd65c009f70 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:43.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.955+0000 7fd667e00700 1 -- 172.21.15.111:0/2031119234 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd660059d70 con 0x7fd670100150 2024-09-10T23:58:43.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.958+0000 7fb028400700 1 -- 172.21.15.111:0/2423343920 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7fb02004ea50 con 0x7fb020100c00 2024-09-10T23:58:43.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.963+0000 7fb01e000700 1 -- 172.21.15.111:0/2423343920 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v18)=0 v18) v1 ==== 121+0+0 (secure 0 0 0) 0x7fb014059190 con 0x7fb020100c00 2024-09-10T23:58:43.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.965+0000 7fb028400700 1 -- 172.21.15.111:0/2423343920 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb00806c600 msgr2=0x7fb00806eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:43.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.965+0000 7fb028400700 1 --2- 172.21.15.111:0/2423343920 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb00806c600 0x7fb00806eab0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb00c005090 tx=0x7fb00c005960 comp rx=0 tx=0).stop 2024-09-10T23:58:43.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.965+0000 7fb028400700 1 -- 172.21.15.111:0/2423343920 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb020100c00 msgr2=0x7fb020195890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:43.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.965+0000 7fb028400700 1 --2- 172.21.15.111:0/2423343920 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb020100c00 0x7fb020195890 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb01400c8a0 tx=0x7fb01400cbb0 comp rx=0 tx=0).stop 2024-09-10T23:58:43.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.966+0000 7fb028400700 1 -- 172.21.15.111:0/2423343920 shutdown_connections 2024-09-10T23:58:43.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.966+0000 7fb028400700 1 --2- 172.21.15.111:0/2423343920 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb00806c600 0x7fb00806eab0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:43.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.966+0000 7fb028400700 1 --2- 172.21.15.111:0/2423343920 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb020100c00 0x7fb020195890 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:43.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.966+0000 7fb028400700 1 --2- 172.21.15.111:0/2423343920 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb020103520 0x7fb020195dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:43.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.966+0000 7fb028400700 1 -- 172.21.15.111:0/2423343920 >> 172.21.15.111:0/2423343920 conn(0x7fb0200fa600 msgr2=0x7fb0200fca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:43.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.966+0000 7fb028400700 1 -- 172.21.15.111:0/2423343920 shutdown_connections 2024-09-10T23:58:43.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:43.966+0000 7fb028400700 1 -- 172.21.15.111:0/2423343920 wait complete. 2024-09-10T23:58:43.983 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:43 smithi111 ceph-mon[27539]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:44.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:44.172+0000 7fd676600700 1 -- 172.21.15.111:0/2031119234 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) v1 -- 0x7fd67002d030 con 0x7fd670100150 2024-09-10T23:58:44.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:44.177+0000 7fd667e00700 1 -- 172.21.15.111:0/2031119234 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v19)=0 v19) v1 ==== 115+0+0 (secure 0 0 0) 0x7fd660059900 con 0x7fd670100150 2024-09-10T23:58:44.181 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:44.179+0000 7fd676600700 1 -- 172.21.15.111:0/2031119234 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd65406c600 msgr2=0x7fd65406eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:44.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:44.179+0000 7fd676600700 1 --2- 172.21.15.111:0/2031119234 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd65406c600 0x7fd65406eab0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd65c00b5e0 tx=0x7fd65c009f70 comp rx=0 tx=0).stop 2024-09-10T23:58:44.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:44.179+0000 7fd676600700 1 -- 172.21.15.111:0/2031119234 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd670100150 msgr2=0x7fd670197aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:44.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:44.179+0000 7fd676600700 1 --2- 172.21.15.111:0/2031119234 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd670100150 0x7fd670197aa0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd66000e8f0 tx=0x7fd66000ec00 comp rx=0 tx=0).stop 2024-09-10T23:58:44.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:44.180+0000 7fd676600700 1 -- 172.21.15.111:0/2031119234 shutdown_connections 2024-09-10T23:58:44.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:44.180+0000 7fd676600700 1 --2- 172.21.15.111:0/2031119234 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd65406c600 0x7fd65406eab0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:44.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:44.180+0000 7fd676600700 1 --2- 172.21.15.111:0/2031119234 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd670100150 0x7fd670197aa0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:44.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:44.180+0000 7fd676600700 1 --2- 172.21.15.111:0/2031119234 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd670101350 0x7fd670197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:44.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:44.180+0000 7fd676600700 1 -- 172.21.15.111:0/2031119234 >> 172.21.15.111:0/2031119234 conn(0x7fd6700fb6e0 msgr2=0x7fd670102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:44.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:44.180+0000 7fd676600700 1 -- 172.21.15.111:0/2031119234 shutdown_connections 2024-09-10T23:58:44.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:44.180+0000 7fd676600700 1 -- 172.21.15.111:0/2031119234 wait complete. 2024-09-10T23:58:44.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:43 smithi203 ceph-mon[33225]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:45.039 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:44 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/2423343920' entity='client.admin' 2024-09-10T23:58:45.039 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:44 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/2031119234' entity='client.admin' 2024-09-10T23:58:45.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:44 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/2423343920' entity='client.admin' 2024-09-10T23:58:45.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:44 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/2031119234' entity='client.admin' 2024-09-10T23:58:45.351 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.0', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '03107fbe-6fd0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi111') 2024-09-10T23:58:46.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.076+0000 7fb278e00700 1 -- 172.21.15.111:0/4001558382 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb274100150 msgr2=0x7fb274100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:46.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.076+0000 7fb278e00700 1 --2- 172.21.15.111:0/4001558382 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb274100150 0x7fb274100560 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb264009910 tx=0x7fb264009c20 comp rx=0 tx=0).stop 2024-09-10T23:58:46.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.076+0000 7fb278e00700 1 -- 172.21.15.111:0/4001558382 shutdown_connections 2024-09-10T23:58:46.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.076+0000 7fb278e00700 1 --2- 172.21.15.111:0/4001558382 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb274101350 0x7fb2741017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.076+0000 7fb278e00700 1 --2- 172.21.15.111:0/4001558382 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb274100150 0x7fb274100560 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.076+0000 7fb278e00700 1 -- 172.21.15.111:0/4001558382 >> 172.21.15.111:0/4001558382 conn(0x7fb2740fb6e0 msgr2=0x7fb2740fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:46.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.076+0000 7fb278e00700 1 -- 172.21.15.111:0/4001558382 shutdown_connections 2024-09-10T23:58:46.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.077+0000 7fb278e00700 1 -- 172.21.15.111:0/4001558382 wait complete. 2024-09-10T23:58:46.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.078+0000 7fb278e00700 1 Processor -- start 2024-09-10T23:58:46.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.078+0000 7fb278e00700 1 -- start start 2024-09-10T23:58:46.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.079+0000 7fb278e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb274100150 0x7fb274074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.079+0000 7fb278e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb274101350 0x7fb274073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.079+0000 7fb278e00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb274073680 con 0x7fb274101350 2024-09-10T23:58:46.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.079+0000 7fb278e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2740737c0 con 0x7fb274100150 2024-09-10T23:58:46.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.079+0000 7fb271400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb274101350 0x7fb274073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.079+0000 7fb271400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb274101350 0x7fb274073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:54784/0 (socket says 172.21.15.111:54784) 2024-09-10T23:58:46.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.079+0000 7fb271400700 1 -- 172.21.15.111:0/3105437417 learned_addr learned my addr 172.21.15.111:0/3105437417 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-10T23:58:46.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.079+0000 7fb271e00700 1 --2- 172.21.15.111:0/3105437417 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb274100150 0x7fb274074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.079+0000 7fb271400700 1 -- 172.21.15.111:0/3105437417 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb274100150 msgr2=0x7fb274074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:46.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.079+0000 7fb271400700 1 --2- 172.21.15.111:0/3105437417 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb274100150 0x7fb274074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.079+0000 7fb271400700 1 -- 172.21.15.111:0/3105437417 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2640095f0 con 0x7fb274101350 2024-09-10T23:58:46.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.080+0000 7fb271400700 1 --2- 172.21.15.111:0/3105437417 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb274101350 0x7fb274073140 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb26000c930 tx=0x7fb26000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:46.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.080+0000 7fb26aa00700 1 -- 172.21.15.111:0/3105437417 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb260007ad0 con 0x7fb274101350 2024-09-10T23:58:46.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.080+0000 7fb26aa00700 1 -- 172.21.15.111:0/3105437417 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb26000ce80 con 0x7fb274101350 2024-09-10T23:58:46.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.080+0000 7fb278e00700 1 -- 172.21.15.111:0/3105437417 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb274073aa0 con 0x7fb274101350 2024-09-10T23:58:46.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.080+0000 7fb26aa00700 1 -- 172.21.15.111:0/3105437417 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb260018630 con 0x7fb274101350 2024-09-10T23:58:46.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.080+0000 7fb278e00700 1 -- 172.21.15.111:0/3105437417 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb27419d920 con 0x7fb274101350 2024-09-10T23:58:46.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.081+0000 7fb278e00700 1 -- 172.21.15.111:0/3105437417 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb274108b60 con 0x7fb274101350 2024-09-10T23:58:46.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.083+0000 7fb26aa00700 1 -- 172.21.15.111:0/3105437417 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) v1 ==== 89860+0+0 (secure 0 0 0) 0x7fb260007c30 con 0x7fb274101350 2024-09-10T23:58:46.086 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.084+0000 7fb26aa00700 1 --2- 172.21.15.111:0/3105437417 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb25806c610 0x7fb25806eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:46.086 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.084+0000 7fb26aa00700 1 -- 172.21.15.111:0/3105437417 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7fb26008a660 con 0x7fb274101350 2024-09-10T23:58:46.086 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.084+0000 7fb271e00700 1 --2- 172.21.15.111:0/3105437417 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb25806c610 0x7fb25806eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:46.086 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.085+0000 7fb271e00700 1 --2- 172.21.15.111:0/3105437417 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb25806c610 0x7fb25806eac0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb264005090 tx=0x7fb264005fb0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:46.089 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.088+0000 7fb26aa00700 1 -- 172.21.15.111:0/3105437417 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb260059940 con 0x7fb274101350 2024-09-10T23:58:46.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.296+0000 7fb278e00700 1 -- 172.21.15.111:0/3105437417 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) v1 -- 0x7fb274108cf0 con 0x7fb274101350 2024-09-10T23:58:46.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.301+0000 7fb26aa00700 1 -- 172.21.15.111:0/3105437417 <== mon.0 v2:172.21.15.111:3300/0 7 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb260059940 con 0x7fb274101350 2024-09-10T23:58:46.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.302+0000 7fb26aa00700 1 -- 172.21.15.111:0/3105437417 <== mon.0 v2:172.21.15.111:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v20)=0 v20) v1 ==== 123+0+0 (secure 0 0 0) 0x7fb2600594d0 con 0x7fb274101350 2024-09-10T23:58:46.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.304+0000 7fb278e00700 1 -- 172.21.15.111:0/3105437417 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb25806c610 msgr2=0x7fb25806eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:46.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.304+0000 7fb278e00700 1 --2- 172.21.15.111:0/3105437417 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb25806c610 0x7fb25806eac0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb264005090 tx=0x7fb264005fb0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.304+0000 7fb278e00700 1 -- 172.21.15.111:0/3105437417 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb274101350 msgr2=0x7fb274073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:46.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.304+0000 7fb278e00700 1 --2- 172.21.15.111:0/3105437417 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb274101350 0x7fb274073140 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb26000c930 tx=0x7fb26000cc40 comp rx=0 tx=0).stop 2024-09-10T23:58:46.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.304+0000 7fb278e00700 1 -- 172.21.15.111:0/3105437417 shutdown_connections 2024-09-10T23:58:46.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.304+0000 7fb278e00700 1 --2- 172.21.15.111:0/3105437417 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb25806c610 0x7fb25806eac0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.304+0000 7fb278e00700 1 --2- 172.21.15.111:0/3105437417 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb274100150 0x7fb274074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.304+0000 7fb278e00700 1 --2- 172.21.15.111:0/3105437417 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb274101350 0x7fb274073140 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:46.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.304+0000 7fb278e00700 1 -- 172.21.15.111:0/3105437417 >> 172.21.15.111:0/3105437417 conn(0x7fb2740fb6e0 msgr2=0x7fb274104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:46.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.304+0000 7fb278e00700 1 -- 172.21.15.111:0/3105437417 shutdown_connections 2024-09-10T23:58:46.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:46.304+0000 7fb278e00700 1 -- 172.21.15.111:0/3105437417 wait complete. 2024-09-10T23:58:46.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:46 smithi203 ceph-mon[33225]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:46.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:46 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T23:58:46.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:46 smithi111 ceph-mon[27539]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:46.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:46 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T23:58:47.174 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.0', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '03107fbe-6fd0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi111') 2024-09-10T23:58:47.174 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.0', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '03107fbe-6fd0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi111') 2024-09-10T23:58:47.547 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:47 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/3105437417' entity='client.admin' 2024-09-10T23:58:47.547 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:47 smithi111 ceph-mon[27539]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:47.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:47 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/3105437417' entity='client.admin' 2024-09-10T23:58:47.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:47 smithi203 ceph-mon[33225]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:49.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:48 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/3805831465' entity='client.admin' 2024-09-10T23:58:49.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:48 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/3805831465' entity='client.admin' 2024-09-10T23:58:50.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:49 smithi203 ceph-mon[33225]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:50.049 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:49 smithi111 ceph-mon[27539]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:50.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.545+0000 7f2509800700 1 -- 172.21.15.111:0/1377877860 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2504074d80 msgr2=0x7f25040731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:50.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.545+0000 7f2509800700 1 --2- 172.21.15.111:0/1377877860 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2504074d80 0x7f25040731e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009940 tx=0x7f24f4009c50 comp rx=0 tx=0).stop 2024-09-10T23:58:50.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.545+0000 7f2509800700 1 -- 172.21.15.111:0/1377877860 shutdown_connections 2024-09-10T23:58:50.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.545+0000 7f2509800700 1 --2- 172.21.15.111:0/1377877860 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25040737b0 0x7f2504073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:50.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.545+0000 7f2509800700 1 --2- 172.21.15.111:0/1377877860 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2504074d80 0x7f25040731e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:50.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.545+0000 7f2509800700 1 -- 172.21.15.111:0/1377877860 >> 172.21.15.111:0/1377877860 conn(0x7f25040fb6e0 msgr2=0x7f25040fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:50.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.545+0000 7f2509800700 1 -- 172.21.15.111:0/1377877860 shutdown_connections 2024-09-10T23:58:50.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.545+0000 7f2509800700 1 -- 172.21.15.111:0/1377877860 wait complete. 2024-09-10T23:58:50.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.546+0000 7f2509800700 1 Processor -- start 2024-09-10T23:58:50.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.546+0000 7f2509800700 1 -- start start 2024-09-10T23:58:50.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.546+0000 7f2509800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25040737b0 0x7f2504197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:50.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.546+0000 7f2509800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2504074d80 0x7f2504198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:50.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.546+0000 7f2509800700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2504198670 con 0x7f2504074d80 2024-09-10T23:58:50.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.546+0000 7f2509800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25041987b0 con 0x7f25040737b0 2024-09-10T23:58:50.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.547+0000 7f2502000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2504074d80 0x7f2504198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:50.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.547+0000 7f2502000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2504074d80 0x7f2504198050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:54800/0 (socket says 172.21.15.111:54800) 2024-09-10T23:58:50.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.547+0000 7f2502000700 1 -- 172.21.15.111:0/3805831465 learned_addr learned my addr 172.21.15.111:0/3805831465 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-10T23:58:50.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.547+0000 7f2502a00700 1 --2- 172.21.15.111:0/3805831465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25040737b0 0x7f2504197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:50.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.547+0000 7f2502000700 1 -- 172.21.15.111:0/3805831465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25040737b0 msgr2=0x7f2504197b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:50.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.547+0000 7f2502000700 1 --2- 172.21.15.111:0/3805831465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25040737b0 0x7f2504197b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:50.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.547+0000 7f2502000700 1 -- 172.21.15.111:0/3805831465 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f40095f0 con 0x7f2504074d80 2024-09-10T23:58:50.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.548+0000 7f2502000700 1 --2- 172.21.15.111:0/3805831465 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2504074d80 0x7f2504198050 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f24f000d900 tx=0x7f24f000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:50.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.548+0000 7f24fb400700 1 -- 172.21.15.111:0/3805831465 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24f00041f0 con 0x7f2504074d80 2024-09-10T23:58:50.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.548+0000 7f24fb400700 1 -- 172.21.15.111:0/3805831465 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f24f0004ce0 con 0x7f2504074d80 2024-09-10T23:58:50.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.548+0000 7f2509800700 1 -- 172.21.15.111:0/3805831465 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f250419d260 con 0x7f2504074d80 2024-09-10T23:58:50.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.548+0000 7f24fb400700 1 -- 172.21.15.111:0/3805831465 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24f000b750 con 0x7f2504074d80 2024-09-10T23:58:50.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.548+0000 7f2509800700 1 -- 172.21.15.111:0/3805831465 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f250419d7b0 con 0x7f2504074d80 2024-09-10T23:58:50.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.549+0000 7f2509800700 1 -- 172.21.15.111:0/3805831465 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f250410ae90 con 0x7f2504074d80 2024-09-10T23:58:50.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.550+0000 7f24fb400700 1 -- 172.21.15.111:0/3805831465 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) v1 ==== 89860+0+0 (secure 0 0 0) 0x7f24f0004e50 con 0x7f2504074d80 2024-09-10T23:58:50.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.551+0000 7f24fb400700 1 --2- 172.21.15.111:0/3805831465 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f24e806c610 0x7f24e806eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:50.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.551+0000 7f24fb400700 1 -- 172.21.15.111:0/3805831465 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f24f008a580 con 0x7f2504074d80 2024-09-10T23:58:50.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.552+0000 7f2502a00700 1 --2- 172.21.15.111:0/3805831465 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f24e806c610 0x7f24e806eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:50.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.552+0000 7f2502a00700 1 --2- 172.21.15.111:0/3805831465 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f24e806c610 0x7f24e806eac0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009910 tx=0x7f24f4005ab0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:50.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.556+0000 7f24fb400700 1 -- 172.21.15.111:0/3805831465 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f24f0059900 con 0x7f2504074d80 2024-09-10T23:58:50.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.766+0000 7f2509800700 1 -- 172.21.15.111:0/3805831465 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) v1 -- 0x7f250410b050 con 0x7f2504074d80 2024-09-10T23:58:50.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.772+0000 7f24fb400700 1 -- 172.21.15.111:0/3805831465 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v21)=0 v21) v1 ==== 106+0+0 (secure 0 0 0) 0x7f24f0016020 con 0x7f2504074d80 2024-09-10T23:58:50.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.775+0000 7f2509800700 1 -- 172.21.15.111:0/3805831465 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f24e806c610 msgr2=0x7f24e806eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:50.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.775+0000 7f2509800700 1 --2- 172.21.15.111:0/3805831465 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f24e806c610 0x7f24e806eac0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009910 tx=0x7f24f4005ab0 comp rx=0 tx=0).stop 2024-09-10T23:58:50.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.775+0000 7f2509800700 1 -- 172.21.15.111:0/3805831465 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2504074d80 msgr2=0x7f2504198050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:50.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.775+0000 7f2509800700 1 --2- 172.21.15.111:0/3805831465 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2504074d80 0x7f2504198050 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f24f000d900 tx=0x7f24f000dc10 comp rx=0 tx=0).stop 2024-09-10T23:58:50.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.775+0000 7f2509800700 1 -- 172.21.15.111:0/3805831465 shutdown_connections 2024-09-10T23:58:50.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.775+0000 7f2509800700 1 --2- 172.21.15.111:0/3805831465 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f24e806c610 0x7f24e806eac0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:50.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.775+0000 7f2509800700 1 --2- 172.21.15.111:0/3805831465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25040737b0 0x7f2504197b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:50.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.775+0000 7f2509800700 1 --2- 172.21.15.111:0/3805831465 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2504074d80 0x7f2504198050 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:50.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.775+0000 7f2509800700 1 -- 172.21.15.111:0/3805831465 >> 172.21.15.111:0/3805831465 conn(0x7f25040fb6e0 msgr2=0x7f2504105f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:50.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.775+0000 7f2509800700 1 -- 172.21.15.111:0/3805831465 shutdown_connections 2024-09-10T23:58:50.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:47.775+0000 7f2509800700 1 -- 172.21.15.111:0/3805831465 wait complete. 2024-09-10T23:58:51.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.520+0000 7fe7fdc00700 1 -- 172.21.15.111:0/808202949 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe7f8103580 msgr2=0x7fe7f81039d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:51.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.520+0000 7fe7fdc00700 1 --2- 172.21.15.111:0/808202949 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe7f8103580 0x7fe7f81039d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4009910 tx=0x7fe7e4009c20 comp rx=0 tx=0).stop 2024-09-10T23:58:51.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.520+0000 7fe7fdc00700 1 -- 172.21.15.111:0/808202949 shutdown_connections 2024-09-10T23:58:51.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.520+0000 7fe7fdc00700 1 --2- 172.21.15.111:0/808202949 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe7f8103580 0x7fe7f81039d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:51.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.520+0000 7fe7fdc00700 1 --2- 172.21.15.111:0/808202949 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7f8102380 0x7fe7f8102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:51.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.520+0000 7fe7fdc00700 1 -- 172.21.15.111:0/808202949 >> 172.21.15.111:0/808202949 conn(0x7fe7f80fd930 msgr2=0x7fe7f80ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:51.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.520+0000 7fe7fdc00700 1 -- 172.21.15.111:0/808202949 shutdown_connections 2024-09-10T23:58:51.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.520+0000 7fe7fdc00700 1 -- 172.21.15.111:0/808202949 wait complete. 2024-09-10T23:58:51.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.521+0000 7fe7fdc00700 1 Processor -- start 2024-09-10T23:58:51.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.521+0000 7fe7fdc00700 1 -- start start 2024-09-10T23:58:51.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.521+0000 7fe7fdc00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe7f8102380 0x7fe7f8197b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:51.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.521+0000 7fe7fdc00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7f8103580 0x7fe7f81980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:51.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.521+0000 7fe7fdc00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f81986e0 con 0x7fe7f8102380 2024-09-10T23:58:51.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.521+0000 7fe7fdc00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f8198820 con 0x7fe7f8103580 2024-09-10T23:58:51.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.522+0000 7fe7f6a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe7f8102380 0x7fe7f8197b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:51.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.522+0000 7fe7f6a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe7f8102380 0x7fe7f8197b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40204/0 (socket says 172.21.15.111:40204) 2024-09-10T23:58:51.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.522+0000 7fe7f6a00700 1 -- 172.21.15.111:0/2409622222 learned_addr learned my addr 172.21.15.111:0/2409622222 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-10T23:58:51.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.522+0000 7fe7f6000700 1 --2- 172.21.15.111:0/2409622222 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7f8103580 0x7fe7f81980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:51.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.522+0000 7fe7f6a00700 1 -- 172.21.15.111:0/2409622222 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7f8103580 msgr2=0x7fe7f81980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:51.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.522+0000 7fe7f6a00700 1 --2- 172.21.15.111:0/2409622222 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7f8103580 0x7fe7f81980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:51.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.522+0000 7fe7f6a00700 1 -- 172.21.15.111:0/2409622222 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e40095f0 con 0x7fe7f8102380 2024-09-10T23:58:51.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.522+0000 7fe7f6a00700 1 --2- 172.21.15.111:0/2409622222 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe7f8102380 0x7fe7f8197b80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe7e800d900 tx=0x7fe7e800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:51.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.523+0000 7fe7ef400700 1 -- 172.21.15.111:0/2409622222 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7e800b920 con 0x7fe7f8102380 2024-09-10T23:58:51.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.523+0000 7fe7ef400700 1 -- 172.21.15.111:0/2409622222 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe7e8010460 con 0x7fe7f8102380 2024-09-10T23:58:51.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.523+0000 7fe7ef400700 1 -- 172.21.15.111:0/2409622222 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7e800f590 con 0x7fe7f8102380 2024-09-10T23:58:51.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.523+0000 7fe7fdc00700 1 -- 172.21.15.111:0/2409622222 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f819d2d0 con 0x7fe7f8102380 2024-09-10T23:58:51.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.523+0000 7fe7fdc00700 1 -- 172.21.15.111:0/2409622222 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f819d820 con 0x7fe7f8102380 2024-09-10T23:58:51.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.524+0000 7fe7fdc00700 1 -- 172.21.15.111:0/2409622222 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f810aed0 con 0x7fe7f8102380 2024-09-10T23:58:51.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.525+0000 7fe7ef400700 1 -- 172.21.15.111:0/2409622222 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) v1 ==== 89860+0+0 (secure 0 0 0) 0x7fe7e80105d0 con 0x7fe7f8102380 2024-09-10T23:58:51.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.525+0000 7fe7ef400700 1 --2- 172.21.15.111:0/2409622222 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fe7dc06c610 0x7fe7dc06eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:51.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.525+0000 7fe7ef400700 1 -- 172.21.15.111:0/2409622222 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7fe7e808a2f0 con 0x7fe7f8102380 2024-09-10T23:58:51.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.526+0000 7fe7f6000700 1 --2- 172.21.15.111:0/2409622222 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fe7dc06c610 0x7fe7dc06eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:51.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.526+0000 7fe7f6000700 1 --2- 172.21.15.111:0/2409622222 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fe7dc06c610 0x7fe7dc06eac0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4006010 tx=0x7fe7e400b560 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:51.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.530+0000 7fe7ef400700 1 -- 172.21.15.111:0/2409622222 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe7e80595d0 con 0x7fe7f8102380 2024-09-10T23:58:51.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.736+0000 7fe7fdc00700 1 -- 172.21.15.111:0/2409622222 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) v1 -- 0x7fe7f819e000 con 0x7fe7f8102380 2024-09-10T23:58:51.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.741+0000 7fe7ef400700 1 -- 172.21.15.111:0/2409622222 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe7e80160c0 con 0x7fe7f8102380 2024-09-10T23:58:51.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.743+0000 7fe7fdc00700 1 -- 172.21.15.111:0/2409622222 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fe7dc06c610 msgr2=0x7fe7dc06eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:51.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.743+0000 7fe7fdc00700 1 --2- 172.21.15.111:0/2409622222 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fe7dc06c610 0x7fe7dc06eac0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4006010 tx=0x7fe7e400b560 comp rx=0 tx=0).stop 2024-09-10T23:58:51.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.743+0000 7fe7fdc00700 1 -- 172.21.15.111:0/2409622222 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe7f8102380 msgr2=0x7fe7f8197b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:51.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.743+0000 7fe7fdc00700 1 --2- 172.21.15.111:0/2409622222 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe7f8102380 0x7fe7f8197b80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe7e800d900 tx=0x7fe7e800dc10 comp rx=0 tx=0).stop 2024-09-10T23:58:51.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.743+0000 7fe7fdc00700 1 -- 172.21.15.111:0/2409622222 shutdown_connections 2024-09-10T23:58:51.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.743+0000 7fe7fdc00700 1 --2- 172.21.15.111:0/2409622222 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fe7dc06c610 0x7fe7dc06eac0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:51.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.743+0000 7fe7fdc00700 1 --2- 172.21.15.111:0/2409622222 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe7f8102380 0x7fe7f8197b80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:51.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.743+0000 7fe7fdc00700 1 --2- 172.21.15.111:0/2409622222 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7f8103580 0x7fe7f81980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:51.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.743+0000 7fe7fdc00700 1 -- 172.21.15.111:0/2409622222 >> 172.21.15.111:0/2409622222 conn(0x7fe7f80fd930 msgr2=0x7fe7f81067b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:51.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.743+0000 7fe7fdc00700 1 -- 172.21.15.111:0/2409622222 shutdown_connections 2024-09-10T23:58:51.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:50.743+0000 7fe7fdc00700 1 -- 172.21.15.111:0/2409622222 wait complete. 2024-09-10T23:58:51.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.823+0000 7f2a21c00700 1 -- 172.21.15.111:0/3988147296 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a1c1033e0 msgr2=0x7f2a1c103830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:51.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.823+0000 7f2a21c00700 1 --2- 172.21.15.111:0/3988147296 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a1c1033e0 0x7f2a1c103830 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2a08009910 tx=0x7f2a08009c20 comp rx=0 tx=0).stop 2024-09-10T23:58:51.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.823+0000 7f2a21c00700 1 -- 172.21.15.111:0/3988147296 shutdown_connections 2024-09-10T23:58:51.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.823+0000 7f2a21c00700 1 --2- 172.21.15.111:0/3988147296 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a1c1033e0 0x7f2a1c103830 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:51.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.823+0000 7f2a21c00700 1 --2- 172.21.15.111:0/3988147296 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a1c1021e0 0x7f2a1c1025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:51.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.823+0000 7f2a21c00700 1 -- 172.21.15.111:0/3988147296 >> 172.21.15.111:0/3988147296 conn(0x7f2a1c0fd8d0 msgr2=0x7f2a1c0ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:51.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.823+0000 7f2a21c00700 1 -- 172.21.15.111:0/3988147296 shutdown_connections 2024-09-10T23:58:51.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.823+0000 7f2a21c00700 1 -- 172.21.15.111:0/3988147296 wait complete. 2024-09-10T23:58:51.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.824+0000 7f2a21c00700 1 Processor -- start 2024-09-10T23:58:51.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.824+0000 7f2a21c00700 1 -- start start 2024-09-10T23:58:51.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.824+0000 7f2a21c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a1c1021e0 0x7f2a1c1979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:51.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.824+0000 7f2a21c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a1c1033e0 0x7f2a1c197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:51.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.824+0000 7f2a21c00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c198540 con 0x7f2a1c1033e0 2024-09-10T23:58:51.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.824+0000 7f2a21c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c198680 con 0x7f2a1c1021e0 2024-09-10T23:58:51.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.824+0000 7f2a1b400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a1c1033e0 0x7f2a1c197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:51.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.824+0000 7f2a1b400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a1c1033e0 0x7f2a1c197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40248/0 (socket says 172.21.15.111:40248) 2024-09-10T23:58:51.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.825+0000 7f2a1b400700 1 -- 172.21.15.111:0/1144413933 learned_addr learned my addr 172.21.15.111:0/1144413933 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-10T23:58:51.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.825+0000 7f2a1be00700 1 --2- 172.21.15.111:0/1144413933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a1c1021e0 0x7f2a1c1979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:51.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.825+0000 7f2a1b400700 1 -- 172.21.15.111:0/1144413933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a1c1021e0 msgr2=0x7f2a1c1979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:51.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.825+0000 7f2a1b400700 1 --2- 172.21.15.111:0/1144413933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a1c1021e0 0x7f2a1c1979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:51.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.825+0000 7f2a1b400700 1 -- 172.21.15.111:0/1144413933 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a080095f0 con 0x7f2a1c1033e0 2024-09-10T23:58:51.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.825+0000 7f2a1b400700 1 --2- 172.21.15.111:0/1144413933 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a1c1033e0 0x7f2a1c197f20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2a08005b40 tx=0x7f2a0800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:51.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.825+0000 7f2a18c00700 1 -- 172.21.15.111:0/1144413933 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a0801d070 con 0x7f2a1c1033e0 2024-09-10T23:58:51.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.826+0000 7f2a18c00700 1 -- 172.21.15.111:0/1144413933 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2a0800f460 con 0x7f2a1c1033e0 2024-09-10T23:58:51.829 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.826+0000 7f2a21c00700 1 -- 172.21.15.111:0/1144413933 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a1c19d0d0 con 0x7f2a1c1033e0 2024-09-10T23:58:51.829 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.826+0000 7f2a18c00700 1 -- 172.21.15.111:0/1144413933 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a08021620 con 0x7f2a1c1033e0 2024-09-10T23:58:51.829 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.826+0000 7f2a21c00700 1 -- 172.21.15.111:0/1144413933 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a1c19d5c0 con 0x7f2a1c1033e0 2024-09-10T23:58:51.829 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.827+0000 7f2a21c00700 1 -- 172.21.15.111:0/1144413933 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a1c10ad30 con 0x7f2a1c1033e0 2024-09-10T23:58:51.829 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.828+0000 7f2a18c00700 1 -- 172.21.15.111:0/1144413933 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) v1 ==== 89860+0+0 (secure 0 0 0) 0x7f2a0800fa40 con 0x7f2a1c1033e0 2024-09-10T23:58:51.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.829+0000 7f2a18c00700 1 --2- 172.21.15.111:0/1144413933 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f2a0006c610 0x7f2a0006eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:51.831 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:51 smithi111 ceph-mon[27539]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:51.831 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:51 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/2409622222' entity='client.admin' 2024-09-10T23:58:51.831 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:51 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/1688366960' entity='client.admin' 2024-09-10T23:58:51.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.830+0000 7f2a18c00700 1 -- 172.21.15.111:0/1144413933 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f2a0808b960 con 0x7f2a1c1033e0 2024-09-10T23:58:51.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.830+0000 7f2a1be00700 1 --2- 172.21.15.111:0/1144413933 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f2a0006c610 0x7f2a0006eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:51.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.830+0000 7f2a1be00700 1 --2- 172.21.15.111:0/1144413933 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f2a0006c610 0x7f2a0006eac0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c103240 tx=0x7f2a0c007400 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:51.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.834+0000 7f2a18c00700 1 -- 172.21.15.111:0/1144413933 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2a0805ac40 con 0x7f2a1c1033e0 2024-09-10T23:58:52.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.042+0000 7f2a21c00700 1 -- 172.21.15.111:0/1144413933 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) v1 -- 0x7f2a1c10af20 con 0x7f2a1c1033e0 2024-09-10T23:58:52.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:51 smithi203 ceph-mon[33225]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:52.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:51 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/2409622222' entity='client.admin' 2024-09-10T23:58:52.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:51 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/1688366960' entity='client.admin' 2024-09-10T23:58:52.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.047+0000 7f2a18c00700 1 -- 172.21.15.111:0/1144413933 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v24)=0 v24) v1 ==== 121+0+0 (secure 0 0 0) 0x7f2a0805a7d0 con 0x7f2a1c1033e0 2024-09-10T23:58:52.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.050+0000 7f2a21c00700 1 -- 172.21.15.111:0/1144413933 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f2a0006c610 msgr2=0x7f2a0006eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:52.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.050+0000 7f2a21c00700 1 --2- 172.21.15.111:0/1144413933 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f2a0006c610 0x7f2a0006eac0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c103240 tx=0x7f2a0c007400 comp rx=0 tx=0).stop 2024-09-10T23:58:52.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.050+0000 7f2a21c00700 1 -- 172.21.15.111:0/1144413933 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a1c1033e0 msgr2=0x7f2a1c197f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:52.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.050+0000 7f2a21c00700 1 --2- 172.21.15.111:0/1144413933 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a1c1033e0 0x7f2a1c197f20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2a08005b40 tx=0x7f2a0800bd70 comp rx=0 tx=0).stop 2024-09-10T23:58:52.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.050+0000 7f2a21c00700 1 -- 172.21.15.111:0/1144413933 shutdown_connections 2024-09-10T23:58:52.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.050+0000 7f2a21c00700 1 --2- 172.21.15.111:0/1144413933 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f2a0006c610 0x7f2a0006eac0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:52.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.050+0000 7f2a21c00700 1 --2- 172.21.15.111:0/1144413933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a1c1021e0 0x7f2a1c1979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:52.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.050+0000 7f2a21c00700 1 --2- 172.21.15.111:0/1144413933 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a1c1033e0 0x7f2a1c197f20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:52.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.050+0000 7f2a21c00700 1 -- 172.21.15.111:0/1144413933 >> 172.21.15.111:0/1144413933 conn(0x7f2a1c0fd8d0 msgr2=0x7f2a1c106610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:52.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.050+0000 7f2a21c00700 1 -- 172.21.15.111:0/1144413933 shutdown_connections 2024-09-10T23:58:52.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.050+0000 7f2a21c00700 1 -- 172.21.15.111:0/1144413933 wait complete. 2024-09-10T23:58:52.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.267+0000 7fba96e00700 1 -- 172.21.15.111:0/3034402220 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba90101350 msgr2=0x7fba901017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:52.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.267+0000 7fba96e00700 1 --2- 172.21.15.111:0/3034402220 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba90101350 0x7fba901017a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fba7c009910 tx=0x7fba7c009c20 comp rx=0 tx=0).stop 2024-09-10T23:58:52.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.267+0000 7fba96e00700 1 -- 172.21.15.111:0/3034402220 shutdown_connections 2024-09-10T23:58:52.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.267+0000 7fba96e00700 1 --2- 172.21.15.111:0/3034402220 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba90101350 0x7fba901017a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:52.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.267+0000 7fba96e00700 1 --2- 172.21.15.111:0/3034402220 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba90100150 0x7fba90100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:52.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.267+0000 7fba96e00700 1 -- 172.21.15.111:0/3034402220 >> 172.21.15.111:0/3034402220 conn(0x7fba900fb6e0 msgr2=0x7fba900fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:52.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.267+0000 7fba96e00700 1 -- 172.21.15.111:0/3034402220 shutdown_connections 2024-09-10T23:58:52.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.267+0000 7fba96e00700 1 -- 172.21.15.111:0/3034402220 wait complete. 2024-09-10T23:58:52.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.268+0000 7fba96e00700 1 Processor -- start 2024-09-10T23:58:52.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.268+0000 7fba96e00700 1 -- start start 2024-09-10T23:58:52.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.268+0000 7fba96e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba90100150 0x7fba90197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:52.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.268+0000 7fba96e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba90101350 0x7fba901980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:52.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.268+0000 7fba96e00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba901986d0 con 0x7fba90100150 2024-09-10T23:58:52.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.268+0000 7fba96e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba90198810 con 0x7fba90101350 2024-09-10T23:58:52.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.269+0000 7fba8fe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba90100150 0x7fba90197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:52.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.269+0000 7fba8fe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba90100150 0x7fba90197b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40272/0 (socket says 172.21.15.111:40272) 2024-09-10T23:58:52.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.269+0000 7fba8fe00700 1 -- 172.21.15.111:0/1815929647 learned_addr learned my addr 172.21.15.111:0/1815929647 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-10T23:58:52.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.269+0000 7fba8f400700 1 --2- 172.21.15.111:0/1815929647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba90101350 0x7fba901980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:52.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.269+0000 7fba8fe00700 1 -- 172.21.15.111:0/1815929647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba90101350 msgr2=0x7fba901980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:52.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.269+0000 7fba8fe00700 1 --2- 172.21.15.111:0/1815929647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba90101350 0x7fba901980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:52.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.269+0000 7fba8fe00700 1 -- 172.21.15.111:0/1815929647 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c0095f0 con 0x7fba90100150 2024-09-10T23:58:52.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.269+0000 7fba8fe00700 1 --2- 172.21.15.111:0/1815929647 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba90100150 0x7fba90197b70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fba8000d900 tx=0x7fba8000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:52.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.270+0000 7fba8cc00700 1 -- 172.21.15.111:0/1815929647 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba800041f0 con 0x7fba90100150 2024-09-10T23:58:52.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.270+0000 7fba8cc00700 1 -- 172.21.15.111:0/1815929647 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fba80004350 con 0x7fba90100150 2024-09-10T23:58:52.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.270+0000 7fba96e00700 1 -- 172.21.15.111:0/1815929647 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba9019d2c0 con 0x7fba90100150 2024-09-10T23:58:52.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.270+0000 7fba8cc00700 1 -- 172.21.15.111:0/1815929647 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba80003d20 con 0x7fba90100150 2024-09-10T23:58:52.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.270+0000 7fba96e00700 1 -- 172.21.15.111:0/1815929647 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba9019d810 con 0x7fba90100150 2024-09-10T23:58:52.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.271+0000 7fba96e00700 1 -- 172.21.15.111:0/1815929647 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba90105430 con 0x7fba90100150 2024-09-10T23:58:52.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.272+0000 7fba8cc00700 1 -- 172.21.15.111:0/1815929647 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) v1 ==== 89860+0+0 (secure 0 0 0) 0x7fba80009730 con 0x7fba90100150 2024-09-10T23:58:52.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.273+0000 7fba8cc00700 1 --2- 172.21.15.111:0/1815929647 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fba7406c610 0x7fba7406eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:52.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.273+0000 7fba8cc00700 1 -- 172.21.15.111:0/1815929647 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7fba8008a660 con 0x7fba90100150 2024-09-10T23:58:52.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.273+0000 7fba8f400700 1 --2- 172.21.15.111:0/1815929647 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fba7406c610 0x7fba7406eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:52.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.274+0000 7fba8f400700 1 --2- 172.21.15.111:0/1815929647 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fba7406c610 0x7fba7406eac0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fba7c006010 tx=0x7fba7c00b560 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:52.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.277+0000 7fba8cc00700 1 -- 172.21.15.111:0/1815929647 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fba800598c0 con 0x7fba90100150 2024-09-10T23:58:52.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.482+0000 7fba96e00700 1 -- 172.21.15.111:0/1815929647 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) v1 -- 0x7fba9002cc30 con 0x7fba90100150 2024-09-10T23:58:52.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.488+0000 7fba8cc00700 1 -- 172.21.15.111:0/1815929647 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v25)=0 v25) v1 ==== 120+0+0 (secure 0 0 0) 0x7fba80003e80 con 0x7fba90100150 2024-09-10T23:58:52.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.491+0000 7fba96e00700 1 -- 172.21.15.111:0/1815929647 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fba7406c610 msgr2=0x7fba7406eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:52.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.491+0000 7fba96e00700 1 --2- 172.21.15.111:0/1815929647 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fba7406c610 0x7fba7406eac0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fba7c006010 tx=0x7fba7c00b560 comp rx=0 tx=0).stop 2024-09-10T23:58:52.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.491+0000 7fba96e00700 1 -- 172.21.15.111:0/1815929647 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba90100150 msgr2=0x7fba90197b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:52.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.491+0000 7fba96e00700 1 --2- 172.21.15.111:0/1815929647 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba90100150 0x7fba90197b70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fba8000d900 tx=0x7fba8000dc10 comp rx=0 tx=0).stop 2024-09-10T23:58:52.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.491+0000 7fba96e00700 1 -- 172.21.15.111:0/1815929647 shutdown_connections 2024-09-10T23:58:52.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.491+0000 7fba96e00700 1 --2- 172.21.15.111:0/1815929647 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fba7406c610 0x7fba7406eac0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:52.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.491+0000 7fba96e00700 1 --2- 172.21.15.111:0/1815929647 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba90100150 0x7fba90197b70 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:52.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.491+0000 7fba96e00700 1 --2- 172.21.15.111:0/1815929647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba90101350 0x7fba901980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:52.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.491+0000 7fba96e00700 1 -- 172.21.15.111:0/1815929647 >> 172.21.15.111:0/1815929647 conn(0x7fba900fb6e0 msgr2=0x7fba90102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:52.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.491+0000 7fba96e00700 1 -- 172.21.15.111:0/1815929647 shutdown_connections 2024-09-10T23:58:52.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:52.491+0000 7fba96e00700 1 -- 172.21.15.111:0/1815929647 wait complete. 2024-09-10T23:58:52.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.352+0000 7f40f1400700 1 -- 172.21.15.111:0/3601927574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f40ec100150 msgr2=0x7f40ec100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:52.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.352+0000 7f40f1400700 1 --2- 172.21.15.111:0/3601927574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f40ec100150 0x7f40ec100560 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f40dc009910 tx=0x7f40dc009c20 comp rx=0 tx=0).stop 2024-09-10T23:58:52.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.352+0000 7f40f1400700 1 -- 172.21.15.111:0/3601927574 shutdown_connections 2024-09-10T23:58:52.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.352+0000 7f40f1400700 1 --2- 172.21.15.111:0/3601927574 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40ec101350 0x7f40ec1017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:52.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.352+0000 7f40f1400700 1 --2- 172.21.15.111:0/3601927574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f40ec100150 0x7f40ec100560 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:52.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.352+0000 7f40f1400700 1 -- 172.21.15.111:0/3601927574 >> 172.21.15.111:0/3601927574 conn(0x7f40ec0fb6e0 msgr2=0x7f40ec0fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:52.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.352+0000 7f40f1400700 1 -- 172.21.15.111:0/3601927574 shutdown_connections 2024-09-10T23:58:52.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.352+0000 7f40f1400700 1 -- 172.21.15.111:0/3601927574 wait complete. 2024-09-10T23:58:52.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.353+0000 7f40f1400700 1 Processor -- start 2024-09-10T23:58:52.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.353+0000 7f40f1400700 1 -- start start 2024-09-10T23:58:52.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.353+0000 7f40f1400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f40ec100150 0x7f40ec197ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:52.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.353+0000 7f40f1400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40ec101350 0x7f40ec1980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:52.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.353+0000 7f40f1400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec198700 con 0x7f40ec100150 2024-09-10T23:58:52.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.353+0000 7f40f1400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec198840 con 0x7f40ec101350 2024-09-10T23:58:52.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.353+0000 7f40ea800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f40ec100150 0x7f40ec197ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:52.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.353+0000 7f40ea800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f40ec100150 0x7f40ec197ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40236/0 (socket says 172.21.15.111:40236) 2024-09-10T23:58:52.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.353+0000 7f40ea800700 1 -- 172.21.15.111:0/1688366960 learned_addr learned my addr 172.21.15.111:0/1688366960 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-10T23:58:52.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.354+0000 7f40ea800700 1 -- 172.21.15.111:0/1688366960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40ec101350 msgr2=0x7f40ec1980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:52.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.354+0000 7f40ea800700 1 --2- 172.21.15.111:0/1688366960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40ec101350 0x7f40ec1980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:52.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.354+0000 7f40ea800700 1 -- 172.21.15.111:0/1688366960 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40dc0095f0 con 0x7f40ec100150 2024-09-10T23:58:52.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.354+0000 7f40ea800700 1 --2- 172.21.15.111:0/1688366960 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f40ec100150 0x7f40ec197ba0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00bda0 tx=0x7f40dc00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:52.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.354+0000 7f40e3400700 1 -- 172.21.15.111:0/1688366960 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40dc01d070 con 0x7f40ec100150 2024-09-10T23:58:52.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.354+0000 7f40e3400700 1 -- 172.21.15.111:0/1688366960 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f40dc00f460 con 0x7f40ec100150 2024-09-10T23:58:52.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.354+0000 7f40f1400700 1 -- 172.21.15.111:0/1688366960 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40ec19d290 con 0x7f40ec100150 2024-09-10T23:58:52.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.354+0000 7f40e3400700 1 -- 172.21.15.111:0/1688366960 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40dc021640 con 0x7f40ec100150 2024-09-10T23:58:52.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.354+0000 7f40f1400700 1 -- 172.21.15.111:0/1688366960 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40ec19d780 con 0x7f40ec100150 2024-09-10T23:58:52.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.355+0000 7f40f1400700 1 -- 172.21.15.111:0/1688366960 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40ec105430 con 0x7f40ec100150 2024-09-10T23:58:52.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.356+0000 7f40e3400700 1 -- 172.21.15.111:0/1688366960 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) v1 ==== 89860+0+0 (secure 0 0 0) 0x7f40dc00f5d0 con 0x7f40ec100150 2024-09-10T23:58:52.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.357+0000 7f40e3400700 1 --2- 172.21.15.111:0/1688366960 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f40d006c600 0x7f40d006eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:52.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.357+0000 7f40e3400700 1 -- 172.21.15.111:0/1688366960 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f40dc08ba00 con 0x7f40ec100150 2024-09-10T23:58:52.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.357+0000 7f40e9e00700 1 --2- 172.21.15.111:0/1688366960 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f40d006c600 0x7f40d006eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:52.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.358+0000 7f40e9e00700 1 --2- 172.21.15.111:0/1688366960 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f40d006c600 0x7f40d006eab0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f40d8005d90 tx=0x7f40d8005d00 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:52.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.361+0000 7f40e3400700 1 -- 172.21.15.111:0/1688366960 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f40dc05ac60 con 0x7f40ec100150 2024-09-10T23:58:52.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.582+0000 7f40f1400700 1 -- 172.21.15.111:0/1688366960 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) v1 -- 0x7f40ec02cc30 con 0x7f40ec100150 2024-09-10T23:58:52.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.587+0000 7f40e3400700 1 -- 172.21.15.111:0/1688366960 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v23)=0 v23) v1 ==== 121+0+0 (secure 0 0 0) 0x7f40dc0260c0 con 0x7f40ec100150 2024-09-10T23:58:52.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.589+0000 7f40f1400700 1 -- 172.21.15.111:0/1688366960 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f40d006c600 msgr2=0x7f40d006eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:52.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.589+0000 7f40f1400700 1 --2- 172.21.15.111:0/1688366960 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f40d006c600 0x7f40d006eab0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f40d8005d90 tx=0x7f40d8005d00 comp rx=0 tx=0).stop 2024-09-10T23:58:52.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.589+0000 7f40f1400700 1 -- 172.21.15.111:0/1688366960 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f40ec100150 msgr2=0x7f40ec197ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:52.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.589+0000 7f40f1400700 1 --2- 172.21.15.111:0/1688366960 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f40ec100150 0x7f40ec197ba0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00bda0 tx=0x7f40dc00be80 comp rx=0 tx=0).stop 2024-09-10T23:58:52.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.590+0000 7f40f1400700 1 -- 172.21.15.111:0/1688366960 shutdown_connections 2024-09-10T23:58:52.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.590+0000 7f40f1400700 1 --2- 172.21.15.111:0/1688366960 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f40d006c600 0x7f40d006eab0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:52.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.590+0000 7f40f1400700 1 --2- 172.21.15.111:0/1688366960 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f40ec100150 0x7f40ec197ba0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:52.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.590+0000 7f40f1400700 1 --2- 172.21.15.111:0/1688366960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40ec101350 0x7f40ec1980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:52.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.590+0000 7f40f1400700 1 -- 172.21.15.111:0/1688366960 >> 172.21.15.111:0/1688366960 conn(0x7f40ec0fb6e0 msgr2=0x7f40ec102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:52.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.590+0000 7f40f1400700 1 -- 172.21.15.111:0/1688366960 shutdown_connections 2024-09-10T23:58:52.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:51.590+0000 7f40f1400700 1 -- 172.21.15.111:0/1688366960 wait complete. 2024-09-10T23:58:53.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:53 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/1144413933' entity='client.admin' 2024-09-10T23:58:53.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:53 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/1815929647' entity='client.admin' 2024-09-10T23:58:53.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:53 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/1144413933' entity='client.admin' 2024-09-10T23:58:53.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:53 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/1815929647' entity='client.admin' 2024-09-10T23:58:53.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.942+0000 7ff933000700 1 -- 172.21.15.111:0/1695639753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff92c101370 msgr2=0x7ff92c1017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:53.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.942+0000 7ff933000700 1 --2- 172.21.15.111:0/1695639753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff92c101370 0x7ff92c1017c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff918009910 tx=0x7ff918009c20 comp rx=0 tx=0).stop 2024-09-10T23:58:53.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.942+0000 7ff933000700 1 -- 172.21.15.111:0/1695639753 shutdown_connections 2024-09-10T23:58:53.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.942+0000 7ff933000700 1 --2- 172.21.15.111:0/1695639753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff92c101370 0x7ff92c1017c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:53.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.942+0000 7ff933000700 1 --2- 172.21.15.111:0/1695639753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff92c100170 0x7ff92c100580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:53.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.942+0000 7ff933000700 1 -- 172.21.15.111:0/1695639753 >> 172.21.15.111:0/1695639753 conn(0x7ff92c0fb6e0 msgr2=0x7ff92c0fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:53.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.942+0000 7ff933000700 1 -- 172.21.15.111:0/1695639753 shutdown_connections 2024-09-10T23:58:53.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.942+0000 7ff933000700 1 -- 172.21.15.111:0/1695639753 wait complete. 2024-09-10T23:58:53.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.944+0000 7ff933000700 1 Processor -- start 2024-09-10T23:58:53.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.944+0000 7ff933000700 1 -- start start 2024-09-10T23:58:53.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.944+0000 7ff933000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff92c100170 0x7ff92c074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:53.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.944+0000 7ff933000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff92c101370 0x7ff92c073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:53.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.944+0000 7ff933000700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c073680 con 0x7ff92c100170 2024-09-10T23:58:53.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.944+0000 7ff933000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c0737c0 con 0x7ff92c101370 2024-09-10T23:58:53.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.944+0000 7ff92be00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff92c100170 0x7ff92c074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:53.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.944+0000 7ff92be00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff92c100170 0x7ff92c074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40290/0 (socket says 172.21.15.111:40290) 2024-09-10T23:58:53.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.945+0000 7ff92be00700 1 -- 172.21.15.111:0/3346191255 learned_addr learned my addr 172.21.15.111:0/3346191255 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-10T23:58:53.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.945+0000 7ff92b400700 1 --2- 172.21.15.111:0/3346191255 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff92c101370 0x7ff92c073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:53.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.945+0000 7ff92be00700 1 -- 172.21.15.111:0/3346191255 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff92c101370 msgr2=0x7ff92c073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:53.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.945+0000 7ff92be00700 1 --2- 172.21.15.111:0/3346191255 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff92c101370 0x7ff92c073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:53.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.945+0000 7ff92be00700 1 -- 172.21.15.111:0/3346191255 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9180095f0 con 0x7ff92c100170 2024-09-10T23:58:53.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.945+0000 7ff92be00700 1 --2- 172.21.15.111:0/3346191255 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff92c100170 0x7ff92c074af0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff91c00d900 tx=0x7ff91c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:53.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.945+0000 7ff928c00700 1 -- 172.21.15.111:0/3346191255 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff91c00b920 con 0x7ff92c100170 2024-09-10T23:58:53.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.945+0000 7ff928c00700 1 -- 172.21.15.111:0/3346191255 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff91c010460 con 0x7ff92c100170 2024-09-10T23:58:53.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.945+0000 7ff933000700 1 -- 172.21.15.111:0/3346191255 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff92c073aa0 con 0x7ff92c100170 2024-09-10T23:58:53.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.946+0000 7ff928c00700 1 -- 172.21.15.111:0/3346191255 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff91c00f590 con 0x7ff92c100170 2024-09-10T23:58:53.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.946+0000 7ff933000700 1 -- 172.21.15.111:0/3346191255 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff92c19d9e0 con 0x7ff92c100170 2024-09-10T23:58:53.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.947+0000 7ff933000700 1 -- 172.21.15.111:0/3346191255 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff92c108cc0 con 0x7ff92c100170 2024-09-10T23:58:53.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.947+0000 7ff928c00700 1 -- 172.21.15.111:0/3346191255 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) v1 ==== 89860+0+0 (secure 0 0 0) 0x7ff91c0105d0 con 0x7ff92c100170 2024-09-10T23:58:53.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.948+0000 7ff928c00700 1 --2- 172.21.15.111:0/3346191255 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff91006c610 0x7ff91006eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:53.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.948+0000 7ff928c00700 1 -- 172.21.15.111:0/3346191255 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7ff91c08a730 con 0x7ff92c100170 2024-09-10T23:58:53.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.949+0000 7ff92b400700 1 --2- 172.21.15.111:0/3346191255 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff91006c610 0x7ff91006eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:53.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.949+0000 7ff92b400700 1 --2- 172.21.15.111:0/3346191255 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff91006c610 0x7ff91006eac0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff918006010 tx=0x7ff91800b560 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:53.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:53.953+0000 7ff928c00700 1 -- 172.21.15.111:0/3346191255 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff91c059990 con 0x7ff92c100170 2024-09-10T23:58:54.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:54 smithi111 ceph-mon[27539]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:54.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:54.160+0000 7ff933000700 1 -- 172.21.15.111:0/3346191255 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) v1 -- 0x7ff92c19df90 con 0x7ff92c100170 2024-09-10T23:58:54.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:54.166+0000 7ff928c00700 1 -- 172.21.15.111:0/3346191255 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v26)=0 v26) v1 ==== 119+0+0 (secure 0 0 0) 0x7ff91c0200b0 con 0x7ff92c100170 2024-09-10T23:58:54.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:54.168+0000 7ff933000700 1 -- 172.21.15.111:0/3346191255 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff91006c610 msgr2=0x7ff91006eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:54.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:54.168+0000 7ff933000700 1 --2- 172.21.15.111:0/3346191255 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff91006c610 0x7ff91006eac0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff918006010 tx=0x7ff91800b560 comp rx=0 tx=0).stop 2024-09-10T23:58:54.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:54.168+0000 7ff933000700 1 -- 172.21.15.111:0/3346191255 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff92c100170 msgr2=0x7ff92c074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:54.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:54.168+0000 7ff933000700 1 --2- 172.21.15.111:0/3346191255 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff92c100170 0x7ff92c074af0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff91c00d900 tx=0x7ff91c00dc10 comp rx=0 tx=0).stop 2024-09-10T23:58:54.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:54.169+0000 7ff933000700 1 -- 172.21.15.111:0/3346191255 shutdown_connections 2024-09-10T23:58:54.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:54.169+0000 7ff933000700 1 --2- 172.21.15.111:0/3346191255 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff91006c610 0x7ff91006eac0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:54.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:54.169+0000 7ff933000700 1 --2- 172.21.15.111:0/3346191255 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff92c100170 0x7ff92c074af0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:54.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:54.169+0000 7ff933000700 1 --2- 172.21.15.111:0/3346191255 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff92c101370 0x7ff92c073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:54.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:54.169+0000 7ff933000700 1 -- 172.21.15.111:0/3346191255 >> 172.21.15.111:0/3346191255 conn(0x7ff92c0fb6e0 msgr2=0x7ff92c1045a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:54.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:54.169+0000 7ff933000700 1 -- 172.21.15.111:0/3346191255 shutdown_connections 2024-09-10T23:58:54.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:54.169+0000 7ff933000700 1 -- 172.21.15.111:0/3346191255 wait complete. 2024-09-10T23:58:54.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:54 smithi203 ceph-mon[33225]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:54.869 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-10T23:58:55.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:55 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/3346191255' entity='client.admin' 2024-09-10T23:58:55.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:55 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/3346191255' entity='client.admin' 2024-09-10T23:58:56.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.402+0000 7f772a400700 1 -- 172.21.15.111:0/2912528471 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7724073750 msgr2=0x7f7724073bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:56.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.402+0000 7f772a400700 1 --2- 172.21.15.111:0/2912528471 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7724073750 0x7f7724073bc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7710009910 tx=0x7f7710009c20 comp rx=0 tx=0).stop 2024-09-10T23:58:56.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.402+0000 7f772a400700 1 -- 172.21.15.111:0/2912528471 shutdown_connections 2024-09-10T23:58:56.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.402+0000 7f772a400700 1 --2- 172.21.15.111:0/2912528471 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7724073750 0x7f7724073bc0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:56.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.402+0000 7f772a400700 1 --2- 172.21.15.111:0/2912528471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7724074d20 0x7f7724073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:56.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.402+0000 7f772a400700 1 -- 172.21.15.111:0/2912528471 >> 172.21.15.111:0/2912528471 conn(0x7f77240fb6e0 msgr2=0x7f77240fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:56.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.402+0000 7f772a400700 1 -- 172.21.15.111:0/2912528471 shutdown_connections 2024-09-10T23:58:56.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.402+0000 7f772a400700 1 -- 172.21.15.111:0/2912528471 wait complete. 2024-09-10T23:58:56.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.404+0000 7f772a400700 1 Processor -- start 2024-09-10T23:58:56.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.404+0000 7f772a400700 1 -- start start 2024-09-10T23:58:56.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.404+0000 7f772a400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7724073750 0x7f7724197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:56.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.404+0000 7f772a400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7724074d20 0x7f7724198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:56.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.404+0000 7f772a400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7724198690 con 0x7f7724074d20 2024-09-10T23:58:56.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.404+0000 7f772a400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77241987d0 con 0x7f7724073750 2024-09-10T23:58:56.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.405+0000 7f7722a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7724074d20 0x7f7724198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:56.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.405+0000 7f7723400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7724073750 0x7f7724197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:56.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.405+0000 7f7722a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7724074d20 0x7f7724198070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40316/0 (socket says 172.21.15.111:40316) 2024-09-10T23:58:56.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.405+0000 7f7722a00700 1 -- 172.21.15.111:0/951174705 learned_addr learned my addr 172.21.15.111:0/951174705 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-10T23:58:56.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.405+0000 7f7722a00700 1 -- 172.21.15.111:0/951174705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7724073750 msgr2=0x7f7724197b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:56.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.405+0000 7f7722a00700 1 --2- 172.21.15.111:0/951174705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7724073750 0x7f7724197b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:56.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.405+0000 7f7722a00700 1 -- 172.21.15.111:0/951174705 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77100095f0 con 0x7f7724074d20 2024-09-10T23:58:56.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.405+0000 7f7722a00700 1 --2- 172.21.15.111:0/951174705 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7724074d20 0x7f7724198070 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7710005b40 tx=0x7f771000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:56.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.405+0000 7f771be00700 1 -- 172.21.15.111:0/951174705 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f771001d070 con 0x7f7724074d20 2024-09-10T23:58:56.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.405+0000 7f771be00700 1 -- 172.21.15.111:0/951174705 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f771000f460 con 0x7f7724074d20 2024-09-10T23:58:56.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.405+0000 7f771be00700 1 -- 172.21.15.111:0/951174705 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7710021620 con 0x7f7724074d20 2024-09-10T23:58:56.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.406+0000 7f772a400700 1 -- 172.21.15.111:0/951174705 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f772419d220 con 0x7f7724074d20 2024-09-10T23:58:56.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.406+0000 7f772a400700 1 -- 172.21.15.111:0/951174705 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f772419d710 con 0x7f7724074d20 2024-09-10T23:58:56.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.407+0000 7f772a400700 1 -- 172.21.15.111:0/951174705 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f772410aeb0 con 0x7f7724074d20 2024-09-10T23:58:56.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.407+0000 7f771be00700 1 -- 172.21.15.111:0/951174705 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) v1 ==== 89860+0+0 (secure 0 0 0) 0x7f771000fa40 con 0x7f7724074d20 2024-09-10T23:58:56.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.408+0000 7f771be00700 1 --2- 172.21.15.111:0/951174705 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f770806c610 0x7f770806eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:58:56.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.408+0000 7f771be00700 1 -- 172.21.15.111:0/951174705 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f771008b9b0 con 0x7f7724074d20 2024-09-10T23:58:56.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.409+0000 7f7723400700 1 --2- 172.21.15.111:0/951174705 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f770806c610 0x7f770806eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:58:56.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.409+0000 7f7723400700 1 --2- 172.21.15.111:0/951174705 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f770806c610 0x7f770806eac0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7714005950 tx=0x7f771400b410 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:58:56.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.413+0000 7f771be00700 1 -- 172.21.15.111:0/951174705 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f771005ac90 con 0x7f7724074d20 2024-09-10T23:58:56.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.622+0000 7f772a400700 1 -- 172.21.15.111:0/951174705 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) v1 -- 0x7f772419dda0 con 0x7f7724074d20 2024-09-10T23:58:56.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.627+0000 7f771be00700 1 -- 172.21.15.111:0/951174705 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v27)=0 v27) v1 ==== 108+0+0 (secure 0 0 0) 0x7f77100260b0 con 0x7f7724074d20 2024-09-10T23:58:56.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.630+0000 7f772a400700 1 -- 172.21.15.111:0/951174705 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f770806c610 msgr2=0x7f770806eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:56.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.630+0000 7f772a400700 1 --2- 172.21.15.111:0/951174705 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f770806c610 0x7f770806eac0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7714005950 tx=0x7f771400b410 comp rx=0 tx=0).stop 2024-09-10T23:58:56.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.630+0000 7f772a400700 1 -- 172.21.15.111:0/951174705 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7724074d20 msgr2=0x7f7724198070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:58:56.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.630+0000 7f772a400700 1 --2- 172.21.15.111:0/951174705 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7724074d20 0x7f7724198070 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7710005b40 tx=0x7f771000bd70 comp rx=0 tx=0).stop 2024-09-10T23:58:56.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.630+0000 7f772a400700 1 -- 172.21.15.111:0/951174705 shutdown_connections 2024-09-10T23:58:56.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.630+0000 7f772a400700 1 --2- 172.21.15.111:0/951174705 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f770806c610 0x7f770806eac0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:56.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.630+0000 7f772a400700 1 --2- 172.21.15.111:0/951174705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7724073750 0x7f7724197b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:56.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.630+0000 7f772a400700 1 --2- 172.21.15.111:0/951174705 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7724074d20 0x7f7724198070 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:58:56.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.630+0000 7f772a400700 1 -- 172.21.15.111:0/951174705 >> 172.21.15.111:0/951174705 conn(0x7f77240fb6e0 msgr2=0x7f7724105fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:58:56.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.630+0000 7f772a400700 1 -- 172.21.15.111:0/951174705 shutdown_connections 2024-09-10T23:58:56.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:58:55.630+0000 7f772a400700 1 -- 172.21.15.111:0/951174705 wait complete. 2024-09-10T23:58:56.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:56 smithi111 ceph-mon[27539]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:56.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:56 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/951174705' entity='client.admin' 2024-09-10T23:58:56.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:56 smithi203 ceph-mon[33225]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:56.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:56 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/951174705' entity='client.admin' 2024-09-10T23:58:57.162 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.0', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '03107fbe-6fd0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi111') 2024-09-10T23:58:57.162 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.0', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '03107fbe-6fd0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi111') 2024-09-10T23:58:58.481 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:58 smithi111 ceph-mon[27539]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:58.481 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:58 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:58.481 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:58 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:58.481 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:58 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi111", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T23:58:58.481 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:58 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:58:58.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:58 smithi203 ceph-mon[33225]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:58:58.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:58 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:58.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:58 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:58:58.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:58 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi111", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T23:58:58.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:58 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:58:59.013 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.0', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '03107fbe-6fd0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi111') 2024-09-10T23:58:59.014 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.0', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '03107fbe-6fd0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi111') 2024-09-10T23:58:59.014 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.0', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '03107fbe-6fd0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi111') 2024-09-10T23:58:59.014 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.0', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '03107fbe-6fd0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi111') 2024-09-10T23:58:59.014 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.0', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '03107fbe-6fd0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi111') 2024-09-10T23:58:59.236 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:59 smithi111 ceph-mon[27539]: Reconfiguring crash.smithi111 (monmap changed)... 2024-09-10T23:58:59.236 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:58:59 smithi111 ceph-mon[27539]: Reconfiguring daemon crash.smithi111 on smithi111 2024-09-10T23:58:59.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:59 smithi203 ceph-mon[33225]: Reconfiguring crash.smithi111 (monmap changed)... 2024-09-10T23:58:59.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:58:59 smithi203 ceph-mon[33225]: Reconfiguring daemon crash.smithi111 on smithi111 2024-09-10T23:59:00.349 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:00 smithi111 ceph-mon[27539]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:00.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:00 smithi203 ceph-mon[33225]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:01.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.276+0000 7f1e61e00700 1 -- 172.21.15.111:0/1867535713 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e5c100150 msgr2=0x7f1e5c100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:01.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.276+0000 7f1e61e00700 1 --2- 172.21.15.111:0/1867535713 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e5c100150 0x7f1e5c100560 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c009910 tx=0x7f1e4c009c20 comp rx=0 tx=0).stop 2024-09-10T23:59:01.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.276+0000 7f1e61e00700 1 -- 172.21.15.111:0/1867535713 shutdown_connections 2024-09-10T23:59:01.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.276+0000 7f1e61e00700 1 --2- 172.21.15.111:0/1867535713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e5c101350 0x7f1e5c1017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:01.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.276+0000 7f1e61e00700 1 --2- 172.21.15.111:0/1867535713 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e5c100150 0x7f1e5c100560 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:01.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.276+0000 7f1e61e00700 1 -- 172.21.15.111:0/1867535713 >> 172.21.15.111:0/1867535713 conn(0x7f1e5c0fb6e0 msgr2=0x7f1e5c0fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:01.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.276+0000 7f1e61e00700 1 -- 172.21.15.111:0/1867535713 shutdown_connections 2024-09-10T23:59:01.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.276+0000 7f1e61e00700 1 -- 172.21.15.111:0/1867535713 wait complete. 2024-09-10T23:59:01.279 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:01 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T23:59:01.279 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:01 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:01.279 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:01 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:01.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.277+0000 7f1e61e00700 1 Processor -- start 2024-09-10T23:59:01.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.277+0000 7f1e61e00700 1 -- start start 2024-09-10T23:59:01.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.278+0000 7f1e61e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e5c100150 0x7f1e5c191d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:01.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.278+0000 7f1e61e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e5c101350 0x7f1e5c192290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:01.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.278+0000 7f1e61e00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c18e840 con 0x7f1e5c101350 2024-09-10T23:59:01.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.278+0000 7f1e61e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c18e9b0 con 0x7f1e5c100150 2024-09-10T23:59:01.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.278+0000 7f1e53e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e5c101350 0x7f1e5c192290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:01.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.278+0000 7f1e53e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e5c101350 0x7f1e5c192290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52130/0 (socket says 172.21.15.111:52130) 2024-09-10T23:59:01.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.278+0000 7f1e5aa00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e5c100150 0x7f1e5c191d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:01.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.278+0000 7f1e53e00700 1 -- 172.21.15.111:0/1597293743 learned_addr learned my addr 172.21.15.111:0/1597293743 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-10T23:59:01.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.279+0000 7f1e53e00700 1 -- 172.21.15.111:0/1597293743 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e5c100150 msgr2=0x7f1e5c191d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:01.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.279+0000 7f1e53e00700 1 --2- 172.21.15.111:0/1597293743 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e5c100150 0x7f1e5c191d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:01.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.279+0000 7f1e53e00700 1 -- 172.21.15.111:0/1597293743 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e4c0095f0 con 0x7f1e5c101350 2024-09-10T23:59:01.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.279+0000 7f1e5aa00700 1 --2- 172.21.15.111:0/1597293743 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e5c100150 0x7f1e5c191d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:59:01.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.279+0000 7f1e53e00700 1 --2- 172.21.15.111:0/1597293743 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e5c101350 0x7f1e5c192290 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400c8a0 tx=0x7f1e4400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:01.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.279+0000 7f1e60a00700 1 -- 172.21.15.111:0/1597293743 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e440078e0 con 0x7f1e5c101350 2024-09-10T23:59:01.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.279+0000 7f1e60a00700 1 -- 172.21.15.111:0/1597293743 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1e4400f450 con 0x7f1e5c101350 2024-09-10T23:59:01.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.279+0000 7f1e60a00700 1 -- 172.21.15.111:0/1597293743 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e4400e5e0 con 0x7f1e5c101350 2024-09-10T23:59:01.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.279+0000 7f1e61e00700 1 -- 172.21.15.111:0/1597293743 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e5c18ec90 con 0x7f1e5c101350 2024-09-10T23:59:01.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.279+0000 7f1e61e00700 1 -- 172.21.15.111:0/1597293743 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e5c18f1e0 con 0x7f1e5c101350 2024-09-10T23:59:01.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.281+0000 7f1e61e00700 1 -- 172.21.15.111:0/1597293743 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e5c105430 con 0x7f1e5c101350 2024-09-10T23:59:01.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.281+0000 7f1e60a00700 1 -- 172.21.15.111:0/1597293743 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) v1 ==== 89860+0+0 (secure 0 0 0) 0x7f1e4400f5c0 con 0x7f1e5c101350 2024-09-10T23:59:01.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.282+0000 7f1e60a00700 1 --2- 172.21.15.111:0/1597293743 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f1e4006c610 0x7f1e4006eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:01.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.282+0000 7f1e60a00700 1 -- 172.21.15.111:0/1597293743 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f1e4408a540 con 0x7f1e5c101350 2024-09-10T23:59:01.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.283+0000 7f1e5aa00700 1 --2- 172.21.15.111:0/1597293743 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f1e4006c610 0x7f1e4006eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:01.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.283+0000 7f1e5aa00700 1 --2- 172.21.15.111:0/1597293743 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f1e4006c610 0x7f1e4006eac0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c006010 tx=0x7f1e4c00b560 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:01.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.287+0000 7f1e60a00700 1 -- 172.21.15.111:0/1597293743 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1e440598c0 con 0x7f1e5c101350 2024-09-10T23:59:01.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.490+0000 7f1e61e00700 1 -- 172.21.15.111:0/1597293743 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7f1e5c02cc30 con 0x7f1e5c101350 2024-09-10T23:59:01.654 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:01 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T23:59:01.654 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:01 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:01.654 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:01 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:01.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.497+0000 7f1e60a00700 1 -- 172.21.15.111:0/1597293743 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v28)=0 v28) v1 ==== 121+0+0 (secure 0 0 0) 0x7f1e44089db0 con 0x7f1e5c101350 2024-09-10T23:59:01.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.499+0000 7f1e61e00700 1 -- 172.21.15.111:0/1597293743 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f1e4006c610 msgr2=0x7f1e4006eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:01.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.499+0000 7f1e61e00700 1 --2- 172.21.15.111:0/1597293743 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f1e4006c610 0x7f1e4006eac0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c006010 tx=0x7f1e4c00b560 comp rx=0 tx=0).stop 2024-09-10T23:59:01.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.499+0000 7f1e61e00700 1 -- 172.21.15.111:0/1597293743 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e5c101350 msgr2=0x7f1e5c192290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:01.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.499+0000 7f1e61e00700 1 --2- 172.21.15.111:0/1597293743 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e5c101350 0x7f1e5c192290 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400c8a0 tx=0x7f1e4400cbb0 comp rx=0 tx=0).stop 2024-09-10T23:59:01.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.499+0000 7f1e61e00700 1 -- 172.21.15.111:0/1597293743 shutdown_connections 2024-09-10T23:59:01.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.499+0000 7f1e61e00700 1 --2- 172.21.15.111:0/1597293743 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f1e4006c610 0x7f1e4006eac0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:01.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.499+0000 7f1e61e00700 1 --2- 172.21.15.111:0/1597293743 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e5c100150 0x7f1e5c191d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:01.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.499+0000 7f1e61e00700 1 --2- 172.21.15.111:0/1597293743 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e5c101350 0x7f1e5c192290 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:01.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.499+0000 7f1e61e00700 1 -- 172.21.15.111:0/1597293743 >> 172.21.15.111:0/1597293743 conn(0x7f1e5c0fb6e0 msgr2=0x7f1e5c102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:01.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.500+0000 7f1e61e00700 1 -- 172.21.15.111:0/1597293743 shutdown_connections 2024-09-10T23:59:01.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:01.500+0000 7f1e61e00700 1 -- 172.21.15.111:0/1597293743 wait complete. 2024-09-10T23:59:02.463 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:02 smithi111 ceph-mon[27539]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:02.463 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:02 smithi111 ceph-mon[27539]: Reconfiguring alertmanager.smithi111 (dependencies changed)... 2024-09-10T23:59:02.463 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:02 smithi111 ceph-mon[27539]: Reconfiguring daemon alertmanager.smithi111 on smithi111 2024-09-10T23:59:02.463 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:02 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/1597293743' entity='client.admin' 2024-09-10T23:59:02.491 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.0', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '03107fbe-6fd0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi111') 2024-09-10T23:59:02.491 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.0', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '03107fbe-6fd0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi111') 2024-09-10T23:59:02.491 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.0', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '03107fbe-6fd0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi111') 2024-09-10T23:59:02.491 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.0', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '03107fbe-6fd0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi111') 2024-09-10T23:59:02.491 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.io/ceph/ceph:v18.2.0', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '03107fbe-6fd0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi111') 2024-09-10T23:59:02.492 INFO:tasks.cephadm:Deploying OSDs... 2024-09-10T23:59:02.492 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-10T23:59:02.492 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T23:59:02.528 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T23:59:02.528 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_1 2024-09-10T23:59:02.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:02 smithi203 ceph-mon[33225]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:02.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:02 smithi203 ceph-mon[33225]: Reconfiguring alertmanager.smithi111 (dependencies changed)... 2024-09-10T23:59:02.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:02 smithi203 ceph-mon[33225]: Reconfiguring daemon alertmanager.smithi111 on smithi111 2024-09-10T23:59:02.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:02 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/1597293743' entity='client.admin' 2024-09-10T23:59:02.604 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T23:59:02.604 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:59:02.604 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 6h/6d Inode: 639 Links: 1 2024-09-10T23:59:02.604 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:59:02.604 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:59:02.604 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-09-10 23:57:20.215056080 +0000 2024-09-10T23:59:02.604 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-09-10 23:51:44.906654425 +0000 2024-09-10T23:59:02.604 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-09-10 23:51:44.906654425 +0000 2024-09-10T23:59:02.604 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: 2024-09-10 23:51:44.906654425 +0000 2024-09-10T23:59:02.605 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T23:59:02.700 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-09-10T23:59:02.700 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-09-10T23:59:02.700 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000264433 s, 1.9 MB/s 2024-09-10T23:59:02.703 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T23:59:02.740 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_2 2024-09-10T23:59:02.815 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T23:59:02.815 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:59:02.815 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 6h/6d Inode: 659 Links: 1 2024-09-10T23:59:02.815 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:59:02.816 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:59:02.816 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-09-10 23:57:20.216056063 +0000 2024-09-10T23:59:02.816 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-09-10 23:51:45.402646068 +0000 2024-09-10T23:59:02.816 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-09-10 23:51:45.402646068 +0000 2024-09-10T23:59:02.816 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: 2024-09-10 23:51:45.402646068 +0000 2024-09-10T23:59:02.816 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T23:59:02.908 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-09-10T23:59:02.908 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-09-10T23:59:02.908 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000266336 s, 1.9 MB/s 2024-09-10T23:59:02.910 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T23:59:02.947 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_3 2024-09-10T23:59:03.022 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T23:59:03.023 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:59:03.023 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 6h/6d Inode: 678 Links: 1 2024-09-10T23:59:03.023 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:59:03.023 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:59:03.023 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-09-10 23:57:20.216056063 +0000 2024-09-10T23:59:03.023 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-09-10 23:51:45.875638099 +0000 2024-09-10T23:59:03.023 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-09-10 23:51:45.875638099 +0000 2024-09-10T23:59:03.023 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: 2024-09-10 23:51:45.875638099 +0000 2024-09-10T23:59:03.023 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T23:59:03.116 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-09-10T23:59:03.117 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-09-10T23:59:03.117 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000244658 s, 2.1 MB/s 2024-09-10T23:59:03.121 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T23:59:03.157 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_4 2024-09-10T23:59:03.233 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T23:59:03.234 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:59:03.234 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 6h/6d Inode: 695 Links: 1 2024-09-10T23:59:03.234 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:59:03.234 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:59:03.234 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-09-10 23:57:20.217056045 +0000 2024-09-10T23:59:03.234 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-09-10 23:51:46.351630079 +0000 2024-09-10T23:59:03.234 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-09-10 23:51:46.351630079 +0000 2024-09-10T23:59:03.234 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: 2024-09-10 23:51:46.351630079 +0000 2024-09-10T23:59:03.234 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T23:59:03.326 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-09-10T23:59:03.326 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-09-10T23:59:03.326 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000237866 s, 2.2 MB/s 2024-09-10T23:59:03.329 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T23:59:03.365 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-10T23:59:03.365 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T23:59:03.406 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T23:59:03.406 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_1 2024-09-10T23:59:03.483 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T23:59:03.484 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:59:03.484 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-09-10T23:59:03.484 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:59:03.484 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:59:03.484 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-09-10 23:58:06.105013480 +0000 2024-09-10T23:59:03.484 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-09-10 23:51:48.307095185 +0000 2024-09-10T23:59:03.484 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-09-10 23:51:48.307095185 +0000 2024-09-10T23:59:03.484 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-09-10 23:51:48.307095185 +0000 2024-09-10T23:59:03.484 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T23:59:03.584 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-09-10T23:59:03.584 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-09-10T23:59:03.584 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000368377 s, 1.4 MB/s 2024-09-10T23:59:03.587 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T23:59:03.624 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_2 2024-09-10T23:59:03.699 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T23:59:03.699 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:59:03.699 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-09-10T23:59:03.699 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:59:03.699 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:59:03.699 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-09-10 23:58:06.105013480 +0000 2024-09-10T23:59:03.699 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-09-10 23:51:48.770083656 +0000 2024-09-10T23:59:03.699 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-09-10 23:51:48.770083656 +0000 2024-09-10T23:59:03.699 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-09-10 23:51:48.770083656 +0000 2024-09-10T23:59:03.700 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T23:59:03.791 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-09-10T23:59:03.791 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-09-10T23:59:03.791 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000292242 s, 1.8 MB/s 2024-09-10T23:59:03.794 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T23:59:03.830 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_3 2024-09-10T23:59:03.905 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T23:59:03.906 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:59:03.906 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-09-10T23:59:03.906 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:59:03.906 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:59:03.906 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-09-10 23:58:06.106013455 +0000 2024-09-10T23:59:03.906 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-09-10 23:51:49.253071629 +0000 2024-09-10T23:59:03.906 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-09-10 23:51:49.253071629 +0000 2024-09-10T23:59:03.906 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-09-10 23:51:49.253071629 +0000 2024-09-10T23:59:03.906 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T23:59:03.998 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-09-10T23:59:03.998 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-09-10T23:59:03.998 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000290017 s, 1.8 MB/s 2024-09-10T23:59:04.001 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T23:59:04.038 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_4 2024-09-10T23:59:04.112 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T23:59:04.113 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:59:04.113 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-09-10T23:59:04.113 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:59:04.113 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T23:59:04.113 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-09-10 23:58:06.107013430 +0000 2024-09-10T23:59:04.113 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-09-10 23:51:49.717060076 +0000 2024-09-10T23:59:04.113 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-09-10 23:51:49.717060076 +0000 2024-09-10T23:59:04.113 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-09-10 23:51:49.717060076 +0000 2024-09-10T23:59:04.113 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T23:59:04.206 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-09-10T23:59:04.206 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-09-10T23:59:04.206 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000435752 s, 1.2 MB/s 2024-09-10T23:59:04.208 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T23:59:04.245 INFO:tasks.cephadm:Deploying osd.0 on smithi111 with /dev/vg_nvme/lv_4... 2024-09-10T23:59:04.245 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T23:59:04.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:04 smithi203 ceph-mon[33225]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:04.572 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:04 smithi111 ceph-mon[27539]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:05.064 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-10T23:59:06.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:06 smithi203 ceph-mon[33225]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:06.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:06 smithi111 ceph-mon[27539]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:08.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:08 smithi111 ceph-mon[27539]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:08.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:08 smithi203 ceph-mon[33225]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:09.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:09 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:09.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:09 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:09.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:09 smithi203 ceph-mon[33225]: Reconfiguring grafana.smithi111 (dependencies changed)... 2024-09-10T23:59:09.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:09 smithi203 ceph-mon[33225]: Reconfiguring daemon grafana.smithi111 on smithi111 2024-09-10T23:59:09.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:09 smithi203 ceph-mon[33225]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:09.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:09 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:09.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:09 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:09.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:09 smithi111 ceph-mon[27539]: Reconfiguring grafana.smithi111 (dependencies changed)... 2024-09-10T23:59:09.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:09 smithi111 ceph-mon[27539]: Reconfiguring daemon grafana.smithi111 on smithi111 2024-09-10T23:59:09.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:09 smithi111 ceph-mon[27539]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:10.029 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:59:10.053 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi111:vg_nvme/lv_4 2024-09-10T23:59:11.280 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-10T23:59:11.822 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:11 smithi111 ceph-mon[27539]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:12.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:11 smithi203 ceph-mon[33225]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:13.876 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:13 smithi111 ceph-mon[27539]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:13.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.941+0000 7fa48f200700 1 -- 172.21.15.111:0/2211505542 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4880737b0 msgr2=0x7fa488073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:13.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.942+0000 7fa48f200700 1 --2- 172.21.15.111:0/2211505542 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4880737b0 0x7fa488073c20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa474009940 tx=0x7fa474009c50 comp rx=0 tx=0).stop 2024-09-10T23:59:13.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.942+0000 7fa48f200700 1 -- 172.21.15.111:0/2211505542 shutdown_connections 2024-09-10T23:59:13.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.942+0000 7fa48f200700 1 --2- 172.21.15.111:0/2211505542 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4880737b0 0x7fa488073c20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.942+0000 7fa48f200700 1 --2- 172.21.15.111:0/2211505542 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa488074d80 0x7fa4880731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.942+0000 7fa48f200700 1 -- 172.21.15.111:0/2211505542 >> 172.21.15.111:0/2211505542 conn(0x7fa4880fb6e0 msgr2=0x7fa4880fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:13.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.942+0000 7fa48f200700 1 -- 172.21.15.111:0/2211505542 shutdown_connections 2024-09-10T23:59:13.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.942+0000 7fa48f200700 1 -- 172.21.15.111:0/2211505542 wait complete. 2024-09-10T23:59:13.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.943+0000 7fa48f200700 1 Processor -- start 2024-09-10T23:59:13.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.943+0000 7fa48f200700 1 -- start start 2024-09-10T23:59:13.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.943+0000 7fa48f200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4880737b0 0x7fa488197c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.943+0000 7fa48f200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa488074d80 0x7fa4881981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.943+0000 7fa48f200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4881987a0 con 0x7fa4880737b0 2024-09-10T23:59:13.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.943+0000 7fa48f200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa488198910 con 0x7fa488074d80 2024-09-10T23:59:13.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.943+0000 7fa487e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4880737b0 0x7fa488197c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.943+0000 7fa487e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4880737b0 0x7fa488197c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:47434/0 (socket says 172.21.15.111:47434) 2024-09-10T23:59:13.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.943+0000 7fa487e00700 1 -- 172.21.15.111:0/44103049 learned_addr learned my addr 172.21.15.111:0/44103049 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-10T23:59:13.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.944+0000 7fa487400700 1 --2- 172.21.15.111:0/44103049 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa488074d80 0x7fa4881981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.944+0000 7fa487e00700 1 -- 172.21.15.111:0/44103049 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa488074d80 msgr2=0x7fa4881981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:13.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.944+0000 7fa487e00700 1 --2- 172.21.15.111:0/44103049 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa488074d80 0x7fa4881981a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:13.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.944+0000 7fa487e00700 1 -- 172.21.15.111:0/44103049 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4740095f0 con 0x7fa4880737b0 2024-09-10T23:59:13.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.944+0000 7fa487e00700 1 --2- 172.21.15.111:0/44103049 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4880737b0 0x7fa488197c60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa47800b4b0 tx=0x7fa47800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:13.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.944+0000 7fa484c00700 1 -- 172.21.15.111:0/44103049 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa478011800 con 0x7fa4880737b0 2024-09-10T23:59:13.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.944+0000 7fa484c00700 1 -- 172.21.15.111:0/44103049 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa478011e10 con 0x7fa4880737b0 2024-09-10T23:59:13.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.944+0000 7fa48f200700 1 -- 172.21.15.111:0/44103049 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa48819d3a0 con 0x7fa4880737b0 2024-09-10T23:59:13.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.944+0000 7fa484c00700 1 -- 172.21.15.111:0/44103049 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa47800f2e0 con 0x7fa4880737b0 2024-09-10T23:59:13.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.945+0000 7fa48f200700 1 -- 172.21.15.111:0/44103049 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48819d970 con 0x7fa4880737b0 2024-09-10T23:59:13.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.946+0000 7fa48f200700 1 -- 172.21.15.111:0/44103049 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa48810af10 con 0x7fa4880737b0 2024-09-10T23:59:13.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.947+0000 7fa484c00700 1 -- 172.21.15.111:0/44103049 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) v1 ==== 89860+0+0 (secure 0 0 0) 0x7fa478010380 con 0x7fa4880737b0 2024-09-10T23:59:13.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.948+0000 7fa484c00700 1 --2- 172.21.15.111:0/44103049 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fa46c06c610 0x7fa46c06eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:13.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.948+0000 7fa484c00700 1 -- 172.21.15.111:0/44103049 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7fa47808a950 con 0x7fa4880737b0 2024-09-10T23:59:13.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.948+0000 7fa487400700 1 --2- 172.21.15.111:0/44103049 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fa46c06c610 0x7fa46c06eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:13.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.949+0000 7fa487400700 1 --2- 172.21.15.111:0/44103049 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fa46c06c610 0x7fa46c06eac0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa474005f50 tx=0x7fa474005ea0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:13.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:13.952+0000 7fa484c00700 1 -- 172.21.15.111:0/44103049 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa478053720 con 0x7fa4880737b0 2024-09-10T23:59:14.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:13 smithi203 ceph-mon[33225]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:14.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:14.168+0000 7fa48f200700 1 -- 172.21.15.111:0/44103049 --> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fa488107650 con 0x7fa46c06c610 2024-09-10T23:59:14.756 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:14 smithi111 ceph-mon[27539]: from='client.14324 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:59:14.756 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:14 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T23:59:14.756 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:14 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T23:59:14.757 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:14 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:59:15.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:14 smithi203 ceph-mon[33225]: from='client.14324 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:59:15.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:14 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T23:59:15.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:14 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T23:59:15.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:14 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:59:15.987 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:15 smithi111 ceph-mon[27539]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:15.987 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:15 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T23:59:16.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:15 smithi203 ceph-mon[33225]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:16.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:15 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T23:59:17.775 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:17 smithi111 ceph-mon[27539]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:17.775 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:17 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:17.775 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:17 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:17.775 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:17 smithi111 ceph-mon[27539]: Reconfiguring prometheus.smithi111 (dependencies changed)... 2024-09-10T23:59:17.775 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:17 smithi111 ceph-mon[27539]: Reconfiguring daemon prometheus.smithi111 on smithi111 2024-09-10T23:59:17.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:17 smithi203 ceph-mon[33225]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:17.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:17 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:17.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:17 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:17.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:17 smithi203 ceph-mon[33225]: Reconfiguring prometheus.smithi111 (dependencies changed)... 2024-09-10T23:59:17.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:17 smithi203 ceph-mon[33225]: Reconfiguring daemon prometheus.smithi111 on smithi111 2024-09-10T23:59:18.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:18 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/2361339334' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "677fb551-96f5-4160-9f99-ffd1ca28e12e"}]: dispatch 2024-09-10T23:59:18.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:18 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/2361339334' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "677fb551-96f5-4160-9f99-ffd1ca28e12e"}]': finished 2024-09-10T23:59:18.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:18 smithi111 ceph-mon[27539]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T23:59:18.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:18 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T23:59:19.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:18 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/2361339334' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "677fb551-96f5-4160-9f99-ffd1ca28e12e"}]: dispatch 2024-09-10T23:59:19.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:18 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/2361339334' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "677fb551-96f5-4160-9f99-ffd1ca28e12e"}]': finished 2024-09-10T23:59:19.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:18 smithi203 ceph-mon[33225]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T23:59:19.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:18 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T23:59:19.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:19 smithi111 ceph-mon[27539]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:19.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:19 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/3142106800' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T23:59:20.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:19 smithi203 ceph-mon[33225]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:20.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:19 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/3142106800' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T23:59:21.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:21 smithi111 ceph-mon[27539]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:22.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:21 smithi203 ceph-mon[33225]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:23.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:23 smithi111 ceph-mon[27539]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:24.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:23 smithi203 ceph-mon[33225]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:25.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:25 smithi111 ceph-mon[27539]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:26.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:25 smithi203 ceph-mon[33225]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:27.794 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:27 smithi203 ceph-mon[33225]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:27.801 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:27 smithi111 ceph-mon[27539]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:30.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:30 smithi111 ceph-mon[27539]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:30.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:30 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:30.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:30 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:30.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:30 smithi111 ceph-mon[27539]: Reconfiguring ceph-exporter.smithi203 (monmap changed)... 2024-09-10T23:59:30.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:30 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi203", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-10T23:59:30.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:30 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:59:30.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:30 smithi111 ceph-mon[27539]: Reconfiguring daemon ceph-exporter.smithi203 on smithi203 2024-09-10T23:59:30.464 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:30 smithi203 ceph-mon[33225]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:30.464 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:30 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:30.464 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:30 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:30.464 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:30 smithi203 ceph-mon[33225]: Reconfiguring ceph-exporter.smithi203 (monmap changed)... 2024-09-10T23:59:30.464 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:30 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi203", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-10T23:59:30.464 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:30 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:59:30.464 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:30 smithi203 ceph-mon[33225]: Reconfiguring daemon ceph-exporter.smithi203 on smithi203 2024-09-10T23:59:31.430 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:31 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T23:59:31.430 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:31 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T23:59:31.430 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:31 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:59:31.431 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:31 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:31.431 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:31 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:31.431 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:31 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi203", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T23:59:31.431 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:31 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:59:31.524 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:31 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T23:59:31.525 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:31 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T23:59:31.525 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:31 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:59:31.525 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:31 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:31.525 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:31 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:31.525 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:31 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi203", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T23:59:31.525 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:31 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:59:32.265 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:32 smithi203 ceph-mon[33225]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:32.266 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:32 smithi203 ceph-mon[33225]: Deploying daemon osd.0 on smithi111 2024-09-10T23:59:32.266 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:32 smithi203 ceph-mon[33225]: Reconfiguring crash.smithi203 (monmap changed)... 2024-09-10T23:59:32.266 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:32 smithi203 ceph-mon[33225]: Reconfiguring daemon crash.smithi203 on smithi203 2024-09-10T23:59:32.366 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:32 smithi111 ceph-mon[27539]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:32.366 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:32 smithi111 ceph-mon[27539]: Deploying daemon osd.0 on smithi111 2024-09-10T23:59:32.366 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:32 smithi111 ceph-mon[27539]: Reconfiguring crash.smithi203 (monmap changed)... 2024-09-10T23:59:32.366 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:32 smithi111 ceph-mon[27539]: Reconfiguring daemon crash.smithi203 on smithi203 2024-09-10T23:59:33.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:33 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:33.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:33 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:33.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:33 smithi203 ceph-mon[33225]: Reconfiguring mgr.smithi203.smuspl (monmap changed)... 2024-09-10T23:59:33.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:33 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi203.smuspl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T23:59:33.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:33 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T23:59:33.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:33 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:59:33.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:33 smithi203 ceph-mon[33225]: Reconfiguring daemon mgr.smithi203.smuspl on smithi203 2024-09-10T23:59:33.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:33 smithi203 ceph-mon[33225]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:33.557 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:33 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:33.557 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:33 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:33.557 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:33 smithi111 ceph-mon[27539]: Reconfiguring mgr.smithi203.smuspl (monmap changed)... 2024-09-10T23:59:33.557 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:33 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi203.smuspl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T23:59:33.557 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:33 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T23:59:33.557 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:33 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:59:33.557 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:33 smithi111 ceph-mon[27539]: Reconfiguring daemon mgr.smithi203.smuspl on smithi203 2024-09-10T23:59:33.557 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:33 smithi111 ceph-mon[27539]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:35.286 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:35 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:35.287 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:35 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:35.287 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:35 smithi111 ceph-mon[27539]: Reconfiguring mon.smithi203 (monmap changed)... 2024-09-10T23:59:35.287 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:35 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T23:59:35.287 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:35 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T23:59:35.287 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:35 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:59:35.287 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:35 smithi111 ceph-mon[27539]: Reconfiguring daemon mon.smithi203 on smithi203 2024-09-10T23:59:35.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:35 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:35.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:35 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:35.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:35 smithi203 ceph-mon[33225]: Reconfiguring mon.smithi203 (monmap changed)... 2024-09-10T23:59:35.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:35 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T23:59:35.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:35 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T23:59:35.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:35 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:59:35.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:35 smithi203 ceph-mon[33225]: Reconfiguring daemon mon.smithi203 on smithi203 2024-09-10T23:59:36.049 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:36 smithi111 ceph-mon[27539]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:36.049 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:36 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:36.049 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:36 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:36.049 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:36 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T23:59:36.049 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:36 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi111.front.sepia.ceph.com:9093"}]: dispatch 2024-09-10T23:59:36.050 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:36 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:36.050 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:36 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T23:59:36.050 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:36 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi111.front.sepia.ceph.com:3000"}]: dispatch 2024-09-10T23:59:36.050 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:36 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:36.050 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:36 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T23:59:36.050 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:36 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi111.front.sepia.ceph.com:9095"}]: dispatch 2024-09-10T23:59:36.050 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:36 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:36.050 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:36 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T23:59:36.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:36 smithi203 ceph-mon[33225]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:36.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:36 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:36.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:36 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:36.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:36 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T23:59:36.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:36 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi111.front.sepia.ceph.com:9093"}]: dispatch 2024-09-10T23:59:36.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:36 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:36.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:36 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T23:59:36.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:36 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi111.front.sepia.ceph.com:3000"}]: dispatch 2024-09-10T23:59:36.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:36 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:36.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:36 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T23:59:36.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:36 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi111.front.sepia.ceph.com:9095"}]: dispatch 2024-09-10T23:59:36.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:36 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:36.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:36 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T23:59:37.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:37 smithi111 ceph-mon[27539]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T23:59:37.216 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:37 smithi111 ceph-mon[27539]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi111.front.sepia.ceph.com:9093"}]: dispatch 2024-09-10T23:59:37.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:37 smithi111 ceph-mon[27539]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T23:59:37.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:37 smithi111 ceph-mon[27539]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi111.front.sepia.ceph.com:3000"}]: dispatch 2024-09-10T23:59:37.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:37 smithi111 ceph-mon[27539]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T23:59:37.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:37 smithi111 ceph-mon[27539]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi111.front.sepia.ceph.com:9095"}]: dispatch 2024-09-10T23:59:37.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:37 smithi203 ceph-mon[33225]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T23:59:37.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:37 smithi203 ceph-mon[33225]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi111.front.sepia.ceph.com:9093"}]: dispatch 2024-09-10T23:59:37.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:37 smithi203 ceph-mon[33225]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T23:59:37.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:37 smithi203 ceph-mon[33225]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi111.front.sepia.ceph.com:3000"}]: dispatch 2024-09-10T23:59:37.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:37 smithi203 ceph-mon[33225]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T23:59:37.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:37 smithi203 ceph-mon[33225]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi111.front.sepia.ceph.com:9095"}]: dispatch 2024-09-10T23:59:38.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:38 smithi203 ceph-mon[33225]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:38.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:38 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:38.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:38 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:38.296 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:38 smithi111 ceph-mon[27539]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:38.296 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:38 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:38.296 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:38 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:39.312 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:39 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:39.313 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:39 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:39.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:39 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:39.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:39 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:40.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:40 smithi111 ceph-mon[27539]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:40.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:40 smithi203 ceph-mon[33225]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:42.336 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:42 smithi111 ceph-mon[27539]: pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:42.336 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:42 smithi111 ceph-mon[27539]: from='osd.0 [v2:172.21.15.111:6802/905671165,v1:172.21.15.111:6803/905671165]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T23:59:42.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:42.411+0000 7fa484c00700 1 -- 172.21.15.111:0/44103049 <== mgr.14211 v2:172.21.15.111:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa488107650 con 0x7fa46c06c610 2024-09-10T23:59:42.413 INFO:teuthology.orchestra.run.smithi111.stdout:Created osd(s) 0 on host 'smithi111' 2024-09-10T23:59:42.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:42.413+0000 7fa48f200700 1 -- 172.21.15.111:0/44103049 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fa46c06c610 msgr2=0x7fa46c06eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:42.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:42.413+0000 7fa48f200700 1 --2- 172.21.15.111:0/44103049 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fa46c06c610 0x7fa46c06eac0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa474005f50 tx=0x7fa474005ea0 comp rx=0 tx=0).stop 2024-09-10T23:59:42.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:42.413+0000 7fa48f200700 1 -- 172.21.15.111:0/44103049 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4880737b0 msgr2=0x7fa488197c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:42.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:42.413+0000 7fa48f200700 1 --2- 172.21.15.111:0/44103049 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4880737b0 0x7fa488197c60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa47800b4b0 tx=0x7fa47800b870 comp rx=0 tx=0).stop 2024-09-10T23:59:42.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:42.413+0000 7fa48f200700 1 -- 172.21.15.111:0/44103049 shutdown_connections 2024-09-10T23:59:42.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:42.413+0000 7fa48f200700 1 --2- 172.21.15.111:0/44103049 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fa46c06c610 0x7fa46c06eac0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:42.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:42.413+0000 7fa48f200700 1 --2- 172.21.15.111:0/44103049 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4880737b0 0x7fa488197c60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:42.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:42.413+0000 7fa48f200700 1 --2- 172.21.15.111:0/44103049 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa488074d80 0x7fa4881981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:42.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:42.413+0000 7fa48f200700 1 -- 172.21.15.111:0/44103049 >> 172.21.15.111:0/44103049 conn(0x7fa4880fb6e0 msgr2=0x7fa488105f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:42.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:42.413+0000 7fa48f200700 1 -- 172.21.15.111:0/44103049 shutdown_connections 2024-09-10T23:59:42.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:42.413+0000 7fa48f200700 1 -- 172.21.15.111:0/44103049 wait complete. 2024-09-10T23:59:42.482 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:42 smithi203 ceph-mon[33225]: pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:42.482 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:42 smithi203 ceph-mon[33225]: from='osd.0 [v2:172.21.15.111:6802/905671165,v1:172.21.15.111:6803/905671165]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T23:59:43.183 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:43 smithi111 ceph-mon[27539]: from='osd.0 [v2:172.21.15.111:6802/905671165,v1:172.21.15.111:6803/905671165]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T23:59:43.183 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:43 smithi111 ceph-mon[27539]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T23:59:43.184 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:43 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T23:59:43.184 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:43 smithi111 ceph-mon[27539]: from='osd.0 [v2:172.21.15.111:6802/905671165,v1:172.21.15.111:6803/905671165]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-09-10T23:59:43.184 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:43 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:43.184 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:43 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:43.184 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:43 smithi111 ceph-mon[27539]: from='osd.0 [v2:172.21.15.111:6802/905671165,v1:172.21.15.111:6803/905671165]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-09-10T23:59:43.184 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:43 smithi111 ceph-mon[27539]: osdmap e8: 1 total, 0 up, 1 in 2024-09-10T23:59:43.184 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:43 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T23:59:43.212 DEBUG:teuthology.orchestra.run.smithi111:osd.0> sudo journalctl -f -n 0 -u ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.0.service 2024-09-10T23:59:43.216 INFO:tasks.cephadm:Deploying osd.1 on smithi111 with /dev/vg_nvme/lv_3... 2024-09-10T23:59:43.216 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T23:59:43.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:43 smithi203 ceph-mon[33225]: from='osd.0 [v2:172.21.15.111:6802/905671165,v1:172.21.15.111:6803/905671165]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T23:59:43.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:43 smithi203 ceph-mon[33225]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T23:59:43.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:43 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T23:59:43.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:43 smithi203 ceph-mon[33225]: from='osd.0 [v2:172.21.15.111:6802/905671165,v1:172.21.15.111:6803/905671165]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-09-10T23:59:43.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:43 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:43.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:43 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:43.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:43 smithi203 ceph-mon[33225]: from='osd.0 [v2:172.21.15.111:6802/905671165,v1:172.21.15.111:6803/905671165]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-09-10T23:59:43.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:43 smithi203 ceph-mon[33225]: osdmap e8: 1 total, 0 up, 1 in 2024-09-10T23:59:43.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:43 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T23:59:44.116 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-10T23:59:44.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:44 smithi111 ceph-mon[27539]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:44.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:44 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T23:59:44.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:44 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:44.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:44 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:44.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:44 smithi203 ceph-mon[33225]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:44.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:44 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T23:59:44.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:44 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:44.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:44 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:45.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:45 smithi111 ceph-mon[27539]: purged_snaps scrub starts 2024-09-10T23:59:45.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:45 smithi111 ceph-mon[27539]: purged_snaps scrub ok 2024-09-10T23:59:45.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:45 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T23:59:45.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:45 smithi111 ceph-mon[27539]: osd.0 [v2:172.21.15.111:6802/905671165,v1:172.21.15.111:6803/905671165] boot 2024-09-10T23:59:45.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:45 smithi111 ceph-mon[27539]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T23:59:45.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:45 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T23:59:45.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:45 smithi203 ceph-mon[33225]: purged_snaps scrub starts 2024-09-10T23:59:45.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:45 smithi203 ceph-mon[33225]: purged_snaps scrub ok 2024-09-10T23:59:45.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:45 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T23:59:45.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:45 smithi203 ceph-mon[33225]: osd.0 [v2:172.21.15.111:6802/905671165,v1:172.21.15.111:6803/905671165] boot 2024-09-10T23:59:45.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:45 smithi203 ceph-mon[33225]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T23:59:45.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:45 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T23:59:46.225 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:46 smithi111 ceph-mon[27539]: pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:46.225 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:46 smithi111 ceph-mon[27539]: osdmap e10: 1 total, 1 up, 1 in 2024-09-10T23:59:46.225 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:46 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T23:59:46.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:46 smithi203 ceph-mon[33225]: pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T23:59:46.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:46 smithi203 ceph-mon[33225]: osdmap e10: 1 total, 1 up, 1 in 2024-09-10T23:59:46.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:46 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T23:59:47.357 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-10T23:59:47.380 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi111:vg_nvme/lv_3 2024-09-10T23:59:47.908 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-10T23:59:48.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:48 smithi111 ceph-mon[27539]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:59:48.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:48 smithi203 ceph-mon[33225]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:59:49.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:49 smithi111 ceph-mon[27539]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:59:50.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:49 smithi203 ceph-mon[33225]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:59:50.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.686+0000 7f4d7bc00700 1 -- 172.21.15.111:0/445652835 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4d74100150 msgr2=0x7f4d74100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:50.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.686+0000 7f4d7bc00700 1 --2- 172.21.15.111:0/445652835 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4d74100150 0x7f4d74100560 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4d68009910 tx=0x7f4d68009c20 comp rx=0 tx=0).stop 2024-09-10T23:59:50.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.686+0000 7f4d7bc00700 1 -- 172.21.15.111:0/445652835 shutdown_connections 2024-09-10T23:59:50.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.686+0000 7f4d7bc00700 1 --2- 172.21.15.111:0/445652835 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d74101350 0x7f4d741017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:50.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.686+0000 7f4d7bc00700 1 --2- 172.21.15.111:0/445652835 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4d74100150 0x7f4d74100560 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:50.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.686+0000 7f4d7bc00700 1 -- 172.21.15.111:0/445652835 >> 172.21.15.111:0/445652835 conn(0x7f4d740fb6e0 msgr2=0x7f4d740fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:59:50.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.686+0000 7f4d7bc00700 1 -- 172.21.15.111:0/445652835 shutdown_connections 2024-09-10T23:59:50.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.686+0000 7f4d7bc00700 1 -- 172.21.15.111:0/445652835 wait complete. 2024-09-10T23:59:50.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.687+0000 7f4d7bc00700 1 Processor -- start 2024-09-10T23:59:50.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.687+0000 7f4d7bc00700 1 -- start start 2024-09-10T23:59:50.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.688+0000 7f4d7bc00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d74100150 0x7f4d74195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:50.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.688+0000 7f4d7bc00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4d74101350 0x7f4d74195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:50.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.688+0000 7f4d7bc00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d74196580 con 0x7f4d74101350 2024-09-10T23:59:50.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.688+0000 7f4d7bc00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d741966c0 con 0x7f4d74100150 2024-09-10T23:59:50.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.688+0000 7f4d73e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4d74101350 0x7f4d74195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:50.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.688+0000 7f4d79200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d74100150 0x7f4d74195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:50.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.688+0000 7f4d73e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4d74101350 0x7f4d74195f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53286/0 (socket says 172.21.15.111:53286) 2024-09-10T23:59:50.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.688+0000 7f4d73e00700 1 -- 172.21.15.111:0/2479132000 learned_addr learned my addr 172.21.15.111:0/2479132000 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-10T23:59:50.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.688+0000 7f4d73e00700 1 -- 172.21.15.111:0/2479132000 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d74100150 msgr2=0x7f4d74195a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:59:50.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.688+0000 7f4d73e00700 1 --2- 172.21.15.111:0/2479132000 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d74100150 0x7f4d74195a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:59:50.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.688+0000 7f4d73e00700 1 -- 172.21.15.111:0/2479132000 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d680095f0 con 0x7f4d74101350 2024-09-10T23:59:50.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.689+0000 7f4d73e00700 1 --2- 172.21.15.111:0/2479132000 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4d74101350 0x7f4d74195f60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000b4b0 tx=0x7f4d6000b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:50.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.689+0000 7f4d71600700 1 -- 172.21.15.111:0/2479132000 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d60011800 con 0x7f4d74101350 2024-09-10T23:59:50.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.689+0000 7f4d7bc00700 1 -- 172.21.15.111:0/2479132000 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7419b170 con 0x7f4d74101350 2024-09-10T23:59:50.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.689+0000 7f4d71600700 1 -- 172.21.15.111:0/2479132000 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4d60011e10 con 0x7f4d74101350 2024-09-10T23:59:50.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.689+0000 7f4d71600700 1 -- 172.21.15.111:0/2479132000 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d6000f2e0 con 0x7f4d74101350 2024-09-10T23:59:50.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.689+0000 7f4d7bc00700 1 -- 172.21.15.111:0/2479132000 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7419b740 con 0x7f4d74101350 2024-09-10T23:59:50.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.690+0000 7f4d7bc00700 1 -- 172.21.15.111:0/2479132000 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d74108d20 con 0x7f4d74101350 2024-09-10T23:59:50.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.691+0000 7f4d71600700 1 -- 172.21.15.111:0/2479132000 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) v1 ==== 89860+0+0 (secure 0 0 0) 0x7f4d60010380 con 0x7f4d74101350 2024-09-10T23:59:50.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.692+0000 7f4d71600700 1 --2- 172.21.15.111:0/2479132000 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f4d5c06c600 0x7f4d5c06eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:59:50.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.692+0000 7f4d71600700 1 -- 172.21.15.111:0/2479132000 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1810+0+0 (secure 0 0 0) 0x7f4d6008a550 con 0x7f4d74101350 2024-09-10T23:59:50.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.692+0000 7f4d79200700 1 --2- 172.21.15.111:0/2479132000 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f4d5c06c600 0x7f4d5c06eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:59:50.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.693+0000 7f4d79200700 1 --2- 172.21.15.111:0/2479132000 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f4d5c06c600 0x7f4d5c06eab0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4d68006010 tx=0x7f4d68005280 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:59:50.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.701+0000 7f4d71600700 1 -- 172.21.15.111:0/2479132000 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4d60059580 con 0x7f4d74101350 2024-09-10T23:59:50.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-10T23:59:50.922+0000 7f4d7bc00700 1 -- 172.21.15.111:0/2479132000 --> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d74105ca0 con 0x7f4d5c06c600 2024-09-10T23:59:51.482 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:51 smithi111 ceph-mon[27539]: Detected new or changed devices on smithi111 2024-09-10T23:59:51.482 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:51 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:51.482 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:51 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:51.482 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:51 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T23:59:51.482 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:51 smithi111 ceph-mon[27539]: Adjusting osd_memory_target on smithi111 to 11841M 2024-09-10T23:59:51.483 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:51 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:51.483 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:51 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:59:51.483 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:51 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T23:59:51.483 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:51 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:51.483 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:51 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T23:59:51.483 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:51 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T23:59:51.483 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:51 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T23:59:51.483 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:51 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:59:51.488 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:51 smithi203 ceph-mon[33225]: Detected new or changed devices on smithi111 2024-09-10T23:59:51.488 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:51 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:51.488 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:51 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:51.488 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:51 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T23:59:51.488 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:51 smithi203 ceph-mon[33225]: Adjusting osd_memory_target on smithi111 to 11841M 2024-09-10T23:59:51.488 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:51 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:51.489 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:51 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:59:51.489 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:51 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T23:59:51.489 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:51 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:51.489 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:51 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T23:59:51.489 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:51 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T23:59:51.489 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:51 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T23:59:51.489 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:51 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:59:52.496 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:52 smithi203 ceph-mon[33225]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:59:52.496 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:52 smithi203 ceph-mon[33225]: from='client.14342 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:59:52.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:52 smithi111 ceph-mon[27539]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:59:52.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:52 smithi111 ceph-mon[27539]: from='client.14342 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T23:59:54.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:53 smithi111 ceph-mon[27539]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:59:54.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:53 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:54.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:53 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:54.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:53 smithi203 ceph-mon[33225]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:59:54.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:53 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:54.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:53 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:56.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:55 smithi111 ceph-mon[27539]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:59:56.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:55 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/4258046877' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b7f9f82-fe27-46d4-a478-d88ed6ea074b"}]: dispatch 2024-09-10T23:59:56.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:55 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/4258046877' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b7f9f82-fe27-46d4-a478-d88ed6ea074b"}]': finished 2024-09-10T23:59:56.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:55 smithi111 ceph-mon[27539]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T23:59:56.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:55 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T23:59:56.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:55 smithi203 ceph-mon[33225]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:59:56.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:55 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/4258046877' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b7f9f82-fe27-46d4-a478-d88ed6ea074b"}]: dispatch 2024-09-10T23:59:56.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:55 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/4258046877' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b7f9f82-fe27-46d4-a478-d88ed6ea074b"}]': finished 2024-09-10T23:59:56.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:55 smithi203 ceph-mon[33225]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T23:59:56.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:55 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T23:59:57.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:56 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/3709268634' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T23:59:57.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:56 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:57.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:56 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:57.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:56 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:59:57.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:56 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T23:59:57.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:56 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:57.196 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:56 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/3709268634' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T23:59:57.196 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:56 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:57.196 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:56 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:57.196 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:56 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T23:59:57.196 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:56 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T23:59:57.196 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:56 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-10T23:59:57.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:57 smithi111 ceph-mon[27539]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:59:58.217 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:57 smithi203 ceph-mon[33225]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T23:59:59.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 10 23:59:59 smithi111 ceph-mon[27539]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:00:00.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 10 23:59:59 smithi203 ceph-mon[33225]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:00:00.900 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:00 smithi111 ceph-mon[27539]: overall HEALTH_OK 2024-09-11T00:00:01.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:00 smithi203 ceph-mon[33225]: overall HEALTH_OK 2024-09-11T00:00:01.793 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:01 smithi111 ceph-mon[27539]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:00:01.794 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:01 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:00:02.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:01 smithi203 ceph-mon[33225]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:00:02.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:01 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:00:03.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:03 smithi111 ceph-mon[27539]: pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:00:04.130 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:03 smithi203 ceph-mon[33225]: pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:00:04.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:04 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-11T00:00:04.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:04 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:00:04.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:04 smithi111 ceph-mon[27539]: Deploying daemon osd.1 on smithi111 2024-09-11T00:00:05.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:04 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-11T00:00:05.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:04 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:00:05.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:04 smithi203 ceph-mon[33225]: Deploying daemon osd.1 on smithi111 2024-09-11T00:00:05.987 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:05 smithi111 ceph-mon[27539]: pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:00:06.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:05 smithi203 ceph-mon[33225]: pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:00:07.780 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:07 smithi111 ceph-mon[27539]: pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:00:07.794 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:07 smithi203 ceph-mon[33225]: pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:00:09.750 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:09 smithi203 ceph-mon[33225]: pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:00:09.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:09 smithi111 ceph-mon[27539]: pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:00:11.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:11 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:11.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:11 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:11.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:11 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:00:11.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:11 smithi111 ceph-mon[27539]: pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:00:11.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:11 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:11.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:11 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:11.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:11 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:00:11.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:11 smithi203 ceph-mon[33225]: pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:00:14.162 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:13 smithi111 ceph-mon[27539]: pgmap v80: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:00:14.163 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:13 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:14.163 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:13 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:14.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:13 smithi203 ceph-mon[33225]: pgmap v80: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:00:14.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:13 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:14.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:13 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:14.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:14.689+0000 7f4d71600700 1 -- 172.21.15.111:0/2479132000 <== mgr.14211 v2:172.21.15.111:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4d74105ca0 con 0x7f4d5c06c600 2024-09-11T00:00:14.690 INFO:teuthology.orchestra.run.smithi111.stdout:Created osd(s) 1 on host 'smithi111' 2024-09-11T00:00:14.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:14.691+0000 7f4d7bc00700 1 -- 172.21.15.111:0/2479132000 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f4d5c06c600 msgr2=0x7f4d5c06eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:14.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:14.691+0000 7f4d7bc00700 1 --2- 172.21.15.111:0/2479132000 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f4d5c06c600 0x7f4d5c06eab0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4d68006010 tx=0x7f4d68005280 comp rx=0 tx=0).stop 2024-09-11T00:00:14.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:14.691+0000 7f4d7bc00700 1 -- 172.21.15.111:0/2479132000 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4d74101350 msgr2=0x7f4d74195f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:14.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:14.691+0000 7f4d7bc00700 1 --2- 172.21.15.111:0/2479132000 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4d74101350 0x7f4d74195f60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000b4b0 tx=0x7f4d6000b7c0 comp rx=0 tx=0).stop 2024-09-11T00:00:14.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:14.692+0000 7f4d7bc00700 1 -- 172.21.15.111:0/2479132000 shutdown_connections 2024-09-11T00:00:14.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:14.692+0000 7f4d7bc00700 1 --2- 172.21.15.111:0/2479132000 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f4d5c06c600 0x7f4d5c06eab0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:14.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:14.692+0000 7f4d7bc00700 1 --2- 172.21.15.111:0/2479132000 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d74100150 0x7f4d74195a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:14.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:14.692+0000 7f4d7bc00700 1 --2- 172.21.15.111:0/2479132000 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4d74101350 0x7f4d74195f60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:14.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:14.692+0000 7f4d7bc00700 1 -- 172.21.15.111:0/2479132000 >> 172.21.15.111:0/2479132000 conn(0x7f4d740fb6e0 msgr2=0x7f4d74104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:14.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:14.692+0000 7f4d7bc00700 1 -- 172.21.15.111:0/2479132000 shutdown_connections 2024-09-11T00:00:14.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:14.692+0000 7f4d7bc00700 1 -- 172.21.15.111:0/2479132000 wait complete. 2024-09-11T00:00:14.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:14 smithi111 ceph-mon[27539]: from='osd.1 [v2:172.21.15.111:6810/1146454471,v1:172.21.15.111:6811/1146454471]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T00:00:14.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:14 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:14.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:14 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:15.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:14 smithi203 ceph-mon[33225]: from='osd.1 [v2:172.21.15.111:6810/1146454471,v1:172.21.15.111:6811/1146454471]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T00:00:15.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:14 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:15.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:14 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:15.651 DEBUG:teuthology.orchestra.run.smithi111:osd.1> sudo journalctl -f -n 0 -u ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.1.service 2024-09-11T00:00:15.656 INFO:tasks.cephadm:Deploying osd.2 on smithi111 with /dev/vg_nvme/lv_2... 2024-09-11T00:00:15.656 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-11T00:00:15.870 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:15 smithi111 ceph-mon[27539]: pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:00:15.871 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:15 smithi111 ceph-mon[27539]: from='osd.1 [v2:172.21.15.111:6810/1146454471,v1:172.21.15.111:6811/1146454471]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T00:00:16.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:15 smithi111 ceph-mon[27539]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T00:00:16.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:15 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T00:00:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:15 smithi111 ceph-mon[27539]: from='osd.1 [v2:172.21.15.111:6810/1146454471,v1:172.21.15.111:6811/1146454471]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-09-11T00:00:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:15 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:00:16.153 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:00:15 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1[50714]: 2024-09-11T00:00:15.872+0000 7f9d23e00700 -1 osd.1 0 waiting for initial osdmap 2024-09-11T00:00:16.153 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:00:15 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1[50714]: 2024-09-11T00:00:15.877+0000 7f9d1cc00700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:00:16.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:15 smithi203 ceph-mon[33225]: pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:00:16.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:15 smithi203 ceph-mon[33225]: from='osd.1 [v2:172.21.15.111:6810/1146454471,v1:172.21.15.111:6811/1146454471]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T00:00:16.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:15 smithi203 ceph-mon[33225]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T00:00:16.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:15 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T00:00:16.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:15 smithi203 ceph-mon[33225]: from='osd.1 [v2:172.21.15.111:6810/1146454471,v1:172.21.15.111:6811/1146454471]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-09-11T00:00:16.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:15 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:00:16.481 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:00:17.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:16 smithi111 ceph-mon[27539]: from='osd.1 [v2:172.21.15.111:6810/1146454471,v1:172.21.15.111:6811/1146454471]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-09-11T00:00:17.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:16 smithi111 ceph-mon[27539]: osdmap e13: 2 total, 1 up, 2 in 2024-09-11T00:00:17.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:16 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T00:00:17.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:16 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T00:00:17.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:16 smithi203 ceph-mon[33225]: from='osd.1 [v2:172.21.15.111:6810/1146454471,v1:172.21.15.111:6811/1146454471]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-09-11T00:00:17.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:16 smithi203 ceph-mon[33225]: osdmap e13: 2 total, 1 up, 2 in 2024-09-11T00:00:17.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:16 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T00:00:17.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:16 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T00:00:18.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:17 smithi111 ceph-mon[27539]: purged_snaps scrub starts 2024-09-11T00:00:18.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:17 smithi111 ceph-mon[27539]: purged_snaps scrub ok 2024-09-11T00:00:18.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:17 smithi111 ceph-mon[27539]: pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:00:18.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:17 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T00:00:18.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:17 smithi111 ceph-mon[27539]: osd.1 [v2:172.21.15.111:6810/1146454471,v1:172.21.15.111:6811/1146454471] boot 2024-09-11T00:00:18.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:17 smithi111 ceph-mon[27539]: osdmap e14: 2 total, 2 up, 2 in 2024-09-11T00:00:18.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:17 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T00:00:18.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:17 smithi203 ceph-mon[33225]: purged_snaps scrub starts 2024-09-11T00:00:18.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:17 smithi203 ceph-mon[33225]: purged_snaps scrub ok 2024-09-11T00:00:18.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:17 smithi203 ceph-mon[33225]: pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:00:18.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:17 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T00:00:18.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:17 smithi203 ceph-mon[33225]: osd.1 [v2:172.21.15.111:6810/1146454471,v1:172.21.15.111:6811/1146454471] boot 2024-09-11T00:00:18.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:17 smithi203 ceph-mon[33225]: osdmap e14: 2 total, 2 up, 2 in 2024-09-11T00:00:18.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:17 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T00:00:19.142 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:18 smithi111 ceph-mon[27539]: osdmap e15: 2 total, 2 up, 2 in 2024-09-11T00:00:19.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:18 smithi203 ceph-mon[33225]: osdmap e15: 2 total, 2 up, 2 in 2024-09-11T00:00:20.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:19 smithi111 ceph-mon[27539]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:20.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:19 smithi203 ceph-mon[33225]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:20.385 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:00:20.411 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi111:vg_nvme/lv_2 2024-09-11T00:00:21.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:21 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:21.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:21 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:21.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:21 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:21.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:21 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:21.840 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:00:22.121 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:22 smithi111 ceph-mon[27539]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:22.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:22 smithi203 ceph-mon[33225]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:24.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:24 smithi111 ceph-mon[27539]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:24.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:24 smithi203 ceph-mon[33225]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:24.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.936+0000 7f194ea00700 1 -- 172.21.15.111:0/856651759 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19480737b0 msgr2=0x7f1948073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:24.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.936+0000 7f194ea00700 1 --2- 172.21.15.111:0/856651759 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19480737b0 0x7f1948073c20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1934009940 tx=0x7f1934009c50 comp rx=0 tx=0).stop 2024-09-11T00:00:24.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.936+0000 7f194ea00700 1 -- 172.21.15.111:0/856651759 shutdown_connections 2024-09-11T00:00:24.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.936+0000 7f194ea00700 1 --2- 172.21.15.111:0/856651759 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19480737b0 0x7f1948073c20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:24.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.936+0000 7f194ea00700 1 --2- 172.21.15.111:0/856651759 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1948074d80 0x7f19480731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:24.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.936+0000 7f194ea00700 1 -- 172.21.15.111:0/856651759 >> 172.21.15.111:0/856651759 conn(0x7f19480fb6e0 msgr2=0x7f19480fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:24.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.936+0000 7f194ea00700 1 -- 172.21.15.111:0/856651759 shutdown_connections 2024-09-11T00:00:24.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.936+0000 7f194ea00700 1 -- 172.21.15.111:0/856651759 wait complete. 2024-09-11T00:00:24.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.937+0000 7f194ea00700 1 Processor -- start 2024-09-11T00:00:24.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.938+0000 7f194ea00700 1 -- start start 2024-09-11T00:00:24.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.938+0000 7f194ea00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19480737b0 0x7f1948197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:24.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.938+0000 7f194ea00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1948074d80 0x7f19481980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:24.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.938+0000 7f194ea00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19481986c0 con 0x7f1948074d80 2024-09-11T00:00:24.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.938+0000 7f194ea00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1948198800 con 0x7f19480737b0 2024-09-11T00:00:24.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.938+0000 7f1947400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1948074d80 0x7f19481980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:24.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.938+0000 7f1947400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1948074d80 0x7f19481980a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:36776/0 (socket says 172.21.15.111:36776) 2024-09-11T00:00:24.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.938+0000 7f1947e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19480737b0 0x7f1948197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:24.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.938+0000 7f1947400700 1 -- 172.21.15.111:0/3891420187 learned_addr learned my addr 172.21.15.111:0/3891420187 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:00:24.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.939+0000 7f1947400700 1 -- 172.21.15.111:0/3891420187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19480737b0 msgr2=0x7f1948197b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:24.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.939+0000 7f1947400700 1 --2- 172.21.15.111:0/3891420187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19480737b0 0x7f1948197b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:24.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.939+0000 7f1947400700 1 -- 172.21.15.111:0/3891420187 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19340095f0 con 0x7f1948074d80 2024-09-11T00:00:24.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.939+0000 7f1947400700 1 --2- 172.21.15.111:0/3891420187 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1948074d80 0x7f19481980a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f19340055f0 tx=0x7f1934005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:24.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.939+0000 7f1944c00700 1 -- 172.21.15.111:0/3891420187 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f193401d070 con 0x7f1948074d80 2024-09-11T00:00:24.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.939+0000 7f1944c00700 1 -- 172.21.15.111:0/3891420187 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f193400f460 con 0x7f1948074d80 2024-09-11T00:00:24.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.939+0000 7f194ea00700 1 -- 172.21.15.111:0/3891420187 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f194819d250 con 0x7f1948074d80 2024-09-11T00:00:24.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.939+0000 7f1944c00700 1 -- 172.21.15.111:0/3891420187 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1934021640 con 0x7f1948074d80 2024-09-11T00:00:24.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.940+0000 7f194ea00700 1 -- 172.21.15.111:0/3891420187 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f194819d740 con 0x7f1948074d80 2024-09-11T00:00:24.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.941+0000 7f194ea00700 1 -- 172.21.15.111:0/3891420187 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f194810ae90 con 0x7f1948074d80 2024-09-11T00:00:24.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.942+0000 7f1944c00700 1 -- 172.21.15.111:0/3891420187 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) v1 ==== 89860+0+0 (secure 0 0 0) 0x7f193400fab0 con 0x7f1948074d80 2024-09-11T00:00:24.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.943+0000 7f1944c00700 1 --2- 172.21.15.111:0/3891420187 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f192c06c600 0x7f192c06eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:24.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.943+0000 7f1944c00700 1 -- 172.21.15.111:0/3891420187 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2242+0+0 (secure 0 0 0) 0x7f193408be80 con 0x7f1948074d80 2024-09-11T00:00:24.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.943+0000 7f1947e00700 1 --2- 172.21.15.111:0/3891420187 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f192c06c600 0x7f192c06eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:24.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.944+0000 7f1947e00700 1 --2- 172.21.15.111:0/3891420187 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f192c06c600 0x7f192c06eab0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1938007c60 tx=0x7f19380073d0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:24.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:24.948+0000 7f1944c00700 1 -- 172.21.15.111:0/3891420187 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f193405acc0 con 0x7f1948074d80 2024-09-11T00:00:25.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:25.166+0000 7f194ea00700 1 -- 172.21.15.111:0/3891420187 --> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f1948107650 con 0x7f192c06c600 2024-09-11T00:00:25.726 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:25 smithi203 ceph-mon[33225]: Detected new or changed devices on smithi111 2024-09-11T00:00:25.726 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:25 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:25.726 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:25 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:25.726 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:25 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:00:25.726 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:25 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:00:25.727 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:25 smithi203 ceph-mon[33225]: Adjusting osd_memory_target on smithi111 to 5920M 2024-09-11T00:00:25.727 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:25 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:25.727 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:25 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:00:25.727 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:25 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:00:25.727 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:25 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:25.727 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:25 smithi203 ceph-mon[33225]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:25.727 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:25 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:00:25.727 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:25 smithi203 ceph-mon[33225]: from='client.14360 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:00:25.727 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:25 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T00:00:25.727 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:25 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T00:00:25.727 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:25 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:00:25.772 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:25 smithi111 ceph-mon[27539]: Detected new or changed devices on smithi111 2024-09-11T00:00:25.772 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:25 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:25.772 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:25 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:25.772 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:25 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:00:25.773 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:25 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:00:25.773 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:25 smithi111 ceph-mon[27539]: Adjusting osd_memory_target on smithi111 to 5920M 2024-09-11T00:00:25.773 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:25 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:25.773 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:25 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:00:25.773 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:25 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:00:25.773 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:25 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:25.773 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:25 smithi111 ceph-mon[27539]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:25.773 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:25 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:00:25.773 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:25 smithi111 ceph-mon[27539]: from='client.14360 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:00:25.773 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:25 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T00:00:25.773 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:25 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T00:00:25.773 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:25 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:00:28.237 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:28 smithi111 ceph-mon[27539]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:28.237 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:28 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:28.237 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:28 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:28.253 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:28 smithi203 ceph-mon[33225]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:28.253 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:28 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:28.253 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:28 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:29.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:29 smithi111 ceph-mon[27539]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:29.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:29 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/1940294261' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "68de9f31-9af1-4fd7-a724-3249f4ff2660"}]: dispatch 2024-09-11T00:00:29.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:29 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/1940294261' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "68de9f31-9af1-4fd7-a724-3249f4ff2660"}]': finished 2024-09-11T00:00:29.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:29 smithi111 ceph-mon[27539]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T00:00:29.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:29 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T00:00:30.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:29 smithi203 ceph-mon[33225]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:30.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:29 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/1940294261' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "68de9f31-9af1-4fd7-a724-3249f4ff2660"}]: dispatch 2024-09-11T00:00:30.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:29 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/1940294261' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "68de9f31-9af1-4fd7-a724-3249f4ff2660"}]': finished 2024-09-11T00:00:30.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:29 smithi203 ceph-mon[33225]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T00:00:30.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:29 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T00:00:31.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:30 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/1315542865' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T00:00:31.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:30 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/1315542865' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T00:00:32.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:31 smithi203 ceph-mon[33225]: pgmap v94: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:32.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:31 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:00:32.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:31 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:32.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:31 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:32.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:31 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:00:32.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:31 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:00:32.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:31 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:32.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:31 smithi111 ceph-mon[27539]: pgmap v94: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:32.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:31 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:00:32.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:31 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:32.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:31 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:32.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:31 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:00:32.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:31 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:00:32.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:31 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:34.014 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:33 smithi111 ceph-mon[27539]: pgmap v95: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:34.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:33 smithi203 ceph-mon[33225]: pgmap v95: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:36.027 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:35 smithi111 ceph-mon[27539]: pgmap v96: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:36.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:35 smithi203 ceph-mon[33225]: pgmap v96: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:38.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:37 smithi203 ceph-mon[33225]: pgmap v97: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:38.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:37 smithi111 ceph-mon[27539]: pgmap v97: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:39.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:38 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-11T00:00:39.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:38 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:00:39.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:38 smithi203 ceph-mon[33225]: Deploying daemon osd.2 on smithi111 2024-09-11T00:00:39.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:38 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-11T00:00:39.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:38 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:00:39.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:38 smithi111 ceph-mon[27539]: Deploying daemon osd.2 on smithi111 2024-09-11T00:00:39.794 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:39 smithi203 ceph-mon[33225]: pgmap v98: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:39.972 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:39 smithi111 ceph-mon[27539]: pgmap v98: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:41.945 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:41 smithi111 ceph-mon[27539]: pgmap v99: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:42.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:41 smithi203 ceph-mon[33225]: pgmap v99: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:43.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:43 smithi111 ceph-mon[27539]: pgmap v100: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:44.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:43 smithi203 ceph-mon[33225]: pgmap v100: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:46.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:45 smithi111 ceph-mon[27539]: pgmap v101: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:46.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:45 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:46.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:45 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:46.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:45 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:00:46.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:45 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:00:46.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:45 smithi203 ceph-mon[33225]: pgmap v101: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:46.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:45 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:46.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:45 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:46.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:45 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:00:46.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:45 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:00:47.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:47 smithi111 ceph-mon[27539]: pgmap v102: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:48.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:47 smithi203 ceph-mon[33225]: pgmap v102: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:49.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:49.434+0000 7f1944c00700 1 -- 172.21.15.111:0/3891420187 <== mgr.14211 v2:172.21.15.111:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1948107650 con 0x7f192c06c600 2024-09-11T00:00:49.436 INFO:teuthology.orchestra.run.smithi111.stdout:Created osd(s) 2 on host 'smithi111' 2024-09-11T00:00:49.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:49.436+0000 7f194ea00700 1 -- 172.21.15.111:0/3891420187 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f192c06c600 msgr2=0x7f192c06eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:49.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:49.436+0000 7f194ea00700 1 --2- 172.21.15.111:0/3891420187 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f192c06c600 0x7f192c06eab0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1938007c60 tx=0x7f19380073d0 comp rx=0 tx=0).stop 2024-09-11T00:00:49.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:49.436+0000 7f194ea00700 1 -- 172.21.15.111:0/3891420187 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1948074d80 msgr2=0x7f19481980a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:49.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:49.436+0000 7f194ea00700 1 --2- 172.21.15.111:0/3891420187 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1948074d80 0x7f19481980a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f19340055f0 tx=0x7f1934005620 comp rx=0 tx=0).stop 2024-09-11T00:00:49.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:49.436+0000 7f194ea00700 1 -- 172.21.15.111:0/3891420187 shutdown_connections 2024-09-11T00:00:49.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:49.436+0000 7f194ea00700 1 --2- 172.21.15.111:0/3891420187 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f192c06c600 0x7f192c06eab0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:49.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:49.436+0000 7f194ea00700 1 --2- 172.21.15.111:0/3891420187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19480737b0 0x7f1948197b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:49.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:49.436+0000 7f194ea00700 1 --2- 172.21.15.111:0/3891420187 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1948074d80 0x7f19481980a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:49.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:49.436+0000 7f194ea00700 1 -- 172.21.15.111:0/3891420187 >> 172.21.15.111:0/3891420187 conn(0x7f19480fb6e0 msgr2=0x7f1948105f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:49.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:49.437+0000 7f194ea00700 1 -- 172.21.15.111:0/3891420187 shutdown_connections 2024-09-11T00:00:49.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:00:49.437+0000 7f194ea00700 1 -- 172.21.15.111:0/3891420187 wait complete. 2024-09-11T00:00:49.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:49 smithi111 ceph-mon[27539]: pgmap v103: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:49.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:49 smithi111 ceph-mon[27539]: from='osd.2 [v2:172.21.15.111:6818/39993762,v1:172.21.15.111:6819/39993762]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T00:00:49.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:49 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:49.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:49 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:50.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:49 smithi203 ceph-mon[33225]: pgmap v103: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:50.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:49 smithi203 ceph-mon[33225]: from='osd.2 [v2:172.21.15.111:6818/39993762,v1:172.21.15.111:6819/39993762]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T00:00:50.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:49 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:50.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:49 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:50.123 DEBUG:teuthology.orchestra.run.smithi111:osd.2> sudo journalctl -f -n 0 -u ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.2.service 2024-09-11T00:00:50.128 INFO:tasks.cephadm:Deploying osd.3 on smithi203 with /dev/vg_nvme/lv_4... 2024-09-11T00:00:50.128 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-11T00:00:50.447 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi203/config 2024-09-11T00:00:50.850 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:50 smithi203 ceph-mon[33225]: from='osd.2 [v2:172.21.15.111:6818/39993762,v1:172.21.15.111:6819/39993762]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T00:00:50.850 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:50 smithi203 ceph-mon[33225]: osdmap e17: 3 total, 2 up, 3 in 2024-09-11T00:00:50.850 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:50 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T00:00:50.850 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:50 smithi203 ceph-mon[33225]: from='osd.2 [v2:172.21.15.111:6818/39993762,v1:172.21.15.111:6819/39993762]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-09-11T00:00:50.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:50 smithi111 ceph-mon[27539]: from='osd.2 [v2:172.21.15.111:6818/39993762,v1:172.21.15.111:6819/39993762]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T00:00:50.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:50 smithi111 ceph-mon[27539]: osdmap e17: 3 total, 2 up, 3 in 2024-09-11T00:00:50.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:50 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T00:00:50.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:50 smithi111 ceph-mon[27539]: from='osd.2 [v2:172.21.15.111:6818/39993762,v1:172.21.15.111:6819/39993762]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-09-11T00:00:50.903 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:00:50 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2[56116]: 2024-09-11T00:00:50.654+0000 7fcb29800700 -1 osd.2 0 waiting for initial osdmap 2024-09-11T00:00:50.903 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:00:50 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2[56116]: 2024-09-11T00:00:50.660+0000 7fcb20800700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:00:51.846 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:51 smithi203 ceph-mon[33225]: pgmap v105: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:51.847 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:51 smithi203 ceph-mon[33225]: from='osd.2 [v2:172.21.15.111:6818/39993762,v1:172.21.15.111:6819/39993762]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-09-11T00:00:51.847 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:51 smithi203 ceph-mon[33225]: osdmap e18: 3 total, 2 up, 3 in 2024-09-11T00:00:51.847 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:51 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T00:00:51.847 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:51 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T00:00:51.991 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:51 smithi111 ceph-mon[27539]: pgmap v105: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:51.991 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:51 smithi111 ceph-mon[27539]: from='osd.2 [v2:172.21.15.111:6818/39993762,v1:172.21.15.111:6819/39993762]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-09-11T00:00:51.991 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:51 smithi111 ceph-mon[27539]: osdmap e18: 3 total, 2 up, 3 in 2024-09-11T00:00:51.991 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:51 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T00:00:51.991 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:51 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T00:00:53.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:52 smithi203 ceph-mon[33225]: purged_snaps scrub starts 2024-09-11T00:00:53.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:52 smithi203 ceph-mon[33225]: purged_snaps scrub ok 2024-09-11T00:00:53.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:52 smithi203 ceph-mon[33225]: osd.2 [v2:172.21.15.111:6818/39993762,v1:172.21.15.111:6819/39993762] boot 2024-09-11T00:00:53.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:52 smithi203 ceph-mon[33225]: osdmap e19: 3 total, 3 up, 3 in 2024-09-11T00:00:53.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:52 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T00:00:53.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:52 smithi111 ceph-mon[27539]: purged_snaps scrub starts 2024-09-11T00:00:53.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:52 smithi111 ceph-mon[27539]: purged_snaps scrub ok 2024-09-11T00:00:53.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:52 smithi111 ceph-mon[27539]: osd.2 [v2:172.21.15.111:6818/39993762,v1:172.21.15.111:6819/39993762] boot 2024-09-11T00:00:53.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:52 smithi111 ceph-mon[27539]: osdmap e19: 3 total, 3 up, 3 in 2024-09-11T00:00:53.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:52 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T00:00:53.455 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T00:00:53.480 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi203:vg_nvme/lv_4 2024-09-11T00:00:53.791 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi203/config 2024-09-11T00:00:53.794 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:53 smithi203 ceph-mon[33225]: pgmap v108: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:53.794 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:53 smithi203 ceph-mon[33225]: osdmap e20: 3 total, 3 up, 3 in 2024-09-11T00:00:53.794 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:53 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-11T00:00:53.794 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:53 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:53.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:53 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:54.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:53 smithi111 ceph-mon[27539]: pgmap v108: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:00:54.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:53 smithi111 ceph-mon[27539]: osdmap e20: 3 total, 3 up, 3 in 2024-09-11T00:00:54.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:53 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-11T00:00:54.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:53 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:54.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:53 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:54.913 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:54 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-11T00:00:54.913 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:54 smithi111 ceph-mon[27539]: osdmap e21: 3 total, 3 up, 3 in 2024-09-11T00:00:54.913 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:54 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T00:00:54.934 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:54 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-11T00:00:54.934 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:54 smithi203 ceph-mon[33225]: osdmap e21: 3 total, 3 up, 3 in 2024-09-11T00:00:54.934 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:54 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T00:00:55.470 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.467+0000 7f2657c00700 1 -- 172.21.15.203:0/333187118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2650074d20 msgr2=0x7f2650073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:55.470 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.467+0000 7f2657c00700 1 --2- 172.21.15.203:0/333187118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2650074d20 0x7f2650073180 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2644009910 tx=0x7f2644009c20 comp rx=0 tx=0).stop 2024-09-11T00:00:55.471 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.467+0000 7f2657c00700 1 -- 172.21.15.203:0/333187118 shutdown_connections 2024-09-11T00:00:55.471 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.467+0000 7f2657c00700 1 --2- 172.21.15.203:0/333187118 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2650073750 0x7f2650073bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.471 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.467+0000 7f2657c00700 1 --2- 172.21.15.203:0/333187118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2650074d20 0x7f2650073180 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.471 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.467+0000 7f2657c00700 1 -- 172.21.15.203:0/333187118 >> 172.21.15.203:0/333187118 conn(0x7f26500fb6e0 msgr2=0x7f26500fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:00:55.471 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.467+0000 7f2657c00700 1 -- 172.21.15.203:0/333187118 shutdown_connections 2024-09-11T00:00:55.471 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.468+0000 7f2657c00700 1 -- 172.21.15.203:0/333187118 wait complete. 2024-09-11T00:00:55.471 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.468+0000 7f2657c00700 1 Processor -- start 2024-09-11T00:00:55.472 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.469+0000 7f2657c00700 1 -- start start 2024-09-11T00:00:55.473 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.469+0000 7f2657c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2650073750 0x7f2650197b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:55.473 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.469+0000 7f2657c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2650074d20 0x7f26501980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:55.473 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.469+0000 7f2657c00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26501986e0 con 0x7f2650074d20 2024-09-11T00:00:55.473 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.469+0000 7f2657c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2650198820 con 0x7f2650073750 2024-09-11T00:00:55.473 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.469+0000 7f2655200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2650073750 0x7f2650197b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:55.473 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.469+0000 7f2655200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2650073750 0x7f2650197b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:38304/0 (socket says 172.21.15.203:38304) 2024-09-11T00:00:55.473 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.469+0000 7f2655200700 1 -- 172.21.15.203:0/1819298015 learned_addr learned my addr 172.21.15.203:0/1819298015 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-11T00:00:55.473 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.469+0000 7f264fe00700 1 --2- 172.21.15.203:0/1819298015 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2650074d20 0x7f26501980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:55.473 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.469+0000 7f2655200700 1 -- 172.21.15.203:0/1819298015 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2650074d20 msgr2=0x7f26501980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:00:55.473 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.469+0000 7f2655200700 1 --2- 172.21.15.203:0/1819298015 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2650074d20 0x7f26501980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:00:55.473 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.469+0000 7f2655200700 1 -- 172.21.15.203:0/1819298015 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26440095f0 con 0x7f2650073750 2024-09-11T00:00:55.474 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.470+0000 7f2655200700 1 --2- 172.21.15.203:0/1819298015 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2650073750 0x7f2650197b80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f26440092e0 tx=0x7f264400f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:55.474 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.470+0000 7f264d600700 1 -- 172.21.15.203:0/1819298015 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f264401d070 con 0x7f2650073750 2024-09-11T00:00:55.474 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.470+0000 7f264d600700 1 -- 172.21.15.203:0/1819298015 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2644005dc0 con 0x7f2650073750 2024-09-11T00:00:55.474 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.470+0000 7f264d600700 1 -- 172.21.15.203:0/1819298015 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2644017630 con 0x7f2650073750 2024-09-11T00:00:55.474 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.470+0000 7f2657c00700 1 -- 172.21.15.203:0/1819298015 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f265019d270 con 0x7f2650073750 2024-09-11T00:00:55.474 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.470+0000 7f2657c00700 1 -- 172.21.15.203:0/1819298015 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f265019d760 con 0x7f2650073750 2024-09-11T00:00:55.474 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.471+0000 7f2657c00700 1 -- 172.21.15.203:0/1819298015 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f265010aeb0 con 0x7f2650073750 2024-09-11T00:00:55.475 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.472+0000 7f264d600700 1 -- 172.21.15.203:0/1819298015 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 18) v1 ==== 89860+0+0 (secure 0 0 0) 0x7f264400faf0 con 0x7f2650073750 2024-09-11T00:00:55.476 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.474+0000 7f264d600700 1 --2- 172.21.15.203:0/1819298015 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f263806c600 0x7f263806eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:00:55.476 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.474+0000 7f264d600700 1 -- 172.21.15.203:0/1819298015 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3060+0+0 (secure 0 0 0) 0x7f264408c260 con 0x7f2650073750 2024-09-11T00:00:55.476 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.474+0000 7f264fe00700 1 --2- 172.21.15.203:0/1819298015 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f263806c600 0x7f263806eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:00:55.477 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.475+0000 7f264fe00700 1 --2- 172.21.15.203:0/1819298015 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f263806c600 0x7f263806eab0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f263c009c60 tx=0x7f263c009260 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:00:55.481 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.480+0000 7f264d600700 1 -- 172.21.15.203:0/1819298015 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f264405adf0 con 0x7f2650073750 2024-09-11T00:00:55.687 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:55.685+0000 7f2657c00700 1 -- 172.21.15.203:0/1819298015 --> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f26501076d0 con 0x7f263806c600 2024-09-11T00:00:55.794 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:55 smithi203 ceph-mon[33225]: pgmap v111: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:00:55.794 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:55 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T00:00:55.794 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:55 smithi203 ceph-mon[33225]: osdmap e22: 3 total, 3 up, 3 in 2024-09-11T00:00:55.941 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:55 smithi111 ceph-mon[27539]: pgmap v111: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:00:55.941 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:55 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T00:00:55.941 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:55 smithi111 ceph-mon[27539]: osdmap e22: 3 total, 3 up, 3 in 2024-09-11T00:00:56.220 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:00:55 smithi111 sudo[58076]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:00:56.220 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:00:55 smithi111 sudo[58076]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:00:56.220 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:00:55 smithi111 sudo[58076]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-11T00:00:56.220 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:00:55 smithi111 sudo[58076]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:00:56.903 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:00:56 smithi111 sudo[58085]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:00:56.903 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:00:56 smithi111 sudo[58085]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:00:56.903 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:00:56 smithi111 sudo[58085]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-11T00:00:56.903 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:00:56 smithi111 sudo[58085]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:00:56.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:56 smithi111 ceph-mon[27539]: from='client.24197 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:00:56.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:56 smithi111 ceph-mon[27539]: osdmap e23: 3 total, 3 up, 3 in 2024-09-11T00:00:56.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:56 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T00:00:56.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:56 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T00:00:56.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:56 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:00:56.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:56 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:57.020 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:56 smithi203 ceph-mon[33225]: from='client.24197 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:00:57.021 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:56 smithi203 ceph-mon[33225]: osdmap e23: 3 total, 3 up, 3 in 2024-09-11T00:00:57.021 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:56 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T00:00:57.021 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:56 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T00:00:57.021 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:56 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:00:57.021 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:56 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:57.294 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:00:57 smithi111 sudo[58471]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:00:57.294 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:00:57 smithi111 sudo[58471]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:00:57.294 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:00:57 smithi111 sudo[58471]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-11T00:00:57.294 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:00:57 smithi111 sudo[58471]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:00:57.547 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:00:57.545+0000 7f264d600700 1 -- 172.21.15.203:0/1819298015 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f2644057730 con 0x7f2650073750 2024-09-11T00:00:57.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:57 smithi111 ceph-mon[27539]: pgmap v114: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:00:57.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:57 smithi111 ceph-mon[27539]: mgrmap e19: smithi111.ypucji(active, since 3m), standbys: smithi203.smuspl 2024-09-11T00:00:57.902 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:00:57 smithi111 sudo[58477]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:00:57.903 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:00:57 smithi111 sudo[58477]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:00:57.903 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:00:57 smithi111 sudo[58477]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-11T00:00:57.903 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:00:57 smithi111 sudo[58477]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:00:58.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:57 smithi203 ceph-mon[33225]: pgmap v114: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:00:58.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:57 smithi203 ceph-mon[33225]: mgrmap e19: smithi111.ypucji(active, since 3m), standbys: smithi203.smuspl 2024-09-11T00:00:58.652 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:00:58 smithi111 sudo[58578]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:00:58.652 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:00:58 smithi111 sudo[58578]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:00:58.652 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:00:58 smithi111 sudo[58578]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-11T00:00:58.652 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:00:58 smithi111 sudo[58578]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:00:59.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:58 smithi203 ceph-mon[33225]: Detected new or changed devices on smithi111 2024-09-11T00:00:59.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:58 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:59.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:58 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:59.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:58 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:00:59.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:58 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:00:59.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:58 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:00:59.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:58 smithi203 ceph-mon[33225]: Adjusting osd_memory_target on smithi111 to 3947M 2024-09-11T00:00:59.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:58 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:59.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:58 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:00:59.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:58 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:00:59.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:58 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:59.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:58 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:00:59.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:58 smithi203 ceph-mon[33225]: from='client.? 172.21.15.203:0/933572334' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "315ef72a-7cb4-48d9-b4d7-2ee54fd230e2"}]: dispatch 2024-09-11T00:00:59.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:58 smithi203 ceph-mon[33225]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "315ef72a-7cb4-48d9-b4d7-2ee54fd230e2"}]: dispatch 2024-09-11T00:00:59.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:58 smithi203 ceph-mon[33225]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "315ef72a-7cb4-48d9-b4d7-2ee54fd230e2"}]': finished 2024-09-11T00:00:59.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:58 smithi203 ceph-mon[33225]: osdmap e24: 4 total, 3 up, 4 in 2024-09-11T00:00:59.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:00:58 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T00:00:59.101 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:00:58 smithi111 sudo[58664]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:00:59.101 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:00:58 smithi111 sudo[58664]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:00:59.101 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:00:58 smithi111 sudo[58664]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-11T00:00:59.101 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:00:58 smithi111 sudo[58664]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:00:59.101 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:58 smithi111 ceph-mon[27539]: Detected new or changed devices on smithi111 2024-09-11T00:00:59.101 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:58 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:59.102 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:58 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:59.102 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:58 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:00:59.102 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:58 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:00:59.102 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:58 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:00:59.102 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:58 smithi111 ceph-mon[27539]: Adjusting osd_memory_target on smithi111 to 3947M 2024-09-11T00:00:59.102 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:58 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:59.102 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:58 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:00:59.102 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:58 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:00:59.102 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:58 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:00:59.102 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:58 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:00:59.102 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:58 smithi111 ceph-mon[27539]: from='client.? 172.21.15.203:0/933572334' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "315ef72a-7cb4-48d9-b4d7-2ee54fd230e2"}]: dispatch 2024-09-11T00:00:59.102 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:58 smithi111 ceph-mon[27539]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "315ef72a-7cb4-48d9-b4d7-2ee54fd230e2"}]: dispatch 2024-09-11T00:00:59.102 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:58 smithi111 ceph-mon[27539]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "315ef72a-7cb4-48d9-b4d7-2ee54fd230e2"}]': finished 2024-09-11T00:00:59.103 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:58 smithi111 ceph-mon[27539]: osdmap e24: 4 total, 3 up, 4 in 2024-09-11T00:00:59.103 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:58 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T00:00:59.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:59 smithi111 sudo[58683]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:00:59.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:59 smithi111 sudo[58683]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:00:59.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:59 smithi111 sudo[58683]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-11T00:00:59.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:59 smithi111 sudo[58683]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:01:00.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:59 smithi111 sudo[58784]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:01:00.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:59 smithi111 sudo[58784]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:01:00.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:59 smithi111 sudo[58784]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-11T00:01:00.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:00:59 smithi111 sudo[58784]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:01:00.794 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:00 smithi203 sudo[37423]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:01:00.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:00 smithi203 sudo[37423]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:01:00.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:00 smithi203 sudo[37423]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-11T00:01:00.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:00 smithi203 sudo[37423]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:01:01.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:00 smithi111 ceph-mon[27539]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:01:01.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:00 smithi111 ceph-mon[27539]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:01:01.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:00 smithi111 ceph-mon[27539]: from='client.? 172.21.15.203:0/3392273089' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T00:01:01.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:00 smithi111 ceph-mon[27539]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:01:01.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:00 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-11T00:01:01.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:00 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-09-11T00:01:01.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:00 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-11T00:01:01.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:00 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-09-11T00:01:01.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:00 smithi203 sudo[37614]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:01:01.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:00 smithi203 sudo[37614]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:01:01.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:00 smithi203 sudo[37614]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-11T00:01:01.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:00 smithi203 sudo[37614]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:01:01.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:00 smithi203 ceph-mon[33225]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:01:01.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:00 smithi203 ceph-mon[33225]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:01:01.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:00 smithi203 ceph-mon[33225]: from='client.? 172.21.15.203:0/3392273089' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T00:01:01.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:00 smithi203 ceph-mon[33225]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:01:01.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:00 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-11T00:01:01.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:00 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-09-11T00:01:01.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:00 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-11T00:01:01.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:00 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-09-11T00:01:02.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:01 smithi111 ceph-mon[27539]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:01:02.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:01 smithi111 ceph-mon[27539]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:01:02.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:01 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:01:02.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:01 smithi111 ceph-mon[27539]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:01:02.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:01 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:02.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:01 smithi203 ceph-mon[33225]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:01:02.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:01 smithi203 ceph-mon[33225]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:01:02.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:01 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:01:02.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:01 smithi203 ceph-mon[33225]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:01:02.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:01 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:04.393 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:04 smithi203 ceph-mon[33225]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:01:04.393 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:04 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:04.393 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:04 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:04.394 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:04 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:01:04.394 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:04 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:01:04.394 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:04 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:04.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:04 smithi111 ceph-mon[27539]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:01:04.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:04 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:04.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:04 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:04.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:04 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:01:04.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:04 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:01:04.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:04 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:06.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:06 smithi111 ceph-mon[27539]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-11T00:01:06.403 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:06 smithi203 ceph-mon[33225]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-11T00:01:07.374 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:07 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-11T00:01:07.374 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:07 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:01:07.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:07 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-11T00:01:07.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:07 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:01:08.381 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:08 smithi203 ceph-mon[33225]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-11T00:01:08.381 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:08 smithi203 ceph-mon[33225]: Deploying daemon osd.3 on smithi203 2024-09-11T00:01:08.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:08 smithi111 ceph-mon[27539]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-11T00:01:08.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:08 smithi111 ceph-mon[27539]: Deploying daemon osd.3 on smithi203 2024-09-11T00:01:09.899 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:09 smithi203 ceph-mon[33225]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-11T00:01:10.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:09 smithi111 ceph-mon[27539]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-11T00:01:12.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:11 smithi203 ceph-mon[33225]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-11T00:01:12.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:11 smithi111 ceph-mon[27539]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-11T00:01:14.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:14 smithi111 ceph-mon[27539]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-11T00:01:14.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:14 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:14.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:14 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:14.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:14 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:01:14.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:14 smithi203 ceph-mon[33225]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-11T00:01:14.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:14 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:14.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:14 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:14.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:14 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:01:16.356 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:16 smithi203 ceph-mon[33225]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-11T00:01:16.357 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:16 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:01:16.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:16 smithi111 ceph-mon[27539]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-11T00:01:16.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:16 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:01:17.309 INFO:teuthology.orchestra.run.smithi203.stdout:Created osd(s) 3 on host 'smithi203' 2024-09-11T00:01:17.310 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:17.308+0000 7f264d600700 1 -- 172.21.15.203:0/1819298015 <== mgr.14211 v2:172.21.15.111:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f26501076d0 con 0x7f263806c600 2024-09-11T00:01:17.312 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:17.310+0000 7f2657c00700 1 -- 172.21.15.203:0/1819298015 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f263806c600 msgr2=0x7f263806eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:17.312 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:17.310+0000 7f2657c00700 1 --2- 172.21.15.203:0/1819298015 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f263806c600 0x7f263806eab0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f263c009c60 tx=0x7f263c009260 comp rx=0 tx=0).stop 2024-09-11T00:01:17.312 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:17.310+0000 7f2657c00700 1 -- 172.21.15.203:0/1819298015 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2650073750 msgr2=0x7f2650197b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:17.312 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:17.310+0000 7f2657c00700 1 --2- 172.21.15.203:0/1819298015 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2650073750 0x7f2650197b80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f26440092e0 tx=0x7f264400f690 comp rx=0 tx=0).stop 2024-09-11T00:01:17.312 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:17.310+0000 7f2657c00700 1 -- 172.21.15.203:0/1819298015 shutdown_connections 2024-09-11T00:01:17.312 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:17.310+0000 7f2657c00700 1 --2- 172.21.15.203:0/1819298015 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f263806c600 0x7f263806eab0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:17.312 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:17.310+0000 7f2657c00700 1 --2- 172.21.15.203:0/1819298015 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2650073750 0x7f2650197b80 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:17.312 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:17.310+0000 7f2657c00700 1 --2- 172.21.15.203:0/1819298015 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2650074d20 0x7f26501980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:17.312 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:17.310+0000 7f2657c00700 1 -- 172.21.15.203:0/1819298015 >> 172.21.15.203:0/1819298015 conn(0x7f26500fb6e0 msgr2=0x7f2650105fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:17.312 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:17.311+0000 7f2657c00700 1 -- 172.21.15.203:0/1819298015 shutdown_connections 2024-09-11T00:01:17.313 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:17.311+0000 7f2657c00700 1 -- 172.21.15.203:0/1819298015 wait complete. 2024-09-11T00:01:17.927 DEBUG:teuthology.orchestra.run.smithi203:osd.3> sudo journalctl -f -n 0 -u ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.3.service 2024-09-11T00:01:17.931 INFO:tasks.cephadm:Deploying osd.4 on smithi203 with /dev/vg_nvme/lv_3... 2024-09-11T00:01:17.931 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-11T00:01:18.273 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:18 smithi203 ceph-mon[33225]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:01:18.273 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:18 smithi203 ceph-mon[33225]: from='osd.3 [v2:172.21.15.203:6800/684842797,v1:172.21.15.203:6801/684842797]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T00:01:18.273 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:18 smithi203 ceph-mon[33225]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T00:01:18.273 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:18 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:18.273 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:18 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:18.273 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:18 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:18.273 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:18 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:18.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:18 smithi111 ceph-mon[27539]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:01:18.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:18 smithi111 ceph-mon[27539]: from='osd.3 [v2:172.21.15.203:6800/684842797,v1:172.21.15.203:6801/684842797]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T00:01:18.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:18 smithi111 ceph-mon[27539]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T00:01:18.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:18 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:18.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:18 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:18.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:18 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:18.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:18 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:19.209 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:19 smithi203 ceph-mon[33225]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T00:01:19.209 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:19 smithi203 ceph-mon[33225]: osdmap e25: 4 total, 3 up, 4 in 2024-09-11T00:01:19.210 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:19 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T00:01:19.210 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:19 smithi203 ceph-mon[33225]: from='osd.3 [v2:172.21.15.203:6800/684842797,v1:172.21.15.203:6801/684842797]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-11T00:01:19.210 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:19 smithi203 ceph-mon[33225]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-11T00:01:19.210 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:01:19 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3[39248]: 2024-09-11T00:01:19.119+0000 7f0d25400700 -1 osd.3 0 waiting for initial osdmap 2024-09-11T00:01:19.210 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:01:19 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3[39248]: 2024-09-11T00:01:19.126+0000 7f0d1ba00700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:01:19.276 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi203/config 2024-09-11T00:01:19.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:19 smithi111 ceph-mon[27539]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T00:01:19.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:19 smithi111 ceph-mon[27539]: osdmap e25: 4 total, 3 up, 4 in 2024-09-11T00:01:19.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:19 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T00:01:19.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:19 smithi111 ceph-mon[27539]: from='osd.3 [v2:172.21.15.203:6800/684842797,v1:172.21.15.203:6801/684842797]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-11T00:01:19.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:19 smithi111 ceph-mon[27539]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-11T00:01:20.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:20 smithi111 ceph-mon[27539]: purged_snaps scrub starts 2024-09-11T00:01:20.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:20 smithi111 ceph-mon[27539]: purged_snaps scrub ok 2024-09-11T00:01:20.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:20 smithi111 ceph-mon[27539]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:01:20.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:20 smithi111 ceph-mon[27539]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-11T00:01:20.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:20 smithi111 ceph-mon[27539]: osdmap e26: 4 total, 3 up, 4 in 2024-09-11T00:01:20.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:20 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T00:01:20.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:20 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T00:01:20.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:20 smithi111 ceph-mon[27539]: osd.3 [v2:172.21.15.203:6800/684842797,v1:172.21.15.203:6801/684842797] boot 2024-09-11T00:01:20.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:20 smithi111 ceph-mon[27539]: osdmap e27: 4 total, 4 up, 4 in 2024-09-11T00:01:20.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:20 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T00:01:20.451 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:20 smithi203 ceph-mon[33225]: purged_snaps scrub starts 2024-09-11T00:01:20.451 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:20 smithi203 ceph-mon[33225]: purged_snaps scrub ok 2024-09-11T00:01:20.451 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:20 smithi203 ceph-mon[33225]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:01:20.451 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:20 smithi203 ceph-mon[33225]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-11T00:01:20.452 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:20 smithi203 ceph-mon[33225]: osdmap e26: 4 total, 3 up, 4 in 2024-09-11T00:01:20.452 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:20 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T00:01:20.452 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:20 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T00:01:20.452 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:20 smithi203 ceph-mon[33225]: osd.3 [v2:172.21.15.203:6800/684842797,v1:172.21.15.203:6801/684842797] boot 2024-09-11T00:01:20.452 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:20 smithi203 ceph-mon[33225]: osdmap e27: 4 total, 4 up, 4 in 2024-09-11T00:01:20.452 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:20 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T00:01:22.382 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:22 smithi203 ceph-mon[33225]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-11T00:01:22.383 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:22 smithi203 ceph-mon[33225]: osdmap e28: 4 total, 4 up, 4 in 2024-09-11T00:01:22.383 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:22 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:22.383 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:22 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:22.383 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:22 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:01:22.383 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:22 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:22.383 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:22 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:01:22.383 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:22 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:01:22.383 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:22 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:22.383 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:22 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:01:22.383 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:22 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:01:22.383 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:22 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:01:22.384 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:22 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:22.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:22 smithi111 ceph-mon[27539]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-11T00:01:22.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:22 smithi111 ceph-mon[27539]: osdmap e28: 4 total, 4 up, 4 in 2024-09-11T00:01:22.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:22 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:22.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:22 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:22.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:22 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:01:22.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:22 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:22.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:22 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:01:22.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:22 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:01:22.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:22 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:22.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:22 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:01:22.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:22 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:01:22.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:22 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:01:22.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:22 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:23.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:23 smithi111 ceph-mon[27539]: Detected new or changed devices on smithi203 2024-09-11T00:01:23.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:23 smithi111 ceph-mon[27539]: Adjusting osd_memory_target on smithi203 to 14913M 2024-09-11T00:01:23.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:23 smithi111 ceph-mon[27539]: osdmap e29: 4 total, 4 up, 4 in 2024-09-11T00:01:23.507 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:23 smithi203 ceph-mon[33225]: Detected new or changed devices on smithi203 2024-09-11T00:01:23.507 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:23 smithi203 ceph-mon[33225]: Adjusting osd_memory_target on smithi203 to 14913M 2024-09-11T00:01:23.507 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:23 smithi203 ceph-mon[33225]: osdmap e29: 4 total, 4 up, 4 in 2024-09-11T00:01:23.514 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T00:01:23.539 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi203:vg_nvme/lv_3 2024-09-11T00:01:23.856 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi203/config 2024-09-11T00:01:24.244 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:24 smithi203 ceph-mon[33225]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-11T00:01:24.244 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:24 smithi203 ceph-mon[33225]: osdmap e30: 4 total, 4 up, 4 in 2024-09-11T00:01:24.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:24 smithi111 ceph-mon[27539]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-11T00:01:24.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:24 smithi111 ceph-mon[27539]: osdmap e30: 4 total, 4 up, 4 in 2024-09-11T00:01:25.181 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:25 smithi203 ceph-mon[33225]: osdmap e31: 4 total, 4 up, 4 in 2024-09-11T00:01:25.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:25 smithi111 ceph-mon[27539]: osdmap e31: 4 total, 4 up, 4 in 2024-09-11T00:01:25.604 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.602+0000 7fe803c00700 1 -- 172.21.15.203:0/3696326146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7fc103580 msgr2=0x7fe7fc1039d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:25.604 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.602+0000 7fe803c00700 1 --2- 172.21.15.203:0/3696326146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7fc103580 0x7fe7fc1039d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8009910 tx=0x7fe7e8009c20 comp rx=0 tx=0).stop 2024-09-11T00:01:25.605 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.602+0000 7fe803c00700 1 -- 172.21.15.203:0/3696326146 shutdown_connections 2024-09-11T00:01:25.605 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.602+0000 7fe803c00700 1 --2- 172.21.15.203:0/3696326146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7fc103580 0x7fe7fc1039d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:25.605 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.602+0000 7fe803c00700 1 --2- 172.21.15.203:0/3696326146 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe7fc102380 0x7fe7fc102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:25.605 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.602+0000 7fe803c00700 1 -- 172.21.15.203:0/3696326146 >> 172.21.15.203:0/3696326146 conn(0x7fe7fc0fd930 msgr2=0x7fe7fc0ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:25.605 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.602+0000 7fe803c00700 1 -- 172.21.15.203:0/3696326146 shutdown_connections 2024-09-11T00:01:25.605 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.602+0000 7fe803c00700 1 -- 172.21.15.203:0/3696326146 wait complete. 2024-09-11T00:01:25.606 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.603+0000 7fe803c00700 1 Processor -- start 2024-09-11T00:01:25.606 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.604+0000 7fe803c00700 1 -- start start 2024-09-11T00:01:25.607 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.604+0000 7fe803c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7fc102380 0x7fe7fc197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:25.607 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.604+0000 7fe803c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe7fc103580 0x7fe7fc198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:25.607 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.604+0000 7fe803c00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc1986b0 con 0x7fe7fc103580 2024-09-11T00:01:25.607 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.604+0000 7fe803c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc1987f0 con 0x7fe7fc102380 2024-09-11T00:01:25.607 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.604+0000 7fe801200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7fc102380 0x7fe7fc197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:25.607 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.604+0000 7fe801200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7fc102380 0x7fe7fc197b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:55758/0 (socket says 172.21.15.203:55758) 2024-09-11T00:01:25.607 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.604+0000 7fe801200700 1 -- 172.21.15.203:0/2522427616 learned_addr learned my addr 172.21.15.203:0/2522427616 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-11T00:01:25.607 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.605+0000 7fe7fbe00700 1 --2- 172.21.15.203:0/2522427616 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe7fc103580 0x7fe7fc198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:25.607 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.605+0000 7fe801200700 1 -- 172.21.15.203:0/2522427616 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe7fc103580 msgr2=0x7fe7fc198090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:25.607 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.605+0000 7fe801200700 1 --2- 172.21.15.203:0/2522427616 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe7fc103580 0x7fe7fc198090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:25.607 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.605+0000 7fe801200700 1 -- 172.21.15.203:0/2522427616 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e80095f0 con 0x7fe7fc102380 2024-09-11T00:01:25.607 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.605+0000 7fe801200700 1 --2- 172.21.15.203:0/2522427616 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7fc102380 0x7fe7fc197b50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe7f000d900 tx=0x7fe7f000dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:25.608 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.605+0000 7fe7f9600700 1 -- 172.21.15.203:0/2522427616 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7f00041f0 con 0x7fe7fc102380 2024-09-11T00:01:25.608 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.605+0000 7fe7f9600700 1 -- 172.21.15.203:0/2522427616 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe7f0004350 con 0x7fe7fc102380 2024-09-11T00:01:25.608 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.605+0000 7fe803c00700 1 -- 172.21.15.203:0/2522427616 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7fc19d2a0 con 0x7fe7fc102380 2024-09-11T00:01:25.608 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.605+0000 7fe7f9600700 1 -- 172.21.15.203:0/2522427616 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7f0003da0 con 0x7fe7fc102380 2024-09-11T00:01:25.608 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.605+0000 7fe803c00700 1 -- 172.21.15.203:0/2522427616 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7fc19d7f0 con 0x7fe7fc102380 2024-09-11T00:01:25.608 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.606+0000 7fe803c00700 1 -- 172.21.15.203:0/2522427616 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7fc10aed0 con 0x7fe7fc102380 2024-09-11T00:01:25.608 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.607+0000 7fe7f9600700 1 -- 172.21.15.203:0/2522427616 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fe7f0009730 con 0x7fe7fc102380 2024-09-11T00:01:25.609 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.608+0000 7fe7f9600700 1 --2- 172.21.15.203:0/2522427616 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fe7e406c680 0x7fe7e406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:25.609 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.608+0000 7fe7f9600700 1 -- 172.21.15.203:0/2522427616 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 3602+0+0 (secure 0 0 0) 0x7fe7f008b3b0 con 0x7fe7fc102380 2024-09-11T00:01:25.610 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.609+0000 7fe7fbe00700 1 --2- 172.21.15.203:0/2522427616 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fe7e406c680 0x7fe7e406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:25.610 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.609+0000 7fe7fbe00700 1 --2- 172.21.15.203:0/2522427616 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fe7e406c680 0x7fe7e406eb30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8006010 tx=0x7fe7e800b540 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:25.614 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.613+0000 7fe7f9600700 1 -- 172.21.15.203:0/2522427616 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe7f0059bc0 con 0x7fe7fc102380 2024-09-11T00:01:25.821 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:25.820+0000 7fe803c00700 1 -- 172.21.15.203:0/2522427616 --> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7fc107ed0 con 0x7fe7e406c680 2024-09-11T00:01:26.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:26 smithi111 ceph-mon[27539]: pgmap v136: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-11T00:01:26.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:26 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T00:01:26.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:26 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T00:01:26.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:26 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:01:26.477 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:26 smithi203 ceph-mon[33225]: pgmap v136: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-11T00:01:26.477 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:26 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T00:01:26.477 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:26 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T00:01:26.477 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:26 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:01:27.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:27 smithi111 ceph-mon[27539]: from='client.24217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:01:27.449 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:27 smithi203 ceph-mon[33225]: from='client.24217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:01:28.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:28 smithi203 ceph-mon[33225]: pgmap v137: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-09-11T00:01:28.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:28 smithi111 ceph-mon[27539]: pgmap v137: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-09-11T00:01:30.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:29 smithi203 ceph-mon[33225]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-11T00:01:30.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:29 smithi203 ceph-mon[33225]: from='client.? 172.21.15.203:0/1402244996' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "166b7f5c-1c8c-4873-acfa-eceee13741eb"}]: dispatch 2024-09-11T00:01:30.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:29 smithi203 ceph-mon[33225]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "166b7f5c-1c8c-4873-acfa-eceee13741eb"}]: dispatch 2024-09-11T00:01:30.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:29 smithi203 ceph-mon[33225]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "166b7f5c-1c8c-4873-acfa-eceee13741eb"}]': finished 2024-09-11T00:01:30.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:29 smithi203 ceph-mon[33225]: osdmap e32: 5 total, 4 up, 5 in 2024-09-11T00:01:30.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:29 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T00:01:30.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:29 smithi203 ceph-mon[33225]: from='client.? 172.21.15.203:0/3587777493' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T00:01:30.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:29 smithi111 ceph-mon[27539]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-11T00:01:30.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:29 smithi111 ceph-mon[27539]: from='client.? 172.21.15.203:0/1402244996' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "166b7f5c-1c8c-4873-acfa-eceee13741eb"}]: dispatch 2024-09-11T00:01:30.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:29 smithi111 ceph-mon[27539]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "166b7f5c-1c8c-4873-acfa-eceee13741eb"}]: dispatch 2024-09-11T00:01:30.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:29 smithi111 ceph-mon[27539]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "166b7f5c-1c8c-4873-acfa-eceee13741eb"}]': finished 2024-09-11T00:01:30.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:29 smithi111 ceph-mon[27539]: osdmap e32: 5 total, 4 up, 5 in 2024-09-11T00:01:30.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:29 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T00:01:30.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:29 smithi111 ceph-mon[27539]: from='client.? 172.21.15.203:0/3587777493' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T00:01:32.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:31 smithi203 ceph-mon[33225]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-11T00:01:32.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:31 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:01:32.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:31 smithi111 ceph-mon[27539]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-11T00:01:32.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:31 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:01:34.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:33 smithi203 ceph-mon[33225]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-11T00:01:34.050 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:33 smithi111 ceph-mon[27539]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-11T00:01:35.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:35 smithi203 ceph-mon[33225]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-11T00:01:36.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:35 smithi111 ceph-mon[27539]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-11T00:01:37.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:37 smithi111 ceph-mon[27539]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-11T00:01:37.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:37 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-11T00:01:37.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:37 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:01:37.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:37 smithi111 ceph-mon[27539]: Deploying daemon osd.4 on smithi203 2024-09-11T00:01:38.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:37 smithi203 ceph-mon[33225]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-11T00:01:38.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:37 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-11T00:01:38.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:37 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:01:38.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:37 smithi203 ceph-mon[33225]: Deploying daemon osd.4 on smithi203 2024-09-11T00:01:39.919 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:39 smithi203 ceph-mon[33225]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-11T00:01:40.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:39 smithi111 ceph-mon[27539]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-11T00:01:41.949 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:41 smithi203 ceph-mon[33225]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-11T00:01:42.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:41 smithi111 ceph-mon[27539]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-11T00:01:43.989 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:43 smithi203 ceph-mon[33225]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-11T00:01:43.990 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:43 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:43.990 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:43 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:43.990 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:43 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:01:44.139 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:43 smithi111 ceph-mon[27539]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-11T00:01:44.139 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:43 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:44.140 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:43 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:44.140 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:43 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:01:45.989 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:45 smithi203 ceph-mon[33225]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-11T00:01:45.989 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:45 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:01:46.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:45 smithi111 ceph-mon[27539]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-11T00:01:46.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:45 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:01:48.056 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:48.055+0000 7fe7f9600700 1 -- 172.21.15.203:0/2522427616 <== mgr.14211 v2:172.21.15.111:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe7fc107ed0 con 0x7fe7e406c680 2024-09-11T00:01:48.057 INFO:teuthology.orchestra.run.smithi203.stdout:Created osd(s) 4 on host 'smithi203' 2024-09-11T00:01:48.059 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:48.058+0000 7fe803c00700 1 -- 172.21.15.203:0/2522427616 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fe7e406c680 msgr2=0x7fe7e406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:48.059 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:48.058+0000 7fe803c00700 1 --2- 172.21.15.203:0/2522427616 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fe7e406c680 0x7fe7e406eb30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8006010 tx=0x7fe7e800b540 comp rx=0 tx=0).stop 2024-09-11T00:01:48.059 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:48.058+0000 7fe803c00700 1 -- 172.21.15.203:0/2522427616 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7fc102380 msgr2=0x7fe7fc197b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:48.059 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:48.058+0000 7fe803c00700 1 --2- 172.21.15.203:0/2522427616 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7fc102380 0x7fe7fc197b50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe7f000d900 tx=0x7fe7f000dcc0 comp rx=0 tx=0).stop 2024-09-11T00:01:48.060 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:48.058+0000 7fe803c00700 1 -- 172.21.15.203:0/2522427616 shutdown_connections 2024-09-11T00:01:48.060 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:48.058+0000 7fe803c00700 1 --2- 172.21.15.203:0/2522427616 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fe7e406c680 0x7fe7e406eb30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:48.060 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:48.058+0000 7fe803c00700 1 --2- 172.21.15.203:0/2522427616 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7fc102380 0x7fe7fc197b50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:48.060 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:48.058+0000 7fe803c00700 1 --2- 172.21.15.203:0/2522427616 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe7fc103580 0x7fe7fc198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:48.061 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:48.058+0000 7fe803c00700 1 -- 172.21.15.203:0/2522427616 >> 172.21.15.203:0/2522427616 conn(0x7fe7fc0fd930 msgr2=0x7fe7fc1067b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:48.061 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:48.058+0000 7fe803c00700 1 -- 172.21.15.203:0/2522427616 shutdown_connections 2024-09-11T00:01:48.061 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:48.058+0000 7fe803c00700 1 -- 172.21.15.203:0/2522427616 wait complete. 2024-09-11T00:01:48.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:48 smithi203 ceph-mon[33225]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-11T00:01:48.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:48 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:48.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:48 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:48.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:48 smithi203 ceph-mon[33225]: from='osd.4 [v2:172.21.15.203:6808/977568057,v1:172.21.15.203:6809/977568057]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T00:01:48.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:48 smithi203 ceph-mon[33225]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T00:01:48.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:48 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:01:48.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:48 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:01:48.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:48 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:48.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:48 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:48.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:48 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:48.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:48 smithi111 ceph-mon[27539]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-11T00:01:48.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:48 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:48.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:48 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:48.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:48 smithi111 ceph-mon[27539]: from='osd.4 [v2:172.21.15.203:6808/977568057,v1:172.21.15.203:6809/977568057]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T00:01:48.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:48 smithi111 ceph-mon[27539]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T00:01:48.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:48 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:01:48.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:48 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:01:48.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:48 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:48.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:48 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:48.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:48 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:48.801 DEBUG:teuthology.orchestra.run.smithi203:osd.4> sudo journalctl -f -n 0 -u ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.4.service 2024-09-11T00:01:48.805 INFO:tasks.cephadm:Deploying osd.5 on smithi203 with /dev/vg_nvme/lv_2... 2024-09-11T00:01:48.805 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-11T00:01:49.345 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:49 smithi203 ceph-mon[33225]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T00:01:49.346 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:49 smithi203 ceph-mon[33225]: osdmap e33: 5 total, 4 up, 5 in 2024-09-11T00:01:49.346 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:49 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T00:01:49.346 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:49 smithi203 ceph-mon[33225]: from='osd.4 [v2:172.21.15.203:6808/977568057,v1:172.21.15.203:6809/977568057]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-11T00:01:49.346 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:49 smithi203 ceph-mon[33225]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-11T00:01:49.346 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:49 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:01:49.346 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:01:49 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4[43860]: 2024-09-11T00:01:49.145+0000 7fd0cfc00700 -1 osd.4 0 waiting for initial osdmap 2024-09-11T00:01:49.347 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:01:49 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4[43860]: 2024-09-11T00:01:49.153+0000 7fd0c8a00700 -1 osd.4 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:01:49.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:49 smithi111 ceph-mon[27539]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T00:01:49.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:49 smithi111 ceph-mon[27539]: osdmap e33: 5 total, 4 up, 5 in 2024-09-11T00:01:49.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:49 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T00:01:49.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:49 smithi111 ceph-mon[27539]: from='osd.4 [v2:172.21.15.203:6808/977568057,v1:172.21.15.203:6809/977568057]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-11T00:01:49.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:49 smithi111 ceph-mon[27539]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-11T00:01:49.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:49 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:01:50.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:50 smithi111 ceph-mon[27539]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-11T00:01:50.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:50 smithi111 ceph-mon[27539]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-11T00:01:50.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:50 smithi111 ceph-mon[27539]: osdmap e34: 5 total, 4 up, 5 in 2024-09-11T00:01:50.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:50 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T00:01:50.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:50 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T00:01:50.407 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:50 smithi203 ceph-mon[33225]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-11T00:01:50.408 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:50 smithi203 ceph-mon[33225]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-11T00:01:50.408 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:50 smithi203 ceph-mon[33225]: osdmap e34: 5 total, 4 up, 5 in 2024-09-11T00:01:50.408 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:50 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T00:01:50.408 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:50 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T00:01:50.568 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi203/config 2024-09-11T00:01:51.260 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:51 smithi203 ceph-mon[33225]: purged_snaps scrub starts 2024-09-11T00:01:51.260 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:51 smithi203 ceph-mon[33225]: purged_snaps scrub ok 2024-09-11T00:01:51.260 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:51 smithi203 ceph-mon[33225]: osd.4 [v2:172.21.15.203:6808/977568057,v1:172.21.15.203:6809/977568057] boot 2024-09-11T00:01:51.260 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:51 smithi203 ceph-mon[33225]: osdmap e35: 5 total, 5 up, 5 in 2024-09-11T00:01:51.260 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:51 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T00:01:51.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:51 smithi111 ceph-mon[27539]: purged_snaps scrub starts 2024-09-11T00:01:51.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:51 smithi111 ceph-mon[27539]: purged_snaps scrub ok 2024-09-11T00:01:51.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:51 smithi111 ceph-mon[27539]: osd.4 [v2:172.21.15.203:6808/977568057,v1:172.21.15.203:6809/977568057] boot 2024-09-11T00:01:51.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:51 smithi111 ceph-mon[27539]: osdmap e35: 5 total, 5 up, 5 in 2024-09-11T00:01:51.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:51 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T00:01:52.431 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:52 smithi203 ceph-mon[33225]: pgmap v153: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-11T00:01:52.431 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:52 smithi203 ceph-mon[33225]: osdmap e36: 5 total, 5 up, 5 in 2024-09-11T00:01:52.554 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:52 smithi111 ceph-mon[27539]: pgmap v153: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-11T00:01:52.554 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:52 smithi111 ceph-mon[27539]: osdmap e36: 5 total, 5 up, 5 in 2024-09-11T00:01:54.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:53 smithi203 ceph-mon[33225]: pgmap v155: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:01:54.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:53 smithi203 ceph-mon[33225]: Detected new or changed devices on smithi203 2024-09-11T00:01:54.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:53 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:54.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:53 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:54.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:53 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:01:54.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:53 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:01:54.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:53 smithi203 ceph-mon[33225]: Adjusting osd_memory_target on smithi203 to 7456M 2024-09-11T00:01:54.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:53 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:54.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:53 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:01:54.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:53 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:01:54.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:53 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:54.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:53 smithi111 ceph-mon[27539]: pgmap v155: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:01:54.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:53 smithi111 ceph-mon[27539]: Detected new or changed devices on smithi203 2024-09-11T00:01:54.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:53 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:54.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:53 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:54.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:53 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:01:54.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:53 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:01:54.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:53 smithi111 ceph-mon[27539]: Adjusting osd_memory_target on smithi203 to 7456M 2024-09-11T00:01:54.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:53 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:54.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:53 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:01:54.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:53 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:01:54.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:53 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:01:54.542 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T00:01:54.566 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi203:vg_nvme/lv_2 2024-09-11T00:01:54.884 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi203/config 2024-09-11T00:01:56.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:55 smithi203 ceph-mon[33225]: pgmap v156: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:01:56.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:55 smithi111 ceph-mon[27539]: pgmap v156: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:01:56.741 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.739+0000 7fe306c00700 1 -- 172.21.15.203:0/3742991522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3000fea30 msgr2=0x7fe3000fee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:56.741 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.739+0000 7fe306c00700 1 --2- 172.21.15.203:0/3742991522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3000fea30 0x7fe3000fee40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0009910 tx=0x7fe2f0009c20 comp rx=0 tx=0).stop 2024-09-11T00:01:56.741 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.740+0000 7fe306c00700 1 -- 172.21.15.203:0/3742991522 shutdown_connections 2024-09-11T00:01:56.742 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.740+0000 7fe306c00700 1 --2- 172.21.15.203:0/3742991522 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3000ff380 0x7fe3000ff7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:56.742 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.740+0000 7fe306c00700 1 --2- 172.21.15.203:0/3742991522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3000fea30 0x7fe3000fee40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:56.742 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.740+0000 7fe306c00700 1 -- 172.21.15.203:0/3742991522 >> 172.21.15.203:0/3742991522 conn(0x7fe3000fa5e0 msgr2=0x7fe3000fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:01:56.742 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.740+0000 7fe306c00700 1 -- 172.21.15.203:0/3742991522 shutdown_connections 2024-09-11T00:01:56.742 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.740+0000 7fe306c00700 1 -- 172.21.15.203:0/3742991522 wait complete. 2024-09-11T00:01:56.744 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.741+0000 7fe306c00700 1 Processor -- start 2024-09-11T00:01:56.744 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.741+0000 7fe306c00700 1 -- start start 2024-09-11T00:01:56.744 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.741+0000 7fe306c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3000fea30 0x7fe300197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:56.744 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.741+0000 7fe306c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3000ff380 0x7fe300198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:56.744 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.741+0000 7fe306c00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe300198610 con 0x7fe3000fea30 2024-09-11T00:01:56.744 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.741+0000 7fe306c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe300198750 con 0x7fe3000ff380 2024-09-11T00:01:56.745 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.741+0000 7fe2ff400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3000ff380 0x7fe300198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:56.745 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.741+0000 7fe2ff400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3000ff380 0x7fe300198080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:44698/0 (socket says 172.21.15.203:44698) 2024-09-11T00:01:56.745 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.741+0000 7fe2ff400700 1 -- 172.21.15.203:0/4051923550 learned_addr learned my addr 172.21.15.203:0/4051923550 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-11T00:01:56.745 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.742+0000 7fe2ffe00700 1 --2- 172.21.15.203:0/4051923550 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3000fea30 0x7fe300197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:56.745 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.742+0000 7fe2ff400700 1 -- 172.21.15.203:0/4051923550 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3000fea30 msgr2=0x7fe300197b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:01:56.745 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.742+0000 7fe2ff400700 1 --2- 172.21.15.203:0/4051923550 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3000fea30 0x7fe300197b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:01:56.745 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.742+0000 7fe2ff400700 1 -- 172.21.15.203:0/4051923550 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f00095f0 con 0x7fe3000ff380 2024-09-11T00:01:56.745 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.742+0000 7fe2ff400700 1 --2- 172.21.15.203:0/4051923550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3000ff380 0x7fe300198080 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00c930 tx=0x7fe2ec00ccf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:56.745 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.742+0000 7fe2fcc00700 1 -- 172.21.15.203:0/4051923550 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2ec007ad0 con 0x7fe3000ff380 2024-09-11T00:01:56.745 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.742+0000 7fe2fcc00700 1 -- 172.21.15.203:0/4051923550 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe2ec007c30 con 0x7fe3000ff380 2024-09-11T00:01:56.745 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.742+0000 7fe306c00700 1 -- 172.21.15.203:0/4051923550 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30019d210 con 0x7fe3000ff380 2024-09-11T00:01:56.745 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.743+0000 7fe2fcc00700 1 -- 172.21.15.203:0/4051923550 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2ec018630 con 0x7fe3000ff380 2024-09-11T00:01:56.745 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.743+0000 7fe306c00700 1 -- 172.21.15.203:0/4051923550 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe30019d730 con 0x7fe3000ff380 2024-09-11T00:01:56.746 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.744+0000 7fe306c00700 1 -- 172.21.15.203:0/4051923550 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe30010ae80 con 0x7fe3000ff380 2024-09-11T00:01:56.746 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.745+0000 7fe2fcc00700 1 -- 172.21.15.203:0/4051923550 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fe2ec00f450 con 0x7fe3000ff380 2024-09-11T00:01:56.747 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.746+0000 7fe2fcc00700 1 --2- 172.21.15.203:0/4051923550 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fe2e406c680 0x7fe2e406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:01:56.747 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.746+0000 7fe2fcc00700 1 -- 172.21.15.203:0/4051923550 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4034+0+0 (secure 0 0 0) 0x7fe2ec08b590 con 0x7fe3000ff380 2024-09-11T00:01:56.748 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.747+0000 7fe2ffe00700 1 --2- 172.21.15.203:0/4051923550 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fe2e406c680 0x7fe2e406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:01:56.748 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.748+0000 7fe2ffe00700 1 --2- 172.21.15.203:0/4051923550 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fe2e406c680 0x7fe2e406eb30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0006010 tx=0x7fe2f000b540 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:01:56.752 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.751+0000 7fe2fcc00700 1 -- 172.21.15.203:0/4051923550 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe2ec059bf0 con 0x7fe3000ff380 2024-09-11T00:01:56.958 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:01:56.957+0000 7fe306c00700 1 -- 172.21.15.203:0/4051923550 --> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fe300108780 con 0x7fe2e406c680 2024-09-11T00:01:57.864 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:57 smithi203 ceph-mon[33225]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:01:57.864 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:57 smithi203 ceph-mon[33225]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:01:57.864 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:57 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T00:01:57.864 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:57 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T00:01:57.865 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:57 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:01:57.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:57 smithi111 ceph-mon[27539]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:01:57.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:57 smithi111 ceph-mon[27539]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:01:57.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:57 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T00:01:57.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:57 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T00:01:57.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:57 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:02:00.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:01:59 smithi203 ceph-mon[33225]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:02:00.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:01:59 smithi111 ceph-mon[27539]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:02:00.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:00 smithi203 ceph-mon[33225]: from='client.? 172.21.15.203:0/4168999773' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9f9d7576-bc02-4fe3-b08f-a439fee67df7"}]: dispatch 2024-09-11T00:02:00.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:00 smithi203 ceph-mon[33225]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9f9d7576-bc02-4fe3-b08f-a439fee67df7"}]: dispatch 2024-09-11T00:02:00.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:00 smithi203 ceph-mon[33225]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9f9d7576-bc02-4fe3-b08f-a439fee67df7"}]': finished 2024-09-11T00:02:00.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:00 smithi203 ceph-mon[33225]: osdmap e37: 6 total, 5 up, 6 in 2024-09-11T00:02:00.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:00 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T00:02:00.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:00 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:02:01.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:00 smithi111 ceph-mon[27539]: from='client.? 172.21.15.203:0/4168999773' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9f9d7576-bc02-4fe3-b08f-a439fee67df7"}]: dispatch 2024-09-11T00:02:01.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:00 smithi111 ceph-mon[27539]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9f9d7576-bc02-4fe3-b08f-a439fee67df7"}]: dispatch 2024-09-11T00:02:01.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:00 smithi111 ceph-mon[27539]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9f9d7576-bc02-4fe3-b08f-a439fee67df7"}]': finished 2024-09-11T00:02:01.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:00 smithi111 ceph-mon[27539]: osdmap e37: 6 total, 5 up, 6 in 2024-09-11T00:02:01.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:00 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T00:02:01.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:00 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:02:02.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:01 smithi203 ceph-mon[33225]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:02:02.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:01 smithi203 ceph-mon[33225]: from='client.? 172.21.15.203:0/1227026899' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T00:02:02.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:01 smithi111 ceph-mon[27539]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:02:02.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:01 smithi111 ceph-mon[27539]: from='client.? 172.21.15.203:0/1227026899' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T00:02:04.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:03 smithi203 ceph-mon[33225]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:02:04.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:03 smithi111 ceph-mon[27539]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:02:06.000 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:05 smithi203 ceph-mon[33225]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:02:06.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:05 smithi111 ceph-mon[27539]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:02:07.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:07 smithi111 ceph-mon[27539]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:02:08.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:07 smithi203 ceph-mon[33225]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:02:08.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:08 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-11T00:02:08.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:08 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:02:09.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:08 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-11T00:02:09.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:08 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:02:09.794 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:09 smithi203 ceph-mon[33225]: Deploying daemon osd.5 on smithi203 2024-09-11T00:02:09.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:09 smithi203 ceph-mon[33225]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:02:10.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:09 smithi111 ceph-mon[27539]: Deploying daemon osd.5 on smithi203 2024-09-11T00:02:10.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:09 smithi111 ceph-mon[27539]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:02:12.023 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:11 smithi203 ceph-mon[33225]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:02:12.280 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:11 smithi111 ceph-mon[27539]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:02:14.024 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:13 smithi203 ceph-mon[33225]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:02:14.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:13 smithi111 ceph-mon[27539]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:02:16.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:15 smithi203 ceph-mon[33225]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:02:16.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:15 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:02:16.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:15 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:02:16.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:15 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:02:16.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:15 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:02:16.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:15 smithi111 ceph-mon[27539]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:02:16.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:15 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:02:16.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:15 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:02:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:15 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:02:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:15 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:02:17.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:17 smithi111 ceph-mon[27539]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:02:18.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:17 smithi203 ceph-mon[33225]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:02:20.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:19 smithi203 ceph-mon[33225]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:02:20.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:19 smithi203 ceph-mon[33225]: from='osd.5 [v2:172.21.15.203:6816/3580090636,v1:172.21.15.203:6817/3580090636]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T00:02:20.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:19 smithi203 ceph-mon[33225]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T00:02:20.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:19 smithi111 ceph-mon[27539]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:02:20.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:19 smithi111 ceph-mon[27539]: from='osd.5 [v2:172.21.15.203:6816/3580090636,v1:172.21.15.203:6817/3580090636]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T00:02:20.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:19 smithi111 ceph-mon[27539]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T00:02:20.291 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:20.290+0000 7fe2fcc00700 1 -- 172.21.15.203:0/4051923550 <== mgr.14211 v2:172.21.15.111:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe300108780 con 0x7fe2e406c680 2024-09-11T00:02:20.291 INFO:teuthology.orchestra.run.smithi203.stdout:Created osd(s) 5 on host 'smithi203' 2024-09-11T00:02:20.295 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:20.293+0000 7fe306c00700 1 -- 172.21.15.203:0/4051923550 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fe2e406c680 msgr2=0x7fe2e406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:20.295 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:20.293+0000 7fe306c00700 1 --2- 172.21.15.203:0/4051923550 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fe2e406c680 0x7fe2e406eb30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0006010 tx=0x7fe2f000b540 comp rx=0 tx=0).stop 2024-09-11T00:02:20.295 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:20.293+0000 7fe306c00700 1 -- 172.21.15.203:0/4051923550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3000ff380 msgr2=0x7fe300198080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:20.295 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:20.293+0000 7fe306c00700 1 --2- 172.21.15.203:0/4051923550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3000ff380 0x7fe300198080 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00c930 tx=0x7fe2ec00ccf0 comp rx=0 tx=0).stop 2024-09-11T00:02:20.295 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:20.294+0000 7fe306c00700 1 -- 172.21.15.203:0/4051923550 shutdown_connections 2024-09-11T00:02:20.295 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:20.294+0000 7fe306c00700 1 --2- 172.21.15.203:0/4051923550 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fe2e406c680 0x7fe2e406eb30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:20.295 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:20.294+0000 7fe306c00700 1 --2- 172.21.15.203:0/4051923550 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3000fea30 0x7fe300197b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:20.295 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:20.294+0000 7fe306c00700 1 --2- 172.21.15.203:0/4051923550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3000ff380 0x7fe300198080 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:20.296 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:20.294+0000 7fe306c00700 1 -- 172.21.15.203:0/4051923550 >> 172.21.15.203:0/4051923550 conn(0x7fe3000fa5e0 msgr2=0x7fe300107060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:20.296 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:20.294+0000 7fe306c00700 1 -- 172.21.15.203:0/4051923550 shutdown_connections 2024-09-11T00:02:20.296 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:20.294+0000 7fe306c00700 1 -- 172.21.15.203:0/4051923550 wait complete. 2024-09-11T00:02:21.042 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:20 smithi203 ceph-mon[33225]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T00:02:21.042 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:20 smithi203 ceph-mon[33225]: osdmap e38: 6 total, 5 up, 6 in 2024-09-11T00:02:21.042 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:20 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T00:02:21.043 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:20 smithi203 ceph-mon[33225]: from='osd.5 [v2:172.21.15.203:6816/3580090636,v1:172.21.15.203:6817/3580090636]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-11T00:02:21.043 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:20 smithi203 ceph-mon[33225]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-11T00:02:21.043 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:20 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:02:21.043 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:20 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:02:21.075 DEBUG:teuthology.orchestra.run.smithi203:osd.5> sudo journalctl -f -n 0 -u ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.5.service 2024-09-11T00:02:21.079 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-11T00:02:21.079 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-11T00:02:21.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:20 smithi111 ceph-mon[27539]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T00:02:21.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:20 smithi111 ceph-mon[27539]: osdmap e38: 6 total, 5 up, 6 in 2024-09-11T00:02:21.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:20 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T00:02:21.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:20 smithi111 ceph-mon[27539]: from='osd.5 [v2:172.21.15.203:6816/3580090636,v1:172.21.15.203:6817/3580090636]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-11T00:02:21.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:20 smithi111 ceph-mon[27539]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-11T00:02:21.136 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:20 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:02:21.136 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:20 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:02:21.419 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:02:21.832 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:21 smithi111 ceph-mon[27539]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:02:21.832 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:21 smithi111 ceph-mon[27539]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-11T00:02:21.832 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:21 smithi111 ceph-mon[27539]: osdmap e39: 6 total, 5 up, 6 in 2024-09-11T00:02:21.832 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:21 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T00:02:21.833 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:21 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T00:02:21.833 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:21 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:02:21.833 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:21 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:02:22.104 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:21 smithi203 ceph-mon[33225]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:02:22.104 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:21 smithi203 ceph-mon[33225]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-11T00:02:22.104 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:21 smithi203 ceph-mon[33225]: osdmap e39: 6 total, 5 up, 6 in 2024-09-11T00:02:22.104 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:21 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T00:02:22.104 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:21 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T00:02:22.104 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:21 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:02:22.105 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:21 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:02:22.867 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:22 smithi111 ceph-mon[27539]: purged_snaps scrub starts 2024-09-11T00:02:22.867 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:22 smithi111 ceph-mon[27539]: purged_snaps scrub ok 2024-09-11T00:02:22.867 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:22 smithi111 ceph-mon[27539]: osd.5 [v2:172.21.15.203:6816/3580090636,v1:172.21.15.203:6817/3580090636] boot 2024-09-11T00:02:22.867 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:22 smithi111 ceph-mon[27539]: osdmap e40: 6 total, 6 up, 6 in 2024-09-11T00:02:22.867 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:22 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T00:02:23.163 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:22 smithi203 ceph-mon[33225]: purged_snaps scrub starts 2024-09-11T00:02:23.163 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:22 smithi203 ceph-mon[33225]: purged_snaps scrub ok 2024-09-11T00:02:23.163 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:22 smithi203 ceph-mon[33225]: osd.5 [v2:172.21.15.203:6816/3580090636,v1:172.21.15.203:6817/3580090636] boot 2024-09-11T00:02:23.164 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:22 smithi203 ceph-mon[33225]: osdmap e40: 6 total, 6 up, 6 in 2024-09-11T00:02:23.164 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:22 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T00:02:23.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.272+0000 7ff08b400700 1 -- 172.21.15.111:0/1341179284 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff084074d80 msgr2=0x7ff0840731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:23.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.272+0000 7ff08b400700 1 --2- 172.21.15.111:0/1341179284 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff084074d80 0x7ff0840731e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff078009940 tx=0x7ff078009c50 comp rx=0 tx=0).stop 2024-09-11T00:02:23.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.273+0000 7ff08b400700 1 -- 172.21.15.111:0/1341179284 shutdown_connections 2024-09-11T00:02:23.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.273+0000 7ff08b400700 1 --2- 172.21.15.111:0/1341179284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff0840737b0 0x7ff084073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:23.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.273+0000 7ff08b400700 1 --2- 172.21.15.111:0/1341179284 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff084074d80 0x7ff0840731e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:23.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.273+0000 7ff08b400700 1 -- 172.21.15.111:0/1341179284 >> 172.21.15.111:0/1341179284 conn(0x7ff0840fb6e0 msgr2=0x7ff0840fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:23.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.273+0000 7ff08b400700 1 -- 172.21.15.111:0/1341179284 shutdown_connections 2024-09-11T00:02:23.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.273+0000 7ff08b400700 1 -- 172.21.15.111:0/1341179284 wait complete. 2024-09-11T00:02:23.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.274+0000 7ff08b400700 1 Processor -- start 2024-09-11T00:02:23.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.274+0000 7ff08b400700 1 -- start start 2024-09-11T00:02:23.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.274+0000 7ff08b400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0840737b0 0x7ff084197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:23.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.274+0000 7ff08b400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff084074d80 0x7ff084198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:23.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.274+0000 7ff08b400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0841985e0 con 0x7ff0840737b0 2024-09-11T00:02:23.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.274+0000 7ff08b400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff084198720 con 0x7ff084074d80 2024-09-11T00:02:23.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.274+0000 7ff088a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0840737b0 0x7ff084197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:23.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.274+0000 7ff088a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0840737b0 0x7ff084197b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:55488/0 (socket says 172.21.15.111:55488) 2024-09-11T00:02:23.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.274+0000 7ff088a00700 1 -- 172.21.15.111:0/3070148850 learned_addr learned my addr 172.21.15.111:0/3070148850 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:02:23.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.275+0000 7ff083e00700 1 --2- 172.21.15.111:0/3070148850 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff084074d80 0x7ff084198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:23.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.275+0000 7ff088a00700 1 -- 172.21.15.111:0/3070148850 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff084074d80 msgr2=0x7ff084198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:23.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.275+0000 7ff088a00700 1 --2- 172.21.15.111:0/3070148850 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff084074d80 0x7ff084198050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:23.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.275+0000 7ff088a00700 1 -- 172.21.15.111:0/3070148850 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0780095f0 con 0x7ff0840737b0 2024-09-11T00:02:23.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.275+0000 7ff088a00700 1 --2- 172.21.15.111:0/3070148850 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0840737b0 0x7ff084197b10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff0780055f0 tx=0x7ff078005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:23.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.276+0000 7ff081600700 1 -- 172.21.15.111:0/3070148850 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff07801d070 con 0x7ff0840737b0 2024-09-11T00:02:23.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.276+0000 7ff08b400700 1 -- 172.21.15.111:0/3070148850 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff08419d180 con 0x7ff0840737b0 2024-09-11T00:02:23.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.276+0000 7ff081600700 1 -- 172.21.15.111:0/3070148850 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff07800f460 con 0x7ff0840737b0 2024-09-11T00:02:23.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.276+0000 7ff081600700 1 -- 172.21.15.111:0/3070148850 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff078021620 con 0x7ff0840737b0 2024-09-11T00:02:23.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.276+0000 7ff08b400700 1 -- 172.21.15.111:0/3070148850 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff08419d6c0 con 0x7ff0840737b0 2024-09-11T00:02:23.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.277+0000 7ff08b400700 1 -- 172.21.15.111:0/3070148850 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff08410ae90 con 0x7ff0840737b0 2024-09-11T00:02:23.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.279+0000 7ff081600700 1 -- 172.21.15.111:0/3070148850 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7ff078003b20 con 0x7ff0840737b0 2024-09-11T00:02:23.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.280+0000 7ff081600700 1 --2- 172.21.15.111:0/3070148850 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff06c06c680 0x7ff06c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:23.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.280+0000 7ff081600700 1 -- 172.21.15.111:0/3070148850 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7ff07808cc40 con 0x7ff0840737b0 2024-09-11T00:02:23.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.280+0000 7ff083e00700 1 --2- 172.21.15.111:0/3070148850 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff06c06c680 0x7ff06c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:23.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.281+0000 7ff083e00700 1 --2- 172.21.15.111:0/3070148850 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff06c06c680 0x7ff06c06eb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff07000ac50 tx=0x7ff07000a380 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:23.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.285+0000 7ff081600700 1 -- 172.21.15.111:0/3070148850 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff07805b210 con 0x7ff0840737b0 2024-09-11T00:02:23.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.493+0000 7ff08b400700 1 -- 172.21.15.111:0/3070148850 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7ff08410b080 con 0x7ff0840737b0 2024-09-11T00:02:23.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.494+0000 7ff081600700 1 -- 172.21.15.111:0/3070148850 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v41) v1 ==== 74+0+130 (secure 0 0 0) 0x7ff07805ada0 con 0x7ff0840737b0 2024-09-11T00:02:23.495 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:02:23.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.496+0000 7ff08b400700 1 -- 172.21.15.111:0/3070148850 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff06c06c680 msgr2=0x7ff06c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:23.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.496+0000 7ff08b400700 1 --2- 172.21.15.111:0/3070148850 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff06c06c680 0x7ff06c06eb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff07000ac50 tx=0x7ff07000a380 comp rx=0 tx=0).stop 2024-09-11T00:02:23.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.496+0000 7ff08b400700 1 -- 172.21.15.111:0/3070148850 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0840737b0 msgr2=0x7ff084197b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:23.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.496+0000 7ff08b400700 1 --2- 172.21.15.111:0/3070148850 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0840737b0 0x7ff084197b10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff0780055f0 tx=0x7ff078005620 comp rx=0 tx=0).stop 2024-09-11T00:02:23.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.496+0000 7ff08b400700 1 -- 172.21.15.111:0/3070148850 shutdown_connections 2024-09-11T00:02:23.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.496+0000 7ff08b400700 1 --2- 172.21.15.111:0/3070148850 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff06c06c680 0x7ff06c06eb30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:23.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.496+0000 7ff08b400700 1 --2- 172.21.15.111:0/3070148850 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0840737b0 0x7ff084197b10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:23.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.496+0000 7ff08b400700 1 --2- 172.21.15.111:0/3070148850 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff084074d80 0x7ff084198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:23.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.496+0000 7ff08b400700 1 -- 172.21.15.111:0/3070148850 >> 172.21.15.111:0/3070148850 conn(0x7ff0840fb6e0 msgr2=0x7ff084105f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:23.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.496+0000 7ff08b400700 1 -- 172.21.15.111:0/3070148850 shutdown_connections 2024-09-11T00:02:23.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:23.496+0000 7ff08b400700 1 -- 172.21.15.111:0/3070148850 wait complete. 2024-09-11T00:02:24.058 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:23 smithi203 ceph-mon[33225]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:02:24.058 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:23 smithi203 ceph-mon[33225]: osdmap e41: 6 total, 6 up, 6 in 2024-09-11T00:02:24.058 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:23 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/3070148850' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T00:02:24.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:23 smithi111 ceph-mon[27539]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:02:24.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:23 smithi111 ceph-mon[27539]: osdmap e41: 6 total, 6 up, 6 in 2024-09-11T00:02:24.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:23 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/3070148850' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T00:02:24.202 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":41,"num_osds":6,"num_up_osds":6,"osd_up_since":1726012941,"num_in_osds":6,"osd_in_since":1726012920,"num_remapped_pgs":0} 2024-09-11T00:02:24.203 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T00:02:24.538 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:02:26.069 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:25 smithi111 ceph-mon[27539]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:26.069 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:25 smithi111 ceph-mon[27539]: Detected new or changed devices on smithi203 2024-09-11T00:02:26.069 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:25 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:02:26.069 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:25 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:02:26.069 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:25 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:02:26.069 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:25 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:02:26.070 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:25 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:02:26.070 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:25 smithi111 ceph-mon[27539]: Adjusting osd_memory_target on smithi203 to 4971M 2024-09-11T00:02:26.070 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:25 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:02:26.070 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:25 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:02:26.070 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:25 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:02:26.070 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:25 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:02:26.071 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:25 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:02:26.071 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:25 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:02:26.071 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:25 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:02:26.071 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:25 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:02:26.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:25 smithi203 ceph-mon[33225]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:26.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:25 smithi203 ceph-mon[33225]: Detected new or changed devices on smithi203 2024-09-11T00:02:26.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:25 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:02:26.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:25 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:02:26.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:25 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:02:26.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:25 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:02:26.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:25 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:02:26.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:25 smithi203 ceph-mon[33225]: Adjusting osd_memory_target on smithi203 to 4971M 2024-09-11T00:02:26.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:25 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:02:26.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:25 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:02:26.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:25 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:02:26.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:25 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:02:26.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:25 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:02:26.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:25 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:02:26.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:25 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:02:26.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:25 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:02:26.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.416+0000 7f5a46800700 1 -- 172.21.15.111:0/756209545 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5a40102600 msgr2=0x7f5a401029d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:26.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.416+0000 7f5a46800700 1 --2- 172.21.15.111:0/756209545 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5a40102600 0x7f5a401029d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5a3000b0a0 tx=0x7f5a3000b3b0 comp rx=0 tx=0).stop 2024-09-11T00:02:26.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.416+0000 7f5a46800700 1 -- 172.21.15.111:0/756209545 shutdown_connections 2024-09-11T00:02:26.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.416+0000 7f5a46800700 1 --2- 172.21.15.111:0/756209545 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a40102fa0 0x7f5a40106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:26.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.416+0000 7f5a46800700 1 --2- 172.21.15.111:0/756209545 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5a40102600 0x7f5a401029d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:26.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.416+0000 7f5a46800700 1 -- 172.21.15.111:0/756209545 >> 172.21.15.111:0/756209545 conn(0x7f5a400fdec0 msgr2=0x7f5a401002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:26.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.416+0000 7f5a46800700 1 -- 172.21.15.111:0/756209545 shutdown_connections 2024-09-11T00:02:26.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.416+0000 7f5a46800700 1 -- 172.21.15.111:0/756209545 wait complete. 2024-09-11T00:02:26.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.417+0000 7f5a46800700 1 Processor -- start 2024-09-11T00:02:26.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.417+0000 7f5a46800700 1 -- start start 2024-09-11T00:02:26.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.418+0000 7f5a46800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a40102600 0x7f5a40197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:26.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.418+0000 7f5a46800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5a40102fa0 0x7f5a401984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:26.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.418+0000 7f5a46800700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a40198bd0 con 0x7f5a40102fa0 2024-09-11T00:02:26.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.418+0000 7f5a46800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4019c960 con 0x7f5a40102600 2024-09-11T00:02:26.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.418+0000 7f5a36a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5a40102fa0 0x7f5a401984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:26.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.418+0000 7f5a36a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5a40102fa0 0x7f5a401984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:55506/0 (socket says 172.21.15.111:55506) 2024-09-11T00:02:26.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.418+0000 7f5a36a00700 1 -- 172.21.15.111:0/2902989913 learned_addr learned my addr 172.21.15.111:0/2902989913 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:02:26.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.418+0000 7f5a3f400700 1 --2- 172.21.15.111:0/2902989913 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a40102600 0x7f5a40197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:26.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.418+0000 7f5a36a00700 1 -- 172.21.15.111:0/2902989913 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a40102600 msgr2=0x7f5a40197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:26.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.418+0000 7f5a36a00700 1 --2- 172.21.15.111:0/2902989913 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a40102600 0x7f5a40197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:26.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.418+0000 7f5a36a00700 1 -- 172.21.15.111:0/2902989913 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a30009d00 con 0x7f5a40102fa0 2024-09-11T00:02:26.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.418+0000 7f5a3f400700 1 --2- 172.21.15.111:0/2902989913 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a40102600 0x7f5a40197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:26.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.418+0000 7f5a36a00700 1 --2- 172.21.15.111:0/2902989913 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5a40102fa0 0x7f5a401984f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800d8d0 tx=0x7f5a2800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:26.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.419+0000 7f5a3cc00700 1 -- 172.21.15.111:0/2902989913 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a280041f0 con 0x7f5a40102fa0 2024-09-11T00:02:26.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.419+0000 7f5a3cc00700 1 -- 172.21.15.111:0/2902989913 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5a28007620 con 0x7f5a40102fa0 2024-09-11T00:02:26.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.419+0000 7f5a46800700 1 -- 172.21.15.111:0/2902989913 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a4019cc40 con 0x7f5a40102fa0 2024-09-11T00:02:26.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.419+0000 7f5a3cc00700 1 -- 172.21.15.111:0/2902989913 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a28003be0 con 0x7f5a40102fa0 2024-09-11T00:02:26.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.419+0000 7f5a46800700 1 -- 172.21.15.111:0/2902989913 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a4019d190 con 0x7f5a40102fa0 2024-09-11T00:02:26.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.420+0000 7f5a46800700 1 -- 172.21.15.111:0/2902989913 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a4004ea50 con 0x7f5a40102fa0 2024-09-11T00:02:26.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.421+0000 7f5a3cc00700 1 -- 172.21.15.111:0/2902989913 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f5a28004350 con 0x7f5a40102fa0 2024-09-11T00:02:26.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.422+0000 7f5a3cc00700 1 --2- 172.21.15.111:0/2902989913 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5a2406c680 0x7f5a2406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:26.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.422+0000 7f5a3cc00700 1 -- 172.21.15.111:0/2902989913 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f5a2808aff0 con 0x7f5a40102fa0 2024-09-11T00:02:26.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.422+0000 7f5a3f400700 1 --2- 172.21.15.111:0/2902989913 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5a2406c680 0x7f5a2406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:26.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.423+0000 7f5a3f400700 1 --2- 172.21.15.111:0/2902989913 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5a2406c680 0x7f5a2406eb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5a300062a0 tx=0x7f5a30006210 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:26.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.426+0000 7f5a3cc00700 1 -- 172.21.15.111:0/2902989913 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5a28055ad0 con 0x7f5a40102fa0 2024-09-11T00:02:26.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.624+0000 7f5a46800700 1 -- 172.21.15.111:0/2902989913 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a4019d650 con 0x7f5a40102fa0 2024-09-11T00:02:26.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.625+0000 7f5a3cc00700 1 -- 172.21.15.111:0/2902989913 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11053 (secure 0 0 0) 0x7f5a280590f0 con 0x7f5a40102fa0 2024-09-11T00:02:26.627 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:02:26.628 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":41,"fsid":"03107fbe-6fd0-11ef-bcea-c7b262605968","created":"2024-09-10T23:54:57.670630+0000","modified":"2024-09-11T00:02:22.793843+0000","last_up_change":"2024-09-11T00:02:21.783719+0000","last_in_change":"2024-09-11T00:02:00.006293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:00:53.220421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"677fb551-96f5-4160-9f99-ffd1ca28e12e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":905671165},{"type":"v1","addr":"172.21.15.111:6803","nonce":905671165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":905671165},{"type":"v1","addr":"172.21.15.111:6805","nonce":905671165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":905671165},{"type":"v1","addr":"172.21.15.111:6809","nonce":905671165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":905671165},{"type":"v1","addr":"172.21.15.111:6807","nonce":905671165}]},"public_addr":"172.21.15.111:6803/905671165","cluster_addr":"172.21.15.111:6805/905671165","heartbeat_back_addr":"172.21.15.111:6809/905671165","heartbeat_front_addr":"172.21.15.111:6807/905671165","state":["exists","up"]},{"osd":1,"uuid":"1b7f9f82-fe27-46d4-a478-d88ed6ea074b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":1146454471},{"type":"v1","addr":"172.21.15.111:6811","nonce":1146454471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1146454471},{"type":"v1","addr":"172.21.15.111:6813","nonce":1146454471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1146454471},{"type":"v1","addr":"172.21.15.111:6817","nonce":1146454471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":1146454471},{"type":"v1","addr":"172.21.15.111:6815","nonce":1146454471}]},"public_addr":"172.21.15.111:6811/1146454471","cluster_addr":"172.21.15.111:6813/1146454471","heartbeat_back_addr":"172.21.15.111:6817/1146454471","heartbeat_front_addr":"172.21.15.111:6815/1146454471","state":["exists","up"]},{"osd":2,"uuid":"68de9f31-9af1-4fd7-a724-3249f4ff2660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":39993762},{"type":"v1","addr":"172.21.15.111:6819","nonce":39993762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":39993762},{"type":"v1","addr":"172.21.15.111:6821","nonce":39993762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":39993762},{"type":"v1","addr":"172.21.15.111:6825","nonce":39993762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":39993762},{"type":"v1","addr":"172.21.15.111:6823","nonce":39993762}]},"public_addr":"172.21.15.111:6819/39993762","cluster_addr":"172.21.15.111:6821/39993762","heartbeat_back_addr":"172.21.15.111:6825/39993762","heartbeat_front_addr":"172.21.15.111:6823/39993762","state":["exists","up"]},{"osd":3,"uuid":"315ef72a-7cb4-48d9-b4d7-2ee54fd230e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":684842797},{"type":"v1","addr":"172.21.15.203:6801","nonce":684842797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":684842797},{"type":"v1","addr":"172.21.15.203:6803","nonce":684842797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":684842797},{"type":"v1","addr":"172.21.15.203:6807","nonce":684842797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":684842797},{"type":"v1","addr":"172.21.15.203:6805","nonce":684842797}]},"public_addr":"172.21.15.203:6801/684842797","cluster_addr":"172.21.15.203:6803/684842797","heartbeat_back_addr":"172.21.15.203:6807/684842797","heartbeat_front_addr":"172.21.15.203:6805/684842797","state":["exists","up"]},{"osd":4,"uuid":"166b7f5c-1c8c-4873-acfa-eceee13741eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":977568057},{"type":"v1","addr":"172.21.15.203:6809","nonce":977568057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":977568057},{"type":"v1","addr":"172.21.15.203:6811","nonce":977568057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":977568057},{"type":"v1","addr":"172.21.15.203:6815","nonce":977568057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":977568057},{"type":"v1","addr":"172.21.15.203:6813","nonce":977568057}]},"public_addr":"172.21.15.203:6809/977568057","cluster_addr":"172.21.15.203:6811/977568057","heartbeat_back_addr":"172.21.15.203:6815/977568057","heartbeat_front_addr":"172.21.15.203:6813/977568057","state":["exists","up"]},{"osd":5,"uuid":"9f9d7576-bc02-4fe3-b08f-a439fee67df7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3580090636},{"type":"v1","addr":"172.21.15.203:6817","nonce":3580090636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":3580090636},{"type":"v1","addr":"172.21.15.203:6819","nonce":3580090636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3580090636},{"type":"v1","addr":"172.21.15.203:6823","nonce":3580090636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3580090636},{"type":"v1","addr":"172.21.15.203:6821","nonce":3580090636}]},"public_addr":"172.21.15.203:6817/3580090636","cluster_addr":"172.21.15.203:6819/3580090636","heartbeat_back_addr":"172.21.15.203:6823/3580090636","heartbeat_front_addr":"172.21.15.203:6821/3580090636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:59:42.353286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:00:15.382222+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:00:49.789267+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:01:18.072373+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:01:48.244923+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:02:20.636978+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.111:0/204109822":"2024-09-11T23:57:30.610091+0000","172.21.15.111:0/118783074":"2024-09-11T23:56:15.498737+0000","172.21.15.111:0/4232639257":"2024-09-11T23:56:15.498737+0000","172.21.15.111:0/2851283125":"2024-09-11T23:57:30.610091+0000","172.21.15.111:6801/2":"2024-09-11T23:55:34.617670+0000","172.21.15.111:6800/2":"2024-09-11T23:55:34.617670+0000","172.21.15.111:0/745179268":"2024-09-11T23:57:30.610091+0000","172.21.15.111:0/113012487":"2024-09-11T23:55:34.617670+0000","172.21.15.111:0/353472070":"2024-09-11T23:55:34.617670+0000","172.21.15.111:0/4097088644":"2024-09-11T23:55:34.617670+0000","172.21.15.111:0/92336389":"2024-09-11T23:56:15.498737+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:02:26.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.628+0000 7f5a46800700 1 -- 172.21.15.111:0/2902989913 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5a2406c680 msgr2=0x7f5a2406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:26.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.628+0000 7f5a46800700 1 --2- 172.21.15.111:0/2902989913 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5a2406c680 0x7f5a2406eb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5a300062a0 tx=0x7f5a30006210 comp rx=0 tx=0).stop 2024-09-11T00:02:26.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.628+0000 7f5a46800700 1 -- 172.21.15.111:0/2902989913 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5a40102fa0 msgr2=0x7f5a401984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:26.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.628+0000 7f5a46800700 1 --2- 172.21.15.111:0/2902989913 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5a40102fa0 0x7f5a401984f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800d8d0 tx=0x7f5a2800dc90 comp rx=0 tx=0).stop 2024-09-11T00:02:26.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.628+0000 7f5a46800700 1 -- 172.21.15.111:0/2902989913 shutdown_connections 2024-09-11T00:02:26.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.628+0000 7f5a46800700 1 --2- 172.21.15.111:0/2902989913 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5a2406c680 0x7f5a2406eb30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:26.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.628+0000 7f5a46800700 1 --2- 172.21.15.111:0/2902989913 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a40102600 0x7f5a40197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:26.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.628+0000 7f5a46800700 1 --2- 172.21.15.111:0/2902989913 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5a40102fa0 0x7f5a401984f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:26.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.628+0000 7f5a46800700 1 -- 172.21.15.111:0/2902989913 >> 172.21.15.111:0/2902989913 conn(0x7f5a400fdec0 msgr2=0x7f5a400ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:26.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.628+0000 7f5a46800700 1 -- 172.21.15.111:0/2902989913 shutdown_connections 2024-09-11T00:02:26.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:26.628+0000 7f5a46800700 1 -- 172.21.15.111:0/2902989913 wait complete. 2024-09-11T00:02:27.197 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:26 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/2902989913' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T00:02:27.325 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:26 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/2902989913' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T00:02:27.355 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T00:00:53.220421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T00:02:27.356 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-11T00:02:27.672 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:02:28.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:27 smithi111 ceph-mon[27539]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:28.209 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:27 smithi203 ceph-mon[33225]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:29.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.396+0000 7f29e5800700 1 -- 172.21.15.111:0/3596302497 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f29e0100bb0 msgr2=0x7f29e0104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:29.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.396+0000 7f29e5800700 1 --2- 172.21.15.111:0/3596302497 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f29e0100bb0 0x7f29e0104b80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f29cc009910 tx=0x7f29cc009c20 comp rx=0 tx=0).stop 2024-09-11T00:02:29.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.396+0000 7f29e5800700 1 -- 172.21.15.111:0/3596302497 shutdown_connections 2024-09-11T00:02:29.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.396+0000 7f29e5800700 1 --2- 172.21.15.111:0/3596302497 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f29e0100bb0 0x7f29e0104b80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:29.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.396+0000 7f29e5800700 1 --2- 172.21.15.111:0/3596302497 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29e0100210 0x7f29e01005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:29.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.396+0000 7f29e5800700 1 -- 172.21.15.111:0/3596302497 >> 172.21.15.111:0/3596302497 conn(0x7f29e00fbab0 msgr2=0x7f29e00fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:29.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.396+0000 7f29e5800700 1 -- 172.21.15.111:0/3596302497 shutdown_connections 2024-09-11T00:02:29.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.396+0000 7f29e5800700 1 -- 172.21.15.111:0/3596302497 wait complete. 2024-09-11T00:02:29.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.397+0000 7f29e5800700 1 Processor -- start 2024-09-11T00:02:29.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.397+0000 7f29e5800700 1 -- start start 2024-09-11T00:02:29.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.398+0000 7f29e5800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f29e0100210 0x7f29e0197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:29.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.398+0000 7f29e5800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29e0100bb0 0x7f29e01983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:29.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.398+0000 7f29e5800700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e0198a80 con 0x7f29e0100210 2024-09-11T00:02:29.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.398+0000 7f29e5800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e019c810 con 0x7f29e0100bb0 2024-09-11T00:02:29.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.398+0000 7f29dfe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f29e0100210 0x7f29e0197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:29.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.398+0000 7f29dfe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f29e0100210 0x7f29e0197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49200/0 (socket says 172.21.15.111:49200) 2024-09-11T00:02:29.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.398+0000 7f29dfe00700 1 -- 172.21.15.111:0/1336610327 learned_addr learned my addr 172.21.15.111:0/1336610327 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:02:29.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.398+0000 7f29df400700 1 --2- 172.21.15.111:0/1336610327 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29e0100bb0 0x7f29e01983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:29.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.398+0000 7f29dfe00700 1 -- 172.21.15.111:0/1336610327 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29e0100bb0 msgr2=0x7f29e01983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:29.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.398+0000 7f29dfe00700 1 --2- 172.21.15.111:0/1336610327 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29e0100bb0 0x7f29e01983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:29.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.399+0000 7f29dfe00700 1 -- 172.21.15.111:0/1336610327 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29cc0095f0 con 0x7f29e0100210 2024-09-11T00:02:29.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.399+0000 7f29df400700 1 --2- 172.21.15.111:0/1336610327 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29e0100bb0 0x7f29e01983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:29.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.399+0000 7f29dfe00700 1 --2- 172.21.15.111:0/1336610327 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f29e0100210 0x7f29e0197e60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f29d000b4b0 tx=0x7f29d000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:29.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.399+0000 7f29dcc00700 1 -- 172.21.15.111:0/1336610327 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29d0011800 con 0x7f29e0100210 2024-09-11T00:02:29.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.399+0000 7f29dcc00700 1 -- 172.21.15.111:0/1336610327 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f29d0011e10 con 0x7f29e0100210 2024-09-11T00:02:29.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.399+0000 7f29e5800700 1 -- 172.21.15.111:0/1336610327 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e019caf0 con 0x7f29e0100210 2024-09-11T00:02:29.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.399+0000 7f29dcc00700 1 -- 172.21.15.111:0/1336610327 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29d000f2e0 con 0x7f29e0100210 2024-09-11T00:02:29.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.399+0000 7f29e5800700 1 -- 172.21.15.111:0/1336610327 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e019d040 con 0x7f29e0100210 2024-09-11T00:02:29.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.400+0000 7f29e5800700 1 -- 172.21.15.111:0/1336610327 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e0104300 con 0x7f29e0100210 2024-09-11T00:02:29.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.401+0000 7f29dcc00700 1 -- 172.21.15.111:0/1336610327 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f29d0010380 con 0x7f29e0100210 2024-09-11T00:02:29.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.402+0000 7f29dcc00700 1 --2- 172.21.15.111:0/1336610327 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f29c406c680 0x7f29c406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:29.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.402+0000 7f29dcc00700 1 -- 172.21.15.111:0/1336610327 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f29d008b090 con 0x7f29e0100210 2024-09-11T00:02:29.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.402+0000 7f29df400700 1 --2- 172.21.15.111:0/1336610327 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f29c406c680 0x7f29c406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:29.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.403+0000 7f29df400700 1 --2- 172.21.15.111:0/1336610327 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f29c406c680 0x7f29c406eb30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f29e0199480 tx=0x7f29cc01a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:29.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.407+0000 7f29dcc00700 1 -- 172.21.15.111:0/1336610327 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f29d0055be0 con 0x7f29e0100210 2024-09-11T00:02:29.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.613+0000 7f29e5800700 1 -- 172.21.15.111:0/1336610327 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f29e019d310 con 0x7f29e0100210 2024-09-11T00:02:29.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.614+0000 7f29dcc00700 1 -- 172.21.15.111:0/1336610327 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f29d0059200 con 0x7f29e0100210 2024-09-11T00:02:29.616 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 1 2024-09-11T00:02:29.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.616+0000 7f29e5800700 1 -- 172.21.15.111:0/1336610327 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f29c406c680 msgr2=0x7f29c406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:29.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.616+0000 7f29e5800700 1 --2- 172.21.15.111:0/1336610327 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f29c406c680 0x7f29c406eb30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f29e0199480 tx=0x7f29cc01a040 comp rx=0 tx=0).stop 2024-09-11T00:02:29.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.616+0000 7f29e5800700 1 -- 172.21.15.111:0/1336610327 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f29e0100210 msgr2=0x7f29e0197e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:29.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.616+0000 7f29e5800700 1 --2- 172.21.15.111:0/1336610327 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f29e0100210 0x7f29e0197e60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f29d000b4b0 tx=0x7f29d000b870 comp rx=0 tx=0).stop 2024-09-11T00:02:29.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.616+0000 7f29e5800700 1 -- 172.21.15.111:0/1336610327 shutdown_connections 2024-09-11T00:02:29.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.616+0000 7f29e5800700 1 --2- 172.21.15.111:0/1336610327 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f29c406c680 0x7f29c406eb30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:29.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.616+0000 7f29e5800700 1 --2- 172.21.15.111:0/1336610327 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f29e0100210 0x7f29e0197e60 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:29.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.616+0000 7f29e5800700 1 --2- 172.21.15.111:0/1336610327 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29e0100bb0 0x7f29e01983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:29.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.616+0000 7f29e5800700 1 -- 172.21.15.111:0/1336610327 >> 172.21.15.111:0/1336610327 conn(0x7f29e00fbab0 msgr2=0x7f29e00fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:29.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.617+0000 7f29e5800700 1 -- 172.21.15.111:0/1336610327 shutdown_connections 2024-09-11T00:02:29.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:29.617+0000 7f29e5800700 1 -- 172.21.15.111:0/1336610327 wait complete. 2024-09-11T00:02:30.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:29 smithi203 ceph-mon[33225]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:30.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:29 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/1336610327' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T00:02:30.314 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:29 smithi111 ceph-mon[27539]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:30.314 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:29 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/1336610327' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T00:02:30.345 INFO:tasks.cephadm:Setting up client nodes... 2024-09-11T00:02:30.345 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-11T00:02:30.661 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:02:31.075 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:30 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:02:31.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:30 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:02:32.088 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:31 smithi111 ceph-mon[27539]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:32.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:31 smithi203 ceph-mon[33225]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:32.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.492+0000 7fb90ac00700 1 -- 172.21.15.111:0/3031717735 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb904102380 msgr2=0x7fb904102790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:32.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.492+0000 7fb90ac00700 1 --2- 172.21.15.111:0/3031717735 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb904102380 0x7fb904102790 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4009910 tx=0x7fb8f4009c20 comp rx=0 tx=0).stop 2024-09-11T00:02:32.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.492+0000 7fb90ac00700 1 -- 172.21.15.111:0/3031717735 shutdown_connections 2024-09-11T00:02:32.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.492+0000 7fb90ac00700 1 --2- 172.21.15.111:0/3031717735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb904103580 0x7fb9041039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:32.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.492+0000 7fb90ac00700 1 --2- 172.21.15.111:0/3031717735 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb904102380 0x7fb904102790 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:32.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.492+0000 7fb90ac00700 1 -- 172.21.15.111:0/3031717735 >> 172.21.15.111:0/3031717735 conn(0x7fb9040fd930 msgr2=0x7fb9040ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:32.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.492+0000 7fb90ac00700 1 -- 172.21.15.111:0/3031717735 shutdown_connections 2024-09-11T00:02:32.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.492+0000 7fb90ac00700 1 -- 172.21.15.111:0/3031717735 wait complete. 2024-09-11T00:02:32.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.493+0000 7fb90ac00700 1 Processor -- start 2024-09-11T00:02:32.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.494+0000 7fb90ac00700 1 -- start start 2024-09-11T00:02:32.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.494+0000 7fb90ac00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb904102380 0x7fb904197ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:32.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.494+0000 7fb90ac00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb904103580 0x7fb9041980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:32.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.494+0000 7fb90ac00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb904198670 con 0x7fb904102380 2024-09-11T00:02:32.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.494+0000 7fb90ac00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9041987b0 con 0x7fb904103580 2024-09-11T00:02:32.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.494+0000 7fb903e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb904102380 0x7fb904197ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:32.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.494+0000 7fb903e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb904102380 0x7fb904197ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49208/0 (socket says 172.21.15.111:49208) 2024-09-11T00:02:32.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.494+0000 7fb903e00700 1 -- 172.21.15.111:0/2964809173 learned_addr learned my addr 172.21.15.111:0/2964809173 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:02:32.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.494+0000 7fb903400700 1 --2- 172.21.15.111:0/2964809173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb904103580 0x7fb9041980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:32.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.494+0000 7fb903e00700 1 -- 172.21.15.111:0/2964809173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb904103580 msgr2=0x7fb9041980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:32.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.494+0000 7fb903e00700 1 --2- 172.21.15.111:0/2964809173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb904103580 0x7fb9041980e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:32.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.494+0000 7fb903e00700 1 -- 172.21.15.111:0/2964809173 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f40095f0 con 0x7fb904102380 2024-09-11T00:02:32.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.495+0000 7fb903400700 1 --2- 172.21.15.111:0/2964809173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb904103580 0x7fb9041980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:32.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.495+0000 7fb903e00700 1 --2- 172.21.15.111:0/2964809173 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb904102380 0x7fb904197ba0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb8f400bda0 tx=0x7fb8f400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:32.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.495+0000 7fb900c00700 1 -- 172.21.15.111:0/2964809173 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8f401d070 con 0x7fb904102380 2024-09-11T00:02:32.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.495+0000 7fb900c00700 1 -- 172.21.15.111:0/2964809173 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb8f4004c50 con 0x7fb904102380 2024-09-11T00:02:32.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.495+0000 7fb900c00700 1 -- 172.21.15.111:0/2964809173 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8f400f690 con 0x7fb904102380 2024-09-11T00:02:32.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.495+0000 7fb90ac00700 1 -- 172.21.15.111:0/2964809173 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb90419d210 con 0x7fb904102380 2024-09-11T00:02:32.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.495+0000 7fb90ac00700 1 -- 172.21.15.111:0/2964809173 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb90419d6d0 con 0x7fb904102380 2024-09-11T00:02:32.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.496+0000 7fb90ac00700 1 -- 172.21.15.111:0/2964809173 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb90410aed0 con 0x7fb904102380 2024-09-11T00:02:32.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.497+0000 7fb900c00700 1 -- 172.21.15.111:0/2964809173 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fb8f400f7f0 con 0x7fb904102380 2024-09-11T00:02:32.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.498+0000 7fb900c00700 1 --2- 172.21.15.111:0/2964809173 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb8e806c680 0x7fb8e806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:32.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.498+0000 7fb900c00700 1 -- 172.21.15.111:0/2964809173 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fb8f408ccb0 con 0x7fb904102380 2024-09-11T00:02:32.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.498+0000 7fb903400700 1 --2- 172.21.15.111:0/2964809173 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb8e806c680 0x7fb8e806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:32.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.499+0000 7fb903400700 1 --2- 172.21.15.111:0/2964809173 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb8e806c680 0x7fb8e806eb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0005fd0 tx=0x7fb8f0005e30 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:32.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.503+0000 7fb900c00700 1 -- 172.21.15.111:0/2964809173 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb8f405b1e0 con 0x7fb904102380 2024-09-11T00:02:32.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.778+0000 7fb90ac00700 1 -- 172.21.15.111:0/2964809173 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fb90419de20 con 0x7fb904102380 2024-09-11T00:02:32.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.783+0000 7fb900c00700 1 -- 172.21.15.111:0/2964809173 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7fb8f405ad70 con 0x7fb904102380 2024-09-11T00:02:32.785 INFO:teuthology.orchestra.run.smithi111.stdout:[client.0] 2024-09-11T00:02:32.785 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAY3uBmciSELhAA5K7E3yBaV2OVYDj1hjtWMQ== 2024-09-11T00:02:32.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.785+0000 7fb90ac00700 1 -- 172.21.15.111:0/2964809173 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb8e806c680 msgr2=0x7fb8e806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:32.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.785+0000 7fb90ac00700 1 --2- 172.21.15.111:0/2964809173 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb8e806c680 0x7fb8e806eb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0005fd0 tx=0x7fb8f0005e30 comp rx=0 tx=0).stop 2024-09-11T00:02:32.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.785+0000 7fb90ac00700 1 -- 172.21.15.111:0/2964809173 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb904102380 msgr2=0x7fb904197ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:32.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.785+0000 7fb90ac00700 1 --2- 172.21.15.111:0/2964809173 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb904102380 0x7fb904197ba0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb8f400bda0 tx=0x7fb8f400be80 comp rx=0 tx=0).stop 2024-09-11T00:02:32.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.786+0000 7fb90ac00700 1 -- 172.21.15.111:0/2964809173 shutdown_connections 2024-09-11T00:02:32.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.786+0000 7fb90ac00700 1 --2- 172.21.15.111:0/2964809173 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb8e806c680 0x7fb8e806eb30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:32.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.786+0000 7fb90ac00700 1 --2- 172.21.15.111:0/2964809173 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb904102380 0x7fb904197ba0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:32.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.786+0000 7fb90ac00700 1 --2- 172.21.15.111:0/2964809173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb904103580 0x7fb9041980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:32.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.786+0000 7fb90ac00700 1 -- 172.21.15.111:0/2964809173 >> 172.21.15.111:0/2964809173 conn(0x7fb9040fd930 msgr2=0x7fb9041067b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:32.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.786+0000 7fb90ac00700 1 -- 172.21.15.111:0/2964809173 shutdown_connections 2024-09-11T00:02:32.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:32.786+0000 7fb90ac00700 1 -- 172.21.15.111:0/2964809173 wait complete. 2024-09-11T00:02:33.111 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:32 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/2964809173' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T00:02:33.111 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:32 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/2964809173' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T00:02:33.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:32 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/2964809173' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T00:02:33.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:32 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/2964809173' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T00:02:33.432 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-11T00:02:33.432 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-11T00:02:33.432 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T00:02:33.512 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-11T00:02:33.841 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi203/config 2024-09-11T00:02:34.276 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:33 smithi203 ceph-mon[33225]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:34.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:33 smithi111 ceph-mon[27539]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:35.755 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.753+0000 7f60ce800700 1 -- 172.21.15.203:0/1683516735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60c8101190 msgr2=0x7f60c81015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:35.755 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.753+0000 7f60ce800700 1 --2- 172.21.15.203:0/1683516735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60c8101190 0x7f60c81015e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009910 tx=0x7f60b4009c20 comp rx=0 tx=0).stop 2024-09-11T00:02:35.755 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.753+0000 7f60ce800700 1 -- 172.21.15.203:0/1683516735 shutdown_connections 2024-09-11T00:02:35.755 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.753+0000 7f60ce800700 1 --2- 172.21.15.203:0/1683516735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60c8101190 0x7f60c81015e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:35.755 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.753+0000 7f60ce800700 1 --2- 172.21.15.203:0/1683516735 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f60c80fff90 0x7f60c81003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:35.755 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.753+0000 7f60ce800700 1 -- 172.21.15.203:0/1683516735 >> 172.21.15.203:0/1683516735 conn(0x7f60c80fb500 msgr2=0x7f60c80fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:35.755 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.753+0000 7f60ce800700 1 -- 172.21.15.203:0/1683516735 shutdown_connections 2024-09-11T00:02:35.755 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.753+0000 7f60ce800700 1 -- 172.21.15.203:0/1683516735 wait complete. 2024-09-11T00:02:35.756 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.754+0000 7f60ce800700 1 Processor -- start 2024-09-11T00:02:35.757 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.754+0000 7f60ce800700 1 -- start start 2024-09-11T00:02:35.757 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.755+0000 7f60ce800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60c80fff90 0x7f60c81979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:35.757 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.755+0000 7f60ce800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f60c8101190 0x7f60c8197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:35.757 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.755+0000 7f60ce800700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c8198510 con 0x7f60c8101190 2024-09-11T00:02:35.757 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.755+0000 7f60ce800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c8198650 con 0x7f60c80fff90 2024-09-11T00:02:35.757 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.755+0000 7f60cd400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60c80fff90 0x7f60c81979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:35.757 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.755+0000 7f60cd400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60c80fff90 0x7f60c81979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:37154/0 (socket says 172.21.15.203:37154) 2024-09-11T00:02:35.757 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.755+0000 7f60cd400700 1 -- 172.21.15.203:0/4246800323 learned_addr learned my addr 172.21.15.203:0/4246800323 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-11T00:02:35.757 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.755+0000 7f60cca00700 1 --2- 172.21.15.203:0/4246800323 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f60c8101190 0x7f60c8197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:35.757 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.755+0000 7f60cd400700 1 -- 172.21.15.203:0/4246800323 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f60c8101190 msgr2=0x7f60c8197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:35.757 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.755+0000 7f60cd400700 1 --2- 172.21.15.203:0/4246800323 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f60c8101190 0x7f60c8197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:35.757 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.755+0000 7f60cd400700 1 -- 172.21.15.203:0/4246800323 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b40095f0 con 0x7f60c80fff90 2024-09-11T00:02:35.758 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.756+0000 7f60cd400700 1 --2- 172.21.15.203:0/4246800323 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60c80fff90 0x7f60c81979b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f60bc00d900 tx=0x7f60bc00dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:35.758 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.756+0000 7f60c6000700 1 -- 172.21.15.203:0/4246800323 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60bc0041f0 con 0x7f60c80fff90 2024-09-11T00:02:35.758 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.756+0000 7f60c6000700 1 -- 172.21.15.203:0/4246800323 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f60bc004350 con 0x7f60c80fff90 2024-09-11T00:02:35.758 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.756+0000 7f60ce800700 1 -- 172.21.15.203:0/4246800323 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c819d100 con 0x7f60c80fff90 2024-09-11T00:02:35.759 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.756+0000 7f60c6000700 1 -- 172.21.15.203:0/4246800323 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60bc003da0 con 0x7f60c80fff90 2024-09-11T00:02:35.759 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.756+0000 7f60ce800700 1 -- 172.21.15.203:0/4246800323 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c819d650 con 0x7f60c80fff90 2024-09-11T00:02:35.759 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.757+0000 7f60ce800700 1 -- 172.21.15.203:0/4246800323 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c8105270 con 0x7f60c80fff90 2024-09-11T00:02:35.759 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.758+0000 7f60c6000700 1 -- 172.21.15.203:0/4246800323 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f60bc009730 con 0x7f60c80fff90 2024-09-11T00:02:35.760 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.759+0000 7f60c6000700 1 --2- 172.21.15.203:0/4246800323 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f60b006c680 0x7f60b006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:35.760 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.759+0000 7f60c6000700 1 -- 172.21.15.203:0/4246800323 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f60bc08b5c0 con 0x7f60c80fff90 2024-09-11T00:02:35.760 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.759+0000 7f60cca00700 1 --2- 172.21.15.203:0/4246800323 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f60b006c680 0x7f60b006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:35.761 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.760+0000 7f60cca00700 1 --2- 172.21.15.203:0/4246800323 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f60b006c680 0x7f60b006eb30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f60b4006010 tx=0x7f60b400b540 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:35.764 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:35.763+0000 7f60c6000700 1 -- 172.21.15.203:0/4246800323 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f60bc059b30 con 0x7f60c80fff90 2024-09-11T00:02:36.042 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:36.041+0000 7f60ce800700 1 -- 172.21.15.203:0/4246800323 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f60c802cc30 con 0x7f60c80fff90 2024-09-11T00:02:36.048 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:36.047+0000 7f60c6000700 1 -- 172.21.15.203:0/4246800323 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7f60bc0596c0 con 0x7f60c80fff90 2024-09-11T00:02:36.048 INFO:teuthology.orchestra.run.smithi203.stdout:[client.1] 2024-09-11T00:02:36.048 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQAc3uBmZnqNAhAAxC7GjywWgGzO1eshtQCqjw== 2024-09-11T00:02:36.050 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:36.049+0000 7f60ce800700 1 -- 172.21.15.203:0/4246800323 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f60b006c680 msgr2=0x7f60b006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:36.051 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:36.049+0000 7f60ce800700 1 --2- 172.21.15.203:0/4246800323 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f60b006c680 0x7f60b006eb30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f60b4006010 tx=0x7f60b400b540 comp rx=0 tx=0).stop 2024-09-11T00:02:36.051 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:36.049+0000 7f60ce800700 1 -- 172.21.15.203:0/4246800323 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60c80fff90 msgr2=0x7f60c81979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:36.051 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:36.049+0000 7f60ce800700 1 --2- 172.21.15.203:0/4246800323 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60c80fff90 0x7f60c81979b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f60bc00d900 tx=0x7f60bc00dcc0 comp rx=0 tx=0).stop 2024-09-11T00:02:36.051 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:36.049+0000 7f60ce800700 1 -- 172.21.15.203:0/4246800323 shutdown_connections 2024-09-11T00:02:36.051 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:36.049+0000 7f60ce800700 1 --2- 172.21.15.203:0/4246800323 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f60b006c680 0x7f60b006eb30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:36.051 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:36.049+0000 7f60ce800700 1 --2- 172.21.15.203:0/4246800323 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60c80fff90 0x7f60c81979b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:36.051 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:36.049+0000 7f60ce800700 1 --2- 172.21.15.203:0/4246800323 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f60c8101190 0x7f60c8197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:36.051 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:36.049+0000 7f60ce800700 1 -- 172.21.15.203:0/4246800323 >> 172.21.15.203:0/4246800323 conn(0x7f60c80fb500 msgr2=0x7f60c81023b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:36.051 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:36.049+0000 7f60ce800700 1 -- 172.21.15.203:0/4246800323 shutdown_connections 2024-09-11T00:02:36.051 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:02:36.049+0000 7f60ce800700 1 -- 172.21.15.203:0/4246800323 wait complete. 2024-09-11T00:02:36.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:35 smithi203 ceph-mon[33225]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:36.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:35 smithi111 ceph-mon[27539]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:36.833 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-11T00:02:36.834 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-11T00:02:36.834 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-11T00:02:36.914 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph config log 1 --format=json 2024-09-11T00:02:37.242 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:02:37.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:36 smithi203 ceph-mon[33225]: from='client.? 172.21.15.203:0/4246800323' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T00:02:37.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:36 smithi203 ceph-mon[33225]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T00:02:37.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:36 smithi203 ceph-mon[33225]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T00:02:37.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:36 smithi111 ceph-mon[27539]: from='client.? 172.21.15.203:0/4246800323' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T00:02:37.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:36 smithi111 ceph-mon[27539]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T00:02:37.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:36 smithi111 ceph-mon[27539]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T00:02:38.301 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:38 smithi203 ceph-mon[33225]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:38.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:38 smithi111 ceph-mon[27539]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:39.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.058+0000 7fc89f200700 1 -- 172.21.15.111:0/1318595606 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8a0100ba0 msgr2=0x7fc8a0104b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:39.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.058+0000 7fc89f200700 1 --2- 172.21.15.111:0/1318595606 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8a0100ba0 0x7fc8a0104b70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc88c009910 tx=0x7fc88c009c20 comp rx=0 tx=0).stop 2024-09-11T00:02:39.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.058+0000 7fc89f200700 1 -- 172.21.15.111:0/1318595606 shutdown_connections 2024-09-11T00:02:39.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.058+0000 7fc89f200700 1 --2- 172.21.15.111:0/1318595606 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8a0100ba0 0x7fc8a0104b70 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.058+0000 7fc89f200700 1 --2- 172.21.15.111:0/1318595606 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8a0100200 0x7fc8a01005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.058+0000 7fc89f200700 1 -- 172.21.15.111:0/1318595606 >> 172.21.15.111:0/1318595606 conn(0x7fc8a00fba80 msgr2=0x7fc8a00fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:39.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.058+0000 7fc89f200700 1 -- 172.21.15.111:0/1318595606 shutdown_connections 2024-09-11T00:02:39.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.058+0000 7fc89f200700 1 -- 172.21.15.111:0/1318595606 wait complete. 2024-09-11T00:02:39.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.060+0000 7fc89f200700 1 Processor -- start 2024-09-11T00:02:39.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.060+0000 7fc89f200700 1 -- start start 2024-09-11T00:02:39.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.060+0000 7fc89f200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8a0100200 0x7fc8a019b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:39.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.060+0000 7fc89f200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8a0100ba0 0x7fc8a019bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:39.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.060+0000 7fc89f200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a019c590 con 0x7fc8a0100200 2024-09-11T00:02:39.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.060+0000 7fc89f200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a0195a40 con 0x7fc8a0100ba0 2024-09-11T00:02:39.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.061+0000 7fc89de00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8a0100200 0x7fc8a019b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:39.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.061+0000 7fc89de00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8a0100200 0x7fc8a019b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52536/0 (socket says 172.21.15.111:52536) 2024-09-11T00:02:39.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.061+0000 7fc89de00700 1 -- 172.21.15.111:0/344739567 learned_addr learned my addr 172.21.15.111:0/344739567 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:02:39.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.061+0000 7fc89d400700 1 --2- 172.21.15.111:0/344739567 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8a0100ba0 0x7fc8a019bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:39.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.061+0000 7fc89de00700 1 -- 172.21.15.111:0/344739567 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8a0100ba0 msgr2=0x7fc8a019bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:39.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.061+0000 7fc89de00700 1 --2- 172.21.15.111:0/344739567 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8a0100ba0 0x7fc8a019bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.061+0000 7fc89de00700 1 -- 172.21.15.111:0/344739567 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88c0095f0 con 0x7fc8a0100200 2024-09-11T00:02:39.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.061+0000 7fc89de00700 1 --2- 172.21.15.111:0/344739567 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8a0100200 0x7fc8a019b9c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc89000b4b0 tx=0x7fc89000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:39.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.061+0000 7fc896a00700 1 -- 172.21.15.111:0/344739567 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc890011800 con 0x7fc8a0100200 2024-09-11T00:02:39.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.062+0000 7fc896a00700 1 -- 172.21.15.111:0/344739567 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc890011e10 con 0x7fc8a0100200 2024-09-11T00:02:39.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.062+0000 7fc89f200700 1 -- 172.21.15.111:0/344739567 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a0195d20 con 0x7fc8a0100200 2024-09-11T00:02:39.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.062+0000 7fc896a00700 1 -- 172.21.15.111:0/344739567 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc89000f2e0 con 0x7fc8a0100200 2024-09-11T00:02:39.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.062+0000 7fc89f200700 1 -- 172.21.15.111:0/344739567 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a0196270 con 0x7fc8a0100200 2024-09-11T00:02:39.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.063+0000 7fc89f200700 1 -- 172.21.15.111:0/344739567 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a01084a0 con 0x7fc8a0100200 2024-09-11T00:02:39.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.064+0000 7fc896a00700 1 -- 172.21.15.111:0/344739567 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fc890010380 con 0x7fc8a0100200 2024-09-11T00:02:39.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.064+0000 7fc896a00700 1 --2- 172.21.15.111:0/344739567 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc88406c680 0x7fc88406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:39.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.065+0000 7fc896a00700 1 -- 172.21.15.111:0/344739567 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fc89008b090 con 0x7fc8a0100200 2024-09-11T00:02:39.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.065+0000 7fc89d400700 1 --2- 172.21.15.111:0/344739567 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc88406c680 0x7fc88406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:39.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.065+0000 7fc89d400700 1 --2- 172.21.15.111:0/344739567 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc88406c680 0x7fc88406eb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00fc330 tx=0x7fc88c01a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:39.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.069+0000 7fc896a00700 1 -- 172.21.15.111:0/344739567 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc890059670 con 0x7fc8a0100200 2024-09-11T00:02:39.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.271+0000 7fc89f200700 1 -- 172.21.15.111:0/344739567 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) v1 -- 0x7fc8a0196590 con 0x7fc8a0100200 2024-09-11T00:02:39.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.272+0000 7fc896a00700 1 -- 172.21.15.111:0/344739567 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v37) v1 ==== 86+0+187 (secure 0 0 0) 0x7fc890059200 con 0x7fc8a0100200 2024-09-11T00:02:39.274 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:02:39.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.274+0000 7fc89f200700 1 -- 172.21.15.111:0/344739567 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc88406c680 msgr2=0x7fc88406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:39.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.274+0000 7fc89f200700 1 --2- 172.21.15.111:0/344739567 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc88406c680 0x7fc88406eb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00fc330 tx=0x7fc88c01a040 comp rx=0 tx=0).stop 2024-09-11T00:02:39.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.274+0000 7fc89f200700 1 -- 172.21.15.111:0/344739567 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8a0100200 msgr2=0x7fc8a019b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:39.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.274+0000 7fc89f200700 1 --2- 172.21.15.111:0/344739567 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8a0100200 0x7fc8a019b9c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc89000b4b0 tx=0x7fc89000b870 comp rx=0 tx=0).stop 2024-09-11T00:02:39.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.274+0000 7fc89f200700 1 -- 172.21.15.111:0/344739567 shutdown_connections 2024-09-11T00:02:39.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.274+0000 7fc89f200700 1 --2- 172.21.15.111:0/344739567 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc88406c680 0x7fc88406eb30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.274+0000 7fc89f200700 1 --2- 172.21.15.111:0/344739567 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8a0100200 0x7fc8a019b9c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.274+0000 7fc89f200700 1 --2- 172.21.15.111:0/344739567 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8a0100ba0 0x7fc8a019bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:39.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.274+0000 7fc89f200700 1 -- 172.21.15.111:0/344739567 >> 172.21.15.111:0/344739567 conn(0x7fc8a00fba80 msgr2=0x7fc8a00fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:39.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.274+0000 7fc89f200700 1 -- 172.21.15.111:0/344739567 shutdown_connections 2024-09-11T00:02:39.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:39.274+0000 7fc89f200700 1 -- 172.21.15.111:0/344739567 wait complete. 2024-09-11T00:02:39.922 INFO:teuthology.orchestra.run.smithi111.stdout:[{"version":37,"timestamp":"2024-09-11T00:02:24.933388+0000","name":"","changes":[{"name":"osd/host:smithi203/osd_memory_target","previous_value":"7819104665","new_value":"5212736443"}]}] 2024-09-11T00:02:39.923 INFO:tasks.ceph_manager:config epoch is 37 2024-09-11T00:02:39.923 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T00:02:39.924 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-11T00:02:39.924 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-11T00:02:40.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:40 smithi111 ceph-mon[27539]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:40.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:40 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/344739567' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-11T00:02:40.242 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:02:40.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:40 smithi203 ceph-mon[33225]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:40.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:40 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/344739567' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-11T00:02:41.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.903+0000 7fedb3e00700 1 -- 172.21.15.111:0/2271247431 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedb4073a00 msgr2=0x7fedb4110a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:41.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.903+0000 7fedb3e00700 1 --2- 172.21.15.111:0/2271247431 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedb4073a00 0x7fedb4110a70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fed9c009910 tx=0x7fed9c009c20 comp rx=0 tx=0).stop 2024-09-11T00:02:41.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.903+0000 7fedb3e00700 1 -- 172.21.15.111:0/2271247431 shutdown_connections 2024-09-11T00:02:41.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.903+0000 7fedb3e00700 1 --2- 172.21.15.111:0/2271247431 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedb4073a00 0x7fedb4110a70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:41.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.903+0000 7fedb3e00700 1 --2- 172.21.15.111:0/2271247431 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedb40730f0 0x7fedb40734c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:41.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.903+0000 7fedb3e00700 1 -- 172.21.15.111:0/2271247431 >> 172.21.15.111:0/2271247431 conn(0x7fedb40fba80 msgr2=0x7fedb40fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:41.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.903+0000 7fedb3e00700 1 -- 172.21.15.111:0/2271247431 shutdown_connections 2024-09-11T00:02:41.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.903+0000 7fedb3e00700 1 -- 172.21.15.111:0/2271247431 wait complete. 2024-09-11T00:02:41.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.904+0000 7fedb3e00700 1 Processor -- start 2024-09-11T00:02:41.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.904+0000 7fedb3e00700 1 -- start start 2024-09-11T00:02:41.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.905+0000 7fedb3e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedb40730f0 0x7fedb419c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:41.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.905+0000 7fedb3e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedb4073a00 0x7fedb419c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:41.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.905+0000 7fedb3e00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb419cd10 con 0x7fedb40730f0 2024-09-11T00:02:41.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.905+0000 7fedb3e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb41a0aa0 con 0x7fedb4073a00 2024-09-11T00:02:41.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.905+0000 7fedb2a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedb40730f0 0x7fedb419c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:41.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.905+0000 7fedb2a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedb40730f0 0x7fedb419c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52542/0 (socket says 172.21.15.111:52542) 2024-09-11T00:02:41.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.905+0000 7fedb2a00700 1 -- 172.21.15.111:0/1328391590 learned_addr learned my addr 172.21.15.111:0/1328391590 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:02:41.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.905+0000 7fedabe00700 1 --2- 172.21.15.111:0/1328391590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedb4073a00 0x7fedb419c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:41.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.905+0000 7fedb2a00700 1 -- 172.21.15.111:0/1328391590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedb4073a00 msgr2=0x7fedb419c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:41.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.905+0000 7fedb2a00700 1 --2- 172.21.15.111:0/1328391590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedb4073a00 0x7fedb419c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:41.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.905+0000 7fedb2a00700 1 -- 172.21.15.111:0/1328391590 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c0095f0 con 0x7fedb40730f0 2024-09-11T00:02:41.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.906+0000 7fedb2a00700 1 --2- 172.21.15.111:0/1328391590 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedb40730f0 0x7fedb419c0f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7feda400d8d0 tx=0x7feda400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:41.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.906+0000 7fedb8a00700 1 -- 172.21.15.111:0/1328391590 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feda4009940 con 0x7fedb40730f0 2024-09-11T00:02:41.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.906+0000 7fedb8a00700 1 -- 172.21.15.111:0/1328391590 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7feda4010460 con 0x7fedb40730f0 2024-09-11T00:02:41.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.906+0000 7fedb8a00700 1 -- 172.21.15.111:0/1328391590 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feda400f5f0 con 0x7fedb40730f0 2024-09-11T00:02:41.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.906+0000 7fedb3e00700 1 -- 172.21.15.111:0/1328391590 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb41a0d80 con 0x7fedb40730f0 2024-09-11T00:02:41.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.906+0000 7fedb3e00700 1 -- 172.21.15.111:0/1328391590 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb41a12d0 con 0x7fedb40730f0 2024-09-11T00:02:41.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.907+0000 7fedb3e00700 1 -- 172.21.15.111:0/1328391590 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb410e1f0 con 0x7fedb40730f0 2024-09-11T00:02:41.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.909+0000 7fedb8a00700 1 -- 172.21.15.111:0/1328391590 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7feda40105d0 con 0x7fedb40730f0 2024-09-11T00:02:41.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.910+0000 7fedb8a00700 1 --2- 172.21.15.111:0/1328391590 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fed9806c680 0x7fed9806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:41.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.910+0000 7fedb8a00700 1 -- 172.21.15.111:0/1328391590 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7feda408b480 con 0x7fedb40730f0 2024-09-11T00:02:41.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.910+0000 7fedabe00700 1 --2- 172.21.15.111:0/1328391590 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fed9806c680 0x7fed9806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:41.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.911+0000 7fedabe00700 1 --2- 172.21.15.111:0/1328391590 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fed9806c680 0x7fed9806eb30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fedb419d710 tx=0x7fed9c01a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:41.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:41.914+0000 7fedb8a00700 1 -- 172.21.15.111:0/1328391590 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7feda4055f20 con 0x7fedb40730f0 2024-09-11T00:02:42.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:42.173+0000 7fedb3e00700 1 -- 172.21.15.111:0/1328391590 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fedb41a15b0 con 0x7fedb40730f0 2024-09-11T00:02:42.175 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:42 smithi111 ceph-mon[27539]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:42.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:42.176+0000 7fedb8a00700 1 -- 172.21.15.111:0/1328391590 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+172837 (secure 0 0 0) 0x7feda4059540 con 0x7fedb40730f0 2024-09-11T00:02:42.181 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:02:42.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:42.179+0000 7fedb3e00700 1 -- 172.21.15.111:0/1328391590 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fed9806c680 msgr2=0x7fed9806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:42.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:42.179+0000 7fedb3e00700 1 --2- 172.21.15.111:0/1328391590 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fed9806c680 0x7fed9806eb30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fedb419d710 tx=0x7fed9c01a040 comp rx=0 tx=0).stop 2024-09-11T00:02:42.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:42.180+0000 7fedb3e00700 1 -- 172.21.15.111:0/1328391590 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedb40730f0 msgr2=0x7fedb419c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:42.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:42.180+0000 7fedb3e00700 1 --2- 172.21.15.111:0/1328391590 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedb40730f0 0x7fedb419c0f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7feda400d8d0 tx=0x7feda400dc90 comp rx=0 tx=0).stop 2024-09-11T00:02:42.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:42.180+0000 7fedb3e00700 1 -- 172.21.15.111:0/1328391590 shutdown_connections 2024-09-11T00:02:42.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:42.180+0000 7fedb3e00700 1 --2- 172.21.15.111:0/1328391590 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fed9806c680 0x7fed9806eb30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:42.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:42.180+0000 7fedb3e00700 1 --2- 172.21.15.111:0/1328391590 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedb40730f0 0x7fedb419c0f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:42.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:42.180+0000 7fedb3e00700 1 --2- 172.21.15.111:0/1328391590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedb4073a00 0x7fedb419c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:42.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:42.180+0000 7fedb3e00700 1 -- 172.21.15.111:0/1328391590 >> 172.21.15.111:0/1328391590 conn(0x7fedb40fba80 msgr2=0x7fedb4102580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:42.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:42.180+0000 7fedb3e00700 1 -- 172.21.15.111:0/1328391590 shutdown_connections 2024-09-11T00:02:42.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:42.180+0000 7fedb3e00700 1 -- 172.21.15.111:0/1328391590 wait complete. 2024-09-11T00:02:42.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:42 smithi203 ceph-mon[33225]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:42.836 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":19,"active_gid":14211,"active_name":"smithi111.ypucji","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":2},{"type":"v1","addr":"172.21.15.111:6801","nonce":2}]},"active_addr":"172.21.15.111:6801/2","active_change":"2024-09-10T23:57:30.610242+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14236,"name":"smithi203.smuspl","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.111:8443/","prometheus":"http://172.21.15.111:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.111:0","nonce":1012099414}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.111:0","nonce":3527343662}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.111:0","nonce":3305093032}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.111:0","nonce":3001861837}]}]} 2024-09-11T00:02:42.840 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-11T00:02:42.840 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-11T00:02:42.841 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T00:02:43.160 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:02:43.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:43 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/1328391590' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-11T00:02:43.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:43 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/1328391590' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-11T00:02:44.303 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:44 smithi111 ceph-mon[27539]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:44.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:44 smithi203 ceph-mon[33225]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:44.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.959+0000 7f73bb400700 1 -- 172.21.15.111:0/1896143503 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73b4102fa0 msgr2=0x7f73b4106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:44.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.959+0000 7f73bb400700 1 --2- 172.21.15.111:0/1896143503 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73b4102fa0 0x7f73b4106f70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f73a0009910 tx=0x7f73a0009c20 comp rx=0 tx=0).stop 2024-09-11T00:02:44.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.960+0000 7f73bb400700 1 -- 172.21.15.111:0/1896143503 shutdown_connections 2024-09-11T00:02:44.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.960+0000 7f73bb400700 1 --2- 172.21.15.111:0/1896143503 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73b4102fa0 0x7f73b4106f70 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:44.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.960+0000 7f73bb400700 1 --2- 172.21.15.111:0/1896143503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73b4102600 0x7f73b41029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:44.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.960+0000 7f73bb400700 1 -- 172.21.15.111:0/1896143503 >> 172.21.15.111:0/1896143503 conn(0x7f73b40fdec0 msgr2=0x7f73b41002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:44.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.960+0000 7f73bb400700 1 -- 172.21.15.111:0/1896143503 shutdown_connections 2024-09-11T00:02:44.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.960+0000 7f73bb400700 1 -- 172.21.15.111:0/1896143503 wait complete. 2024-09-11T00:02:44.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.961+0000 7f73bb400700 1 Processor -- start 2024-09-11T00:02:44.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.961+0000 7f73bb400700 1 -- start start 2024-09-11T00:02:44.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.961+0000 7f73bb400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73b4102600 0x7f73b4197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:44.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.961+0000 7f73bb400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73b4102fa0 0x7f73b4198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:44.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.961+0000 7f73bb400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b4198c10 con 0x7f73b4102fa0 2024-09-11T00:02:44.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.961+0000 7f73bb400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b419c9a0 con 0x7f73b4102600 2024-09-11T00:02:44.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.961+0000 7f73b3e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73b4102fa0 0x7f73b4198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:44.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.961+0000 7f73b3e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73b4102fa0 0x7f73b4198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52550/0 (socket says 172.21.15.111:52550) 2024-09-11T00:02:44.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.961+0000 7f73b3e00700 1 -- 172.21.15.111:0/4201080886 learned_addr learned my addr 172.21.15.111:0/4201080886 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:02:44.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.961+0000 7f73b8a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73b4102600 0x7f73b4197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:44.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.962+0000 7f73b3e00700 1 -- 172.21.15.111:0/4201080886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73b4102600 msgr2=0x7f73b4197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:44.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.962+0000 7f73b3e00700 1 --2- 172.21.15.111:0/4201080886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73b4102600 0x7f73b4197ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:44.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.962+0000 7f73b3e00700 1 -- 172.21.15.111:0/4201080886 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a00095f0 con 0x7f73b4102fa0 2024-09-11T00:02:44.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.962+0000 7f73b3e00700 1 --2- 172.21.15.111:0/4201080886 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73b4102fa0 0x7f73b4198530 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f73a000bd70 tx=0x7f73a000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:44.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.962+0000 7f73b1600700 1 -- 172.21.15.111:0/4201080886 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73a001d070 con 0x7f73b4102fa0 2024-09-11T00:02:44.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.962+0000 7f73bb400700 1 -- 172.21.15.111:0/4201080886 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b419cc20 con 0x7f73b4102fa0 2024-09-11T00:02:44.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.962+0000 7f73b1600700 1 -- 172.21.15.111:0/4201080886 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f73a000f460 con 0x7f73b4102fa0 2024-09-11T00:02:44.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.962+0000 7f73b1600700 1 -- 172.21.15.111:0/4201080886 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73a0017630 con 0x7f73b4102fa0 2024-09-11T00:02:44.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.962+0000 7f73bb400700 1 -- 172.21.15.111:0/4201080886 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b419d110 con 0x7f73b4102fa0 2024-09-11T00:02:44.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.963+0000 7f73bb400700 1 -- 172.21.15.111:0/4201080886 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b404ea50 con 0x7f73b4102fa0 2024-09-11T00:02:44.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.965+0000 7f73b1600700 1 -- 172.21.15.111:0/4201080886 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f73a000f5d0 con 0x7f73b4102fa0 2024-09-11T00:02:44.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.966+0000 7f73b1600700 1 --2- 172.21.15.111:0/4201080886 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f739c06c680 0x7f739c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:44.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.966+0000 7f73b1600700 1 -- 172.21.15.111:0/4201080886 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f73a008cb70 con 0x7f73b4102fa0 2024-09-11T00:02:44.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.967+0000 7f73b8a00700 1 --2- 172.21.15.111:0/4201080886 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f739c06c680 0x7f739c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:44.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.967+0000 7f73b8a00700 1 --2- 172.21.15.111:0/4201080886 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f739c06c680 0x7f739c06eb30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f73a8005950 tx=0x7f73a800b410 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:44.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:44.970+0000 7f73b1600700 1 -- 172.21.15.111:0/4201080886 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f73a0057610 con 0x7f73b4102fa0 2024-09-11T00:02:45.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:45.177+0000 7f73bb400700 1 -- 172.21.15.111:0/4201080886 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73b4199350 con 0x7f73b4102fa0 2024-09-11T00:02:45.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:45.178+0000 7f73b1600700 1 -- 172.21.15.111:0/4201080886 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11053 (secure 0 0 0) 0x7f73a005ac30 con 0x7f73b4102fa0 2024-09-11T00:02:45.181 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:02:45.181 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":41,"fsid":"03107fbe-6fd0-11ef-bcea-c7b262605968","created":"2024-09-10T23:54:57.670630+0000","modified":"2024-09-11T00:02:22.793843+0000","last_up_change":"2024-09-11T00:02:21.783719+0000","last_in_change":"2024-09-11T00:02:00.006293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:00:53.220421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"677fb551-96f5-4160-9f99-ffd1ca28e12e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":905671165},{"type":"v1","addr":"172.21.15.111:6803","nonce":905671165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":905671165},{"type":"v1","addr":"172.21.15.111:6805","nonce":905671165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":905671165},{"type":"v1","addr":"172.21.15.111:6809","nonce":905671165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":905671165},{"type":"v1","addr":"172.21.15.111:6807","nonce":905671165}]},"public_addr":"172.21.15.111:6803/905671165","cluster_addr":"172.21.15.111:6805/905671165","heartbeat_back_addr":"172.21.15.111:6809/905671165","heartbeat_front_addr":"172.21.15.111:6807/905671165","state":["exists","up"]},{"osd":1,"uuid":"1b7f9f82-fe27-46d4-a478-d88ed6ea074b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":1146454471},{"type":"v1","addr":"172.21.15.111:6811","nonce":1146454471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1146454471},{"type":"v1","addr":"172.21.15.111:6813","nonce":1146454471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1146454471},{"type":"v1","addr":"172.21.15.111:6817","nonce":1146454471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":1146454471},{"type":"v1","addr":"172.21.15.111:6815","nonce":1146454471}]},"public_addr":"172.21.15.111:6811/1146454471","cluster_addr":"172.21.15.111:6813/1146454471","heartbeat_back_addr":"172.21.15.111:6817/1146454471","heartbeat_front_addr":"172.21.15.111:6815/1146454471","state":["exists","up"]},{"osd":2,"uuid":"68de9f31-9af1-4fd7-a724-3249f4ff2660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":39993762},{"type":"v1","addr":"172.21.15.111:6819","nonce":39993762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":39993762},{"type":"v1","addr":"172.21.15.111:6821","nonce":39993762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":39993762},{"type":"v1","addr":"172.21.15.111:6825","nonce":39993762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":39993762},{"type":"v1","addr":"172.21.15.111:6823","nonce":39993762}]},"public_addr":"172.21.15.111:6819/39993762","cluster_addr":"172.21.15.111:6821/39993762","heartbeat_back_addr":"172.21.15.111:6825/39993762","heartbeat_front_addr":"172.21.15.111:6823/39993762","state":["exists","up"]},{"osd":3,"uuid":"315ef72a-7cb4-48d9-b4d7-2ee54fd230e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":684842797},{"type":"v1","addr":"172.21.15.203:6801","nonce":684842797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":684842797},{"type":"v1","addr":"172.21.15.203:6803","nonce":684842797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":684842797},{"type":"v1","addr":"172.21.15.203:6807","nonce":684842797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":684842797},{"type":"v1","addr":"172.21.15.203:6805","nonce":684842797}]},"public_addr":"172.21.15.203:6801/684842797","cluster_addr":"172.21.15.203:6803/684842797","heartbeat_back_addr":"172.21.15.203:6807/684842797","heartbeat_front_addr":"172.21.15.203:6805/684842797","state":["exists","up"]},{"osd":4,"uuid":"166b7f5c-1c8c-4873-acfa-eceee13741eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":977568057},{"type":"v1","addr":"172.21.15.203:6809","nonce":977568057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":977568057},{"type":"v1","addr":"172.21.15.203:6811","nonce":977568057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":977568057},{"type":"v1","addr":"172.21.15.203:6815","nonce":977568057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":977568057},{"type":"v1","addr":"172.21.15.203:6813","nonce":977568057}]},"public_addr":"172.21.15.203:6809/977568057","cluster_addr":"172.21.15.203:6811/977568057","heartbeat_back_addr":"172.21.15.203:6815/977568057","heartbeat_front_addr":"172.21.15.203:6813/977568057","state":["exists","up"]},{"osd":5,"uuid":"9f9d7576-bc02-4fe3-b08f-a439fee67df7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3580090636},{"type":"v1","addr":"172.21.15.203:6817","nonce":3580090636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":3580090636},{"type":"v1","addr":"172.21.15.203:6819","nonce":3580090636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3580090636},{"type":"v1","addr":"172.21.15.203:6823","nonce":3580090636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3580090636},{"type":"v1","addr":"172.21.15.203:6821","nonce":3580090636}]},"public_addr":"172.21.15.203:6817/3580090636","cluster_addr":"172.21.15.203:6819/3580090636","heartbeat_back_addr":"172.21.15.203:6823/3580090636","heartbeat_front_addr":"172.21.15.203:6821/3580090636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:59:42.353286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:00:15.382222+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:00:49.789267+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:01:18.072373+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:01:48.244923+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:02:20.636978+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.111:0/204109822":"2024-09-11T23:57:30.610091+0000","172.21.15.111:0/118783074":"2024-09-11T23:56:15.498737+0000","172.21.15.111:0/4232639257":"2024-09-11T23:56:15.498737+0000","172.21.15.111:0/2851283125":"2024-09-11T23:57:30.610091+0000","172.21.15.111:6801/2":"2024-09-11T23:55:34.617670+0000","172.21.15.111:6800/2":"2024-09-11T23:55:34.617670+0000","172.21.15.111:0/745179268":"2024-09-11T23:57:30.610091+0000","172.21.15.111:0/113012487":"2024-09-11T23:55:34.617670+0000","172.21.15.111:0/353472070":"2024-09-11T23:55:34.617670+0000","172.21.15.111:0/4097088644":"2024-09-11T23:55:34.617670+0000","172.21.15.111:0/92336389":"2024-09-11T23:56:15.498737+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:02:45.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:45.182+0000 7f73bb400700 1 -- 172.21.15.111:0/4201080886 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f739c06c680 msgr2=0x7f739c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:45.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:45.182+0000 7f73bb400700 1 --2- 172.21.15.111:0/4201080886 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f739c06c680 0x7f739c06eb30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f73a8005950 tx=0x7f73a800b410 comp rx=0 tx=0).stop 2024-09-11T00:02:45.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:45.182+0000 7f73bb400700 1 -- 172.21.15.111:0/4201080886 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73b4102fa0 msgr2=0x7f73b4198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:45.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:45.182+0000 7f73bb400700 1 --2- 172.21.15.111:0/4201080886 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73b4102fa0 0x7f73b4198530 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f73a000bd70 tx=0x7f73a000bda0 comp rx=0 tx=0).stop 2024-09-11T00:02:45.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:45.182+0000 7f73bb400700 1 -- 172.21.15.111:0/4201080886 shutdown_connections 2024-09-11T00:02:45.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:45.182+0000 7f73bb400700 1 --2- 172.21.15.111:0/4201080886 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f739c06c680 0x7f739c06eb30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:45.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:45.182+0000 7f73bb400700 1 --2- 172.21.15.111:0/4201080886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73b4102600 0x7f73b4197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:45.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:45.182+0000 7f73bb400700 1 --2- 172.21.15.111:0/4201080886 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73b4102fa0 0x7f73b4198530 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:45.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:45.182+0000 7f73bb400700 1 -- 172.21.15.111:0/4201080886 >> 172.21.15.111:0/4201080886 conn(0x7f73b40fdec0 msgr2=0x7f73b40ff4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:45.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:45.182+0000 7f73bb400700 1 -- 172.21.15.111:0/4201080886 shutdown_connections 2024-09-11T00:02:45.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:45.182+0000 7f73bb400700 1 -- 172.21.15.111:0/4201080886 wait complete. 2024-09-11T00:02:45.832 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-11T00:02:45.832 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T00:02:46.151 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:02:46.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:46 smithi111 ceph-mon[27539]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:46.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:46 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/4201080886' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T00:02:46.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:46 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:02:46.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:46 smithi203 ceph-mon[33225]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:46.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:46 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/4201080886' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T00:02:46.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:46 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:02:47.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.830+0000 7fc390c00700 1 -- 172.21.15.111:0/3450519729 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc38c102600 msgr2=0x7fc38c1029d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:47.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.830+0000 7fc390c00700 1 --2- 172.21.15.111:0/3450519729 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc38c102600 0x7fc38c1029d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc37c009910 tx=0x7fc37c009c20 comp rx=0 tx=0).stop 2024-09-11T00:02:47.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.830+0000 7fc390c00700 1 -- 172.21.15.111:0/3450519729 shutdown_connections 2024-09-11T00:02:47.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.830+0000 7fc390c00700 1 --2- 172.21.15.111:0/3450519729 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc38c102fa0 0x7fc38c106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:47.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.830+0000 7fc390c00700 1 --2- 172.21.15.111:0/3450519729 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc38c102600 0x7fc38c1029d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:47.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.830+0000 7fc390c00700 1 -- 172.21.15.111:0/3450519729 >> 172.21.15.111:0/3450519729 conn(0x7fc38c0fdec0 msgr2=0x7fc38c1002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:47.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.831+0000 7fc390c00700 1 -- 172.21.15.111:0/3450519729 shutdown_connections 2024-09-11T00:02:47.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.831+0000 7fc390c00700 1 -- 172.21.15.111:0/3450519729 wait complete. 2024-09-11T00:02:47.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.832+0000 7fc390c00700 1 Processor -- start 2024-09-11T00:02:47.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.832+0000 7fc390c00700 1 -- start start 2024-09-11T00:02:47.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.832+0000 7fc390c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc38c102600 0x7fc38c197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:47.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.832+0000 7fc390c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc38c102fa0 0x7fc38c1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:47.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.832+0000 7fc390c00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c198bd0 con 0x7fc38c102fa0 2024-09-11T00:02:47.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.832+0000 7fc390c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c19c960 con 0x7fc38c102600 2024-09-11T00:02:47.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.832+0000 7fc389400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc38c102fa0 0x7fc38c1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:47.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.832+0000 7fc389400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc38c102fa0 0x7fc38c1984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:33124/0 (socket says 172.21.15.111:33124) 2024-09-11T00:02:47.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.832+0000 7fc389400700 1 -- 172.21.15.111:0/2801495006 learned_addr learned my addr 172.21.15.111:0/2801495006 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:02:47.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.832+0000 7fc389e00700 1 --2- 172.21.15.111:0/2801495006 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc38c102600 0x7fc38c197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:47.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.833+0000 7fc389400700 1 -- 172.21.15.111:0/2801495006 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc38c102600 msgr2=0x7fc38c197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:47.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.833+0000 7fc389400700 1 --2- 172.21.15.111:0/2801495006 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc38c102600 0x7fc38c197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:47.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.833+0000 7fc389400700 1 -- 172.21.15.111:0/2801495006 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c0095f0 con 0x7fc38c102fa0 2024-09-11T00:02:47.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.833+0000 7fc389400700 1 --2- 172.21.15.111:0/2801495006 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc38c102fa0 0x7fc38c1984f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc37800d900 tx=0x7fc37800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:47.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.833+0000 7fc382a00700 1 -- 172.21.15.111:0/2801495006 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc378009900 con 0x7fc38c102fa0 2024-09-11T00:02:47.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.833+0000 7fc382a00700 1 -- 172.21.15.111:0/2801495006 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc378010460 con 0x7fc38c102fa0 2024-09-11T00:02:47.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.833+0000 7fc390c00700 1 -- 172.21.15.111:0/2801495006 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc38c19cc40 con 0x7fc38c102fa0 2024-09-11T00:02:47.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.833+0000 7fc382a00700 1 -- 172.21.15.111:0/2801495006 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc37800f5f0 con 0x7fc38c102fa0 2024-09-11T00:02:47.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.833+0000 7fc390c00700 1 -- 172.21.15.111:0/2801495006 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc38c19d190 con 0x7fc38c102fa0 2024-09-11T00:02:47.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.834+0000 7fc390c00700 1 -- 172.21.15.111:0/2801495006 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc38c04ea50 con 0x7fc38c102fa0 2024-09-11T00:02:47.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.836+0000 7fc382a00700 1 -- 172.21.15.111:0/2801495006 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fc3780105d0 con 0x7fc38c102fa0 2024-09-11T00:02:47.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.836+0000 7fc382a00700 1 --2- 172.21.15.111:0/2801495006 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc37006c680 0x7fc37006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:47.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.837+0000 7fc382a00700 1 -- 172.21.15.111:0/2801495006 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fc37808b0e0 con 0x7fc38c102fa0 2024-09-11T00:02:47.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.837+0000 7fc389e00700 1 --2- 172.21.15.111:0/2801495006 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc37006c680 0x7fc37006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:47.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.837+0000 7fc389e00700 1 --2- 172.21.15.111:0/2801495006 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc37006c680 0x7fc37006eb30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00b5c0 tx=0x7fc37c01a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:47.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:47.841+0000 7fc382a00700 1 -- 172.21.15.111:0/2801495006 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc378055b00 con 0x7fc38c102fa0 2024-09-11T00:02:48.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:48.038+0000 7fc390c00700 1 -- 172.21.15.111:0/2801495006 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc38c19d600 con 0x7fc38c102fa0 2024-09-11T00:02:48.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:48.039+0000 7fc382a00700 1 -- 172.21.15.111:0/2801495006 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11053 (secure 0 0 0) 0x7fc378089e60 con 0x7fc38c102fa0 2024-09-11T00:02:48.041 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:02:48.041 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":41,"fsid":"03107fbe-6fd0-11ef-bcea-c7b262605968","created":"2024-09-10T23:54:57.670630+0000","modified":"2024-09-11T00:02:22.793843+0000","last_up_change":"2024-09-11T00:02:21.783719+0000","last_in_change":"2024-09-11T00:02:00.006293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:00:53.220421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"677fb551-96f5-4160-9f99-ffd1ca28e12e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":905671165},{"type":"v1","addr":"172.21.15.111:6803","nonce":905671165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":905671165},{"type":"v1","addr":"172.21.15.111:6805","nonce":905671165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":905671165},{"type":"v1","addr":"172.21.15.111:6809","nonce":905671165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":905671165},{"type":"v1","addr":"172.21.15.111:6807","nonce":905671165}]},"public_addr":"172.21.15.111:6803/905671165","cluster_addr":"172.21.15.111:6805/905671165","heartbeat_back_addr":"172.21.15.111:6809/905671165","heartbeat_front_addr":"172.21.15.111:6807/905671165","state":["exists","up"]},{"osd":1,"uuid":"1b7f9f82-fe27-46d4-a478-d88ed6ea074b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":1146454471},{"type":"v1","addr":"172.21.15.111:6811","nonce":1146454471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1146454471},{"type":"v1","addr":"172.21.15.111:6813","nonce":1146454471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1146454471},{"type":"v1","addr":"172.21.15.111:6817","nonce":1146454471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":1146454471},{"type":"v1","addr":"172.21.15.111:6815","nonce":1146454471}]},"public_addr":"172.21.15.111:6811/1146454471","cluster_addr":"172.21.15.111:6813/1146454471","heartbeat_back_addr":"172.21.15.111:6817/1146454471","heartbeat_front_addr":"172.21.15.111:6815/1146454471","state":["exists","up"]},{"osd":2,"uuid":"68de9f31-9af1-4fd7-a724-3249f4ff2660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":39993762},{"type":"v1","addr":"172.21.15.111:6819","nonce":39993762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":39993762},{"type":"v1","addr":"172.21.15.111:6821","nonce":39993762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":39993762},{"type":"v1","addr":"172.21.15.111:6825","nonce":39993762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":39993762},{"type":"v1","addr":"172.21.15.111:6823","nonce":39993762}]},"public_addr":"172.21.15.111:6819/39993762","cluster_addr":"172.21.15.111:6821/39993762","heartbeat_back_addr":"172.21.15.111:6825/39993762","heartbeat_front_addr":"172.21.15.111:6823/39993762","state":["exists","up"]},{"osd":3,"uuid":"315ef72a-7cb4-48d9-b4d7-2ee54fd230e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":684842797},{"type":"v1","addr":"172.21.15.203:6801","nonce":684842797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":684842797},{"type":"v1","addr":"172.21.15.203:6803","nonce":684842797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":684842797},{"type":"v1","addr":"172.21.15.203:6807","nonce":684842797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":684842797},{"type":"v1","addr":"172.21.15.203:6805","nonce":684842797}]},"public_addr":"172.21.15.203:6801/684842797","cluster_addr":"172.21.15.203:6803/684842797","heartbeat_back_addr":"172.21.15.203:6807/684842797","heartbeat_front_addr":"172.21.15.203:6805/684842797","state":["exists","up"]},{"osd":4,"uuid":"166b7f5c-1c8c-4873-acfa-eceee13741eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":977568057},{"type":"v1","addr":"172.21.15.203:6809","nonce":977568057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":977568057},{"type":"v1","addr":"172.21.15.203:6811","nonce":977568057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":977568057},{"type":"v1","addr":"172.21.15.203:6815","nonce":977568057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":977568057},{"type":"v1","addr":"172.21.15.203:6813","nonce":977568057}]},"public_addr":"172.21.15.203:6809/977568057","cluster_addr":"172.21.15.203:6811/977568057","heartbeat_back_addr":"172.21.15.203:6815/977568057","heartbeat_front_addr":"172.21.15.203:6813/977568057","state":["exists","up"]},{"osd":5,"uuid":"9f9d7576-bc02-4fe3-b08f-a439fee67df7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3580090636},{"type":"v1","addr":"172.21.15.203:6817","nonce":3580090636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":3580090636},{"type":"v1","addr":"172.21.15.203:6819","nonce":3580090636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3580090636},{"type":"v1","addr":"172.21.15.203:6823","nonce":3580090636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3580090636},{"type":"v1","addr":"172.21.15.203:6821","nonce":3580090636}]},"public_addr":"172.21.15.203:6817/3580090636","cluster_addr":"172.21.15.203:6819/3580090636","heartbeat_back_addr":"172.21.15.203:6823/3580090636","heartbeat_front_addr":"172.21.15.203:6821/3580090636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:59:42.353286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:00:15.382222+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:00:49.789267+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:01:18.072373+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:01:48.244923+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:02:20.636978+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.111:0/204109822":"2024-09-11T23:57:30.610091+0000","172.21.15.111:0/118783074":"2024-09-11T23:56:15.498737+0000","172.21.15.111:0/4232639257":"2024-09-11T23:56:15.498737+0000","172.21.15.111:0/2851283125":"2024-09-11T23:57:30.610091+0000","172.21.15.111:6801/2":"2024-09-11T23:55:34.617670+0000","172.21.15.111:6800/2":"2024-09-11T23:55:34.617670+0000","172.21.15.111:0/745179268":"2024-09-11T23:57:30.610091+0000","172.21.15.111:0/113012487":"2024-09-11T23:55:34.617670+0000","172.21.15.111:0/353472070":"2024-09-11T23:55:34.617670+0000","172.21.15.111:0/4097088644":"2024-09-11T23:55:34.617670+0000","172.21.15.111:0/92336389":"2024-09-11T23:56:15.498737+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:02:48.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:48.042+0000 7fc390c00700 1 -- 172.21.15.111:0/2801495006 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc37006c680 msgr2=0x7fc37006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:48.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:48.042+0000 7fc390c00700 1 --2- 172.21.15.111:0/2801495006 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc37006c680 0x7fc37006eb30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00b5c0 tx=0x7fc37c01a040 comp rx=0 tx=0).stop 2024-09-11T00:02:48.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:48.042+0000 7fc390c00700 1 -- 172.21.15.111:0/2801495006 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc38c102fa0 msgr2=0x7fc38c1984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:48.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:48.042+0000 7fc390c00700 1 --2- 172.21.15.111:0/2801495006 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc38c102fa0 0x7fc38c1984f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc37800d900 tx=0x7fc37800dc10 comp rx=0 tx=0).stop 2024-09-11T00:02:48.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:48.042+0000 7fc390c00700 1 -- 172.21.15.111:0/2801495006 shutdown_connections 2024-09-11T00:02:48.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:48.042+0000 7fc390c00700 1 --2- 172.21.15.111:0/2801495006 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc37006c680 0x7fc37006eb30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:48.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:48.042+0000 7fc390c00700 1 --2- 172.21.15.111:0/2801495006 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc38c102600 0x7fc38c197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:48.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:48.042+0000 7fc390c00700 1 --2- 172.21.15.111:0/2801495006 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc38c102fa0 0x7fc38c1984f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:48.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:48.042+0000 7fc390c00700 1 -- 172.21.15.111:0/2801495006 >> 172.21.15.111:0/2801495006 conn(0x7fc38c0fdec0 msgr2=0x7fc38c0ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:48.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:48.042+0000 7fc390c00700 1 -- 172.21.15.111:0/2801495006 shutdown_connections 2024-09-11T00:02:48.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:48.042+0000 7fc390c00700 1 -- 172.21.15.111:0/2801495006 wait complete. 2024-09-11T00:02:48.372 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:48 smithi111 ceph-mon[27539]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:48.373 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:48 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/2801495006' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T00:02:48.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:48 smithi203 ceph-mon[33225]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:48.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:48 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/2801495006' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T00:02:48.704 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-11T00:02:48.705 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-11T00:02:48.705 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-11T00:02:48.706 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-11T00:02:48.706 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-11T00:02:48.707 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-11T00:02:49.163 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:02:49.169 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:02:49.193 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:02:49.219 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:02:49.225 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:02:49.247 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:02:50.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:50 smithi111 ceph-mon[27539]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:50.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:50 smithi203 ceph-mon[33225]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:52.110 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:52 smithi111 ceph-mon[27539]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:52.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:52 smithi203 ceph-mon[33225]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:53.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.966+0000 7f9b82200700 1 -- 172.21.15.111:0/1213795145 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b7c0730f0 msgr2=0x7f9b7c0734c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:53.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.967+0000 7f9b82200700 1 --2- 172.21.15.111:0/1213795145 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b7c0730f0 0x7f9b7c0734c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c009910 tx=0x7f9b6c009c20 comp rx=0 tx=0).stop 2024-09-11T00:02:53.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.967+0000 7f9b82200700 1 -- 172.21.15.111:0/1213795145 shutdown_connections 2024-09-11T00:02:53.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.967+0000 7f9b82200700 1 --2- 172.21.15.111:0/1213795145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9b7c073a00 0x7f9b7c110c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:53.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.967+0000 7f9b82200700 1 --2- 172.21.15.111:0/1213795145 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b7c0730f0 0x7f9b7c0734c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:53.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.967+0000 7f9b82200700 1 -- 172.21.15.111:0/1213795145 >> 172.21.15.111:0/1213795145 conn(0x7f9b7c0fbc30 msgr2=0x7f9b7c0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:53.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.967+0000 7f9b82200700 1 -- 172.21.15.111:0/1213795145 shutdown_connections 2024-09-11T00:02:53.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.967+0000 7f9b82200700 1 -- 172.21.15.111:0/1213795145 wait complete. 2024-09-11T00:02:53.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.968+0000 7f9b82200700 1 Processor -- start 2024-09-11T00:02:53.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.968+0000 7f9b82200700 1 -- start start 2024-09-11T00:02:53.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.968+0000 7f9b82200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b7c0730f0 0x7f9b7c19c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:53.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.968+0000 7f9b82200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9b7c073a00 0x7f9b7c19c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:53.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.968+0000 7f9b82200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7c19cea0 con 0x7f9b7c0730f0 2024-09-11T00:02:53.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.968+0000 7f9b82200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7c1a0c30 con 0x7f9b7c073a00 2024-09-11T00:02:53.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.969+0000 7f9b7b400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b7c0730f0 0x7f9b7c19c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:53.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.969+0000 7f9b7b400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b7c0730f0 0x7f9b7c19c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:33140/0 (socket says 172.21.15.111:33140) 2024-09-11T00:02:53.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.969+0000 7f9b7b400700 1 -- 172.21.15.111:0/129791456 learned_addr learned my addr 172.21.15.111:0/129791456 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:02:53.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.969+0000 7f9b7aa00700 1 --2- 172.21.15.111:0/129791456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9b7c073a00 0x7f9b7c19c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:53.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.969+0000 7f9b7b400700 1 -- 172.21.15.111:0/129791456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9b7c073a00 msgr2=0x7f9b7c19c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:53.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.969+0000 7f9b7b400700 1 --2- 172.21.15.111:0/129791456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9b7c073a00 0x7f9b7c19c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:53.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.969+0000 7f9b7b400700 1 -- 172.21.15.111:0/129791456 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b6c0095f0 con 0x7f9b7c0730f0 2024-09-11T00:02:53.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.969+0000 7f9b7b400700 1 --2- 172.21.15.111:0/129791456 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b7c0730f0 0x7f9b7c19c280 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c00b5c0 tx=0x7f9b6c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:53.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.970+0000 7f9b73e00700 1 -- 172.21.15.111:0/129791456 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b6c01d070 con 0x7f9b7c0730f0 2024-09-11T00:02:53.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.970+0000 7f9b73e00700 1 -- 172.21.15.111:0/129791456 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9b6c005e00 con 0x7f9b7c0730f0 2024-09-11T00:02:53.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.970+0000 7f9b82200700 1 -- 172.21.15.111:0/129791456 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b7c1a0f10 con 0x7f9b7c0730f0 2024-09-11T00:02:53.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.970+0000 7f9b73e00700 1 -- 172.21.15.111:0/129791456 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b6c017400 con 0x7f9b7c0730f0 2024-09-11T00:02:53.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.970+0000 7f9b82200700 1 -- 172.21.15.111:0/129791456 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b7c1a1460 con 0x7f9b7c0730f0 2024-09-11T00:02:53.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.971+0000 7f9b82200700 1 -- 172.21.15.111:0/129791456 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9b7c113b40 con 0x7f9b7c0730f0 2024-09-11T00:02:53.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.972+0000 7f9b73e00700 1 -- 172.21.15.111:0/129791456 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f9b6c00f460 con 0x7f9b7c0730f0 2024-09-11T00:02:53.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.972+0000 7f9b73e00700 1 --2- 172.21.15.111:0/129791456 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f9b6006c680 0x7f9b6006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:53.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.973+0000 7f9b73e00700 1 -- 172.21.15.111:0/129791456 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f9b6c08c920 con 0x7f9b7c0730f0 2024-09-11T00:02:53.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.973+0000 7f9b7aa00700 1 --2- 172.21.15.111:0/129791456 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f9b6006c680 0x7f9b6006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:53.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.973+0000 7f9b73e00700 1 --2- 172.21.15.111:0/129791456 >> [v2:172.21.15.111:6810/1146454471,v1:172.21.15.111:6811/1146454471] conn(0x7f9b60072210 0x7f9b60074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:53.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.973+0000 7f9b73e00700 1 -- 172.21.15.111:0/129791456 --> [v2:172.21.15.111:6810/1146454471,v1:172.21.15.111:6811/1146454471] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9b60074cd0 con 0x7f9b60072210 2024-09-11T00:02:53.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.973+0000 7f9b73e00700 1 -- 172.21.15.111:0/129791456 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b6c0912a0 con 0x7f9b7c0730f0 2024-09-11T00:02:53.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.973+0000 7f9b7be00700 1 --2- 172.21.15.111:0/129791456 >> [v2:172.21.15.111:6810/1146454471,v1:172.21.15.111:6811/1146454471] conn(0x7f9b60072210 0x7f9b60074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:53.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.974+0000 7f9b7aa00700 1 --2- 172.21.15.111:0/129791456 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f9b6006c680 0x7f9b6006eb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c19d8a0 tx=0x7f9b680073d0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:53.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.974+0000 7f9b7be00700 1 --2- 172.21.15.111:0/129791456 >> [v2:172.21.15.111:6810/1146454471,v1:172.21.15.111:6811/1146454471] conn(0x7f9b60072210 0x7f9b60074620 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:53.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.975+0000 7f9b73e00700 1 -- 172.21.15.111:0/129791456 <== osd.1 v2:172.21.15.111:6810/1146454471 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9b60074cd0 con 0x7f9b60072210 2024-09-11T00:02:53.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.992+0000 7f9b82200700 1 -- 172.21.15.111:0/129791456 --> [v2:172.21.15.111:6810/1146454471,v1:172.21.15.111:6811/1146454471] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9b7c04ea50 con 0x7f9b60072210 2024-09-11T00:02:53.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.992+0000 7f9b73e00700 1 -- 172.21.15.111:0/129791456 <== osd.1 v2:172.21.15.111:6810/1146454471 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9b7c04ea50 con 0x7f9b60072210 2024-09-11T00:02:53.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.993+0000 7f9b82200700 1 -- 172.21.15.111:0/129791456 >> [v2:172.21.15.111:6810/1146454471,v1:172.21.15.111:6811/1146454471] conn(0x7f9b60072210 msgr2=0x7f9b60074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:53.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.993+0000 7f9b82200700 1 --2- 172.21.15.111:0/129791456 >> [v2:172.21.15.111:6810/1146454471,v1:172.21.15.111:6811/1146454471] conn(0x7f9b60072210 0x7f9b60074620 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:53.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.993+0000 7f9b82200700 1 -- 172.21.15.111:0/129791456 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f9b6006c680 msgr2=0x7f9b6006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:53.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.993+0000 7f9b82200700 1 --2- 172.21.15.111:0/129791456 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f9b6006c680 0x7f9b6006eb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c19d8a0 tx=0x7f9b680073d0 comp rx=0 tx=0).stop 2024-09-11T00:02:53.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.993+0000 7f9b82200700 1 -- 172.21.15.111:0/129791456 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b7c0730f0 msgr2=0x7f9b7c19c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:53.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.993+0000 7f9b82200700 1 --2- 172.21.15.111:0/129791456 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b7c0730f0 0x7f9b7c19c280 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c00b5c0 tx=0x7f9b6c00bd70 comp rx=0 tx=0).stop 2024-09-11T00:02:53.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.993+0000 7f9b82200700 1 -- 172.21.15.111:0/129791456 shutdown_connections 2024-09-11T00:02:53.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.993+0000 7f9b82200700 1 --2- 172.21.15.111:0/129791456 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f9b6006c680 0x7f9b6006eb30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:53.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.993+0000 7f9b82200700 1 --2- 172.21.15.111:0/129791456 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b7c0730f0 0x7f9b7c19c280 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:53.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.993+0000 7f9b82200700 1 --2- 172.21.15.111:0/129791456 >> [v2:172.21.15.111:6810/1146454471,v1:172.21.15.111:6811/1146454471] conn(0x7f9b60072210 0x7f9b60074620 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:53.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.993+0000 7f9b82200700 1 --2- 172.21.15.111:0/129791456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9b7c073a00 0x7f9b7c19c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:53.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.993+0000 7f9b82200700 1 -- 172.21.15.111:0/129791456 >> 172.21.15.111:0/129791456 conn(0x7f9b7c0fbc30 msgr2=0x7f9b7c102730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:53.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.993+0000 7f9b82200700 1 -- 172.21.15.111:0/129791456 shutdown_connections 2024-09-11T00:02:53.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:53.993+0000 7f9b82200700 1 -- 172.21.15.111:0/129791456 wait complete. 2024-09-11T00:02:54.350 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:54 smithi111 ceph-mon[27539]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:54.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:54 smithi203 ceph-mon[33225]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:56.345 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:56 smithi111 ceph-mon[27539]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:56.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:56 smithi203 ceph-mon[33225]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:56.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.645+0000 7f5fb5800700 1 -- 172.21.15.111:0/2269183724 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5fb01003b0 msgr2=0x7f5fb0100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:56.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.645+0000 7f5fb5800700 1 --2- 172.21.15.111:0/2269183724 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5fb01003b0 0x7f5fb0100780 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0009910 tx=0x7f5fa0009c20 comp rx=0 tx=0).stop 2024-09-11T00:02:56.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.645+0000 7f5fb5800700 1 -- 172.21.15.111:0/2269183724 shutdown_connections 2024-09-11T00:02:56.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.645+0000 7f5fb5800700 1 --2- 172.21.15.111:0/2269183724 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fb0100d50 0x7f5fb0104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:56.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.645+0000 7f5fb5800700 1 --2- 172.21.15.111:0/2269183724 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5fb01003b0 0x7f5fb0100780 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:56.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.645+0000 7f5fb5800700 1 -- 172.21.15.111:0/2269183724 >> 172.21.15.111:0/2269183724 conn(0x7f5fb00fbc30 msgr2=0x7f5fb00fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:56.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.645+0000 7f5fb5800700 1 -- 172.21.15.111:0/2269183724 shutdown_connections 2024-09-11T00:02:56.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.645+0000 7f5fb5800700 1 -- 172.21.15.111:0/2269183724 wait complete. 2024-09-11T00:02:56.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.646+0000 7f5fb5800700 1 Processor -- start 2024-09-11T00:02:56.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.646+0000 7f5fb5800700 1 -- start start 2024-09-11T00:02:56.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.647+0000 7f5fb5800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5fb01003b0 0x7f5fb0195d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:56.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.647+0000 7f5fb5800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fb0100d50 0x7f5fb0196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:56.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.647+0000 7f5fb5800700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb0196930 con 0x7f5fb01003b0 2024-09-11T00:02:56.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.647+0000 7f5fb5800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb019a6c0 con 0x7f5fb0100d50 2024-09-11T00:02:56.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.647+0000 7f5faea00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5fb01003b0 0x7f5fb0195d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:56.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.647+0000 7f5faea00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5fb01003b0 0x7f5fb0195d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:33186/0 (socket says 172.21.15.111:33186) 2024-09-11T00:02:56.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.647+0000 7f5faea00700 1 -- 172.21.15.111:0/3395358072 learned_addr learned my addr 172.21.15.111:0/3395358072 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:02:56.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.647+0000 7f5fae000700 1 --2- 172.21.15.111:0/3395358072 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fb0100d50 0x7f5fb0196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:56.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.647+0000 7f5faea00700 1 -- 172.21.15.111:0/3395358072 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fb0100d50 msgr2=0x7f5fb0196250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:56.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.647+0000 7f5faea00700 1 --2- 172.21.15.111:0/3395358072 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fb0100d50 0x7f5fb0196250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:56.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.647+0000 7f5faea00700 1 -- 172.21.15.111:0/3395358072 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa00095f0 con 0x7f5fb01003b0 2024-09-11T00:02:56.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.648+0000 7f5faea00700 1 --2- 172.21.15.111:0/3395358072 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5fb01003b0 0x7f5fb0195d10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000b5c0 tx=0x7f5fa000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:56.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.648+0000 7f5fa7400700 1 -- 172.21.15.111:0/3395358072 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fa001d070 con 0x7f5fb01003b0 2024-09-11T00:02:56.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.648+0000 7f5fa7400700 1 -- 172.21.15.111:0/3395358072 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5fa0005e00 con 0x7f5fb01003b0 2024-09-11T00:02:56.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.648+0000 7f5fb5800700 1 -- 172.21.15.111:0/3395358072 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb019a940 con 0x7f5fb01003b0 2024-09-11T00:02:56.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.648+0000 7f5fa7400700 1 -- 172.21.15.111:0/3395358072 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fa0017400 con 0x7f5fb01003b0 2024-09-11T00:02:56.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.648+0000 7f5fb5800700 1 -- 172.21.15.111:0/3395358072 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb019ae30 con 0x7f5fb01003b0 2024-09-11T00:02:56.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.649+0000 7f5fb5800700 1 -- 172.21.15.111:0/3395358072 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5fb010d590 con 0x7f5fb01003b0 2024-09-11T00:02:56.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.650+0000 7f5fa7400700 1 -- 172.21.15.111:0/3395358072 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f5fa000f460 con 0x7f5fb01003b0 2024-09-11T00:02:56.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.651+0000 7f5fa7400700 1 --2- 172.21.15.111:0/3395358072 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5f9406c680 0x7f5f9406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:56.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.651+0000 7f5fa7400700 1 -- 172.21.15.111:0/3395358072 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f5fa008c960 con 0x7f5fb01003b0 2024-09-11T00:02:56.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.651+0000 7f5fae000700 1 --2- 172.21.15.111:0/3395358072 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5f9406c680 0x7f5f9406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:56.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.651+0000 7f5fa7400700 1 --2- 172.21.15.111:0/3395358072 >> [v2:172.21.15.203:6800/684842797,v1:172.21.15.203:6801/684842797] conn(0x7f5f94072210 0x7f5f94074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:56.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.651+0000 7f5fa7400700 1 -- 172.21.15.111:0/3395358072 --> [v2:172.21.15.203:6800/684842797,v1:172.21.15.203:6801/684842797] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5f94074cd0 con 0x7f5f94072210 2024-09-11T00:02:56.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.651+0000 7f5fa7400700 1 -- 172.21.15.111:0/3395358072 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fa00912a0 con 0x7f5fb01003b0 2024-09-11T00:02:56.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.652+0000 7f5fae000700 1 --2- 172.21.15.111:0/3395358072 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5f9406c680 0x7f5f9406eb30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0197330 tx=0x7f5f9c00b410 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:56.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.652+0000 7f5faf400700 1 --2- 172.21.15.111:0/3395358072 >> [v2:172.21.15.203:6800/684842797,v1:172.21.15.203:6801/684842797] conn(0x7f5f94072210 0x7f5f94074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:56.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.652+0000 7f5faf400700 1 --2- 172.21.15.111:0/3395358072 >> [v2:172.21.15.203:6800/684842797,v1:172.21.15.203:6801/684842797] conn(0x7f5f94072210 0x7f5f94074620 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:56.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.653+0000 7f5fa7400700 1 -- 172.21.15.111:0/3395358072 <== osd.3 v2:172.21.15.203:6800/684842797 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5f94074cd0 con 0x7f5f94072210 2024-09-11T00:02:56.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.670+0000 7f5fb5800700 1 -- 172.21.15.111:0/3395358072 --> [v2:172.21.15.203:6800/684842797,v1:172.21.15.203:6801/684842797] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5fb004ea50 con 0x7f5f94072210 2024-09-11T00:02:56.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.671+0000 7f5fa7400700 1 -- 172.21.15.111:0/3395358072 <== osd.3 v2:172.21.15.203:6800/684842797 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f5fb004ea50 con 0x7f5f94072210 2024-09-11T00:02:56.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.671+0000 7f5fb5800700 1 -- 172.21.15.111:0/3395358072 >> [v2:172.21.15.203:6800/684842797,v1:172.21.15.203:6801/684842797] conn(0x7f5f94072210 msgr2=0x7f5f94074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:56.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.671+0000 7f5fb5800700 1 --2- 172.21.15.111:0/3395358072 >> [v2:172.21.15.203:6800/684842797,v1:172.21.15.203:6801/684842797] conn(0x7f5f94072210 0x7f5f94074620 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:56.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.671+0000 7f5fb5800700 1 -- 172.21.15.111:0/3395358072 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5f9406c680 msgr2=0x7f5f9406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:56.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.671+0000 7f5fb5800700 1 --2- 172.21.15.111:0/3395358072 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5f9406c680 0x7f5f9406eb30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0197330 tx=0x7f5f9c00b410 comp rx=0 tx=0).stop 2024-09-11T00:02:56.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.671+0000 7f5fb5800700 1 -- 172.21.15.111:0/3395358072 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5fb01003b0 msgr2=0x7f5fb0195d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:56.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.671+0000 7f5fb5800700 1 --2- 172.21.15.111:0/3395358072 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5fb01003b0 0x7f5fb0195d10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000b5c0 tx=0x7f5fa000bd70 comp rx=0 tx=0).stop 2024-09-11T00:02:56.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.671+0000 7f5fb5800700 1 -- 172.21.15.111:0/3395358072 shutdown_connections 2024-09-11T00:02:56.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.671+0000 7f5fb5800700 1 --2- 172.21.15.111:0/3395358072 >> [v2:172.21.15.203:6800/684842797,v1:172.21.15.203:6801/684842797] conn(0x7f5f94072210 0x7f5f94074620 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:56.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.671+0000 7f5fb5800700 1 --2- 172.21.15.111:0/3395358072 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5f9406c680 0x7f5f9406eb30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:56.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.671+0000 7f5fb5800700 1 --2- 172.21.15.111:0/3395358072 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5fb01003b0 0x7f5fb0195d10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:56.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.671+0000 7f5fb5800700 1 --2- 172.21.15.111:0/3395358072 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fb0100d50 0x7f5fb0196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:56.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.671+0000 7f5fb5800700 1 -- 172.21.15.111:0/3395358072 >> 172.21.15.111:0/3395358072 conn(0x7f5fb00fbc30 msgr2=0x7f5fb00fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:56.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.672+0000 7f5fb5800700 1 -- 172.21.15.111:0/3395358072 shutdown_connections 2024-09-11T00:02:56.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.672+0000 7f5fb5800700 1 -- 172.21.15.111:0/3395358072 wait complete. 2024-09-11T00:02:56.707 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.561+0000 7f975d600700 1 -- 172.21.15.111:0/1971045558 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9758100200 msgr2=0x7f97581005d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:56.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.561+0000 7f975d600700 1 --2- 172.21.15.111:0/1971045558 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9758100200 0x7f97581005d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9748009910 tx=0x7f9748009c20 comp rx=0 tx=0).stop 2024-09-11T00:02:56.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.562+0000 7f975d600700 1 -- 172.21.15.111:0/1971045558 shutdown_connections 2024-09-11T00:02:56.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.562+0000 7f975d600700 1 --2- 172.21.15.111:0/1971045558 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9758100ba0 0x7f9758104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:56.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.562+0000 7f975d600700 1 --2- 172.21.15.111:0/1971045558 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9758100200 0x7f97581005d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:56.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.562+0000 7f975d600700 1 -- 172.21.15.111:0/1971045558 >> 172.21.15.111:0/1971045558 conn(0x7f97580fba80 msgr2=0x7f97580fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:56.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.562+0000 7f975d600700 1 -- 172.21.15.111:0/1971045558 shutdown_connections 2024-09-11T00:02:56.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.562+0000 7f975d600700 1 -- 172.21.15.111:0/1971045558 wait complete. 2024-09-11T00:02:56.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.563+0000 7f975d600700 1 Processor -- start 2024-09-11T00:02:56.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.563+0000 7f975d600700 1 -- start start 2024-09-11T00:02:56.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.563+0000 7f975d600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9758100200 0x7f9758197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:56.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.563+0000 7f975d600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9758100ba0 0x7f9758198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:56.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.563+0000 7f975d600700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9758198a10 con 0x7f9758100ba0 2024-09-11T00:02:56.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.563+0000 7f975d600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975819c7a0 con 0x7f9758100200 2024-09-11T00:02:56.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.564+0000 7f9757400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9758100ba0 0x7f9758198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:56.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.564+0000 7f9757400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9758100ba0 0x7f9758198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:33160/0 (socket says 172.21.15.111:33160) 2024-09-11T00:02:56.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.564+0000 7f9757400700 1 -- 172.21.15.111:0/2049305907 learned_addr learned my addr 172.21.15.111:0/2049305907 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:02:56.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.564+0000 7f9757e00700 1 --2- 172.21.15.111:0/2049305907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9758100200 0x7f9758197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:56.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.564+0000 7f9757400700 1 -- 172.21.15.111:0/2049305907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9758100200 msgr2=0x7f9758197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:56.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.564+0000 7f9757400700 1 --2- 172.21.15.111:0/2049305907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9758100200 0x7f9758197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:56.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.564+0000 7f9757400700 1 -- 172.21.15.111:0/2049305907 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97480095f0 con 0x7f9758100ba0 2024-09-11T00:02:56.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.564+0000 7f9757e00700 1 --2- 172.21.15.111:0/2049305907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9758100200 0x7f9758197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:02:56.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.564+0000 7f9757400700 1 --2- 172.21.15.111:0/2049305907 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9758100ba0 0x7f9758198330 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f974400d900 tx=0x7f974400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:56.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.565+0000 7f9754c00700 1 -- 172.21.15.111:0/2049305907 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9744009900 con 0x7f9758100ba0 2024-09-11T00:02:56.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.565+0000 7f9754c00700 1 -- 172.21.15.111:0/2049305907 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9744010460 con 0x7f9758100ba0 2024-09-11T00:02:56.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.565+0000 7f9754c00700 1 -- 172.21.15.111:0/2049305907 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f974400f5f0 con 0x7f9758100ba0 2024-09-11T00:02:56.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.565+0000 7f975d600700 1 -- 172.21.15.111:0/2049305907 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975819ca80 con 0x7f9758100ba0 2024-09-11T00:02:56.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.565+0000 7f975d600700 1 -- 172.21.15.111:0/2049305907 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975819cfd0 con 0x7f9758100ba0 2024-09-11T00:02:56.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.566+0000 7f975d600700 1 -- 172.21.15.111:0/2049305907 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f975810d360 con 0x7f9758100ba0 2024-09-11T00:02:56.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.568+0000 7f9754c00700 1 -- 172.21.15.111:0/2049305907 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f97440105d0 con 0x7f9758100ba0 2024-09-11T00:02:56.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.569+0000 7f9754c00700 1 --2- 172.21.15.111:0/2049305907 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f973c06c680 0x7f973c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:56.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.569+0000 7f9754c00700 1 -- 172.21.15.111:0/2049305907 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f974408b290 con 0x7f9758100ba0 2024-09-11T00:02:56.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.569+0000 7f9757e00700 1 --2- 172.21.15.111:0/2049305907 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f973c06c680 0x7f973c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:56.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.569+0000 7f9754c00700 1 --2- 172.21.15.111:0/2049305907 >> [v2:172.21.15.203:6808/977568057,v1:172.21.15.203:6809/977568057] conn(0x7f973c072210 0x7f973c074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:56.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.569+0000 7f9754c00700 1 -- 172.21.15.111:0/2049305907 --> [v2:172.21.15.203:6808/977568057,v1:172.21.15.203:6809/977568057] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f973c074cd0 con 0x7f973c072210 2024-09-11T00:02:56.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.570+0000 7f9754c00700 1 -- 172.21.15.111:0/2049305907 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f974408d900 con 0x7f9758100ba0 2024-09-11T00:02:56.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.570+0000 7f975cc00700 1 --2- 172.21.15.111:0/2049305907 >> [v2:172.21.15.203:6808/977568057,v1:172.21.15.203:6809/977568057] conn(0x7f973c072210 0x7f973c074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:56.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.570+0000 7f9757e00700 1 --2- 172.21.15.111:0/2049305907 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f973c06c680 0x7f973c06eb30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9748006010 tx=0x7f974801a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:56.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.571+0000 7f975cc00700 1 --2- 172.21.15.111:0/2049305907 >> [v2:172.21.15.203:6808/977568057,v1:172.21.15.203:6809/977568057] conn(0x7f973c072210 0x7f973c074620 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:56.711 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.572+0000 7f9754c00700 1 -- 172.21.15.111:0/2049305907 <== osd.4 v2:172.21.15.203:6808/977568057 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f973c074cd0 con 0x7f973c072210 2024-09-11T00:02:56.711 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.588+0000 7f975d600700 1 -- 172.21.15.111:0/2049305907 --> [v2:172.21.15.203:6808/977568057,v1:172.21.15.203:6809/977568057] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f975804f2a0 con 0x7f973c072210 2024-09-11T00:02:56.711 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.588+0000 7f9754c00700 1 -- 172.21.15.111:0/2049305907 <== osd.4 v2:172.21.15.203:6808/977568057 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f975804f2a0 con 0x7f973c072210 2024-09-11T00:02:56.711 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.589+0000 7f975d600700 1 -- 172.21.15.111:0/2049305907 >> [v2:172.21.15.203:6808/977568057,v1:172.21.15.203:6809/977568057] conn(0x7f973c072210 msgr2=0x7f973c074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:56.711 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.589+0000 7f975d600700 1 --2- 172.21.15.111:0/2049305907 >> [v2:172.21.15.203:6808/977568057,v1:172.21.15.203:6809/977568057] conn(0x7f973c072210 0x7f973c074620 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:56.711 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.589+0000 7f975d600700 1 -- 172.21.15.111:0/2049305907 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f973c06c680 msgr2=0x7f973c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:56.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.589+0000 7f975d600700 1 --2- 172.21.15.111:0/2049305907 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f973c06c680 0x7f973c06eb30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9748006010 tx=0x7f974801a040 comp rx=0 tx=0).stop 2024-09-11T00:02:56.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.589+0000 7f975d600700 1 -- 172.21.15.111:0/2049305907 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9758100ba0 msgr2=0x7f9758198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:56.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.589+0000 7f975d600700 1 --2- 172.21.15.111:0/2049305907 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9758100ba0 0x7f9758198330 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f974400d900 tx=0x7f974400dcc0 comp rx=0 tx=0).stop 2024-09-11T00:02:56.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.589+0000 7f975d600700 1 -- 172.21.15.111:0/2049305907 shutdown_connections 2024-09-11T00:02:56.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.589+0000 7f975d600700 1 --2- 172.21.15.111:0/2049305907 >> [v2:172.21.15.203:6808/977568057,v1:172.21.15.203:6809/977568057] conn(0x7f973c072210 0x7f973c074620 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:56.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.589+0000 7f975d600700 1 --2- 172.21.15.111:0/2049305907 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f973c06c680 0x7f973c06eb30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:56.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.589+0000 7f975d600700 1 --2- 172.21.15.111:0/2049305907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9758100200 0x7f9758197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:56.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.589+0000 7f975d600700 1 --2- 172.21.15.111:0/2049305907 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9758100ba0 0x7f9758198330 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:56.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.589+0000 7f975d600700 1 -- 172.21.15.111:0/2049305907 >> 172.21.15.111:0/2049305907 conn(0x7f97580fba80 msgr2=0x7f97580fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:56.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.589+0000 7f975d600700 1 -- 172.21.15.111:0/2049305907 shutdown_connections 2024-09-11T00:02:56.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:56.589+0000 7f975d600700 1 -- 172.21.15.111:0/2049305907 wait complete. 2024-09-11T00:02:57.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.944+0000 7ffaa6200700 1 -- 172.21.15.111:0/2823758193 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaa0102fa0 msgr2=0x7ffaa0106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:57.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.944+0000 7ffaa6200700 1 --2- 172.21.15.111:0/2823758193 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaa0102fa0 0x7ffaa0106f70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009910 tx=0x7ffa88009c20 comp rx=0 tx=0).stop 2024-09-11T00:02:57.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.945+0000 7ffaa6200700 1 -- 172.21.15.111:0/2823758193 shutdown_connections 2024-09-11T00:02:57.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.945+0000 7ffaa6200700 1 --2- 172.21.15.111:0/2823758193 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaa0102fa0 0x7ffaa0106f70 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:57.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.945+0000 7ffaa6200700 1 --2- 172.21.15.111:0/2823758193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffaa0102600 0x7ffaa01029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:57.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.945+0000 7ffaa6200700 1 -- 172.21.15.111:0/2823758193 >> 172.21.15.111:0/2823758193 conn(0x7ffaa00fdec0 msgr2=0x7ffaa01002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:57.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.945+0000 7ffaa6200700 1 -- 172.21.15.111:0/2823758193 shutdown_connections 2024-09-11T00:02:57.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.945+0000 7ffaa6200700 1 -- 172.21.15.111:0/2823758193 wait complete. 2024-09-11T00:02:57.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.946+0000 7ffaa6200700 1 Processor -- start 2024-09-11T00:02:57.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.946+0000 7ffaa6200700 1 -- start start 2024-09-11T00:02:57.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.946+0000 7ffaa6200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffaa0102600 0x7ffaa0197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:57.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.946+0000 7ffaa6200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaa0102fa0 0x7ffaa0198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:57.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.946+0000 7ffaa6200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa0198c10 con 0x7ffaa0102fa0 2024-09-11T00:02:57.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.946+0000 7ffaa6200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa019c9a0 con 0x7ffaa0102600 2024-09-11T00:02:57.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.946+0000 7ffa96a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaa0102fa0 0x7ffaa0198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:57.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.946+0000 7ffa96a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaa0102fa0 0x7ffaa0198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:57368/0 (socket says 172.21.15.111:57368) 2024-09-11T00:02:57.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.946+0000 7ffa96a00700 1 -- 172.21.15.111:0/1479611704 learned_addr learned my addr 172.21.15.111:0/1479611704 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:02:57.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.947+0000 7ffa9f400700 1 --2- 172.21.15.111:0/1479611704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffaa0102600 0x7ffaa0197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:57.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.947+0000 7ffa96a00700 1 -- 172.21.15.111:0/1479611704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffaa0102600 msgr2=0x7ffaa0197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:57.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.947+0000 7ffa96a00700 1 --2- 172.21.15.111:0/1479611704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffaa0102600 0x7ffaa0197ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:57.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.947+0000 7ffa96a00700 1 -- 172.21.15.111:0/1479611704 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa880095f0 con 0x7ffaa0102fa0 2024-09-11T00:02:57.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.947+0000 7ffa96a00700 1 --2- 172.21.15.111:0/1479611704 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaa0102fa0 0x7ffaa0198530 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffa8800bda0 tx=0x7ffa8800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:57.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.947+0000 7ffa9cc00700 1 -- 172.21.15.111:0/1479611704 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa8801d070 con 0x7ffaa0102fa0 2024-09-11T00:02:57.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.947+0000 7ffa9cc00700 1 -- 172.21.15.111:0/1479611704 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffa88004fa0 con 0x7ffaa0102fa0 2024-09-11T00:02:57.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.947+0000 7ffaa6200700 1 -- 172.21.15.111:0/1479611704 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa019cc20 con 0x7ffaa0102fa0 2024-09-11T00:02:57.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.947+0000 7ffa9cc00700 1 -- 172.21.15.111:0/1479611704 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa8800f460 con 0x7ffaa0102fa0 2024-09-11T00:02:57.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.948+0000 7ffaa6200700 1 -- 172.21.15.111:0/1479611704 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa019d110 con 0x7ffaa0102fa0 2024-09-11T00:02:57.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.948+0000 7ffaa6200700 1 -- 172.21.15.111:0/1479611704 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffaa010f770 con 0x7ffaa0102fa0 2024-09-11T00:02:57.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.949+0000 7ffa9cc00700 1 -- 172.21.15.111:0/1479611704 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7ffa88022850 con 0x7ffaa0102fa0 2024-09-11T00:02:57.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.950+0000 7ffa9cc00700 1 --2- 172.21.15.111:0/1479611704 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ffa8406c680 0x7ffa8406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:57.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.950+0000 7ffa9cc00700 1 -- 172.21.15.111:0/1479611704 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7ffa8808c9d0 con 0x7ffaa0102fa0 2024-09-11T00:02:57.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.950+0000 7ffa9f400700 1 --2- 172.21.15.111:0/1479611704 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ffa8406c680 0x7ffa8406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:57.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.951+0000 7ffa9cc00700 1 --2- 172.21.15.111:0/1479611704 >> [v2:172.21.15.203:6816/3580090636,v1:172.21.15.203:6817/3580090636] conn(0x7ffa84072210 0x7ffa84074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:57.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.951+0000 7ffa9cc00700 1 -- 172.21.15.111:0/1479611704 --> [v2:172.21.15.203:6816/3580090636,v1:172.21.15.203:6817/3580090636] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffa84074cd0 con 0x7ffa84072210 2024-09-11T00:02:57.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.951+0000 7ffa9cc00700 1 -- 172.21.15.111:0/1479611704 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa880912a0 con 0x7ffaa0102fa0 2024-09-11T00:02:57.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.951+0000 7ffa9f400700 1 --2- 172.21.15.111:0/1479611704 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ffa8406c680 0x7ffa8406eb30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ffa900060b0 tx=0x7ffa9000c040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:57.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.951+0000 7ffa9fe00700 1 --2- 172.21.15.111:0/1479611704 >> [v2:172.21.15.203:6816/3580090636,v1:172.21.15.203:6817/3580090636] conn(0x7ffa84072210 0x7ffa84074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:57.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.952+0000 7ffa9fe00700 1 --2- 172.21.15.111:0/1479611704 >> [v2:172.21.15.203:6816/3580090636,v1:172.21.15.203:6817/3580090636] conn(0x7ffa84072210 0x7ffa84074620 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:57.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.953+0000 7ffa9cc00700 1 -- 172.21.15.111:0/1479611704 <== osd.5 v2:172.21.15.203:6816/3580090636 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ffa84074cd0 con 0x7ffa84072210 2024-09-11T00:02:57.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.969+0000 7ffaa6200700 1 -- 172.21.15.111:0/1479611704 --> [v2:172.21.15.203:6816/3580090636,v1:172.21.15.203:6817/3580090636] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffaa004ea50 con 0x7ffa84072210 2024-09-11T00:02:57.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.969+0000 7ffa9cc00700 1 -- 172.21.15.111:0/1479611704 <== osd.5 v2:172.21.15.203:6816/3580090636 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ffaa004ea50 con 0x7ffa84072210 2024-09-11T00:02:57.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.970+0000 7ffaa6200700 1 -- 172.21.15.111:0/1479611704 >> [v2:172.21.15.203:6816/3580090636,v1:172.21.15.203:6817/3580090636] conn(0x7ffa84072210 msgr2=0x7ffa84074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:57.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.970+0000 7ffaa6200700 1 --2- 172.21.15.111:0/1479611704 >> [v2:172.21.15.203:6816/3580090636,v1:172.21.15.203:6817/3580090636] conn(0x7ffa84072210 0x7ffa84074620 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:57.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.970+0000 7ffaa6200700 1 -- 172.21.15.111:0/1479611704 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ffa8406c680 msgr2=0x7ffa8406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:57.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.970+0000 7ffaa6200700 1 --2- 172.21.15.111:0/1479611704 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ffa8406c680 0x7ffa8406eb30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ffa900060b0 tx=0x7ffa9000c040 comp rx=0 tx=0).stop 2024-09-11T00:02:57.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.970+0000 7ffaa6200700 1 -- 172.21.15.111:0/1479611704 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaa0102fa0 msgr2=0x7ffaa0198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:57.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.970+0000 7ffaa6200700 1 --2- 172.21.15.111:0/1479611704 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaa0102fa0 0x7ffaa0198530 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffa8800bda0 tx=0x7ffa8800bdd0 comp rx=0 tx=0).stop 2024-09-11T00:02:57.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.970+0000 7ffaa6200700 1 -- 172.21.15.111:0/1479611704 shutdown_connections 2024-09-11T00:02:57.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.970+0000 7ffaa6200700 1 --2- 172.21.15.111:0/1479611704 >> [v2:172.21.15.203:6816/3580090636,v1:172.21.15.203:6817/3580090636] conn(0x7ffa84072210 0x7ffa84074620 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:57.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.970+0000 7ffaa6200700 1 --2- 172.21.15.111:0/1479611704 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ffa8406c680 0x7ffa8406eb30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:57.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.970+0000 7ffaa6200700 1 --2- 172.21.15.111:0/1479611704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffaa0102600 0x7ffaa0197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:57.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.970+0000 7ffaa6200700 1 --2- 172.21.15.111:0/1479611704 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaa0102fa0 0x7ffaa0198530 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:57.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.970+0000 7ffaa6200700 1 -- 172.21.15.111:0/1479611704 >> 172.21.15.111:0/1479611704 conn(0x7ffaa00fdec0 msgr2=0x7ffaa00ff4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:57.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.970+0000 7ffaa6200700 1 -- 172.21.15.111:0/1479611704 shutdown_connections 2024-09-11T00:02:57.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:57.970+0000 7ffaa6200700 1 -- 172.21.15.111:0/1479611704 wait complete. 2024-09-11T00:02:58.347 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:02:58 smithi203 ceph-mon[33225]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:58.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:02:58 smithi111 ceph-mon[27539]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:02:58.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.555+0000 7f49ba400700 1 -- 172.21.15.111:0/2286793164 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f49b4102600 msgr2=0x7f49b41029d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:58.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.555+0000 7f49ba400700 1 --2- 172.21.15.111:0/2286793164 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f49b4102600 0x7f49b41029d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f49a4009910 tx=0x7f49a4009c20 comp rx=0 tx=0).stop 2024-09-11T00:02:58.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.555+0000 7f49ba400700 1 -- 172.21.15.111:0/2286793164 shutdown_connections 2024-09-11T00:02:58.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.555+0000 7f49ba400700 1 --2- 172.21.15.111:0/2286793164 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49b4102fa0 0x7f49b4106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:58.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.555+0000 7f49ba400700 1 --2- 172.21.15.111:0/2286793164 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f49b4102600 0x7f49b41029d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:58.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.555+0000 7f49ba400700 1 -- 172.21.15.111:0/2286793164 >> 172.21.15.111:0/2286793164 conn(0x7f49b40fdec0 msgr2=0x7f49b41002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:58.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.555+0000 7f49ba400700 1 -- 172.21.15.111:0/2286793164 shutdown_connections 2024-09-11T00:02:58.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.555+0000 7f49ba400700 1 -- 172.21.15.111:0/2286793164 wait complete. 2024-09-11T00:02:58.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.556+0000 7f49ba400700 1 Processor -- start 2024-09-11T00:02:58.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.556+0000 7f49ba400700 1 -- start start 2024-09-11T00:02:58.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.556+0000 7f49ba400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f49b4102600 0x7f49b4198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:58.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.556+0000 7f49ba400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49b4102fa0 0x7f49b4198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:58.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.556+0000 7f49ba400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b4198c50 con 0x7f49b4102600 2024-09-11T00:02:58.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.556+0000 7f49ba400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b419c9e0 con 0x7f49b4102fa0 2024-09-11T00:02:58.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.556+0000 7f49b3400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f49b4102600 0x7f49b4198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:58.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.557+0000 7f49b3400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f49b4102600 0x7f49b4198030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:57388/0 (socket says 172.21.15.111:57388) 2024-09-11T00:02:58.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.557+0000 7f49b3400700 1 -- 172.21.15.111:0/407251489 learned_addr learned my addr 172.21.15.111:0/407251489 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:02:58.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.557+0000 7f49b2a00700 1 --2- 172.21.15.111:0/407251489 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49b4102fa0 0x7f49b4198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:58.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.557+0000 7f49b3400700 1 -- 172.21.15.111:0/407251489 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49b4102fa0 msgr2=0x7f49b4198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:58.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.557+0000 7f49b3400700 1 --2- 172.21.15.111:0/407251489 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49b4102fa0 0x7f49b4198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:58.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.557+0000 7f49b3400700 1 -- 172.21.15.111:0/407251489 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a40095f0 con 0x7f49b4102600 2024-09-11T00:02:58.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.557+0000 7f49b3400700 1 --2- 172.21.15.111:0/407251489 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f49b4102600 0x7f49b4198030 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f49a400b5c0 tx=0x7f49a400bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:58.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.557+0000 7f49abe00700 1 -- 172.21.15.111:0/407251489 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49a401d070 con 0x7f49b4102600 2024-09-11T00:02:58.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.557+0000 7f49abe00700 1 -- 172.21.15.111:0/407251489 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f49a400f460 con 0x7f49b4102600 2024-09-11T00:02:58.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.557+0000 7f49ba400700 1 -- 172.21.15.111:0/407251489 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b419cc60 con 0x7f49b4102600 2024-09-11T00:02:58.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.558+0000 7f49abe00700 1 -- 172.21.15.111:0/407251489 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49a4017630 con 0x7f49b4102600 2024-09-11T00:02:58.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.558+0000 7f49ba400700 1 -- 172.21.15.111:0/407251489 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b419d150 con 0x7f49b4102600 2024-09-11T00:02:58.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.558+0000 7f49ba400700 1 -- 172.21.15.111:0/407251489 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f49b410f810 con 0x7f49b4102600 2024-09-11T00:02:58.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.559+0000 7f49abe00700 1 -- 172.21.15.111:0/407251489 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f49a4003b20 con 0x7f49b4102600 2024-09-11T00:02:58.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.560+0000 7f49abe00700 1 --2- 172.21.15.111:0/407251489 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f499806c680 0x7f499806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:58.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.560+0000 7f49abe00700 1 -- 172.21.15.111:0/407251489 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f49a408ce70 con 0x7f49b4102600 2024-09-11T00:02:58.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.561+0000 7f49b2a00700 1 --2- 172.21.15.111:0/407251489 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f499806c680 0x7f499806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:58.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.561+0000 7f49abe00700 1 --2- 172.21.15.111:0/407251489 >> [v2:172.21.15.111:6802/905671165,v1:172.21.15.111:6803/905671165] conn(0x7f4998072210 0x7f4998074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:02:58.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.561+0000 7f49abe00700 1 -- 172.21.15.111:0/407251489 --> [v2:172.21.15.111:6802/905671165,v1:172.21.15.111:6803/905671165] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4998074cd0 con 0x7f4998072210 2024-09-11T00:02:58.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.561+0000 7f49abe00700 1 -- 172.21.15.111:0/407251489 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49a408d2d0 con 0x7f49b4102600 2024-09-11T00:02:58.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.561+0000 7f49b3e00700 1 --2- 172.21.15.111:0/407251489 >> [v2:172.21.15.111:6802/905671165,v1:172.21.15.111:6803/905671165] conn(0x7f4998072210 0x7f4998074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:02:58.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.561+0000 7f49b2a00700 1 --2- 172.21.15.111:0/407251489 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f499806c680 0x7f499806eb30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f49b4199650 tx=0x7f49a0009190 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:58.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.561+0000 7f49b3e00700 1 --2- 172.21.15.111:0/407251489 >> [v2:172.21.15.111:6802/905671165,v1:172.21.15.111:6803/905671165] conn(0x7f4998072210 0x7f4998074620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:02:58.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.562+0000 7f49abe00700 1 -- 172.21.15.111:0/407251489 <== osd.0 v2:172.21.15.111:6802/905671165 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4998074cd0 con 0x7f4998072210 2024-09-11T00:02:58.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.580+0000 7f49ba400700 1 -- 172.21.15.111:0/407251489 --> [v2:172.21.15.111:6802/905671165,v1:172.21.15.111:6803/905671165] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f49b404ea50 con 0x7f4998072210 2024-09-11T00:02:58.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.580+0000 7f49abe00700 1 -- 172.21.15.111:0/407251489 <== osd.0 v2:172.21.15.111:6802/905671165 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f49b404ea50 con 0x7f4998072210 2024-09-11T00:02:58.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.580+0000 7f49ba400700 1 -- 172.21.15.111:0/407251489 >> [v2:172.21.15.111:6802/905671165,v1:172.21.15.111:6803/905671165] conn(0x7f4998072210 msgr2=0x7f4998074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:58.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.580+0000 7f49ba400700 1 --2- 172.21.15.111:0/407251489 >> [v2:172.21.15.111:6802/905671165,v1:172.21.15.111:6803/905671165] conn(0x7f4998072210 0x7f4998074620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:58.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.580+0000 7f49ba400700 1 -- 172.21.15.111:0/407251489 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f499806c680 msgr2=0x7f499806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:58.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.580+0000 7f49ba400700 1 --2- 172.21.15.111:0/407251489 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f499806c680 0x7f499806eb30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f49b4199650 tx=0x7f49a0009190 comp rx=0 tx=0).stop 2024-09-11T00:02:58.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.580+0000 7f49ba400700 1 -- 172.21.15.111:0/407251489 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f49b4102600 msgr2=0x7f49b4198030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:02:58.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.580+0000 7f49ba400700 1 --2- 172.21.15.111:0/407251489 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f49b4102600 0x7f49b4198030 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f49a400b5c0 tx=0x7f49a400bd50 comp rx=0 tx=0).stop 2024-09-11T00:02:58.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.580+0000 7f49ba400700 1 -- 172.21.15.111:0/407251489 shutdown_connections 2024-09-11T00:02:58.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.580+0000 7f49ba400700 1 --2- 172.21.15.111:0/407251489 >> [v2:172.21.15.111:6802/905671165,v1:172.21.15.111:6803/905671165] conn(0x7f4998072210 0x7f4998074620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:58.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.580+0000 7f49ba400700 1 --2- 172.21.15.111:0/407251489 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f499806c680 0x7f499806eb30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:58.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.580+0000 7f49ba400700 1 --2- 172.21.15.111:0/407251489 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f49b4102600 0x7f49b4198030 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:58.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.580+0000 7f49ba400700 1 --2- 172.21.15.111:0/407251489 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49b4102fa0 0x7f49b4198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:02:58.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.580+0000 7f49ba400700 1 -- 172.21.15.111:0/407251489 >> 172.21.15.111:0/407251489 conn(0x7f49b40fdec0 msgr2=0x7f49b40ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:02:58.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.580+0000 7f49ba400700 1 -- 172.21.15.111:0/407251489 shutdown_connections 2024-09-11T00:02:58.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:02:58.580+0000 7f49ba400700 1 -- 172.21.15.111:0/407251489 wait complete. 2024-09-11T00:02:58.644 INFO:teuthology.orchestra.run.smithi111.stdout:60129542179 2024-09-11T00:02:58.645 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-11T00:02:59.352 INFO:teuthology.orchestra.run.smithi111.stdout:38654705706 2024-09-11T00:02:59.352 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-11T00:03:00.226 INFO:teuthology.orchestra.run.smithi111.stdout:171798691850 2024-09-11T00:03:00.226 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-11T00:03:00.351 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:00 smithi111 ceph-mon[27539]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:00.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:00 smithi203 ceph-mon[33225]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:00.903 INFO:teuthology.orchestra.run.smithi111.stdout:150323855377 2024-09-11T00:03:00.903 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-11T00:03:01.150 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:01 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:03:01.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.190+0000 7fb8f5800700 1 -- 172.21.15.111:0/2093025848 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8f0073a00 msgr2=0x7fb8f0110c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:01.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.190+0000 7fb8f5800700 1 --2- 172.21.15.111:0/2093025848 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8f0073a00 0x7fb8f0110c20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc009910 tx=0x7fb8dc009c20 comp rx=0 tx=0).stop 2024-09-11T00:03:01.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.190+0000 7fb8f5800700 1 -- 172.21.15.111:0/2093025848 shutdown_connections 2024-09-11T00:03:01.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.190+0000 7fb8f5800700 1 --2- 172.21.15.111:0/2093025848 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8f0073a00 0x7fb8f0110c20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.190+0000 7fb8f5800700 1 --2- 172.21.15.111:0/2093025848 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8f00730f0 0x7fb8f00734c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.190+0000 7fb8f5800700 1 -- 172.21.15.111:0/2093025848 >> 172.21.15.111:0/2093025848 conn(0x7fb8f00fbc30 msgr2=0x7fb8f00fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:01.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.191+0000 7fb8f5800700 1 -- 172.21.15.111:0/2093025848 shutdown_connections 2024-09-11T00:03:01.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.191+0000 7fb8f5800700 1 -- 172.21.15.111:0/2093025848 wait complete. 2024-09-11T00:03:01.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.192+0000 7fb8f5800700 1 Processor -- start 2024-09-11T00:03:01.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.192+0000 7fb8f5800700 1 -- start start 2024-09-11T00:03:01.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.192+0000 7fb8f5800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8f00730f0 0x7fb8f019c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:01.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.192+0000 7fb8f5800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8f0073a00 0x7fb8f019c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:01.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.192+0000 7fb8f5800700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f019cf70 con 0x7fb8f00730f0 2024-09-11T00:03:01.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.192+0000 7fb8f5800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f01a0d00 con 0x7fb8f0073a00 2024-09-11T00:03:01.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.193+0000 7fb8eea00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8f00730f0 0x7fb8f019c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:01.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.193+0000 7fb8eea00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8f00730f0 0x7fb8f019c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:57398/0 (socket says 172.21.15.111:57398) 2024-09-11T00:03:01.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.193+0000 7fb8eea00700 1 -- 172.21.15.111:0/3713776620 learned_addr learned my addr 172.21.15.111:0/3713776620 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:03:01.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.193+0000 7fb8ee000700 1 --2- 172.21.15.111:0/3713776620 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8f0073a00 0x7fb8f019c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:01.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.193+0000 7fb8eea00700 1 -- 172.21.15.111:0/3713776620 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8f0073a00 msgr2=0x7fb8f019c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:01.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.193+0000 7fb8eea00700 1 --2- 172.21.15.111:0/3713776620 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8f0073a00 0x7fb8f019c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.193+0000 7fb8eea00700 1 -- 172.21.15.111:0/3713776620 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8dc0095f0 con 0x7fb8f00730f0 2024-09-11T00:03:01.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.194+0000 7fb8eea00700 1 --2- 172.21.15.111:0/3713776620 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8f00730f0 0x7fb8f019c350 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb8e000b4b0 tx=0x7fb8e000b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:01.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.194+0000 7fb8e7400700 1 -- 172.21.15.111:0/3713776620 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8e0011800 con 0x7fb8f00730f0 2024-09-11T00:03:01.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.194+0000 7fb8f5800700 1 -- 172.21.15.111:0/3713776620 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f01a0fe0 con 0x7fb8f00730f0 2024-09-11T00:03:01.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.194+0000 7fb8e7400700 1 -- 172.21.15.111:0/3713776620 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb8e0011e10 con 0x7fb8f00730f0 2024-09-11T00:03:01.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.194+0000 7fb8e7400700 1 -- 172.21.15.111:0/3713776620 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8e000f2e0 con 0x7fb8f00730f0 2024-09-11T00:03:01.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.194+0000 7fb8f5800700 1 -- 172.21.15.111:0/3713776620 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f01a1530 con 0x7fb8f00730f0 2024-09-11T00:03:01.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.195+0000 7fb8f5800700 1 -- 172.21.15.111:0/3713776620 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb8f0113bc0 con 0x7fb8f00730f0 2024-09-11T00:03:01.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.196+0000 7fb8e7400700 1 -- 172.21.15.111:0/3713776620 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fb8e0010380 con 0x7fb8f00730f0 2024-09-11T00:03:01.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.197+0000 7fb8e7400700 1 --2- 172.21.15.111:0/3713776620 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb8d406c680 0x7fb8d406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:01.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.197+0000 7fb8e7400700 1 -- 172.21.15.111:0/3713776620 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fb8e008aff0 con 0x7fb8f00730f0 2024-09-11T00:03:01.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.197+0000 7fb8ee000700 1 --2- 172.21.15.111:0/3713776620 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb8d406c680 0x7fb8d406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:01.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.197+0000 7fb8e7400700 1 --2- 172.21.15.111:0/3713776620 >> [v2:172.21.15.111:6818/39993762,v1:172.21.15.111:6819/39993762] conn(0x7fb8d4072210 0x7fb8d4074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:01.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.197+0000 7fb8e7400700 1 -- 172.21.15.111:0/3713776620 --> [v2:172.21.15.111:6818/39993762,v1:172.21.15.111:6819/39993762] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb8d4074cd0 con 0x7fb8d4072210 2024-09-11T00:03:01.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.197+0000 7fb8e7400700 1 -- 172.21.15.111:0/3713776620 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8e008d5d0 con 0x7fb8f00730f0 2024-09-11T00:03:01.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.197+0000 7fb8ef400700 1 --2- 172.21.15.111:0/3713776620 >> [v2:172.21.15.111:6818/39993762,v1:172.21.15.111:6819/39993762] conn(0x7fb8d4072210 0x7fb8d4074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:01.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.198+0000 7fb8ee000700 1 --2- 172.21.15.111:0/3713776620 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb8d406c680 0x7fb8d406eb30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb8f019d970 tx=0x7fb8dc01a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:01.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.198+0000 7fb8ef400700 1 --2- 172.21.15.111:0/3713776620 >> [v2:172.21.15.111:6818/39993762,v1:172.21.15.111:6819/39993762] conn(0x7fb8d4072210 0x7fb8d4074620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:01.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.199+0000 7fb8e7400700 1 -- 172.21.15.111:0/3713776620 <== osd.2 v2:172.21.15.111:6818/39993762 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb8d4074cd0 con 0x7fb8d4072210 2024-09-11T00:03:01.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.222+0000 7fb8f5800700 1 -- 172.21.15.111:0/3713776620 --> [v2:172.21.15.111:6818/39993762,v1:172.21.15.111:6819/39993762] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb8f004ea50 con 0x7fb8d4072210 2024-09-11T00:03:01.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.223+0000 7fb8e7400700 1 -- 172.21.15.111:0/3713776620 <== osd.2 v2:172.21.15.111:6818/39993762 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb8f004ea50 con 0x7fb8d4072210 2024-09-11T00:03:01.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.223+0000 7fb8f5800700 1 -- 172.21.15.111:0/3713776620 >> [v2:172.21.15.111:6818/39993762,v1:172.21.15.111:6819/39993762] conn(0x7fb8d4072210 msgr2=0x7fb8d4074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:01.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.223+0000 7fb8f5800700 1 --2- 172.21.15.111:0/3713776620 >> [v2:172.21.15.111:6818/39993762,v1:172.21.15.111:6819/39993762] conn(0x7fb8d4072210 0x7fb8d4074620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.223+0000 7fb8f5800700 1 -- 172.21.15.111:0/3713776620 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb8d406c680 msgr2=0x7fb8d406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:01.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.223+0000 7fb8f5800700 1 --2- 172.21.15.111:0/3713776620 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb8d406c680 0x7fb8d406eb30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb8f019d970 tx=0x7fb8dc01a040 comp rx=0 tx=0).stop 2024-09-11T00:03:01.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.223+0000 7fb8f5800700 1 -- 172.21.15.111:0/3713776620 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8f00730f0 msgr2=0x7fb8f019c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:01.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.223+0000 7fb8f5800700 1 --2- 172.21.15.111:0/3713776620 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8f00730f0 0x7fb8f019c350 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb8e000b4b0 tx=0x7fb8e000b7c0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.223+0000 7fb8f5800700 1 -- 172.21.15.111:0/3713776620 shutdown_connections 2024-09-11T00:03:01.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.223+0000 7fb8f5800700 1 --2- 172.21.15.111:0/3713776620 >> [v2:172.21.15.111:6818/39993762,v1:172.21.15.111:6819/39993762] conn(0x7fb8d4072210 0x7fb8d4074620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.223+0000 7fb8f5800700 1 --2- 172.21.15.111:0/3713776620 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb8d406c680 0x7fb8d406eb30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.223+0000 7fb8f5800700 1 --2- 172.21.15.111:0/3713776620 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8f00730f0 0x7fb8f019c350 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.223+0000 7fb8f5800700 1 --2- 172.21.15.111:0/3713776620 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8f0073a00 0x7fb8f019c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:01.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.223+0000 7fb8f5800700 1 -- 172.21.15.111:0/3713776620 >> 172.21.15.111:0/3713776620 conn(0x7fb8f00fbc30 msgr2=0x7fb8f0102730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:01.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.223+0000 7fb8f5800700 1 -- 172.21.15.111:0/3713776620 shutdown_connections 2024-09-11T00:03:01.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:01.223+0000 7fb8f5800700 1 -- 172.21.15.111:0/3713776620 wait complete. 2024-09-11T00:03:01.508 INFO:teuthology.orchestra.run.smithi111.stdout:115964117014 2024-09-11T00:03:01.509 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-11T00:03:01.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:01 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:03:01.739 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:03:02.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:02 smithi111 ceph-mon[27539]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:02.213 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:03:02.215 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:03:02.216 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:03:02.241 INFO:teuthology.orchestra.run.smithi111.stdout:81604378653 2024-09-11T00:03:02.241 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-11T00:03:02.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:02 smithi203 ceph-mon[33225]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:03.063 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:03:04.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:04 smithi111 ceph-mon[27539]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:04.414 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:03:04.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:04 smithi203 ceph-mon[33225]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:06.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:06 smithi111 ceph-mon[27539]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:06.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:06 smithi203 ceph-mon[33225]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:07.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.513+0000 7fdfcbc00700 1 -- 172.21.15.111:0/125526231 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdfc4100d50 msgr2=0x7fdfc4104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:07.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.513+0000 7fdfcbc00700 1 --2- 172.21.15.111:0/125526231 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdfc4100d50 0x7fdfc4104d20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0009910 tx=0x7fdfb0009c20 comp rx=0 tx=0).stop 2024-09-11T00:03:07.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.513+0000 7fdfcbc00700 1 -- 172.21.15.111:0/125526231 shutdown_connections 2024-09-11T00:03:07.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.513+0000 7fdfcbc00700 1 --2- 172.21.15.111:0/125526231 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdfc4100d50 0x7fdfc4104d20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:07.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.513+0000 7fdfcbc00700 1 --2- 172.21.15.111:0/125526231 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdfc41003b0 0x7fdfc4100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:07.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.513+0000 7fdfcbc00700 1 -- 172.21.15.111:0/125526231 >> 172.21.15.111:0/125526231 conn(0x7fdfc40fbc30 msgr2=0x7fdfc40fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:07.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.513+0000 7fdfcbc00700 1 -- 172.21.15.111:0/125526231 shutdown_connections 2024-09-11T00:03:07.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.513+0000 7fdfcbc00700 1 -- 172.21.15.111:0/125526231 wait complete. 2024-09-11T00:03:07.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.514+0000 7fdfcbc00700 1 Processor -- start 2024-09-11T00:03:07.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.514+0000 7fdfcbc00700 1 -- start start 2024-09-11T00:03:07.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.515+0000 7fdfcbc00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdfc41003b0 0x7fdfc4073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:07.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.515+0000 7fdfcbc00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdfc4100d50 0x7fdfc4073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:07.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.515+0000 7fdfcbc00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc4073ad0 con 0x7fdfc4100d50 2024-09-11T00:03:07.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.515+0000 7fdfcbc00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc4073c10 con 0x7fdfc41003b0 2024-09-11T00:03:07.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.515+0000 7fdfc3e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdfc4100d50 0x7fdfc4073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:07.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.515+0000 7fdfc3e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdfc4100d50 0x7fdfc4073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:57418/0 (socket says 172.21.15.111:57418) 2024-09-11T00:03:07.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.515+0000 7fdfc3e00700 1 -- 172.21.15.111:0/3045637052 learned_addr learned my addr 172.21.15.111:0/3045637052 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:03:07.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.515+0000 7fdfc9200700 1 --2- 172.21.15.111:0/3045637052 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdfc41003b0 0x7fdfc4073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:07.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.516+0000 7fdfc3e00700 1 -- 172.21.15.111:0/3045637052 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdfc41003b0 msgr2=0x7fdfc4073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:07.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.516+0000 7fdfc3e00700 1 --2- 172.21.15.111:0/3045637052 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdfc41003b0 0x7fdfc4073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:07.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.516+0000 7fdfc3e00700 1 -- 172.21.15.111:0/3045637052 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb00095f0 con 0x7fdfc4100d50 2024-09-11T00:03:07.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.516+0000 7fdfc3e00700 1 --2- 172.21.15.111:0/3045637052 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdfc4100d50 0x7fdfc4073590 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000bda0 tx=0x7fdfb000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:07.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.516+0000 7fdfc1600700 1 -- 172.21.15.111:0/3045637052 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfb001d070 con 0x7fdfc4100d50 2024-09-11T00:03:07.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.516+0000 7fdfc1600700 1 -- 172.21.15.111:0/3045637052 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdfb000f460 con 0x7fdfc4100d50 2024-09-11T00:03:07.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.516+0000 7fdfcbc00700 1 -- 172.21.15.111:0/3045637052 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc4073e90 con 0x7fdfc4100d50 2024-09-11T00:03:07.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.516+0000 7fdfc1600700 1 -- 172.21.15.111:0/3045637052 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfb0017630 con 0x7fdfc4100d50 2024-09-11T00:03:07.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.516+0000 7fdfcbc00700 1 -- 172.21.15.111:0/3045637052 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc41a22c0 con 0x7fdfc4100d50 2024-09-11T00:03:07.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.517+0000 7fdfcbc00700 1 -- 172.21.15.111:0/3045637052 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc4108720 con 0x7fdfc4100d50 2024-09-11T00:03:07.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.518+0000 7fdfc1600700 1 -- 172.21.15.111:0/3045637052 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fdfb000fab0 con 0x7fdfc4100d50 2024-09-11T00:03:07.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.519+0000 7fdfc1600700 1 --2- 172.21.15.111:0/3045637052 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fdfac06c680 0x7fdfac06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:07.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.519+0000 7fdfc1600700 1 -- 172.21.15.111:0/3045637052 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fdfb008c8a0 con 0x7fdfc4100d50 2024-09-11T00:03:07.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.519+0000 7fdfc9200700 1 --2- 172.21.15.111:0/3045637052 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fdfac06c680 0x7fdfac06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:07.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.520+0000 7fdfc9200700 1 --2- 172.21.15.111:0/3045637052 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fdfac06c680 0x7fdfac06eb30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8005950 tx=0x7fdfb80058e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:07.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.524+0000 7fdfc1600700 1 -- 172.21.15.111:0/3045637052 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fdfb0057340 con 0x7fdfc4100d50 2024-09-11T00:03:07.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.731+0000 7fdfcbc00700 1 -- 172.21.15.111:0/3045637052 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdfc404ea50 con 0x7fdfc4100d50 2024-09-11T00:03:07.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.731+0000 7fdfc1600700 1 -- 172.21.15.111:0/3045637052 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdfb005a960 con 0x7fdfc4100d50 2024-09-11T00:03:07.732 INFO:teuthology.orchestra.run.smithi111.stdout:60129542181 2024-09-11T00:03:07.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.734+0000 7fdfcbc00700 1 -- 172.21.15.111:0/3045637052 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fdfac06c680 msgr2=0x7fdfac06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:07.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.734+0000 7fdfcbc00700 1 --2- 172.21.15.111:0/3045637052 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fdfac06c680 0x7fdfac06eb30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8005950 tx=0x7fdfb80058e0 comp rx=0 tx=0).stop 2024-09-11T00:03:07.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.734+0000 7fdfcbc00700 1 -- 172.21.15.111:0/3045637052 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdfc4100d50 msgr2=0x7fdfc4073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:07.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.734+0000 7fdfcbc00700 1 --2- 172.21.15.111:0/3045637052 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdfc4100d50 0x7fdfc4073590 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000bda0 tx=0x7fdfb000be80 comp rx=0 tx=0).stop 2024-09-11T00:03:07.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.734+0000 7fdfcbc00700 1 -- 172.21.15.111:0/3045637052 shutdown_connections 2024-09-11T00:03:07.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.734+0000 7fdfcbc00700 1 --2- 172.21.15.111:0/3045637052 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fdfac06c680 0x7fdfac06eb30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:07.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.734+0000 7fdfcbc00700 1 --2- 172.21.15.111:0/3045637052 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdfc41003b0 0x7fdfc4073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:07.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.734+0000 7fdfcbc00700 1 --2- 172.21.15.111:0/3045637052 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdfc4100d50 0x7fdfc4073590 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:07.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.734+0000 7fdfcbc00700 1 -- 172.21.15.111:0/3045637052 >> 172.21.15.111:0/3045637052 conn(0x7fdfc40fbc30 msgr2=0x7fdfc40fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:07.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.734+0000 7fdfcbc00700 1 -- 172.21.15.111:0/3045637052 shutdown_connections 2024-09-11T00:03:07.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:07.734+0000 7fdfcbc00700 1 -- 172.21.15.111:0/3045637052 wait complete. 2024-09-11T00:03:08.368 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:08 smithi203 ceph-mon[33225]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:08.368 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:08 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/3045637052' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-11T00:03:08.388 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:08 smithi111 ceph-mon[27539]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:08.388 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:08 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/3045637052' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-11T00:03:08.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.532+0000 7f26cd200700 1 -- 172.21.15.111:0/4237430331 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f26c8100d50 msgr2=0x7f26c8104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:08.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.532+0000 7f26cd200700 1 --2- 172.21.15.111:0/4237430331 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f26c8100d50 0x7f26c8104d20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f26b4009910 tx=0x7f26b4009c20 comp rx=0 tx=0).stop 2024-09-11T00:03:08.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.533+0000 7f26cd200700 1 -- 172.21.15.111:0/4237430331 shutdown_connections 2024-09-11T00:03:08.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.533+0000 7f26cd200700 1 --2- 172.21.15.111:0/4237430331 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f26c8100d50 0x7f26c8104d20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:08.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.533+0000 7f26cd200700 1 --2- 172.21.15.111:0/4237430331 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26c81003b0 0x7f26c8100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:08.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.533+0000 7f26cd200700 1 -- 172.21.15.111:0/4237430331 >> 172.21.15.111:0/4237430331 conn(0x7f26c80fbc30 msgr2=0x7f26c80fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:08.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.533+0000 7f26cd200700 1 -- 172.21.15.111:0/4237430331 shutdown_connections 2024-09-11T00:03:08.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.533+0000 7f26cd200700 1 -- 172.21.15.111:0/4237430331 wait complete. 2024-09-11T00:03:08.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.534+0000 7f26cd200700 1 Processor -- start 2024-09-11T00:03:08.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.534+0000 7f26cd200700 1 -- start start 2024-09-11T00:03:08.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.534+0000 7f26cd200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f26c81003b0 0x7f26c8195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:08.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.534+0000 7f26cd200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26c8100d50 0x7f26c8196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:08.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.534+0000 7f26cd200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c81969e0 con 0x7f26c81003b0 2024-09-11T00:03:08.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.534+0000 7f26cd200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c819a770 con 0x7f26c8100d50 2024-09-11T00:03:08.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.534+0000 7f26c5e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f26c81003b0 0x7f26c8195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:08.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.534+0000 7f26c5e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f26c81003b0 0x7f26c8195dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39638/0 (socket says 172.21.15.111:39638) 2024-09-11T00:03:08.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.534+0000 7f26c5e00700 1 -- 172.21.15.111:0/526185126 learned_addr learned my addr 172.21.15.111:0/526185126 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:03:08.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.535+0000 7f26c5400700 1 --2- 172.21.15.111:0/526185126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26c8100d50 0x7f26c8196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:08.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.535+0000 7f26c5e00700 1 -- 172.21.15.111:0/526185126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26c8100d50 msgr2=0x7f26c8196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:08.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.535+0000 7f26c5e00700 1 --2- 172.21.15.111:0/526185126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26c8100d50 0x7f26c8196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:08.537 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.535+0000 7f26c5e00700 1 -- 172.21.15.111:0/526185126 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b40095f0 con 0x7f26c81003b0 2024-09-11T00:03:08.537 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.535+0000 7f26c5e00700 1 --2- 172.21.15.111:0/526185126 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f26c81003b0 0x7f26c8195dc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f26b800d8d0 tx=0x7f26b800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:08.537 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.535+0000 7f26bea00700 1 -- 172.21.15.111:0/526185126 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26b8009940 con 0x7f26c81003b0 2024-09-11T00:03:08.537 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.535+0000 7f26bea00700 1 -- 172.21.15.111:0/526185126 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f26b8010460 con 0x7f26c81003b0 2024-09-11T00:03:08.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.535+0000 7f26cd200700 1 -- 172.21.15.111:0/526185126 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26c819aa50 con 0x7f26c81003b0 2024-09-11T00:03:08.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.535+0000 7f26bea00700 1 -- 172.21.15.111:0/526185126 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26b800f5f0 con 0x7f26c81003b0 2024-09-11T00:03:08.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.536+0000 7f26cd200700 1 -- 172.21.15.111:0/526185126 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c819afa0 con 0x7f26c81003b0 2024-09-11T00:03:08.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.537+0000 7f26cd200700 1 -- 172.21.15.111:0/526185126 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26c8108720 con 0x7f26c81003b0 2024-09-11T00:03:08.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.537+0000 7f26bea00700 1 -- 172.21.15.111:0/526185126 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f26b80105d0 con 0x7f26c81003b0 2024-09-11T00:03:08.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.538+0000 7f26bea00700 1 --2- 172.21.15.111:0/526185126 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f26ac06c680 0x7f26ac06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:08.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.538+0000 7f26bea00700 1 -- 172.21.15.111:0/526185126 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f26b808b540 con 0x7f26c81003b0 2024-09-11T00:03:08.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.539+0000 7f26c5400700 1 --2- 172.21.15.111:0/526185126 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f26ac06c680 0x7f26ac06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:08.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.539+0000 7f26c5400700 1 --2- 172.21.15.111:0/526185126 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f26ac06c680 0x7f26ac06eb30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f26c81973e0 tx=0x7f26b401a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:08.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.543+0000 7f26bea00700 1 -- 172.21.15.111:0/526185126 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f26b8055f60 con 0x7f26c81003b0 2024-09-11T00:03:08.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.747+0000 7f26cd200700 1 -- 172.21.15.111:0/526185126 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f26c804ea50 con 0x7f26c81003b0 2024-09-11T00:03:08.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.747+0000 7f26bea00700 1 -- 172.21.15.111:0/526185126 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f26b8059580 con 0x7f26c81003b0 2024-09-11T00:03:08.749 INFO:teuthology.orchestra.run.smithi111.stdout:150323855379 2024-09-11T00:03:08.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.750+0000 7f26cd200700 1 -- 172.21.15.111:0/526185126 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f26ac06c680 msgr2=0x7f26ac06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:08.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.750+0000 7f26cd200700 1 --2- 172.21.15.111:0/526185126 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f26ac06c680 0x7f26ac06eb30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f26c81973e0 tx=0x7f26b401a040 comp rx=0 tx=0).stop 2024-09-11T00:03:08.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.750+0000 7f26cd200700 1 -- 172.21.15.111:0/526185126 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f26c81003b0 msgr2=0x7f26c8195dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:08.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.750+0000 7f26cd200700 1 --2- 172.21.15.111:0/526185126 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f26c81003b0 0x7f26c8195dc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f26b800d8d0 tx=0x7f26b800dc90 comp rx=0 tx=0).stop 2024-09-11T00:03:08.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.750+0000 7f26cd200700 1 -- 172.21.15.111:0/526185126 shutdown_connections 2024-09-11T00:03:08.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.750+0000 7f26cd200700 1 --2- 172.21.15.111:0/526185126 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f26ac06c680 0x7f26ac06eb30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:08.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.750+0000 7f26cd200700 1 --2- 172.21.15.111:0/526185126 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f26c81003b0 0x7f26c8195dc0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:08.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.750+0000 7f26cd200700 1 --2- 172.21.15.111:0/526185126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26c8100d50 0x7f26c8196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:08.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.750+0000 7f26cd200700 1 -- 172.21.15.111:0/526185126 >> 172.21.15.111:0/526185126 conn(0x7f26c80fbc30 msgr2=0x7f26c80fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:08.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.750+0000 7f26cd200700 1 -- 172.21.15.111:0/526185126 shutdown_connections 2024-09-11T00:03:08.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:08.750+0000 7f26cd200700 1 -- 172.21.15.111:0/526185126 wait complete. 2024-09-11T00:03:09.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.568+0000 7f3452400700 1 -- 172.21.15.111:0/1238995289 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f344c073a00 msgr2=0x7f344c110c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:09.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.568+0000 7f3452400700 1 --2- 172.21.15.111:0/1238995289 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f344c073a00 0x7f344c110c20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f343400b0a0 tx=0x7f343400b3b0 comp rx=0 tx=0).stop 2024-09-11T00:03:09.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.568+0000 7f3452400700 1 -- 172.21.15.111:0/1238995289 shutdown_connections 2024-09-11T00:03:09.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.568+0000 7f3452400700 1 --2- 172.21.15.111:0/1238995289 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f344c073a00 0x7f344c110c20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:09.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.568+0000 7f3452400700 1 --2- 172.21.15.111:0/1238995289 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f344c0730f0 0x7f344c0734c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:09.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.568+0000 7f3452400700 1 -- 172.21.15.111:0/1238995289 >> 172.21.15.111:0/1238995289 conn(0x7f344c0fbc30 msgr2=0x7f344c0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:09.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.568+0000 7f3452400700 1 -- 172.21.15.111:0/1238995289 shutdown_connections 2024-09-11T00:03:09.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.568+0000 7f3452400700 1 -- 172.21.15.111:0/1238995289 wait complete. 2024-09-11T00:03:09.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.569+0000 7f3452400700 1 Processor -- start 2024-09-11T00:03:09.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.569+0000 7f3452400700 1 -- start start 2024-09-11T00:03:09.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.569+0000 7f3452400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f344c0730f0 0x7f344c19c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:09.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.569+0000 7f3452400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f344c073a00 0x7f344c19c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:09.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.569+0000 7f3452400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344c19cf20 con 0x7f344c073a00 2024-09-11T00:03:09.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.569+0000 7f3452400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344c1a0cb0 con 0x7f344c0730f0 2024-09-11T00:03:09.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.570+0000 7f3442a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f344c073a00 0x7f344c19c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:09.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.570+0000 7f3442a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f344c073a00 0x7f344c19c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39656/0 (socket says 172.21.15.111:39656) 2024-09-11T00:03:09.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.570+0000 7f3442a00700 1 -- 172.21.15.111:0/3790194172 learned_addr learned my addr 172.21.15.111:0/3790194172 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:03:09.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.570+0000 7f344b400700 1 --2- 172.21.15.111:0/3790194172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f344c0730f0 0x7f344c19c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:09.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.570+0000 7f3442a00700 1 -- 172.21.15.111:0/3790194172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f344c0730f0 msgr2=0x7f344c19c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:09.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.570+0000 7f3442a00700 1 --2- 172.21.15.111:0/3790194172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f344c0730f0 0x7f344c19c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:09.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.570+0000 7f3442a00700 1 -- 172.21.15.111:0/3790194172 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3434009d00 con 0x7f344c073a00 2024-09-11T00:03:09.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.570+0000 7f3442a00700 1 --2- 172.21.15.111:0/3790194172 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f344c073a00 0x7f344c19c840 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3434009fd0 tx=0x7f3434003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:09.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.570+0000 7f3448c00700 1 -- 172.21.15.111:0/3790194172 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f343400e040 con 0x7f344c073a00 2024-09-11T00:03:09.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.571+0000 7f3448c00700 1 -- 172.21.15.111:0/3790194172 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3434007d60 con 0x7f344c073a00 2024-09-11T00:03:09.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.571+0000 7f3448c00700 1 -- 172.21.15.111:0/3790194172 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f343401d6b0 con 0x7f344c073a00 2024-09-11T00:03:09.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.571+0000 7f3452400700 1 -- 172.21.15.111:0/3790194172 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f344c1a0f30 con 0x7f344c073a00 2024-09-11T00:03:09.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.571+0000 7f3452400700 1 -- 172.21.15.111:0/3790194172 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f344c1a13e0 con 0x7f344c073a00 2024-09-11T00:03:09.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.572+0000 7f3452400700 1 -- 172.21.15.111:0/3790194172 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f344c10e3a0 con 0x7f344c073a00 2024-09-11T00:03:09.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.573+0000 7f3448c00700 1 -- 172.21.15.111:0/3790194172 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f3434004040 con 0x7f344c073a00 2024-09-11T00:03:09.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.574+0000 7f3448c00700 1 --2- 172.21.15.111:0/3790194172 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f343006c680 0x7f343006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:09.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.574+0000 7f3448c00700 1 -- 172.21.15.111:0/3790194172 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f343408cca0 con 0x7f344c073a00 2024-09-11T00:03:09.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.574+0000 7f344b400700 1 --2- 172.21.15.111:0/3790194172 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f343006c680 0x7f343006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:09.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.575+0000 7f344b400700 1 --2- 172.21.15.111:0/3790194172 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f343006c680 0x7f343006eb30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f343c005950 tx=0x7f343c00b410 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:09.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.579+0000 7f3448c00700 1 -- 172.21.15.111:0/3790194172 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3434057740 con 0x7f344c073a00 2024-09-11T00:03:09.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.787+0000 7f3452400700 1 -- 172.21.15.111:0/3790194172 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f344c1a1760 con 0x7f344c073a00 2024-09-11T00:03:09.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.787+0000 7f3448c00700 1 -- 172.21.15.111:0/3790194172 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f343405ad60 con 0x7f344c073a00 2024-09-11T00:03:09.789 INFO:teuthology.orchestra.run.smithi111.stdout:115964117016 2024-09-11T00:03:09.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.789+0000 7f3452400700 1 -- 172.21.15.111:0/3790194172 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f343006c680 msgr2=0x7f343006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:09.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.789+0000 7f3452400700 1 --2- 172.21.15.111:0/3790194172 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f343006c680 0x7f343006eb30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f343c005950 tx=0x7f343c00b410 comp rx=0 tx=0).stop 2024-09-11T00:03:09.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.789+0000 7f3452400700 1 -- 172.21.15.111:0/3790194172 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f344c073a00 msgr2=0x7f344c19c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:09.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.789+0000 7f3452400700 1 --2- 172.21.15.111:0/3790194172 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f344c073a00 0x7f344c19c840 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3434009fd0 tx=0x7f3434003c30 comp rx=0 tx=0).stop 2024-09-11T00:03:09.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.790+0000 7f3452400700 1 -- 172.21.15.111:0/3790194172 shutdown_connections 2024-09-11T00:03:09.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.790+0000 7f3452400700 1 --2- 172.21.15.111:0/3790194172 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f343006c680 0x7f343006eb30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:09.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.790+0000 7f3452400700 1 --2- 172.21.15.111:0/3790194172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f344c0730f0 0x7f344c19c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:09.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.790+0000 7f3452400700 1 --2- 172.21.15.111:0/3790194172 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f344c073a00 0x7f344c19c840 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:09.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.790+0000 7f3452400700 1 -- 172.21.15.111:0/3790194172 >> 172.21.15.111:0/3790194172 conn(0x7f344c0fbc30 msgr2=0x7f344c102730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:09.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.790+0000 7f3452400700 1 -- 172.21.15.111:0/3790194172 shutdown_connections 2024-09-11T00:03:09.792 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:09 smithi111 ceph-mon[27539]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:09.792 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:09 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/526185126' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-11T00:03:09.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:09.790+0000 7f3452400700 1 -- 172.21.15.111:0/3790194172 wait complete. 2024-09-11T00:03:10.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:09 smithi203 ceph-mon[33225]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:10.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:09 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/526185126' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-11T00:03:10.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.539+0000 7f828a400700 1 -- 172.21.15.111:0/913403318 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8284073090 msgr2=0x7f8284073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:10.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.539+0000 7f828a400700 1 --2- 172.21.15.111:0/913403318 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8284073090 0x7f8284073460 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8278009940 tx=0x7f8278009c50 comp rx=0 tx=0).stop 2024-09-11T00:03:10.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.539+0000 7f828a400700 1 -- 172.21.15.111:0/913403318 shutdown_connections 2024-09-11T00:03:10.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.539+0000 7f828a400700 1 --2- 172.21.15.111:0/913403318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82840739a0 0x7f828410c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:10.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.539+0000 7f828a400700 1 --2- 172.21.15.111:0/913403318 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8284073090 0x7f8284073460 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:10.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.539+0000 7f828a400700 1 -- 172.21.15.111:0/913403318 >> 172.21.15.111:0/913403318 conn(0x7f82840fbb10 msgr2=0x7f82840fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:10.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.539+0000 7f828a400700 1 -- 172.21.15.111:0/913403318 shutdown_connections 2024-09-11T00:03:10.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.539+0000 7f828a400700 1 -- 172.21.15.111:0/913403318 wait complete. 2024-09-11T00:03:10.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.540+0000 7f828a400700 1 Processor -- start 2024-09-11T00:03:10.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.540+0000 7f828a400700 1 -- start start 2024-09-11T00:03:10.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.541+0000 7f828a400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8284073090 0x7f8284197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:10.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.541+0000 7f828a400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f82840739a0 0x7f82841982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:10.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.541+0000 7f828a400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82841989a0 con 0x7f82840739a0 2024-09-11T00:03:10.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.541+0000 7f828a400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828419c730 con 0x7f8284073090 2024-09-11T00:03:10.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.541+0000 7f8283e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f82840739a0 0x7f82841982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:10.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.541+0000 7f8283e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f82840739a0 0x7f82841982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39666/0 (socket says 172.21.15.111:39666) 2024-09-11T00:03:10.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.541+0000 7f8283e00700 1 -- 172.21.15.111:0/3531748258 learned_addr learned my addr 172.21.15.111:0/3531748258 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:03:10.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.541+0000 7f8289000700 1 --2- 172.21.15.111:0/3531748258 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8284073090 0x7f8284197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:10.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.541+0000 7f8283e00700 1 -- 172.21.15.111:0/3531748258 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8284073090 msgr2=0x7f8284197d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:10.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.541+0000 7f8283e00700 1 --2- 172.21.15.111:0/3531748258 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8284073090 0x7f8284197d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:10.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.541+0000 7f8283e00700 1 -- 172.21.15.111:0/3531748258 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82780095f0 con 0x7f82840739a0 2024-09-11T00:03:10.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.541+0000 7f8289000700 1 --2- 172.21.15.111:0/3531748258 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8284073090 0x7f8284197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:03:10.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.542+0000 7f8283e00700 1 --2- 172.21.15.111:0/3531748258 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f82840739a0 0x7f82841982c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f827000d8d0 tx=0x7f827000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:10.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.542+0000 7f8281600700 1 -- 172.21.15.111:0/3531748258 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8270009940 con 0x7f82840739a0 2024-09-11T00:03:10.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.542+0000 7f8281600700 1 -- 172.21.15.111:0/3531748258 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8270010460 con 0x7f82840739a0 2024-09-11T00:03:10.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.542+0000 7f828a400700 1 -- 172.21.15.111:0/3531748258 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f828419ca10 con 0x7f82840739a0 2024-09-11T00:03:10.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.542+0000 7f8281600700 1 -- 172.21.15.111:0/3531748258 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f827000f5f0 con 0x7f82840739a0 2024-09-11T00:03:10.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.542+0000 7f828a400700 1 -- 172.21.15.111:0/3531748258 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828419cf60 con 0x7f82840739a0 2024-09-11T00:03:10.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.543+0000 7f828a400700 1 -- 172.21.15.111:0/3531748258 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8284109a50 con 0x7f82840739a0 2024-09-11T00:03:10.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.544+0000 7f8281600700 1 -- 172.21.15.111:0/3531748258 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f82700105d0 con 0x7f82840739a0 2024-09-11T00:03:10.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.545+0000 7f8281600700 1 --2- 172.21.15.111:0/3531748258 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f826c06c680 0x7f826c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:10.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.545+0000 7f8281600700 1 -- 172.21.15.111:0/3531748258 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f827008b450 con 0x7f82840739a0 2024-09-11T00:03:10.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.545+0000 7f8289000700 1 --2- 172.21.15.111:0/3531748258 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f826c06c680 0x7f826c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:10.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.546+0000 7f8289000700 1 --2- 172.21.15.111:0/3531748258 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f826c06c680 0x7f826c06eb30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8278009910 tx=0x7f8278005fd0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:10.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.550+0000 7f8281600700 1 -- 172.21.15.111:0/3531748258 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8270055ef0 con 0x7f82840739a0 2024-09-11T00:03:10.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.770+0000 7f828a400700 1 -- 172.21.15.111:0/3531748258 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f828419d1d0 con 0x7f82840739a0 2024-09-11T00:03:10.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.771+0000 7f8281600700 1 -- 172.21.15.111:0/3531748258 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8270059510 con 0x7f82840739a0 2024-09-11T00:03:10.773 INFO:teuthology.orchestra.run.smithi111.stdout:171798691852 2024-09-11T00:03:10.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.773+0000 7f828a400700 1 -- 172.21.15.111:0/3531748258 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f826c06c680 msgr2=0x7f826c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:10.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.773+0000 7f828a400700 1 --2- 172.21.15.111:0/3531748258 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f826c06c680 0x7f826c06eb30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8278009910 tx=0x7f8278005fd0 comp rx=0 tx=0).stop 2024-09-11T00:03:10.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.773+0000 7f828a400700 1 -- 172.21.15.111:0/3531748258 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f82840739a0 msgr2=0x7f82841982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:10.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.773+0000 7f828a400700 1 --2- 172.21.15.111:0/3531748258 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f82840739a0 0x7f82841982c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f827000d8d0 tx=0x7f827000dc90 comp rx=0 tx=0).stop 2024-09-11T00:03:10.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.774+0000 7f828a400700 1 -- 172.21.15.111:0/3531748258 shutdown_connections 2024-09-11T00:03:10.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.774+0000 7f828a400700 1 --2- 172.21.15.111:0/3531748258 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f826c06c680 0x7f826c06eb30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:10.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.774+0000 7f828a400700 1 --2- 172.21.15.111:0/3531748258 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8284073090 0x7f8284197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:10.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.774+0000 7f828a400700 1 --2- 172.21.15.111:0/3531748258 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f82840739a0 0x7f82841982c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:10.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.774+0000 7f828a400700 1 -- 172.21.15.111:0/3531748258 >> 172.21.15.111:0/3531748258 conn(0x7f82840fbb10 msgr2=0x7f8284106b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:10.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.774+0000 7f828a400700 1 -- 172.21.15.111:0/3531748258 shutdown_connections 2024-09-11T00:03:10.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:10.774+0000 7f828a400700 1 -- 172.21.15.111:0/3531748258 wait complete. 2024-09-11T00:03:10.964 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:10 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/3790194172' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-11T00:03:10.994 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542179 got 60129542181 for osd.1 2024-09-11T00:03:10.994 DEBUG:teuthology.parallel:result is None 2024-09-11T00:03:11.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:10 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/3790194172' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-11T00:03:11.920 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:11 smithi111 ceph-mon[27539]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:11.920 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:11 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/3531748258' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-11T00:03:12.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:11 smithi203 ceph-mon[33225]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:12.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:11 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/3531748258' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-11T00:03:12.210 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855377 got 150323855379 for osd.4 2024-09-11T00:03:12.210 DEBUG:teuthology.parallel:result is None 2024-09-11T00:03:12.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.654+0000 7ff959000700 1 -- 172.21.15.111:0/1448038772 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff9540730f0 msgr2=0x7ff9540734c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:12.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.654+0000 7ff959000700 1 --2- 172.21.15.111:0/1448038772 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff9540730f0 0x7ff9540734c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff944009910 tx=0x7ff944009c20 comp rx=0 tx=0).stop 2024-09-11T00:03:12.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.654+0000 7ff959000700 1 -- 172.21.15.111:0/1448038772 shutdown_connections 2024-09-11T00:03:12.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.655+0000 7ff959000700 1 --2- 172.21.15.111:0/1448038772 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff954073a00 0x7ff95410c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.655+0000 7ff959000700 1 --2- 172.21.15.111:0/1448038772 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff9540730f0 0x7ff9540734c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.655+0000 7ff959000700 1 -- 172.21.15.111:0/1448038772 >> 172.21.15.111:0/1448038772 conn(0x7ff9540fbc30 msgr2=0x7ff9540fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:12.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.655+0000 7ff959000700 1 -- 172.21.15.111:0/1448038772 shutdown_connections 2024-09-11T00:03:12.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.655+0000 7ff959000700 1 -- 172.21.15.111:0/1448038772 wait complete. 2024-09-11T00:03:12.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.656+0000 7ff959000700 1 Processor -- start 2024-09-11T00:03:12.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.656+0000 7ff959000700 1 -- start start 2024-09-11T00:03:12.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.656+0000 7ff959000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9540730f0 0x7ff954197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:12.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.656+0000 7ff959000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff954073a00 0x7ff9541984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:12.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.656+0000 7ff959000700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95419c830 con 0x7ff954073a00 2024-09-11T00:03:12.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.656+0000 7ff959000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95419c9a0 con 0x7ff9540730f0 2024-09-11T00:03:12.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.656+0000 7ff951400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff954073a00 0x7ff9541984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:12.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.656+0000 7ff951e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9540730f0 0x7ff954197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:12.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.656+0000 7ff951400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff954073a00 0x7ff9541984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39674/0 (socket says 172.21.15.111:39674) 2024-09-11T00:03:12.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.656+0000 7ff951400700 1 -- 172.21.15.111:0/3342132493 learned_addr learned my addr 172.21.15.111:0/3342132493 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:03:12.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.657+0000 7ff951400700 1 -- 172.21.15.111:0/3342132493 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9540730f0 msgr2=0x7ff954197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:12.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.657+0000 7ff951400700 1 --2- 172.21.15.111:0/3342132493 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9540730f0 0x7ff954197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.657+0000 7ff951400700 1 -- 172.21.15.111:0/3342132493 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9440095f0 con 0x7ff954073a00 2024-09-11T00:03:12.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.657+0000 7ff951400700 1 --2- 172.21.15.111:0/3342132493 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff954073a00 0x7ff9541984f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff94000b4b0 tx=0x7ff94000b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:12.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.657+0000 7ff94aa00700 1 -- 172.21.15.111:0/3342132493 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff940011800 con 0x7ff954073a00 2024-09-11T00:03:12.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.657+0000 7ff94aa00700 1 -- 172.21.15.111:0/3342132493 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff940011e10 con 0x7ff954073a00 2024-09-11T00:03:12.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.657+0000 7ff959000700 1 -- 172.21.15.111:0/3342132493 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff95419cc80 con 0x7ff954073a00 2024-09-11T00:03:12.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.657+0000 7ff94aa00700 1 -- 172.21.15.111:0/3342132493 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff94000f2e0 con 0x7ff954073a00 2024-09-11T00:03:12.560 INFO:teuthology.orchestra.run.smithi111.stdout:38654705709 2024-09-11T00:03:12.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.657+0000 7ff959000700 1 -- 172.21.15.111:0/3342132493 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff95419d1d0 con 0x7ff954073a00 2024-09-11T00:03:12.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.658+0000 7ff959000700 1 -- 172.21.15.111:0/3342132493 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff954109b50 con 0x7ff954073a00 2024-09-11T00:03:12.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.660+0000 7ff94aa00700 1 -- 172.21.15.111:0/3342132493 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7ff940010380 con 0x7ff954073a00 2024-09-11T00:03:12.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.661+0000 7ff94aa00700 1 --2- 172.21.15.111:0/3342132493 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff93806c680 0x7ff93806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:12.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.661+0000 7ff94aa00700 1 -- 172.21.15.111:0/3342132493 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7ff94008aff0 con 0x7ff954073a00 2024-09-11T00:03:12.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.661+0000 7ff951e00700 1 --2- 172.21.15.111:0/3342132493 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff93806c680 0x7ff93806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:12.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.661+0000 7ff951e00700 1 --2- 172.21.15.111:0/3342132493 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff93806c680 0x7ff93806eb30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff944006010 tx=0x7ff94401a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:12.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.665+0000 7ff94aa00700 1 -- 172.21.15.111:0/3342132493 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff940055a90 con 0x7ff954073a00 2024-09-11T00:03:12.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.868+0000 7ff959000700 1 -- 172.21.15.111:0/3342132493 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff95404ea50 con 0x7ff954073a00 2024-09-11T00:03:12.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.869+0000 7ff94aa00700 1 -- 172.21.15.111:0/3342132493 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff9400590b0 con 0x7ff954073a00 2024-09-11T00:03:12.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.871+0000 7ff959000700 1 -- 172.21.15.111:0/3342132493 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff93806c680 msgr2=0x7ff93806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:12.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.871+0000 7ff959000700 1 --2- 172.21.15.111:0/3342132493 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff93806c680 0x7ff93806eb30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff944006010 tx=0x7ff94401a040 comp rx=0 tx=0).stop 2024-09-11T00:03:12.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.871+0000 7ff959000700 1 -- 172.21.15.111:0/3342132493 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff954073a00 msgr2=0x7ff9541984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:12.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.871+0000 7ff959000700 1 --2- 172.21.15.111:0/3342132493 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff954073a00 0x7ff9541984f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff94000b4b0 tx=0x7ff94000b7c0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.871+0000 7ff959000700 1 -- 172.21.15.111:0/3342132493 shutdown_connections 2024-09-11T00:03:12.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.871+0000 7ff959000700 1 --2- 172.21.15.111:0/3342132493 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff93806c680 0x7ff93806eb30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.871+0000 7ff959000700 1 --2- 172.21.15.111:0/3342132493 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9540730f0 0x7ff954197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.871+0000 7ff959000700 1 --2- 172.21.15.111:0/3342132493 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff954073a00 0x7ff9541984f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:12.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.871+0000 7ff959000700 1 -- 172.21.15.111:0/3342132493 >> 172.21.15.111:0/3342132493 conn(0x7ff9540fbc30 msgr2=0x7ff954106c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:12.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.871+0000 7ff959000700 1 -- 172.21.15.111:0/3342132493 shutdown_connections 2024-09-11T00:03:12.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:11.871+0000 7ff959000700 1 -- 172.21.15.111:0/3342132493 wait complete. 2024-09-11T00:03:12.887 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:12 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/3342132493' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-11T00:03:13.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:12 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/3342132493' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-11T00:03:13.316 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705706 got 38654705709 for osd.0 2024-09-11T00:03:13.317 DEBUG:teuthology.parallel:result is None 2024-09-11T00:03:13.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.542+0000 7f1ef9c00700 1 -- 172.21.15.111:0/1555605885 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ef41003b0 msgr2=0x7f1ef4100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:13.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.542+0000 7f1ef9c00700 1 --2- 172.21.15.111:0/1555605885 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ef41003b0 0x7f1ef4100780 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4009910 tx=0x7f1ee4009c20 comp rx=0 tx=0).stop 2024-09-11T00:03:13.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.542+0000 7f1ef9c00700 1 -- 172.21.15.111:0/1555605885 shutdown_connections 2024-09-11T00:03:13.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.542+0000 7f1ef9c00700 1 --2- 172.21.15.111:0/1555605885 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ef4100d50 0x7f1ef4104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:13.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.542+0000 7f1ef9c00700 1 --2- 172.21.15.111:0/1555605885 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ef41003b0 0x7f1ef4100780 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:13.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.542+0000 7f1ef9c00700 1 -- 172.21.15.111:0/1555605885 >> 172.21.15.111:0/1555605885 conn(0x7f1ef40fbc30 msgr2=0x7f1ef40fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:13.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.542+0000 7f1ef9c00700 1 -- 172.21.15.111:0/1555605885 shutdown_connections 2024-09-11T00:03:13.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.542+0000 7f1ef9c00700 1 -- 172.21.15.111:0/1555605885 wait complete. 2024-09-11T00:03:13.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.543+0000 7f1ef9c00700 1 Processor -- start 2024-09-11T00:03:13.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.543+0000 7f1ef9c00700 1 -- start start 2024-09-11T00:03:13.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.544+0000 7f1ef9c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ef41003b0 0x7f1ef4195d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:13.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.544+0000 7f1ef9c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ef4100d50 0x7f1ef4196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:13.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.544+0000 7f1ef9c00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef4196930 con 0x7f1ef4100d50 2024-09-11T00:03:13.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.544+0000 7f1ef9c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef419a6c0 con 0x7f1ef41003b0 2024-09-11T00:03:13.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.544+0000 7f1ef2000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ef4100d50 0x7f1ef4196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:13.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.544+0000 7f1ef2000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ef4100d50 0x7f1ef4196250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39700/0 (socket says 172.21.15.111:39700) 2024-09-11T00:03:13.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.544+0000 7f1ef2000700 1 -- 172.21.15.111:0/1405909349 learned_addr learned my addr 172.21.15.111:0/1405909349 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:03:13.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.544+0000 7f1ef2a00700 1 --2- 172.21.15.111:0/1405909349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ef41003b0 0x7f1ef4195d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:13.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.544+0000 7f1ef2000700 1 -- 172.21.15.111:0/1405909349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ef41003b0 msgr2=0x7f1ef4195d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:13.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.544+0000 7f1ef2000700 1 --2- 172.21.15.111:0/1405909349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ef41003b0 0x7f1ef4195d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:13.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.544+0000 7f1ef2000700 1 -- 172.21.15.111:0/1405909349 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee40095f0 con 0x7f1ef4100d50 2024-09-11T00:03:13.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.545+0000 7f1ef2000700 1 --2- 172.21.15.111:0/1405909349 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ef4100d50 0x7f1ef4196250 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1ee000d900 tx=0x7f1ee000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:13.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.545+0000 7f1eeb400700 1 -- 172.21.15.111:0/1405909349 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ee0009900 con 0x7f1ef4100d50 2024-09-11T00:03:13.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.545+0000 7f1eeb400700 1 -- 172.21.15.111:0/1405909349 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1ee0010460 con 0x7f1ef4100d50 2024-09-11T00:03:13.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.545+0000 7f1ef9c00700 1 -- 172.21.15.111:0/1405909349 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ef419a9a0 con 0x7f1ef4100d50 2024-09-11T00:03:13.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.545+0000 7f1eeb400700 1 -- 172.21.15.111:0/1405909349 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ee000f5f0 con 0x7f1ef4100d50 2024-09-11T00:03:13.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.545+0000 7f1ef9c00700 1 -- 172.21.15.111:0/1405909349 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef419aef0 con 0x7f1ef4100d50 2024-09-11T00:03:13.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.546+0000 7f1ef9c00700 1 -- 172.21.15.111:0/1405909349 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef41086c0 con 0x7f1ef4100d50 2024-09-11T00:03:13.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.547+0000 7f1eeb400700 1 -- 172.21.15.111:0/1405909349 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f1ee00105d0 con 0x7f1ef4100d50 2024-09-11T00:03:13.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.548+0000 7f1eeb400700 1 --2- 172.21.15.111:0/1405909349 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f1ed806c680 0x7f1ed806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:13.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.548+0000 7f1eeb400700 1 -- 172.21.15.111:0/1405909349 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f1ee008aff0 con 0x7f1ef4100d50 2024-09-11T00:03:13.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.549+0000 7f1ef2a00700 1 --2- 172.21.15.111:0/1405909349 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f1ed806c680 0x7f1ed806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:13.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.549+0000 7f1ef2a00700 1 --2- 172.21.15.111:0/1405909349 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f1ed806c680 0x7f1ed806eb30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4006010 tx=0x7f1ee401a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:13.554 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.553+0000 7f1eeb400700 1 -- 172.21.15.111:0/1405909349 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1ee0055ab0 con 0x7f1ef4100d50 2024-09-11T00:03:13.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.756+0000 7f1ef9c00700 1 -- 172.21.15.111:0/1405909349 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1ef404ea50 con 0x7f1ef4100d50 2024-09-11T00:03:13.758 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.756+0000 7f1eeb400700 1 -- 172.21.15.111:0/1405909349 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1ee00590d0 con 0x7f1ef4100d50 2024-09-11T00:03:13.758 INFO:teuthology.orchestra.run.smithi111.stdout:81604378656 2024-09-11T00:03:13.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.758+0000 7f1ef9c00700 1 -- 172.21.15.111:0/1405909349 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f1ed806c680 msgr2=0x7f1ed806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:13.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.759+0000 7f1ef9c00700 1 --2- 172.21.15.111:0/1405909349 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f1ed806c680 0x7f1ed806eb30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4006010 tx=0x7f1ee401a040 comp rx=0 tx=0).stop 2024-09-11T00:03:13.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.759+0000 7f1ef9c00700 1 -- 172.21.15.111:0/1405909349 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ef4100d50 msgr2=0x7f1ef4196250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:13.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.759+0000 7f1ef9c00700 1 --2- 172.21.15.111:0/1405909349 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ef4100d50 0x7f1ef4196250 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1ee000d900 tx=0x7f1ee000dc10 comp rx=0 tx=0).stop 2024-09-11T00:03:13.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.759+0000 7f1ef9c00700 1 -- 172.21.15.111:0/1405909349 shutdown_connections 2024-09-11T00:03:13.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.759+0000 7f1ef9c00700 1 --2- 172.21.15.111:0/1405909349 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f1ed806c680 0x7f1ed806eb30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:13.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.759+0000 7f1ef9c00700 1 --2- 172.21.15.111:0/1405909349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ef41003b0 0x7f1ef4195d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:13.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.759+0000 7f1ef9c00700 1 --2- 172.21.15.111:0/1405909349 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ef4100d50 0x7f1ef4196250 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:13.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.759+0000 7f1ef9c00700 1 -- 172.21.15.111:0/1405909349 >> 172.21.15.111:0/1405909349 conn(0x7f1ef40fbc30 msgr2=0x7f1ef40fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:13.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.759+0000 7f1ef9c00700 1 -- 172.21.15.111:0/1405909349 shutdown_connections 2024-09-11T00:03:13.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:13.759+0000 7f1ef9c00700 1 -- 172.21.15.111:0/1405909349 wait complete. 2024-09-11T00:03:13.888 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:13 smithi111 ceph-mon[27539]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:14.035 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691850 got 171798691852 for osd.5 2024-09-11T00:03:14.035 DEBUG:teuthology.parallel:result is None 2024-09-11T00:03:14.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:13 smithi203 ceph-mon[33225]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:14.627 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378653 got 81604378656 for osd.2 2024-09-11T00:03:14.628 DEBUG:teuthology.parallel:result is None 2024-09-11T00:03:14.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:14 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/1405909349' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-11T00:03:14.940 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117014 got 115964117016 for osd.3 2024-09-11T00:03:14.940 DEBUG:teuthology.parallel:result is None 2024-09-11T00:03:14.940 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-11T00:03:14.941 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T00:03:15.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:14 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/1405909349' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-11T00:03:15.259 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:03:16.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:15 smithi203 ceph-mon[33225]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:16.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:15 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:03:16.112 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:15 smithi111 ceph-mon[27539]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:16.113 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:15 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:03:17.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.185+0000 7fd24ca00700 1 -- 172.21.15.111:0/3940137382 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2481003d0 msgr2=0x7fd2481007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:17.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.185+0000 7fd24ca00700 1 --2- 172.21.15.111:0/3940137382 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2481003d0 0x7fd2481007a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd238009910 tx=0x7fd238009c20 comp rx=0 tx=0).stop 2024-09-11T00:03:17.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.185+0000 7fd24ca00700 1 -- 172.21.15.111:0/3940137382 shutdown_connections 2024-09-11T00:03:17.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.185+0000 7fd24ca00700 1 --2- 172.21.15.111:0/3940137382 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd248100d70 0x7fd248104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.185+0000 7fd24ca00700 1 --2- 172.21.15.111:0/3940137382 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2481003d0 0x7fd2481007a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.185+0000 7fd24ca00700 1 -- 172.21.15.111:0/3940137382 >> 172.21.15.111:0/3940137382 conn(0x7fd2480fbc90 msgr2=0x7fd2480fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:17.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.185+0000 7fd24ca00700 1 -- 172.21.15.111:0/3940137382 shutdown_connections 2024-09-11T00:03:17.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.185+0000 7fd24ca00700 1 -- 172.21.15.111:0/3940137382 wait complete. 2024-09-11T00:03:17.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.186+0000 7fd24ca00700 1 Processor -- start 2024-09-11T00:03:17.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.186+0000 7fd24ca00700 1 -- start start 2024-09-11T00:03:17.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.187+0000 7fd24ca00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2481003d0 0x7fd248197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:17.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.187+0000 7fd24ca00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd248100d70 0x7fd248198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:17.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.187+0000 7fd24ca00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd248198b70 con 0x7fd2481003d0 2024-09-11T00:03:17.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.187+0000 7fd24ca00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24819c900 con 0x7fd248100d70 2024-09-11T00:03:17.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.187+0000 7fd245e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2481003d0 0x7fd248197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:17.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.187+0000 7fd245e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2481003d0 0x7fd248197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39720/0 (socket says 172.21.15.111:39720) 2024-09-11T00:03:17.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.187+0000 7fd245e00700 1 -- 172.21.15.111:0/4142752716 learned_addr learned my addr 172.21.15.111:0/4142752716 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:03:17.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.187+0000 7fd245400700 1 --2- 172.21.15.111:0/4142752716 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd248100d70 0x7fd248198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:17.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.188+0000 7fd245e00700 1 -- 172.21.15.111:0/4142752716 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd248100d70 msgr2=0x7fd248198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:17.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.188+0000 7fd245e00700 1 --2- 172.21.15.111:0/4142752716 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd248100d70 0x7fd248198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.188+0000 7fd245e00700 1 -- 172.21.15.111:0/4142752716 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2380095f0 con 0x7fd2481003d0 2024-09-11T00:03:17.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.188+0000 7fd245e00700 1 --2- 172.21.15.111:0/4142752716 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2481003d0 0x7fd248197f50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd238006010 tx=0x7fd23800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:17.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.188+0000 7fd23ea00700 1 -- 172.21.15.111:0/4142752716 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd23801d070 con 0x7fd2481003d0 2024-09-11T00:03:17.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.188+0000 7fd23ea00700 1 -- 172.21.15.111:0/4142752716 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd23800f460 con 0x7fd2481003d0 2024-09-11T00:03:17.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.188+0000 7fd23ea00700 1 -- 172.21.15.111:0/4142752716 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd238017630 con 0x7fd2481003d0 2024-09-11T00:03:17.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.188+0000 7fd24ca00700 1 -- 172.21.15.111:0/4142752716 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd24819cb80 con 0x7fd2481003d0 2024-09-11T00:03:17.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.188+0000 7fd24ca00700 1 -- 172.21.15.111:0/4142752716 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24819d070 con 0x7fd2481003d0 2024-09-11T00:03:17.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.190+0000 7fd24ca00700 1 -- 172.21.15.111:0/4142752716 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2481044c0 con 0x7fd2481003d0 2024-09-11T00:03:17.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.190+0000 7fd23ea00700 1 -- 172.21.15.111:0/4142752716 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fd23800f5d0 con 0x7fd2481003d0 2024-09-11T00:03:17.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.191+0000 7fd23ea00700 1 --2- 172.21.15.111:0/4142752716 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd22c06c680 0x7fd22c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:17.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.191+0000 7fd23ea00700 1 -- 172.21.15.111:0/4142752716 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fd23808c7c0 con 0x7fd2481003d0 2024-09-11T00:03:17.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.191+0000 7fd245400700 1 --2- 172.21.15.111:0/4142752716 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd22c06c680 0x7fd22c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:17.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.192+0000 7fd245400700 1 --2- 172.21.15.111:0/4142752716 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd22c06c680 0x7fd22c06eb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd248199570 tx=0x7fd23400b410 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:17.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.196+0000 7fd23ea00700 1 -- 172.21.15.111:0/4142752716 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd238057300 con 0x7fd2481003d0 2024-09-11T00:03:17.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.388+0000 7fd24ca00700 1 -- 172.21.15.111:0/4142752716 --> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd24802ccf0 con 0x7fd22c06c680 2024-09-11T00:03:17.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.390+0000 7fd23ea00700 1 -- 172.21.15.111:0/4142752716 <== mgr.14211 v2:172.21.15.111:6800/2 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27998 (secure 0 0 0) 0x7fd24802ccf0 con 0x7fd22c06c680 2024-09-11T00:03:17.392 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:03:17.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.393+0000 7fd24ca00700 1 -- 172.21.15.111:0/4142752716 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd22c06c680 msgr2=0x7fd22c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:17.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.393+0000 7fd24ca00700 1 --2- 172.21.15.111:0/4142752716 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd22c06c680 0x7fd22c06eb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd248199570 tx=0x7fd23400b410 comp rx=0 tx=0).stop 2024-09-11T00:03:17.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.393+0000 7fd24ca00700 1 -- 172.21.15.111:0/4142752716 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2481003d0 msgr2=0x7fd248197f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:17.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.394+0000 7fd24ca00700 1 --2- 172.21.15.111:0/4142752716 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2481003d0 0x7fd248197f50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd238006010 tx=0x7fd23800bd70 comp rx=0 tx=0).stop 2024-09-11T00:03:17.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.394+0000 7fd24ca00700 1 -- 172.21.15.111:0/4142752716 shutdown_connections 2024-09-11T00:03:17.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.394+0000 7fd24ca00700 1 --2- 172.21.15.111:0/4142752716 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd22c06c680 0x7fd22c06eb30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.394+0000 7fd24ca00700 1 --2- 172.21.15.111:0/4142752716 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2481003d0 0x7fd248197f50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.394+0000 7fd24ca00700 1 --2- 172.21.15.111:0/4142752716 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd248100d70 0x7fd248198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:17.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.394+0000 7fd24ca00700 1 -- 172.21.15.111:0/4142752716 >> 172.21.15.111:0/4142752716 conn(0x7fd2480fbc90 msgr2=0x7fd2480fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:17.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.394+0000 7fd24ca00700 1 -- 172.21.15.111:0/4142752716 shutdown_connections 2024-09-11T00:03:17.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:17.394+0000 7fd24ca00700 1 -- 172.21.15.111:0/4142752716 wait complete. 2024-09-11T00:03:17.397 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-09-11T00:03:18.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:17 smithi203 ceph-mon[33225]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:18.103 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:17 smithi111 ceph-mon[27539]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:18.142 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-09-11T00:03:16.672231+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165588,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305324,"statfs":{"total":575970213888,"available":575800651776,"internally_reserved":0,"allocated":3969024,"data_stored":2588226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002100"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":186,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-11T00:02:21.787939+0000","last_change":"2024-09-11T00:01:50.149455+0000","last_active":"2024-09-11T00:02:21.787939+0000","last_peered":"2024-09-11T00:02:21.787939+0000","last_clean":"2024-09-11T00:02:21.787939+0000","last_became_active":"2024-09-11T00:01:50.149079+0000","last_became_peered":"2024-09-11T00:01:50.149079+0000","last_unstale":"2024-09-11T00:02:21.787939+0000","last_undegraded":"2024-09-11T00:02:21.787939+0000","last_fullsized":"2024-09-11T00:02:21.787939+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:53.667434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:53.667434+0000","last_clean_scrub_stamp":"2024-09-11T00:00:53.667434+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:49:02.705629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]}]},{"osd":4,"up_from":35,"seq":150323855381,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 11 00:02:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.54600000000000004}]},{"osd":1,"last update":"Wed Sep 11 00:02:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.497},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.59799999999999998}]},{"osd":2,"last update":"Wed Sep 11 00:02:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.629}]},{"osd":3,"last update":"Wed Sep 11 00:02:53 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":3,"up_from":27,"seq":115964117018,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 11 00:02:21 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.65100000000000002}]},{"osd":1,"last update":"Wed Sep 11 00:02:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.58599999999999997}]},{"osd":2,"last update":"Wed Sep 11 00:02:21 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.752},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.60999999999999999}]},{"osd":4,"last update":"Wed Sep 11 00:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.498},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]},{"osd":2,"up_from":19,"seq":81604378656,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 11 00:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.40899999999999997,"15min":0.41299999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.42899999999999999,"15min":0.433},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.36699999999999999}]},{"osd":1,"last update":"Wed Sep 11 00:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.45400000000000001,"15min":0.46000000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.63500000000000001,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.39500000000000002}]},{"osd":3,"last update":"Wed Sep 11 00:02:22 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.71599999999999997}]},{"osd":4,"last update":"Wed Sep 11 00:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.67700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 11 00:02:21 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.39000000000000001,"15min":0.38600000000000001},"min":{"1min":0.30399999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.55100000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.44,"15min":0.435},"min":{"1min":0.34100000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.63100000000000001,"5min":1.218,"15min":1.218},"last":0.30099999999999999}]},{"osd":2,"last update":"Wed Sep 11 00:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.503,"15min":0.51100000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71899999999999997,"5min":1.014,"15min":1.014},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52700000000000002,"15min":0.53400000000000003},"min":{"1min":0.374,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76900000000000002,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.316}]},{"osd":3,"last update":"Wed Sep 11 00:02:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.76200000000000001}]},{"osd":4,"last update":"Wed Sep 11 00:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.94299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 11 00:02:21 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.40300000000000002,"15min":0.39800000000000002},"min":{"1min":0.29199999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.57699999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.42299999999999999,"15min":0.41499999999999998},"min":{"1min":0.32600000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.65300000000000002,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.318}]},{"osd":2,"last update":"Wed Sep 11 00:02:56 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.48399999999999999,"15min":0.49299999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.58799999999999997,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.495,"15min":0.501},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.40000000000000002}]},{"osd":3,"last update":"Wed Sep 11 00:02:21 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.54500000000000004}]},{"osd":4,"last update":"Wed Sep 11 00:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:03:18.143 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T00:03:18.461 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:03:18.852 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:18 smithi111 ceph-mon[27539]: from='client.14498 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:03:19.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:18 smithi203 ceph-mon[33225]: from='client.14498 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:03:19.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:19 smithi111 ceph-mon[27539]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:20.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:19 smithi203 ceph-mon[33225]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:20.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.256+0000 7f4032600700 1 -- 172.21.15.111:0/718103174 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f402c102df0 msgr2=0x7f402c106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:20.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.256+0000 7f4032600700 1 --2- 172.21.15.111:0/718103174 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f402c102df0 0x7f402c106dc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4018009910 tx=0x7f4018009c20 comp rx=0 tx=0).stop 2024-09-11T00:03:20.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.256+0000 7f4032600700 1 -- 172.21.15.111:0/718103174 shutdown_connections 2024-09-11T00:03:20.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.256+0000 7f4032600700 1 --2- 172.21.15.111:0/718103174 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f402c102df0 0x7f402c106dc0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:20.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.256+0000 7f4032600700 1 --2- 172.21.15.111:0/718103174 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f402c102450 0x7f402c102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:20.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.256+0000 7f4032600700 1 -- 172.21.15.111:0/718103174 >> 172.21.15.111:0/718103174 conn(0x7f402c0fdd30 msgr2=0x7f402c100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:20.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.256+0000 7f4032600700 1 -- 172.21.15.111:0/718103174 shutdown_connections 2024-09-11T00:03:20.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.256+0000 7f4032600700 1 -- 172.21.15.111:0/718103174 wait complete. 2024-09-11T00:03:20.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.257+0000 7f4032600700 1 Processor -- start 2024-09-11T00:03:20.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.257+0000 7f4032600700 1 -- start start 2024-09-11T00:03:20.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.258+0000 7f4032600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f402c102450 0x7f402c197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:20.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.258+0000 7f4032600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f402c102df0 0x7f402c1982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:20.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.258+0000 7f4032600700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402c1989a0 con 0x7f402c102450 2024-09-11T00:03:20.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.258+0000 7f4032600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402c19c730 con 0x7f402c102df0 2024-09-11T00:03:20.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.258+0000 7f4031200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f402c102450 0x7f402c197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:20.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.258+0000 7f4031200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f402c102450 0x7f402c197d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48266/0 (socket says 172.21.15.111:48266) 2024-09-11T00:03:20.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.258+0000 7f4031200700 1 -- 172.21.15.111:0/3443474547 learned_addr learned my addr 172.21.15.111:0/3443474547 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:03:20.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.258+0000 7f402be00700 1 --2- 172.21.15.111:0/3443474547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f402c102df0 0x7f402c1982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:20.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.258+0000 7f4031200700 1 -- 172.21.15.111:0/3443474547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f402c102df0 msgr2=0x7f402c1982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:20.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.258+0000 7f4031200700 1 --2- 172.21.15.111:0/3443474547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f402c102df0 0x7f402c1982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:20.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.258+0000 7f4031200700 1 -- 172.21.15.111:0/3443474547 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40180095f0 con 0x7f402c102450 2024-09-11T00:03:20.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.258+0000 7f402be00700 1 --2- 172.21.15.111:0/3443474547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f402c102df0 0x7f402c1982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:03:20.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.259+0000 7f4031200700 1 --2- 172.21.15.111:0/3443474547 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f402c102450 0x7f402c197d80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f402000d900 tx=0x7f402000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:20.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.259+0000 7f4029600700 1 -- 172.21.15.111:0/3443474547 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40200041f0 con 0x7f402c102450 2024-09-11T00:03:20.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.259+0000 7f4029600700 1 -- 172.21.15.111:0/3443474547 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4020004ce0 con 0x7f402c102450 2024-09-11T00:03:20.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.259+0000 7f4032600700 1 -- 172.21.15.111:0/3443474547 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f402c19ca10 con 0x7f402c102450 2024-09-11T00:03:20.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.259+0000 7f4029600700 1 -- 172.21.15.111:0/3443474547 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f402000b750 con 0x7f402c102450 2024-09-11T00:03:20.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.259+0000 7f4032600700 1 -- 172.21.15.111:0/3443474547 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f402c19cf60 con 0x7f402c102450 2024-09-11T00:03:20.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.260+0000 7f4032600700 1 -- 172.21.15.111:0/3443474547 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f402c04f2a0 con 0x7f402c102450 2024-09-11T00:03:20.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.261+0000 7f4029600700 1 -- 172.21.15.111:0/3443474547 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f4020004350 con 0x7f402c102450 2024-09-11T00:03:20.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.262+0000 7f4029600700 1 --2- 172.21.15.111:0/3443474547 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f401406c680 0x7f401406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:20.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.262+0000 7f4029600700 1 -- 172.21.15.111:0/3443474547 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f402008b690 con 0x7f402c102450 2024-09-11T00:03:20.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.262+0000 7f402be00700 1 --2- 172.21.15.111:0/3443474547 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f401406c680 0x7f401406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:20.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.263+0000 7f402be00700 1 --2- 172.21.15.111:0/3443474547 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f401406c680 0x7f401406eb30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f402c1993a0 tx=0x7f401801a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:20.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.267+0000 7f4029600700 1 -- 172.21.15.111:0/3443474547 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f40200560b0 con 0x7f402c102450 2024-09-11T00:03:20.459 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.457+0000 7f4032600700 1 -- 172.21.15.111:0/3443474547 --> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f402c19d460 con 0x7f401406c680 2024-09-11T00:03:20.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.459+0000 7f4029600700 1 -- 172.21.15.111:0/3443474547 <== mgr.14211 v2:172.21.15.111:6800/2 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28012 (secure 0 0 0) 0x7f402c19d460 con 0x7f401406c680 2024-09-11T00:03:20.461 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:03:20.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.461+0000 7f4032600700 1 -- 172.21.15.111:0/3443474547 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f401406c680 msgr2=0x7f401406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:20.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.461+0000 7f4032600700 1 --2- 172.21.15.111:0/3443474547 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f401406c680 0x7f401406eb30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f402c1993a0 tx=0x7f401801a040 comp rx=0 tx=0).stop 2024-09-11T00:03:20.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.461+0000 7f4032600700 1 -- 172.21.15.111:0/3443474547 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f402c102450 msgr2=0x7f402c197d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:20.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.461+0000 7f4032600700 1 --2- 172.21.15.111:0/3443474547 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f402c102450 0x7f402c197d80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f402000d900 tx=0x7f402000dcc0 comp rx=0 tx=0).stop 2024-09-11T00:03:20.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.462+0000 7f4032600700 1 -- 172.21.15.111:0/3443474547 shutdown_connections 2024-09-11T00:03:20.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.462+0000 7f4032600700 1 --2- 172.21.15.111:0/3443474547 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f401406c680 0x7f401406eb30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:20.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.462+0000 7f4032600700 1 --2- 172.21.15.111:0/3443474547 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f402c102450 0x7f402c197d80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:20.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.462+0000 7f4032600700 1 --2- 172.21.15.111:0/3443474547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f402c102df0 0x7f402c1982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:20.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.462+0000 7f4032600700 1 -- 172.21.15.111:0/3443474547 >> 172.21.15.111:0/3443474547 conn(0x7f402c0fdd30 msgr2=0x7f402c0ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:20.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.462+0000 7f4032600700 1 -- 172.21.15.111:0/3443474547 shutdown_connections 2024-09-11T00:03:20.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:20.462+0000 7f4032600700 1 -- 172.21.15.111:0/3443474547 wait complete. 2024-09-11T00:03:20.464 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-09-11T00:03:21.135 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2024-09-11T00:03:18.672587+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165588,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305324,"statfs":{"total":575970213888,"available":575800651776,"internally_reserved":0,"allocated":3969024,"data_stored":2588226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002052"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":186,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-11T00:02:21.787939+0000","last_change":"2024-09-11T00:01:50.149455+0000","last_active":"2024-09-11T00:02:21.787939+0000","last_peered":"2024-09-11T00:02:21.787939+0000","last_clean":"2024-09-11T00:02:21.787939+0000","last_became_active":"2024-09-11T00:01:50.149079+0000","last_became_peered":"2024-09-11T00:01:50.149079+0000","last_unstale":"2024-09-11T00:02:21.787939+0000","last_undegraded":"2024-09-11T00:02:21.787939+0000","last_fullsized":"2024-09-11T00:02:21.787939+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:00:53.667434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:00:53.667434+0000","last_clean_scrub_stamp":"2024-09-11T00:00:53.667434+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:49:02.705629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":4,"up_from":35,"seq":150323855381,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 11 00:02:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.54600000000000004}]},{"osd":1,"last update":"Wed Sep 11 00:02:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.497},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.59799999999999998}]},{"osd":2,"last update":"Wed Sep 11 00:02:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.629}]},{"osd":3,"last update":"Wed Sep 11 00:02:53 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":3,"up_from":27,"seq":115964117018,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 11 00:02:21 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.65100000000000002}]},{"osd":1,"last update":"Wed Sep 11 00:02:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.58599999999999997}]},{"osd":2,"last update":"Wed Sep 11 00:02:21 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.752},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.60999999999999999}]},{"osd":4,"last update":"Wed Sep 11 00:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.498},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]},{"osd":2,"up_from":19,"seq":81604378657,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 11 00:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.40899999999999997,"15min":0.41299999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.42899999999999999,"15min":0.433},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.28599999999999998}]},{"osd":1,"last update":"Wed Sep 11 00:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.45400000000000001,"15min":0.46000000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.63500000000000001,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.35099999999999998}]},{"osd":3,"last update":"Wed Sep 11 00:02:22 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.92400000000000004}]},{"osd":4,"last update":"Wed Sep 11 00:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.89300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 11 00:02:21 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.39000000000000001,"15min":0.38600000000000001},"min":{"1min":0.30399999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.55100000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.44,"15min":0.435},"min":{"1min":0.34100000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.63100000000000001,"5min":1.218,"15min":1.218},"last":0.30099999999999999}]},{"osd":2,"last update":"Wed Sep 11 00:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.503,"15min":0.51100000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71899999999999997,"5min":1.014,"15min":1.014},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52700000000000002,"15min":0.53400000000000003},"min":{"1min":0.374,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76900000000000002,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.316}]},{"osd":3,"last update":"Wed Sep 11 00:02:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.76200000000000001}]},{"osd":4,"last update":"Wed Sep 11 00:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.94299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542184,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 11 00:02:21 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.40300000000000002,"15min":0.39800000000000002},"min":{"1min":0.29199999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.57699999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.42299999999999999,"15min":0.41499999999999998},"min":{"1min":0.32600000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.65300000000000002,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.38400000000000001}]},{"osd":2,"last update":"Wed Sep 11 00:02:56 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.48399999999999999,"15min":0.49299999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.58799999999999997,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.495,"15min":0.501},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.40699999999999997}]},{"osd":3,"last update":"Wed Sep 11 00:02:21 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.54800000000000004}]},{"osd":4,"last update":"Wed Sep 11 00:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.58799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:03:21.136 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-11T00:03:21.136 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T00:03:21.136 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-11T00:03:21.136 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-11T00:03:21.453 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:03:21.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:21 smithi111 ceph-mon[27539]: from='client.14502 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:03:21.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:21 smithi111 ceph-mon[27539]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:22.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:21 smithi203 ceph-mon[33225]: from='client.14502 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:03:22.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:21 smithi203 ceph-mon[33225]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:23.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.301+0000 7f8063400700 1 -- 172.21.15.111:0/3692602344 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f805c073a00 msgr2=0x7f805c10c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:23.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.301+0000 7f8063400700 1 --2- 172.21.15.111:0/3692602344 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f805c073a00 0x7f805c10c450 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8048009910 tx=0x7f8048009c20 comp rx=0 tx=0).stop 2024-09-11T00:03:23.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.301+0000 7f8063400700 1 -- 172.21.15.111:0/3692602344 shutdown_connections 2024-09-11T00:03:23.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.301+0000 7f8063400700 1 --2- 172.21.15.111:0/3692602344 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f805c073a00 0x7f805c10c450 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:23.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.301+0000 7f8063400700 1 --2- 172.21.15.111:0/3692602344 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f805c0730f0 0x7f805c0734c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:23.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.301+0000 7f8063400700 1 -- 172.21.15.111:0/3692602344 >> 172.21.15.111:0/3692602344 conn(0x7f805c0fbc30 msgr2=0x7f805c0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:23.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.301+0000 7f8063400700 1 -- 172.21.15.111:0/3692602344 shutdown_connections 2024-09-11T00:03:23.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.301+0000 7f8063400700 1 -- 172.21.15.111:0/3692602344 wait complete. 2024-09-11T00:03:23.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.302+0000 7f8063400700 1 Processor -- start 2024-09-11T00:03:23.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.302+0000 7f8063400700 1 -- start start 2024-09-11T00:03:23.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.303+0000 7f8063400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f805c0730f0 0x7f805c197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:23.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.303+0000 7f8063400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f805c073a00 0x7f805c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:23.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.303+0000 7f8063400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805c19c7c0 con 0x7f805c0730f0 2024-09-11T00:03:23.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.303+0000 7f8063400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805c19c930 con 0x7f805c073a00 2024-09-11T00:03:23.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.303+0000 7f8060a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f805c0730f0 0x7f805c197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:23.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.303+0000 7f8060a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f805c0730f0 0x7f805c197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48292/0 (socket says 172.21.15.111:48292) 2024-09-11T00:03:23.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.303+0000 7f8060a00700 1 -- 172.21.15.111:0/1833593775 learned_addr learned my addr 172.21.15.111:0/1833593775 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:03:23.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.303+0000 7f805be00700 1 --2- 172.21.15.111:0/1833593775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f805c073a00 0x7f805c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:23.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.303+0000 7f8060a00700 1 -- 172.21.15.111:0/1833593775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f805c073a00 msgr2=0x7f805c198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:23.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.303+0000 7f8060a00700 1 --2- 172.21.15.111:0/1833593775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f805c073a00 0x7f805c198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:23.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.303+0000 7f8060a00700 1 -- 172.21.15.111:0/1833593775 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80480095f0 con 0x7f805c0730f0 2024-09-11T00:03:23.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.304+0000 7f8060a00700 1 --2- 172.21.15.111:0/1833593775 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f805c0730f0 0x7f805c197e10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f805000d8d0 tx=0x7f805000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:23.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.304+0000 7f8059600700 1 -- 172.21.15.111:0/1833593775 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80500098a0 con 0x7f805c0730f0 2024-09-11T00:03:23.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.304+0000 7f8059600700 1 -- 172.21.15.111:0/1833593775 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8050010460 con 0x7f805c0730f0 2024-09-11T00:03:23.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.304+0000 7f8063400700 1 -- 172.21.15.111:0/1833593775 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f805c19cc10 con 0x7f805c0730f0 2024-09-11T00:03:23.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.304+0000 7f8063400700 1 -- 172.21.15.111:0/1833593775 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f805c19d160 con 0x7f805c0730f0 2024-09-11T00:03:23.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.304+0000 7f8059600700 1 -- 172.21.15.111:0/1833593775 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f805000f5f0 con 0x7f805c0730f0 2024-09-11T00:03:23.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.305+0000 7f8063400700 1 -- 172.21.15.111:0/1833593775 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f803c005320 con 0x7f805c0730f0 2024-09-11T00:03:23.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.306+0000 7f8059600700 1 -- 172.21.15.111:0/1833593775 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f8050009a00 con 0x7f805c0730f0 2024-09-11T00:03:23.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.307+0000 7f8059600700 1 --2- 172.21.15.111:0/1833593775 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f804406c680 0x7f804406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:23.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.307+0000 7f8059600700 1 -- 172.21.15.111:0/1833593775 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f805008b360 con 0x7f805c0730f0 2024-09-11T00:03:23.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.307+0000 7f805be00700 1 --2- 172.21.15.111:0/1833593775 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f804406c680 0x7f804406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:23.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.308+0000 7f805be00700 1 --2- 172.21.15.111:0/1833593775 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f804406c680 0x7f804406eb30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8048006010 tx=0x7f804801a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:23.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.312+0000 7f8059600700 1 -- 172.21.15.111:0/1833593775 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8050055e00 con 0x7f805c0730f0 2024-09-11T00:03:23.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.563+0000 7f8063400700 1 -- 172.21.15.111:0/1833593775 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f803c005f70 con 0x7f805c0730f0 2024-09-11T00:03:23.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.564+0000 7f8059600700 1 -- 172.21.15.111:0/1833593775 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8050059420 con 0x7f805c0730f0 2024-09-11T00:03:23.566 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:03:23.566 INFO:teuthology.orchestra.run.smithi111.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T00:03:23.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.566+0000 7f8063400700 1 -- 172.21.15.111:0/1833593775 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f804406c680 msgr2=0x7f804406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:23.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.566+0000 7f8063400700 1 --2- 172.21.15.111:0/1833593775 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f804406c680 0x7f804406eb30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8048006010 tx=0x7f804801a040 comp rx=0 tx=0).stop 2024-09-11T00:03:23.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.566+0000 7f8063400700 1 -- 172.21.15.111:0/1833593775 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f805c0730f0 msgr2=0x7f805c197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:23.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.566+0000 7f8063400700 1 --2- 172.21.15.111:0/1833593775 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f805c0730f0 0x7f805c197e10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f805000d8d0 tx=0x7f805000dbe0 comp rx=0 tx=0).stop 2024-09-11T00:03:23.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.566+0000 7f8063400700 1 -- 172.21.15.111:0/1833593775 shutdown_connections 2024-09-11T00:03:23.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.566+0000 7f8063400700 1 --2- 172.21.15.111:0/1833593775 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f804406c680 0x7f804406eb30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:23.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.566+0000 7f8063400700 1 --2- 172.21.15.111:0/1833593775 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f805c0730f0 0x7f805c197e10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:23.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.566+0000 7f8063400700 1 --2- 172.21.15.111:0/1833593775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f805c073a00 0x7f805c198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:23.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.566+0000 7f8063400700 1 -- 172.21.15.111:0/1833593775 >> 172.21.15.111:0/1833593775 conn(0x7f805c0fbc30 msgr2=0x7f805c106c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:23.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.567+0000 7f8063400700 1 -- 172.21.15.111:0/1833593775 shutdown_connections 2024-09-11T00:03:23.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:23.567+0000 7f8063400700 1 -- 172.21.15.111:0/1833593775 wait complete. 2024-09-11T00:03:23.794 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:23 smithi203 ceph-mon[33225]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:23.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:23 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/1833593775' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-11T00:03:23.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:23 smithi111 ceph-mon[27539]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:23.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:23 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/1833593775' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-11T00:03:24.367 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-11T00:03:24.367 INFO:tasks.cephadm:Setup complete, yielding 2024-09-11T00:03:24.367 INFO:teuthology.run_tasks:Running task print... 2024-09-11T00:03:24.375 INFO:teuthology.task.print:**** done end installing v18.2.0 cephadm ... 2024-09-11T00:03:24.375 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-11T00:03:24.413 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi111.front.sepia.ceph.com 2024-09-11T00:03:24.413 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-11T00:03:24.740 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:03:25.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:25 smithi111 ceph-mon[27539]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:25.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:25 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:03:26.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:25 smithi203 ceph-mon[33225]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:26.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:25 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:03:26.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.671+0000 7f0f97200700 1 -- 172.21.15.111:0/4240571798 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f98101190 msgr2=0x7f0f981015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:26.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.671+0000 7f0f97200700 1 --2- 172.21.15.111:0/4240571798 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f98101190 0x7f0f981015e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0f84009910 tx=0x7f0f84009c20 comp rx=0 tx=0).stop 2024-09-11T00:03:26.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.671+0000 7f0f97200700 1 -- 172.21.15.111:0/4240571798 shutdown_connections 2024-09-11T00:03:26.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.671+0000 7f0f97200700 1 --2- 172.21.15.111:0/4240571798 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f98101190 0x7f0f981015e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:26.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.671+0000 7f0f97200700 1 --2- 172.21.15.111:0/4240571798 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f980fff90 0x7f0f981003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:26.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.671+0000 7f0f97200700 1 -- 172.21.15.111:0/4240571798 >> 172.21.15.111:0/4240571798 conn(0x7f0f980fb500 msgr2=0x7f0f980fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:26.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.671+0000 7f0f97200700 1 -- 172.21.15.111:0/4240571798 shutdown_connections 2024-09-11T00:03:26.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.671+0000 7f0f97200700 1 -- 172.21.15.111:0/4240571798 wait complete. 2024-09-11T00:03:26.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.672+0000 7f0f97200700 1 Processor -- start 2024-09-11T00:03:26.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.672+0000 7f0f97200700 1 -- start start 2024-09-11T00:03:26.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.673+0000 7f0f97200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f980fff90 0x7f0f981979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:26.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.673+0000 7f0f97200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f98101190 0x7f0f98197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:26.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.673+0000 7f0f97200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f98198510 con 0x7f0f980fff90 2024-09-11T00:03:26.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.673+0000 7f0f97200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f98198650 con 0x7f0f98101190 2024-09-11T00:03:26.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.673+0000 7f0f95e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f980fff90 0x7f0f981979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:26.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.673+0000 7f0f95e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f980fff90 0x7f0f981979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48304/0 (socket says 172.21.15.111:48304) 2024-09-11T00:03:26.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.673+0000 7f0f95e00700 1 -- 172.21.15.111:0/970974850 learned_addr learned my addr 172.21.15.111:0/970974850 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:03:26.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.673+0000 7f0f95400700 1 --2- 172.21.15.111:0/970974850 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f98101190 0x7f0f98197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:26.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.673+0000 7f0f95e00700 1 -- 172.21.15.111:0/970974850 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f98101190 msgr2=0x7f0f98197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:26.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.673+0000 7f0f95e00700 1 --2- 172.21.15.111:0/970974850 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f98101190 0x7f0f98197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:26.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.673+0000 7f0f95e00700 1 -- 172.21.15.111:0/970974850 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f840095f0 con 0x7f0f980fff90 2024-09-11T00:03:26.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.674+0000 7f0f95e00700 1 --2- 172.21.15.111:0/970974850 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f980fff90 0x7f0f981979b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0f8800e8f0 tx=0x7f0f8800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:26.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.674+0000 7f0f8ea00700 1 -- 172.21.15.111:0/970974850 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f88009790 con 0x7f0f980fff90 2024-09-11T00:03:26.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.674+0000 7f0f8ea00700 1 -- 172.21.15.111:0/970974850 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0f8800c810 con 0x7f0f980fff90 2024-09-11T00:03:26.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.674+0000 7f0f8ea00700 1 -- 172.21.15.111:0/970974850 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f88003d20 con 0x7f0f980fff90 2024-09-11T00:03:26.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.674+0000 7f0f97200700 1 -- 172.21.15.111:0/970974850 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f9819d100 con 0x7f0f980fff90 2024-09-11T00:03:26.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.674+0000 7f0f97200700 1 -- 172.21.15.111:0/970974850 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f9819d650 con 0x7f0f980fff90 2024-09-11T00:03:26.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.675+0000 7f0f97200700 1 -- 172.21.15.111:0/970974850 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f98105270 con 0x7f0f980fff90 2024-09-11T00:03:26.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.676+0000 7f0f8ea00700 1 -- 172.21.15.111:0/970974850 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f0f880041f0 con 0x7f0f980fff90 2024-09-11T00:03:26.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.677+0000 7f0f8ea00700 1 --2- 172.21.15.111:0/970974850 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f0f7c06c680 0x7f0f7c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:26.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.677+0000 7f0f8ea00700 1 -- 172.21.15.111:0/970974850 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f0f88014070 con 0x7f0f980fff90 2024-09-11T00:03:26.679 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.677+0000 7f0f95400700 1 --2- 172.21.15.111:0/970974850 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f0f7c06c680 0x7f0f7c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:26.679 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.678+0000 7f0f95400700 1 --2- 172.21.15.111:0/970974850 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f0f7c06c680 0x7f0f7c06eb30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400b6f0 tx=0x7f0f84005a90 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:26.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.682+0000 7f0f8ea00700 1 -- 172.21.15.111:0/970974850 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0f88059da0 con 0x7f0f980fff90 2024-09-11T00:03:26.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.880+0000 7f0f97200700 1 -- 172.21.15.111:0/970974850 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f0f9802cc30 con 0x7f0f980fff90 2024-09-11T00:03:26.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:26 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:03:26.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:26 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:03:26.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:26 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:03:26.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.885+0000 7f0f8ea00700 1 -- 172.21.15.111:0/970974850 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v38)=0 v38) v1 ==== 143+0+0 (secure 0 0 0) 0x7f0f9802cc30 con 0x7f0f980fff90 2024-09-11T00:03:26.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.888+0000 7f0f97200700 1 -- 172.21.15.111:0/970974850 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f0f7c06c680 msgr2=0x7f0f7c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:26.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.888+0000 7f0f97200700 1 --2- 172.21.15.111:0/970974850 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f0f7c06c680 0x7f0f7c06eb30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400b6f0 tx=0x7f0f84005a90 comp rx=0 tx=0).stop 2024-09-11T00:03:26.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.888+0000 7f0f97200700 1 -- 172.21.15.111:0/970974850 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f980fff90 msgr2=0x7f0f981979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:26.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.888+0000 7f0f97200700 1 --2- 172.21.15.111:0/970974850 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f980fff90 0x7f0f981979b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0f8800e8f0 tx=0x7f0f8800ec00 comp rx=0 tx=0).stop 2024-09-11T00:03:26.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.888+0000 7f0f97200700 1 -- 172.21.15.111:0/970974850 shutdown_connections 2024-09-11T00:03:26.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.888+0000 7f0f97200700 1 --2- 172.21.15.111:0/970974850 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f0f7c06c680 0x7f0f7c06eb30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:26.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.888+0000 7f0f97200700 1 --2- 172.21.15.111:0/970974850 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f980fff90 0x7f0f981979b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:26.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.888+0000 7f0f97200700 1 --2- 172.21.15.111:0/970974850 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f98101190 0x7f0f98197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:26.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.888+0000 7f0f97200700 1 -- 172.21.15.111:0/970974850 >> 172.21.15.111:0/970974850 conn(0x7f0f980fb500 msgr2=0x7f0f981023b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:26.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.888+0000 7f0f97200700 1 -- 172.21.15.111:0/970974850 shutdown_connections 2024-09-11T00:03:26.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:26.888+0000 7f0f97200700 1 -- 172.21.15.111:0/970974850 wait complete. 2024-09-11T00:03:27.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:26 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:03:27.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:26 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:03:27.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:26 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:03:27.788 INFO:teuthology.run_tasks:Running task print... 2024-09-11T00:03:27.824 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-11T00:03:27.825 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-11T00:03:27.903 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi111.front.sepia.ceph.com 2024-09-11T00:03:27.903 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-11T00:03:28.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:27 smithi111 ceph-mon[27539]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:28.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:27 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/970974850' entity='client.admin' 2024-09-11T00:03:28.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:27 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:03:28.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:27 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:03:28.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:27 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:03:28.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:27 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:03:28.221 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:03:28.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:27 smithi203 ceph-mon[33225]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:28.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:27 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/970974850' entity='client.admin' 2024-09-11T00:03:28.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:27 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:03:28.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:27 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:03:28.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:27 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:03:28.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:27 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:03:30.116 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:29 smithi203 ceph-mon[33225]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:30.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:29 smithi111 ceph-mon[27539]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:30.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.171+0000 7f9fc8600700 1 -- 172.21.15.111:0/842219374 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9fc0103500 msgr2=0x7f9fc01058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:30.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.171+0000 7f9fc8600700 1 --2- 172.21.15.111:0/842219374 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9fc0103500 0x7f9fc01058e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9fac009910 tx=0x7f9fac009c20 comp rx=0 tx=0).stop 2024-09-11T00:03:30.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.171+0000 7f9fc8600700 1 -- 172.21.15.111:0/842219374 shutdown_connections 2024-09-11T00:03:30.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.171+0000 7f9fc8600700 1 --2- 172.21.15.111:0/842219374 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9fc0103500 0x7f9fc01058e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:30.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.171+0000 7f9fc8600700 1 --2- 172.21.15.111:0/842219374 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9fc0100be0 0x7f9fc0102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:30.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.171+0000 7f9fc8600700 1 -- 172.21.15.111:0/842219374 >> 172.21.15.111:0/842219374 conn(0x7f9fc00fa5e0 msgr2=0x7f9fc00fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:30.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.171+0000 7f9fc8600700 1 -- 172.21.15.111:0/842219374 shutdown_connections 2024-09-11T00:03:30.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.171+0000 7f9fc8600700 1 -- 172.21.15.111:0/842219374 wait complete. 2024-09-11T00:03:30.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.172+0000 7f9fc8600700 1 Processor -- start 2024-09-11T00:03:30.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.172+0000 7f9fc8600700 1 -- start start 2024-09-11T00:03:30.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.172+0000 7f9fc8600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9fc0100be0 0x7f9fc0195930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:30.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.172+0000 7f9fc8600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9fc0103500 0x7f9fc0195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:30.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.172+0000 7f9fc8600700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc0196490 con 0x7f9fc0103500 2024-09-11T00:03:30.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.172+0000 7f9fc8600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc01965d0 con 0x7f9fc0100be0 2024-09-11T00:03:30.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.173+0000 7f9fc5200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9fc0103500 0x7f9fc0195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:30.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.173+0000 7f9fc5200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9fc0103500 0x7f9fc0195e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:38312/0 (socket says 172.21.15.111:38312) 2024-09-11T00:03:30.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.173+0000 7f9fc5200700 1 -- 172.21.15.111:0/2016398133 learned_addr learned my addr 172.21.15.111:0/2016398133 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:03:30.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.173+0000 7f9fc5c00700 1 --2- 172.21.15.111:0/2016398133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9fc0100be0 0x7f9fc0195930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:30.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.173+0000 7f9fc5200700 1 -- 172.21.15.111:0/2016398133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9fc0100be0 msgr2=0x7f9fc0195930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:30.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.173+0000 7f9fc5200700 1 --2- 172.21.15.111:0/2016398133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9fc0100be0 0x7f9fc0195930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:30.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.173+0000 7f9fc5200700 1 -- 172.21.15.111:0/2016398133 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fac0095f0 con 0x7f9fc0103500 2024-09-11T00:03:30.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.173+0000 7f9fc5200700 1 --2- 172.21.15.111:0/2016398133 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9fc0103500 0x7f9fc0195e70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00bd70 tx=0x7f9fac00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:30.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.174+0000 7f9fbe000700 1 -- 172.21.15.111:0/2016398133 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fac01d070 con 0x7f9fc0103500 2024-09-11T00:03:30.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.174+0000 7f9fbe000700 1 -- 172.21.15.111:0/2016398133 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9fac005dc0 con 0x7f9fc0103500 2024-09-11T00:03:30.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.174+0000 7f9fc8600700 1 -- 172.21.15.111:0/2016398133 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc019b020 con 0x7f9fc0103500 2024-09-11T00:03:30.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.174+0000 7f9fbe000700 1 -- 172.21.15.111:0/2016398133 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fac021410 con 0x7f9fc0103500 2024-09-11T00:03:30.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.174+0000 7f9fc8600700 1 -- 172.21.15.111:0/2016398133 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc019b510 con 0x7f9fc0103500 2024-09-11T00:03:30.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.175+0000 7f9fc8600700 1 -- 172.21.15.111:0/2016398133 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc018fb70 con 0x7f9fc0103500 2024-09-11T00:03:30.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.176+0000 7f9fbe000700 1 -- 172.21.15.111:0/2016398133 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f9fac00f7d0 con 0x7f9fc0103500 2024-09-11T00:03:30.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.176+0000 7f9fbe000700 1 --2- 172.21.15.111:0/2016398133 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f9fa806c680 0x7f9fa806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:30.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.177+0000 7f9fbe000700 1 -- 172.21.15.111:0/2016398133 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f9fac08c8b0 con 0x7f9fc0103500 2024-09-11T00:03:30.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.177+0000 7f9fc5c00700 1 --2- 172.21.15.111:0/2016398133 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f9fa806c680 0x7f9fa806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:30.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.177+0000 7f9fc5c00700 1 --2- 172.21.15.111:0/2016398133 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f9fa806c680 0x7f9fa806eb30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4005950 tx=0x7f9fb400b410 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:30.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.181+0000 7f9fbe000700 1 -- 172.21.15.111:0/2016398133 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9fac05ad60 con 0x7f9fc0103500 2024-09-11T00:03:30.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.396+0000 7f9fc8600700 1 -- 172.21.15.111:0/2016398133 --> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9fc0061190 con 0x7f9fa806c680 2024-09-11T00:03:30.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.398+0000 7f9fbe000700 1 -- 172.21.15.111:0/2016398133 <== mgr.14211 v2:172.21.15.111:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f9fc0061190 con 0x7f9fa806c680 2024-09-11T00:03:30.399 INFO:teuthology.orchestra.run.smithi111.stdout:Backend: cephadm 2024-09-11T00:03:30.399 INFO:teuthology.orchestra.run.smithi111.stdout:Available: Yes 2024-09-11T00:03:30.400 INFO:teuthology.orchestra.run.smithi111.stdout:Paused: No 2024-09-11T00:03:30.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.400+0000 7f9fc8600700 1 -- 172.21.15.111:0/2016398133 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f9fa806c680 msgr2=0x7f9fa806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:30.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.400+0000 7f9fc8600700 1 --2- 172.21.15.111:0/2016398133 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f9fa806c680 0x7f9fa806eb30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4005950 tx=0x7f9fb400b410 comp rx=0 tx=0).stop 2024-09-11T00:03:30.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.400+0000 7f9fc8600700 1 -- 172.21.15.111:0/2016398133 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9fc0103500 msgr2=0x7f9fc0195e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:30.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.400+0000 7f9fc8600700 1 --2- 172.21.15.111:0/2016398133 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9fc0103500 0x7f9fc0195e70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00bd70 tx=0x7f9fac00bda0 comp rx=0 tx=0).stop 2024-09-11T00:03:30.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.400+0000 7f9fc8600700 1 -- 172.21.15.111:0/2016398133 shutdown_connections 2024-09-11T00:03:30.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.400+0000 7f9fc8600700 1 --2- 172.21.15.111:0/2016398133 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f9fa806c680 0x7f9fa806eb30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:30.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.400+0000 7f9fc8600700 1 --2- 172.21.15.111:0/2016398133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9fc0100be0 0x7f9fc0195930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:30.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.400+0000 7f9fc8600700 1 --2- 172.21.15.111:0/2016398133 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9fc0103500 0x7f9fc0195e70 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:30.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.400+0000 7f9fc8600700 1 -- 172.21.15.111:0/2016398133 >> 172.21.15.111:0/2016398133 conn(0x7f9fc00fa5e0 msgr2=0x7f9fc00fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:30.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.400+0000 7f9fc8600700 1 -- 172.21.15.111:0/2016398133 shutdown_connections 2024-09-11T00:03:30.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:30.400+0000 7f9fc8600700 1 -- 172.21.15.111:0/2016398133 wait complete. 2024-09-11T00:03:31.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:30 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:03:31.236 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-11T00:03:31.244 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:30 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:03:31.553 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:03:31.942 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:31 smithi111 ceph-mon[27539]: from='client.14514 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:03:31.942 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:31 smithi111 ceph-mon[27539]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:32.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:31 smithi203 ceph-mon[33225]: from='client.14514 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:03:32.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:31 smithi203 ceph-mon[33225]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:33.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.293+0000 7fc6abe00700 1 -- 172.21.15.111:0/1447688686 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc6ac1033c0 msgr2=0x7fc6ac103810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:33.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.293+0000 7fc6abe00700 1 --2- 172.21.15.111:0/1447688686 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc6ac1033c0 0x7fc6ac103810 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc698009910 tx=0x7fc698009c20 comp rx=0 tx=0).stop 2024-09-11T00:03:33.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.293+0000 7fc6abe00700 1 -- 172.21.15.111:0/1447688686 shutdown_connections 2024-09-11T00:03:33.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.293+0000 7fc6abe00700 1 --2- 172.21.15.111:0/1447688686 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc6ac1033c0 0x7fc6ac103810 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:33.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.293+0000 7fc6abe00700 1 --2- 172.21.15.111:0/1447688686 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6ac1021c0 0x7fc6ac1025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:33.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.293+0000 7fc6abe00700 1 -- 172.21.15.111:0/1447688686 >> 172.21.15.111:0/1447688686 conn(0x7fc6ac0fd790 msgr2=0x7fc6ac0ffba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:33.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.293+0000 7fc6abe00700 1 -- 172.21.15.111:0/1447688686 shutdown_connections 2024-09-11T00:03:33.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.293+0000 7fc6abe00700 1 -- 172.21.15.111:0/1447688686 wait complete. 2024-09-11T00:03:33.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.294+0000 7fc6abe00700 1 Processor -- start 2024-09-11T00:03:33.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.294+0000 7fc6abe00700 1 -- start start 2024-09-11T00:03:33.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.294+0000 7fc6abe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc6ac1021c0 0x7fc6ac1979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:33.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.294+0000 7fc6abe00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6ac1033c0 0x7fc6ac197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:33.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.294+0000 7fc6abe00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac198520 con 0x7fc6ac1021c0 2024-09-11T00:03:33.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.294+0000 7fc6abe00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac198660 con 0x7fc6ac1033c0 2024-09-11T00:03:33.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.295+0000 7fc6aaa00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc6ac1021c0 0x7fc6ac1979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:33.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.295+0000 7fc6aaa00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc6ac1021c0 0x7fc6ac1979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:38330/0 (socket says 172.21.15.111:38330) 2024-09-11T00:03:33.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.295+0000 7fc6aaa00700 1 -- 172.21.15.111:0/954899611 learned_addr learned my addr 172.21.15.111:0/954899611 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:03:33.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.295+0000 7fc6aa000700 1 --2- 172.21.15.111:0/954899611 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6ac1033c0 0x7fc6ac197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:33.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.295+0000 7fc6aaa00700 1 -- 172.21.15.111:0/954899611 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6ac1033c0 msgr2=0x7fc6ac197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:33.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.295+0000 7fc6aaa00700 1 --2- 172.21.15.111:0/954899611 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6ac1033c0 0x7fc6ac197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:33.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.295+0000 7fc6aaa00700 1 -- 172.21.15.111:0/954899611 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6980095f0 con 0x7fc6ac1021c0 2024-09-11T00:03:33.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.295+0000 7fc6aaa00700 1 --2- 172.21.15.111:0/954899611 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc6ac1021c0 0x7fc6ac1979c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc69c00d900 tx=0x7fc69c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:33.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.296+0000 7fc6a3400700 1 -- 172.21.15.111:0/954899611 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc69c00b920 con 0x7fc6ac1021c0 2024-09-11T00:03:33.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.296+0000 7fc6a3400700 1 -- 172.21.15.111:0/954899611 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc69c010460 con 0x7fc6ac1021c0 2024-09-11T00:03:33.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.296+0000 7fc6abe00700 1 -- 172.21.15.111:0/954899611 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6ac19d110 con 0x7fc6ac1021c0 2024-09-11T00:03:33.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.296+0000 7fc6a3400700 1 -- 172.21.15.111:0/954899611 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc69c00f590 con 0x7fc6ac1021c0 2024-09-11T00:03:33.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.296+0000 7fc6abe00700 1 -- 172.21.15.111:0/954899611 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ac19d660 con 0x7fc6ac1021c0 2024-09-11T00:03:33.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.297+0000 7fc6abe00700 1 -- 172.21.15.111:0/954899611 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6ac10ad10 con 0x7fc6ac1021c0 2024-09-11T00:03:33.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.298+0000 7fc6a3400700 1 -- 172.21.15.111:0/954899611 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fc69c0105d0 con 0x7fc6ac1021c0 2024-09-11T00:03:33.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.299+0000 7fc6a3400700 1 --2- 172.21.15.111:0/954899611 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc69006c680 0x7fc69006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:33.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.299+0000 7fc6a3400700 1 -- 172.21.15.111:0/954899611 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fc69c08b470 con 0x7fc6ac1021c0 2024-09-11T00:03:33.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.299+0000 7fc6aa000700 1 --2- 172.21.15.111:0/954899611 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc69006c680 0x7fc69006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:33.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.300+0000 7fc6aa000700 1 --2- 172.21.15.111:0/954899611 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc69006c680 0x7fc69006eb30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc698006010 tx=0x7fc69800b540 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:33.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.303+0000 7fc6a3400700 1 -- 172.21.15.111:0/954899611 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc69c059960 con 0x7fc6ac1021c0 2024-09-11T00:03:33.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.511+0000 7fc6abe00700 1 -- 172.21.15.111:0/954899611 --> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6ac107d10 con 0x7fc69006c680 2024-09-11T00:03:33.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.521+0000 7fc6a3400700 1 -- 172.21.15.111:0/954899611 <== mgr.14211 v2:172.21.15.111:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2860 (secure 0 0 0) 0x7fc6ac107d10 con 0x7fc69006c680 2024-09-11T00:03:33.523 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:03:33.523 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (4m) 2m ago 6m 14.3M - 0.25.0 c8568f914cd2 eb9e393000ec 2024-09-11T00:03:33.523 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (6m) 2m ago 6m 7033k - 18.2.0 dc2bc1663786 b6e7b6bd4d27 2024-09-11T00:03:33.523 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi203 smithi203 running (5m) 72s ago 5m 6975k - 18.2.0 dc2bc1663786 7bbfd9c27900 2024-09-11T00:03:33.523 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (6m) 2m ago 6m 6665k - 18.2.0 dc2bc1663786 72a36c166ffa 2024-09-11T00:03:33.523 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi203 smithi203 running (5m) 72s ago 5m 6669k - 18.2.0 dc2bc1663786 9b102b6f6d70 2024-09-11T00:03:33.523 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (4m) 2m ago 6m 75.0M - 9.4.7 954c08fa6188 e599624a9c9e 2024-09-11T00:03:33.523 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.ypucji smithi111 *:9283,8765,8443 running (8m) 2m ago 8m 480M - 18.2.0 dc2bc1663786 0329ec697a09 2024-09-11T00:03:33.523 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi203.smuspl smithi203 *:8443,9283,8765 running (5m) 72s ago 5m 436M - 18.2.0 dc2bc1663786 9f1086684d72 2024-09-11T00:03:33.524 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (8m) 2m ago 8m 43.7M 2048M 18.2.0 dc2bc1663786 2596322539fb 2024-09-11T00:03:33.524 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi203 smithi203 running (5m) 72s ago 5m 32.8M 2048M 18.2.0 dc2bc1663786 ff8eb7ca85ea 2024-09-11T00:03:33.524 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (6m) 2m ago 6m 7688k - 1.5.0 0da6a335fe13 4fd66ebc9c0d 2024-09-11T00:03:33.524 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi203 smithi203 *:9100 running (5m) 72s ago 5m 8078k - 1.5.0 0da6a335fe13 1cb3ca740f4a 2024-09-11T00:03:33.524 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (3m) 2m ago 3m 40.2M 3947M 18.2.0 dc2bc1663786 162b7249a591 2024-09-11T00:03:33.524 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (3m) 2m ago 3m 40.0M 3947M 18.2.0 dc2bc1663786 3614d95b1425 2024-09-11T00:03:33.524 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (2m) 2m ago 2m 41.1M 3947M 18.2.0 dc2bc1663786 db175d4b09b9 2024-09-11T00:03:33.524 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi203 running (2m) 72s ago 2m 41.0M 4971M 18.2.0 dc2bc1663786 60b1cef7a70d 2024-09-11T00:03:33.524 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi203 running (110s) 72s ago 110s 37.8M 4971M 18.2.0 dc2bc1663786 769c7942c42b 2024-09-11T00:03:33.524 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi203 running (78s) 72s ago 77s 11.0M 4971M 18.2.0 dc2bc1663786 6d824001d40c 2024-09-11T00:03:33.524 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (4m) 2m ago 6m 44.1M - 2.43.0 a07b618ecd1d bd707157a41b 2024-09-11T00:03:33.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.524+0000 7fc6abe00700 1 -- 172.21.15.111:0/954899611 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc69006c680 msgr2=0x7fc69006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:33.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.524+0000 7fc6abe00700 1 --2- 172.21.15.111:0/954899611 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc69006c680 0x7fc69006eb30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc698006010 tx=0x7fc69800b540 comp rx=0 tx=0).stop 2024-09-11T00:03:33.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.524+0000 7fc6abe00700 1 -- 172.21.15.111:0/954899611 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc6ac1021c0 msgr2=0x7fc6ac1979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:33.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.524+0000 7fc6abe00700 1 --2- 172.21.15.111:0/954899611 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc6ac1021c0 0x7fc6ac1979c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc69c00d900 tx=0x7fc69c00dcc0 comp rx=0 tx=0).stop 2024-09-11T00:03:33.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.524+0000 7fc6abe00700 1 -- 172.21.15.111:0/954899611 shutdown_connections 2024-09-11T00:03:33.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.524+0000 7fc6abe00700 1 --2- 172.21.15.111:0/954899611 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc69006c680 0x7fc69006eb30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:33.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.524+0000 7fc6abe00700 1 --2- 172.21.15.111:0/954899611 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc6ac1021c0 0x7fc6ac1979c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:33.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.524+0000 7fc6abe00700 1 --2- 172.21.15.111:0/954899611 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6ac1033c0 0x7fc6ac197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:33.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.524+0000 7fc6abe00700 1 -- 172.21.15.111:0/954899611 >> 172.21.15.111:0/954899611 conn(0x7fc6ac0fd790 msgr2=0x7fc6ac1065f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:33.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.524+0000 7fc6abe00700 1 -- 172.21.15.111:0/954899611 shutdown_connections 2024-09-11T00:03:33.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:33.524+0000 7fc6abe00700 1 -- 172.21.15.111:0/954899611 wait complete. 2024-09-11T00:03:34.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:33 smithi111 ceph-mon[27539]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:34.181 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-11T00:03:34.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:33 smithi203 ceph-mon[33225]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:34.497 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:03:35.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:34 smithi203 ceph-mon[33225]: from='client.14518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:03:35.322 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:34 smithi111 ceph-mon[27539]: from='client.14518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:03:36.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:35 smithi111 ceph-mon[27539]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:36.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:35 smithi203 ceph-mon[33225]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:36.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.299+0000 7f3b05400700 1 -- 172.21.15.111:0/3411786784 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b00075700 msgr2=0x7f3b00075b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:36.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.299+0000 7f3b05400700 1 --2- 172.21.15.111:0/3411786784 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b00075700 0x7f3b00075b10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3af0009910 tx=0x7f3af0009c20 comp rx=0 tx=0).stop 2024-09-11T00:03:36.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.299+0000 7f3b05400700 1 -- 172.21.15.111:0/3411786784 shutdown_connections 2024-09-11T00:03:36.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.299+0000 7f3b05400700 1 --2- 172.21.15.111:0/3411786784 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b00076950 0x7f3b00076dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:36.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.299+0000 7f3b05400700 1 --2- 172.21.15.111:0/3411786784 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b00075700 0x7f3b00075b10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:36.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.299+0000 7f3b05400700 1 -- 172.21.15.111:0/3411786784 >> 172.21.15.111:0/3411786784 conn(0x7f3b000fd930 msgr2=0x7f3b000ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:36.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.300+0000 7f3b05400700 1 -- 172.21.15.111:0/3411786784 shutdown_connections 2024-09-11T00:03:36.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.300+0000 7f3b05400700 1 -- 172.21.15.111:0/3411786784 wait complete. 2024-09-11T00:03:36.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.300+0000 7f3b05400700 1 Processor -- start 2024-09-11T00:03:36.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.301+0000 7f3b05400700 1 -- start start 2024-09-11T00:03:36.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.301+0000 7f3b05400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b00075700 0x7f3b0019c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:36.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.301+0000 7f3b05400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b00076950 0x7f3b0019c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:36.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.301+0000 7f3b05400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0019cb70 con 0x7f3b00075700 2024-09-11T00:03:36.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.301+0000 7f3b05400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0019ccb0 con 0x7f3b00076950 2024-09-11T00:03:36.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.301+0000 7f3afe800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b00075700 0x7f3b0019c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:36.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.301+0000 7f3afe800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b00075700 0x7f3b0019c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:38358/0 (socket says 172.21.15.111:38358) 2024-09-11T00:03:36.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.301+0000 7f3afe800700 1 -- 172.21.15.111:0/1875650209 learned_addr learned my addr 172.21.15.111:0/1875650209 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:03:36.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.301+0000 7f3af7e00700 1 --2- 172.21.15.111:0/1875650209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b00076950 0x7f3b0019c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:36.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.302+0000 7f3afe800700 1 -- 172.21.15.111:0/1875650209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b00076950 msgr2=0x7f3b0019c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:36.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.302+0000 7f3afe800700 1 --2- 172.21.15.111:0/1875650209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b00076950 0x7f3b0019c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:36.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.302+0000 7f3afe800700 1 -- 172.21.15.111:0/1875650209 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af00095f0 con 0x7f3b00075700 2024-09-11T00:03:36.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.302+0000 7f3afe800700 1 --2- 172.21.15.111:0/1875650209 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b00075700 0x7f3b0019c010 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3af000bd70 tx=0x7f3af000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:36.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.302+0000 7f3af7400700 1 -- 172.21.15.111:0/1875650209 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3af001d070 con 0x7f3b00075700 2024-09-11T00:03:36.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.302+0000 7f3af7400700 1 -- 172.21.15.111:0/1875650209 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3af0022470 con 0x7f3b00075700 2024-09-11T00:03:36.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.302+0000 7f3b05400700 1 -- 172.21.15.111:0/1875650209 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b001a1700 con 0x7f3b00075700 2024-09-11T00:03:36.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.302+0000 7f3af7400700 1 -- 172.21.15.111:0/1875650209 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3af000f670 con 0x7f3b00075700 2024-09-11T00:03:36.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.302+0000 7f3b05400700 1 -- 172.21.15.111:0/1875650209 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b001a1c70 con 0x7f3b00075700 2024-09-11T00:03:36.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.303+0000 7f3b05400700 1 -- 172.21.15.111:0/1875650209 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0010f340 con 0x7f3b00075700 2024-09-11T00:03:36.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.304+0000 7f3af7400700 1 -- 172.21.15.111:0/1875650209 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f3af0022a50 con 0x7f3b00075700 2024-09-11T00:03:36.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.305+0000 7f3af7400700 1 --2- 172.21.15.111:0/1875650209 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f3ae406c680 0x7f3ae406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:36.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.306+0000 7f3af7400700 1 -- 172.21.15.111:0/1875650209 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f3af008cb40 con 0x7f3b00075700 2024-09-11T00:03:36.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.306+0000 7f3af7e00700 1 --2- 172.21.15.111:0/1875650209 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f3ae406c680 0x7f3ae406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:36.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.306+0000 7f3af7e00700 1 --2- 172.21.15.111:0/1875650209 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f3ae406c680 0x7f3ae406eb30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8006fd0 tx=0x7f3ae8008040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:36.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.310+0000 7f3af7400700 1 -- 172.21.15.111:0/1875650209 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3af005b120 con 0x7f3b00075700 2024-09-11T00:03:36.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.513+0000 7f3b05400700 1 -- 172.21.15.111:0/1875650209 --> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b0010dd00 con 0x7f3ae406c680 2024-09-11T00:03:36.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.520+0000 7f3af7400700 1 -- 172.21.15.111:0/1875650209 <== mgr.14211 v2:172.21.15.111:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1310 (secure 0 0 0) 0x7f3b0010dd00 con 0x7f3ae406c680 2024-09-11T00:03:36.522 INFO:teuthology.orchestra.run.smithi111.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-11T00:03:36.522 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager ?:9093,9094 1/1 2m ago 7m count:1 2024-09-11T00:03:36.522 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter 2/2 2m ago 7m * 2024-09-11T00:03:36.522 INFO:teuthology.orchestra.run.smithi111.stdout:crash 2/2 2m ago 7m * 2024-09-11T00:03:36.522 INFO:teuthology.orchestra.run.smithi111.stdout:grafana ?:3000 1/1 2m ago 7m count:1 2024-09-11T00:03:36.522 INFO:teuthology.orchestra.run.smithi111.stdout:mgr 2/2 2m ago 7m count:2 2024-09-11T00:03:36.523 INFO:teuthology.orchestra.run.smithi111.stdout:mon 2/2 2m ago 6m smithi111:172.21.15.111=smithi111;smithi203:172.21.15.203=smithi203;count:2 2024-09-11T00:03:36.523 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter ?:9100 2/2 2m ago 7m * 2024-09-11T00:03:36.523 INFO:teuthology.orchestra.run.smithi111.stdout:osd 6 2m ago - 2024-09-11T00:03:36.523 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus ?:9095 1/1 2m ago 7m count:1 2024-09-11T00:03:36.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.523+0000 7f3b05400700 1 -- 172.21.15.111:0/1875650209 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f3ae406c680 msgr2=0x7f3ae406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:36.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.523+0000 7f3b05400700 1 --2- 172.21.15.111:0/1875650209 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f3ae406c680 0x7f3ae406eb30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8006fd0 tx=0x7f3ae8008040 comp rx=0 tx=0).stop 2024-09-11T00:03:36.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.523+0000 7f3b05400700 1 -- 172.21.15.111:0/1875650209 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b00075700 msgr2=0x7f3b0019c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:36.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.523+0000 7f3b05400700 1 --2- 172.21.15.111:0/1875650209 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b00075700 0x7f3b0019c010 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3af000bd70 tx=0x7f3af000be50 comp rx=0 tx=0).stop 2024-09-11T00:03:36.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.523+0000 7f3b05400700 1 -- 172.21.15.111:0/1875650209 shutdown_connections 2024-09-11T00:03:36.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.523+0000 7f3b05400700 1 --2- 172.21.15.111:0/1875650209 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f3ae406c680 0x7f3ae406eb30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:36.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.523+0000 7f3b05400700 1 --2- 172.21.15.111:0/1875650209 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b00075700 0x7f3b0019c010 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:36.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.523+0000 7f3b05400700 1 --2- 172.21.15.111:0/1875650209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b00076950 0x7f3b0019c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:36.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.523+0000 7f3b05400700 1 -- 172.21.15.111:0/1875650209 >> 172.21.15.111:0/1875650209 conn(0x7f3b000fd930 msgr2=0x7f3b0010c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:36.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.523+0000 7f3b05400700 1 -- 172.21.15.111:0/1875650209 shutdown_connections 2024-09-11T00:03:36.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:36.523+0000 7f3b05400700 1 -- 172.21.15.111:0/1875650209 wait complete. 2024-09-11T00:03:37.283 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-11T00:03:37.601 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:03:38.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:37 smithi111 ceph-mon[27539]: from='client.14522 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:03:38.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:37 smithi111 ceph-mon[27539]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:38.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:37 smithi203 ceph-mon[33225]: from='client.14522 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:03:38.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:37 smithi203 ceph-mon[33225]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:39.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.524+0000 7f84c0600700 1 -- 172.21.15.111:0/4026797306 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84b8100150 msgr2=0x7f84b8100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:39.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.524+0000 7f84c0600700 1 --2- 172.21.15.111:0/4026797306 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84b8100150 0x7f84b8100560 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00b0a0 tx=0x7f84ac00b3b0 comp rx=0 tx=0).stop 2024-09-11T00:03:39.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.524+0000 7f84c0600700 1 -- 172.21.15.111:0/4026797306 shutdown_connections 2024-09-11T00:03:39.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.524+0000 7f84c0600700 1 --2- 172.21.15.111:0/4026797306 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84b8101350 0x7f84b81017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:39.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.524+0000 7f84c0600700 1 --2- 172.21.15.111:0/4026797306 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84b8100150 0x7f84b8100560 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:39.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.524+0000 7f84c0600700 1 -- 172.21.15.111:0/4026797306 >> 172.21.15.111:0/4026797306 conn(0x7f84b80fb6e0 msgr2=0x7f84b80fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:39.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.524+0000 7f84c0600700 1 -- 172.21.15.111:0/4026797306 shutdown_connections 2024-09-11T00:03:39.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.524+0000 7f84c0600700 1 -- 172.21.15.111:0/4026797306 wait complete. 2024-09-11T00:03:39.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.525+0000 7f84c0600700 1 Processor -- start 2024-09-11T00:03:39.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.526+0000 7f84c0600700 1 -- start start 2024-09-11T00:03:39.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.526+0000 7f84c0600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84b8100150 0x7f84b8197ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:39.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.526+0000 7f84c0600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84b8101350 0x7f84b81980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:39.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.526+0000 7f84c0600700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b8198700 con 0x7f84b8100150 2024-09-11T00:03:39.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.526+0000 7f84c0600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b8198840 con 0x7f84b8101350 2024-09-11T00:03:39.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.526+0000 7f84bdc00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84b8100150 0x7f84b8197ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:39.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.526+0000 7f84bdc00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84b8100150 0x7f84b8197ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42888/0 (socket says 172.21.15.111:42888) 2024-09-11T00:03:39.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.526+0000 7f84bdc00700 1 -- 172.21.15.111:0/3799712973 learned_addr learned my addr 172.21.15.111:0/3799712973 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:03:39.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.526+0000 7f84bd200700 1 --2- 172.21.15.111:0/3799712973 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84b8101350 0x7f84b81980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:39.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.526+0000 7f84bdc00700 1 -- 172.21.15.111:0/3799712973 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84b8101350 msgr2=0x7f84b81980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:39.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.526+0000 7f84bdc00700 1 --2- 172.21.15.111:0/3799712973 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84b8101350 0x7f84b81980e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:39.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.526+0000 7f84bdc00700 1 -- 172.21.15.111:0/3799712973 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ac009d00 con 0x7f84b8100150 2024-09-11T00:03:39.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.526+0000 7f84bd200700 1 --2- 172.21.15.111:0/3799712973 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84b8101350 0x7f84b81980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:03:39.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.527+0000 7f84bdc00700 1 --2- 172.21.15.111:0/3799712973 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84b8100150 0x7f84b8197ba0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0077b0 tx=0x7f84ac009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:39.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.527+0000 7f84b6000700 1 -- 172.21.15.111:0/3799712973 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84ac00e040 con 0x7f84b8100150 2024-09-11T00:03:39.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.527+0000 7f84b6000700 1 -- 172.21.15.111:0/3799712973 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f84ac0044f0 con 0x7f84b8100150 2024-09-11T00:03:39.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.527+0000 7f84c0600700 1 -- 172.21.15.111:0/3799712973 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b819d290 con 0x7f84b8100150 2024-09-11T00:03:39.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.527+0000 7f84b6000700 1 -- 172.21.15.111:0/3799712973 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84ac01d9e0 con 0x7f84b8100150 2024-09-11T00:03:39.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.527+0000 7f84c0600700 1 -- 172.21.15.111:0/3799712973 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b819d780 con 0x7f84b8100150 2024-09-11T00:03:39.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.528+0000 7f84c0600700 1 -- 172.21.15.111:0/3799712973 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b8105430 con 0x7f84b8100150 2024-09-11T00:03:39.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.529+0000 7f84b6000700 1 -- 172.21.15.111:0/3799712973 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f84ac004040 con 0x7f84b8100150 2024-09-11T00:03:39.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.530+0000 7f84b6000700 1 --2- 172.21.15.111:0/3799712973 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f84a006c680 0x7f84a006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:39.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.530+0000 7f84b6000700 1 -- 172.21.15.111:0/3799712973 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f84ac08cf70 con 0x7f84b8100150 2024-09-11T00:03:39.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.530+0000 7f84bd200700 1 --2- 172.21.15.111:0/3799712973 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f84a006c680 0x7f84a006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:39.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.531+0000 7f84bd200700 1 --2- 172.21.15.111:0/3799712973 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f84a006c680 0x7f84a006eb30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f84a4005fd0 tx=0x7f84a4005f60 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:39.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.534+0000 7f84b6000700 1 -- 172.21.15.111:0/3799712973 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f84ac05b420 con 0x7f84b8100150 2024-09-11T00:03:39.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.738+0000 7f84c0600700 1 -- 172.21.15.111:0/3799712973 --> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f84b8061190 con 0x7f84a006c680 2024-09-11T00:03:39.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.739+0000 7f84b6000700 1 -- 172.21.15.111:0/3799712973 <== mgr.14211 v2:172.21.15.111:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f84b8061190 con 0x7f84a006c680 2024-09-11T00:03:39.741 INFO:teuthology.orchestra.run.smithi111.stdout:HOST ADDR LABELS STATUS 2024-09-11T00:03:39.741 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111 172.21.15.111 2024-09-11T00:03:39.741 INFO:teuthology.orchestra.run.smithi111.stdout:smithi203 172.21.15.203 2024-09-11T00:03:39.742 INFO:teuthology.orchestra.run.smithi111.stdout:2 hosts in cluster 2024-09-11T00:03:39.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.742+0000 7f84c0600700 1 -- 172.21.15.111:0/3799712973 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f84a006c680 msgr2=0x7f84a006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:39.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.742+0000 7f84c0600700 1 --2- 172.21.15.111:0/3799712973 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f84a006c680 0x7f84a006eb30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f84a4005fd0 tx=0x7f84a4005f60 comp rx=0 tx=0).stop 2024-09-11T00:03:39.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.742+0000 7f84c0600700 1 -- 172.21.15.111:0/3799712973 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84b8100150 msgr2=0x7f84b8197ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:39.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.742+0000 7f84c0600700 1 --2- 172.21.15.111:0/3799712973 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84b8100150 0x7f84b8197ba0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0077b0 tx=0x7f84ac009810 comp rx=0 tx=0).stop 2024-09-11T00:03:39.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.742+0000 7f84c0600700 1 -- 172.21.15.111:0/3799712973 shutdown_connections 2024-09-11T00:03:39.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.742+0000 7f84c0600700 1 --2- 172.21.15.111:0/3799712973 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f84a006c680 0x7f84a006eb30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:39.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.742+0000 7f84c0600700 1 --2- 172.21.15.111:0/3799712973 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84b8100150 0x7f84b8197ba0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:39.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.742+0000 7f84c0600700 1 --2- 172.21.15.111:0/3799712973 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84b8101350 0x7f84b81980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:39.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.742+0000 7f84c0600700 1 -- 172.21.15.111:0/3799712973 >> 172.21.15.111:0/3799712973 conn(0x7f84b80fb6e0 msgr2=0x7f84b8102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:39.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.742+0000 7f84c0600700 1 -- 172.21.15.111:0/3799712973 shutdown_connections 2024-09-11T00:03:39.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:39.742+0000 7f84c0600700 1 -- 172.21.15.111:0/3799712973 wait complete. 2024-09-11T00:03:40.073 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:39 smithi111 ceph-mon[27539]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:40.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:39 smithi203 ceph-mon[33225]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:40.522 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-11T00:03:40.839 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:03:41.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:40 smithi203 ceph-mon[33225]: from='client.14526 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:03:41.242 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:40 smithi111 ceph-mon[27539]: from='client.14526 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:03:42.256 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:41 smithi111 ceph-mon[27539]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:42.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:41 smithi203 ceph-mon[33225]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:42.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.629+0000 7faa53200700 1 -- 172.21.15.111:0/218525579 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faa541021e0 msgr2=0x7faa541025f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:42.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.629+0000 7faa53200700 1 --2- 172.21.15.111:0/218525579 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faa541021e0 0x7faa541025f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7faa44009910 tx=0x7faa44009c20 comp rx=0 tx=0).stop 2024-09-11T00:03:42.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.629+0000 7faa53200700 1 -- 172.21.15.111:0/218525579 shutdown_connections 2024-09-11T00:03:42.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.629+0000 7faa53200700 1 --2- 172.21.15.111:0/218525579 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa541033e0 0x7faa54103830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:42.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.629+0000 7faa53200700 1 --2- 172.21.15.111:0/218525579 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faa541021e0 0x7faa541025f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:42.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.629+0000 7faa53200700 1 -- 172.21.15.111:0/218525579 >> 172.21.15.111:0/218525579 conn(0x7faa540fd8d0 msgr2=0x7faa540ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:42.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.629+0000 7faa53200700 1 -- 172.21.15.111:0/218525579 shutdown_connections 2024-09-11T00:03:42.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.629+0000 7faa53200700 1 -- 172.21.15.111:0/218525579 wait complete. 2024-09-11T00:03:42.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.630+0000 7faa53200700 1 Processor -- start 2024-09-11T00:03:42.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.630+0000 7faa53200700 1 -- start start 2024-09-11T00:03:42.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.630+0000 7faa53200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faa541021e0 0x7faa541979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:42.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.630+0000 7faa53200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa541033e0 0x7faa54197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:42.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.631+0000 7faa53200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa54198520 con 0x7faa541021e0 2024-09-11T00:03:42.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.631+0000 7faa53200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa54198660 con 0x7faa541033e0 2024-09-11T00:03:42.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.631+0000 7faa51e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faa541021e0 0x7faa541979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:42.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.631+0000 7faa51e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faa541021e0 0x7faa541979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42912/0 (socket says 172.21.15.111:42912) 2024-09-11T00:03:42.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.631+0000 7faa51e00700 1 -- 172.21.15.111:0/2365991519 learned_addr learned my addr 172.21.15.111:0/2365991519 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:03:42.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.631+0000 7faa51e00700 1 -- 172.21.15.111:0/2365991519 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa541033e0 msgr2=0x7faa54197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:42.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.631+0000 7faa51e00700 1 --2- 172.21.15.111:0/2365991519 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa541033e0 0x7faa54197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:42.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.631+0000 7faa51e00700 1 -- 172.21.15.111:0/2365991519 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa440095f0 con 0x7faa541021e0 2024-09-11T00:03:42.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.631+0000 7faa51e00700 1 --2- 172.21.15.111:0/2365991519 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faa541021e0 0x7faa541979c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7faa4400bd70 tx=0x7faa4400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:42.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.632+0000 7faa4aa00700 1 -- 172.21.15.111:0/2365991519 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa4401d070 con 0x7faa541021e0 2024-09-11T00:03:42.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.632+0000 7faa4aa00700 1 -- 172.21.15.111:0/2365991519 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7faa4400f460 con 0x7faa541021e0 2024-09-11T00:03:42.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.632+0000 7faa4aa00700 1 -- 172.21.15.111:0/2365991519 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa44021620 con 0x7faa541021e0 2024-09-11T00:03:42.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.632+0000 7faa53200700 1 -- 172.21.15.111:0/2365991519 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa5419d0b0 con 0x7faa541021e0 2024-09-11T00:03:42.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.632+0000 7faa53200700 1 -- 172.21.15.111:0/2365991519 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5419d550 con 0x7faa541021e0 2024-09-11T00:03:42.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.633+0000 7faa53200700 1 -- 172.21.15.111:0/2365991519 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa5410ad30 con 0x7faa541021e0 2024-09-11T00:03:42.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.634+0000 7faa4aa00700 1 -- 172.21.15.111:0/2365991519 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7faa4400fa40 con 0x7faa541021e0 2024-09-11T00:03:42.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.635+0000 7faa4aa00700 1 --2- 172.21.15.111:0/2365991519 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7faa3806c680 0x7faa3806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:42.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.635+0000 7faa4aa00700 1 -- 172.21.15.111:0/2365991519 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7faa4408c860 con 0x7faa541021e0 2024-09-11T00:03:42.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.635+0000 7faa51400700 1 --2- 172.21.15.111:0/2365991519 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7faa3806c680 0x7faa3806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:42.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.635+0000 7faa51400700 1 --2- 172.21.15.111:0/2365991519 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7faa3806c680 0x7faa3806eb30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7faa40005950 tx=0x7faa400058e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:42.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.639+0000 7faa4aa00700 1 -- 172.21.15.111:0/2365991519 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7faa4405ad10 con 0x7faa541021e0 2024-09-11T00:03:42.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.846+0000 7faa53200700 1 -- 172.21.15.111:0/2365991519 --> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7faa54107d30 con 0x7faa3806c680 2024-09-11T00:03:42.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.848+0000 7faa4aa00700 1 -- 172.21.15.111:0/2365991519 <== mgr.14211 v2:172.21.15.111:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7faa54107d30 con 0x7faa3806c680 2024-09-11T00:03:42.849 INFO:teuthology.orchestra.run.smithi111.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-11T00:03:42.850 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400VZ400BGN 372G No 2m ago LVM detected, locked 2024-09-11T00:03:42.850 INFO:teuthology.orchestra.run.smithi111.stdout:smithi203 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GK400BGN 372G No 77s ago LVM detected, locked 2024-09-11T00:03:42.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.850+0000 7faa53200700 1 -- 172.21.15.111:0/2365991519 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7faa3806c680 msgr2=0x7faa3806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:42.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.850+0000 7faa53200700 1 --2- 172.21.15.111:0/2365991519 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7faa3806c680 0x7faa3806eb30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7faa40005950 tx=0x7faa400058e0 comp rx=0 tx=0).stop 2024-09-11T00:03:42.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.850+0000 7faa53200700 1 -- 172.21.15.111:0/2365991519 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faa541021e0 msgr2=0x7faa541979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:42.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.850+0000 7faa53200700 1 --2- 172.21.15.111:0/2365991519 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faa541021e0 0x7faa541979c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7faa4400bd70 tx=0x7faa4400be50 comp rx=0 tx=0).stop 2024-09-11T00:03:42.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.850+0000 7faa53200700 1 -- 172.21.15.111:0/2365991519 shutdown_connections 2024-09-11T00:03:42.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.850+0000 7faa53200700 1 --2- 172.21.15.111:0/2365991519 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7faa3806c680 0x7faa3806eb30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:42.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.850+0000 7faa53200700 1 --2- 172.21.15.111:0/2365991519 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faa541021e0 0x7faa541979c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:42.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.850+0000 7faa53200700 1 --2- 172.21.15.111:0/2365991519 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa541033e0 0x7faa54197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:42.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.850+0000 7faa53200700 1 -- 172.21.15.111:0/2365991519 >> 172.21.15.111:0/2365991519 conn(0x7faa540fd8d0 msgr2=0x7faa54106610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:42.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.850+0000 7faa53200700 1 -- 172.21.15.111:0/2365991519 shutdown_connections 2024-09-11T00:03:42.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:42.850+0000 7faa53200700 1 -- 172.21.15.111:0/2365991519 wait complete. 2024-09-11T00:03:43.537 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-11T00:03:43.578 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi111.front.sepia.ceph.com 2024-09-11T00:03:43.578 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-11T00:03:43.896 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:03:44.256 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:43 smithi111 ceph-mon[27539]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:44.256 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:43 smithi111 ceph-mon[27539]: from='client.14530 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:03:44.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:43 smithi203 ceph-mon[33225]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:44.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:43 smithi203 ceph-mon[33225]: from='client.14530 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:03:45.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.812+0000 7fe938e00700 1 -- 172.21.15.111:0/1784194690 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9340fff90 msgr2=0x7fe9341003a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:45.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.812+0000 7fe938e00700 1 --2- 172.21.15.111:0/1784194690 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9340fff90 0x7fe9341003a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe924009910 tx=0x7fe924009c20 comp rx=0 tx=0).stop 2024-09-11T00:03:45.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.812+0000 7fe938e00700 1 -- 172.21.15.111:0/1784194690 shutdown_connections 2024-09-11T00:03:45.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.812+0000 7fe938e00700 1 --2- 172.21.15.111:0/1784194690 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe934101190 0x7fe9341015e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:45.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.812+0000 7fe938e00700 1 --2- 172.21.15.111:0/1784194690 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9340fff90 0x7fe9341003a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:45.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.812+0000 7fe938e00700 1 -- 172.21.15.111:0/1784194690 >> 172.21.15.111:0/1784194690 conn(0x7fe9340fb500 msgr2=0x7fe9340fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:45.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.812+0000 7fe938e00700 1 -- 172.21.15.111:0/1784194690 shutdown_connections 2024-09-11T00:03:45.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.812+0000 7fe938e00700 1 -- 172.21.15.111:0/1784194690 wait complete. 2024-09-11T00:03:45.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.813+0000 7fe938e00700 1 Processor -- start 2024-09-11T00:03:45.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.813+0000 7fe938e00700 1 -- start start 2024-09-11T00:03:45.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.813+0000 7fe938e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9340fff90 0x7fe9341979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:45.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.814+0000 7fe938e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe934101190 0x7fe934197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:45.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.814+0000 7fe938e00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe934198520 con 0x7fe9340fff90 2024-09-11T00:03:45.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.814+0000 7fe938e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe934198660 con 0x7fe934101190 2024-09-11T00:03:45.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.814+0000 7fe933400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9340fff90 0x7fe9341979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:45.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.814+0000 7fe933400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9340fff90 0x7fe9341979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42926/0 (socket says 172.21.15.111:42926) 2024-09-11T00:03:45.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.814+0000 7fe933400700 1 -- 172.21.15.111:0/2758354460 learned_addr learned my addr 172.21.15.111:0/2758354460 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:03:45.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.814+0000 7fe932a00700 1 --2- 172.21.15.111:0/2758354460 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe934101190 0x7fe934197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:45.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.814+0000 7fe933400700 1 -- 172.21.15.111:0/2758354460 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe934101190 msgr2=0x7fe934197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:45.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.814+0000 7fe933400700 1 --2- 172.21.15.111:0/2758354460 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe934101190 0x7fe934197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:45.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.814+0000 7fe933400700 1 -- 172.21.15.111:0/2758354460 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9240095f0 con 0x7fe9340fff90 2024-09-11T00:03:45.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.814+0000 7fe932a00700 1 --2- 172.21.15.111:0/2758354460 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe934101190 0x7fe934197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:03:45.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.815+0000 7fe933400700 1 --2- 172.21.15.111:0/2758354460 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9340fff90 0x7fe9341979c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe92400f690 tx=0x7fe92400f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:45.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.815+0000 7fe92be00700 1 -- 172.21.15.111:0/2758354460 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe92401d070 con 0x7fe9340fff90 2024-09-11T00:03:45.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.815+0000 7fe92be00700 1 -- 172.21.15.111:0/2758354460 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe924005dc0 con 0x7fe9340fff90 2024-09-11T00:03:45.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.815+0000 7fe92be00700 1 -- 172.21.15.111:0/2758354460 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe924017630 con 0x7fe9340fff90 2024-09-11T00:03:45.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.815+0000 7fe938e00700 1 -- 172.21.15.111:0/2758354460 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe93419d0b0 con 0x7fe9340fff90 2024-09-11T00:03:45.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.815+0000 7fe938e00700 1 -- 172.21.15.111:0/2758354460 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe93419d5a0 con 0x7fe9340fff90 2024-09-11T00:03:45.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.816+0000 7fe938e00700 1 -- 172.21.15.111:0/2758354460 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe934105270 con 0x7fe9340fff90 2024-09-11T00:03:45.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.817+0000 7fe92be00700 1 -- 172.21.15.111:0/2758354460 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fe924003680 con 0x7fe9340fff90 2024-09-11T00:03:45.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.818+0000 7fe92be00700 1 --2- 172.21.15.111:0/2758354460 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fe91806c680 0x7fe91806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:45.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.818+0000 7fe92be00700 1 -- 172.21.15.111:0/2758354460 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fe92408c990 con 0x7fe9340fff90 2024-09-11T00:03:45.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.818+0000 7fe932a00700 1 --2- 172.21.15.111:0/2758354460 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fe91806c680 0x7fe91806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:45.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.819+0000 7fe932a00700 1 --2- 172.21.15.111:0/2758354460 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fe91806c680 0x7fe91806eb30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe920009cb0 tx=0x7fe920009260 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:45.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:45.823+0000 7fe92be00700 1 -- 172.21.15.111:0/2758354460 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe92405aec0 con 0x7fe9340fff90 2024-09-11T00:03:46.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:46.058+0000 7fe938e00700 1 -- 172.21.15.111:0/2758354460 --> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe934061190 con 0x7fe91806c680 2024-09-11T00:03:46.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:45 smithi203 ceph-mon[33225]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:46.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:45 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:03:46.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:45 smithi111 ceph-mon[27539]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:46.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:45 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:03:47.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:46 smithi203 ceph-mon[33225]: from='client.14534 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:03:47.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:46 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-11T00:03:47.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:46 smithi111 ceph-mon[27539]: from='client.14534 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:03:47.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:46 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-11T00:03:47.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:47.977+0000 7fe92be00700 1 -- 172.21.15.111:0/2758354460 <== mgr.14211 v2:172.21.15.111:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe934061190 con 0x7fe91806c680 2024-09-11T00:03:47.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:47.979+0000 7fe938e00700 1 -- 172.21.15.111:0/2758354460 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fe91806c680 msgr2=0x7fe91806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:47.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:47.979+0000 7fe938e00700 1 --2- 172.21.15.111:0/2758354460 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fe91806c680 0x7fe91806eb30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe920009cb0 tx=0x7fe920009260 comp rx=0 tx=0).stop 2024-09-11T00:03:47.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:47.979+0000 7fe938e00700 1 -- 172.21.15.111:0/2758354460 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9340fff90 msgr2=0x7fe9341979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:47.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:47.979+0000 7fe938e00700 1 --2- 172.21.15.111:0/2758354460 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9340fff90 0x7fe9341979c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe92400f690 tx=0x7fe92400f770 comp rx=0 tx=0).stop 2024-09-11T00:03:47.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:47.979+0000 7fe938e00700 1 -- 172.21.15.111:0/2758354460 shutdown_connections 2024-09-11T00:03:47.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:47.980+0000 7fe938e00700 1 --2- 172.21.15.111:0/2758354460 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fe91806c680 0x7fe91806eb30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:47.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:47.980+0000 7fe938e00700 1 --2- 172.21.15.111:0/2758354460 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9340fff90 0x7fe9341979c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:47.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:47.980+0000 7fe938e00700 1 --2- 172.21.15.111:0/2758354460 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe934101190 0x7fe934197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:47.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:47.980+0000 7fe938e00700 1 -- 172.21.15.111:0/2758354460 >> 172.21.15.111:0/2758354460 conn(0x7fe9340fb500 msgr2=0x7fe9341023b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:47.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:47.980+0000 7fe938e00700 1 -- 172.21.15.111:0/2758354460 shutdown_connections 2024-09-11T00:03:47.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:47.980+0000 7fe938e00700 1 -- 172.21.15.111:0/2758354460 wait complete. 2024-09-11T00:03:48.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:47 smithi203 ceph-mon[33225]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:48.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:47 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-11T00:03:48.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:47 smithi203 ceph-mon[33225]: osdmap e42: 6 total, 6 up, 6 in 2024-09-11T00:03:48.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:47 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-11T00:03:48.309 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:47 smithi111 ceph-mon[27539]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:48.309 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:47 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-11T00:03:48.309 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:47 smithi111 ceph-mon[27539]: osdmap e42: 6 total, 6 up, 6 in 2024-09-11T00:03:48.309 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:47 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-11T00:03:48.309 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:47 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi111[27535]: 2024-09-11T00:03:47.949+0000 7fbe06800700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T00:03:48.677 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-11T00:03:49.212 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:48 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-11T00:03:49.212 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:48 smithi111 ceph-mon[27539]: osdmap e43: 6 total, 6 up, 6 in 2024-09-11T00:03:49.212 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:48 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-11T00:03:49.212 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:48 smithi111 ceph-mon[27539]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T00:03:49.212 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:48 smithi111 ceph-mon[27539]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-11T00:03:49.212 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:48 smithi111 ceph-mon[27539]: osdmap e44: 6 total, 6 up, 6 in 2024-09-11T00:03:49.213 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:48 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-11T00:03:49.213 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:48 smithi111 ceph-mon[27539]: fsmap cephfs:0 2024-09-11T00:03:49.213 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:48 smithi111 ceph-mon[27539]: Saving service mds.cephfs spec with placement count:4 2024-09-11T00:03:49.213 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:48 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:03:49.213 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:48 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:03:49.213 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:48 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:03:49.213 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:48 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:03:49.213 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:48 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:03:49.213 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:48 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.gmgsay", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T00:03:49.213 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:48 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.gmgsay", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:03:49.213 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:48 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:03:49.213 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:48 smithi111 ceph-mon[27539]: Deploying daemon mds.cephfs.smithi111.gmgsay on smithi111 2024-09-11T00:03:49.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:48 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-11T00:03:49.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:48 smithi203 ceph-mon[33225]: osdmap e43: 6 total, 6 up, 6 in 2024-09-11T00:03:49.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:48 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-11T00:03:49.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:48 smithi203 ceph-mon[33225]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T00:03:49.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:48 smithi203 ceph-mon[33225]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-11T00:03:49.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:48 smithi203 ceph-mon[33225]: osdmap e44: 6 total, 6 up, 6 in 2024-09-11T00:03:49.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:48 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-11T00:03:49.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:48 smithi203 ceph-mon[33225]: fsmap cephfs:0 2024-09-11T00:03:49.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:48 smithi203 ceph-mon[33225]: Saving service mds.cephfs spec with placement count:4 2024-09-11T00:03:49.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:48 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:03:49.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:48 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:03:49.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:48 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:03:49.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:48 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:03:49.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:48 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:03:49.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:48 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.gmgsay", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T00:03:49.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:48 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.gmgsay", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:03:49.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:48 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:03:49.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:48 smithi203 ceph-mon[33225]: Deploying daemon mds.cephfs.smithi111.gmgsay on smithi111 2024-09-11T00:03:49.854 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:03:50.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:49 smithi111 ceph-mon[27539]: pgmap v221: 65 pgs: 17 creating+peering, 1 active+clean, 47 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:50.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:49 smithi111 ceph-mon[27539]: osdmap e45: 6 total, 6 up, 6 in 2024-09-11T00:03:50.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:49 smithi203 ceph-mon[33225]: pgmap v221: 65 pgs: 17 creating+peering, 1 active+clean, 47 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:50.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:49 smithi203 ceph-mon[33225]: osdmap e45: 6 total, 6 up, 6 in 2024-09-11T00:03:51.148 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:50 smithi111 ceph-mon[27539]: osdmap e46: 6 total, 6 up, 6 in 2024-09-11T00:03:51.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:50 smithi203 ceph-mon[33225]: osdmap e46: 6 total, 6 up, 6 in 2024-09-11T00:03:52.104 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:51 smithi111 ceph-mon[27539]: pgmap v224: 65 pgs: 25 active+clean, 17 creating+peering, 23 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:52.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:51 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:03:52.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.162+0000 7f6657200700 1 -- 172.21.15.111:0/2309605661 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66500737b0 msgr2=0x7f6650073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:52.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.162+0000 7f6657200700 1 --2- 172.21.15.111:0/2309605661 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66500737b0 0x7f6650073c20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f663c009940 tx=0x7f663c009c50 comp rx=0 tx=0).stop 2024-09-11T00:03:52.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.162+0000 7f6657200700 1 -- 172.21.15.111:0/2309605661 shutdown_connections 2024-09-11T00:03:52.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.162+0000 7f6657200700 1 --2- 172.21.15.111:0/2309605661 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66500737b0 0x7f6650073c20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:52.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.162+0000 7f6657200700 1 --2- 172.21.15.111:0/2309605661 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6650074d80 0x7f66500731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:52.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.162+0000 7f6657200700 1 -- 172.21.15.111:0/2309605661 >> 172.21.15.111:0/2309605661 conn(0x7f66500fb6e0 msgr2=0x7f66500fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:52.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.162+0000 7f6657200700 1 -- 172.21.15.111:0/2309605661 shutdown_connections 2024-09-11T00:03:52.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.162+0000 7f6657200700 1 -- 172.21.15.111:0/2309605661 wait complete. 2024-09-11T00:03:52.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.164+0000 7f6657200700 1 Processor -- start 2024-09-11T00:03:52.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.164+0000 7f6657200700 1 -- start start 2024-09-11T00:03:52.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.164+0000 7f6657200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66500737b0 0x7f6650197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:52.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.164+0000 7f6657200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6650074d80 0x7f66501980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:52.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.164+0000 7f6657200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66501986c0 con 0x7f66500737b0 2024-09-11T00:03:52.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.164+0000 7f6657200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6650198800 con 0x7f6650074d80 2024-09-11T00:03:52.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.164+0000 7f664fe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66500737b0 0x7f6650197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:52.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.165+0000 7f664f400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6650074d80 0x7f66501980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:52.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.165+0000 7f664fe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66500737b0 0x7f6650197b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42026/0 (socket says 172.21.15.111:42026) 2024-09-11T00:03:52.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.165+0000 7f664fe00700 1 -- 172.21.15.111:0/240876902 learned_addr learned my addr 172.21.15.111:0/240876902 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:03:52.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.165+0000 7f664f400700 1 -- 172.21.15.111:0/240876902 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66500737b0 msgr2=0x7f6650197b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:52.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.165+0000 7f664f400700 1 --2- 172.21.15.111:0/240876902 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66500737b0 0x7f6650197b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:52.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.165+0000 7f664f400700 1 -- 172.21.15.111:0/240876902 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c0095f0 con 0x7f6650074d80 2024-09-11T00:03:52.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.165+0000 7f664fe00700 1 --2- 172.21.15.111:0/240876902 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66500737b0 0x7f6650197b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:03:52.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.165+0000 7f664f400700 1 --2- 172.21.15.111:0/240876902 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6650074d80 0x7f66501980a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f663c006010 tx=0x7f663c00be80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:52.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.165+0000 7f664cc00700 1 -- 172.21.15.111:0/240876902 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f663c01d070 con 0x7f6650074d80 2024-09-11T00:03:52.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.166+0000 7f664cc00700 1 -- 172.21.15.111:0/240876902 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f663c00f460 con 0x7f6650074d80 2024-09-11T00:03:52.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.166+0000 7f6657200700 1 -- 172.21.15.111:0/240876902 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f665019d250 con 0x7f6650074d80 2024-09-11T00:03:52.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.166+0000 7f664cc00700 1 -- 172.21.15.111:0/240876902 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f663c0175d0 con 0x7f6650074d80 2024-09-11T00:03:52.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.166+0000 7f6657200700 1 -- 172.21.15.111:0/240876902 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f665019d6e0 con 0x7f6650074d80 2024-09-11T00:03:52.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.167+0000 7f6657200700 1 -- 172.21.15.111:0/240876902 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f665010ae90 con 0x7f6650074d80 2024-09-11T00:03:52.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.168+0000 7f664cc00700 1 -- 172.21.15.111:0/240876902 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f663c00f5d0 con 0x7f6650074d80 2024-09-11T00:03:52.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.168+0000 7f664cc00700 1 --2- 172.21.15.111:0/240876902 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f663406c680 0x7f663406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:52.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.168+0000 7f664cc00700 1 -- 172.21.15.111:0/240876902 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f663c08ca60 con 0x7f6650074d80 2024-09-11T00:03:52.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.169+0000 7f664fe00700 1 --2- 172.21.15.111:0/240876902 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f663406c680 0x7f663406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:52.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.169+0000 7f664fe00700 1 --2- 172.21.15.111:0/240876902 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f663406c680 0x7f663406eb30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6640011550 tx=0x7f6640009260 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:52.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.174+0000 7f664cc00700 1 -- 172.21.15.111:0/240876902 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f663c05ac00 con 0x7f6650074d80 2024-09-11T00:03:52.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:51 smithi203 ceph-mon[33225]: pgmap v224: 65 pgs: 25 active+clean, 17 creating+peering, 23 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:03:52.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:51 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:03:52.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.415+0000 7f6657200700 1 -- 172.21.15.111:0/240876902 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f665019dd80 con 0x7f6650074d80 2024-09-11T00:03:52.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.416+0000 7f664cc00700 1 -- 172.21.15.111:0/240876902 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 4 v4) v1 ==== 75+0+1266 (secure 0 0 0) 0x7f663c00f880 con 0x7f6650074d80 2024-09-11T00:03:52.417 INFO:teuthology.orchestra.run.smithi111.stdout:e4 2024-09-11T00:03:52.418 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T00:03:52.418 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:03:52.418 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-11T00:03:52.418 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:03:52.418 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-11T00:03:52.418 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-11T00:03:52.418 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 4 2024-09-11T00:03:52.418 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-11T00:03:52.418 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-11T00:03:47.950356+0000 2024-09-11T00:03:52.418 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-11T00:03:51.981640+0000 2024-09-11T00:03:52.418 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-11T00:03:52.419 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-11T00:03:52.419 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-11T00:03:52.419 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-11T00:03:52.419 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-11T00:03:52.419 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-11T00:03:52.419 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-11T00:03:52.419 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 0 2024-09-11T00:03:52.419 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:03:52.419 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-11T00:03:52.419 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-11T00:03:52.420 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=14538} 2024-09-11T00:03:52.420 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-11T00:03:52.420 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-11T00:03:52.420 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-11T00:03:52.420 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-11T00:03:52.420 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-11T00:03:52.420 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data disabled 2024-09-11T00:03:52.420 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-11T00:03:52.420 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-11T00:03:52.420 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 0 2024-09-11T00:03:52.421 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.gmgsay{0:14538} state up:creating seq 1 addr [v2:172.21.15.111:6826/3294522638,v1:172.21.15.111:6827/3294522638] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:03:52.421 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:03:52.421 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:03:52.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.418+0000 7f6657200700 1 -- 172.21.15.111:0/240876902 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f663406c680 msgr2=0x7f663406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:52.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.418+0000 7f6657200700 1 --2- 172.21.15.111:0/240876902 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f663406c680 0x7f663406eb30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6640011550 tx=0x7f6640009260 comp rx=0 tx=0).stop 2024-09-11T00:03:52.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.418+0000 7f6657200700 1 -- 172.21.15.111:0/240876902 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6650074d80 msgr2=0x7f66501980a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:52.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.418+0000 7f6657200700 1 --2- 172.21.15.111:0/240876902 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6650074d80 0x7f66501980a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f663c006010 tx=0x7f663c00be80 comp rx=0 tx=0).stop 2024-09-11T00:03:52.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.418+0000 7f6657200700 1 -- 172.21.15.111:0/240876902 shutdown_connections 2024-09-11T00:03:52.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.418+0000 7f6657200700 1 --2- 172.21.15.111:0/240876902 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f663406c680 0x7f663406eb30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:52.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.418+0000 7f6657200700 1 --2- 172.21.15.111:0/240876902 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66500737b0 0x7f6650197b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:52.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.418+0000 7f6657200700 1 --2- 172.21.15.111:0/240876902 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6650074d80 0x7f66501980a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:52.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.418+0000 7f6657200700 1 -- 172.21.15.111:0/240876902 >> 172.21.15.111:0/240876902 conn(0x7f66500fb6e0 msgr2=0x7f6650105f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:52.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.418+0000 7f6657200700 1 -- 172.21.15.111:0/240876902 shutdown_connections 2024-09-11T00:03:52.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:52.418+0000 7f6657200700 1 -- 172.21.15.111:0/240876902 wait complete. 2024-09-11T00:03:52.422 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 4 2024-09-11T00:03:53.069 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:52 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:03:53.069 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:52 smithi111 ceph-mon[27539]: mds.? [v2:172.21.15.111:6826/3294522638,v1:172.21.15.111:6827/3294522638] up:boot 2024-09-11T00:03:53.069 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:52 smithi111 ceph-mon[27539]: daemon mds.cephfs.smithi111.gmgsay assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-11T00:03:53.070 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:52 smithi111 ceph-mon[27539]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T00:03:53.070 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:52 smithi111 ceph-mon[27539]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-11T00:03:53.070 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:52 smithi111 ceph-mon[27539]: Cluster is now healthy 2024-09-11T00:03:53.070 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:52 smithi111 ceph-mon[27539]: fsmap cephfs:0 1 up:standby 2024-09-11T00:03:53.070 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:52 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.gmgsay"}]: dispatch 2024-09-11T00:03:53.070 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:52 smithi111 ceph-mon[27539]: fsmap cephfs:1 {0=cephfs.smithi111.gmgsay=up:creating} 2024-09-11T00:03:53.070 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:52 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:03:53.070 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:52 smithi111 ceph-mon[27539]: daemon mds.cephfs.smithi111.gmgsay is now active in filesystem cephfs as rank 0 2024-09-11T00:03:53.070 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:52 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.tcrqop", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T00:03:53.070 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:52 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.tcrqop", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:03:53.070 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:52 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:03:53.070 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:52 smithi111 ceph-mon[27539]: Deploying daemon mds.cephfs.smithi203.tcrqop on smithi203 2024-09-11T00:03:53.070 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:52 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/240876902' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-11T00:03:53.245 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-11T00:03:53.286 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi111.front.sepia.ceph.com 2024-09-11T00:03:53.286 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-09-11T00:03:53.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:52 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:03:53.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:52 smithi203 ceph-mon[33225]: mds.? [v2:172.21.15.111:6826/3294522638,v1:172.21.15.111:6827/3294522638] up:boot 2024-09-11T00:03:53.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:52 smithi203 ceph-mon[33225]: daemon mds.cephfs.smithi111.gmgsay assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-11T00:03:53.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:52 smithi203 ceph-mon[33225]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T00:03:53.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:52 smithi203 ceph-mon[33225]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-11T00:03:53.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:52 smithi203 ceph-mon[33225]: Cluster is now healthy 2024-09-11T00:03:53.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:52 smithi203 ceph-mon[33225]: fsmap cephfs:0 1 up:standby 2024-09-11T00:03:53.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:52 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.gmgsay"}]: dispatch 2024-09-11T00:03:53.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:52 smithi203 ceph-mon[33225]: fsmap cephfs:1 {0=cephfs.smithi111.gmgsay=up:creating} 2024-09-11T00:03:53.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:52 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:03:53.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:52 smithi203 ceph-mon[33225]: daemon mds.cephfs.smithi111.gmgsay is now active in filesystem cephfs as rank 0 2024-09-11T00:03:53.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:52 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.tcrqop", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T00:03:53.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:52 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.tcrqop", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:03:53.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:52 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:03:53.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:52 smithi203 ceph-mon[33225]: Deploying daemon mds.cephfs.smithi203.tcrqop on smithi203 2024-09-11T00:03:53.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:52 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/240876902' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-11T00:03:53.624 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:03:54.141 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:54 smithi111 ceph-mon[27539]: pgmap v225: 65 pgs: 40 active+clean, 12 creating+peering, 13 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 3 op/s 2024-09-11T00:03:54.142 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:54 smithi111 ceph-mon[27539]: mds.? [v2:172.21.15.111:6826/3294522638,v1:172.21.15.111:6827/3294522638] up:active 2024-09-11T00:03:54.142 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:54 smithi111 ceph-mon[27539]: fsmap cephfs:1 {0=cephfs.smithi111.gmgsay=up:active} 2024-09-11T00:03:54.244 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:54 smithi203 ceph-mon[33225]: pgmap v225: 65 pgs: 40 active+clean, 12 creating+peering, 13 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 3 op/s 2024-09-11T00:03:54.244 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:54 smithi203 ceph-mon[33225]: mds.? [v2:172.21.15.111:6826/3294522638,v1:172.21.15.111:6827/3294522638] up:active 2024-09-11T00:03:54.245 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:54 smithi203 ceph-mon[33225]: fsmap cephfs:1 {0=cephfs.smithi111.gmgsay=up:active} 2024-09-11T00:03:55.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.593+0000 7f0406600700 1 -- 172.21.15.111:0/331986381 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0400100150 msgr2=0x7f0400100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:55.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.593+0000 7f0406600700 1 --2- 172.21.15.111:0/331986381 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0400100150 0x7f0400100560 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f03f0009910 tx=0x7f03f0009c20 comp rx=0 tx=0).stop 2024-09-11T00:03:55.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.594+0000 7f0406600700 1 -- 172.21.15.111:0/331986381 shutdown_connections 2024-09-11T00:03:55.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.594+0000 7f0406600700 1 --2- 172.21.15.111:0/331986381 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0400101350 0x7f04001017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:55.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.594+0000 7f0406600700 1 --2- 172.21.15.111:0/331986381 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0400100150 0x7f0400100560 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:55.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.594+0000 7f0406600700 1 -- 172.21.15.111:0/331986381 >> 172.21.15.111:0/331986381 conn(0x7f04000fb6e0 msgr2=0x7f04000fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:55.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.594+0000 7f0406600700 1 -- 172.21.15.111:0/331986381 shutdown_connections 2024-09-11T00:03:55.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.594+0000 7f0406600700 1 -- 172.21.15.111:0/331986381 wait complete. 2024-09-11T00:03:55.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.595+0000 7f0406600700 1 Processor -- start 2024-09-11T00:03:55.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.595+0000 7f0406600700 1 -- start start 2024-09-11T00:03:55.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.595+0000 7f0406600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0400100150 0x7f0400197ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:55.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.595+0000 7f0406600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0400101350 0x7f04001980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:55.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.595+0000 7f0406600700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0400198700 con 0x7f0400100150 2024-09-11T00:03:55.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.595+0000 7f0406600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0400198840 con 0x7f0400101350 2024-09-11T00:03:55.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.595+0000 7f03ff400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0400100150 0x7f0400197ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:55.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.595+0000 7f03ff400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0400100150 0x7f0400197ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42050/0 (socket says 172.21.15.111:42050) 2024-09-11T00:03:55.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.595+0000 7f03ff400700 1 -- 172.21.15.111:0/3488077677 learned_addr learned my addr 172.21.15.111:0/3488077677 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:03:55.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.595+0000 7f03fea00700 1 --2- 172.21.15.111:0/3488077677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0400101350 0x7f04001980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:55.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.596+0000 7f03ff400700 1 -- 172.21.15.111:0/3488077677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0400101350 msgr2=0x7f04001980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:55.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.596+0000 7f03ff400700 1 --2- 172.21.15.111:0/3488077677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0400101350 0x7f04001980e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:55.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.596+0000 7f03ff400700 1 -- 172.21.15.111:0/3488077677 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f00095f0 con 0x7f0400100150 2024-09-11T00:03:55.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.596+0000 7f03ff400700 1 --2- 172.21.15.111:0/3488077677 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0400100150 0x7f0400197ba0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f03f000f690 tx=0x7f03f000f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:55.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.596+0000 7f03f7e00700 1 -- 172.21.15.111:0/3488077677 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03f001d070 con 0x7f0400100150 2024-09-11T00:03:55.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.596+0000 7f03f7e00700 1 -- 172.21.15.111:0/3488077677 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f03f0005dc0 con 0x7f0400100150 2024-09-11T00:03:55.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.596+0000 7f0406600700 1 -- 172.21.15.111:0/3488077677 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f040019d290 con 0x7f0400100150 2024-09-11T00:03:55.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.596+0000 7f03f7e00700 1 -- 172.21.15.111:0/3488077677 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03f0017630 con 0x7f0400100150 2024-09-11T00:03:55.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.596+0000 7f0406600700 1 -- 172.21.15.111:0/3488077677 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f040019d780 con 0x7f0400100150 2024-09-11T00:03:55.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.598+0000 7f0406600700 1 -- 172.21.15.111:0/3488077677 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0400105430 con 0x7f0400100150 2024-09-11T00:03:55.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.598+0000 7f03f7e00700 1 -- 172.21.15.111:0/3488077677 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f03f000fb20 con 0x7f0400100150 2024-09-11T00:03:55.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.599+0000 7f03f7e00700 1 --2- 172.21.15.111:0/3488077677 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f03e406c680 0x7f03e406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:03:55.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.599+0000 7f03f7e00700 1 -- 172.21.15.111:0/3488077677 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f03f008ccd0 con 0x7f0400100150 2024-09-11T00:03:55.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.599+0000 7f03fea00700 1 --2- 172.21.15.111:0/3488077677 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f03e406c680 0x7f03e406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:03:55.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.600+0000 7f03fea00700 1 --2- 172.21.15.111:0/3488077677 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f03e406c680 0x7f03e406eb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f03ec009c60 tx=0x7f03ec009260 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:03:55.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.605+0000 7f03f7e00700 1 -- 172.21.15.111:0/3488077677 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f03f005ae70 con 0x7f0400100150 2024-09-11T00:03:55.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:55.901+0000 7f0406600700 1 -- 172.21.15.111:0/3488077677 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f0400061960 con 0x7f0400100150 2024-09-11T00:03:56.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:56.013+0000 7f03f7e00700 1 -- 172.21.15.111:0/3488077677 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f03f005aa00 con 0x7f0400100150 2024-09-11T00:03:56.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:56.015+0000 7f0406600700 1 -- 172.21.15.111:0/3488077677 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f03e406c680 msgr2=0x7f03e406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:56.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:56.015+0000 7f0406600700 1 --2- 172.21.15.111:0/3488077677 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f03e406c680 0x7f03e406eb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f03ec009c60 tx=0x7f03ec009260 comp rx=0 tx=0).stop 2024-09-11T00:03:56.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:56.015+0000 7f0406600700 1 -- 172.21.15.111:0/3488077677 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0400100150 msgr2=0x7f0400197ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:03:56.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:56.015+0000 7f0406600700 1 --2- 172.21.15.111:0/3488077677 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0400100150 0x7f0400197ba0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f03f000f690 tx=0x7f03f000f6c0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:56.015+0000 7f0406600700 1 -- 172.21.15.111:0/3488077677 shutdown_connections 2024-09-11T00:03:56.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:56.015+0000 7f0406600700 1 --2- 172.21.15.111:0/3488077677 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f03e406c680 0x7f03e406eb30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:56.015+0000 7f0406600700 1 --2- 172.21.15.111:0/3488077677 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0400100150 0x7f0400197ba0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:56.015+0000 7f0406600700 1 --2- 172.21.15.111:0/3488077677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0400101350 0x7f04001980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:03:56.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:56.015+0000 7f0406600700 1 -- 172.21.15.111:0/3488077677 >> 172.21.15.111:0/3488077677 conn(0x7f04000fb6e0 msgr2=0x7f0400102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:03:56.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:56.016+0000 7f0406600700 1 -- 172.21.15.111:0/3488077677 shutdown_connections 2024-09-11T00:03:56.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:03:56.016+0000 7f0406600700 1 -- 172.21.15.111:0/3488077677 wait complete. 2024-09-11T00:03:56.425 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:56 smithi111 ceph-mon[27539]: pgmap v226: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 304 B/s wr, 2 op/s 2024-09-11T00:03:56.425 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:56 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:03:56.425 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:56 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:03:56.425 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:56 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:03:56.425 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:56 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.rucaba", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T00:03:56.425 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:56 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.rucaba", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:03:56.425 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:56 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:03:56.425 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:56 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/3488077677' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-11T00:03:56.425 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:56 smithi111 ceph-mon[27539]: mds.? [v2:172.21.15.203:6824/3082736449,v1:172.21.15.203:6825/3082736449] up:boot 2024-09-11T00:03:56.425 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:56 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/3488077677' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-11T00:03:56.426 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:56 smithi111 ceph-mon[27539]: fsmap cephfs:1 {0=cephfs.smithi111.gmgsay=up:active} 1 up:standby 2024-09-11T00:03:56.426 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:56 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.tcrqop"}]: dispatch 2024-09-11T00:03:56.426 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:56 smithi111 ceph-mon[27539]: fsmap cephfs:1 {0=cephfs.smithi111.gmgsay=up:active} 1 up:standby 2024-09-11T00:03:56.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:56 smithi203 ceph-mon[33225]: pgmap v226: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 304 B/s wr, 2 op/s 2024-09-11T00:03:56.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:56 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:03:56.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:56 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:03:56.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:56 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:03:56.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:56 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.rucaba", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T00:03:56.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:56 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.rucaba", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:03:56.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:56 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:03:56.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:56 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/3488077677' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-11T00:03:56.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:56 smithi203 ceph-mon[33225]: mds.? [v2:172.21.15.203:6824/3082736449,v1:172.21.15.203:6825/3082736449] up:boot 2024-09-11T00:03:56.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:56 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/3488077677' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-11T00:03:56.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:56 smithi203 ceph-mon[33225]: fsmap cephfs:1 {0=cephfs.smithi111.gmgsay=up:active} 1 up:standby 2024-09-11T00:03:56.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:56 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.tcrqop"}]: dispatch 2024-09-11T00:03:56.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:56 smithi203 ceph-mon[33225]: fsmap cephfs:1 {0=cephfs.smithi111.gmgsay=up:active} 1 up:standby 2024-09-11T00:03:57.252 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-11T00:03:57.291 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi111.front.sepia.ceph.com 2024-09-11T00:03:57.291 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-09-11T00:03:57.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:57 smithi203 ceph-mon[33225]: Deploying daemon mds.cephfs.smithi111.rucaba on smithi111 2024-09-11T00:03:57.606 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:57 smithi111 ceph-mon[27539]: Deploying daemon mds.cephfs.smithi111.rucaba on smithi111 2024-09-11T00:03:57.868 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:03:58.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:03:58 smithi111 ceph-mon[27539]: pgmap v227: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-11T00:03:58.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:03:58 smithi203 ceph-mon[33225]: pgmap v227: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-11T00:04:00.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.432+0000 7ff1b2800700 1 -- 172.21.15.111:0/1780208701 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1ac0fffb0 msgr2=0x7ff1ac1003c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:00.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.432+0000 7ff1b2800700 1 --2- 172.21.15.111:0/1780208701 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1ac0fffb0 0x7ff1ac1003c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009910 tx=0x7ff1a0009c20 comp rx=0 tx=0).stop 2024-09-11T00:04:00.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.432+0000 7ff1b2800700 1 -- 172.21.15.111:0/1780208701 shutdown_connections 2024-09-11T00:04:00.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.432+0000 7ff1b2800700 1 --2- 172.21.15.111:0/1780208701 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1ac1011b0 0x7ff1ac101600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:00.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.432+0000 7ff1b2800700 1 --2- 172.21.15.111:0/1780208701 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1ac0fffb0 0x7ff1ac1003c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:00.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.432+0000 7ff1b2800700 1 -- 172.21.15.111:0/1780208701 >> 172.21.15.111:0/1780208701 conn(0x7ff1ac0fb540 msgr2=0x7ff1ac0fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:00.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.432+0000 7ff1b2800700 1 -- 172.21.15.111:0/1780208701 shutdown_connections 2024-09-11T00:04:00.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.432+0000 7ff1b2800700 1 -- 172.21.15.111:0/1780208701 wait complete. 2024-09-11T00:04:00.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.433+0000 7ff1b2800700 1 Processor -- start 2024-09-11T00:04:00.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.433+0000 7ff1b2800700 1 -- start start 2024-09-11T00:04:00.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.434+0000 7ff1b2800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1ac0fffb0 0x7ff1ac074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:00.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.434+0000 7ff1b2800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1ac1011b0 0x7ff1ac073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:00.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.434+0000 7ff1b2800700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac073680 con 0x7ff1ac0fffb0 2024-09-11T00:04:00.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.434+0000 7ff1b2800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac0737c0 con 0x7ff1ac1011b0 2024-09-11T00:04:00.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.434+0000 7ff1b1400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1ac0fffb0 0x7ff1ac074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:00.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.434+0000 7ff1b1400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1ac0fffb0 0x7ff1ac074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44774/0 (socket says 172.21.15.111:44774) 2024-09-11T00:04:00.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.434+0000 7ff1b1400700 1 -- 172.21.15.111:0/1727155203 learned_addr learned my addr 172.21.15.111:0/1727155203 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:04:00.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.434+0000 7ff1b0a00700 1 --2- 172.21.15.111:0/1727155203 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1ac1011b0 0x7ff1ac073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:00.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.434+0000 7ff1b1400700 1 -- 172.21.15.111:0/1727155203 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1ac1011b0 msgr2=0x7ff1ac073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:00.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.434+0000 7ff1b1400700 1 --2- 172.21.15.111:0/1727155203 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1ac1011b0 0x7ff1ac073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:00.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.434+0000 7ff1b1400700 1 -- 172.21.15.111:0/1727155203 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a00095f0 con 0x7ff1ac0fffb0 2024-09-11T00:04:00.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.435+0000 7ff1b1400700 1 --2- 172.21.15.111:0/1727155203 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1ac0fffb0 0x7ff1ac074af0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff1a000fa00 tx=0x7ff1a000fa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:00.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.435+0000 7ff1aa000700 1 -- 172.21.15.111:0/1727155203 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1a001d070 con 0x7ff1ac0fffb0 2024-09-11T00:04:00.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.435+0000 7ff1aa000700 1 -- 172.21.15.111:0/1727155203 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff1a000fe90 con 0x7ff1ac0fffb0 2024-09-11T00:04:00.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.435+0000 7ff1aa000700 1 -- 172.21.15.111:0/1727155203 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1a0017630 con 0x7ff1ac0fffb0 2024-09-11T00:04:00.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.435+0000 7ff1b2800700 1 -- 172.21.15.111:0/1727155203 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1ac073a40 con 0x7ff1ac0fffb0 2024-09-11T00:04:00.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.436+0000 7ff1b2800700 1 -- 172.21.15.111:0/1727155203 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1ac073eb0 con 0x7ff1ac0fffb0 2024-09-11T00:04:00.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.437+0000 7ff1b2800700 1 -- 172.21.15.111:0/1727155203 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1ac108b00 con 0x7ff1ac0fffb0 2024-09-11T00:04:00.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.438+0000 7ff1aa000700 1 -- 172.21.15.111:0/1727155203 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7ff1a0003680 con 0x7ff1ac0fffb0 2024-09-11T00:04:00.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.438+0000 7ff1aa000700 1 --2- 172.21.15.111:0/1727155203 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff19406c680 0x7ff19406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:00.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.439+0000 7ff1aa000700 1 -- 172.21.15.111:0/1727155203 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ff1a008cbe0 con 0x7ff1ac0fffb0 2024-09-11T00:04:00.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.439+0000 7ff1b0a00700 1 --2- 172.21.15.111:0/1727155203 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff19406c680 0x7ff19406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:00.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.439+0000 7ff1b0a00700 1 --2- 172.21.15.111:0/1727155203 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff19406c680 0x7ff19406eb30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff198009c60 tx=0x7ff198009260 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:00.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.443+0000 7ff1aa000700 1 -- 172.21.15.111:0/1727155203 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff1a005aeb0 con 0x7ff1ac0fffb0 2024-09-11T00:04:00.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:00 smithi203 ceph-mon[33225]: pgmap v228: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-11T00:04:00.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:00 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:00.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:00 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:00.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:00 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:00.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:00 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.uqkbkn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T00:04:00.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:00 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.uqkbkn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:04:00.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:00 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:04:00.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:00 smithi111 ceph-mon[27539]: pgmap v228: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-11T00:04:00.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:00 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:00.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:00 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:00.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:00 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:00.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:00 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.uqkbkn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T00:04:00.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:00 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.uqkbkn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:04:00.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:00 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:04:00.695 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:00.695+0000 7ff1b2800700 1 -- 172.21.15.111:0/1727155203 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff1ac108cf0 con 0x7ff1ac0fffb0 2024-09-11T00:04:01.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:01.260+0000 7ff1aa000700 1 -- 172.21.15.111:0/1727155203 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff1a0003e60 con 0x7ff1ac0fffb0 2024-09-11T00:04:01.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:01.262+0000 7ff1b2800700 1 -- 172.21.15.111:0/1727155203 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff19406c680 msgr2=0x7ff19406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:01.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:01.262+0000 7ff1b2800700 1 --2- 172.21.15.111:0/1727155203 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff19406c680 0x7ff19406eb30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff198009c60 tx=0x7ff198009260 comp rx=0 tx=0).stop 2024-09-11T00:04:01.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:01.262+0000 7ff1b2800700 1 -- 172.21.15.111:0/1727155203 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1ac0fffb0 msgr2=0x7ff1ac074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:01.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:01.262+0000 7ff1b2800700 1 --2- 172.21.15.111:0/1727155203 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1ac0fffb0 0x7ff1ac074af0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff1a000fa00 tx=0x7ff1a000fa30 comp rx=0 tx=0).stop 2024-09-11T00:04:01.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:01.262+0000 7ff1b2800700 1 -- 172.21.15.111:0/1727155203 shutdown_connections 2024-09-11T00:04:01.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:01.262+0000 7ff1b2800700 1 --2- 172.21.15.111:0/1727155203 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff19406c680 0x7ff19406eb30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:01.262+0000 7ff1b2800700 1 --2- 172.21.15.111:0/1727155203 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1ac0fffb0 0x7ff1ac074af0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:01.262+0000 7ff1b2800700 1 --2- 172.21.15.111:0/1727155203 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1ac1011b0 0x7ff1ac073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:01.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:01.262+0000 7ff1b2800700 1 -- 172.21.15.111:0/1727155203 >> 172.21.15.111:0/1727155203 conn(0x7ff1ac0fb540 msgr2=0x7ff1ac1043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:01.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:01.263+0000 7ff1b2800700 1 -- 172.21.15.111:0/1727155203 shutdown_connections 2024-09-11T00:04:01.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:01.263+0000 7ff1b2800700 1 -- 172.21.15.111:0/1727155203 wait complete. 2024-09-11T00:04:01.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:01 smithi203 ceph-mon[33225]: Deploying daemon mds.cephfs.smithi203.uqkbkn on smithi203 2024-09-11T00:04:01.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:01 smithi203 ceph-mon[33225]: mds.? [v2:172.21.15.111:6828/2045133285,v1:172.21.15.111:6829/2045133285] up:boot 2024-09-11T00:04:01.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:01 smithi203 ceph-mon[33225]: fsmap cephfs:1 {0=cephfs.smithi111.gmgsay=up:active} 2 up:standby 2024-09-11T00:04:01.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:01 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.rucaba"}]: dispatch 2024-09-11T00:04:01.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:01 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:04:01.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:01 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/1727155203' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-11T00:04:01.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:01 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:01.593 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:01 smithi111 ceph-mon[27539]: Deploying daemon mds.cephfs.smithi203.uqkbkn on smithi203 2024-09-11T00:04:01.593 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:01 smithi111 ceph-mon[27539]: mds.? [v2:172.21.15.111:6828/2045133285,v1:172.21.15.111:6829/2045133285] up:boot 2024-09-11T00:04:01.593 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:01 smithi111 ceph-mon[27539]: fsmap cephfs:1 {0=cephfs.smithi111.gmgsay=up:active} 2 up:standby 2024-09-11T00:04:01.593 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:01 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.rucaba"}]: dispatch 2024-09-11T00:04:01.593 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:01 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:04:01.593 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:01 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/1727155203' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-11T00:04:01.593 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:01 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:02.001 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-11T00:04:02.038 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi111.front.sepia.ceph.com 2024-09-11T00:04:02.039 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-09-11T00:04:02.361 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:04:02.510 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:02 smithi111 ceph-mon[27539]: pgmap v229: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-09-11T00:04:02.510 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:02 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/1727155203' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-11T00:04:02.511 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:02 smithi111 ceph-mon[27539]: fsmap cephfs:1 {0=cephfs.smithi111.gmgsay=up:active} 2 up:standby 2024-09-11T00:04:02.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:02 smithi203 ceph-mon[33225]: pgmap v229: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-09-11T00:04:02.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:02 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/1727155203' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-11T00:04:02.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:02 smithi203 ceph-mon[33225]: fsmap cephfs:1 {0=cephfs.smithi111.gmgsay=up:active} 2 up:standby 2024-09-11T00:04:04.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:03 smithi111 ceph-mon[27539]: pgmap v230: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-09-11T00:04:04.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:03 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:04.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:03 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:04.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:03 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:04.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:03 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:04.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:03 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:04.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:03 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:04:04.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:03 smithi111 ceph-mon[27539]: mds.? [v2:172.21.15.203:6826/695613114,v1:172.21.15.203:6827/695613114] up:boot 2024-09-11T00:04:04.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:03 smithi111 ceph-mon[27539]: mds.? [v2:172.21.15.203:6824/3082736449,v1:172.21.15.203:6825/3082736449] up:standby 2024-09-11T00:04:04.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:03 smithi111 ceph-mon[27539]: Dropping low affinity active daemon mds.cephfs.smithi111.gmgsay in favor of higher affinity standby. 2024-09-11T00:04:04.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:03 smithi111 ceph-mon[27539]: Replacing daemon mds.cephfs.smithi111.gmgsay as rank 0 with standby daemon mds.cephfs.smithi203.tcrqop 2024-09-11T00:04:04.106 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:03 smithi111 ceph-mon[27539]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T00:04:04.106 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:03 smithi111 ceph-mon[27539]: fsmap cephfs:1 {0=cephfs.smithi111.gmgsay=up:active} 3 up:standby 2024-09-11T00:04:04.106 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:03 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.uqkbkn"}]: dispatch 2024-09-11T00:04:04.106 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:03 smithi111 ceph-mon[27539]: osdmap e47: 6 total, 6 up, 6 in 2024-09-11T00:04:04.106 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:03 smithi111 ceph-mon[27539]: fsmap cephfs:1/1 {0=cephfs.smithi203.tcrqop=up:replay} 2 up:standby 2024-09-11T00:04:04.169 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:03 smithi203 ceph-mon[33225]: pgmap v230: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-09-11T00:04:04.169 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:03 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:04.169 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:03 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:04.169 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:03 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:04.169 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:03 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:04.169 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:03 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:04.169 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:03 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:04:04.169 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:03 smithi203 ceph-mon[33225]: mds.? [v2:172.21.15.203:6826/695613114,v1:172.21.15.203:6827/695613114] up:boot 2024-09-11T00:04:04.170 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:03 smithi203 ceph-mon[33225]: mds.? [v2:172.21.15.203:6824/3082736449,v1:172.21.15.203:6825/3082736449] up:standby 2024-09-11T00:04:04.170 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:03 smithi203 ceph-mon[33225]: Dropping low affinity active daemon mds.cephfs.smithi111.gmgsay in favor of higher affinity standby. 2024-09-11T00:04:04.170 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:03 smithi203 ceph-mon[33225]: Replacing daemon mds.cephfs.smithi111.gmgsay as rank 0 with standby daemon mds.cephfs.smithi203.tcrqop 2024-09-11T00:04:04.170 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:03 smithi203 ceph-mon[33225]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T00:04:04.170 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:03 smithi203 ceph-mon[33225]: fsmap cephfs:1 {0=cephfs.smithi111.gmgsay=up:active} 3 up:standby 2024-09-11T00:04:04.170 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:03 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.uqkbkn"}]: dispatch 2024-09-11T00:04:04.170 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:03 smithi203 ceph-mon[33225]: osdmap e47: 6 total, 6 up, 6 in 2024-09-11T00:04:04.170 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:03 smithi203 ceph-mon[33225]: fsmap cephfs:1/1 {0=cephfs.smithi203.tcrqop=up:replay} 2 up:standby 2024-09-11T00:04:04.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.248+0000 7f5248200700 1 -- 172.21.15.111:0/1062085701 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5240100150 msgr2=0x7f5240100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:04.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.248+0000 7f5248200700 1 --2- 172.21.15.111:0/1062085701 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5240100150 0x7f5240100560 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f523400b0a0 tx=0x7f523400b3b0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.248+0000 7f5248200700 1 -- 172.21.15.111:0/1062085701 shutdown_connections 2024-09-11T00:04:04.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.248+0000 7f5248200700 1 --2- 172.21.15.111:0/1062085701 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5240101350 0x7f52401017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.248+0000 7f5248200700 1 --2- 172.21.15.111:0/1062085701 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5240100150 0x7f5240100560 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.248+0000 7f5248200700 1 -- 172.21.15.111:0/1062085701 >> 172.21.15.111:0/1062085701 conn(0x7f52400fb6e0 msgr2=0x7f52400fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:04.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.248+0000 7f5248200700 1 -- 172.21.15.111:0/1062085701 shutdown_connections 2024-09-11T00:04:04.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.248+0000 7f5248200700 1 -- 172.21.15.111:0/1062085701 wait complete. 2024-09-11T00:04:04.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.249+0000 7f5248200700 1 Processor -- start 2024-09-11T00:04:04.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.250+0000 7f5248200700 1 -- start start 2024-09-11T00:04:04.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.250+0000 7f5248200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5240100150 0x7f52401959c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:04.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.250+0000 7f5248200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5240101350 0x7f5240195f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:04.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.250+0000 7f5248200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5240196520 con 0x7f5240100150 2024-09-11T00:04:04.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.250+0000 7f5248200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5240196660 con 0x7f5240101350 2024-09-11T00:04:04.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.250+0000 7f5245800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5240100150 0x7f52401959c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:04.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.250+0000 7f5245800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5240100150 0x7f52401959c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44812/0 (socket says 172.21.15.111:44812) 2024-09-11T00:04:04.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.250+0000 7f5245800700 1 -- 172.21.15.111:0/1127034034 learned_addr learned my addr 172.21.15.111:0/1127034034 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:04:04.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.250+0000 7f5244e00700 1 --2- 172.21.15.111:0/1127034034 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5240101350 0x7f5240195f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:04.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.251+0000 7f5245800700 1 -- 172.21.15.111:0/1127034034 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5240101350 msgr2=0x7f5240195f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:04.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.251+0000 7f5245800700 1 --2- 172.21.15.111:0/1127034034 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5240101350 0x7f5240195f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:04.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.251+0000 7f5245800700 1 -- 172.21.15.111:0/1127034034 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5234009d00 con 0x7f5240100150 2024-09-11T00:04:04.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.251+0000 7f5245800700 1 --2- 172.21.15.111:0/1127034034 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5240100150 0x7f52401959c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5234009fd0 tx=0x7f52340096e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:04.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.251+0000 7f523e000700 1 -- 172.21.15.111:0/1127034034 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f523400e040 con 0x7f5240100150 2024-09-11T00:04:04.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.252+0000 7f523e000700 1 -- 172.21.15.111:0/1127034034 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5234003de0 con 0x7f5240100150 2024-09-11T00:04:04.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.252+0000 7f523e000700 1 -- 172.21.15.111:0/1127034034 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f523401d820 con 0x7f5240100150 2024-09-11T00:04:04.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.252+0000 7f5248200700 1 -- 172.21.15.111:0/1127034034 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f524019b0b0 con 0x7f5240100150 2024-09-11T00:04:04.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.252+0000 7f5248200700 1 -- 172.21.15.111:0/1127034034 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f524019b620 con 0x7f5240100150 2024-09-11T00:04:04.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.253+0000 7f5248200700 1 -- 172.21.15.111:0/1127034034 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5240108ca0 con 0x7f5240100150 2024-09-11T00:04:04.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.254+0000 7f523e000700 1 -- 172.21.15.111:0/1127034034 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f52340047f0 con 0x7f5240100150 2024-09-11T00:04:04.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.255+0000 7f523e000700 1 --2- 172.21.15.111:0/1127034034 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f522806c680 0x7f522806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:04.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.255+0000 7f523e000700 1 -- 172.21.15.111:0/1127034034 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f523408dc80 con 0x7f5240100150 2024-09-11T00:04:04.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.255+0000 7f5244e00700 1 --2- 172.21.15.111:0/1127034034 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f522806c680 0x7f522806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:04.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.256+0000 7f5244e00700 1 --2- 172.21.15.111:0/1127034034 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f522806c680 0x7f522806eb30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f522c005950 tx=0x7f522c00b410 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:04.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.259+0000 7f523e000700 1 -- 172.21.15.111:0/1127034034 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f523405bea0 con 0x7f5240100150 2024-09-11T00:04:04.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:04.521+0000 7f5248200700 1 -- 172.21.15.111:0/1127034034 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5240108e90 con 0x7f5240100150 2024-09-11T00:04:05.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:05.278+0000 7f523e000700 1 -- 172.21.15.111:0/1127034034 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v13) v1 ==== 168+0+0 (secure 0 0 0) 0x7f52340170d0 con 0x7f5240100150 2024-09-11T00:04:05.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:05.281+0000 7f5248200700 1 -- 172.21.15.111:0/1127034034 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f522806c680 msgr2=0x7f522806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:05.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:05.281+0000 7f5248200700 1 --2- 172.21.15.111:0/1127034034 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f522806c680 0x7f522806eb30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f522c005950 tx=0x7f522c00b410 comp rx=0 tx=0).stop 2024-09-11T00:04:05.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:05.281+0000 7f5248200700 1 -- 172.21.15.111:0/1127034034 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5240100150 msgr2=0x7f52401959c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:05.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:05.281+0000 7f5248200700 1 --2- 172.21.15.111:0/1127034034 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5240100150 0x7f52401959c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5234009fd0 tx=0x7f52340096e0 comp rx=0 tx=0).stop 2024-09-11T00:04:05.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:05.281+0000 7f5248200700 1 -- 172.21.15.111:0/1127034034 shutdown_connections 2024-09-11T00:04:05.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:05.281+0000 7f5248200700 1 --2- 172.21.15.111:0/1127034034 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f522806c680 0x7f522806eb30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:05.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:05.281+0000 7f5248200700 1 --2- 172.21.15.111:0/1127034034 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5240100150 0x7f52401959c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:05.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:05.281+0000 7f5248200700 1 --2- 172.21.15.111:0/1127034034 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5240101350 0x7f5240195f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:05.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:05.281+0000 7f5248200700 1 -- 172.21.15.111:0/1127034034 >> 172.21.15.111:0/1127034034 conn(0x7f52400fb6e0 msgr2=0x7f5240104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:05.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:05.281+0000 7f5248200700 1 -- 172.21.15.111:0/1127034034 shutdown_connections 2024-09-11T00:04:05.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:05.281+0000 7f5248200700 1 -- 172.21.15.111:0/1127034034 wait complete. 2024-09-11T00:04:05.283 INFO:teuthology.orchestra.run.smithi111.stderr:inline data enabled 2024-09-11T00:04:05.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:05 smithi203 ceph-mon[33225]: mds.? [v2:172.21.15.203:6824/3082736449,v1:172.21.15.203:6825/3082736449] up:reconnect 2024-09-11T00:04:05.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:05 smithi203 ceph-mon[33225]: mds.? [v2:172.21.15.111:6826/1122545830,v1:172.21.15.111:6827/1122545830] up:boot 2024-09-11T00:04:05.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:05 smithi203 ceph-mon[33225]: mds.? [v2:172.21.15.111:6828/2045133285,v1:172.21.15.111:6829/2045133285] up:standby 2024-09-11T00:04:05.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:05 smithi203 ceph-mon[33225]: fsmap cephfs:1/1 {0=cephfs.smithi203.tcrqop=up:reconnect} 3 up:standby 2024-09-11T00:04:05.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:05 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.gmgsay"}]: dispatch 2024-09-11T00:04:05.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:05 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/1127034034' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T00:04:05.621 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:05 smithi111 ceph-mon[27539]: mds.? [v2:172.21.15.203:6824/3082736449,v1:172.21.15.203:6825/3082736449] up:reconnect 2024-09-11T00:04:05.621 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:05 smithi111 ceph-mon[27539]: mds.? [v2:172.21.15.111:6826/1122545830,v1:172.21.15.111:6827/1122545830] up:boot 2024-09-11T00:04:05.621 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:05 smithi111 ceph-mon[27539]: mds.? [v2:172.21.15.111:6828/2045133285,v1:172.21.15.111:6829/2045133285] up:standby 2024-09-11T00:04:05.622 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:05 smithi111 ceph-mon[27539]: fsmap cephfs:1/1 {0=cephfs.smithi203.tcrqop=up:reconnect} 3 up:standby 2024-09-11T00:04:05.622 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:05 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.gmgsay"}]: dispatch 2024-09-11T00:04:05.622 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:05 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/1127034034' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T00:04:06.010 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-11T00:04:06.162 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi111.front.sepia.ceph.com 2024-09-11T00:04:06.162 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-11T00:04:06.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:06 smithi203 ceph-mon[33225]: pgmap v232: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 2 op/s 2024-09-11T00:04:06.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:06 smithi203 ceph-mon[33225]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-11T00:04:06.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:06 smithi203 ceph-mon[33225]: mds.? [v2:172.21.15.203:6824/3082736449,v1:172.21.15.203:6825/3082736449] up:rejoin 2024-09-11T00:04:06.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:06 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/1127034034' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T00:04:06.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:06 smithi203 ceph-mon[33225]: fsmap cephfs:1/1 {0=cephfs.smithi203.tcrqop=up:rejoin} 3 up:standby 2024-09-11T00:04:06.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:06 smithi203 ceph-mon[33225]: daemon mds.cephfs.smithi203.tcrqop is now active in filesystem cephfs as rank 0 2024-09-11T00:04:06.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:06 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:06.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:06 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:06.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:06 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:06.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:06 smithi203 ceph-mon[33225]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T00:04:06.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:06 smithi111 ceph-mon[27539]: pgmap v232: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 2 op/s 2024-09-11T00:04:06.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:06 smithi111 ceph-mon[27539]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-11T00:04:06.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:06 smithi111 ceph-mon[27539]: mds.? [v2:172.21.15.203:6824/3082736449,v1:172.21.15.203:6825/3082736449] up:rejoin 2024-09-11T00:04:06.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:06 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/1127034034' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T00:04:06.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:06 smithi111 ceph-mon[27539]: fsmap cephfs:1/1 {0=cephfs.smithi203.tcrqop=up:rejoin} 3 up:standby 2024-09-11T00:04:06.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:06 smithi111 ceph-mon[27539]: daemon mds.cephfs.smithi203.tcrqop is now active in filesystem cephfs as rank 0 2024-09-11T00:04:06.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:06 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:06.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:06 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:06.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:06 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:06.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:06 smithi111 ceph-mon[27539]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T00:04:06.720 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:04:07.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:07 smithi203 ceph-mon[33225]: mds.? [v2:172.21.15.203:6824/3082736449,v1:172.21.15.203:6825/3082736449] up:active 2024-09-11T00:04:07.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:07 smithi203 ceph-mon[33225]: fsmap cephfs:1 {0=cephfs.smithi203.tcrqop=up:active} 3 up:standby 2024-09-11T00:04:07.606 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:07 smithi111 ceph-mon[27539]: mds.? [v2:172.21.15.203:6824/3082736449,v1:172.21.15.203:6825/3082736449] up:active 2024-09-11T00:04:07.606 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:07 smithi111 ceph-mon[27539]: fsmap cephfs:1 {0=cephfs.smithi203.tcrqop=up:active} 3 up:standby 2024-09-11T00:04:08.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:08 smithi203 ceph-mon[33225]: pgmap v233: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 819 B/s rd, 0 B/s wr, 0 op/s 2024-09-11T00:04:08.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:08 smithi203 ceph-mon[33225]: mds.? [v2:172.21.15.203:6826/695613114,v1:172.21.15.203:6827/695613114] up:standby 2024-09-11T00:04:08.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:08 smithi203 ceph-mon[33225]: fsmap cephfs:1 {0=cephfs.smithi203.tcrqop=up:active} 3 up:standby 2024-09-11T00:04:08.594 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:08 smithi111 ceph-mon[27539]: pgmap v233: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 819 B/s rd, 0 B/s wr, 0 op/s 2024-09-11T00:04:08.594 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:08 smithi111 ceph-mon[27539]: mds.? [v2:172.21.15.203:6826/695613114,v1:172.21.15.203:6827/695613114] up:standby 2024-09-11T00:04:08.594 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:08 smithi111 ceph-mon[27539]: fsmap cephfs:1 {0=cephfs.smithi203.tcrqop=up:active} 3 up:standby 2024-09-11T00:04:09.861 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:09 smithi111 ceph-mon[27539]: pgmap v234: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 4.8 KiB/s rd, 4 op/s 2024-09-11T00:04:09.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.592+0000 7f77f8200700 1 -- 172.21.15.111:0/1669421656 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f77f0101350 msgr2=0x7f77f01017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:09.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.592+0000 7f77f8200700 1 --2- 172.21.15.111:0/1669421656 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f77f0101350 0x7f77f01017a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f77dc009910 tx=0x7f77dc009c20 comp rx=0 tx=0).stop 2024-09-11T00:04:09.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.593+0000 7f77f8200700 1 -- 172.21.15.111:0/1669421656 shutdown_connections 2024-09-11T00:04:09.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.593+0000 7f77f8200700 1 --2- 172.21.15.111:0/1669421656 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f77f0101350 0x7f77f01017a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.593+0000 7f77f8200700 1 --2- 172.21.15.111:0/1669421656 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f77f0100150 0x7f77f0100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.593+0000 7f77f8200700 1 -- 172.21.15.111:0/1669421656 >> 172.21.15.111:0/1669421656 conn(0x7f77f00fb6e0 msgr2=0x7f77f00fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:09.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.593+0000 7f77f8200700 1 -- 172.21.15.111:0/1669421656 shutdown_connections 2024-09-11T00:04:09.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.593+0000 7f77f8200700 1 -- 172.21.15.111:0/1669421656 wait complete. 2024-09-11T00:04:09.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.594+0000 7f77f8200700 1 Processor -- start 2024-09-11T00:04:09.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.594+0000 7f77f8200700 1 -- start start 2024-09-11T00:04:09.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.594+0000 7f77f8200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f77f0100150 0x7f77f0074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:09.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.594+0000 7f77f8200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f77f0101350 0x7f77f0073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:09.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.594+0000 7f77f8200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f0073680 con 0x7f77f0101350 2024-09-11T00:04:09.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.594+0000 7f77f8200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f00737c0 con 0x7f77f0100150 2024-09-11T00:04:09.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.594+0000 7f77f4e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f77f0101350 0x7f77f0073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:09.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.594+0000 7f77f4e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f77f0101350 0x7f77f0073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50894/0 (socket says 172.21.15.111:50894) 2024-09-11T00:04:09.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.594+0000 7f77f4e00700 1 -- 172.21.15.111:0/2087372738 learned_addr learned my addr 172.21.15.111:0/2087372738 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:04:09.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.595+0000 7f77f5800700 1 --2- 172.21.15.111:0/2087372738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f77f0100150 0x7f77f0074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:09.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.595+0000 7f77f4e00700 1 -- 172.21.15.111:0/2087372738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f77f0100150 msgr2=0x7f77f0074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:09.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.595+0000 7f77f4e00700 1 --2- 172.21.15.111:0/2087372738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f77f0100150 0x7f77f0074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.595+0000 7f77f4e00700 1 -- 172.21.15.111:0/2087372738 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77dc0095f0 con 0x7f77f0101350 2024-09-11T00:04:09.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.595+0000 7f77f4e00700 1 --2- 172.21.15.111:0/2087372738 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f77f0101350 0x7f77f0073140 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f77dc005b40 tx=0x7f77dc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:09.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.595+0000 7f77ee000700 1 -- 172.21.15.111:0/2087372738 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77dc01d070 con 0x7f77f0101350 2024-09-11T00:04:09.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.595+0000 7f77ee000700 1 -- 172.21.15.111:0/2087372738 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f77dc00f460 con 0x7f77f0101350 2024-09-11T00:04:09.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.595+0000 7f77ee000700 1 -- 172.21.15.111:0/2087372738 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77dc021640 con 0x7f77f0101350 2024-09-11T00:04:09.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.595+0000 7f77f8200700 1 -- 172.21.15.111:0/2087372738 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f0073a40 con 0x7f77f0101350 2024-09-11T00:04:09.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.596+0000 7f77f8200700 1 -- 172.21.15.111:0/2087372738 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f0073ee0 con 0x7f77f0101350 2024-09-11T00:04:09.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.597+0000 7f77f8200700 1 -- 172.21.15.111:0/2087372738 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f0108ca0 con 0x7f77f0101350 2024-09-11T00:04:09.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.597+0000 7f77ee000700 1 -- 172.21.15.111:0/2087372738 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f77dc00fa90 con 0x7f77f0101350 2024-09-11T00:04:09.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.598+0000 7f77ee000700 1 --2- 172.21.15.111:0/2087372738 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f77d806c680 0x7f77d806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:09.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.598+0000 7f77ee000700 1 -- 172.21.15.111:0/2087372738 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f77dc08cc10 con 0x7f77f0101350 2024-09-11T00:04:09.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.599+0000 7f77f5800700 1 --2- 172.21.15.111:0/2087372738 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f77d806c680 0x7f77d806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:09.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.599+0000 7f77f5800700 1 --2- 172.21.15.111:0/2087372738 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f77d806c680 0x7f77d806eb30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f77e4005950 tx=0x7f77e40058e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:09.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.603+0000 7f77ee000700 1 -- 172.21.15.111:0/2087372738 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f77dc05add0 con 0x7f77f0101350 2024-09-11T00:04:09.870 INFO:teuthology.orchestra.run.smithi111.stdout:e15 2024-09-11T00:04:09.870 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T00:04:09.870 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:04:09.870 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-11T00:04:09.871 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:04:09.871 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-11T00:04:09.871 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-11T00:04:09.871 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 14 2024-09-11T00:04:09.871 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-11T00:04:09.871 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-11T00:03:47.950356+0000 2024-09-11T00:04:09.871 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-11T00:04:06.275905+0000 2024-09-11T00:04:09.871 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-11T00:04:09.871 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-11T00:04:09.871 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-11T00:04:09.871 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-11T00:04:09.871 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-11T00:04:09.871 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-11T00:04:09.871 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-11T00:04:09.871 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 47 2024-09-11T00:04:09.872 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:04:09.872 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-11T00:04:09.872 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-11T00:04:09.872 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=24363} 2024-09-11T00:04:09.872 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-11T00:04:09.872 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-11T00:04:09.872 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-11T00:04:09.872 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-11T00:04:09.872 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-11T00:04:09.872 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data enabled 2024-09-11T00:04:09.872 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-11T00:04:09.872 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-11T00:04:09.872 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 1 2024-09-11T00:04:09.872 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.tcrqop{0:24363} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.203:6824/3082736449,v1:172.21.15.203:6825/3082736449] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:04:09.873 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:04:09.873 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:04:09.873 INFO:teuthology.orchestra.run.smithi111.stdout:Standby daemons: 2024-09-11T00:04:09.873 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:04:09.873 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.rucaba{-1:14554} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6828/2045133285,v1:172.21.15.111:6829/2045133285] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:04:09.873 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.gmgsay{-1:14566} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.111:6826/1122545830,v1:172.21.15.111:6827/1122545830] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:04:09.873 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.uqkbkn{-1:24379} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.203:6826/695613114,v1:172.21.15.203:6827/695613114] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:04:09.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.859+0000 7f77f8200700 1 -- 172.21.15.111:0/2087372738 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f77f019dde0 con 0x7f77f0101350 2024-09-11T00:04:09.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.859+0000 7f77ee000700 1 -- 172.21.15.111:0/2087372738 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1830 (secure 0 0 0) 0x7f77dc026740 con 0x7f77f0101350 2024-09-11T00:04:09.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.862+0000 7f77f8200700 1 -- 172.21.15.111:0/2087372738 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f77d806c680 msgr2=0x7f77d806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:09.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.862+0000 7f77f8200700 1 --2- 172.21.15.111:0/2087372738 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f77d806c680 0x7f77d806eb30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f77e4005950 tx=0x7f77e40058e0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.862+0000 7f77f8200700 1 -- 172.21.15.111:0/2087372738 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f77f0101350 msgr2=0x7f77f0073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:09.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.862+0000 7f77f8200700 1 --2- 172.21.15.111:0/2087372738 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f77f0101350 0x7f77f0073140 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f77dc005b40 tx=0x7f77dc00be20 comp rx=0 tx=0).stop 2024-09-11T00:04:09.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.862+0000 7f77f8200700 1 -- 172.21.15.111:0/2087372738 shutdown_connections 2024-09-11T00:04:09.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.862+0000 7f77f8200700 1 --2- 172.21.15.111:0/2087372738 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f77d806c680 0x7f77d806eb30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.862+0000 7f77f8200700 1 --2- 172.21.15.111:0/2087372738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f77f0100150 0x7f77f0074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.862+0000 7f77f8200700 1 --2- 172.21.15.111:0/2087372738 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f77f0101350 0x7f77f0073140 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:09.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.862+0000 7f77f8200700 1 -- 172.21.15.111:0/2087372738 >> 172.21.15.111:0/2087372738 conn(0x7f77f00fb6e0 msgr2=0x7f77f0104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:09.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.862+0000 7f77f8200700 1 -- 172.21.15.111:0/2087372738 shutdown_connections 2024-09-11T00:04:09.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:09.862+0000 7f77f8200700 1 -- 172.21.15.111:0/2087372738 wait complete. 2024-09-11T00:04:09.874 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 15 2024-09-11T00:04:10.005 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:09 smithi203 ceph-mon[33225]: pgmap v234: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 4.8 KiB/s rd, 4 op/s 2024-09-11T00:04:10.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:10 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/2087372738' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-11T00:04:11.021 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:10 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/2087372738' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-11T00:04:11.028 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-11T00:04:11.535 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:04:11.927 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:11 smithi111 ceph-mon[27539]: pgmap v235: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.6 KiB/s rd, 7 op/s 2024-09-11T00:04:12.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:11 smithi203 ceph-mon[33225]: pgmap v235: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.6 KiB/s rd, 7 op/s 2024-09-11T00:04:13.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.357+0000 7fd44f600700 1 -- 172.21.15.111:0/2334591454 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd448100150 msgr2=0x7fd448100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:13.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.357+0000 7fd44f600700 1 --2- 172.21.15.111:0/2334591454 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd448100150 0x7fd448100560 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd43c009910 tx=0x7fd43c009c20 comp rx=0 tx=0).stop 2024-09-11T00:04:13.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.357+0000 7fd44f600700 1 -- 172.21.15.111:0/2334591454 shutdown_connections 2024-09-11T00:04:13.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.357+0000 7fd44f600700 1 --2- 172.21.15.111:0/2334591454 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd448101350 0x7fd4481017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:13.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.357+0000 7fd44f600700 1 --2- 172.21.15.111:0/2334591454 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd448100150 0x7fd448100560 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:13.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.357+0000 7fd44f600700 1 -- 172.21.15.111:0/2334591454 >> 172.21.15.111:0/2334591454 conn(0x7fd4480fb6e0 msgr2=0x7fd4480fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:13.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.357+0000 7fd44f600700 1 -- 172.21.15.111:0/2334591454 shutdown_connections 2024-09-11T00:04:13.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.357+0000 7fd44f600700 1 -- 172.21.15.111:0/2334591454 wait complete. 2024-09-11T00:04:13.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.358+0000 7fd44f600700 1 Processor -- start 2024-09-11T00:04:13.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.358+0000 7fd44f600700 1 -- start start 2024-09-11T00:04:13.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.358+0000 7fd44f600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd448100150 0x7fd4481959a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:13.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.358+0000 7fd44f600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd448101350 0x7fd448195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:13.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.358+0000 7fd44f600700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd448196500 con 0x7fd448101350 2024-09-11T00:04:13.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.358+0000 7fd44f600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd448196640 con 0x7fd448100150 2024-09-11T00:04:13.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.359+0000 7fd447e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd448101350 0x7fd448195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:13.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.359+0000 7fd447e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd448101350 0x7fd448195ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50910/0 (socket says 172.21.15.111:50910) 2024-09-11T00:04:13.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.359+0000 7fd447e00700 1 -- 172.21.15.111:0/3230253152 learned_addr learned my addr 172.21.15.111:0/3230253152 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:04:13.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.359+0000 7fd447e00700 1 -- 172.21.15.111:0/3230253152 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd448100150 msgr2=0x7fd4481959a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:13.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.359+0000 7fd447e00700 1 --2- 172.21.15.111:0/3230253152 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd448100150 0x7fd4481959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:13.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.359+0000 7fd447e00700 1 -- 172.21.15.111:0/3230253152 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c0095f0 con 0x7fd448101350 2024-09-11T00:04:13.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.359+0000 7fd447e00700 1 --2- 172.21.15.111:0/3230253152 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd448101350 0x7fd448195ee0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd43400d8d0 tx=0x7fd43400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:13.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.360+0000 7fd445600700 1 -- 172.21.15.111:0/3230253152 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd434009940 con 0x7fd448101350 2024-09-11T00:04:13.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.360+0000 7fd44f600700 1 -- 172.21.15.111:0/3230253152 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd44819b0f0 con 0x7fd448101350 2024-09-11T00:04:13.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.360+0000 7fd445600700 1 -- 172.21.15.111:0/3230253152 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd434010460 con 0x7fd448101350 2024-09-11T00:04:13.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.360+0000 7fd44f600700 1 -- 172.21.15.111:0/3230253152 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd44819b640 con 0x7fd448101350 2024-09-11T00:04:13.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.360+0000 7fd445600700 1 -- 172.21.15.111:0/3230253152 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd43401b620 con 0x7fd448101350 2024-09-11T00:04:13.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.361+0000 7fd44f600700 1 -- 172.21.15.111:0/3230253152 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd448108ca0 con 0x7fd448101350 2024-09-11T00:04:13.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.362+0000 7fd445600700 1 -- 172.21.15.111:0/3230253152 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fd4340105d0 con 0x7fd448101350 2024-09-11T00:04:13.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.363+0000 7fd445600700 1 --2- 172.21.15.111:0/3230253152 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd43006c680 0x7fd43006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:13.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.363+0000 7fd445600700 1 -- 172.21.15.111:0/3230253152 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fd43408bbd0 con 0x7fd448101350 2024-09-11T00:04:13.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.363+0000 7fd44cc00700 1 --2- 172.21.15.111:0/3230253152 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd43006c680 0x7fd43006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:13.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.364+0000 7fd44cc00700 1 --2- 172.21.15.111:0/3230253152 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd43006c680 0x7fd43006eb30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00b5c0 tx=0x7fd43c005fd0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:13.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.367+0000 7fd445600700 1 -- 172.21.15.111:0/3230253152 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd434059cf0 con 0x7fd448101350 2024-09-11T00:04:13.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.632+0000 7fd44f600700 1 -- 172.21.15.111:0/3230253152 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd44819bcd0 con 0x7fd448101350 2024-09-11T00:04:13.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.633+0000 7fd445600700 1 -- 172.21.15.111:0/3230253152 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4748 (secure 0 0 0) 0x7fd434020090 con 0x7fd448101350 2024-09-11T00:04:13.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.636+0000 7fd44f600700 1 -- 172.21.15.111:0/3230253152 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd43006c680 msgr2=0x7fd43006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:13.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.636+0000 7fd44f600700 1 --2- 172.21.15.111:0/3230253152 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd43006c680 0x7fd43006eb30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00b5c0 tx=0x7fd43c005fd0 comp rx=0 tx=0).stop 2024-09-11T00:04:13.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.636+0000 7fd44f600700 1 -- 172.21.15.111:0/3230253152 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd448101350 msgr2=0x7fd448195ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:13.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.636+0000 7fd44f600700 1 --2- 172.21.15.111:0/3230253152 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd448101350 0x7fd448195ee0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd43400d8d0 tx=0x7fd43400dc90 comp rx=0 tx=0).stop 2024-09-11T00:04:13.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.636+0000 7fd44f600700 1 -- 172.21.15.111:0/3230253152 shutdown_connections 2024-09-11T00:04:13.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.636+0000 7fd44f600700 1 --2- 172.21.15.111:0/3230253152 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd43006c680 0x7fd43006eb30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:13.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.636+0000 7fd44f600700 1 --2- 172.21.15.111:0/3230253152 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd448100150 0x7fd4481959a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:13.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.636+0000 7fd44f600700 1 --2- 172.21.15.111:0/3230253152 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd448101350 0x7fd448195ee0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:13.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.636+0000 7fd44f600700 1 -- 172.21.15.111:0/3230253152 >> 172.21.15.111:0/3230253152 conn(0x7fd4480fb6e0 msgr2=0x7fd448104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:13.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.636+0000 7fd44f600700 1 -- 172.21.15.111:0/3230253152 shutdown_connections 2024-09-11T00:04:13.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:13.636+0000 7fd44f600700 1 -- 172.21.15.111:0/3230253152 wait complete. 2024-09-11T00:04:13.639 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 15 2024-09-11T00:04:13.652 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:04:13.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:13 smithi111 ceph-mon[27539]: pgmap v236: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 7 op/s 2024-09-11T00:04:13.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:13 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:13.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:13 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:13.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:13 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:04:13.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:13 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:04:13.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:13 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:13.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:13 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:04:13.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:13 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/3230253152' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T00:04:14.212 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:13 smithi203 ceph-mon[33225]: pgmap v236: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 7 op/s 2024-09-11T00:04:14.212 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:13 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:14.212 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:13 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:14.212 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:13 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:04:14.212 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:13 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:04:14.212 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:13 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:14.212 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:13 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:04:14.212 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:13 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/3230253152' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T00:04:15.006 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-11T00:04:15.363 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:04:16.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:15 smithi111 ceph-mon[27539]: pgmap v237: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-11T00:04:16.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:15 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:16.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:15 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:04:16.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:15 smithi203 ceph-mon[33225]: pgmap v237: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-11T00:04:16.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:15 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:16.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:15 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:04:17.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:17 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:17.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:17 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:17.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:17 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:17.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:17 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:18.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:18 smithi111 ceph-mon[27539]: pgmap v238: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-11T00:04:18.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:18 smithi203 ceph-mon[33225]: pgmap v238: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-11T00:04:18.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.314+0000 7f3905c00700 1 -- 172.21.15.111:0/2065983817 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39000fff90 msgr2=0x7f39001003a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:18.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.314+0000 7f3905c00700 1 --2- 172.21.15.111:0/2065983817 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39000fff90 0x7f39001003a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f38f0009910 tx=0x7f38f0009c20 comp rx=0 tx=0).stop 2024-09-11T00:04:18.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.314+0000 7f3905c00700 1 -- 172.21.15.111:0/2065983817 shutdown_connections 2024-09-11T00:04:18.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.314+0000 7f3905c00700 1 --2- 172.21.15.111:0/2065983817 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3900101190 0x7f39001015e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:18.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.314+0000 7f3905c00700 1 --2- 172.21.15.111:0/2065983817 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39000fff90 0x7f39001003a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:18.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.314+0000 7f3905c00700 1 -- 172.21.15.111:0/2065983817 >> 172.21.15.111:0/2065983817 conn(0x7f39000fb500 msgr2=0x7f39000fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:18.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.314+0000 7f3905c00700 1 -- 172.21.15.111:0/2065983817 shutdown_connections 2024-09-11T00:04:18.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.314+0000 7f3905c00700 1 -- 172.21.15.111:0/2065983817 wait complete. 2024-09-11T00:04:18.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.315+0000 7f3905c00700 1 Processor -- start 2024-09-11T00:04:18.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.315+0000 7f3905c00700 1 -- start start 2024-09-11T00:04:18.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.316+0000 7f3905c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39000fff90 0x7f39001979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:18.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.316+0000 7f3905c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3900101190 0x7f3900197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:18.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.316+0000 7f3905c00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3900198520 con 0x7f39000fff90 2024-09-11T00:04:18.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.316+0000 7f3905c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3900198660 con 0x7f3900101190 2024-09-11T00:04:18.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.316+0000 7f38ffe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39000fff90 0x7f39001979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:18.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.316+0000 7f38ffe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39000fff90 0x7f39001979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39168/0 (socket says 172.21.15.111:39168) 2024-09-11T00:04:18.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.316+0000 7f38ffe00700 1 -- 172.21.15.111:0/3064874917 learned_addr learned my addr 172.21.15.111:0/3064874917 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:04:18.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.316+0000 7f38ff400700 1 --2- 172.21.15.111:0/3064874917 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3900101190 0x7f3900197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:18.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.317+0000 7f38ffe00700 1 -- 172.21.15.111:0/3064874917 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3900101190 msgr2=0x7f3900197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:18.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.317+0000 7f38ffe00700 1 --2- 172.21.15.111:0/3064874917 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3900101190 0x7f3900197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:18.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.317+0000 7f38ffe00700 1 -- 172.21.15.111:0/3064874917 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f00095f0 con 0x7f39000fff90 2024-09-11T00:04:18.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.317+0000 7f38ffe00700 1 --2- 172.21.15.111:0/3064874917 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39000fff90 0x7f39001979c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f38f000f690 tx=0x7f38f000f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:18.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.317+0000 7f38fcc00700 1 -- 172.21.15.111:0/3064874917 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38f001d070 con 0x7f39000fff90 2024-09-11T00:04:18.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.317+0000 7f38fcc00700 1 -- 172.21.15.111:0/3064874917 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f38f0005dc0 con 0x7f39000fff90 2024-09-11T00:04:18.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.317+0000 7f3905c00700 1 -- 172.21.15.111:0/3064874917 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390019d0b0 con 0x7f39000fff90 2024-09-11T00:04:18.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.317+0000 7f38fcc00700 1 -- 172.21.15.111:0/3064874917 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38f0017630 con 0x7f39000fff90 2024-09-11T00:04:18.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.317+0000 7f3905c00700 1 -- 172.21.15.111:0/3064874917 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390019d5a0 con 0x7f39000fff90 2024-09-11T00:04:18.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.319+0000 7f3905c00700 1 -- 172.21.15.111:0/3064874917 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3900105270 con 0x7f39000fff90 2024-09-11T00:04:18.321 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.319+0000 7f38fcc00700 1 -- 172.21.15.111:0/3064874917 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f38f000fb20 con 0x7f39000fff90 2024-09-11T00:04:18.322 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.320+0000 7f38fcc00700 1 --2- 172.21.15.111:0/3064874917 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f38e406c680 0x7f38e406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:18.322 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.320+0000 7f38fcc00700 1 -- 172.21.15.111:0/3064874917 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f38f008cc40 con 0x7f39000fff90 2024-09-11T00:04:18.322 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.320+0000 7f38ff400700 1 --2- 172.21.15.111:0/3064874917 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f38e406c680 0x7f38e406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:18.322 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.321+0000 7f38ff400700 1 --2- 172.21.15.111:0/3064874917 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f38e406c680 0x7f38e406eb30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f38ec009c60 tx=0x7f38ec009260 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:18.327 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.325+0000 7f38fcc00700 1 -- 172.21.15.111:0/3064874917 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f38f005ade0 con 0x7f39000fff90 2024-09-11T00:04:18.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.618+0000 7f3905c00700 1 -- 172.21.15.111:0/3064874917 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f390002cc30 con 0x7f39000fff90 2024-09-11T00:04:18.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.619+0000 7f38fcc00700 1 -- 172.21.15.111:0/3064874917 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v15) v1 ==== 78+0+83 (secure 0 0 0) 0x7f38f005a970 con 0x7f39000fff90 2024-09-11T00:04:18.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.621+0000 7f3905c00700 1 -- 172.21.15.111:0/3064874917 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f38e406c680 msgr2=0x7f38e406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:18.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.621+0000 7f3905c00700 1 --2- 172.21.15.111:0/3064874917 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f38e406c680 0x7f38e406eb30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f38ec009c60 tx=0x7f38ec009260 comp rx=0 tx=0).stop 2024-09-11T00:04:18.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.621+0000 7f3905c00700 1 -- 172.21.15.111:0/3064874917 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39000fff90 msgr2=0x7f39001979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:18.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.621+0000 7f3905c00700 1 --2- 172.21.15.111:0/3064874917 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39000fff90 0x7f39001979c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f38f000f690 tx=0x7f38f000f6c0 comp rx=0 tx=0).stop 2024-09-11T00:04:18.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.622+0000 7f3905c00700 1 -- 172.21.15.111:0/3064874917 shutdown_connections 2024-09-11T00:04:18.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.622+0000 7f3905c00700 1 --2- 172.21.15.111:0/3064874917 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f38e406c680 0x7f38e406eb30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:18.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.622+0000 7f3905c00700 1 --2- 172.21.15.111:0/3064874917 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39000fff90 0x7f39001979c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:18.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.622+0000 7f3905c00700 1 --2- 172.21.15.111:0/3064874917 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3900101190 0x7f3900197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:18.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.622+0000 7f3905c00700 1 -- 172.21.15.111:0/3064874917 >> 172.21.15.111:0/3064874917 conn(0x7f39000fb500 msgr2=0x7f39001023b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:18.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.622+0000 7f3905c00700 1 -- 172.21.15.111:0/3064874917 shutdown_connections 2024-09-11T00:04:18.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:18.622+0000 7f3905c00700 1 -- 172.21.15.111:0/3064874917 wait complete. 2024-09-11T00:04:18.638 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:04:19.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:19 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/3064874917' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-11T00:04:19.302 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:19 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/3064874917' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-11T00:04:19.623 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-11T00:04:19.651 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:04:20.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:20 smithi111 ceph-mon[27539]: pgmap v239: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-11T00:04:20.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:20 smithi203 ceph-mon[33225]: pgmap v239: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-11T00:04:20.358 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:04:22.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.157+0000 7f2b5ca00700 1 -- 172.21.15.111:0/2235914035 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b58100210 msgr2=0x7f2b581005e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:22.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.157+0000 7f2b5ca00700 1 --2- 172.21.15.111:0/2235914035 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b58100210 0x7f2b581005e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2b48009910 tx=0x7f2b48009c20 comp rx=0 tx=0).stop 2024-09-11T00:04:22.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.157+0000 7f2b5ca00700 1 -- 172.21.15.111:0/2235914035 shutdown_connections 2024-09-11T00:04:22.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.157+0000 7f2b5ca00700 1 --2- 172.21.15.111:0/2235914035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2b58100bb0 0x7f2b58104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:22.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.157+0000 7f2b5ca00700 1 --2- 172.21.15.111:0/2235914035 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b58100210 0x7f2b581005e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:22.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.157+0000 7f2b5ca00700 1 -- 172.21.15.111:0/2235914035 >> 172.21.15.111:0/2235914035 conn(0x7f2b580fbab0 msgr2=0x7f2b580fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:22.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.157+0000 7f2b5ca00700 1 -- 172.21.15.111:0/2235914035 shutdown_connections 2024-09-11T00:04:22.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.157+0000 7f2b5ca00700 1 -- 172.21.15.111:0/2235914035 wait complete. 2024-09-11T00:04:22.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.158+0000 7f2b5ca00700 1 Processor -- start 2024-09-11T00:04:22.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.158+0000 7f2b5ca00700 1 -- start start 2024-09-11T00:04:22.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.159+0000 7f2b5ca00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b58100210 0x7f2b58197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:22.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.159+0000 7f2b5ca00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2b58100bb0 0x7f2b58198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:22.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.159+0000 7f2b5ca00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b58198a30 con 0x7f2b58100210 2024-09-11T00:04:22.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.159+0000 7f2b5ca00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5819c7c0 con 0x7f2b58100bb0 2024-09-11T00:04:22.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.159+0000 7f2b57400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b58100210 0x7f2b58197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:22.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.159+0000 7f2b57400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b58100210 0x7f2b58197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39178/0 (socket says 172.21.15.111:39178) 2024-09-11T00:04:22.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.159+0000 7f2b57400700 1 -- 172.21.15.111:0/2706943035 learned_addr learned my addr 172.21.15.111:0/2706943035 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:04:22.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.159+0000 7f2b56a00700 1 --2- 172.21.15.111:0/2706943035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2b58100bb0 0x7f2b58198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:22.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.160+0000 7f2b57400700 1 -- 172.21.15.111:0/2706943035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2b58100bb0 msgr2=0x7f2b58198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:22.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.160+0000 7f2b57400700 1 --2- 172.21.15.111:0/2706943035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2b58100bb0 0x7f2b58198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:22.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.160+0000 7f2b57400700 1 -- 172.21.15.111:0/2706943035 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b480095f0 con 0x7f2b58100210 2024-09-11T00:04:22.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.160+0000 7f2b57400700 1 --2- 172.21.15.111:0/2706943035 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b58100210 0x7f2b58197e10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800fa00 tx=0x7f2b4800fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:22.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.160+0000 7f2b4fe00700 1 -- 172.21.15.111:0/2706943035 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b4801d070 con 0x7f2b58100210 2024-09-11T00:04:22.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.160+0000 7f2b4fe00700 1 -- 172.21.15.111:0/2706943035 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2b48005640 con 0x7f2b58100210 2024-09-11T00:04:22.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.160+0000 7f2b5ca00700 1 -- 172.21.15.111:0/2706943035 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b5819ca40 con 0x7f2b58100210 2024-09-11T00:04:22.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.160+0000 7f2b4fe00700 1 -- 172.21.15.111:0/2706943035 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b480226a0 con 0x7f2b58100210 2024-09-11T00:04:22.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.161+0000 7f2b5ca00700 1 -- 172.21.15.111:0/2706943035 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b5819cf30 con 0x7f2b58100210 2024-09-11T00:04:22.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.162+0000 7f2b5ca00700 1 -- 172.21.15.111:0/2706943035 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b58104300 con 0x7f2b58100210 2024-09-11T00:04:22.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.163+0000 7f2b4fe00700 1 -- 172.21.15.111:0/2706943035 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f2b48003680 con 0x7f2b58100210 2024-09-11T00:04:22.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.164+0000 7f2b4fe00700 1 --2- 172.21.15.111:0/2706943035 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f2b3c06c680 0x7f2b3c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:22.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.164+0000 7f2b4fe00700 1 -- 172.21.15.111:0/2706943035 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f2b4808cda0 con 0x7f2b58100210 2024-09-11T00:04:22.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.164+0000 7f2b56a00700 1 --2- 172.21.15.111:0/2706943035 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f2b3c06c680 0x7f2b3c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:22.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.165+0000 7f2b56a00700 1 --2- 172.21.15.111:0/2706943035 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f2b3c06c680 0x7f2b3c06eb30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2b58199430 tx=0x7f2b44009260 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:22.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.169+0000 7f2b4fe00700 1 -- 172.21.15.111:0/2706943035 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2b48057470 con 0x7f2b58100210 2024-09-11T00:04:22.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:22 smithi203 ceph-mon[33225]: pgmap v240: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-11T00:04:22.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:22 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:22.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:22 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:22.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:22 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:04:22.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:22 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:04:22.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:22 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:22.345 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:22 smithi111 ceph-mon[27539]: pgmap v240: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-11T00:04:22.345 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:22 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:22.345 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:22 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:22.345 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:22 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:04:22.345 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:22 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:04:22.345 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:22 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:04:22.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.418+0000 7f2b5ca00700 1 -- 172.21.15.111:0/2706943035 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b5804f2a0 con 0x7f2b58100210 2024-09-11T00:04:22.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.419+0000 7f2b4fe00700 1 -- 172.21.15.111:0/2706943035 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4748 (secure 0 0 0) 0x7f2b4805aa90 con 0x7f2b58100210 2024-09-11T00:04:22.421 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:04:22.421 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14554,"name":"cephfs.smithi111.rucaba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.111:6829/2045133285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":2045133285},{"type":"v1","addr":"172.21.15.111:6829","nonce":2045133285}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":14566,"name":"cephfs.smithi111.gmgsay","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6827/1122545830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":1122545830},{"type":"v1","addr":"172.21.15.111:6827","nonce":1122545830}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24379,"name":"cephfs.smithi203.uqkbkn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.203:6827/695613114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":695613114},{"type":"v1","addr":"172.21.15.203:6827","nonce":695613114}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:03:47.950356+0000","modified":"2024-09-11T00:04:06.275905+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24363":{"gid":24363,"name":"cephfs.smithi203.tcrqop","rank":0,"incarnation":11,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6825/3082736449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3082736449},{"type":"v1","addr":"172.21.15.203:6825","nonce":3082736449}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-11T00:04:22.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.421+0000 7f2b5ca00700 1 -- 172.21.15.111:0/2706943035 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f2b3c06c680 msgr2=0x7f2b3c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:22.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.421+0000 7f2b5ca00700 1 --2- 172.21.15.111:0/2706943035 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f2b3c06c680 0x7f2b3c06eb30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2b58199430 tx=0x7f2b44009260 comp rx=0 tx=0).stop 2024-09-11T00:04:22.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.421+0000 7f2b5ca00700 1 -- 172.21.15.111:0/2706943035 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b58100210 msgr2=0x7f2b58197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:22.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.421+0000 7f2b5ca00700 1 --2- 172.21.15.111:0/2706943035 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b58100210 0x7f2b58197e10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800fa00 tx=0x7f2b4800fae0 comp rx=0 tx=0).stop 2024-09-11T00:04:22.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.422+0000 7f2b5ca00700 1 -- 172.21.15.111:0/2706943035 shutdown_connections 2024-09-11T00:04:22.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.422+0000 7f2b5ca00700 1 --2- 172.21.15.111:0/2706943035 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f2b3c06c680 0x7f2b3c06eb30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:22.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.422+0000 7f2b5ca00700 1 --2- 172.21.15.111:0/2706943035 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b58100210 0x7f2b58197e10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:22.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.422+0000 7f2b5ca00700 1 --2- 172.21.15.111:0/2706943035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2b58100bb0 0x7f2b58198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:22.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.422+0000 7f2b5ca00700 1 -- 172.21.15.111:0/2706943035 >> 172.21.15.111:0/2706943035 conn(0x7f2b580fbab0 msgr2=0x7f2b580fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:22.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.422+0000 7f2b5ca00700 1 -- 172.21.15.111:0/2706943035 shutdown_connections 2024-09-11T00:04:22.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:22.422+0000 7f2b5ca00700 1 -- 172.21.15.111:0/2706943035 wait complete. 2024-09-11T00:04:22.425 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 15 2024-09-11T00:04:23.119 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 14, 'max_mds': 1, 'flags': 18} 2024-09-11T00:04:23.120 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-11T00:04:23.168 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-11T00:04:23.168 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-09-11T00:04:23.169 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-11T00:04:23.169 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T00:04:23.169 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T00:04:23.169 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-11T00:04:23.169 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T00:04:23.170 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T00:04:23.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:04:23.170 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list 2024-09-11T00:04:23.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:04:23.213 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link delete ceph-brx 2024-09-11T00:04:23.305 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:23 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/2706943035' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T00:04:23.319 INFO:teuthology.orchestra.run.smithi203.stderr:Cannot find device "ceph-brx" 2024-09-11T00:04:23.321 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:04:23.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:04:23.322 DEBUG:teuthology.orchestra.run.smithi111:> ip netns list 2024-09-11T00:04:23.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:04:23.360 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip link delete ceph-brx 2024-09-11T00:04:23.405 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:23 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/2706943035' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T00:04:23.463 INFO:teuthology.orchestra.run.smithi111.stderr:Cannot find device "ceph-brx" 2024-09-11T00:04:23.465 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:04:23.466 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-11T00:04:23.466 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-11T00:04:23.466 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-11T00:04:23.788 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:04:24.231 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:24 smithi111 ceph-mon[27539]: pgmap v241: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 0 B/s wr, 0 op/s 2024-09-11T00:04:24.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:24 smithi203 ceph-mon[33225]: pgmap v241: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 0 B/s wr, 0 op/s 2024-09-11T00:04:25.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.700+0000 7ff2fd000700 1 -- 172.21.15.111:0/504009481 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2f8100200 msgr2=0x7ff2f81005d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:25.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.700+0000 7ff2fd000700 1 --2- 172.21.15.111:0/504009481 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2f8100200 0x7ff2f81005d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009910 tx=0x7ff2e8009c20 comp rx=0 tx=0).stop 2024-09-11T00:04:25.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.700+0000 7ff2fd000700 1 -- 172.21.15.111:0/504009481 shutdown_connections 2024-09-11T00:04:25.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.700+0000 7ff2fd000700 1 --2- 172.21.15.111:0/504009481 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2f8100ba0 0x7ff2f8104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:25.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.700+0000 7ff2fd000700 1 --2- 172.21.15.111:0/504009481 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2f8100200 0x7ff2f81005d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:25.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.700+0000 7ff2fd000700 1 -- 172.21.15.111:0/504009481 >> 172.21.15.111:0/504009481 conn(0x7ff2f80fba80 msgr2=0x7ff2f80fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:25.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.700+0000 7ff2fd000700 1 -- 172.21.15.111:0/504009481 shutdown_connections 2024-09-11T00:04:25.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.700+0000 7ff2fd000700 1 -- 172.21.15.111:0/504009481 wait complete. 2024-09-11T00:04:25.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.701+0000 7ff2fd000700 1 Processor -- start 2024-09-11T00:04:25.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.701+0000 7ff2fd000700 1 -- start start 2024-09-11T00:04:25.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.701+0000 7ff2fd000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2f8100200 0x7ff2f8197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:25.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.701+0000 7ff2fd000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2f8100ba0 0x7ff2f8198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:25.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.701+0000 7ff2fd000700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f8198970 con 0x7ff2f8100200 2024-09-11T00:04:25.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.701+0000 7ff2fd000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f8198ab0 con 0x7ff2f8100ba0 2024-09-11T00:04:25.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.702+0000 7ff2f7400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2f8100200 0x7ff2f8197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:25.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.702+0000 7ff2f7400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2f8100200 0x7ff2f8197de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39192/0 (socket says 172.21.15.111:39192) 2024-09-11T00:04:25.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.702+0000 7ff2f7400700 1 -- 172.21.15.111:0/1078745184 learned_addr learned my addr 172.21.15.111:0/1078745184 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:04:25.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.702+0000 7ff2f6a00700 1 --2- 172.21.15.111:0/1078745184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2f8100ba0 0x7ff2f8198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:25.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.702+0000 7ff2f7400700 1 -- 172.21.15.111:0/1078745184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2f8100ba0 msgr2=0x7ff2f8198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:25.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.702+0000 7ff2f7400700 1 --2- 172.21.15.111:0/1078745184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2f8100ba0 0x7ff2f8198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:25.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.702+0000 7ff2f7400700 1 -- 172.21.15.111:0/1078745184 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e80095f0 con 0x7ff2f8100200 2024-09-11T00:04:25.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.702+0000 7ff2f7400700 1 --2- 172.21.15.111:0/1078745184 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2f8100200 0x7ff2f8197de0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8006010 tx=0x7ff2e800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:25.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.702+0000 7ff2efe00700 1 -- 172.21.15.111:0/1078745184 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2e801d070 con 0x7ff2f8100200 2024-09-11T00:04:25.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.703+0000 7ff2efe00700 1 -- 172.21.15.111:0/1078745184 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff2e800f460 con 0x7ff2f8100200 2024-09-11T00:04:25.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.703+0000 7ff2fd000700 1 -- 172.21.15.111:0/1078745184 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f819c8a0 con 0x7ff2f8100200 2024-09-11T00:04:25.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.703+0000 7ff2efe00700 1 -- 172.21.15.111:0/1078745184 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2e8021640 con 0x7ff2f8100200 2024-09-11T00:04:25.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.703+0000 7ff2fd000700 1 -- 172.21.15.111:0/1078745184 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f819cd90 con 0x7ff2f8100200 2024-09-11T00:04:25.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.704+0000 7ff2ed600700 1 -- 172.21.15.111:0/1078745184 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f804f2a0 con 0x7ff2f8100200 2024-09-11T00:04:25.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.705+0000 7ff2efe00700 1 -- 172.21.15.111:0/1078745184 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7ff2e800fab0 con 0x7ff2f8100200 2024-09-11T00:04:25.707 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.705+0000 7ff2efe00700 1 --2- 172.21.15.111:0/1078745184 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff2dc06c680 0x7ff2dc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:25.707 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.705+0000 7ff2efe00700 1 -- 172.21.15.111:0/1078745184 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7ff2e808cc40 con 0x7ff2f8100200 2024-09-11T00:04:25.707 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.706+0000 7ff2f6a00700 1 --2- 172.21.15.111:0/1078745184 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff2dc06c680 0x7ff2dc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:25.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.706+0000 7ff2f6a00700 1 --2- 172.21.15.111:0/1078745184 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff2dc06c680 0x7ff2dc06eb30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4005ea0 tx=0x7ff2e4005e30 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:25.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.710+0000 7ff2efe00700 1 -- 172.21.15.111:0/1078745184 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff2e80572d0 con 0x7ff2f8100200 2024-09-11T00:04:25.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.955+0000 7ff2ed600700 1 -- 172.21.15.111:0/1078745184 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff2f8199140 con 0x7ff2f8100200 2024-09-11T00:04:25.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.955+0000 7ff2efe00700 1 -- 172.21.15.111:0/1078745184 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+83 (secure 0 0 0) 0x7ff2e8026070 con 0x7ff2f8100200 2024-09-11T00:04:25.957 INFO:teuthology.orchestra.run.smithi111.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-11T00:04:25.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.957+0000 7ff2ed600700 1 -- 172.21.15.111:0/1078745184 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff2dc06c680 msgr2=0x7ff2dc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:25.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.957+0000 7ff2ed600700 1 --2- 172.21.15.111:0/1078745184 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff2dc06c680 0x7ff2dc06eb30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4005ea0 tx=0x7ff2e4005e30 comp rx=0 tx=0).stop 2024-09-11T00:04:25.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.957+0000 7ff2ed600700 1 -- 172.21.15.111:0/1078745184 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2f8100200 msgr2=0x7ff2f8197de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:25.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.957+0000 7ff2ed600700 1 --2- 172.21.15.111:0/1078745184 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2f8100200 0x7ff2f8197de0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8006010 tx=0x7ff2e800be20 comp rx=0 tx=0).stop 2024-09-11T00:04:25.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.957+0000 7ff2ed600700 1 -- 172.21.15.111:0/1078745184 shutdown_connections 2024-09-11T00:04:25.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.957+0000 7ff2ed600700 1 --2- 172.21.15.111:0/1078745184 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff2dc06c680 0x7ff2dc06eb30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:25.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.957+0000 7ff2ed600700 1 --2- 172.21.15.111:0/1078745184 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2f8100200 0x7ff2f8197de0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:25.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.957+0000 7ff2ed600700 1 --2- 172.21.15.111:0/1078745184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2f8100ba0 0x7ff2f8198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:25.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.957+0000 7ff2ed600700 1 -- 172.21.15.111:0/1078745184 >> 172.21.15.111:0/1078745184 conn(0x7ff2f80fba80 msgr2=0x7ff2f80fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:25.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.958+0000 7ff2ed600700 1 -- 172.21.15.111:0/1078745184 shutdown_connections 2024-09-11T00:04:25.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:25.958+0000 7ff2ed600700 1 -- 172.21.15.111:0/1078745184 wait complete. 2024-09-11T00:04:26.283 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:26 smithi111 ceph-mon[27539]: pgmap v242: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-11T00:04:26.283 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:26 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/1078745184' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T00:04:26.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:26 smithi203 ceph-mon[33225]: pgmap v242: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-11T00:04:26.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:26 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/1078745184' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T00:04:26.647 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T00:04:26.647 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T00:04:26.647 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi111.front.sepia.ceph.com 2024-09-11T00:04:26.648 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T00:04:26.648 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T00:04:26.648 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T00:04:26.648 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T00:04:26.648 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T00:04:26.648 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T00:04:26.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:04:26.648 DEBUG:teuthology.orchestra.run.smithi111:> ip addr 2024-09-11T00:04:26.685 INFO:teuthology.orchestra.run.smithi111.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T00:04:26.685 INFO:teuthology.orchestra.run.smithi111.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T00:04:26.685 INFO:teuthology.orchestra.run.smithi111.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T00:04:26.686 INFO:teuthology.orchestra.run.smithi111.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:04:26.686 INFO:teuthology.orchestra.run.smithi111.stdout: inet6 ::1/128 scope host 2024-09-11T00:04:26.686 INFO:teuthology.orchestra.run.smithi111.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:04:26.686 INFO:teuthology.orchestra.run.smithi111.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:04:26.686 INFO:teuthology.orchestra.run.smithi111.stdout: link/ether 0c:c4:7a:d8:a1:24 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:04:26.686 INFO:teuthology.orchestra.run.smithi111.stdout: altname enp7s0f0 2024-09-11T00:04:26.686 INFO:teuthology.orchestra.run.smithi111.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:04:26.686 INFO:teuthology.orchestra.run.smithi111.stdout: link/ether 0c:c4:7a:d8:a1:25 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:04:26.686 INFO:teuthology.orchestra.run.smithi111.stdout: altname enp7s0f1 2024-09-11T00:04:26.686 INFO:teuthology.orchestra.run.smithi111.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:04:26.686 INFO:teuthology.orchestra.run.smithi111.stdout: link/ether 0c:c4:7a:8f:cc:2e brd ff:ff:ff:ff:ff:ff 2024-09-11T00:04:26.686 INFO:teuthology.orchestra.run.smithi111.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T00:04:26.686 INFO:teuthology.orchestra.run.smithi111.stdout: link/ether 0c:c4:7a:8f:cc:2f brd ff:ff:ff:ff:ff:ff 2024-09-11T00:04:26.687 INFO:teuthology.orchestra.run.smithi111.stdout: inet 172.21.15.111/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T00:04:26.687 INFO:teuthology.orchestra.run.smithi111.stdout: valid_lft 42178sec preferred_lft 42178sec 2024-09-11T00:04:26.687 INFO:teuthology.orchestra.run.smithi111.stdout: inet6 fe80::ec4:7aff:fe8f:cc2f/64 scope link noprefixroute 2024-09-11T00:04:26.687 INFO:teuthology.orchestra.run.smithi111.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:04:26.687 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T00:04:26.687 DEBUG:teuthology.orchestra.run.smithi111:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:04:26.687 DEBUG:teuthology.orchestra.run.smithi111:> set -e 2024-09-11T00:04:26.688 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip link add name ceph-brx type bridge 2024-09-11T00:04:26.688 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip addr flush dev ceph-brx 2024-09-11T00:04:26.688 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip link set ceph-brx up 2024-09-11T00:04:26.688 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T00:04:26.688 DEBUG:teuthology.orchestra.run.smithi111:> ') 2024-09-11T00:04:26.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:04:27.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:04:27.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:04:27.103 DEBUG:teuthology.orchestra.run.smithi111:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T00:04:27.163 INFO:teuthology.orchestra.run.smithi111.stdout:1 2024-09-11T00:04:27.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:04:27.167 DEBUG:teuthology.orchestra.run.smithi111:> route 2024-09-11T00:04:27.218 INFO:teuthology.orchestra.run.smithi111.stdout:Kernel IP routing table 2024-09-11T00:04:27.218 INFO:teuthology.orchestra.run.smithi111.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T00:04:27.218 INFO:teuthology.orchestra.run.smithi111.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T00:04:27.219 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T00:04:27.219 INFO:teuthology.orchestra.run.smithi111.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T00:04:27.219 DEBUG:teuthology.orchestra.run.smithi111:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:04:27.219 DEBUG:teuthology.orchestra.run.smithi111:> set -e 2024-09-11T00:04:27.219 DEBUG:teuthology.orchestra.run.smithi111:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T00:04:27.219 DEBUG:teuthology.orchestra.run.smithi111:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T00:04:27.219 DEBUG:teuthology.orchestra.run.smithi111:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T00:04:27.220 DEBUG:teuthology.orchestra.run.smithi111:> ') 2024-09-11T00:04:27.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:04:27.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:04:27.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:04:27.808 DEBUG:teuthology.orchestra.run.smithi111:> ip netns list 2024-09-11T00:04:27.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:04:27.844 DEBUG:teuthology.orchestra.run.smithi111:> ip netns list-id 2024-09-11T00:04:27.919 DEBUG:teuthology.orchestra.run.smithi111:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:04:27.919 DEBUG:teuthology.orchestra.run.smithi111:> set -e 2024-09-11T00:04:27.919 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:04:27.920 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-11T00:04:27.920 DEBUG:teuthology.orchestra.run.smithi111:> ') 2024-09-11T00:04:28.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:04:28.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:04:28.101 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-11T00:04:28.102 DEBUG:teuthology.orchestra.run.smithi111:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:04:28.102 DEBUG:teuthology.orchestra.run.smithi111:> set -e 2024-09-11T00:04:28.102 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-11T00:04:28.102 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T00:04:28.102 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-11T00:04:28.102 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-11T00:04:28.102 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-11T00:04:28.102 DEBUG:teuthology.orchestra.run.smithi111:> ') 2024-09-11T00:04:28.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:04:28.303 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:28 smithi111 ceph-mon[27539]: pgmap v243: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:04:28.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:04:28.339 DEBUG:teuthology.orchestra.run.smithi111:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:04:28.339 DEBUG:teuthology.orchestra.run.smithi111:> set -e 2024-09-11T00:04:28.340 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip link set brx.0 up 2024-09-11T00:04:28.340 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T00:04:28.340 DEBUG:teuthology.orchestra.run.smithi111:> ') 2024-09-11T00:04:28.347 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:28 smithi203 ceph-mon[33225]: pgmap v243: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:04:28.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:04:28.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:04:28.507 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-11T00:04:28.507 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:04:28.507 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T00:04:28.625 INFO:teuthology.orchestra.run.smithi111.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T00:04:28.625 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:04:28.625 DEBUG:teuthology.orchestra.run.smithi111:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T00:04:28.661 DEBUG:teuthology.orchestra.run.smithi111:> sudo modprobe fuse 2024-09-11T00:04:28.759 DEBUG:teuthology.orchestra.run.smithi111:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T00:04:28.796 INFO:teuthology.orchestra.run.smithi111.stdout:/proc 2024-09-11T00:04:28.796 INFO:teuthology.orchestra.run.smithi111.stdout:/sys 2024-09-11T00:04:28.796 INFO:teuthology.orchestra.run.smithi111.stdout:/dev 2024-09-11T00:04:28.796 INFO:teuthology.orchestra.run.smithi111.stdout:/sys/kernel/security 2024-09-11T00:04:28.797 INFO:teuthology.orchestra.run.smithi111.stdout:/dev/shm 2024-09-11T00:04:28.797 INFO:teuthology.orchestra.run.smithi111.stdout:/dev/pts 2024-09-11T00:04:28.797 INFO:teuthology.orchestra.run.smithi111.stdout:/run 2024-09-11T00:04:28.797 INFO:teuthology.orchestra.run.smithi111.stdout:/sys/fs/cgroup 2024-09-11T00:04:28.797 INFO:teuthology.orchestra.run.smithi111.stdout:/sys/fs/pstore 2024-09-11T00:04:28.797 INFO:teuthology.orchestra.run.smithi111.stdout:/sys/fs/bpf 2024-09-11T00:04:28.798 INFO:teuthology.orchestra.run.smithi111.stdout:/ 2024-09-11T00:04:28.798 INFO:teuthology.orchestra.run.smithi111.stdout:/sys/fs/selinux 2024-09-11T00:04:28.798 INFO:teuthology.orchestra.run.smithi111.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:04:28.798 INFO:teuthology.orchestra.run.smithi111.stdout:/dev/hugepages 2024-09-11T00:04:28.798 INFO:teuthology.orchestra.run.smithi111.stdout:/dev/mqueue 2024-09-11T00:04:28.798 INFO:teuthology.orchestra.run.smithi111.stdout:/sys/kernel/debug 2024-09-11T00:04:28.798 INFO:teuthology.orchestra.run.smithi111.stdout:/sys/kernel/tracing 2024-09-11T00:04:28.798 INFO:teuthology.orchestra.run.smithi111.stdout:/sys/fs/fuse/connections 2024-09-11T00:04:28.798 INFO:teuthology.orchestra.run.smithi111.stdout:/sys/kernel/config 2024-09-11T00:04:28.799 INFO:teuthology.orchestra.run.smithi111.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T00:04:28.799 INFO:teuthology.orchestra.run.smithi111.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T00:04:28.799 INFO:teuthology.orchestra.run.smithi111.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T00:04:28.799 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T00:04:28.799 INFO:teuthology.orchestra.run.smithi111.stdout:/run/user/1000 2024-09-11T00:04:28.799 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/ceph 2024-09-11T00:04:28.799 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay 2024-09-11T00:04:28.800 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/d26a5414ceb7b7912a61b8b51412644cc880aa538bbba5f63d36cde8ae804fce/merged 2024-09-11T00:04:28.800 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/a488d8186383835e0ea0de7e8327288f293ace81a6f25c3ba0e33d3a180de3d4/merged 2024-09-11T00:04:28.800 INFO:teuthology.orchestra.run.smithi111.stdout:/run/user/0 2024-09-11T00:04:28.800 INFO:teuthology.orchestra.run.smithi111.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:04:28.800 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/52293f8473cc37f452ccc9b13147ac9419a566c9abfb66955a3d9b9a0d55dbdc/merged 2024-09-11T00:04:28.801 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/bcf70d69f3986a96212041fed27db8485470dcde79e7132b629c994e8de90fcb/merged 2024-09-11T00:04:28.801 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/7508b7ed05d6b101e9dd37197679c4cbb613c8f68e99b283f08f9e620854d336/merged 2024-09-11T00:04:28.801 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/ac69e4af428fc394c83d3da490d7c956c0ed5935c2fc8c623b801339025faa23/merged 2024-09-11T00:04:28.801 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/fa13de9e37b513c4fd414d03af8432be32019e0003bae1812a8fea542a518e9e/merged 2024-09-11T00:04:28.801 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/3acd798f5269a3eb8a5a5684dac253c7e2e39c64c6296fc1dfa935acf9ab9001/merged 2024-09-11T00:04:28.802 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/791f0a44a0009f036f6b75836a18ace92c2b55d422cf8b877c26f5a64421234c/merged 2024-09-11T00:04:28.802 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/6a197fd4de1c6af90fa26c7095776cb16ae374be9cdaa7ab4f30ada3ee8c271c/merged 2024-09-11T00:04:28.802 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/20f2a8ae2927a315420ac46c0e2174244b9cb0cd6164f07f6986d3545b62422a/merged 2024-09-11T00:04:28.802 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/9e58fa1e2a8075a9bd07fd158661c0ed8f6b2a9a657ceb320f1cfc07ba330b7d/merged 2024-09-11T00:04:28.802 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/a50d93570c23e5934caf8cc957a39eab8b1da3e90ebc7391d7166e17bca2d397/merged 2024-09-11T00:04:28.802 INFO:teuthology.orchestra.run.smithi111.stdout:/run/netns 2024-09-11T00:04:28.803 INFO:teuthology.orchestra.run.smithi111.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:04:28.803 INFO:teuthology.orchestra.run.smithi111.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:04:28.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:04:28.804 DEBUG:teuthology.orchestra.run.smithi111:> ls /sys/fs/fuse/connections 2024-09-11T00:04:28.880 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T00:04:28.881 DEBUG:teuthology.orchestra.run.smithi111:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-11T00:04:28.925 DEBUG:teuthology.orchestra.run.smithi111:> sudo modprobe fuse 2024-09-11T00:04:28.983 DEBUG:teuthology.orchestra.run.smithi111:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T00:04:29.022 INFO:teuthology.orchestra.run.smithi111.stdout:/proc 2024-09-11T00:04:29.022 INFO:teuthology.orchestra.run.smithi111.stdout:/sys 2024-09-11T00:04:29.022 INFO:teuthology.orchestra.run.smithi111.stdout:/dev 2024-09-11T00:04:29.022 INFO:teuthology.orchestra.run.smithi111.stdout:/sys/kernel/security 2024-09-11T00:04:29.023 INFO:teuthology.orchestra.run.smithi111.stdout:/dev/shm 2024-09-11T00:04:29.023 INFO:teuthology.orchestra.run.smithi111.stdout:/dev/pts 2024-09-11T00:04:29.023 INFO:teuthology.orchestra.run.smithi111.stdout:/run 2024-09-11T00:04:29.023 INFO:teuthology.orchestra.run.smithi111.stdout:/sys/fs/cgroup 2024-09-11T00:04:29.023 INFO:teuthology.orchestra.run.smithi111.stdout:/sys/fs/pstore 2024-09-11T00:04:29.023 INFO:teuthology.orchestra.run.smithi111.stdout:/sys/fs/bpf 2024-09-11T00:04:29.023 INFO:teuthology.orchestra.run.smithi111.stdout:/ 2024-09-11T00:04:29.023 INFO:teuthology.orchestra.run.smithi111.stdout:/sys/fs/selinux 2024-09-11T00:04:29.023 INFO:teuthology.orchestra.run.smithi111.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:04:29.023 INFO:teuthology.orchestra.run.smithi111.stdout:/dev/hugepages 2024-09-11T00:04:29.023 INFO:teuthology.orchestra.run.smithi111.stdout:/dev/mqueue 2024-09-11T00:04:29.023 INFO:teuthology.orchestra.run.smithi111.stdout:/sys/kernel/debug 2024-09-11T00:04:29.023 INFO:teuthology.orchestra.run.smithi111.stdout:/sys/kernel/tracing 2024-09-11T00:04:29.024 INFO:teuthology.orchestra.run.smithi111.stdout:/sys/fs/fuse/connections 2024-09-11T00:04:29.024 INFO:teuthology.orchestra.run.smithi111.stdout:/sys/kernel/config 2024-09-11T00:04:29.024 INFO:teuthology.orchestra.run.smithi111.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T00:04:29.024 INFO:teuthology.orchestra.run.smithi111.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T00:04:29.024 INFO:teuthology.orchestra.run.smithi111.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T00:04:29.024 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T00:04:29.024 INFO:teuthology.orchestra.run.smithi111.stdout:/run/user/1000 2024-09-11T00:04:29.024 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/ceph 2024-09-11T00:04:29.024 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay 2024-09-11T00:04:29.024 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/d26a5414ceb7b7912a61b8b51412644cc880aa538bbba5f63d36cde8ae804fce/merged 2024-09-11T00:04:29.024 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/a488d8186383835e0ea0de7e8327288f293ace81a6f25c3ba0e33d3a180de3d4/merged 2024-09-11T00:04:29.024 INFO:teuthology.orchestra.run.smithi111.stdout:/run/user/0 2024-09-11T00:04:29.024 INFO:teuthology.orchestra.run.smithi111.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:04:29.025 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/52293f8473cc37f452ccc9b13147ac9419a566c9abfb66955a3d9b9a0d55dbdc/merged 2024-09-11T00:04:29.025 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/bcf70d69f3986a96212041fed27db8485470dcde79e7132b629c994e8de90fcb/merged 2024-09-11T00:04:29.025 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/7508b7ed05d6b101e9dd37197679c4cbb613c8f68e99b283f08f9e620854d336/merged 2024-09-11T00:04:29.025 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/ac69e4af428fc394c83d3da490d7c956c0ed5935c2fc8c623b801339025faa23/merged 2024-09-11T00:04:29.025 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/fa13de9e37b513c4fd414d03af8432be32019e0003bae1812a8fea542a518e9e/merged 2024-09-11T00:04:29.025 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/3acd798f5269a3eb8a5a5684dac253c7e2e39c64c6296fc1dfa935acf9ab9001/merged 2024-09-11T00:04:29.025 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/791f0a44a0009f036f6b75836a18ace92c2b55d422cf8b877c26f5a64421234c/merged 2024-09-11T00:04:29.025 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/6a197fd4de1c6af90fa26c7095776cb16ae374be9cdaa7ab4f30ada3ee8c271c/merged 2024-09-11T00:04:29.025 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/20f2a8ae2927a315420ac46c0e2174244b9cb0cd6164f07f6986d3545b62422a/merged 2024-09-11T00:04:29.025 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/9e58fa1e2a8075a9bd07fd158661c0ed8f6b2a9a657ceb320f1cfc07ba330b7d/merged 2024-09-11T00:04:29.025 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/a50d93570c23e5934caf8cc957a39eab8b1da3e90ebc7391d7166e17bca2d397/merged 2024-09-11T00:04:29.025 INFO:teuthology.orchestra.run.smithi111.stdout:/run/netns 2024-09-11T00:04:29.025 INFO:teuthology.orchestra.run.smithi111.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:04:29.025 INFO:teuthology.orchestra.run.smithi111.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:04:29.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:04:29.026 DEBUG:teuthology.orchestra.run.smithi111:> ls /sys/fs/fuse/connections 2024-09-11T00:04:29.106 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi111.stderr:2024-09-11T00:04:29.105+0000 7f7a7ce74480 -1 init, newargv = 0x5578f5263520 newargc=15 2024-09-11T00:04:29.107 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi111.stderr:ceph-fuse[68079]: starting ceph client 2024-09-11T00:04:29.117 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi111.stderr:ceph-fuse[68079]: starting fuse 2024-09-11T00:04:30.203 DEBUG:teuthology.orchestra.run.smithi111:> sudo modprobe fuse 2024-09-11T00:04:30.267 DEBUG:teuthology.orchestra.run.smithi111:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T00:04:30.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:30 smithi203 ceph-mon[33225]: pgmap v244: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:04:30.306 INFO:teuthology.orchestra.run.smithi111.stdout:/proc 2024-09-11T00:04:30.306 INFO:teuthology.orchestra.run.smithi111.stdout:/sys 2024-09-11T00:04:30.306 INFO:teuthology.orchestra.run.smithi111.stdout:/dev 2024-09-11T00:04:30.306 INFO:teuthology.orchestra.run.smithi111.stdout:/sys/kernel/security 2024-09-11T00:04:30.306 INFO:teuthology.orchestra.run.smithi111.stdout:/dev/shm 2024-09-11T00:04:30.307 INFO:teuthology.orchestra.run.smithi111.stdout:/dev/pts 2024-09-11T00:04:30.307 INFO:teuthology.orchestra.run.smithi111.stdout:/run 2024-09-11T00:04:30.307 INFO:teuthology.orchestra.run.smithi111.stdout:/sys/fs/cgroup 2024-09-11T00:04:30.307 INFO:teuthology.orchestra.run.smithi111.stdout:/sys/fs/pstore 2024-09-11T00:04:30.307 INFO:teuthology.orchestra.run.smithi111.stdout:/sys/fs/bpf 2024-09-11T00:04:30.307 INFO:teuthology.orchestra.run.smithi111.stdout:/ 2024-09-11T00:04:30.307 INFO:teuthology.orchestra.run.smithi111.stdout:/sys/fs/selinux 2024-09-11T00:04:30.307 INFO:teuthology.orchestra.run.smithi111.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:04:30.307 INFO:teuthology.orchestra.run.smithi111.stdout:/dev/hugepages 2024-09-11T00:04:30.307 INFO:teuthology.orchestra.run.smithi111.stdout:/dev/mqueue 2024-09-11T00:04:30.307 INFO:teuthology.orchestra.run.smithi111.stdout:/sys/kernel/debug 2024-09-11T00:04:30.307 INFO:teuthology.orchestra.run.smithi111.stdout:/sys/kernel/tracing 2024-09-11T00:04:30.307 INFO:teuthology.orchestra.run.smithi111.stdout:/sys/fs/fuse/connections 2024-09-11T00:04:30.307 INFO:teuthology.orchestra.run.smithi111.stdout:/sys/kernel/config 2024-09-11T00:04:30.308 INFO:teuthology.orchestra.run.smithi111.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T00:04:30.308 INFO:teuthology.orchestra.run.smithi111.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T00:04:30.308 INFO:teuthology.orchestra.run.smithi111.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T00:04:30.308 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T00:04:30.308 INFO:teuthology.orchestra.run.smithi111.stdout:/run/user/1000 2024-09-11T00:04:30.308 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/ceph 2024-09-11T00:04:30.308 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay 2024-09-11T00:04:30.308 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/d26a5414ceb7b7912a61b8b51412644cc880aa538bbba5f63d36cde8ae804fce/merged 2024-09-11T00:04:30.308 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/a488d8186383835e0ea0de7e8327288f293ace81a6f25c3ba0e33d3a180de3d4/merged 2024-09-11T00:04:30.308 INFO:teuthology.orchestra.run.smithi111.stdout:/run/user/0 2024-09-11T00:04:30.308 INFO:teuthology.orchestra.run.smithi111.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:04:30.308 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/52293f8473cc37f452ccc9b13147ac9419a566c9abfb66955a3d9b9a0d55dbdc/merged 2024-09-11T00:04:30.309 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/bcf70d69f3986a96212041fed27db8485470dcde79e7132b629c994e8de90fcb/merged 2024-09-11T00:04:30.309 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/7508b7ed05d6b101e9dd37197679c4cbb613c8f68e99b283f08f9e620854d336/merged 2024-09-11T00:04:30.309 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/ac69e4af428fc394c83d3da490d7c956c0ed5935c2fc8c623b801339025faa23/merged 2024-09-11T00:04:30.309 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/fa13de9e37b513c4fd414d03af8432be32019e0003bae1812a8fea542a518e9e/merged 2024-09-11T00:04:30.309 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/3acd798f5269a3eb8a5a5684dac253c7e2e39c64c6296fc1dfa935acf9ab9001/merged 2024-09-11T00:04:30.309 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/791f0a44a0009f036f6b75836a18ace92c2b55d422cf8b877c26f5a64421234c/merged 2024-09-11T00:04:30.309 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/6a197fd4de1c6af90fa26c7095776cb16ae374be9cdaa7ab4f30ada3ee8c271c/merged 2024-09-11T00:04:30.309 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/20f2a8ae2927a315420ac46c0e2174244b9cb0cd6164f07f6986d3545b62422a/merged 2024-09-11T00:04:30.309 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/9e58fa1e2a8075a9bd07fd158661c0ed8f6b2a9a657ceb320f1cfc07ba330b7d/merged 2024-09-11T00:04:30.309 INFO:teuthology.orchestra.run.smithi111.stdout:/var/lib/containers/storage/overlay/a50d93570c23e5934caf8cc957a39eab8b1da3e90ebc7391d7166e17bca2d397/merged 2024-09-11T00:04:30.309 INFO:teuthology.orchestra.run.smithi111.stdout:/run/netns 2024-09-11T00:04:30.309 INFO:teuthology.orchestra.run.smithi111.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:04:30.309 INFO:teuthology.orchestra.run.smithi111.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:04:30.309 INFO:teuthology.orchestra.run.smithi111.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T00:04:30.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:04:30.310 DEBUG:teuthology.orchestra.run.smithi111:> ls /sys/fs/fuse/connections 2024-09-11T00:04:30.386 INFO:teuthology.orchestra.run.smithi111.stdout:165 2024-09-11T00:04:30.387 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [165] 2024-09-11T00:04:30.387 DEBUG:teuthology.orchestra.run.smithi111:> sudo stdin-killer -- python3 -c ' 2024-09-11T00:04:30.387 DEBUG:teuthology.orchestra.run.smithi111:> import glob 2024-09-11T00:04:30.387 DEBUG:teuthology.orchestra.run.smithi111:> import re 2024-09-11T00:04:30.387 DEBUG:teuthology.orchestra.run.smithi111:> import os 2024-09-11T00:04:30.387 DEBUG:teuthology.orchestra.run.smithi111:> import subprocess 2024-09-11T00:04:30.387 DEBUG:teuthology.orchestra.run.smithi111:> 2024-09-11T00:04:30.387 DEBUG:teuthology.orchestra.run.smithi111:> def _find_admin_socket(client_name): 2024-09-11T00:04:30.387 DEBUG:teuthology.orchestra.run.smithi111:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-11T00:04:30.387 DEBUG:teuthology.orchestra.run.smithi111:> files = glob.glob(asok_path) 2024-09-11T00:04:30.387 DEBUG:teuthology.orchestra.run.smithi111:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-11T00:04:30.388 DEBUG:teuthology.orchestra.run.smithi111:> 2024-09-11T00:04:30.388 DEBUG:teuthology.orchestra.run.smithi111:> # Given a non-glob path, it better be there 2024-09-11T00:04:30.388 DEBUG:teuthology.orchestra.run.smithi111:> if "*" not in asok_path: 2024-09-11T00:04:30.388 DEBUG:teuthology.orchestra.run.smithi111:> assert(len(files) == 1) 2024-09-11T00:04:30.388 DEBUG:teuthology.orchestra.run.smithi111:> return files[0] 2024-09-11T00:04:30.388 DEBUG:teuthology.orchestra.run.smithi111:> 2024-09-11T00:04:30.388 DEBUG:teuthology.orchestra.run.smithi111:> for f in files: 2024-09-11T00:04:30.388 DEBUG:teuthology.orchestra.run.smithi111:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T00:04:30.388 DEBUG:teuthology.orchestra.run.smithi111:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T00:04:30.388 DEBUG:teuthology.orchestra.run.smithi111:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T00:04:30.388 DEBUG:teuthology.orchestra.run.smithi111:> contents = proc_f.read() 2024-09-11T00:04:30.388 DEBUG:teuthology.orchestra.run.smithi111:> if mountpoint in contents: 2024-09-11T00:04:30.388 DEBUG:teuthology.orchestra.run.smithi111:> return f 2024-09-11T00:04:30.388 DEBUG:teuthology.orchestra.run.smithi111:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T00:04:30.388 DEBUG:teuthology.orchestra.run.smithi111:> 2024-09-11T00:04:30.389 DEBUG:teuthology.orchestra.run.smithi111:> print(_find_admin_socket("client.0")) 2024-09-11T00:04:30.389 DEBUG:teuthology.orchestra.run.smithi111:> ' 2024-09-11T00:04:30.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:30 smithi111 ceph-mon[27539]: pgmap v244: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:04:30.524 INFO:teuthology.orchestra.run.smithi111.stdout:/var/run/ceph/ceph-client.0.68079.asok 2024-09-11T00:04:30.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:04:30.539 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.68079.asok 2024-09-11T00:04:30.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:04:30.539 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.68079.asok status 2024-09-11T00:04:30.729 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:04:30.729 INFO:teuthology.orchestra.run.smithi111.stdout: "metadata": { 2024-09-11T00:04:30.729 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph_sha1": "5dd24139a1eada541a3bc16b6941c5dde975e26d", 2024-09-11T00:04:30.729 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-09-11T00:04:30.729 INFO:teuthology.orchestra.run.smithi111.stdout: "entity_id": "0", 2024-09-11T00:04:30.729 INFO:teuthology.orchestra.run.smithi111.stdout: "hostname": "smithi111", 2024-09-11T00:04:30.729 INFO:teuthology.orchestra.run.smithi111.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-11T00:04:30.730 INFO:teuthology.orchestra.run.smithi111.stdout: "pid": "68079", 2024-09-11T00:04:30.730 INFO:teuthology.orchestra.run.smithi111.stdout: "root": "/" 2024-09-11T00:04:30.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:04:30.730 INFO:teuthology.orchestra.run.smithi111.stdout: "dentry_count": 0, 2024-09-11T00:04:30.730 INFO:teuthology.orchestra.run.smithi111.stdout: "dentry_pinned_count": 0, 2024-09-11T00:04:30.730 INFO:teuthology.orchestra.run.smithi111.stdout: "id": 14594, 2024-09-11T00:04:30.730 INFO:teuthology.orchestra.run.smithi111.stdout: "inst": { 2024-09-11T00:04:30.730 INFO:teuthology.orchestra.run.smithi111.stdout: "name": { 2024-09-11T00:04:30.730 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "client", 2024-09-11T00:04:30.730 INFO:teuthology.orchestra.run.smithi111.stdout: "num": 14594 2024-09-11T00:04:30.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:04:30.731 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": { 2024-09-11T00:04:30.731 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-09-11T00:04:30.731 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "192.168.0.1:0", 2024-09-11T00:04:30.731 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 3937520575 2024-09-11T00:04:30.731 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-11T00:04:30.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:04:30.731 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": { 2024-09-11T00:04:30.731 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-09-11T00:04:30.731 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "192.168.0.1:0", 2024-09-11T00:04:30.731 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 3937520575 2024-09-11T00:04:30.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:04:30.731 INFO:teuthology.orchestra.run.smithi111.stdout: "inst_str": "client.14594 192.168.0.1:0/3937520575", 2024-09-11T00:04:30.731 INFO:teuthology.orchestra.run.smithi111.stdout: "addr_str": "192.168.0.1:0/3937520575", 2024-09-11T00:04:30.731 INFO:teuthology.orchestra.run.smithi111.stdout: "inode_count": 1, 2024-09-11T00:04:30.732 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_epoch": 14, 2024-09-11T00:04:30.732 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_epoch": 47, 2024-09-11T00:04:30.732 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_epoch_barrier": 0, 2024-09-11T00:04:30.732 INFO:teuthology.orchestra.run.smithi111.stdout: "blocklisted": false, 2024-09-11T00:04:30.732 INFO:teuthology.orchestra.run.smithi111.stdout: "fs_name": "cephfs" 2024-09-11T00:04:30.732 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:04:30.741 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-11T00:04:30.741 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-11T00:04:31.063 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:04:31.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:31 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:04:31.312 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:31 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:04:32.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:32 smithi111 ceph-mon[27539]: pgmap v245: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-11T00:04:32.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:32 smithi203 ceph-mon[33225]: pgmap v245: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-11T00:04:32.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.866+0000 7fd9bfa00700 1 -- 172.21.15.111:0/3972098858 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd9b81003d0 msgr2=0x7fd9b81007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:32.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.866+0000 7fd9bfa00700 1 --2- 172.21.15.111:0/3972098858 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd9b81003d0 0x7fd9b81007a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac009910 tx=0x7fd9ac009c20 comp rx=0 tx=0).stop 2024-09-11T00:04:32.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.866+0000 7fd9bfa00700 1 -- 172.21.15.111:0/3972098858 shutdown_connections 2024-09-11T00:04:32.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.866+0000 7fd9bfa00700 1 --2- 172.21.15.111:0/3972098858 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd9b8100d70 0x7fd9b8104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:32.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.866+0000 7fd9bfa00700 1 --2- 172.21.15.111:0/3972098858 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd9b81003d0 0x7fd9b81007a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:32.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.866+0000 7fd9bfa00700 1 -- 172.21.15.111:0/3972098858 >> 172.21.15.111:0/3972098858 conn(0x7fd9b80fbc50 msgr2=0x7fd9b80fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:32.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.866+0000 7fd9bfa00700 1 -- 172.21.15.111:0/3972098858 shutdown_connections 2024-09-11T00:04:32.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.866+0000 7fd9bfa00700 1 -- 172.21.15.111:0/3972098858 wait complete. 2024-09-11T00:04:32.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.867+0000 7fd9bfa00700 1 Processor -- start 2024-09-11T00:04:32.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.867+0000 7fd9bfa00700 1 -- start start 2024-09-11T00:04:32.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.867+0000 7fd9bfa00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd9b81003d0 0x7fd9b8197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:32.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.867+0000 7fd9bfa00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd9b8100d70 0x7fd9b81984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:32.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.867+0000 7fd9bfa00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b8198bd0 con 0x7fd9b8100d70 2024-09-11T00:04:32.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.867+0000 7fd9bfa00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b819c960 con 0x7fd9b81003d0 2024-09-11T00:04:32.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.868+0000 7fd9b7e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd9b8100d70 0x7fd9b81984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:32.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.868+0000 7fd9b7e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd9b8100d70 0x7fd9b81984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:54072/0 (socket says 172.21.15.111:54072) 2024-09-11T00:04:32.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.868+0000 7fd9b7e00700 1 -- 172.21.15.111:0/215556425 learned_addr learned my addr 172.21.15.111:0/215556425 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:04:32.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.868+0000 7fd9bd000700 1 --2- 172.21.15.111:0/215556425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd9b81003d0 0x7fd9b8197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:32.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.868+0000 7fd9b7e00700 1 -- 172.21.15.111:0/215556425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd9b81003d0 msgr2=0x7fd9b8197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:32.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.868+0000 7fd9b7e00700 1 --2- 172.21.15.111:0/215556425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd9b81003d0 0x7fd9b8197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:32.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.868+0000 7fd9b7e00700 1 -- 172.21.15.111:0/215556425 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ac0095f0 con 0x7fd9b8100d70 2024-09-11T00:04:32.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.868+0000 7fd9b7e00700 1 --2- 172.21.15.111:0/215556425 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd9b8100d70 0x7fd9b81984f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd9a400d900 tx=0x7fd9a400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:32.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.869+0000 7fd9b5600700 1 -- 172.21.15.111:0/215556425 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9a4009900 con 0x7fd9b8100d70 2024-09-11T00:04:32.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.869+0000 7fd9bfa00700 1 -- 172.21.15.111:0/215556425 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b819cc40 con 0x7fd9b8100d70 2024-09-11T00:04:32.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.869+0000 7fd9b5600700 1 -- 172.21.15.111:0/215556425 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd9a4010460 con 0x7fd9b8100d70 2024-09-11T00:04:32.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.869+0000 7fd9b5600700 1 -- 172.21.15.111:0/215556425 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9a400f5f0 con 0x7fd9b8100d70 2024-09-11T00:04:32.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.869+0000 7fd9bfa00700 1 -- 172.21.15.111:0/215556425 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b819d190 con 0x7fd9b8100d70 2024-09-11T00:04:32.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.870+0000 7fd9bfa00700 1 -- 172.21.15.111:0/215556425 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b81044c0 con 0x7fd9b8100d70 2024-09-11T00:04:32.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.871+0000 7fd9b5600700 1 -- 172.21.15.111:0/215556425 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fd9a40105d0 con 0x7fd9b8100d70 2024-09-11T00:04:32.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.872+0000 7fd9b5600700 1 --2- 172.21.15.111:0/215556425 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd9a006c6d0 0x7fd9a006eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:32.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.872+0000 7fd9b5600700 1 -- 172.21.15.111:0/215556425 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fd9a408b470 con 0x7fd9b8100d70 2024-09-11T00:04:32.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.872+0000 7fd9bd000700 1 --2- 172.21.15.111:0/215556425 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd9a006c6d0 0x7fd9a006eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:32.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.873+0000 7fd9bd000700 1 --2- 172.21.15.111:0/215556425 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd9a006c6d0 0x7fd9a006eb80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac006010 tx=0x7fd9ac01a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:32.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:32.876+0000 7fd9b5600700 1 -- 172.21.15.111:0/215556425 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd9a4055b00 con 0x7fd9b8100d70 2024-09-11T00:04:33.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:33.130+0000 7fd9bfa00700 1 -- 172.21.15.111:0/215556425 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd9b804ea50 con 0x7fd9b8100d70 2024-09-11T00:04:33.132 INFO:teuthology.orchestra.run.smithi111.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-11T00:04:33.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:33.130+0000 7fd9b5600700 1 -- 172.21.15.111:0/215556425 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+83 (secure 0 0 0) 0x7fd9a4059120 con 0x7fd9b8100d70 2024-09-11T00:04:33.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:33.133+0000 7fd9bfa00700 1 -- 172.21.15.111:0/215556425 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd9a006c6d0 msgr2=0x7fd9a006eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:33.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:33.133+0000 7fd9bfa00700 1 --2- 172.21.15.111:0/215556425 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd9a006c6d0 0x7fd9a006eb80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac006010 tx=0x7fd9ac01a040 comp rx=0 tx=0).stop 2024-09-11T00:04:33.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:33.133+0000 7fd9bfa00700 1 -- 172.21.15.111:0/215556425 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd9b8100d70 msgr2=0x7fd9b81984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:33.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:33.133+0000 7fd9bfa00700 1 --2- 172.21.15.111:0/215556425 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd9b8100d70 0x7fd9b81984f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd9a400d900 tx=0x7fd9a400dc10 comp rx=0 tx=0).stop 2024-09-11T00:04:33.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:33.133+0000 7fd9bfa00700 1 -- 172.21.15.111:0/215556425 shutdown_connections 2024-09-11T00:04:33.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:33.133+0000 7fd9bfa00700 1 --2- 172.21.15.111:0/215556425 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd9a006c6d0 0x7fd9a006eb80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:33.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:33.133+0000 7fd9bfa00700 1 --2- 172.21.15.111:0/215556425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd9b81003d0 0x7fd9b8197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:33.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:33.133+0000 7fd9bfa00700 1 --2- 172.21.15.111:0/215556425 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd9b8100d70 0x7fd9b81984f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:33.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:33.133+0000 7fd9bfa00700 1 -- 172.21.15.111:0/215556425 >> 172.21.15.111:0/215556425 conn(0x7fd9b80fbc50 msgr2=0x7fd9b80fd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:33.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:33.133+0000 7fd9bfa00700 1 -- 172.21.15.111:0/215556425 shutdown_connections 2024-09-11T00:04:33.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:33.133+0000 7fd9bfa00700 1 -- 172.21.15.111:0/215556425 wait complete. 2024-09-11T00:04:33.891 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T00:04:33.891 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T00:04:33.891 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi203.front.sepia.ceph.com 2024-09-11T00:04:33.891 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-11T00:04:33.891 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T00:04:33.891 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T00:04:33.892 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T00:04:33.892 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T00:04:33.892 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T00:04:33.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:04:33.892 DEBUG:teuthology.orchestra.run.smithi203:> ip addr 2024-09-11T00:04:33.935 INFO:teuthology.orchestra.run.smithi203.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T00:04:33.935 INFO:teuthology.orchestra.run.smithi203.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T00:04:33.935 INFO:teuthology.orchestra.run.smithi203.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T00:04:33.935 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:04:33.935 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 ::1/128 scope host 2024-09-11T00:04:33.935 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:04:33.935 INFO:teuthology.orchestra.run.smithi203.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:04:33.935 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:d9:19:44 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:04:33.935 INFO:teuthology.orchestra.run.smithi203.stdout: altname enp7s0f0 2024-09-11T00:04:33.936 INFO:teuthology.orchestra.run.smithi203.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:04:33.936 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:d9:19:45 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:04:33.936 INFO:teuthology.orchestra.run.smithi203.stdout: altname enp7s0f1 2024-09-11T00:04:33.936 INFO:teuthology.orchestra.run.smithi203.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:04:33.936 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:8f:4a:22 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:04:33.936 INFO:teuthology.orchestra.run.smithi203.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T00:04:33.936 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:8f:4a:23 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:04:33.936 INFO:teuthology.orchestra.run.smithi203.stdout: inet 172.21.15.203/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T00:04:33.936 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft 42158sec preferred_lft 42158sec 2024-09-11T00:04:33.936 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::ec4:7aff:fe8f:4a23/64 scope link noprefixroute 2024-09-11T00:04:33.936 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:04:33.937 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T00:04:33.937 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:04:33.937 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-09-11T00:04:33.937 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link add name ceph-brx type bridge 2024-09-11T00:04:33.937 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip addr flush dev ceph-brx 2024-09-11T00:04:33.937 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link set ceph-brx up 2024-09-11T00:04:33.937 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T00:04:33.937 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-09-11T00:04:34.058 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:04:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:04:34.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:34 smithi111 ceph-mon[27539]: pgmap v246: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-11T00:04:34.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:34 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/215556425' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T00:04:34.318 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:34 smithi203 ceph-mon[33225]: pgmap v246: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-11T00:04:34.318 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:34 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/215556425' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T00:04:34.349 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:04:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:04:34.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:04:34.357 DEBUG:teuthology.orchestra.run.smithi203:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T00:04:34.415 INFO:teuthology.orchestra.run.smithi203.stdout:1 2024-09-11T00:04:34.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:04:34.419 DEBUG:teuthology.orchestra.run.smithi203:> route 2024-09-11T00:04:34.467 INFO:teuthology.orchestra.run.smithi203.stdout:Kernel IP routing table 2024-09-11T00:04:34.468 INFO:teuthology.orchestra.run.smithi203.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T00:04:34.468 INFO:teuthology.orchestra.run.smithi203.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T00:04:34.468 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T00:04:34.468 INFO:teuthology.orchestra.run.smithi203.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T00:04:34.468 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:04:34.468 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-09-11T00:04:34.468 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T00:04:34.468 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T00:04:34.468 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T00:04:34.469 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-09-11T00:04:34.546 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:04:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:04:35.093 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:04:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:04:35.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:04:35.101 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list 2024-09-11T00:04:35.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:04:35.138 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list-id 2024-09-11T00:04:35.214 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:04:35.214 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-09-11T00:04:35.214 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T00:04:35.214 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-11T00:04:35.214 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-09-11T00:04:35.331 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:04:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:04:35.383 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:04:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:04:35.392 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-11T00:04:35.392 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:04:35.392 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-09-11T00:04:35.392 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-11T00:04:35.392 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T00:04:35.392 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-11T00:04:35.392 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-11T00:04:35.392 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-11T00:04:35.392 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-09-11T00:04:35.470 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:04:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:04:35.623 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:04:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:04:35.631 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:04:35.631 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-09-11T00:04:35.631 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link set brx.0 up 2024-09-11T00:04:35.631 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T00:04:35.631 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-09-11T00:04:35.709 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:04:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:04:35.789 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:04:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:04:35.798 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-11T00:04:35.798 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:04:35.798 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-11T00:04:35.834 INFO:teuthology.orchestra.run.smithi203.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-11T00:04:35.834 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:04:35.834 DEBUG:teuthology.orchestra.run.smithi203:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-11T00:04:35.909 DEBUG:teuthology.orchestra.run.smithi203:> sudo modprobe fuse 2024-09-11T00:04:36.008 DEBUG:teuthology.orchestra.run.smithi203:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T00:04:36.045 INFO:teuthology.orchestra.run.smithi203.stdout:/proc 2024-09-11T00:04:36.045 INFO:teuthology.orchestra.run.smithi203.stdout:/sys 2024-09-11T00:04:36.045 INFO:teuthology.orchestra.run.smithi203.stdout:/dev 2024-09-11T00:04:36.046 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/security 2024-09-11T00:04:36.046 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/shm 2024-09-11T00:04:36.046 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/pts 2024-09-11T00:04:36.046 INFO:teuthology.orchestra.run.smithi203.stdout:/run 2024-09-11T00:04:36.046 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/cgroup 2024-09-11T00:04:36.046 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/pstore 2024-09-11T00:04:36.046 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/bpf 2024-09-11T00:04:36.046 INFO:teuthology.orchestra.run.smithi203.stdout:/ 2024-09-11T00:04:36.046 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/selinux 2024-09-11T00:04:36.046 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:04:36.046 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/hugepages 2024-09-11T00:04:36.046 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/mqueue 2024-09-11T00:04:36.046 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/debug 2024-09-11T00:04:36.046 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/tracing 2024-09-11T00:04:36.047 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/fuse/connections 2024-09-11T00:04:36.047 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/config 2024-09-11T00:04:36.047 INFO:teuthology.orchestra.run.smithi203.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T00:04:36.047 INFO:teuthology.orchestra.run.smithi203.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T00:04:36.047 INFO:teuthology.orchestra.run.smithi203.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T00:04:36.047 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T00:04:36.047 INFO:teuthology.orchestra.run.smithi203.stdout:/run/user/1000 2024-09-11T00:04:36.047 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph 2024-09-11T00:04:36.047 INFO:teuthology.orchestra.run.smithi203.stdout:/run/user/0 2024-09-11T00:04:36.047 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:04:36.047 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay 2024-09-11T00:04:36.047 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/63443266f9614fa8059779e753aa5f06fba9793f397bf06cccf72343faf3d890/merged 2024-09-11T00:04:36.047 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/b8d601e117ad24386d5cfea9213a0f64eb682e088e84fd61f28aa67091e8295c/merged 2024-09-11T00:04:36.047 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/fae36ecb4df55bdfe216c3d0127728089258297a33efac47c04f50a7bb3d6c74/merged 2024-09-11T00:04:36.048 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/e76e3cb917b2a559487da264cab8de5c8d19df960c44f76e287d188412e18e2d/merged 2024-09-11T00:04:36.048 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/d10fed2396a5eecc6bb8a9f89dd11adea570b9d3a60944956a3ddaf55d7e593a/merged 2024-09-11T00:04:36.048 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/70697a550a4272ba3813805f9a02799d92e736cf25934333a958bac13a839431/merged 2024-09-11T00:04:36.048 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/545cdb1b3beafffe5ef4de8e5edc1eceb127d8e9c5f844daea849ea095a0b6d2/merged 2024-09-11T00:04:36.048 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/7ec16964a7e7198f08b995886f373747db092703693e56c6b2bce56b3bd6b3d5/merged 2024-09-11T00:04:36.048 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/a42d421a0b8bc5597604446bd7ad8f592cebb67c2250d3cb1bd07cc8c45db567/merged 2024-09-11T00:04:36.048 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/2c18f71fa329c00970bf4f027dc64759929409ab6be98717189c505e4400e589/merged 2024-09-11T00:04:36.048 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns 2024-09-11T00:04:36.048 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T00:04:36.048 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T00:04:36.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:04:36.049 DEBUG:teuthology.orchestra.run.smithi203:> ls /sys/fs/fuse/connections 2024-09-11T00:04:36.125 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T00:04:36.125 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-11T00:04:36.169 DEBUG:teuthology.orchestra.run.smithi203:> sudo modprobe fuse 2024-09-11T00:04:36.226 DEBUG:teuthology.orchestra.run.smithi203:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T00:04:36.262 INFO:teuthology.orchestra.run.smithi203.stdout:/proc 2024-09-11T00:04:36.262 INFO:teuthology.orchestra.run.smithi203.stdout:/sys 2024-09-11T00:04:36.262 INFO:teuthology.orchestra.run.smithi203.stdout:/dev 2024-09-11T00:04:36.262 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/security 2024-09-11T00:04:36.262 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/shm 2024-09-11T00:04:36.262 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/pts 2024-09-11T00:04:36.262 INFO:teuthology.orchestra.run.smithi203.stdout:/run 2024-09-11T00:04:36.263 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/cgroup 2024-09-11T00:04:36.263 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/pstore 2024-09-11T00:04:36.263 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/bpf 2024-09-11T00:04:36.263 INFO:teuthology.orchestra.run.smithi203.stdout:/ 2024-09-11T00:04:36.263 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/selinux 2024-09-11T00:04:36.263 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:04:36.263 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/hugepages 2024-09-11T00:04:36.263 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/mqueue 2024-09-11T00:04:36.263 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/debug 2024-09-11T00:04:36.263 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/tracing 2024-09-11T00:04:36.263 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/fuse/connections 2024-09-11T00:04:36.263 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/config 2024-09-11T00:04:36.263 INFO:teuthology.orchestra.run.smithi203.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T00:04:36.264 INFO:teuthology.orchestra.run.smithi203.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T00:04:36.264 INFO:teuthology.orchestra.run.smithi203.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T00:04:36.264 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T00:04:36.264 INFO:teuthology.orchestra.run.smithi203.stdout:/run/user/1000 2024-09-11T00:04:36.264 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph 2024-09-11T00:04:36.264 INFO:teuthology.orchestra.run.smithi203.stdout:/run/user/0 2024-09-11T00:04:36.264 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:04:36.264 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay 2024-09-11T00:04:36.264 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/63443266f9614fa8059779e753aa5f06fba9793f397bf06cccf72343faf3d890/merged 2024-09-11T00:04:36.264 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/b8d601e117ad24386d5cfea9213a0f64eb682e088e84fd61f28aa67091e8295c/merged 2024-09-11T00:04:36.264 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/fae36ecb4df55bdfe216c3d0127728089258297a33efac47c04f50a7bb3d6c74/merged 2024-09-11T00:04:36.265 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/e76e3cb917b2a559487da264cab8de5c8d19df960c44f76e287d188412e18e2d/merged 2024-09-11T00:04:36.265 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/d10fed2396a5eecc6bb8a9f89dd11adea570b9d3a60944956a3ddaf55d7e593a/merged 2024-09-11T00:04:36.265 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/70697a550a4272ba3813805f9a02799d92e736cf25934333a958bac13a839431/merged 2024-09-11T00:04:36.265 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/545cdb1b3beafffe5ef4de8e5edc1eceb127d8e9c5f844daea849ea095a0b6d2/merged 2024-09-11T00:04:36.265 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/7ec16964a7e7198f08b995886f373747db092703693e56c6b2bce56b3bd6b3d5/merged 2024-09-11T00:04:36.265 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/a42d421a0b8bc5597604446bd7ad8f592cebb67c2250d3cb1bd07cc8c45db567/merged 2024-09-11T00:04:36.265 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/2c18f71fa329c00970bf4f027dc64759929409ab6be98717189c505e4400e589/merged 2024-09-11T00:04:36.265 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns 2024-09-11T00:04:36.265 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T00:04:36.265 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T00:04:36.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:04:36.266 DEBUG:teuthology.orchestra.run.smithi203:> ls /sys/fs/fuse/connections 2024-09-11T00:04:36.273 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:36 smithi203 ceph-mon[33225]: pgmap v247: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-11T00:04:36.371 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi203.stderr:2024-09-11T00:04:36.370+0000 7fc147f08480 -1 init, newargv = 0x556f208dd340 newargc=15 2024-09-11T00:04:36.371 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi203.stderr:ceph-fuse[52948]: starting ceph client 2024-09-11T00:04:36.380 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi203.stderr:ceph-fuse[52948]: starting fuse 2024-09-11T00:04:36.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:36 smithi111 ceph-mon[27539]: pgmap v247: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-11T00:04:37.411 DEBUG:teuthology.orchestra.run.smithi203:> sudo modprobe fuse 2024-09-11T00:04:37.470 DEBUG:teuthology.orchestra.run.smithi203:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T00:04:37.507 INFO:teuthology.orchestra.run.smithi203.stdout:/proc 2024-09-11T00:04:37.507 INFO:teuthology.orchestra.run.smithi203.stdout:/sys 2024-09-11T00:04:37.507 INFO:teuthology.orchestra.run.smithi203.stdout:/dev 2024-09-11T00:04:37.507 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/security 2024-09-11T00:04:37.507 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/shm 2024-09-11T00:04:37.507 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/pts 2024-09-11T00:04:37.507 INFO:teuthology.orchestra.run.smithi203.stdout:/run 2024-09-11T00:04:37.507 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/cgroup 2024-09-11T00:04:37.508 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/pstore 2024-09-11T00:04:37.508 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/bpf 2024-09-11T00:04:37.508 INFO:teuthology.orchestra.run.smithi203.stdout:/ 2024-09-11T00:04:37.508 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/selinux 2024-09-11T00:04:37.508 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:04:37.508 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/hugepages 2024-09-11T00:04:37.508 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/mqueue 2024-09-11T00:04:37.508 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/debug 2024-09-11T00:04:37.508 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/tracing 2024-09-11T00:04:37.508 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/fuse/connections 2024-09-11T00:04:37.508 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/config 2024-09-11T00:04:37.508 INFO:teuthology.orchestra.run.smithi203.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T00:04:37.509 INFO:teuthology.orchestra.run.smithi203.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T00:04:37.509 INFO:teuthology.orchestra.run.smithi203.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T00:04:37.509 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T00:04:37.509 INFO:teuthology.orchestra.run.smithi203.stdout:/run/user/1000 2024-09-11T00:04:37.509 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph 2024-09-11T00:04:37.509 INFO:teuthology.orchestra.run.smithi203.stdout:/run/user/0 2024-09-11T00:04:37.509 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T00:04:37.509 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay 2024-09-11T00:04:37.509 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/63443266f9614fa8059779e753aa5f06fba9793f397bf06cccf72343faf3d890/merged 2024-09-11T00:04:37.509 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/b8d601e117ad24386d5cfea9213a0f64eb682e088e84fd61f28aa67091e8295c/merged 2024-09-11T00:04:37.509 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/fae36ecb4df55bdfe216c3d0127728089258297a33efac47c04f50a7bb3d6c74/merged 2024-09-11T00:04:37.509 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/e76e3cb917b2a559487da264cab8de5c8d19df960c44f76e287d188412e18e2d/merged 2024-09-11T00:04:37.509 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/d10fed2396a5eecc6bb8a9f89dd11adea570b9d3a60944956a3ddaf55d7e593a/merged 2024-09-11T00:04:37.509 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/70697a550a4272ba3813805f9a02799d92e736cf25934333a958bac13a839431/merged 2024-09-11T00:04:37.510 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/545cdb1b3beafffe5ef4de8e5edc1eceb127d8e9c5f844daea849ea095a0b6d2/merged 2024-09-11T00:04:37.510 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/7ec16964a7e7198f08b995886f373747db092703693e56c6b2bce56b3bd6b3d5/merged 2024-09-11T00:04:37.510 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/a42d421a0b8bc5597604446bd7ad8f592cebb67c2250d3cb1bd07cc8c45db567/merged 2024-09-11T00:04:37.510 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/2c18f71fa329c00970bf4f027dc64759929409ab6be98717189c505e4400e589/merged 2024-09-11T00:04:37.510 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns 2024-09-11T00:04:37.510 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T00:04:37.510 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T00:04:37.510 INFO:teuthology.orchestra.run.smithi203.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-11T00:04:37.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:04:37.511 DEBUG:teuthology.orchestra.run.smithi203:> ls /sys/fs/fuse/connections 2024-09-11T00:04:37.586 INFO:teuthology.orchestra.run.smithi203.stdout:129 2024-09-11T00:04:37.586 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [129] 2024-09-11T00:04:37.586 DEBUG:teuthology.orchestra.run.smithi203:> sudo stdin-killer -- python3 -c ' 2024-09-11T00:04:37.586 DEBUG:teuthology.orchestra.run.smithi203:> import glob 2024-09-11T00:04:37.586 DEBUG:teuthology.orchestra.run.smithi203:> import re 2024-09-11T00:04:37.587 DEBUG:teuthology.orchestra.run.smithi203:> import os 2024-09-11T00:04:37.587 DEBUG:teuthology.orchestra.run.smithi203:> import subprocess 2024-09-11T00:04:37.587 DEBUG:teuthology.orchestra.run.smithi203:> 2024-09-11T00:04:37.587 DEBUG:teuthology.orchestra.run.smithi203:> def _find_admin_socket(client_name): 2024-09-11T00:04:37.587 DEBUG:teuthology.orchestra.run.smithi203:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-11T00:04:37.587 DEBUG:teuthology.orchestra.run.smithi203:> files = glob.glob(asok_path) 2024-09-11T00:04:37.587 DEBUG:teuthology.orchestra.run.smithi203:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-11T00:04:37.587 DEBUG:teuthology.orchestra.run.smithi203:> 2024-09-11T00:04:37.587 DEBUG:teuthology.orchestra.run.smithi203:> # Given a non-glob path, it better be there 2024-09-11T00:04:37.587 DEBUG:teuthology.orchestra.run.smithi203:> if "*" not in asok_path: 2024-09-11T00:04:37.588 DEBUG:teuthology.orchestra.run.smithi203:> assert(len(files) == 1) 2024-09-11T00:04:37.588 DEBUG:teuthology.orchestra.run.smithi203:> return files[0] 2024-09-11T00:04:37.588 DEBUG:teuthology.orchestra.run.smithi203:> 2024-09-11T00:04:37.588 DEBUG:teuthology.orchestra.run.smithi203:> for f in files: 2024-09-11T00:04:37.588 DEBUG:teuthology.orchestra.run.smithi203:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T00:04:37.588 DEBUG:teuthology.orchestra.run.smithi203:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T00:04:37.588 DEBUG:teuthology.orchestra.run.smithi203:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T00:04:37.589 DEBUG:teuthology.orchestra.run.smithi203:> contents = proc_f.read() 2024-09-11T00:04:37.589 DEBUG:teuthology.orchestra.run.smithi203:> if mountpoint in contents: 2024-09-11T00:04:37.589 DEBUG:teuthology.orchestra.run.smithi203:> return f 2024-09-11T00:04:37.589 DEBUG:teuthology.orchestra.run.smithi203:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T00:04:37.589 DEBUG:teuthology.orchestra.run.smithi203:> 2024-09-11T00:04:37.589 DEBUG:teuthology.orchestra.run.smithi203:> print(_find_admin_socket("client.1")) 2024-09-11T00:04:37.589 DEBUG:teuthology.orchestra.run.smithi203:> ' 2024-09-11T00:04:37.746 INFO:teuthology.orchestra.run.smithi203.stdout:/var/run/ceph/ceph-client.1.52948.asok 2024-09-11T00:04:37.750 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T00:04:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:04:37.761 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.52948.asok 2024-09-11T00:04:37.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:04:37.761 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.52948.asok status 2024-09-11T00:04:37.942 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-11T00:04:37.943 INFO:teuthology.orchestra.run.smithi203.stdout: "metadata": { 2024-09-11T00:04:37.943 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_sha1": "5dd24139a1eada541a3bc16b6941c5dde975e26d", 2024-09-11T00:04:37.943 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-09-11T00:04:37.943 INFO:teuthology.orchestra.run.smithi203.stdout: "entity_id": "1", 2024-09-11T00:04:37.943 INFO:teuthology.orchestra.run.smithi203.stdout: "hostname": "smithi203", 2024-09-11T00:04:37.943 INFO:teuthology.orchestra.run.smithi203.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-11T00:04:37.943 INFO:teuthology.orchestra.run.smithi203.stdout: "pid": "52948", 2024-09-11T00:04:37.943 INFO:teuthology.orchestra.run.smithi203.stdout: "root": "/" 2024-09-11T00:04:37.943 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-11T00:04:37.943 INFO:teuthology.orchestra.run.smithi203.stdout: "dentry_count": 0, 2024-09-11T00:04:37.943 INFO:teuthology.orchestra.run.smithi203.stdout: "dentry_pinned_count": 0, 2024-09-11T00:04:37.944 INFO:teuthology.orchestra.run.smithi203.stdout: "id": 24415, 2024-09-11T00:04:37.944 INFO:teuthology.orchestra.run.smithi203.stdout: "inst": { 2024-09-11T00:04:37.944 INFO:teuthology.orchestra.run.smithi203.stdout: "name": { 2024-09-11T00:04:37.944 INFO:teuthology.orchestra.run.smithi203.stdout: "type": "client", 2024-09-11T00:04:37.944 INFO:teuthology.orchestra.run.smithi203.stdout: "num": 24415 2024-09-11T00:04:37.944 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-11T00:04:37.944 INFO:teuthology.orchestra.run.smithi203.stdout: "addr": { 2024-09-11T00:04:37.944 INFO:teuthology.orchestra.run.smithi203.stdout: "type": "v1", 2024-09-11T00:04:37.944 INFO:teuthology.orchestra.run.smithi203.stdout: "addr": "192.168.0.1:0", 2024-09-11T00:04:37.944 INFO:teuthology.orchestra.run.smithi203.stdout: "nonce": 3848893757 2024-09-11T00:04:37.944 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-11T00:04:37.944 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-11T00:04:37.944 INFO:teuthology.orchestra.run.smithi203.stdout: "addr": { 2024-09-11T00:04:37.944 INFO:teuthology.orchestra.run.smithi203.stdout: "type": "v1", 2024-09-11T00:04:37.945 INFO:teuthology.orchestra.run.smithi203.stdout: "addr": "192.168.0.1:0", 2024-09-11T00:04:37.945 INFO:teuthology.orchestra.run.smithi203.stdout: "nonce": 3848893757 2024-09-11T00:04:37.945 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-11T00:04:37.945 INFO:teuthology.orchestra.run.smithi203.stdout: "inst_str": "client.24415 192.168.0.1:0/3848893757", 2024-09-11T00:04:37.945 INFO:teuthology.orchestra.run.smithi203.stdout: "addr_str": "192.168.0.1:0/3848893757", 2024-09-11T00:04:37.945 INFO:teuthology.orchestra.run.smithi203.stdout: "inode_count": 1, 2024-09-11T00:04:37.945 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_epoch": 14, 2024-09-11T00:04:37.945 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_epoch": 47, 2024-09-11T00:04:37.945 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_epoch_barrier": 0, 2024-09-11T00:04:37.945 INFO:teuthology.orchestra.run.smithi203.stdout: "blocklisted": false, 2024-09-11T00:04:37.945 INFO:teuthology.orchestra.run.smithi203.stdout: "fs_name": "cephfs" 2024-09-11T00:04:37.945 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-11T00:04:37.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:04:37.955 DEBUG:teuthology.orchestra.run.smithi111:> stat --file-system '--printf=%T 2024-09-11T00:04:37.955 DEBUG:teuthology.orchestra.run.smithi111:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-11T00:04:37.998 INFO:teuthology.orchestra.run.smithi111.stdout:fuseblk 2024-09-11T00:04:37.998 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-11T00:04:37.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:04:37.998 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T00:04:38.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:04:38.104 DEBUG:teuthology.orchestra.run.smithi203:> stat --file-system '--printf=%T 2024-09-11T00:04:38.104 DEBUG:teuthology.orchestra.run.smithi203:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-11T00:04:38.140 INFO:teuthology.orchestra.run.smithi203.stdout:fuseblk 2024-09-11T00:04:38.141 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-11T00:04:38.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:04:38.141 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-11T00:04:38.240 INFO:teuthology.run_tasks:Running task print... 2024-09-11T00:04:38.249 INFO:teuthology.task.print:**** done client 2024-09-11T00:04:38.249 INFO:teuthology.run_tasks:Running task parallel... 2024-09-11T00:04:38.329 INFO:teuthology.task.parallel:starting parallel... 2024-09-11T00:04:38.330 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-11T00:04:38.337 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-11T00:04:38.337 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi111.front.sepia.ceph.com 2024-09-11T00:04:38.337 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -e sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-11T00:04:38.338 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-11T00:04:38.338 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-11T00:04:38.343 INFO:tasks.workunit:Pulling workunits from ref 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:04:38.343 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-11T00:04:38.343 INFO:tasks.workunit:timeout=3h 2024-09-11T00:04:38.343 INFO:tasks.workunit:cleanup=True 2024-09-11T00:04:38.343 DEBUG:teuthology.orchestra.run.smithi111:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-11T00:04:38.385 INFO:teuthology.orchestra.run.smithi111.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-11T00:04:38.385 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-11T00:04:38.385 INFO:teuthology.orchestra.run.smithi111.stdout:Device: a5h/165d Inode: 1 Links: 2 2024-09-11T00:04:38.385 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:04:38.385 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-11T00:04:38.385 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-11T00:04:38.385 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-09-11 00:03:51.987104585 +0000 2024-09-11T00:04:38.385 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-09-11 00:04:38.098820171 +0000 2024-09-11T00:04:38.386 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-09-11T00:04:38.386 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-11T00:04:38.386 DEBUG:teuthology.orchestra.run.smithi111:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-11T00:04:38.395 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:38 smithi111 ceph-mon[27539]: pgmap v248: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-11T00:04:38.459 DEBUG:teuthology.orchestra.run.smithi203:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-11T00:04:38.496 INFO:teuthology.orchestra.run.smithi203.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-11T00:04:38.496 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-11T00:04:38.497 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 81h/129d Inode: 1 Links: 3 2024-09-11T00:04:38.497 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:04:38.497 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-11T00:04:38.497 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-11T00:04:38.497 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-09-11 00:04:38.451096586 +0000 2024-09-11T00:04:38.497 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-09-11 00:04:38.451096586 +0000 2024-09-11T00:04:38.497 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: - 2024-09-11T00:04:38.497 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-11T00:04:38.497 DEBUG:teuthology.orchestra.run.smithi203:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-11T00:04:38.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:38 smithi203 ceph-mon[33225]: pgmap v248: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-11T00:04:38.599 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:04:38.600 DEBUG:teuthology.orchestra.run.smithi203:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:04:38.638 INFO:tasks.workunit.client.0.smithi111.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-11T00:04:38.676 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:04:38.676 INFO:tasks.workunit.client.1.smithi203.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-11T00:04:40.239 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:40 smithi111 ceph-mon[27539]: pgmap v249: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-11T00:04:40.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:40 smithi203 ceph-mon[33225]: pgmap v249: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-11T00:04:40.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.646+0000 7fc86ae00700 1 -- 172.21.15.111:0/3619998231 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc864074d00 msgr2=0x7fc864073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:40.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.646+0000 7fc86ae00700 1 --2- 172.21.15.111:0/3619998231 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc864074d00 0x7fc864073160 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc854009910 tx=0x7fc854009c20 comp rx=0 tx=0).stop 2024-09-11T00:04:40.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.646+0000 7fc86ae00700 1 -- 172.21.15.111:0/3619998231 shutdown_connections 2024-09-11T00:04:40.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.646+0000 7fc86ae00700 1 --2- 172.21.15.111:0/3619998231 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc864073730 0x7fc864073ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:40.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.646+0000 7fc86ae00700 1 --2- 172.21.15.111:0/3619998231 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc864074d00 0x7fc864073160 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:40.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.646+0000 7fc86ae00700 1 -- 172.21.15.111:0/3619998231 >> 172.21.15.111:0/3619998231 conn(0x7fc8640fb6e0 msgr2=0x7fc8640fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:40.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.646+0000 7fc86ae00700 1 -- 172.21.15.111:0/3619998231 shutdown_connections 2024-09-11T00:04:40.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.646+0000 7fc86ae00700 1 -- 172.21.15.111:0/3619998231 wait complete. 2024-09-11T00:04:40.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.647+0000 7fc86ae00700 1 Processor -- start 2024-09-11T00:04:40.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.647+0000 7fc86ae00700 1 -- start start 2024-09-11T00:04:40.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.647+0000 7fc86ae00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc864073730 0x7fc864197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:40.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.647+0000 7fc86ae00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc864074d00 0x7fc8641980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:40.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.647+0000 7fc86ae00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8641986d0 con 0x7fc864073730 2024-09-11T00:04:40.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.647+0000 7fc86ae00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc864198810 con 0x7fc864074d00 2024-09-11T00:04:40.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.648+0000 7fc863e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc864073730 0x7fc864197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:40.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.648+0000 7fc863e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc864073730 0x7fc864197b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:57046/0 (socket says 172.21.15.111:57046) 2024-09-11T00:04:40.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.648+0000 7fc863e00700 1 -- 172.21.15.111:0/3511914753 learned_addr learned my addr 172.21.15.111:0/3511914753 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:04:40.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.648+0000 7fc863400700 1 --2- 172.21.15.111:0/3511914753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc864074d00 0x7fc8641980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:40.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.648+0000 7fc863e00700 1 -- 172.21.15.111:0/3511914753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc864074d00 msgr2=0x7fc8641980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:40.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.648+0000 7fc863e00700 1 --2- 172.21.15.111:0/3511914753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc864074d00 0x7fc8641980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:40.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.648+0000 7fc863e00700 1 -- 172.21.15.111:0/3511914753 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8540095f0 con 0x7fc864073730 2024-09-11T00:04:40.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.648+0000 7fc863400700 1 --2- 172.21.15.111:0/3511914753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc864074d00 0x7fc8641980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:04:40.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.649+0000 7fc863e00700 1 --2- 172.21.15.111:0/3511914753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc864073730 0x7fc864197b70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc85400bd70 tx=0x7fc85400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:40.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.649+0000 7fc860c00700 1 -- 172.21.15.111:0/3511914753 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc85401d070 con 0x7fc864073730 2024-09-11T00:04:40.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.649+0000 7fc860c00700 1 -- 172.21.15.111:0/3511914753 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc854022470 con 0x7fc864073730 2024-09-11T00:04:40.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.649+0000 7fc860c00700 1 -- 172.21.15.111:0/3511914753 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc85400f670 con 0x7fc864073730 2024-09-11T00:04:40.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.649+0000 7fc86ae00700 1 -- 172.21.15.111:0/3511914753 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc86419d260 con 0x7fc864073730 2024-09-11T00:04:40.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.649+0000 7fc86ae00700 1 -- 172.21.15.111:0/3511914753 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc86419d750 con 0x7fc864073730 2024-09-11T00:04:40.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.650+0000 7fc86ae00700 1 -- 172.21.15.111:0/3511914753 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc86410ae80 con 0x7fc864073730 2024-09-11T00:04:40.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.651+0000 7fc860c00700 1 -- 172.21.15.111:0/3511914753 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fc854022a50 con 0x7fc864073730 2024-09-11T00:04:40.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.652+0000 7fc860c00700 1 --2- 172.21.15.111:0/3511914753 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc84806c680 0x7fc84806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:40.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.652+0000 7fc860c00700 1 -- 172.21.15.111:0/3511914753 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fc85408cdb0 con 0x7fc864073730 2024-09-11T00:04:40.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.653+0000 7fc863400700 1 --2- 172.21.15.111:0/3511914753 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc84806c680 0x7fc84806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:40.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.653+0000 7fc863400700 1 --2- 172.21.15.111:0/3511914753 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc84806c680 0x7fc84806eb30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc850005fd0 tx=0x7fc850005ee0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:40.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.657+0000 7fc860c00700 1 -- 172.21.15.111:0/3511914753 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc85405b000 con 0x7fc864073730 2024-09-11T00:04:40.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.863+0000 7fc86ae00700 1 -- 172.21.15.111:0/3511914753 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fc86410b070 con 0x7fc864073730 2024-09-11T00:04:40.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.864+0000 7fc860c00700 1 -- 172.21.15.111:0/3511914753 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v39)=0 v39) v1 ==== 155+0+0 (secure 0 0 0) 0x7fc85405ab90 con 0x7fc864073730 2024-09-11T00:04:40.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.867+0000 7fc86ae00700 1 -- 172.21.15.111:0/3511914753 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc84806c680 msgr2=0x7fc84806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:40.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.867+0000 7fc86ae00700 1 --2- 172.21.15.111:0/3511914753 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc84806c680 0x7fc84806eb30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc850005fd0 tx=0x7fc850005ee0 comp rx=0 tx=0).stop 2024-09-11T00:04:40.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.867+0000 7fc86ae00700 1 -- 172.21.15.111:0/3511914753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc864073730 msgr2=0x7fc864197b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:40.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.867+0000 7fc86ae00700 1 --2- 172.21.15.111:0/3511914753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc864073730 0x7fc864197b70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc85400bd70 tx=0x7fc85400be50 comp rx=0 tx=0).stop 2024-09-11T00:04:40.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.867+0000 7fc86ae00700 1 -- 172.21.15.111:0/3511914753 shutdown_connections 2024-09-11T00:04:40.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.867+0000 7fc86ae00700 1 --2- 172.21.15.111:0/3511914753 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc84806c680 0x7fc84806eb30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:40.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.867+0000 7fc86ae00700 1 --2- 172.21.15.111:0/3511914753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc864073730 0x7fc864197b70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:40.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.867+0000 7fc86ae00700 1 --2- 172.21.15.111:0/3511914753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc864074d00 0x7fc8641980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:40.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.867+0000 7fc86ae00700 1 -- 172.21.15.111:0/3511914753 >> 172.21.15.111:0/3511914753 conn(0x7fc8640fb6e0 msgr2=0x7fc864105fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:40.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.867+0000 7fc86ae00700 1 -- 172.21.15.111:0/3511914753 shutdown_connections 2024-09-11T00:04:40.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:40.867+0000 7fc86ae00700 1 -- 172.21.15.111:0/3511914753 wait complete. 2024-09-11T00:04:41.586 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -e sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-11T00:04:41.947 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:04:42.334 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:42 smithi111 ceph-mon[27539]: pgmap v250: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-09-11T00:04:42.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:42 smithi203 ceph-mon[33225]: pgmap v250: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-09-11T00:04:43.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.851+0000 7fb2c3a00700 1 -- 172.21.15.111:0/2279176205 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb2bc101350 msgr2=0x7fb2bc1017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:43.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.851+0000 7fb2c3a00700 1 --2- 172.21.15.111:0/2279176205 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb2bc101350 0x7fb2bc1017a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8009910 tx=0x7fb2a8009c20 comp rx=0 tx=0).stop 2024-09-11T00:04:43.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.851+0000 7fb2c3a00700 1 -- 172.21.15.111:0/2279176205 shutdown_connections 2024-09-11T00:04:43.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.851+0000 7fb2c3a00700 1 --2- 172.21.15.111:0/2279176205 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb2bc101350 0x7fb2bc1017a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:43.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.851+0000 7fb2c3a00700 1 --2- 172.21.15.111:0/2279176205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb2bc100150 0x7fb2bc100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:43.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.851+0000 7fb2c3a00700 1 -- 172.21.15.111:0/2279176205 >> 172.21.15.111:0/2279176205 conn(0x7fb2bc0fb6e0 msgr2=0x7fb2bc0fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:43.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.851+0000 7fb2c3a00700 1 -- 172.21.15.111:0/2279176205 shutdown_connections 2024-09-11T00:04:43.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.851+0000 7fb2c3a00700 1 -- 172.21.15.111:0/2279176205 wait complete. 2024-09-11T00:04:43.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.852+0000 7fb2c3a00700 1 Processor -- start 2024-09-11T00:04:43.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.852+0000 7fb2c3a00700 1 -- start start 2024-09-11T00:04:43.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.852+0000 7fb2c3a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb2bc100150 0x7fb2bc195960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:43.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.853+0000 7fb2c3a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb2bc101350 0x7fb2bc195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:43.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.853+0000 7fb2c3a00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc1964c0 con 0x7fb2bc101350 2024-09-11T00:04:43.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.853+0000 7fb2c3a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc196600 con 0x7fb2bc100150 2024-09-11T00:04:43.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.853+0000 7fb2bbe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb2bc101350 0x7fb2bc195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:43.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.853+0000 7fb2bbe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb2bc101350 0x7fb2bc195ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:57072/0 (socket says 172.21.15.111:57072) 2024-09-11T00:04:43.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.853+0000 7fb2bbe00700 1 -- 172.21.15.111:0/2447709572 learned_addr learned my addr 172.21.15.111:0/2447709572 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:04:43.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.853+0000 7fb2c1000700 1 --2- 172.21.15.111:0/2447709572 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb2bc100150 0x7fb2bc195960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:43.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.853+0000 7fb2bbe00700 1 -- 172.21.15.111:0/2447709572 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb2bc100150 msgr2=0x7fb2bc195960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:43.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.853+0000 7fb2bbe00700 1 --2- 172.21.15.111:0/2447709572 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb2bc100150 0x7fb2bc195960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:43.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.853+0000 7fb2bbe00700 1 -- 172.21.15.111:0/2447709572 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a80095f0 con 0x7fb2bc101350 2024-09-11T00:04:43.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.853+0000 7fb2c1000700 1 --2- 172.21.15.111:0/2447709572 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb2bc100150 0x7fb2bc195960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:04:43.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.854+0000 7fb2bbe00700 1 --2- 172.21.15.111:0/2447709572 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb2bc101350 0x7fb2bc195ea0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb2a800b5c0 tx=0x7fb2a800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:43.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.854+0000 7fb2b9600700 1 -- 172.21.15.111:0/2447709572 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2a801d070 con 0x7fb2bc101350 2024-09-11T00:04:43.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.854+0000 7fb2b9600700 1 -- 172.21.15.111:0/2447709572 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb2a800f460 con 0x7fb2bc101350 2024-09-11T00:04:43.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.854+0000 7fb2c3a00700 1 -- 172.21.15.111:0/2447709572 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2bc19b050 con 0x7fb2bc101350 2024-09-11T00:04:43.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.854+0000 7fb2b9600700 1 -- 172.21.15.111:0/2447709572 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2a8021640 con 0x7fb2bc101350 2024-09-11T00:04:43.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.854+0000 7fb2c3a00700 1 -- 172.21.15.111:0/2447709572 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2bc19b540 con 0x7fb2bc101350 2024-09-11T00:04:43.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.855+0000 7fb2c3a00700 1 -- 172.21.15.111:0/2447709572 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2bc108ca0 con 0x7fb2bc101350 2024-09-11T00:04:43.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.856+0000 7fb2b9600700 1 -- 172.21.15.111:0/2447709572 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fb2a800f5d0 con 0x7fb2bc101350 2024-09-11T00:04:43.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.857+0000 7fb2b9600700 1 --2- 172.21.15.111:0/2447709572 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb2a406c680 0x7fb2a406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:43.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.857+0000 7fb2b9600700 1 -- 172.21.15.111:0/2447709572 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fb2a808ccd0 con 0x7fb2bc101350 2024-09-11T00:04:43.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.857+0000 7fb2c1000700 1 --2- 172.21.15.111:0/2447709572 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb2a406c680 0x7fb2a406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:43.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.858+0000 7fb2c1000700 1 --2- 172.21.15.111:0/2447709572 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb2a406c680 0x7fb2a406eb30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0005fd0 tx=0x7fb2b0005f00 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:43.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:43.862+0000 7fb2b9600700 1 -- 172.21.15.111:0/2447709572 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb2a805adf0 con 0x7fb2bc101350 2024-09-11T00:04:44.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:44.062+0000 7fb2c3a00700 1 -- 172.21.15.111:0/2447709572 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fb2bc108e60 con 0x7fb2bc101350 2024-09-11T00:04:44.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:44.063+0000 7fb2b9600700 1 -- 172.21.15.111:0/2447709572 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v39)=0 v39) v1 ==== 163+0+0 (secure 0 0 0) 0x7fb2a805a980 con 0x7fb2bc101350 2024-09-11T00:04:44.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:44.065+0000 7fb2c3a00700 1 -- 172.21.15.111:0/2447709572 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb2a406c680 msgr2=0x7fb2a406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:44.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:44.065+0000 7fb2c3a00700 1 --2- 172.21.15.111:0/2447709572 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb2a406c680 0x7fb2a406eb30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0005fd0 tx=0x7fb2b0005f00 comp rx=0 tx=0).stop 2024-09-11T00:04:44.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:44.065+0000 7fb2c3a00700 1 -- 172.21.15.111:0/2447709572 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb2bc101350 msgr2=0x7fb2bc195ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:44.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:44.065+0000 7fb2c3a00700 1 --2- 172.21.15.111:0/2447709572 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb2bc101350 0x7fb2bc195ea0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb2a800b5c0 tx=0x7fb2a800be20 comp rx=0 tx=0).stop 2024-09-11T00:04:44.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:44.065+0000 7fb2c3a00700 1 -- 172.21.15.111:0/2447709572 shutdown_connections 2024-09-11T00:04:44.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:44.065+0000 7fb2c3a00700 1 --2- 172.21.15.111:0/2447709572 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fb2a406c680 0x7fb2a406eb30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:44.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:44.065+0000 7fb2c3a00700 1 --2- 172.21.15.111:0/2447709572 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb2bc100150 0x7fb2bc195960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:44.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:44.065+0000 7fb2c3a00700 1 --2- 172.21.15.111:0/2447709572 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb2bc101350 0x7fb2bc195ea0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:44.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:44.065+0000 7fb2c3a00700 1 -- 172.21.15.111:0/2447709572 >> 172.21.15.111:0/2447709572 conn(0x7fb2bc0fb6e0 msgr2=0x7fb2bc104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:44.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:44.066+0000 7fb2c3a00700 1 -- 172.21.15.111:0/2447709572 shutdown_connections 2024-09-11T00:04:44.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:44.066+0000 7fb2c3a00700 1 -- 172.21.15.111:0/2447709572 wait complete. 2024-09-11T00:04:44.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:44 smithi111 ceph-mon[27539]: pgmap v251: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-11T00:04:44.421 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:44 smithi203 ceph-mon[33225]: pgmap v251: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-11T00:04:44.871 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -e sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-11T00:04:45.222 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:04:46.386 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:46 smithi111 ceph-mon[27539]: pgmap v252: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-11T00:04:46.386 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:46 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:04:46.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:46 smithi203 ceph-mon[33225]: pgmap v252: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-11T00:04:46.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:46 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:04:47.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.249+0000 7fcf2d400700 1 -- 172.21.15.111:0/2622127026 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcf28101350 msgr2=0x7fcf281017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:47.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.249+0000 7fcf2d400700 1 --2- 172.21.15.111:0/2622127026 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcf28101350 0x7fcf281017a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcf14009910 tx=0x7fcf14009c20 comp rx=0 tx=0).stop 2024-09-11T00:04:47.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.250+0000 7fcf2d400700 1 -- 172.21.15.111:0/2622127026 shutdown_connections 2024-09-11T00:04:47.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.250+0000 7fcf2d400700 1 --2- 172.21.15.111:0/2622127026 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcf28101350 0x7fcf281017a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.250+0000 7fcf2d400700 1 --2- 172.21.15.111:0/2622127026 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf28100150 0x7fcf28100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.250+0000 7fcf2d400700 1 -- 172.21.15.111:0/2622127026 >> 172.21.15.111:0/2622127026 conn(0x7fcf280fb6e0 msgr2=0x7fcf280fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:47.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.250+0000 7fcf2d400700 1 -- 172.21.15.111:0/2622127026 shutdown_connections 2024-09-11T00:04:47.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.250+0000 7fcf2d400700 1 -- 172.21.15.111:0/2622127026 wait complete. 2024-09-11T00:04:47.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.251+0000 7fcf2d400700 1 Processor -- start 2024-09-11T00:04:47.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.251+0000 7fcf2d400700 1 -- start start 2024-09-11T00:04:47.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.251+0000 7fcf2d400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf28100150 0x7fcf28197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:47.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.251+0000 7fcf2d400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcf28101350 0x7fcf281980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:47.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.251+0000 7fcf2d400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf281986d0 con 0x7fcf28101350 2024-09-11T00:04:47.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.251+0000 7fcf2d400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf28198810 con 0x7fcf28100150 2024-09-11T00:04:47.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.252+0000 7fcf26800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf28100150 0x7fcf28197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:47.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.252+0000 7fcf25e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcf28101350 0x7fcf281980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:47.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.252+0000 7fcf26800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf28100150 0x7fcf28197b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.111:51928/0 (socket says 172.21.15.111:51928) 2024-09-11T00:04:47.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.252+0000 7fcf26800700 1 -- 172.21.15.111:0/1634194358 learned_addr learned my addr 172.21.15.111:0/1634194358 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:04:47.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.252+0000 7fcf26800700 1 -- 172.21.15.111:0/1634194358 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcf28101350 msgr2=0x7fcf281980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:47.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.252+0000 7fcf26800700 1 --2- 172.21.15.111:0/1634194358 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcf28101350 0x7fcf281980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.252+0000 7fcf26800700 1 -- 172.21.15.111:0/1634194358 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf140095f0 con 0x7fcf28100150 2024-09-11T00:04:47.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.252+0000 7fcf26800700 1 --2- 172.21.15.111:0/1634194358 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf28100150 0x7fcf28197b70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800e8f0 tx=0x7fcf1800ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:47.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.253+0000 7fcf1f400700 1 -- 172.21.15.111:0/1634194358 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf18009790 con 0x7fcf28100150 2024-09-11T00:04:47.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.253+0000 7fcf1f400700 1 -- 172.21.15.111:0/1634194358 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcf1800c810 con 0x7fcf28100150 2024-09-11T00:04:47.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.253+0000 7fcf2d400700 1 -- 172.21.15.111:0/1634194358 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf2819d2c0 con 0x7fcf28100150 2024-09-11T00:04:47.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.253+0000 7fcf1f400700 1 -- 172.21.15.111:0/1634194358 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf18003d20 con 0x7fcf28100150 2024-09-11T00:04:47.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.253+0000 7fcf2d400700 1 -- 172.21.15.111:0/1634194358 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2819d810 con 0x7fcf28100150 2024-09-11T00:04:47.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.254+0000 7fcf2d400700 1 -- 172.21.15.111:0/1634194358 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf28105430 con 0x7fcf28100150 2024-09-11T00:04:47.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.255+0000 7fcf1f400700 1 -- 172.21.15.111:0/1634194358 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fcf180041f0 con 0x7fcf28100150 2024-09-11T00:04:47.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.256+0000 7fcf1f400700 1 --2- 172.21.15.111:0/1634194358 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fcf0c06c680 0x7fcf0c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:47.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.256+0000 7fcf1f400700 1 -- 172.21.15.111:0/1634194358 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fcf18014070 con 0x7fcf28100150 2024-09-11T00:04:47.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.257+0000 7fcf25e00700 1 --2- 172.21.15.111:0/1634194358 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fcf0c06c680 0x7fcf0c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:47.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.257+0000 7fcf25e00700 1 --2- 172.21.15.111:0/1634194358 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fcf0c06c680 0x7fcf0c06eb30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcf14009fd0 tx=0x7fcf14005fd0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:47.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.261+0000 7fcf1f400700 1 -- 172.21.15.111:0/1634194358 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fcf18059da0 con 0x7fcf28100150 2024-09-11T00:04:47.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.471+0000 7fcf2d400700 1 -- 172.21.15.111:0/1634194358 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fcf2802cc30 con 0x7fcf28100150 2024-09-11T00:04:47.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.472+0000 7fcf1f400700 1 -- 172.21.15.111:0/1634194358 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v39)=0 v39) v1 ==== 135+0+0 (secure 0 0 0) 0x7fcf18059930 con 0x7fcf28100150 2024-09-11T00:04:47.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.475+0000 7fcf2d400700 1 -- 172.21.15.111:0/1634194358 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fcf0c06c680 msgr2=0x7fcf0c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:47.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.475+0000 7fcf2d400700 1 --2- 172.21.15.111:0/1634194358 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fcf0c06c680 0x7fcf0c06eb30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcf14009fd0 tx=0x7fcf14005fd0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.475+0000 7fcf2d400700 1 -- 172.21.15.111:0/1634194358 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf28100150 msgr2=0x7fcf28197b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:47.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.475+0000 7fcf2d400700 1 --2- 172.21.15.111:0/1634194358 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf28100150 0x7fcf28197b70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800e8f0 tx=0x7fcf1800ec00 comp rx=0 tx=0).stop 2024-09-11T00:04:47.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.475+0000 7fcf2d400700 1 -- 172.21.15.111:0/1634194358 shutdown_connections 2024-09-11T00:04:47.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.475+0000 7fcf2d400700 1 --2- 172.21.15.111:0/1634194358 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fcf0c06c680 0x7fcf0c06eb30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.475+0000 7fcf2d400700 1 --2- 172.21.15.111:0/1634194358 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf28100150 0x7fcf28197b70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.475+0000 7fcf2d400700 1 --2- 172.21.15.111:0/1634194358 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcf28101350 0x7fcf281980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:47.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.475+0000 7fcf2d400700 1 -- 172.21.15.111:0/1634194358 >> 172.21.15.111:0/1634194358 conn(0x7fcf280fb6e0 msgr2=0x7fcf28102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:47.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.475+0000 7fcf2d400700 1 -- 172.21.15.111:0/1634194358 shutdown_connections 2024-09-11T00:04:47.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:47.475+0000 7fcf2d400700 1 -- 172.21.15.111:0/1634194358 wait complete. 2024-09-11T00:04:48.177 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -e sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-09-11T00:04:48.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:48 smithi111 ceph-mon[27539]: pgmap v253: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-11T00:04:48.531 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:04:48.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:48 smithi203 ceph-mon[33225]: pgmap v253: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-11T00:04:50.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:50 smithi111 ceph-mon[27539]: pgmap v254: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-09-11T00:04:50.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:50 smithi203 ceph-mon[33225]: pgmap v254: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-09-11T00:04:50.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.590+0000 7ff13de00700 1 -- 172.21.15.111:0/1095636782 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1380fffa0 msgr2=0x7ff1381003b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:50.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.590+0000 7ff13de00700 1 --2- 172.21.15.111:0/1095636782 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1380fffa0 0x7ff1381003b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff128009910 tx=0x7ff128009c20 comp rx=0 tx=0).stop 2024-09-11T00:04:50.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.590+0000 7ff13de00700 1 -- 172.21.15.111:0/1095636782 shutdown_connections 2024-09-11T00:04:50.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.590+0000 7ff13de00700 1 --2- 172.21.15.111:0/1095636782 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1381011a0 0x7ff1381015f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:50.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.590+0000 7ff13de00700 1 --2- 172.21.15.111:0/1095636782 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1380fffa0 0x7ff1381003b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:50.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.590+0000 7ff13de00700 1 -- 172.21.15.111:0/1095636782 >> 172.21.15.111:0/1095636782 conn(0x7ff1380fb510 msgr2=0x7ff1380fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:04:50.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.590+0000 7ff13de00700 1 -- 172.21.15.111:0/1095636782 shutdown_connections 2024-09-11T00:04:50.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.590+0000 7ff13de00700 1 -- 172.21.15.111:0/1095636782 wait complete. 2024-09-11T00:04:50.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.591+0000 7ff13de00700 1 Processor -- start 2024-09-11T00:04:50.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.591+0000 7ff13de00700 1 -- start start 2024-09-11T00:04:50.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.591+0000 7ff13de00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1380fffa0 0x7ff138074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:50.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.591+0000 7ff13de00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1381011a0 0x7ff138073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:50.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.591+0000 7ff13de00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff138073680 con 0x7ff1380fffa0 2024-09-11T00:04:50.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.591+0000 7ff13de00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1380737c0 con 0x7ff1381011a0 2024-09-11T00:04:50.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.592+0000 7ff13ca00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1380fffa0 0x7ff138074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:50.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.592+0000 7ff12fe00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1381011a0 0x7ff138073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:50.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.592+0000 7ff13ca00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1380fffa0 0x7ff138074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:34488/0 (socket says 172.21.15.111:34488) 2024-09-11T00:04:50.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.592+0000 7ff13ca00700 1 -- 172.21.15.111:0/2347983187 learned_addr learned my addr 172.21.15.111:0/2347983187 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:04:50.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.592+0000 7ff13ca00700 1 -- 172.21.15.111:0/2347983187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1381011a0 msgr2=0x7ff138073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:04:50.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.592+0000 7ff13ca00700 1 --2- 172.21.15.111:0/2347983187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1381011a0 0x7ff138073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:04:50.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.592+0000 7ff13ca00700 1 -- 172.21.15.111:0/2347983187 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1280095f0 con 0x7ff1380fffa0 2024-09-11T00:04:50.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.592+0000 7ff12fe00700 1 --2- 172.21.15.111:0/2347983187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1381011a0 0x7ff138073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:04:50.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.592+0000 7ff13ca00700 1 --2- 172.21.15.111:0/2347983187 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1380fffa0 0x7ff138074af0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff128000c00 tx=0x7ff12800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:50.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.593+0000 7ff136000700 1 -- 172.21.15.111:0/2347983187 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff12801d070 con 0x7ff1380fffa0 2024-09-11T00:04:50.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.593+0000 7ff136000700 1 -- 172.21.15.111:0/2347983187 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff128005dc0 con 0x7ff1380fffa0 2024-09-11T00:04:50.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.593+0000 7ff136000700 1 -- 172.21.15.111:0/2347983187 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff128022470 con 0x7ff1380fffa0 2024-09-11T00:04:50.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.593+0000 7ff13de00700 1 -- 172.21.15.111:0/2347983187 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff138073a40 con 0x7ff1380fffa0 2024-09-11T00:04:50.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.593+0000 7ff13de00700 1 -- 172.21.15.111:0/2347983187 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff138073f30 con 0x7ff1380fffa0 2024-09-11T00:04:50.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.594+0000 7ff13de00700 1 -- 172.21.15.111:0/2347983187 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff138108af0 con 0x7ff1380fffa0 2024-09-11T00:04:50.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.595+0000 7ff136000700 1 -- 172.21.15.111:0/2347983187 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7ff128003810 con 0x7ff1380fffa0 2024-09-11T00:04:50.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.596+0000 7ff136000700 1 --2- 172.21.15.111:0/2347983187 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff11c06c680 0x7ff11c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:04:50.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.596+0000 7ff136000700 1 -- 172.21.15.111:0/2347983187 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7ff12808cd90 con 0x7ff1380fffa0 2024-09-11T00:04:50.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.597+0000 7ff12fe00700 1 --2- 172.21.15.111:0/2347983187 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff11c06c680 0x7ff11c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:04:50.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.597+0000 7ff12fe00700 1 --2- 172.21.15.111:0/2347983187 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff11c06c680 0x7ff11c06eb30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff124011490 tx=0x7ff124009260 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:04:50.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.601+0000 7ff136000700 1 -- 172.21.15.111:0/2347983187 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff12805af30 con 0x7ff1380fffa0 2024-09-11T00:04:50.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:04:50.853+0000 7ff13de00700 1 -- 172.21.15.111:0/2347983187 --> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7ff138105ba0 con 0x7ff11c06c680 2024-09-11T00:04:52.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:52 smithi111 ceph-mon[27539]: pgmap v255: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-09-11T00:04:52.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:52 smithi111 ceph-mon[27539]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:04:52.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:52 smithi203 ceph-mon[33225]: pgmap v255: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-09-11T00:04:52.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:52 smithi203 ceph-mon[33225]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:04:54.377 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:54 smithi203 ceph-mon[33225]: pgmap v256: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-11T00:04:54.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:54 smithi111 ceph-mon[27539]: pgmap v256: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-11T00:04:56.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:56 smithi111 ceph-mon[27539]: pgmap v257: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-11T00:04:56.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:56 smithi203 ceph-mon[33225]: pgmap v257: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-11T00:04:58.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:04:58 smithi111 ceph-mon[27539]: pgmap v258: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-11T00:04:58.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:04:58 smithi203 ceph-mon[33225]: pgmap v258: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-11T00:05:00.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:00 smithi111 ceph-mon[27539]: pgmap v259: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-11T00:05:00.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:00 smithi203 ceph-mon[33225]: pgmap v259: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-11T00:05:01.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:01 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:05:01.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:01 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:05:02.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:02 smithi111 ceph-mon[27539]: pgmap v260: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:02.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:02 smithi203 ceph-mon[33225]: pgmap v260: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:04.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:04 smithi111 ceph-mon[27539]: pgmap v261: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:04.521 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:04 smithi203 ceph-mon[33225]: pgmap v261: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:06.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:06 smithi111 ceph-mon[27539]: pgmap v262: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:06.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:06 smithi203 ceph-mon[33225]: pgmap v262: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:08.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:08 smithi111 ceph-mon[27539]: pgmap v263: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:08.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:08 smithi203 ceph-mon[33225]: pgmap v263: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:10.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:10 smithi111 ceph-mon[27539]: pgmap v264: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:10.440 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:10 smithi203 ceph-mon[33225]: pgmap v264: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:12.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:12 smithi111 ceph-mon[27539]: pgmap v265: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:12.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:12 smithi203 ceph-mon[33225]: pgmap v265: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:14.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:14 smithi111 ceph-mon[27539]: pgmap v266: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:14.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:14 smithi203 ceph-mon[33225]: pgmap v266: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:16.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:16 smithi111 ceph-mon[27539]: pgmap v267: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:16.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:16 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:05:16.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:16 smithi203 ceph-mon[33225]: pgmap v267: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:16.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:16 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:05:18.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:18 smithi203 ceph-mon[33225]: pgmap v268: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:18.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:18 smithi111 ceph-mon[27539]: pgmap v268: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:20.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:20 smithi203 ceph-mon[33225]: pgmap v269: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:20.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:20 smithi111 ceph-mon[27539]: pgmap v269: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:22.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:22 smithi203 ceph-mon[33225]: pgmap v270: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:22.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:22 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:05:22.555 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:22 smithi111 ceph-mon[27539]: pgmap v270: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:22.555 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:22 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:05:24.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:24 smithi111 ceph-mon[27539]: pgmap v271: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:24.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:24 smithi203 ceph-mon[33225]: pgmap v271: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:26.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:26 smithi203 ceph-mon[33225]: pgmap v272: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:26.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:26 smithi111 ceph-mon[27539]: pgmap v272: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:28.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:28 smithi203 ceph-mon[33225]: pgmap v273: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:28.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:28 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:05:28.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:28 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:05:28.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:28 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:05:28.621 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:28 smithi111 ceph-mon[27539]: pgmap v273: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:28.621 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:28 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:05:28.621 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:28 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:05:28.622 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:28 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:05:30.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:30 smithi203 ceph-mon[33225]: pgmap v274: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:30.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:30 smithi111 ceph-mon[27539]: pgmap v274: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:31.493 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:31 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:05:31.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:31 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:05:32.500 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:32 smithi111 ceph-mon[27539]: pgmap v275: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:32.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:32 smithi203 ceph-mon[33225]: pgmap v275: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:32.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:32.656+0000 7ff136000700 1 -- 172.21.15.111:0/2347983187 <== mgr.14211 v2:172.21.15.111:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7ff138105ba0 con 0x7ff11c06c680 2024-09-11T00:05:32.658 INFO:teuthology.orchestra.run.smithi111.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:05:32.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:32.659+0000 7ff13de00700 1 -- 172.21.15.111:0/2347983187 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff11c06c680 msgr2=0x7ff11c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:32.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:32.659+0000 7ff13de00700 1 --2- 172.21.15.111:0/2347983187 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff11c06c680 0x7ff11c06eb30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff124011490 tx=0x7ff124009260 comp rx=0 tx=0).stop 2024-09-11T00:05:32.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:32.659+0000 7ff13de00700 1 -- 172.21.15.111:0/2347983187 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1380fffa0 msgr2=0x7ff138074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:32.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:32.659+0000 7ff13de00700 1 --2- 172.21.15.111:0/2347983187 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1380fffa0 0x7ff138074af0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff128000c00 tx=0x7ff12800f690 comp rx=0 tx=0).stop 2024-09-11T00:05:32.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:32.660+0000 7ff13de00700 1 -- 172.21.15.111:0/2347983187 shutdown_connections 2024-09-11T00:05:32.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:32.660+0000 7ff13de00700 1 --2- 172.21.15.111:0/2347983187 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7ff11c06c680 0x7ff11c06eb30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:32.660+0000 7ff13de00700 1 --2- 172.21.15.111:0/2347983187 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1380fffa0 0x7ff138074af0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:32.660+0000 7ff13de00700 1 --2- 172.21.15.111:0/2347983187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1381011a0 0x7ff138073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:32.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:32.660+0000 7ff13de00700 1 -- 172.21.15.111:0/2347983187 >> 172.21.15.111:0/2347983187 conn(0x7ff1380fb510 msgr2=0x7ff1381043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:32.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:32.660+0000 7ff13de00700 1 -- 172.21.15.111:0/2347983187 shutdown_connections 2024-09-11T00:05:32.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:32.660+0000 7ff13de00700 1 -- 172.21.15.111:0/2347983187 wait complete. 2024-09-11T00:05:33.886 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -e sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-11T00:05:33.954 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:33 smithi111 ceph-mon[27539]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:05:33.954 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:33 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:05:33.955 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:33 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:05:33.955 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:33 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:05:33.955 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:33 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:05:33.955 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:33 smithi111 ceph-mon[27539]: pgmap v276: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:33.956 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:33 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:05:33.956 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:33 smithi111 ceph-mon[27539]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:05:34.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:33 smithi203 ceph-mon[33225]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:05:34.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:33 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:05:34.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:33 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:05:34.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:33 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:05:34.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:33 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:05:34.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:33 smithi203 ceph-mon[33225]: pgmap v276: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:34.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:33 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:05:34.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:33 smithi203 ceph-mon[33225]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:05:34.724 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:05:35.865 INFO:tasks.workunit.client.1.smithi203.stderr:Updating files: 65% (7886/12088) Updating files: 66% (7979/12088) Updating files: 67% (8099/12088) Updating files: 68% (8220/12088) Updating files: 69% (8341/12088) Updating files: 70% (8462/12088) Updating files: 71% (8583/12088) Updating files: 72% (8704/12088) Updating files: 73% (8825/12088) Updating files: 74% (8946/12088) Updating files: 75% (9066/12088) Updating files: 76% (9187/12088) Updating files: 77% (9308/12088) Updating files: 78% (9429/12088) Updating files: 79% (9550/12088) Updating files: 80% (9671/12088) Updating files: 81% (9792/12088) Updating files: 82% (9913/12088) Updating files: 83% (10034/12088) Updating files: 84% (10154/12088) Updating files: 85% (10275/12088) Updating files: 86% (10396/12088) Updating files: 87% (10517/12088) Updating files: 88% (10638/12088) Updating files: 89% (10759/12088) Updating files: 90% (10880/12088) Updating files: 91% (11001/12088) Updating files: 92% (11121/12088) Updating files: 93% (11242/12088) Updating files: 94% (11363/12088) Updating files: 95% (11484/12088) Updating files: 96% (11605/12088) Updating files: 97% (11726/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-09-11T00:05:35.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:35 smithi111 ceph-mon[27539]: pgmap v277: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:36.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:35 smithi203 ceph-mon[33225]: pgmap v277: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:37.264 INFO:tasks.workunit.client.1.smithi203.stderr:Note: switching to '8f219c476cb4f26fc5719c661c0323719a45cb30'. 2024-09-11T00:05:37.264 INFO:tasks.workunit.client.1.smithi203.stderr: 2024-09-11T00:05:37.264 INFO:tasks.workunit.client.1.smithi203.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-11T00:05:37.264 INFO:tasks.workunit.client.1.smithi203.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-11T00:05:37.264 INFO:tasks.workunit.client.1.smithi203.stderr:state without impacting any branches by switching back to a branch. 2024-09-11T00:05:37.264 INFO:tasks.workunit.client.1.smithi203.stderr: 2024-09-11T00:05:37.264 INFO:tasks.workunit.client.1.smithi203.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-11T00:05:37.265 INFO:tasks.workunit.client.1.smithi203.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-11T00:05:37.265 INFO:tasks.workunit.client.1.smithi203.stderr: 2024-09-11T00:05:37.265 INFO:tasks.workunit.client.1.smithi203.stderr: git switch -c 2024-09-11T00:05:37.265 INFO:tasks.workunit.client.1.smithi203.stderr: 2024-09-11T00:05:37.265 INFO:tasks.workunit.client.1.smithi203.stderr:Or undo this operation with: 2024-09-11T00:05:37.265 INFO:tasks.workunit.client.1.smithi203.stderr: 2024-09-11T00:05:37.265 INFO:tasks.workunit.client.1.smithi203.stderr: git switch - 2024-09-11T00:05:37.265 INFO:tasks.workunit.client.1.smithi203.stderr: 2024-09-11T00:05:37.265 INFO:tasks.workunit.client.1.smithi203.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-11T00:05:37.265 INFO:tasks.workunit.client.1.smithi203.stderr: 2024-09-11T00:05:37.265 INFO:tasks.workunit.client.1.smithi203.stderr:HEAD is now at 8f219c476cb Merge branch 'mgr-vol-mod-disable' of https://github.com/rishabh-d-dave/ceph into wip-hemanth-testing-2024-09-10-0723 2024-09-11T00:05:37.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.267+0000 7f007a600700 1 -- 172.21.15.111:0/2957992539 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f00740fff90 msgr2=0x7f00741003a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:37.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.267+0000 7f007a600700 1 --2- 172.21.15.111:0/2957992539 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f00740fff90 0x7f00741003a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0068009910 tx=0x7f0068009c20 comp rx=0 tx=0).stop 2024-09-11T00:05:37.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.268+0000 7f007a600700 1 -- 172.21.15.111:0/2957992539 shutdown_connections 2024-09-11T00:05:37.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.268+0000 7f007a600700 1 --2- 172.21.15.111:0/2957992539 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0074101190 0x7f00741015e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.268+0000 7f007a600700 1 --2- 172.21.15.111:0/2957992539 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f00740fff90 0x7f00741003a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.268+0000 7f007a600700 1 -- 172.21.15.111:0/2957992539 >> 172.21.15.111:0/2957992539 conn(0x7f00740fb500 msgr2=0x7f00740fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:37.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.268+0000 7f007a600700 1 -- 172.21.15.111:0/2957992539 shutdown_connections 2024-09-11T00:05:37.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.268+0000 7f007a600700 1 -- 172.21.15.111:0/2957992539 wait complete. 2024-09-11T00:05:37.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.269+0000 7f007a600700 1 Processor -- start 2024-09-11T00:05:37.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.270+0000 7f007a600700 1 -- start start 2024-09-11T00:05:37.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.271+0000 7f007a600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f00740fff90 0x7f00741979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:37.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.271+0000 7f007a600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0074101190 0x7f0074197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:37.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.271+0000 7f007a600700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0074198520 con 0x7f00740fff90 2024-09-11T00:05:37.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.271+0000 7f007a600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0074198660 con 0x7f0074101190 2024-09-11T00:05:37.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.271+0000 7f0079200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f00740fff90 0x7f00741979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:37.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.271+0000 7f0079200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f00740fff90 0x7f00741979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:57298/0 (socket says 172.21.15.111:57298) 2024-09-11T00:05:37.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.271+0000 7f0073e00700 1 --2- 172.21.15.111:0/4231377611 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0074101190 0x7f0074197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:37.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.271+0000 7f0079200700 1 -- 172.21.15.111:0/4231377611 learned_addr learned my addr 172.21.15.111:0/4231377611 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:05:37.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.272+0000 7f0079200700 1 -- 172.21.15.111:0/4231377611 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0074101190 msgr2=0x7f0074197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:37.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.272+0000 7f0079200700 1 --2- 172.21.15.111:0/4231377611 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0074101190 0x7f0074197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.272+0000 7f0079200700 1 -- 172.21.15.111:0/4231377611 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00680095f0 con 0x7f00740fff90 2024-09-11T00:05:37.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.272+0000 7f0079200700 1 --2- 172.21.15.111:0/4231377611 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f00740fff90 0x7f00741979c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f006800f690 tx=0x7f006800f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:37.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.272+0000 7f0071600700 1 -- 172.21.15.111:0/4231377611 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f006801d070 con 0x7f00740fff90 2024-09-11T00:05:37.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.273+0000 7f007a600700 1 -- 172.21.15.111:0/4231377611 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007419d0b0 con 0x7f00740fff90 2024-09-11T00:05:37.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.273+0000 7f007a600700 1 -- 172.21.15.111:0/4231377611 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007419d5a0 con 0x7f00740fff90 2024-09-11T00:05:37.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.273+0000 7f0071600700 1 -- 172.21.15.111:0/4231377611 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0068005dc0 con 0x7f00740fff90 2024-09-11T00:05:37.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.273+0000 7f0071600700 1 -- 172.21.15.111:0/4231377611 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0068017630 con 0x7f00740fff90 2024-09-11T00:05:37.277 DEBUG:teuthology.orchestra.run.smithi203:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-11T00:05:37.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.274+0000 7f007a600700 1 -- 172.21.15.111:0/4231377611 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0054005320 con 0x7f00740fff90 2024-09-11T00:05:37.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.276+0000 7f0071600700 1 -- 172.21.15.111:0/4231377611 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f0068003680 con 0x7f00740fff90 2024-09-11T00:05:37.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.281+0000 7f0071600700 1 --2- 172.21.15.111:0/4231377611 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f005c06c680 0x7f005c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:37.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.281+0000 7f0071600700 1 -- 172.21.15.111:0/4231377611 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f006808cd10 con 0x7f00740fff90 2024-09-11T00:05:37.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.281+0000 7f0073e00700 1 --2- 172.21.15.111:0/4231377611 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f005c06c680 0x7f005c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:37.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.282+0000 7f0073e00700 1 --2- 172.21.15.111:0/4231377611 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f005c06c680 0x7f005c06eb30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0060009bf0 tx=0x7f0060009260 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:37.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.283+0000 7f0071600700 1 -- 172.21.15.111:0/4231377611 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f006805aeb0 con 0x7f00740fff90 2024-09-11T00:05:37.364 INFO:tasks.workunit.client.1.smithi203.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-11T00:05:37.369 INFO:tasks.workunit.client.1.smithi203.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-11T00:05:37.369 INFO:tasks.workunit.client.1.smithi203.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-11T00:05:37.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.617+0000 7f007a600700 1 -- 172.21.15.111:0/4231377611 --> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0054000bf0 con 0x7f005c06c680 2024-09-11T00:05:37.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.619+0000 7f0071600700 1 -- 172.21.15.111:0/4231377611 <== mgr.14211 v2:172.21.15.111:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f0054000bf0 con 0x7f005c06c680 2024-09-11T00:05:37.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.621+0000 7f007a600700 1 -- 172.21.15.111:0/4231377611 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f005c06c680 msgr2=0x7f005c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:37.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.621+0000 7f007a600700 1 --2- 172.21.15.111:0/4231377611 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f005c06c680 0x7f005c06eb30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0060009bf0 tx=0x7f0060009260 comp rx=0 tx=0).stop 2024-09-11T00:05:37.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.621+0000 7f007a600700 1 -- 172.21.15.111:0/4231377611 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f00740fff90 msgr2=0x7f00741979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:37.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.621+0000 7f007a600700 1 --2- 172.21.15.111:0/4231377611 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f00740fff90 0x7f00741979c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f006800f690 tx=0x7f006800f770 comp rx=0 tx=0).stop 2024-09-11T00:05:37.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.622+0000 7f007a600700 1 -- 172.21.15.111:0/4231377611 shutdown_connections 2024-09-11T00:05:37.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.622+0000 7f007a600700 1 --2- 172.21.15.111:0/4231377611 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f005c06c680 0x7f005c06eb30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.622+0000 7f007a600700 1 --2- 172.21.15.111:0/4231377611 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f00740fff90 0x7f00741979c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.622+0000 7f007a600700 1 --2- 172.21.15.111:0/4231377611 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0074101190 0x7f0074197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.622+0000 7f007a600700 1 -- 172.21.15.111:0/4231377611 >> 172.21.15.111:0/4231377611 conn(0x7f00740fb500 msgr2=0x7f00741023b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:37.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.622+0000 7f007a600700 1 -- 172.21.15.111:0/4231377611 shutdown_connections 2024-09-11T00:05:37.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.622+0000 7f007a600700 1 -- 172.21.15.111:0/4231377611 wait complete. 2024-09-11T00:05:37.639 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:05:37.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.788+0000 7fec9fe00700 1 -- 172.21.15.111:0/3069958427 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feca0101190 msgr2=0x7feca01015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:37.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.788+0000 7fec9fe00700 1 --2- 172.21.15.111:0/3069958427 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feca0101190 0x7feca01015e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fec8c009910 tx=0x7fec8c009c20 comp rx=0 tx=0).stop 2024-09-11T00:05:37.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.788+0000 7fec9fe00700 1 -- 172.21.15.111:0/3069958427 shutdown_connections 2024-09-11T00:05:37.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.788+0000 7fec9fe00700 1 --2- 172.21.15.111:0/3069958427 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feca0101190 0x7feca01015e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.788+0000 7fec9fe00700 1 --2- 172.21.15.111:0/3069958427 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feca00fff90 0x7feca01003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.788+0000 7fec9fe00700 1 -- 172.21.15.111:0/3069958427 >> 172.21.15.111:0/3069958427 conn(0x7feca00fb500 msgr2=0x7feca00fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:37.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.788+0000 7fec9fe00700 1 -- 172.21.15.111:0/3069958427 shutdown_connections 2024-09-11T00:05:37.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.788+0000 7fec9fe00700 1 -- 172.21.15.111:0/3069958427 wait complete. 2024-09-11T00:05:37.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.789+0000 7fec9fe00700 1 Processor -- start 2024-09-11T00:05:37.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.790+0000 7fec9fe00700 1 -- start start 2024-09-11T00:05:37.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.790+0000 7fec9fe00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feca00fff90 0x7feca01979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:37.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.790+0000 7fec9fe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feca0101190 0x7feca0197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:37.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.790+0000 7fec9fe00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca0198510 con 0x7feca0101190 2024-09-11T00:05:37.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.790+0000 7fec9fe00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca0198650 con 0x7feca00fff90 2024-09-11T00:05:37.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.790+0000 7fec9ea00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feca00fff90 0x7feca01979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:37.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.790+0000 7fec9e000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feca0101190 0x7feca0197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:37.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.790+0000 7fec9ea00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feca00fff90 0x7feca01979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.111:43704/0 (socket says 172.21.15.111:43704) 2024-09-11T00:05:37.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.790+0000 7fec9ea00700 1 -- 172.21.15.111:0/1771803856 learned_addr learned my addr 172.21.15.111:0/1771803856 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:05:37.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.791+0000 7fec9ea00700 1 -- 172.21.15.111:0/1771803856 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feca0101190 msgr2=0x7feca0197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:37.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.791+0000 7fec9ea00700 1 --2- 172.21.15.111:0/1771803856 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feca0101190 0x7feca0197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:37.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.791+0000 7fec9ea00700 1 -- 172.21.15.111:0/1771803856 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec90009520 con 0x7feca00fff90 2024-09-11T00:05:37.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.791+0000 7fec9e000700 1 --2- 172.21.15.111:0/1771803856 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feca0101190 0x7feca0197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:05:37.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.791+0000 7fec9ea00700 1 --2- 172.21.15.111:0/1771803856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feca00fff90 0x7feca01979b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fec9000e9d0 tx=0x7fec9000ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:37.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.792+0000 7fec97400700 1 -- 172.21.15.111:0/1771803856 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec9000cba0 con 0x7feca00fff90 2024-09-11T00:05:37.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.792+0000 7fec97400700 1 -- 172.21.15.111:0/1771803856 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fec9000cd00 con 0x7feca00fff90 2024-09-11T00:05:37.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.792+0000 7fec9fe00700 1 -- 172.21.15.111:0/1771803856 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec8c0095f0 con 0x7feca00fff90 2024-09-11T00:05:37.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.792+0000 7fec97400700 1 -- 172.21.15.111:0/1771803856 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec90018770 con 0x7feca00fff90 2024-09-11T00:05:37.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.792+0000 7fec9fe00700 1 -- 172.21.15.111:0/1771803856 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca019d4c0 con 0x7feca00fff90 2024-09-11T00:05:37.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.793+0000 7fec9fe00700 1 -- 172.21.15.111:0/1771803856 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca0105270 con 0x7feca00fff90 2024-09-11T00:05:37.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.795+0000 7fec97400700 1 -- 172.21.15.111:0/1771803856 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fec900189e0 con 0x7feca00fff90 2024-09-11T00:05:37.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.796+0000 7fec97400700 1 --2- 172.21.15.111:0/1771803856 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fec8406c680 0x7fec8406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:37.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.796+0000 7fec97400700 1 -- 172.21.15.111:0/1771803856 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fec90014070 con 0x7feca00fff90 2024-09-11T00:05:37.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.796+0000 7fec9e000700 1 --2- 172.21.15.111:0/1771803856 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fec8406c680 0x7fec8406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:37.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.797+0000 7fec9e000700 1 --2- 172.21.15.111:0/1771803856 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fec8406c680 0x7fec8406eb30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fec8c009fd0 tx=0x7fec8c005fd0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:37.802 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:37.800+0000 7fec97400700 1 -- 172.21.15.111:0/1771803856 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fec90059f50 con 0x7feca00fff90 2024-09-11T00:05:37.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:37 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:05:37.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:37 smithi111 ceph-mon[27539]: Upgrade: Target is version 19.3.0-4854-g8f219c47 (unknown) 2024-09-11T00:05:37.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:37 smithi111 ceph-mon[27539]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, digests ['quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e'] 2024-09-11T00:05:37.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:37 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:05:37.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:37 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:05:37.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:37 smithi111 ceph-mon[27539]: Upgrade: Need to upgrade myself (mgr.smithi111.ypucji) 2024-09-11T00:05:37.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:37 smithi111 ceph-mon[27539]: pgmap v278: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:37.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:37 smithi111 ceph-mon[27539]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e on smithi203 2024-09-11T00:05:38.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.026+0000 7fec9fe00700 1 -- 172.21.15.111:0/1771803856 --> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feca0061190 con 0x7fec8406c680 2024-09-11T00:05:38.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.028+0000 7fec97400700 1 -- 172.21.15.111:0/1771803856 <== mgr.14211 v2:172.21.15.111:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7feca0061190 con 0x7fec8406c680 2024-09-11T00:05:38.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.030+0000 7fec9fe00700 1 -- 172.21.15.111:0/1771803856 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fec8406c680 msgr2=0x7fec8406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:38.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.030+0000 7fec9fe00700 1 --2- 172.21.15.111:0/1771803856 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fec8406c680 0x7fec8406eb30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fec8c009fd0 tx=0x7fec8c005fd0 comp rx=0 tx=0).stop 2024-09-11T00:05:38.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.030+0000 7fec9fe00700 1 -- 172.21.15.111:0/1771803856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feca00fff90 msgr2=0x7feca01979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:38.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.030+0000 7fec9fe00700 1 --2- 172.21.15.111:0/1771803856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feca00fff90 0x7feca01979b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fec9000e9d0 tx=0x7fec9000ece0 comp rx=0 tx=0).stop 2024-09-11T00:05:38.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.030+0000 7fec9fe00700 1 -- 172.21.15.111:0/1771803856 shutdown_connections 2024-09-11T00:05:38.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.030+0000 7fec9fe00700 1 --2- 172.21.15.111:0/1771803856 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fec8406c680 0x7fec8406eb30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:38.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.030+0000 7fec9fe00700 1 --2- 172.21.15.111:0/1771803856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feca00fff90 0x7feca01979b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:38.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.030+0000 7fec9fe00700 1 --2- 172.21.15.111:0/1771803856 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feca0101190 0x7feca0197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:38.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.030+0000 7fec9fe00700 1 -- 172.21.15.111:0/1771803856 >> 172.21.15.111:0/1771803856 conn(0x7feca00fb500 msgr2=0x7feca01023b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:38.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.031+0000 7fec9fe00700 1 -- 172.21.15.111:0/1771803856 shutdown_connections 2024-09-11T00:05:38.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.031+0000 7fec9fe00700 1 -- 172.21.15.111:0/1771803856 wait complete. 2024-09-11T00:05:38.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:37 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:05:38.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:37 smithi203 ceph-mon[33225]: Upgrade: Target is version 19.3.0-4854-g8f219c47 (unknown) 2024-09-11T00:05:38.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:37 smithi203 ceph-mon[33225]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, digests ['quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e'] 2024-09-11T00:05:38.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:37 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:05:38.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:37 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:05:38.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:37 smithi203 ceph-mon[33225]: Upgrade: Need to upgrade myself (mgr.smithi111.ypucji) 2024-09-11T00:05:38.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:37 smithi203 ceph-mon[33225]: pgmap v278: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:38.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:37 smithi203 ceph-mon[33225]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e on smithi203 2024-09-11T00:05:38.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.218+0000 7f5b4e000700 1 -- 172.21.15.111:0/1896506938 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b48100a20 msgr2=0x7f5b48102e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:38.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.218+0000 7f5b4e000700 1 --2- 172.21.15.111:0/1896506938 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b48100a20 0x7f5b48102e00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c009910 tx=0x7f5b3c009c20 comp rx=0 tx=0).stop 2024-09-11T00:05:38.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.218+0000 7f5b4e000700 1 -- 172.21.15.111:0/1896506938 shutdown_connections 2024-09-11T00:05:38.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.218+0000 7f5b4e000700 1 --2- 172.21.15.111:0/1896506938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b48103340 0x7f5b48105720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:38.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.218+0000 7f5b4e000700 1 --2- 172.21.15.111:0/1896506938 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b48100a20 0x7f5b48102e00 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:38.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.218+0000 7f5b4e000700 1 -- 172.21.15.111:0/1896506938 >> 172.21.15.111:0/1896506938 conn(0x7f5b480fa440 msgr2=0x7f5b480fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:38.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.218+0000 7f5b4e000700 1 -- 172.21.15.111:0/1896506938 shutdown_connections 2024-09-11T00:05:38.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.218+0000 7f5b4e000700 1 -- 172.21.15.111:0/1896506938 wait complete. 2024-09-11T00:05:38.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.219+0000 7f5b4e000700 1 Processor -- start 2024-09-11T00:05:38.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.220+0000 7f5b4e000700 1 -- start start 2024-09-11T00:05:38.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.220+0000 7f5b4e000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b48100a20 0x7f5b48197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:38.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.220+0000 7f5b4e000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b48103340 0x7f5b48197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:38.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.220+0000 7f5b4e000700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b481984e0 con 0x7f5b48103340 2024-09-11T00:05:38.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.220+0000 7f5b4e000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b48198620 con 0x7f5b48100a20 2024-09-11T00:05:38.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.220+0000 7f5b4cc00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b48100a20 0x7f5b48197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:38.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.220+0000 7f5b4cc00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b48100a20 0x7f5b48197980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.111:43730/0 (socket says 172.21.15.111:43730) 2024-09-11T00:05:38.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.220+0000 7f5b4cc00700 1 -- 172.21.15.111:0/3787301559 learned_addr learned my addr 172.21.15.111:0/3787301559 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:05:38.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.220+0000 7f5b47e00700 1 --2- 172.21.15.111:0/3787301559 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b48103340 0x7f5b48197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:38.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.221+0000 7f5b4cc00700 1 -- 172.21.15.111:0/3787301559 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b48103340 msgr2=0x7f5b48197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:38.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.221+0000 7f5b4cc00700 1 --2- 172.21.15.111:0/3787301559 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b48103340 0x7f5b48197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:38.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.221+0000 7f5b4cc00700 1 -- 172.21.15.111:0/3787301559 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3c0095f0 con 0x7f5b48100a20 2024-09-11T00:05:38.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.221+0000 7f5b4cc00700 1 --2- 172.21.15.111:0/3787301559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b48100a20 0x7f5b48197980 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c000c00 tx=0x7f5b3c00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:38.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.222+0000 7f5b45600700 1 -- 172.21.15.111:0/3787301559 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b3c01d070 con 0x7f5b48100a20 2024-09-11T00:05:38.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.222+0000 7f5b45600700 1 -- 172.21.15.111:0/3787301559 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5b3c005dc0 con 0x7f5b48100a20 2024-09-11T00:05:38.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.222+0000 7f5b4e000700 1 -- 172.21.15.111:0/3787301559 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b4819d070 con 0x7f5b48100a20 2024-09-11T00:05:38.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.222+0000 7f5b45600700 1 -- 172.21.15.111:0/3787301559 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b3c0226a0 con 0x7f5b48100a20 2024-09-11T00:05:38.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.222+0000 7f5b4e000700 1 -- 172.21.15.111:0/3787301559 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b4819d560 con 0x7f5b48100a20 2024-09-11T00:05:38.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.223+0000 7f5b4e000700 1 -- 172.21.15.111:0/3787301559 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b480fc000 con 0x7f5b48100a20 2024-09-11T00:05:38.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.225+0000 7f5b45600700 1 -- 172.21.15.111:0/3787301559 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f5b3c0038f0 con 0x7f5b48100a20 2024-09-11T00:05:38.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.226+0000 7f5b45600700 1 --2- 172.21.15.111:0/3787301559 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5b3006c680 0x7f5b3006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:38.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.226+0000 7f5b45600700 1 -- 172.21.15.111:0/3787301559 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f5b3c08cf80 con 0x7f5b48100a20 2024-09-11T00:05:38.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.226+0000 7f5b47e00700 1 --2- 172.21.15.111:0/3787301559 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5b3006c680 0x7f5b3006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:38.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.227+0000 7f5b47e00700 1 --2- 172.21.15.111:0/3787301559 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5b3006c680 0x7f5b3006eb30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009c60 tx=0x7f5b34009260 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:38.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.231+0000 7f5b45600700 1 -- 172.21.15.111:0/3787301559 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5b3c0bf720 con 0x7f5b48100a20 2024-09-11T00:05:38.337 INFO:tasks.workunit.client.1.smithi203.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-11T00:05:38.460 INFO:tasks.workunit.client.1.smithi203.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-11T00:05:38.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.487+0000 7f5b4e000700 1 -- 172.21.15.111:0/3787301559 --> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b48061190 con 0x7f5b3006c680 2024-09-11T00:05:38.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.498+0000 7f5b45600700 1 -- 172.21.15.111:0/3787301559 <== mgr.14211 v2:172.21.15.111:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3528 (secure 0 0 0) 0x7f5b48061190 con 0x7f5b3006c680 2024-09-11T00:05:38.500 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:05:38.500 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (6m) 76s ago 8m 13.3M - 0.25.0 c8568f914cd2 eb9e393000ec 2024-09-11T00:05:38.500 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (9m) 76s ago 9m 7453k - 18.2.0 dc2bc1663786 b6e7b6bd4d27 2024-09-11T00:05:38.500 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi203 smithi203 running (7m) 82s ago 7m 7360k - 18.2.0 dc2bc1663786 7bbfd9c27900 2024-09-11T00:05:38.501 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (9m) 76s ago 8m 6665k - 18.2.0 dc2bc1663786 72a36c166ffa 2024-09-11T00:05:38.501 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi203 smithi203 running (7m) 82s ago 7m 6669k - 18.2.0 dc2bc1663786 9b102b6f6d70 2024-09-11T00:05:38.501 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (6m) 76s ago 8m 75.0M - 9.4.7 954c08fa6188 e599624a9c9e 2024-09-11T00:05:38.501 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.gmgsay smithi111 running (107s) 76s ago 106s 11.6M - 18.2.0 dc2bc1663786 795e4ff0075c 2024-09-11T00:05:38.501 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.rucaba smithi111 running (99s) 76s ago 98s 11.6M - 18.2.0 dc2bc1663786 02885adac62c 2024-09-11T00:05:38.501 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.tcrqop smithi203 running (103s) 82s ago 103s 14.1M - 18.2.0 dc2bc1663786 4df492159bb4 2024-09-11T00:05:38.501 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.uqkbkn smithi203 running (96s) 82s ago 95s 11.5M - 18.2.0 dc2bc1663786 619aa58ea314 2024-09-11T00:05:38.501 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.ypucji smithi111 *:9283,8765,8443 running (10m) 76s ago 10m 488M - 18.2.0 dc2bc1663786 0329ec697a09 2024-09-11T00:05:38.501 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi203.smuspl smithi203 *:8443,9283,8765 running (7m) 82s ago 7m 437M - 18.2.0 dc2bc1663786 9f1086684d72 2024-09-11T00:05:38.501 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (10m) 76s ago 10m 44.6M 2048M 18.2.0 dc2bc1663786 2596322539fb 2024-09-11T00:05:38.501 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi203 smithi203 running (7m) 82s ago 7m 34.0M 2048M 18.2.0 dc2bc1663786 ff8eb7ca85ea 2024-09-11T00:05:38.501 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (8m) 76s ago 8m 7604k - 1.5.0 0da6a335fe13 4fd66ebc9c0d 2024-09-11T00:05:38.501 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi203 smithi203 *:9100 running (7m) 82s ago 7m 7600k - 1.5.0 0da6a335fe13 1cb3ca740f4a 2024-09-11T00:05:38.501 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (6m) 76s ago 6m 46.8M 3947M 18.2.0 dc2bc1663786 162b7249a591 2024-09-11T00:05:38.502 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (5m) 76s ago 5m 46.7M 3947M 18.2.0 dc2bc1663786 3614d95b1425 2024-09-11T00:05:38.502 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (4m) 76s ago 4m 45.2M 3947M 18.2.0 dc2bc1663786 db175d4b09b9 2024-09-11T00:05:38.502 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi203 running (4m) 82s ago 4m 45.3M 4971M 18.2.0 dc2bc1663786 60b1cef7a70d 2024-09-11T00:05:38.502 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi203 running (3m) 82s ago 3m 42.8M 4971M 18.2.0 dc2bc1663786 769c7942c42b 2024-09-11T00:05:38.502 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi203 running (3m) 82s ago 3m 42.6M 4971M 18.2.0 dc2bc1663786 6d824001d40c 2024-09-11T00:05:38.502 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (6m) 76s ago 8m 62.5M - 2.43.0 a07b618ecd1d bd707157a41b 2024-09-11T00:05:38.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.501+0000 7f5b4e000700 1 -- 172.21.15.111:0/3787301559 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5b3006c680 msgr2=0x7f5b3006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:38.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.501+0000 7f5b4e000700 1 --2- 172.21.15.111:0/3787301559 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5b3006c680 0x7f5b3006eb30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009c60 tx=0x7f5b34009260 comp rx=0 tx=0).stop 2024-09-11T00:05:38.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.501+0000 7f5b4e000700 1 -- 172.21.15.111:0/3787301559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b48100a20 msgr2=0x7f5b48197980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:38.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.501+0000 7f5b4e000700 1 --2- 172.21.15.111:0/3787301559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b48100a20 0x7f5b48197980 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c000c00 tx=0x7f5b3c00f690 comp rx=0 tx=0).stop 2024-09-11T00:05:38.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.501+0000 7f5b4e000700 1 -- 172.21.15.111:0/3787301559 shutdown_connections 2024-09-11T00:05:38.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.501+0000 7f5b4e000700 1 --2- 172.21.15.111:0/3787301559 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5b3006c680 0x7f5b3006eb30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:38.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.501+0000 7f5b4e000700 1 --2- 172.21.15.111:0/3787301559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b48100a20 0x7f5b48197980 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:38.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.501+0000 7f5b4e000700 1 --2- 172.21.15.111:0/3787301559 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b48103340 0x7f5b48197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:38.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.501+0000 7f5b4e000700 1 -- 172.21.15.111:0/3787301559 >> 172.21.15.111:0/3787301559 conn(0x7f5b480fa440 msgr2=0x7f5b48103fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:38.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.501+0000 7f5b4e000700 1 -- 172.21.15.111:0/3787301559 shutdown_connections 2024-09-11T00:05:38.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.501+0000 7f5b4e000700 1 -- 172.21.15.111:0/3787301559 wait complete. 2024-09-11T00:05:38.545 INFO:tasks.workunit.client.1.smithi203.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-11T00:05:38.550 INFO:tasks.workunit.client.1.smithi203.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-11T00:05:38.550 INFO:tasks.workunit.client.1.smithi203.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-11T00:05:38.637 INFO:tasks.workunit.client.1.smithi203.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-11T00:05:38.646 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-11T00:05:38.646 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-11T00:05:38.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.646+0000 7fa287e00700 1 -- 172.21.15.111:0/2753827520 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa2881011c0 msgr2=0x7fa288101610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:38.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.646+0000 7fa287e00700 1 --2- 172.21.15.111:0/2753827520 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa2881011c0 0x7fa288101610 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa274009910 tx=0x7fa274009c20 comp rx=0 tx=0).stop 2024-09-11T00:05:38.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.646+0000 7fa287e00700 1 -- 172.21.15.111:0/2753827520 shutdown_connections 2024-09-11T00:05:38.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.646+0000 7fa287e00700 1 --2- 172.21.15.111:0/2753827520 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa2881011c0 0x7fa288101610 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:38.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.646+0000 7fa287e00700 1 --2- 172.21.15.111:0/2753827520 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa2880fffc0 0x7fa2881003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:38.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.646+0000 7fa287e00700 1 -- 172.21.15.111:0/2753827520 >> 172.21.15.111:0/2753827520 conn(0x7fa2880fb570 msgr2=0x7fa2880fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:38.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.647+0000 7fa287e00700 1 -- 172.21.15.111:0/2753827520 shutdown_connections 2024-09-11T00:05:38.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.647+0000 7fa287e00700 1 -- 172.21.15.111:0/2753827520 wait complete. 2024-09-11T00:05:38.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.648+0000 7fa287e00700 1 Processor -- start 2024-09-11T00:05:38.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.648+0000 7fa287e00700 1 -- start start 2024-09-11T00:05:38.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.648+0000 7fa287e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa2880fffc0 0x7fa288197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:38.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.648+0000 7fa287e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa2881011c0 0x7fa288197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:38.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.648+0000 7fa287e00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa288198580 con 0x7fa2880fffc0 2024-09-11T00:05:38.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.648+0000 7fa287e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2881986c0 con 0x7fa2881011c0 2024-09-11T00:05:38.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.649+0000 7fa286a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa2880fffc0 0x7fa288197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:38.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.649+0000 7fa286a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa2880fffc0 0x7fa288197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48986/0 (socket says 172.21.15.111:48986) 2024-09-11T00:05:38.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.649+0000 7fa286a00700 1 -- 172.21.15.111:0/2116382449 learned_addr learned my addr 172.21.15.111:0/2116382449 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:05:38.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.649+0000 7fa286000700 1 --2- 172.21.15.111:0/2116382449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa2881011c0 0x7fa288197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:38.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.649+0000 7fa286a00700 1 -- 172.21.15.111:0/2116382449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa2881011c0 msgr2=0x7fa288197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:38.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.649+0000 7fa286a00700 1 --2- 172.21.15.111:0/2116382449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa2881011c0 0x7fa288197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:38.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.649+0000 7fa286a00700 1 -- 172.21.15.111:0/2116382449 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2740095f0 con 0x7fa2880fffc0 2024-09-11T00:05:38.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.650+0000 7fa286a00700 1 --2- 172.21.15.111:0/2116382449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa2880fffc0 0x7fa288197a20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa27800e8f0 tx=0x7fa27800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:38.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.650+0000 7fa27f400700 1 -- 172.21.15.111:0/2116382449 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa278009790 con 0x7fa2880fffc0 2024-09-11T00:05:38.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.650+0000 7fa27f400700 1 -- 172.21.15.111:0/2116382449 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa27800c810 con 0x7fa2880fffc0 2024-09-11T00:05:38.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.650+0000 7fa27f400700 1 -- 172.21.15.111:0/2116382449 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa278003d20 con 0x7fa2880fffc0 2024-09-11T00:05:38.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.650+0000 7fa287e00700 1 -- 172.21.15.111:0/2116382449 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa28819d170 con 0x7fa2880fffc0 2024-09-11T00:05:38.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.650+0000 7fa287e00700 1 -- 172.21.15.111:0/2116382449 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa28819d6c0 con 0x7fa2880fffc0 2024-09-11T00:05:38.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.652+0000 7fa287e00700 1 -- 172.21.15.111:0/2116382449 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2881052a0 con 0x7fa2880fffc0 2024-09-11T00:05:38.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.653+0000 7fa27f400700 1 -- 172.21.15.111:0/2116382449 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fa278018430 con 0x7fa2880fffc0 2024-09-11T00:05:38.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.654+0000 7fa27f400700 1 --2- 172.21.15.111:0/2116382449 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fa26c06c6d0 0x7fa26c06eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:38.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.654+0000 7fa27f400700 1 -- 172.21.15.111:0/2116382449 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fa278014070 con 0x7fa2880fffc0 2024-09-11T00:05:38.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.654+0000 7fa286000700 1 --2- 172.21.15.111:0/2116382449 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fa26c06c6d0 0x7fa26c06eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:38.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.655+0000 7fa286000700 1 --2- 172.21.15.111:0/2116382449 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fa26c06c6d0 0x7fa26c06eb80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa274009fd0 tx=0x7fa274005fd0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:38.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:38.661+0000 7fa27f400700 1 -- 172.21.15.111:0/2116382449 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa278003e80 con 0x7fa2880fffc0 2024-09-11T00:05:38.689 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-11T00:05:38.691 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-11T00:05:38.691 DEBUG:teuthology.orchestra.run.smithi203:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8f219c476cb4f26fc5719c661c0323719a45cb30 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-11T00:05:38.799 INFO:tasks.workunit.client.1.smithi203.stderr:+ mkdir -p fsstress 2024-09-11T00:05:38.805 INFO:tasks.workunit.client.1.smithi203.stderr:+ pushd fsstress 2024-09-11T00:05:38.809 INFO:tasks.workunit.client.1.smithi203.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-11T00:05:38.809 INFO:tasks.workunit.client.1.smithi203.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-11T00:05:38.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:38 smithi111 ceph-mon[27539]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:05:38.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:38 smithi111 ceph-mon[27539]: from='client.24435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:05:39.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:38 smithi203 ceph-mon[33225]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:05:39.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:38 smithi203 ceph-mon[33225]: from='client.24435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:05:39.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.075+0000 7fa287e00700 1 -- 172.21.15.111:0/2116382449 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa28802ce90 con 0x7fa2880fffc0 2024-09-11T00:05:39.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.076+0000 7fa27f400700 1 -- 172.21.15.111:0/2116382449 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7fa278003e80 con 0x7fa2880fffc0 2024-09-11T00:05:39.078 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:05:39.078 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-11T00:05:39.078 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-11T00:05:39.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:05:39.078 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-11T00:05:39.078 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-11T00:05:39.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:05:39.078 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-11T00:05:39.078 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-11T00:05:39.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:05:39.079 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-11T00:05:39.079 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-11T00:05:39.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:05:39.079 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-11T00:05:39.079 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-09-11T00:05:39.079 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-11T00:05:39.079 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:05:39.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.079+0000 7fa287e00700 1 -- 172.21.15.111:0/2116382449 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fa26c06c6d0 msgr2=0x7fa26c06eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:39.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.079+0000 7fa287e00700 1 --2- 172.21.15.111:0/2116382449 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fa26c06c6d0 0x7fa26c06eb80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa274009fd0 tx=0x7fa274005fd0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.079+0000 7fa287e00700 1 -- 172.21.15.111:0/2116382449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa2880fffc0 msgr2=0x7fa288197a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:39.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.079+0000 7fa287e00700 1 --2- 172.21.15.111:0/2116382449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa2880fffc0 0x7fa288197a20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa27800e8f0 tx=0x7fa27800ec00 comp rx=0 tx=0).stop 2024-09-11T00:05:39.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.080+0000 7fa287e00700 1 -- 172.21.15.111:0/2116382449 shutdown_connections 2024-09-11T00:05:39.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.080+0000 7fa287e00700 1 --2- 172.21.15.111:0/2116382449 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fa26c06c6d0 0x7fa26c06eb80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.080+0000 7fa287e00700 1 --2- 172.21.15.111:0/2116382449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa2880fffc0 0x7fa288197a20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.080+0000 7fa287e00700 1 --2- 172.21.15.111:0/2116382449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa2881011c0 0x7fa288197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.080+0000 7fa287e00700 1 -- 172.21.15.111:0/2116382449 >> 172.21.15.111:0/2116382449 conn(0x7fa2880fb570 msgr2=0x7fa2881023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:39.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.080+0000 7fa287e00700 1 -- 172.21.15.111:0/2116382449 shutdown_connections 2024-09-11T00:05:39.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.080+0000 7fa287e00700 1 -- 172.21.15.111:0/2116382449 wait complete. 2024-09-11T00:05:39.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.295+0000 7f5ab9c00700 1 -- 172.21.15.111:0/3399357155 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ab41011a0 msgr2=0x7f5ab41015f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:39.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.295+0000 7f5ab9c00700 1 --2- 172.21.15.111:0/3399357155 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ab41011a0 0x7f5ab41015f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0009910 tx=0x7f5aa0009c20 comp rx=0 tx=0).stop 2024-09-11T00:05:39.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.296+0000 7f5ab9c00700 1 -- 172.21.15.111:0/3399357155 shutdown_connections 2024-09-11T00:05:39.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.296+0000 7f5ab9c00700 1 --2- 172.21.15.111:0/3399357155 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ab41011a0 0x7f5ab41015f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.296+0000 7f5ab9c00700 1 --2- 172.21.15.111:0/3399357155 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ab40fffa0 0x7f5ab41003b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.296+0000 7f5ab9c00700 1 -- 172.21.15.111:0/3399357155 >> 172.21.15.111:0/3399357155 conn(0x7f5ab40fb510 msgr2=0x7f5ab40fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:39.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.296+0000 7f5ab9c00700 1 -- 172.21.15.111:0/3399357155 shutdown_connections 2024-09-11T00:05:39.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.296+0000 7f5ab9c00700 1 -- 172.21.15.111:0/3399357155 wait complete. 2024-09-11T00:05:39.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.297+0000 7f5ab9c00700 1 Processor -- start 2024-09-11T00:05:39.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.297+0000 7f5ab9c00700 1 -- start start 2024-09-11T00:05:39.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.298+0000 7f5ab9c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ab40fffa0 0x7f5ab41957a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:39.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.298+0000 7f5ab9c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ab41011a0 0x7f5ab4195ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:39.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.298+0000 7f5ab9c00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab4196300 con 0x7f5ab41011a0 2024-09-11T00:05:39.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.298+0000 7f5ab9c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab4196440 con 0x7f5ab40fffa0 2024-09-11T00:05:39.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.298+0000 7f5ab3e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ab40fffa0 0x7f5ab41957a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:39.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.298+0000 7f5ab3400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ab41011a0 0x7f5ab4195ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:39.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.298+0000 7f5ab3e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ab40fffa0 0x7f5ab41957a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.111:43766/0 (socket says 172.21.15.111:43766) 2024-09-11T00:05:39.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.298+0000 7f5ab3e00700 1 -- 172.21.15.111:0/2871926988 learned_addr learned my addr 172.21.15.111:0/2871926988 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:05:39.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.299+0000 7f5ab3e00700 1 -- 172.21.15.111:0/2871926988 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ab41011a0 msgr2=0x7f5ab4195ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:39.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.299+0000 7f5ab3e00700 1 --2- 172.21.15.111:0/2871926988 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ab41011a0 0x7f5ab4195ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.299+0000 7f5ab3e00700 1 -- 172.21.15.111:0/2871926988 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa00095f0 con 0x7f5ab40fffa0 2024-09-11T00:05:39.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.299+0000 7f5ab3400700 1 --2- 172.21.15.111:0/2871926988 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ab41011a0 0x7f5ab4195ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:05:39.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.299+0000 7f5ab3e00700 1 --2- 172.21.15.111:0/2871926988 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ab40fffa0 0x7f5ab41957a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5aa400e8f0 tx=0x7f5aa400ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:39.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.300+0000 7f5ab0c00700 1 -- 172.21.15.111:0/2871926988 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5aa4009790 con 0x7f5ab40fffa0 2024-09-11T00:05:39.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.300+0000 7f5ab0c00700 1 -- 172.21.15.111:0/2871926988 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5aa400c810 con 0x7f5ab40fffa0 2024-09-11T00:05:39.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.300+0000 7f5ab9c00700 1 -- 172.21.15.111:0/2871926988 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab419aef0 con 0x7f5ab40fffa0 2024-09-11T00:05:39.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.300+0000 7f5ab0c00700 1 -- 172.21.15.111:0/2871926988 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5aa4003d20 con 0x7f5ab40fffa0 2024-09-11T00:05:39.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.300+0000 7f5ab9c00700 1 -- 172.21.15.111:0/2871926988 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab419b3b0 con 0x7f5ab40fffa0 2024-09-11T00:05:39.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.301+0000 7f5ab9c00700 1 -- 172.21.15.111:0/2871926988 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab4108af0 con 0x7f5ab40fffa0 2024-09-11T00:05:39.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.303+0000 7f5ab0c00700 1 -- 172.21.15.111:0/2871926988 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f5aa40041f0 con 0x7f5ab40fffa0 2024-09-11T00:05:39.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.304+0000 7f5ab0c00700 1 --2- 172.21.15.111:0/2871926988 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5a9806c680 0x7f5a9806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:05:39.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.304+0000 7f5ab0c00700 1 -- 172.21.15.111:0/2871926988 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f5aa4014070 con 0x7f5ab40fffa0 2024-09-11T00:05:39.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.304+0000 7f5ab3400700 1 --2- 172.21.15.111:0/2871926988 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5a9806c680 0x7f5a9806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:05:39.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.305+0000 7f5ab3400700 1 --2- 172.21.15.111:0/2871926988 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5a9806c680 0x7f5a9806eb30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0009fd0 tx=0x7f5aa0005fd0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:05:39.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.310+0000 7f5ab0c00700 1 -- 172.21.15.111:0/2871926988 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5aa4059d90 con 0x7f5ab40fffa0 2024-09-11T00:05:39.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.614+0000 7f5ab9c00700 1 -- 172.21.15.111:0/2871926988 --> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ab4105af0 con 0x7f5a9806c680 2024-09-11T00:05:39.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.616+0000 7f5ab0c00700 1 -- 172.21.15.111:0/2871926988 <== mgr.14211 v2:172.21.15.111:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f5ab4105af0 con 0x7f5a9806c680 2024-09-11T00:05:39.618 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:05:39.618 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e", 2024-09-11T00:05:39.618 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-11T00:05:39.618 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-11T00:05:39.618 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [], 2024-09-11T00:05:39.618 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "0/2 daemons upgraded", 2024-09-11T00:05:39.618 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e image on host smithi203", 2024-09-11T00:05:39.618 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-11T00:05:39.618 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:05:39.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.619+0000 7f5ab9c00700 1 -- 172.21.15.111:0/2871926988 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5a9806c680 msgr2=0x7f5a9806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:39.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.619+0000 7f5ab9c00700 1 --2- 172.21.15.111:0/2871926988 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5a9806c680 0x7f5a9806eb30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0009fd0 tx=0x7f5aa0005fd0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.619+0000 7f5ab9c00700 1 -- 172.21.15.111:0/2871926988 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ab40fffa0 msgr2=0x7f5ab41957a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:05:39.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.619+0000 7f5ab9c00700 1 --2- 172.21.15.111:0/2871926988 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ab40fffa0 0x7f5ab41957a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5aa400e8f0 tx=0x7f5aa400ec00 comp rx=0 tx=0).stop 2024-09-11T00:05:39.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.619+0000 7f5ab9c00700 1 -- 172.21.15.111:0/2871926988 shutdown_connections 2024-09-11T00:05:39.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.619+0000 7f5ab9c00700 1 --2- 172.21.15.111:0/2871926988 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5a9806c680 0x7f5a9806eb30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.619+0000 7f5ab9c00700 1 --2- 172.21.15.111:0/2871926988 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ab40fffa0 0x7f5ab41957a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.619+0000 7f5ab9c00700 1 --2- 172.21.15.111:0/2871926988 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ab41011a0 0x7f5ab4195ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:05:39.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.619+0000 7f5ab9c00700 1 -- 172.21.15.111:0/2871926988 >> 172.21.15.111:0/2871926988 conn(0x7f5ab40fb510 msgr2=0x7f5ab41043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:05:39.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.620+0000 7f5ab9c00700 1 -- 172.21.15.111:0/2871926988 shutdown_connections 2024-09-11T00:05:39.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:05:39.620+0000 7f5ab9c00700 1 -- 172.21.15.111:0/2871926988 wait complete. 2024-09-11T00:05:39.637 INFO:tasks.workunit.client.1.smithi203.stderr:+ tar xzf ltp-full.tgz 2024-09-11T00:05:39.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:39 smithi111 ceph-mon[27539]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:05:39.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:39 smithi111 ceph-mon[27539]: pgmap v279: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:39.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:39 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/2116382449' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:05:40.020 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:39 smithi203 ceph-mon[33225]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:05:40.021 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:39 smithi203 ceph-mon[33225]: pgmap v279: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:05:40.021 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:39 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/2116382449' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:05:41.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:40 smithi203 ceph-mon[33225]: from='client.24447 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:05:41.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:40 smithi111 ceph-mon[27539]: from='client.24447 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:05:42.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:41 smithi203 ceph-mon[33225]: pgmap v280: 65 pgs: 65 active+clean; 928 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 29 KiB/s wr, 1 op/s 2024-09-11T00:05:42.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:41 smithi111 ceph-mon[27539]: pgmap v280: 65 pgs: 65 active+clean; 928 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 29 KiB/s wr, 1 op/s 2024-09-11T00:05:44.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:43 smithi203 ceph-mon[33225]: pgmap v281: 65 pgs: 65 active+clean; 1.4 MiB data, 172 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 73 KiB/s wr, 4 op/s 2024-09-11T00:05:44.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:43 smithi111 ceph-mon[27539]: pgmap v281: 65 pgs: 65 active+clean; 1.4 MiB data, 172 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 73 KiB/s wr, 4 op/s 2024-09-11T00:05:46.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:45 smithi203 ceph-mon[33225]: pgmap v282: 65 pgs: 65 active+clean; 12 MiB data, 191 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1012 KiB/s wr, 16 op/s 2024-09-11T00:05:46.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:45 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:05:46.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:45 smithi111 ceph-mon[27539]: pgmap v282: 65 pgs: 65 active+clean; 12 MiB data, 191 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1012 KiB/s wr, 16 op/s 2024-09-11T00:05:46.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:45 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:05:47.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:47 smithi111 ceph-mon[27539]: pgmap v283: 65 pgs: 65 active+clean; 15 MiB data, 205 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.2 MiB/s wr, 31 op/s 2024-09-11T00:05:48.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:47 smithi203 ceph-mon[33225]: pgmap v283: 65 pgs: 65 active+clean; 15 MiB data, 205 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.2 MiB/s wr, 31 op/s 2024-09-11T00:05:48.188 INFO:tasks.workunit.client.0.smithi111.stderr:Updating files: 64% (7850/12088) Updating files: 65% (7858/12088) Updating files: 66% (7979/12088) Updating files: 67% (8099/12088) Updating files: 68% (8220/12088) Updating files: 69% (8341/12088) Updating files: 70% (8462/12088) Updating files: 71% (8583/12088) Updating files: 72% (8704/12088) Updating files: 73% (8825/12088) Updating files: 74% (8946/12088) Updating files: 75% (9066/12088) Updating files: 76% (9187/12088) Updating files: 77% (9308/12088) Updating files: 78% (9429/12088) Updating files: 79% (9550/12088) Updating files: 80% (9671/12088) Updating files: 81% (9792/12088) Updating files: 82% (9913/12088) Updating files: 83% (10034/12088) Updating files: 84% (10154/12088) Updating files: 85% (10275/12088) Updating files: 86% (10396/12088) Updating files: 87% (10517/12088) Updating files: 88% (10638/12088) Updating files: 89% (10759/12088) Updating files: 90% (10880/12088) Updating files: 91% (11001/12088) Updating files: 92% (11121/12088) Updating files: 93% (11242/12088) Updating files: 94% (11363/12088) Updating files: 95% (11484/12088) Updating files: 96% (11605/12088) Updating files: 97% (11726/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-09-11T00:05:49.182 INFO:tasks.workunit.client.0.smithi111.stderr:Note: switching to '8f219c476cb4f26fc5719c661c0323719a45cb30'. 2024-09-11T00:05:49.182 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-11T00:05:49.182 INFO:tasks.workunit.client.0.smithi111.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-11T00:05:49.183 INFO:tasks.workunit.client.0.smithi111.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-11T00:05:49.183 INFO:tasks.workunit.client.0.smithi111.stderr:state without impacting any branches by switching back to a branch. 2024-09-11T00:05:49.183 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-11T00:05:49.183 INFO:tasks.workunit.client.0.smithi111.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-11T00:05:49.183 INFO:tasks.workunit.client.0.smithi111.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-11T00:05:49.183 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-11T00:05:49.183 INFO:tasks.workunit.client.0.smithi111.stderr: git switch -c 2024-09-11T00:05:49.183 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-11T00:05:49.183 INFO:tasks.workunit.client.0.smithi111.stderr:Or undo this operation with: 2024-09-11T00:05:49.183 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-11T00:05:49.184 INFO:tasks.workunit.client.0.smithi111.stderr: git switch - 2024-09-11T00:05:49.184 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-11T00:05:49.184 INFO:tasks.workunit.client.0.smithi111.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-11T00:05:49.184 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-11T00:05:49.184 INFO:tasks.workunit.client.0.smithi111.stderr:HEAD is now at 8f219c476cb Merge branch 'mgr-vol-mod-disable' of https://github.com/rishabh-d-dave/ceph into wip-hemanth-testing-2024-09-10-0723 2024-09-11T00:05:49.196 DEBUG:teuthology.orchestra.run.smithi111:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-11T00:05:49.243 INFO:tasks.workunit.client.0.smithi111.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-11T00:05:49.247 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-11T00:05:49.247 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-11T00:05:49.980 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-11T00:05:50.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:49 smithi203 ceph-mon[33225]: pgmap v284: 65 pgs: 65 active+clean; 16 MiB data, 210 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.3 MiB/s wr, 41 op/s 2024-09-11T00:05:50.071 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-11T00:05:50.148 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-11T00:05:50.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:49 smithi111 ceph-mon[27539]: pgmap v284: 65 pgs: 65 active+clean; 16 MiB data, 210 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.3 MiB/s wr, 41 op/s 2024-09-11T00:05:50.152 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-11T00:05:50.152 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-11T00:05:50.222 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-11T00:05:50.229 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-11T00:05:50.229 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-11T00:05:50.269 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-11T00:05:50.270 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-11T00:05:50.270 DEBUG:teuthology.orchestra.run.smithi111:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8f219c476cb4f26fc5719c661c0323719a45cb30 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-11T00:05:50.364 INFO:tasks.workunit.client.0.smithi111.stderr:+ mkdir -p fsstress 2024-09-11T00:05:50.369 INFO:tasks.workunit.client.0.smithi111.stderr:+ pushd fsstress 2024-09-11T00:05:50.371 INFO:tasks.workunit.client.0.smithi111.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-11T00:05:50.371 INFO:tasks.workunit.client.0.smithi111.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-11T00:05:51.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:51 smithi111 ceph-mon[27539]: pgmap v285: 65 pgs: 65 active+clean; 18 MiB data, 216 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 50 op/s 2024-09-11T00:05:52.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:51 smithi203 ceph-mon[33225]: pgmap v285: 65 pgs: 65 active+clean; 18 MiB data, 216 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 50 op/s 2024-09-11T00:05:52.129 INFO:tasks.workunit.client.0.smithi111.stderr:+ tar xzf ltp-full.tgz 2024-09-11T00:05:54.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:53 smithi203 ceph-mon[33225]: pgmap v286: 65 pgs: 65 active+clean; 18 MiB data, 222 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.5 MiB/s wr, 60 op/s 2024-09-11T00:05:54.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:53 smithi111 ceph-mon[27539]: pgmap v286: 65 pgs: 65 active+clean; 18 MiB data, 222 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.5 MiB/s wr, 60 op/s 2024-09-11T00:05:56.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:55 smithi203 ceph-mon[33225]: pgmap v287: 65 pgs: 65 active+clean; 28 MiB data, 241 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.3 MiB/s wr, 74 op/s 2024-09-11T00:05:56.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:55 smithi111 ceph-mon[27539]: pgmap v287: 65 pgs: 65 active+clean; 28 MiB data, 241 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.3 MiB/s wr, 74 op/s 2024-09-11T00:05:57.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:57 smithi111 ceph-mon[27539]: pgmap v288: 65 pgs: 65 active+clean; 42 MiB data, 280 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.5 MiB/s wr, 83 op/s 2024-09-11T00:05:58.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:57 smithi203 ceph-mon[33225]: pgmap v288: 65 pgs: 65 active+clean; 42 MiB data, 280 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.5 MiB/s wr, 83 op/s 2024-09-11T00:06:00.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:05:59 smithi203 ceph-mon[33225]: pgmap v289: 65 pgs: 65 active+clean; 45 MiB data, 302 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.6 MiB/s wr, 93 op/s 2024-09-11T00:06:00.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:05:59 smithi111 ceph-mon[27539]: pgmap v289: 65 pgs: 65 active+clean; 45 MiB data, 302 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.6 MiB/s wr, 93 op/s 2024-09-11T00:06:01.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:00 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:06:01.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:00 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:06:02.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:01 smithi203 ceph-mon[33225]: pgmap v290: 65 pgs: 65 active+clean; 54 MiB data, 330 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.2 MiB/s wr, 106 op/s 2024-09-11T00:06:02.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:01 smithi111 ceph-mon[27539]: pgmap v290: 65 pgs: 65 active+clean; 54 MiB data, 330 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.2 MiB/s wr, 106 op/s 2024-09-11T00:06:04.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:03 smithi203 ceph-mon[33225]: pgmap v291: 65 pgs: 65 active+clean; 59 MiB data, 352 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.5 MiB/s wr, 113 op/s 2024-09-11T00:06:04.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:03 smithi111 ceph-mon[27539]: pgmap v291: 65 pgs: 65 active+clean; 59 MiB data, 352 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.5 MiB/s wr, 113 op/s 2024-09-11T00:06:06.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:05 smithi203 ceph-mon[33225]: pgmap v292: 65 pgs: 65 active+clean; 62 MiB data, 373 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.7 MiB/s wr, 129 op/s 2024-09-11T00:06:06.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:05 smithi111 ceph-mon[27539]: pgmap v292: 65 pgs: 65 active+clean; 62 MiB data, 373 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.7 MiB/s wr, 129 op/s 2024-09-11T00:06:07.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:07 smithi111 ceph-mon[27539]: pgmap v293: 65 pgs: 65 active+clean; 73 MiB data, 396 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.8 MiB/s wr, 138 op/s 2024-09-11T00:06:08.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:07 smithi203 ceph-mon[33225]: pgmap v293: 65 pgs: 65 active+clean; 73 MiB data, 396 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.8 MiB/s wr, 138 op/s 2024-09-11T00:06:09.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.770+0000 7f7c80200700 1 -- 172.21.15.111:0/3098548383 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c78075700 msgr2=0x7f7c78075b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:09.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.770+0000 7f7c80200700 1 --2- 172.21.15.111:0/3098548383 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c78075700 0x7f7c78075b10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c009910 tx=0x7f7c6c009c20 comp rx=0 tx=0).stop 2024-09-11T00:06:09.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.770+0000 7f7c80200700 1 -- 172.21.15.111:0/3098548383 shutdown_connections 2024-09-11T00:06:09.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.770+0000 7f7c80200700 1 --2- 172.21.15.111:0/3098548383 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c78076950 0x7f7c78076dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:09.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.770+0000 7f7c80200700 1 --2- 172.21.15.111:0/3098548383 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c78075700 0x7f7c78075b10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:09.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.770+0000 7f7c80200700 1 -- 172.21.15.111:0/3098548383 >> 172.21.15.111:0/3098548383 conn(0x7f7c780fd930 msgr2=0x7f7c780ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:09.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.771+0000 7f7c80200700 1 -- 172.21.15.111:0/3098548383 shutdown_connections 2024-09-11T00:06:09.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.771+0000 7f7c80200700 1 -- 172.21.15.111:0/3098548383 wait complete. 2024-09-11T00:06:09.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.772+0000 7f7c80200700 1 Processor -- start 2024-09-11T00:06:09.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.772+0000 7f7c80200700 1 -- start start 2024-09-11T00:06:09.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.772+0000 7f7c80200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c78075700 0x7f7c7819bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:09.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.772+0000 7f7c80200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c78076950 0x7f7c7819c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:09.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.772+0000 7f7c80200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7819caf0 con 0x7f7c78076950 2024-09-11T00:06:09.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.772+0000 7f7c80200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7819cc30 con 0x7f7c78075700 2024-09-11T00:06:09.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.772+0000 7f7c7ce00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c78076950 0x7f7c7819c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:09.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.772+0000 7f7c7ce00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c78076950 0x7f7c7819c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48070/0 (socket says 172.21.15.111:48070) 2024-09-11T00:06:09.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.772+0000 7f7c7ce00700 1 -- 172.21.15.111:0/3736583510 learned_addr learned my addr 172.21.15.111:0/3736583510 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:06:09.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.773+0000 7f7c7ce00700 1 -- 172.21.15.111:0/3736583510 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c78075700 msgr2=0x7f7c7819bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:09.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.773+0000 7f7c7ce00700 1 --2- 172.21.15.111:0/3736583510 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c78075700 0x7f7c7819bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:09.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.773+0000 7f7c7ce00700 1 -- 172.21.15.111:0/3736583510 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c0095f0 con 0x7f7c78076950 2024-09-11T00:06:09.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.773+0000 7f7c7ce00700 1 --2- 172.21.15.111:0/3736583510 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c78076950 0x7f7c7819c4d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7c6400d8d0 tx=0x7f7c6400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:09.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.773+0000 7f7c76000700 1 -- 172.21.15.111:0/3736583510 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c64009940 con 0x7f7c78076950 2024-09-11T00:06:09.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.773+0000 7f7c76000700 1 -- 172.21.15.111:0/3736583510 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7c64010460 con 0x7f7c78076950 2024-09-11T00:06:09.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.773+0000 7f7c76000700 1 -- 172.21.15.111:0/3736583510 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c6400f5f0 con 0x7f7c78076950 2024-09-11T00:06:09.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.773+0000 7f7c80200700 1 -- 172.21.15.111:0/3736583510 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c781a16e0 con 0x7f7c78076950 2024-09-11T00:06:09.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.774+0000 7f7c80200700 1 -- 172.21.15.111:0/3736583510 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c781a1c30 con 0x7f7c78076950 2024-09-11T00:06:09.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.775+0000 7f7c80200700 1 -- 172.21.15.111:0/3736583510 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7810f2d0 con 0x7f7c78076950 2024-09-11T00:06:09.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.776+0000 7f7c76000700 1 -- 172.21.15.111:0/3736583510 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f7c640105d0 con 0x7f7c78076950 2024-09-11T00:06:09.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.777+0000 7f7c76000700 1 --2- 172.21.15.111:0/3736583510 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f7c6006c680 0x7f7c6006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:09.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.777+0000 7f7c76000700 1 -- 172.21.15.111:0/3736583510 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f7c6408b830 con 0x7f7c78076950 2024-09-11T00:06:09.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.777+0000 7f7c7d800700 1 --2- 172.21.15.111:0/3736583510 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f7c6006c680 0x7f7c6006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:09.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.778+0000 7f7c7d800700 1 --2- 172.21.15.111:0/3736583510 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f7c6006c680 0x7f7c6006eb30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00b5c0 tx=0x7f7c6c005fd0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:09.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:09.782+0000 7f7c76000700 1 -- 172.21.15.111:0/3736583510 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7c640599f0 con 0x7f7c78076950 2024-09-11T00:06:10.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:09 smithi203 ceph-mon[33225]: pgmap v294: 65 pgs: 65 active+clean; 74 MiB data, 410 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.7 MiB/s wr, 133 op/s 2024-09-11T00:06:10.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.052+0000 7f7c80200700 1 -- 172.21.15.111:0/3736583510 --> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c7810dd00 con 0x7f7c6006c680 2024-09-11T00:06:10.054 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:09 smithi111 ceph-mon[27539]: pgmap v294: 65 pgs: 65 active+clean; 74 MiB data, 410 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.7 MiB/s wr, 133 op/s 2024-09-11T00:06:10.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.053+0000 7f7c76000700 1 -- 172.21.15.111:0/3736583510 <== mgr.14211 v2:172.21.15.111:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f7c7810dd00 con 0x7f7c6006c680 2024-09-11T00:06:10.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.056+0000 7f7c80200700 1 -- 172.21.15.111:0/3736583510 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f7c6006c680 msgr2=0x7f7c6006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:10.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.056+0000 7f7c80200700 1 --2- 172.21.15.111:0/3736583510 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f7c6006c680 0x7f7c6006eb30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00b5c0 tx=0x7f7c6c005fd0 comp rx=0 tx=0).stop 2024-09-11T00:06:10.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.056+0000 7f7c80200700 1 -- 172.21.15.111:0/3736583510 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c78076950 msgr2=0x7f7c7819c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:10.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.056+0000 7f7c80200700 1 --2- 172.21.15.111:0/3736583510 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c78076950 0x7f7c7819c4d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7c6400d8d0 tx=0x7f7c6400dc90 comp rx=0 tx=0).stop 2024-09-11T00:06:10.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.056+0000 7f7c80200700 1 -- 172.21.15.111:0/3736583510 shutdown_connections 2024-09-11T00:06:10.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.056+0000 7f7c80200700 1 --2- 172.21.15.111:0/3736583510 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f7c6006c680 0x7f7c6006eb30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:10.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.056+0000 7f7c80200700 1 --2- 172.21.15.111:0/3736583510 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c78075700 0x7f7c7819bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:10.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.056+0000 7f7c80200700 1 --2- 172.21.15.111:0/3736583510 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c78076950 0x7f7c7819c4d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:10.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.056+0000 7f7c80200700 1 -- 172.21.15.111:0/3736583510 >> 172.21.15.111:0/3736583510 conn(0x7f7c780fd930 msgr2=0x7f7c7810c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:10.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.056+0000 7f7c80200700 1 -- 172.21.15.111:0/3736583510 shutdown_connections 2024-09-11T00:06:10.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.056+0000 7f7c80200700 1 -- 172.21.15.111:0/3736583510 wait complete. 2024-09-11T00:06:10.075 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:06:10.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.233+0000 7fd7ff200700 1 -- 172.21.15.111:0/1774220235 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd800073730 msgr2=0x7fd800073ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:10.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.233+0000 7fd7ff200700 1 --2- 172.21.15.111:0/1774220235 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd800073730 0x7fd800073ba0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec009910 tx=0x7fd7ec009c20 comp rx=0 tx=0).stop 2024-09-11T00:06:10.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.233+0000 7fd7ff200700 1 -- 172.21.15.111:0/1774220235 shutdown_connections 2024-09-11T00:06:10.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.233+0000 7fd7ff200700 1 --2- 172.21.15.111:0/1774220235 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd800073730 0x7fd800073ba0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:10.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.233+0000 7fd7ff200700 1 --2- 172.21.15.111:0/1774220235 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd800074d00 0x7fd800073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:10.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.233+0000 7fd7ff200700 1 -- 172.21.15.111:0/1774220235 >> 172.21.15.111:0/1774220235 conn(0x7fd8000fb540 msgr2=0x7fd8000fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:10.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.233+0000 7fd7ff200700 1 -- 172.21.15.111:0/1774220235 shutdown_connections 2024-09-11T00:06:10.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.233+0000 7fd7ff200700 1 -- 172.21.15.111:0/1774220235 wait complete. 2024-09-11T00:06:10.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.234+0000 7fd7ff200700 1 Processor -- start 2024-09-11T00:06:10.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.234+0000 7fd7ff200700 1 -- start start 2024-09-11T00:06:10.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.235+0000 7fd7ff200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd800073730 0x7fd800197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:10.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.235+0000 7fd7ff200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd800074d00 0x7fd800197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:10.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.235+0000 7fd7ff200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8001984c0 con 0x7fd800073730 2024-09-11T00:06:10.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.235+0000 7fd7ff200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd800198600 con 0x7fd800074d00 2024-09-11T00:06:10.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.235+0000 7fd7fde00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd800073730 0x7fd800197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:10.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.235+0000 7fd7fde00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd800073730 0x7fd800197960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48086/0 (socket says 172.21.15.111:48086) 2024-09-11T00:06:10.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.235+0000 7fd7fde00700 1 -- 172.21.15.111:0/646993997 learned_addr learned my addr 172.21.15.111:0/646993997 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:06:10.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.235+0000 7fd7fd400700 1 --2- 172.21.15.111:0/646993997 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd800074d00 0x7fd800197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:10.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.235+0000 7fd7fde00700 1 -- 172.21.15.111:0/646993997 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd800074d00 msgr2=0x7fd800197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:10.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.235+0000 7fd7fde00700 1 --2- 172.21.15.111:0/646993997 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd800074d00 0x7fd800197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:10.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.235+0000 7fd7fde00700 1 -- 172.21.15.111:0/646993997 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec0095f0 con 0x7fd800073730 2024-09-11T00:06:10.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.236+0000 7fd7fd400700 1 --2- 172.21.15.111:0/646993997 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd800074d00 0x7fd800197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:06:10.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.236+0000 7fd7fde00700 1 --2- 172.21.15.111:0/646993997 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd800073730 0x7fd800197960 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd7f000d8d0 tx=0x7fd7f000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:10.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.236+0000 7fd7f6a00700 1 -- 172.21.15.111:0/646993997 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7f0009940 con 0x7fd800073730 2024-09-11T00:06:10.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.236+0000 7fd7f6a00700 1 -- 172.21.15.111:0/646993997 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd7f0010460 con 0x7fd800073730 2024-09-11T00:06:10.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.236+0000 7fd7f6a00700 1 -- 172.21.15.111:0/646993997 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7f000f5f0 con 0x7fd800073730 2024-09-11T00:06:10.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.236+0000 7fd7ff200700 1 -- 172.21.15.111:0/646993997 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd80019d0b0 con 0x7fd800073730 2024-09-11T00:06:10.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.236+0000 7fd7ff200700 1 -- 172.21.15.111:0/646993997 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80019d5b0 con 0x7fd800073730 2024-09-11T00:06:10.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.237+0000 7fd7ff200700 1 -- 172.21.15.111:0/646993997 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd80010ace0 con 0x7fd800073730 2024-09-11T00:06:10.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.239+0000 7fd7f6a00700 1 -- 172.21.15.111:0/646993997 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fd7f00105d0 con 0x7fd800073730 2024-09-11T00:06:10.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.239+0000 7fd7f6a00700 1 --2- 172.21.15.111:0/646993997 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd7e406c680 0x7fd7e406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:10.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.240+0000 7fd7f6a00700 1 -- 172.21.15.111:0/646993997 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fd7f008b8d0 con 0x7fd800073730 2024-09-11T00:06:10.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.240+0000 7fd7fd400700 1 --2- 172.21.15.111:0/646993997 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd7e406c680 0x7fd7e406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:10.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.240+0000 7fd7fd400700 1 --2- 172.21.15.111:0/646993997 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd7e406c680 0x7fd7e406eb30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec006010 tx=0x7fd7ec00b540 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:10.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.245+0000 7fd7f6a00700 1 -- 172.21.15.111:0/646993997 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd7f00599f0 con 0x7fd800073730 2024-09-11T00:06:10.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.512+0000 7fd7ff200700 1 -- 172.21.15.111:0/646993997 --> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd800107530 con 0x7fd7e406c680 2024-09-11T00:06:10.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.513+0000 7fd7f6a00700 1 -- 172.21.15.111:0/646993997 <== mgr.14211 v2:172.21.15.111:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fd800107530 con 0x7fd7e406c680 2024-09-11T00:06:10.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.515+0000 7fd7ff200700 1 -- 172.21.15.111:0/646993997 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd7e406c680 msgr2=0x7fd7e406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:10.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.515+0000 7fd7ff200700 1 --2- 172.21.15.111:0/646993997 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd7e406c680 0x7fd7e406eb30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec006010 tx=0x7fd7ec00b540 comp rx=0 tx=0).stop 2024-09-11T00:06:10.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.515+0000 7fd7ff200700 1 -- 172.21.15.111:0/646993997 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd800073730 msgr2=0x7fd800197960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:10.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.515+0000 7fd7ff200700 1 --2- 172.21.15.111:0/646993997 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd800073730 0x7fd800197960 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd7f000d8d0 tx=0x7fd7f000dc90 comp rx=0 tx=0).stop 2024-09-11T00:06:10.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.515+0000 7fd7ff200700 1 -- 172.21.15.111:0/646993997 shutdown_connections 2024-09-11T00:06:10.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.515+0000 7fd7ff200700 1 --2- 172.21.15.111:0/646993997 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fd7e406c680 0x7fd7e406eb30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:10.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.515+0000 7fd7ff200700 1 --2- 172.21.15.111:0/646993997 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd800073730 0x7fd800197960 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:10.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.515+0000 7fd7ff200700 1 --2- 172.21.15.111:0/646993997 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd800074d00 0x7fd800197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:10.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.515+0000 7fd7ff200700 1 -- 172.21.15.111:0/646993997 >> 172.21.15.111:0/646993997 conn(0x7fd8000fb540 msgr2=0x7fd800105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:10.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.516+0000 7fd7ff200700 1 -- 172.21.15.111:0/646993997 shutdown_connections 2024-09-11T00:06:10.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.516+0000 7fd7ff200700 1 -- 172.21.15.111:0/646993997 wait complete. 2024-09-11T00:06:10.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.659+0000 7f5d83200700 1 -- 172.21.15.111:0/2962931106 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5d7c1011a0 msgr2=0x7f5d7c1015f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:10.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.659+0000 7f5d83200700 1 --2- 172.21.15.111:0/2962931106 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5d7c1011a0 0x7f5d7c1015f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c009910 tx=0x7f5d6c009c20 comp rx=0 tx=0).stop 2024-09-11T00:06:10.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.659+0000 7f5d83200700 1 -- 172.21.15.111:0/2962931106 shutdown_connections 2024-09-11T00:06:10.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.659+0000 7f5d83200700 1 --2- 172.21.15.111:0/2962931106 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5d7c1011a0 0x7f5d7c1015f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:10.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.659+0000 7f5d83200700 1 --2- 172.21.15.111:0/2962931106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d7c0fffa0 0x7f5d7c1003b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:10.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.659+0000 7f5d83200700 1 -- 172.21.15.111:0/2962931106 >> 172.21.15.111:0/2962931106 conn(0x7f5d7c0fb510 msgr2=0x7f5d7c0fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:10.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.659+0000 7f5d83200700 1 -- 172.21.15.111:0/2962931106 shutdown_connections 2024-09-11T00:06:10.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.659+0000 7f5d83200700 1 -- 172.21.15.111:0/2962931106 wait complete. 2024-09-11T00:06:10.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.661+0000 7f5d83200700 1 Processor -- start 2024-09-11T00:06:10.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.661+0000 7f5d83200700 1 -- start start 2024-09-11T00:06:10.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.661+0000 7f5d83200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d7c0fffa0 0x7f5d7c1979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:10.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.661+0000 7f5d83200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5d7c1011a0 0x7f5d7c197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:10.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.661+0000 7f5d83200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c198520 con 0x7f5d7c1011a0 2024-09-11T00:06:10.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.661+0000 7f5d83200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c198660 con 0x7f5d7c0fffa0 2024-09-11T00:06:10.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.662+0000 7f5d81400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5d7c1011a0 0x7f5d7c197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:10.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.662+0000 7f5d81400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5d7c1011a0 0x7f5d7c197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48114/0 (socket says 172.21.15.111:48114) 2024-09-11T00:06:10.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.662+0000 7f5d81400700 1 -- 172.21.15.111:0/3702262210 learned_addr learned my addr 172.21.15.111:0/3702262210 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:06:10.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.662+0000 7f5d81e00700 1 --2- 172.21.15.111:0/3702262210 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d7c0fffa0 0x7f5d7c1979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:10.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.662+0000 7f5d81400700 1 -- 172.21.15.111:0/3702262210 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d7c0fffa0 msgr2=0x7f5d7c1979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:10.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.662+0000 7f5d81400700 1 --2- 172.21.15.111:0/3702262210 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d7c0fffa0 0x7f5d7c1979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:10.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.662+0000 7f5d81400700 1 -- 172.21.15.111:0/3702262210 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c0095f0 con 0x7f5d7c1011a0 2024-09-11T00:06:10.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.663+0000 7f5d81400700 1 --2- 172.21.15.111:0/3702262210 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5d7c1011a0 0x7f5d7c197f00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c005b40 tx=0x7f5d6c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:10.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.663+0000 7f5d76a00700 1 -- 172.21.15.111:0/3702262210 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d6c01d070 con 0x7f5d7c1011a0 2024-09-11T00:06:10.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.663+0000 7f5d76a00700 1 -- 172.21.15.111:0/3702262210 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5d6c00f460 con 0x7f5d7c1011a0 2024-09-11T00:06:10.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.663+0000 7f5d76a00700 1 -- 172.21.15.111:0/3702262210 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d6c021640 con 0x7f5d7c1011a0 2024-09-11T00:06:10.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.663+0000 7f5d83200700 1 -- 172.21.15.111:0/3702262210 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d7c19d0b0 con 0x7f5d7c1011a0 2024-09-11T00:06:10.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.663+0000 7f5d83200700 1 -- 172.21.15.111:0/3702262210 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d7c19d5a0 con 0x7f5d7c1011a0 2024-09-11T00:06:10.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.665+0000 7f5d83200700 1 -- 172.21.15.111:0/3702262210 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d7c105280 con 0x7f5d7c1011a0 2024-09-11T00:06:10.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.666+0000 7f5d76a00700 1 -- 172.21.15.111:0/3702262210 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f5d6c00fa90 con 0x7f5d7c1011a0 2024-09-11T00:06:10.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.667+0000 7f5d76a00700 1 --2- 172.21.15.111:0/3702262210 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5d6406c680 0x7f5d6406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:10.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.667+0000 7f5d76a00700 1 -- 172.21.15.111:0/3702262210 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f5d6c08cba0 con 0x7f5d7c1011a0 2024-09-11T00:06:10.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.667+0000 7f5d81e00700 1 --2- 172.21.15.111:0/3702262210 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5d6406c680 0x7f5d6406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:10.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.668+0000 7f5d81e00700 1 --2- 172.21.15.111:0/3702262210 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5d6406c680 0x7f5d6406eb30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5d70005950 tx=0x7f5d700058e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:10.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.672+0000 7f5d76a00700 1 -- 172.21.15.111:0/3702262210 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5d6c05ad40 con 0x7f5d7c1011a0 2024-09-11T00:06:10.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.926+0000 7f5d83200700 1 -- 172.21.15.111:0/3702262210 --> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d7c061190 con 0x7f5d6406c680 2024-09-11T00:06:10.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.939+0000 7f5d76a00700 1 -- 172.21.15.111:0/3702262210 <== mgr.14211 v2:172.21.15.111:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3480 (secure 0 0 0) 0x7f5d7c061190 con 0x7f5d6406c680 2024-09-11T00:06:10.941 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:06:10.941 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (7m) 109s ago 9m 13.3M - 0.25.0 c8568f914cd2 eb9e393000ec 2024-09-11T00:06:10.941 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (9m) 109s ago 9m 7453k - 18.2.0 dc2bc1663786 b6e7b6bd4d27 2024-09-11T00:06:10.941 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi203 smithi203 running (8m) 114s ago 8m 7360k - 18.2.0 dc2bc1663786 7bbfd9c27900 2024-09-11T00:06:10.941 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (9m) 109s ago 9m 6665k - 18.2.0 dc2bc1663786 72a36c166ffa 2024-09-11T00:06:10.941 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi203 smithi203 running (8m) 114s ago 8m 6669k - 18.2.0 dc2bc1663786 9b102b6f6d70 2024-09-11T00:06:10.941 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (6m) 109s ago 9m 75.0M - 9.4.7 954c08fa6188 e599624a9c9e 2024-09-11T00:06:10.942 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.gmgsay smithi111 running (2m) 109s ago 2m 11.6M - 18.2.0 dc2bc1663786 795e4ff0075c 2024-09-11T00:06:10.942 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.rucaba smithi111 running (2m) 109s ago 2m 11.6M - 18.2.0 dc2bc1663786 02885adac62c 2024-09-11T00:06:10.942 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.tcrqop smithi203 running (2m) 114s ago 2m 14.1M - 18.2.0 dc2bc1663786 4df492159bb4 2024-09-11T00:06:10.942 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.uqkbkn smithi203 running (2m) 114s ago 2m 11.5M - 18.2.0 dc2bc1663786 619aa58ea314 2024-09-11T00:06:10.942 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.ypucji smithi111 *:9283,8765,8443 running (10m) 109s ago 10m 488M - 18.2.0 dc2bc1663786 0329ec697a09 2024-09-11T00:06:10.942 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi203.smuspl smithi203 *:8443,9283,8765 running (8m) 114s ago 8m 437M - 18.2.0 dc2bc1663786 9f1086684d72 2024-09-11T00:06:10.942 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (11m) 109s ago 11m 44.6M 2048M 18.2.0 dc2bc1663786 2596322539fb 2024-09-11T00:06:10.942 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi203 smithi203 running (8m) 114s ago 8m 34.0M 2048M 18.2.0 dc2bc1663786 ff8eb7ca85ea 2024-09-11T00:06:10.942 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (9m) 109s ago 9m 7604k - 1.5.0 0da6a335fe13 4fd66ebc9c0d 2024-09-11T00:06:10.942 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi203 smithi203 *:9100 running (8m) 114s ago 8m 7600k - 1.5.0 0da6a335fe13 1cb3ca740f4a 2024-09-11T00:06:10.942 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (6m) 109s ago 6m 46.8M 3947M 18.2.0 dc2bc1663786 162b7249a591 2024-09-11T00:06:10.942 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (6m) 109s ago 6m 46.7M 3947M 18.2.0 dc2bc1663786 3614d95b1425 2024-09-11T00:06:10.942 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (5m) 109s ago 5m 45.2M 3947M 18.2.0 dc2bc1663786 db175d4b09b9 2024-09-11T00:06:10.943 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi203 running (4m) 114s ago 4m 45.3M 4971M 18.2.0 dc2bc1663786 60b1cef7a70d 2024-09-11T00:06:10.943 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi203 running (4m) 114s ago 4m 42.8M 4971M 18.2.0 dc2bc1663786 769c7942c42b 2024-09-11T00:06:10.943 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi203 running (3m) 114s ago 3m 42.6M 4971M 18.2.0 dc2bc1663786 6d824001d40c 2024-09-11T00:06:10.943 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (6m) 109s ago 8m 62.5M - 2.43.0 a07b618ecd1d bd707157a41b 2024-09-11T00:06:10.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.942+0000 7f5d83200700 1 -- 172.21.15.111:0/3702262210 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5d6406c680 msgr2=0x7f5d6406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:10.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.942+0000 7f5d83200700 1 --2- 172.21.15.111:0/3702262210 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5d6406c680 0x7f5d6406eb30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5d70005950 tx=0x7f5d700058e0 comp rx=0 tx=0).stop 2024-09-11T00:06:10.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.942+0000 7f5d83200700 1 -- 172.21.15.111:0/3702262210 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5d7c1011a0 msgr2=0x7f5d7c197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:10.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.942+0000 7f5d83200700 1 --2- 172.21.15.111:0/3702262210 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5d7c1011a0 0x7f5d7c197f00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c005b40 tx=0x7f5d6c00be20 comp rx=0 tx=0).stop 2024-09-11T00:06:10.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.942+0000 7f5d83200700 1 -- 172.21.15.111:0/3702262210 shutdown_connections 2024-09-11T00:06:10.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.942+0000 7f5d83200700 1 --2- 172.21.15.111:0/3702262210 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5d6406c680 0x7f5d6406eb30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:10.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.942+0000 7f5d83200700 1 --2- 172.21.15.111:0/3702262210 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d7c0fffa0 0x7f5d7c1979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:10.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.942+0000 7f5d83200700 1 --2- 172.21.15.111:0/3702262210 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5d7c1011a0 0x7f5d7c197f00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:10.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.942+0000 7f5d83200700 1 -- 172.21.15.111:0/3702262210 >> 172.21.15.111:0/3702262210 conn(0x7f5d7c0fb510 msgr2=0x7f5d7c1023c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:10.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.943+0000 7f5d83200700 1 -- 172.21.15.111:0/3702262210 shutdown_connections 2024-09-11T00:06:10.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:10.943+0000 7f5d83200700 1 -- 172.21.15.111:0/3702262210 wait complete. 2024-09-11T00:06:11.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:10 smithi203 ceph-mon[33225]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:06:11.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.107+0000 7f58c1200700 1 -- 172.21.15.111:0/780948155 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f58bc1079a0 msgr2=0x7f58bc107df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:11.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.107+0000 7f58c1200700 1 --2- 172.21.15.111:0/780948155 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f58bc1079a0 0x7f58bc107df0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f58a8009910 tx=0x7f58a8009c20 comp rx=0 tx=0).stop 2024-09-11T00:06:11.109 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:10 smithi111 ceph-mon[27539]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:06:11.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.107+0000 7f58c1200700 1 -- 172.21.15.111:0/780948155 shutdown_connections 2024-09-11T00:06:11.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.107+0000 7f58c1200700 1 --2- 172.21.15.111:0/780948155 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f58bc1079a0 0x7f58bc107df0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:11.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.107+0000 7f58c1200700 1 --2- 172.21.15.111:0/780948155 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f58bc1067a0 0x7f58bc106bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:11.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.107+0000 7f58c1200700 1 -- 172.21.15.111:0/780948155 >> 172.21.15.111:0/780948155 conn(0x7f58bc069ae0 msgr2=0x7f58bc069f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:11.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.107+0000 7f58c1200700 1 -- 172.21.15.111:0/780948155 shutdown_connections 2024-09-11T00:06:11.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.107+0000 7f58c1200700 1 -- 172.21.15.111:0/780948155 wait complete. 2024-09-11T00:06:11.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.109+0000 7f58c1200700 1 Processor -- start 2024-09-11T00:06:11.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.109+0000 7f58c1200700 1 -- start start 2024-09-11T00:06:11.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.110+0000 7f58c1200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f58bc1067a0 0x7f58bc19bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:11.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.110+0000 7f58c1200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f58bc1079a0 0x7f58bc19c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:11.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.110+0000 7f58c1200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc19cab0 con 0x7f58bc1067a0 2024-09-11T00:06:11.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.110+0000 7f58c1200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc19cbf0 con 0x7f58bc1079a0 2024-09-11T00:06:11.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.110+0000 7f58b9e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f58bc1067a0 0x7f58bc19bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:11.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.110+0000 7f58b9e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f58bc1067a0 0x7f58bc19bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48132/0 (socket says 172.21.15.111:48132) 2024-09-11T00:06:11.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.110+0000 7f58b9e00700 1 -- 172.21.15.111:0/3790697571 learned_addr learned my addr 172.21.15.111:0/3790697571 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:06:11.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.111+0000 7f58b9400700 1 --2- 172.21.15.111:0/3790697571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f58bc1079a0 0x7f58bc19c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:11.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.111+0000 7f58b9e00700 1 -- 172.21.15.111:0/3790697571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f58bc1079a0 msgr2=0x7f58bc19c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:11.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.111+0000 7f58b9e00700 1 --2- 172.21.15.111:0/3790697571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f58bc1079a0 0x7f58bc19c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:11.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.111+0000 7f58b9e00700 1 -- 172.21.15.111:0/3790697571 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a80095f0 con 0x7f58bc1067a0 2024-09-11T00:06:11.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.111+0000 7f58b9e00700 1 --2- 172.21.15.111:0/3790697571 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f58bc1067a0 0x7f58bc19bf50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f58ac00e8f0 tx=0x7f58ac00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:11.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.111+0000 7f58b2a00700 1 -- 172.21.15.111:0/3790697571 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58ac009790 con 0x7f58bc1067a0 2024-09-11T00:06:11.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.111+0000 7f58b2a00700 1 -- 172.21.15.111:0/3790697571 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f58ac0044d0 con 0x7f58bc1067a0 2024-09-11T00:06:11.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.111+0000 7f58c1200700 1 -- 172.21.15.111:0/3790697571 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58bc1a16a0 con 0x7f58bc1067a0 2024-09-11T00:06:11.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.112+0000 7f58b2a00700 1 -- 172.21.15.111:0/3790697571 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58ac003da0 con 0x7f58bc1067a0 2024-09-11T00:06:11.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.112+0000 7f58c1200700 1 -- 172.21.15.111:0/3790697571 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58bc1a1bf0 con 0x7f58bc1067a0 2024-09-11T00:06:11.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.113+0000 7f58c1200700 1 -- 172.21.15.111:0/3790697571 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58bc10f2f0 con 0x7f58bc1067a0 2024-09-11T00:06:11.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.114+0000 7f58b2a00700 1 -- 172.21.15.111:0/3790697571 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f58ac00cba0 con 0x7f58bc1067a0 2024-09-11T00:06:11.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.115+0000 7f58b2a00700 1 --2- 172.21.15.111:0/3790697571 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f58a006c680 0x7f58a006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:11.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.115+0000 7f58b2a00700 1 -- 172.21.15.111:0/3790697571 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f58ac014070 con 0x7f58bc1067a0 2024-09-11T00:06:11.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.116+0000 7f58b9400700 1 --2- 172.21.15.111:0/3790697571 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f58a006c680 0x7f58a006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:11.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.117+0000 7f58b9400700 1 --2- 172.21.15.111:0/3790697571 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f58a006c680 0x7f58a006eb30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f58a8000c00 tx=0x7f58a8009f70 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:11.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.121+0000 7f58b2a00700 1 -- 172.21.15.111:0/3790697571 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f58ac059f90 con 0x7f58bc1067a0 2024-09-11T00:06:11.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.493+0000 7f58c1200700 1 -- 172.21.15.111:0/3790697571 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f58bc1a2290 con 0x7f58bc1067a0 2024-09-11T00:06:11.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.494+0000 7f58b2a00700 1 -- 172.21.15.111:0/3790697571 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7f58ac059b20 con 0x7f58bc1067a0 2024-09-11T00:06:11.495 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:06:11.495 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-11T00:06:11.496 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-11T00:06:11.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:06:11.496 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-11T00:06:11.496 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-11T00:06:11.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:06:11.496 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-11T00:06:11.496 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-11T00:06:11.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:06:11.496 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-11T00:06:11.496 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-11T00:06:11.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:06:11.496 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-11T00:06:11.496 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-09-11T00:06:11.496 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-11T00:06:11.497 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:06:11.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.496+0000 7f58c1200700 1 -- 172.21.15.111:0/3790697571 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f58a006c680 msgr2=0x7f58a006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:11.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.496+0000 7f58c1200700 1 --2- 172.21.15.111:0/3790697571 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f58a006c680 0x7f58a006eb30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f58a8000c00 tx=0x7f58a8009f70 comp rx=0 tx=0).stop 2024-09-11T00:06:11.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.496+0000 7f58c1200700 1 -- 172.21.15.111:0/3790697571 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f58bc1067a0 msgr2=0x7f58bc19bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:11.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.496+0000 7f58c1200700 1 --2- 172.21.15.111:0/3790697571 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f58bc1067a0 0x7f58bc19bf50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f58ac00e8f0 tx=0x7f58ac00ecb0 comp rx=0 tx=0).stop 2024-09-11T00:06:11.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.496+0000 7f58c1200700 1 -- 172.21.15.111:0/3790697571 shutdown_connections 2024-09-11T00:06:11.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.496+0000 7f58c1200700 1 --2- 172.21.15.111:0/3790697571 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f58a006c680 0x7f58a006eb30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:11.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.496+0000 7f58c1200700 1 --2- 172.21.15.111:0/3790697571 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f58bc1067a0 0x7f58bc19bf50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:11.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.496+0000 7f58c1200700 1 --2- 172.21.15.111:0/3790697571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f58bc1079a0 0x7f58bc19c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:11.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.496+0000 7f58c1200700 1 -- 172.21.15.111:0/3790697571 >> 172.21.15.111:0/3790697571 conn(0x7f58bc069ae0 msgr2=0x7f58bc10abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:11.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.497+0000 7f58c1200700 1 -- 172.21.15.111:0/3790697571 shutdown_connections 2024-09-11T00:06:11.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.497+0000 7f58c1200700 1 -- 172.21.15.111:0/3790697571 wait complete. 2024-09-11T00:06:11.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.645+0000 7f5e10e00700 1 -- 172.21.15.111:0/274471417 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5e0c101350 msgr2=0x7f5e0c1017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:11.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.645+0000 7f5e10e00700 1 --2- 172.21.15.111:0/274471417 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5e0c101350 0x7f5e0c1017a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5df8009910 tx=0x7f5df8009c20 comp rx=0 tx=0).stop 2024-09-11T00:06:11.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.645+0000 7f5e10e00700 1 -- 172.21.15.111:0/274471417 shutdown_connections 2024-09-11T00:06:11.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.645+0000 7f5e10e00700 1 --2- 172.21.15.111:0/274471417 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5e0c101350 0x7f5e0c1017a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:11.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.645+0000 7f5e10e00700 1 --2- 172.21.15.111:0/274471417 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e0c100150 0x7f5e0c100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:11.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.645+0000 7f5e10e00700 1 -- 172.21.15.111:0/274471417 >> 172.21.15.111:0/274471417 conn(0x7f5e0c0fb6e0 msgr2=0x7f5e0c0fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:11.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.645+0000 7f5e10e00700 1 -- 172.21.15.111:0/274471417 shutdown_connections 2024-09-11T00:06:11.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.645+0000 7f5e10e00700 1 -- 172.21.15.111:0/274471417 wait complete. 2024-09-11T00:06:11.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.646+0000 7f5e10e00700 1 Processor -- start 2024-09-11T00:06:11.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.646+0000 7f5e10e00700 1 -- start start 2024-09-11T00:06:11.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.646+0000 7f5e10e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e0c100150 0x7f5e0c074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:11.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.647+0000 7f5e10e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5e0c101350 0x7f5e0c073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:11.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.647+0000 7f5e10e00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c073680 con 0x7f5e0c101350 2024-09-11T00:06:11.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.647+0000 7f5e10e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c0737c0 con 0x7f5e0c100150 2024-09-11T00:06:11.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.647+0000 7f5e09e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e0c100150 0x7f5e0c074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:11.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.647+0000 7f5e09e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e0c100150 0x7f5e0c074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.111:48972/0 (socket says 172.21.15.111:48972) 2024-09-11T00:06:11.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.647+0000 7f5e09e00700 1 -- 172.21.15.111:0/4218520487 learned_addr learned my addr 172.21.15.111:0/4218520487 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:06:11.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.647+0000 7f5e09400700 1 --2- 172.21.15.111:0/4218520487 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5e0c101350 0x7f5e0c073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:11.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.647+0000 7f5e09e00700 1 -- 172.21.15.111:0/4218520487 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5e0c101350 msgr2=0x7f5e0c073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:11.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.647+0000 7f5e09e00700 1 --2- 172.21.15.111:0/4218520487 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5e0c101350 0x7f5e0c073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:11.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.647+0000 7f5e09e00700 1 -- 172.21.15.111:0/4218520487 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df80095f0 con 0x7f5e0c100150 2024-09-11T00:06:11.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.648+0000 7f5e09e00700 1 --2- 172.21.15.111:0/4218520487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e0c100150 0x7f5e0c074af0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00e8f0 tx=0x7f5dfc00ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:11.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.648+0000 7f5e02a00700 1 -- 172.21.15.111:0/4218520487 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5dfc009790 con 0x7f5e0c100150 2024-09-11T00:06:11.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.648+0000 7f5e02a00700 1 -- 172.21.15.111:0/4218520487 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5dfc00c810 con 0x7f5e0c100150 2024-09-11T00:06:11.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.648+0000 7f5e02a00700 1 -- 172.21.15.111:0/4218520487 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5dfc003d20 con 0x7f5e0c100150 2024-09-11T00:06:11.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.648+0000 7f5e10e00700 1 -- 172.21.15.111:0/4218520487 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e0c073a40 con 0x7f5e0c100150 2024-09-11T00:06:11.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.648+0000 7f5e10e00700 1 -- 172.21.15.111:0/4218520487 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e0c073f90 con 0x7f5e0c100150 2024-09-11T00:06:11.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.650+0000 7f5e10e00700 1 -- 172.21.15.111:0/4218520487 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e0c108ca0 con 0x7f5e0c100150 2024-09-11T00:06:11.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.651+0000 7f5e02a00700 1 -- 172.21.15.111:0/4218520487 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f5dfc0041f0 con 0x7f5e0c100150 2024-09-11T00:06:11.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.651+0000 7f5e02a00700 1 --2- 172.21.15.111:0/4218520487 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5df006c680 0x7f5df006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:11.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.652+0000 7f5e02a00700 1 -- 172.21.15.111:0/4218520487 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f5dfc014070 con 0x7f5e0c100150 2024-09-11T00:06:11.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.652+0000 7f5e09400700 1 --2- 172.21.15.111:0/4218520487 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5df006c680 0x7f5df006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:11.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.652+0000 7f5e09400700 1 --2- 172.21.15.111:0/4218520487 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5df006c680 0x7f5df006eb30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5df8009fd0 tx=0x7f5df8024040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:11.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.656+0000 7f5e02a00700 1 -- 172.21.15.111:0/4218520487 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5dfc059e20 con 0x7f5e0c100150 2024-09-11T00:06:11.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.940+0000 7f5e10e00700 1 -- 172.21.15.111:0/4218520487 --> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e0c105ca0 con 0x7f5df006c680 2024-09-11T00:06:11.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.941+0000 7f5e02a00700 1 -- 172.21.15.111:0/4218520487 <== mgr.14211 v2:172.21.15.111:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f5e0c105ca0 con 0x7f5df006c680 2024-09-11T00:06:11.943 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:06:11.943 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e", 2024-09-11T00:06:11.943 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-11T00:06:11.943 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-11T00:06:11.943 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [], 2024-09-11T00:06:11.943 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "0/2 daemons upgraded", 2024-09-11T00:06:11.943 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e image on host smithi203", 2024-09-11T00:06:11.943 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-11T00:06:11.943 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:06:11.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.943+0000 7f5e10e00700 1 -- 172.21.15.111:0/4218520487 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5df006c680 msgr2=0x7f5df006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:11.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.943+0000 7f5e10e00700 1 --2- 172.21.15.111:0/4218520487 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5df006c680 0x7f5df006eb30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5df8009fd0 tx=0x7f5df8024040 comp rx=0 tx=0).stop 2024-09-11T00:06:11.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.943+0000 7f5e10e00700 1 -- 172.21.15.111:0/4218520487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e0c100150 msgr2=0x7f5e0c074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:11.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.943+0000 7f5e10e00700 1 --2- 172.21.15.111:0/4218520487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e0c100150 0x7f5e0c074af0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00e8f0 tx=0x7f5dfc00ec00 comp rx=0 tx=0).stop 2024-09-11T00:06:11.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.943+0000 7f5e10e00700 1 -- 172.21.15.111:0/4218520487 shutdown_connections 2024-09-11T00:06:11.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.943+0000 7f5e10e00700 1 --2- 172.21.15.111:0/4218520487 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f5df006c680 0x7f5df006eb30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:11.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.943+0000 7f5e10e00700 1 --2- 172.21.15.111:0/4218520487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e0c100150 0x7f5e0c074af0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:11.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.943+0000 7f5e10e00700 1 --2- 172.21.15.111:0/4218520487 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5e0c101350 0x7f5e0c073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:11.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.943+0000 7f5e10e00700 1 -- 172.21.15.111:0/4218520487 >> 172.21.15.111:0/4218520487 conn(0x7f5e0c0fb6e0 msgr2=0x7f5e0c104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:11.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.944+0000 7f5e10e00700 1 -- 172.21.15.111:0/4218520487 shutdown_connections 2024-09-11T00:06:11.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:11.944+0000 7f5e10e00700 1 -- 172.21.15.111:0/4218520487 wait complete. 2024-09-11T00:06:12.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:11 smithi203 ceph-mon[33225]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:06:12.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:11 smithi203 ceph-mon[33225]: pgmap v295: 65 pgs: 65 active+clean; 84 MiB data, 430 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.3 MiB/s wr, 121 op/s 2024-09-11T00:06:12.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:11 smithi203 ceph-mon[33225]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:06:12.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:11 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/3790697571' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:06:12.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:11 smithi111 ceph-mon[27539]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:06:12.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:11 smithi111 ceph-mon[27539]: pgmap v295: 65 pgs: 65 active+clean; 84 MiB data, 430 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.3 MiB/s wr, 121 op/s 2024-09-11T00:06:12.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:11 smithi111 ceph-mon[27539]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:06:12.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:11 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/3790697571' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:06:13.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:12 smithi111 ceph-mon[27539]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:06:13.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:12 smithi203 ceph-mon[33225]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:06:14.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:13 smithi111 ceph-mon[27539]: pgmap v296: 65 pgs: 65 active+clean; 85 MiB data, 444 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.6 MiB/s wr, 109 op/s 2024-09-11T00:06:14.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:13 smithi203 ceph-mon[33225]: pgmap v296: 65 pgs: 65 active+clean; 85 MiB data, 444 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.6 MiB/s wr, 109 op/s 2024-09-11T00:06:16.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:15 smithi203 ceph-mon[33225]: pgmap v297: 65 pgs: 65 active+clean; 93 MiB data, 464 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.9 MiB/s wr, 119 op/s 2024-09-11T00:06:16.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:15 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:06:16.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:15 smithi111 ceph-mon[27539]: pgmap v297: 65 pgs: 65 active+clean; 93 MiB data, 464 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.9 MiB/s wr, 119 op/s 2024-09-11T00:06:16.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:15 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:06:17.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:17 smithi111 ceph-mon[27539]: pgmap v298: 65 pgs: 65 active+clean; 102 MiB data, 499 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.3 MiB/s wr, 130 op/s 2024-09-11T00:06:18.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:17 smithi203 ceph-mon[33225]: pgmap v298: 65 pgs: 65 active+clean; 102 MiB data, 499 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.3 MiB/s wr, 130 op/s 2024-09-11T00:06:20.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:19 smithi111 ceph-mon[27539]: pgmap v299: 65 pgs: 65 active+clean; 104 MiB data, 519 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.6 MiB/s wr, 123 op/s 2024-09-11T00:06:20.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:19 smithi203 ceph-mon[33225]: pgmap v299: 65 pgs: 65 active+clean; 104 MiB data, 519 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.6 MiB/s wr, 123 op/s 2024-09-11T00:06:22.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:21 smithi111 ceph-mon[27539]: pgmap v300: 65 pgs: 65 active+clean; 108 MiB data, 536 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.9 MiB/s wr, 118 op/s 2024-09-11T00:06:22.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:21 smithi203 ceph-mon[33225]: pgmap v300: 65 pgs: 65 active+clean; 108 MiB data, 536 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.9 MiB/s wr, 118 op/s 2024-09-11T00:06:24.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:23 smithi111 ceph-mon[27539]: pgmap v301: 65 pgs: 65 active+clean; 109 MiB data, 548 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.1 MiB/s wr, 112 op/s 2024-09-11T00:06:24.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:23 smithi203 ceph-mon[33225]: pgmap v301: 65 pgs: 65 active+clean; 109 MiB data, 548 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.1 MiB/s wr, 112 op/s 2024-09-11T00:06:26.126 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:25 smithi203 ceph-mon[33225]: pgmap v302: 65 pgs: 65 active+clean; 114 MiB data, 562 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.4 MiB/s wr, 124 op/s 2024-09-11T00:06:26.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:25 smithi111 ceph-mon[27539]: pgmap v302: 65 pgs: 65 active+clean; 114 MiB data, 562 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.4 MiB/s wr, 124 op/s 2024-09-11T00:06:27.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:27 smithi111 ceph-mon[27539]: pgmap v303: 65 pgs: 65 active+clean; 119 MiB data, 583 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.2 MiB/s wr, 134 op/s 2024-09-11T00:06:28.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:27 smithi203 ceph-mon[33225]: pgmap v303: 65 pgs: 65 active+clean; 119 MiB data, 583 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.2 MiB/s wr, 134 op/s 2024-09-11T00:06:30.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:29 smithi111 ceph-mon[27539]: pgmap v304: 65 pgs: 65 active+clean; 131 MiB data, 616 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.6 MiB/s wr, 143 op/s 2024-09-11T00:06:30.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:29 smithi203 ceph-mon[33225]: pgmap v304: 65 pgs: 65 active+clean; 131 MiB data, 616 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.6 MiB/s wr, 143 op/s 2024-09-11T00:06:31.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:30 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:06:31.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:30 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:06:32.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:31 smithi111 ceph-mon[27539]: pgmap v305: 65 pgs: 65 active+clean; 133 MiB data, 634 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.5 MiB/s wr, 148 op/s 2024-09-11T00:06:32.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:31 smithi203 ceph-mon[33225]: pgmap v305: 65 pgs: 65 active+clean; 133 MiB data, 634 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.5 MiB/s wr, 148 op/s 2024-09-11T00:06:34.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:33 smithi111 ceph-mon[27539]: pgmap v306: 65 pgs: 65 active+clean; 138 MiB data, 650 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.5 MiB/s wr, 156 op/s 2024-09-11T00:06:34.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:33 smithi203 ceph-mon[33225]: pgmap v306: 65 pgs: 65 active+clean; 138 MiB data, 650 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.5 MiB/s wr, 156 op/s 2024-09-11T00:06:36.127 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:35 smithi203 ceph-mon[33225]: pgmap v307: 65 pgs: 65 active+clean; 143 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.0 MiB/s wr, 177 op/s 2024-09-11T00:06:36.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:35 smithi111 ceph-mon[27539]: pgmap v307: 65 pgs: 65 active+clean; 143 MiB data, 659 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.0 MiB/s wr, 177 op/s 2024-09-11T00:06:37.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:37 smithi111 ceph-mon[27539]: Upgrade: Updating mgr.smithi203.smuspl 2024-09-11T00:06:37.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:37 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:06:37.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:37 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi203.smuspl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T00:06:37.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:37 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T00:06:37.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:37 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:06:37.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:37 smithi111 ceph-mon[27539]: Deploying daemon mgr.smithi203.smuspl on smithi203 2024-09-11T00:06:37.473 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:37 smithi203 ceph-mon[33225]: Upgrade: Updating mgr.smithi203.smuspl 2024-09-11T00:06:37.473 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:37 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:06:37.473 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:37 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi203.smuspl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T00:06:37.474 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:37 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T00:06:37.474 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:37 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:06:37.474 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:37 smithi203 ceph-mon[33225]: Deploying daemon mgr.smithi203.smuspl on smithi203 2024-09-11T00:06:38.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:38 smithi203 ceph-mon[33225]: pgmap v308: 65 pgs: 65 active+clean; 150 MiB data, 683 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.1 MiB/s wr, 196 op/s 2024-09-11T00:06:38.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:38 smithi111 ceph-mon[27539]: pgmap v308: 65 pgs: 65 active+clean; 150 MiB data, 683 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.1 MiB/s wr, 196 op/s 2024-09-11T00:06:40.403 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:40 smithi203 ceph-mon[33225]: pgmap v309: 65 pgs: 65 active+clean; 156 MiB data, 723 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.2 MiB/s wr, 222 op/s 2024-09-11T00:06:40.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:40 smithi111 ceph-mon[27539]: pgmap v309: 65 pgs: 65 active+clean; 156 MiB data, 723 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.2 MiB/s wr, 222 op/s 2024-09-11T00:06:42.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.115+0000 7f09eb200700 1 -- 172.21.15.111:0/1838118306 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f09ec1033c0 msgr2=0x7f09ec103810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:42.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.115+0000 7f09eb200700 1 --2- 172.21.15.111:0/1838118306 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f09ec1033c0 0x7f09ec103810 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f09d8009910 tx=0x7f09d8009c20 comp rx=0 tx=0).stop 2024-09-11T00:06:42.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.115+0000 7f09eb200700 1 -- 172.21.15.111:0/1838118306 shutdown_connections 2024-09-11T00:06:42.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.115+0000 7f09eb200700 1 --2- 172.21.15.111:0/1838118306 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f09ec1033c0 0x7f09ec103810 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:42.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.115+0000 7f09eb200700 1 --2- 172.21.15.111:0/1838118306 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f09ec1021c0 0x7f09ec1025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:42.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.115+0000 7f09eb200700 1 -- 172.21.15.111:0/1838118306 >> 172.21.15.111:0/1838118306 conn(0x7f09ec0fd790 msgr2=0x7f09ec0ffba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:42.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.116+0000 7f09eb200700 1 -- 172.21.15.111:0/1838118306 shutdown_connections 2024-09-11T00:06:42.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.116+0000 7f09eb200700 1 -- 172.21.15.111:0/1838118306 wait complete. 2024-09-11T00:06:42.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.117+0000 7f09eb200700 1 Processor -- start 2024-09-11T00:06:42.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.117+0000 7f09eb200700 1 -- start start 2024-09-11T00:06:42.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.117+0000 7f09eb200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f09ec1021c0 0x7f09ec193580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:42.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.117+0000 7f09eb200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f09ec1033c0 0x7f09ec193ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:42.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.117+0000 7f09eb200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec194000 con 0x7f09ec1033c0 2024-09-11T00:06:42.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.117+0000 7f09eb200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec194140 con 0x7f09ec1021c0 2024-09-11T00:06:42.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.118+0000 7f09e9400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f09ec1033c0 0x7f09ec193ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:42.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.118+0000 7f09e9e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f09ec1021c0 0x7f09ec193580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:42.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.118+0000 7f09e9e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f09ec1021c0 0x7f09ec193580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.111:44644/0 (socket says 172.21.15.111:44644) 2024-09-11T00:06:42.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.118+0000 7f09e9400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f09ec1033c0 0x7f09ec193ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44764/0 (socket says 172.21.15.111:44764) 2024-09-11T00:06:42.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.118+0000 7f09e9e00700 1 -- 172.21.15.111:0/3991789501 learned_addr learned my addr 172.21.15.111:0/3991789501 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:06:42.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.118+0000 7f09e9e00700 1 -- 172.21.15.111:0/3991789501 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f09ec1033c0 msgr2=0x7f09ec193ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:42.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.118+0000 7f09e9e00700 1 --2- 172.21.15.111:0/3991789501 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f09ec1033c0 0x7f09ec193ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:42.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.118+0000 7f09e9e00700 1 -- 172.21.15.111:0/3991789501 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d80095f0 con 0x7f09ec1021c0 2024-09-11T00:06:42.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.118+0000 7f09e9400700 1 --2- 172.21.15.111:0/3991789501 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f09ec1033c0 0x7f09ec193ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:06:42.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.119+0000 7f09e9e00700 1 --2- 172.21.15.111:0/3991789501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f09ec1021c0 0x7f09ec193580 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f09dc00e8f0 tx=0x7f09dc00ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:42.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.119+0000 7f09e2a00700 1 -- 172.21.15.111:0/3991789501 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09dc009790 con 0x7f09ec1021c0 2024-09-11T00:06:42.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.119+0000 7f09e2a00700 1 -- 172.21.15.111:0/3991789501 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f09dc00c810 con 0x7f09ec1021c0 2024-09-11T00:06:42.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.119+0000 7f09e2a00700 1 -- 172.21.15.111:0/3991789501 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09dc003d20 con 0x7f09ec1021c0 2024-09-11T00:06:42.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.119+0000 7f09eb200700 1 -- 172.21.15.111:0/3991789501 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09ec1a9cd0 con 0x7f09ec1021c0 2024-09-11T00:06:42.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.119+0000 7f09eb200700 1 -- 172.21.15.111:0/3991789501 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09ec1aa170 con 0x7f09ec1021c0 2024-09-11T00:06:42.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.120+0000 7f09eb200700 1 -- 172.21.15.111:0/3991789501 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09ec10ad10 con 0x7f09ec1021c0 2024-09-11T00:06:42.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.122+0000 7f09e2a00700 1 -- 172.21.15.111:0/3991789501 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f09dc0041f0 con 0x7f09ec1021c0 2024-09-11T00:06:42.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.123+0000 7f09e2a00700 1 --2- 172.21.15.111:0/3991789501 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f09d006c680 0x7f09d006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:42.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.123+0000 7f09e2a00700 1 -- 172.21.15.111:0/3991789501 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f09dc014070 con 0x7f09ec1021c0 2024-09-11T00:06:42.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.123+0000 7f09e9400700 1 --2- 172.21.15.111:0/3991789501 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f09d006c680 0x7f09d006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:42.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.124+0000 7f09e9400700 1 --2- 172.21.15.111:0/3991789501 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f09d006c680 0x7f09d006eb30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f09d8009fd0 tx=0x7f09d8005fd0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:42.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.130+0000 7f09e2a00700 1 -- 172.21.15.111:0/3991789501 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f09dc059ea0 con 0x7f09ec1021c0 2024-09-11T00:06:42.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:42 smithi111 ceph-mon[27539]: pgmap v310: 65 pgs: 65 active+clean; 162 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.6 MiB/s wr, 234 op/s 2024-09-11T00:06:42.410 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.409+0000 7f09eb200700 1 -- 172.21.15.111:0/3991789501 --> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f09ec107d10 con 0x7f09d006c680 2024-09-11T00:06:42.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.410+0000 7f09e2a00700 1 -- 172.21.15.111:0/3991789501 <== mgr.14211 v2:172.21.15.111:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f09ec107d10 con 0x7f09d006c680 2024-09-11T00:06:42.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.413+0000 7f09eb200700 1 -- 172.21.15.111:0/3991789501 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f09d006c680 msgr2=0x7f09d006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:42.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.413+0000 7f09eb200700 1 --2- 172.21.15.111:0/3991789501 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f09d006c680 0x7f09d006eb30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f09d8009fd0 tx=0x7f09d8005fd0 comp rx=0 tx=0).stop 2024-09-11T00:06:42.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.413+0000 7f09eb200700 1 -- 172.21.15.111:0/3991789501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f09ec1021c0 msgr2=0x7f09ec193580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:42.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.413+0000 7f09eb200700 1 --2- 172.21.15.111:0/3991789501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f09ec1021c0 0x7f09ec193580 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f09dc00e8f0 tx=0x7f09dc00ec00 comp rx=0 tx=0).stop 2024-09-11T00:06:42.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.413+0000 7f09eb200700 1 -- 172.21.15.111:0/3991789501 shutdown_connections 2024-09-11T00:06:42.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.413+0000 7f09eb200700 1 --2- 172.21.15.111:0/3991789501 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f09d006c680 0x7f09d006eb30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:42.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.413+0000 7f09eb200700 1 --2- 172.21.15.111:0/3991789501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f09ec1021c0 0x7f09ec193580 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:42.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.413+0000 7f09eb200700 1 --2- 172.21.15.111:0/3991789501 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f09ec1033c0 0x7f09ec193ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:42.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.413+0000 7f09eb200700 1 -- 172.21.15.111:0/3991789501 >> 172.21.15.111:0/3991789501 conn(0x7f09ec0fd790 msgr2=0x7f09ec1065f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:42.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.414+0000 7f09eb200700 1 -- 172.21.15.111:0/3991789501 shutdown_connections 2024-09-11T00:06:42.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.414+0000 7f09eb200700 1 -- 172.21.15.111:0/3991789501 wait complete. 2024-09-11T00:06:42.433 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:06:42.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:42 smithi203 ceph-mon[33225]: pgmap v310: 65 pgs: 65 active+clean; 162 MiB data, 732 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.6 MiB/s wr, 234 op/s 2024-09-11T00:06:42.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.588+0000 7f106f800700 1 -- 172.21.15.111:0/3794982259 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1068101350 msgr2=0x7f10681017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:42.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.588+0000 7f106f800700 1 --2- 172.21.15.111:0/3794982259 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1068101350 0x7f10681017a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1054009910 tx=0x7f1054009c20 comp rx=0 tx=0).stop 2024-09-11T00:06:42.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.589+0000 7f106f800700 1 -- 172.21.15.111:0/3794982259 shutdown_connections 2024-09-11T00:06:42.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.589+0000 7f106f800700 1 --2- 172.21.15.111:0/3794982259 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1068101350 0x7f10681017a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:42.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.589+0000 7f106f800700 1 --2- 172.21.15.111:0/3794982259 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1068100150 0x7f1068100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:42.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.589+0000 7f106f800700 1 -- 172.21.15.111:0/3794982259 >> 172.21.15.111:0/3794982259 conn(0x7f10680fb6e0 msgr2=0x7f10680fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:42.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.589+0000 7f106f800700 1 -- 172.21.15.111:0/3794982259 shutdown_connections 2024-09-11T00:06:42.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.589+0000 7f106f800700 1 -- 172.21.15.111:0/3794982259 wait complete. 2024-09-11T00:06:42.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.590+0000 7f106f800700 1 Processor -- start 2024-09-11T00:06:42.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.590+0000 7f106f800700 1 -- start start 2024-09-11T00:06:42.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.591+0000 7f106f800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1068100150 0x7f1068074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:42.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.591+0000 7f106f800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1068101350 0x7f1068073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:42.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.591+0000 7f106f800700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1068073680 con 0x7f1068100150 2024-09-11T00:06:42.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.591+0000 7f106f800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10680737c0 con 0x7f1068101350 2024-09-11T00:06:42.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.591+0000 7f106ce00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1068100150 0x7f1068074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:42.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.591+0000 7f1067e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1068101350 0x7f1068073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:42.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.591+0000 7f106ce00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1068100150 0x7f1068074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44796/0 (socket says 172.21.15.111:44796) 2024-09-11T00:06:42.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.591+0000 7f106ce00700 1 -- 172.21.15.111:0/3154366083 learned_addr learned my addr 172.21.15.111:0/3154366083 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:06:42.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.592+0000 7f1067e00700 1 -- 172.21.15.111:0/3154366083 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1068100150 msgr2=0x7f1068074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:42.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.592+0000 7f1067e00700 1 --2- 172.21.15.111:0/3154366083 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1068100150 0x7f1068074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:42.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.592+0000 7f1067e00700 1 -- 172.21.15.111:0/3154366083 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10540095f0 con 0x7f1068101350 2024-09-11T00:06:42.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.592+0000 7f106ce00700 1 --2- 172.21.15.111:0/3154366083 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1068100150 0x7f1068074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:06:42.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.592+0000 7f1067e00700 1 --2- 172.21.15.111:0/3154366083 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1068101350 0x7f1068073140 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1054009910 tx=0x7f105400f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:42.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.593+0000 7f1065600700 1 -- 172.21.15.111:0/3154366083 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f105401d070 con 0x7f1068101350 2024-09-11T00:06:42.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.593+0000 7f106f800700 1 -- 172.21.15.111:0/3154366083 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1068073a40 con 0x7f1068101350 2024-09-11T00:06:42.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.593+0000 7f1065600700 1 -- 172.21.15.111:0/3154366083 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1054005dc0 con 0x7f1068101350 2024-09-11T00:06:42.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.593+0000 7f1065600700 1 -- 172.21.15.111:0/3154366083 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1054017400 con 0x7f1068101350 2024-09-11T00:06:42.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.593+0000 7f106f800700 1 -- 172.21.15.111:0/3154366083 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1068073f30 con 0x7f1068101350 2024-09-11T00:06:42.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.595+0000 7f106f800700 1 -- 172.21.15.111:0/3154366083 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1068108ca0 con 0x7f1068101350 2024-09-11T00:06:42.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.596+0000 7f1065600700 1 -- 172.21.15.111:0/3154366083 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f1054003810 con 0x7f1068101350 2024-09-11T00:06:42.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.597+0000 7f1065600700 1 --2- 172.21.15.111:0/3154366083 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f105006c6d0 0x7f105006eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:42.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.597+0000 7f1065600700 1 -- 172.21.15.111:0/3154366083 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f105408cb80 con 0x7f1068101350 2024-09-11T00:06:42.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.598+0000 7f106ce00700 1 --2- 172.21.15.111:0/3154366083 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f105006c6d0 0x7f105006eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:42.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.599+0000 7f106ce00700 1 --2- 172.21.15.111:0/3154366083 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f105006c6d0 0x7f105006eb80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f105c005950 tx=0x7f105c009260 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:42.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.605+0000 7f1065600700 1 -- 172.21.15.111:0/3154366083 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f105405ad20 con 0x7f1068101350 2024-09-11T00:06:42.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.872+0000 7f106f800700 1 -- 172.21.15.111:0/3154366083 --> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1068105ca0 con 0x7f105006c6d0 2024-09-11T00:06:42.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.873+0000 7f1065600700 1 -- 172.21.15.111:0/3154366083 <== mgr.14211 v2:172.21.15.111:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f1068105ca0 con 0x7f105006c6d0 2024-09-11T00:06:42.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.876+0000 7f106f800700 1 -- 172.21.15.111:0/3154366083 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f105006c6d0 msgr2=0x7f105006eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:42.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.876+0000 7f106f800700 1 --2- 172.21.15.111:0/3154366083 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f105006c6d0 0x7f105006eb80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f105c005950 tx=0x7f105c009260 comp rx=0 tx=0).stop 2024-09-11T00:06:42.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.876+0000 7f106f800700 1 -- 172.21.15.111:0/3154366083 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1068101350 msgr2=0x7f1068073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:42.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.876+0000 7f106f800700 1 --2- 172.21.15.111:0/3154366083 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1068101350 0x7f1068073140 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1054009910 tx=0x7f105400f690 comp rx=0 tx=0).stop 2024-09-11T00:06:42.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.876+0000 7f106f800700 1 -- 172.21.15.111:0/3154366083 shutdown_connections 2024-09-11T00:06:42.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.876+0000 7f106f800700 1 --2- 172.21.15.111:0/3154366083 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f105006c6d0 0x7f105006eb80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:42.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.876+0000 7f106f800700 1 --2- 172.21.15.111:0/3154366083 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1068100150 0x7f1068074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:42.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.876+0000 7f106f800700 1 --2- 172.21.15.111:0/3154366083 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1068101350 0x7f1068073140 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1054009910 tx=0x7f105400f690 comp rx=0 tx=0).stop 2024-09-11T00:06:42.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.876+0000 7f106f800700 1 -- 172.21.15.111:0/3154366083 >> 172.21.15.111:0/3154366083 conn(0x7f10680fb6e0 msgr2=0x7f1068104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:42.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.877+0000 7f106f800700 1 -- 172.21.15.111:0/3154366083 shutdown_connections 2024-09-11T00:06:42.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:42.877+0000 7f106f800700 1 -- 172.21.15.111:0/3154366083 wait complete. 2024-09-11T00:06:43.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.059+0000 7f2eba000700 1 -- 172.21.15.111:0/2745754103 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2eb40ff1c0 msgr2=0x7f2eb40ff630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:43.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.059+0000 7f2eba000700 1 --2- 172.21.15.111:0/2745754103 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2eb40ff1c0 0x7f2eb40ff630 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0009910 tx=0x7f2ea0009c20 comp rx=0 tx=0).stop 2024-09-11T00:06:43.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.059+0000 7f2eba000700 1 -- 172.21.15.111:0/2745754103 shutdown_connections 2024-09-11T00:06:43.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.059+0000 7f2eba000700 1 --2- 172.21.15.111:0/2745754103 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2eb40ff1c0 0x7f2eb40ff630 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:43.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.059+0000 7f2eba000700 1 --2- 172.21.15.111:0/2745754103 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2eb40fe870 0x7f2eb40fec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:43.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.059+0000 7f2eba000700 1 -- 172.21.15.111:0/2745754103 >> 172.21.15.111:0/2745754103 conn(0x7f2eb40fa440 msgr2=0x7f2eb40fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:43.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.060+0000 7f2eba000700 1 -- 172.21.15.111:0/2745754103 shutdown_connections 2024-09-11T00:06:43.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.060+0000 7f2eba000700 1 -- 172.21.15.111:0/2745754103 wait complete. 2024-09-11T00:06:43.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.061+0000 7f2eba000700 1 Processor -- start 2024-09-11T00:06:43.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.061+0000 7f2eba000700 1 -- start start 2024-09-11T00:06:43.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.061+0000 7f2eba000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2eb40fe870 0x7f2eb419bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:43.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.061+0000 7f2eba000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2eb40ff1c0 0x7f2eb419c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:43.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.061+0000 7f2eba000700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb419c8c0 con 0x7f2eb40ff1c0 2024-09-11T00:06:43.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.061+0000 7f2eba000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb419ca00 con 0x7f2eb40fe870 2024-09-11T00:06:43.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.062+0000 7f2eb8c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2eb40fe870 0x7f2eb419bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:43.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.062+0000 7f2eb8c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2eb40fe870 0x7f2eb419bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.111:44690/0 (socket says 172.21.15.111:44690) 2024-09-11T00:06:43.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.062+0000 7f2eb8c00700 1 -- 172.21.15.111:0/258639108 learned_addr learned my addr 172.21.15.111:0/258639108 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:06:43.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.062+0000 7f2eb3e00700 1 --2- 172.21.15.111:0/258639108 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2eb40ff1c0 0x7f2eb419c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:43.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.062+0000 7f2eb8c00700 1 -- 172.21.15.111:0/258639108 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2eb40ff1c0 msgr2=0x7f2eb419c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:43.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.062+0000 7f2eb8c00700 1 --2- 172.21.15.111:0/258639108 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2eb40ff1c0 0x7f2eb419c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:43.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.062+0000 7f2eb8c00700 1 -- 172.21.15.111:0/258639108 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea00095f0 con 0x7f2eb40fe870 2024-09-11T00:06:43.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.062+0000 7f2eb3e00700 1 --2- 172.21.15.111:0/258639108 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2eb40ff1c0 0x7f2eb419c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:06:43.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.063+0000 7f2eb8c00700 1 --2- 172.21.15.111:0/258639108 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2eb40fe870 0x7f2eb419bd60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2ea800e920 tx=0x7f2ea800ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:43.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.063+0000 7f2eb1600700 1 -- 172.21.15.111:0/258639108 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ea8009790 con 0x7f2eb40fe870 2024-09-11T00:06:43.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.063+0000 7f2eb1600700 1 -- 172.21.15.111:0/258639108 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2ea800cba0 con 0x7f2eb40fe870 2024-09-11T00:06:43.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.063+0000 7f2eb1600700 1 -- 172.21.15.111:0/258639108 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ea8018630 con 0x7f2eb40fe870 2024-09-11T00:06:43.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.063+0000 7f2eba000700 1 -- 172.21.15.111:0/258639108 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb41a14b0 con 0x7f2eb40fe870 2024-09-11T00:06:43.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.063+0000 7f2eba000700 1 -- 172.21.15.111:0/258639108 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb41a1a00 con 0x7f2eb40fe870 2024-09-11T00:06:43.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.065+0000 7f2eba000700 1 -- 172.21.15.111:0/258639108 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb41074c0 con 0x7f2eb40fe870 2024-09-11T00:06:43.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.067+0000 7f2eb1600700 1 -- 172.21.15.111:0/258639108 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f2ea800cd10 con 0x7f2eb40fe870 2024-09-11T00:06:43.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.068+0000 7f2eb1600700 1 --2- 172.21.15.111:0/258639108 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f2e9c06c680 0x7f2e9c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:43.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.068+0000 7f2eb1600700 1 -- 172.21.15.111:0/258639108 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f2ea8014070 con 0x7f2eb40fe870 2024-09-11T00:06:43.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.068+0000 7f2eb3e00700 1 --2- 172.21.15.111:0/258639108 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f2e9c06c680 0x7f2e9c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:43.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.069+0000 7f2eb3e00700 1 --2- 172.21.15.111:0/258639108 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f2e9c06c680 0x7f2e9c06eb30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0009fd0 tx=0x7f2ea0005940 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:43.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.073+0000 7f2eb1600700 1 -- 172.21.15.111:0/258639108 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2ea805a3a0 con 0x7f2eb40fe870 2024-09-11T00:06:43.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.347+0000 7f2eba000700 1 -- 172.21.15.111:0/258639108 --> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2eb4061190 con 0x7f2e9c06c680 2024-09-11T00:06:43.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.361+0000 7f2eb1600700 1 -- 172.21.15.111:0/258639108 <== mgr.14211 v2:172.21.15.111:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3528 (secure 0 0 0) 0x7f2eb4061190 con 0x7f2e9c06c680 2024-09-11T00:06:43.363 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:06:43.363 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (7m) 2m ago 9m 13.3M - 0.25.0 c8568f914cd2 eb9e393000ec 2024-09-11T00:06:43.363 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (10m) 2m ago 10m 7453k - 18.2.0 dc2bc1663786 b6e7b6bd4d27 2024-09-11T00:06:43.363 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi203 smithi203 running (8m) 2m ago 8m 7360k - 18.2.0 dc2bc1663786 7bbfd9c27900 2024-09-11T00:06:43.363 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (10m) 2m ago 10m 6665k - 18.2.0 dc2bc1663786 72a36c166ffa 2024-09-11T00:06:43.363 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi203 smithi203 running (8m) 2m ago 8m 6669k - 18.2.0 dc2bc1663786 9b102b6f6d70 2024-09-11T00:06:43.363 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (7m) 2m ago 9m 75.0M - 9.4.7 954c08fa6188 e599624a9c9e 2024-09-11T00:06:43.364 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.gmgsay smithi111 running (2m) 2m ago 2m 11.6M - 18.2.0 dc2bc1663786 795e4ff0075c 2024-09-11T00:06:43.364 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.rucaba smithi111 running (2m) 2m ago 2m 11.6M - 18.2.0 dc2bc1663786 02885adac62c 2024-09-11T00:06:43.364 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.tcrqop smithi203 running (2m) 2m ago 2m 14.1M - 18.2.0 dc2bc1663786 4df492159bb4 2024-09-11T00:06:43.364 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.uqkbkn smithi203 running (2m) 2m ago 2m 11.5M - 18.2.0 dc2bc1663786 619aa58ea314 2024-09-11T00:06:43.364 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.ypucji smithi111 *:9283,8765,8443 running (11m) 2m ago 11m 488M - 18.2.0 dc2bc1663786 0329ec697a09 2024-09-11T00:06:43.364 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi203.smuspl smithi203 *:8443,9283,8765 starting - - - - 2024-09-11T00:06:43.364 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (11m) 2m ago 11m 44.6M 2048M 18.2.0 dc2bc1663786 2596322539fb 2024-09-11T00:06:43.364 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi203 smithi203 running (8m) 2m ago 8m 34.0M 2048M 18.2.0 dc2bc1663786 ff8eb7ca85ea 2024-09-11T00:06:43.364 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (10m) 2m ago 9m 7604k - 1.5.0 0da6a335fe13 4fd66ebc9c0d 2024-09-11T00:06:43.364 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi203 smithi203 *:9100 running (8m) 2m ago 8m 7600k - 1.5.0 0da6a335fe13 1cb3ca740f4a 2024-09-11T00:06:43.364 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (7m) 2m ago 7m 46.8M 3947M 18.2.0 dc2bc1663786 162b7249a591 2024-09-11T00:06:43.364 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (6m) 2m ago 6m 46.7M 3947M 18.2.0 dc2bc1663786 3614d95b1425 2024-09-11T00:06:43.365 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (5m) 2m ago 5m 45.2M 3947M 18.2.0 dc2bc1663786 db175d4b09b9 2024-09-11T00:06:43.365 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi203 running (5m) 2m ago 5m 45.3M 4971M 18.2.0 dc2bc1663786 60b1cef7a70d 2024-09-11T00:06:43.365 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi203 running (5m) 2m ago 5m 42.8M 4971M 18.2.0 dc2bc1663786 769c7942c42b 2024-09-11T00:06:43.365 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi203 running (4m) 2m ago 4m 42.6M 4971M 18.2.0 dc2bc1663786 6d824001d40c 2024-09-11T00:06:43.365 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (7m) 2m ago 9m 62.5M - 2.43.0 a07b618ecd1d bd707157a41b 2024-09-11T00:06:43.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.364+0000 7f2eba000700 1 -- 172.21.15.111:0/258639108 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f2e9c06c680 msgr2=0x7f2e9c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:43.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.364+0000 7f2eba000700 1 --2- 172.21.15.111:0/258639108 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f2e9c06c680 0x7f2e9c06eb30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0009fd0 tx=0x7f2ea0005940 comp rx=0 tx=0).stop 2024-09-11T00:06:43.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.364+0000 7f2eba000700 1 -- 172.21.15.111:0/258639108 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2eb40fe870 msgr2=0x7f2eb419bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:43.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.364+0000 7f2eba000700 1 --2- 172.21.15.111:0/258639108 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2eb40fe870 0x7f2eb419bd60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2ea800e920 tx=0x7f2ea800ece0 comp rx=0 tx=0).stop 2024-09-11T00:06:43.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.364+0000 7f2eba000700 1 -- 172.21.15.111:0/258639108 shutdown_connections 2024-09-11T00:06:43.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.364+0000 7f2eba000700 1 --2- 172.21.15.111:0/258639108 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f2e9c06c680 0x7f2e9c06eb30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:43.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.364+0000 7f2eba000700 1 --2- 172.21.15.111:0/258639108 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2eb40fe870 0x7f2eb419bd60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:43.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.364+0000 7f2eba000700 1 --2- 172.21.15.111:0/258639108 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2eb40ff1c0 0x7f2eb419c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:43.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.364+0000 7f2eba000700 1 -- 172.21.15.111:0/258639108 >> 172.21.15.111:0/258639108 conn(0x7f2eb40fa440 msgr2=0x7f2eb4104600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:43.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.364+0000 7f2eba000700 1 -- 172.21.15.111:0/258639108 shutdown_connections 2024-09-11T00:06:43.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.365+0000 7f2eba000700 1 -- 172.21.15.111:0/258639108 wait complete. 2024-09-11T00:06:43.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.543+0000 7fc107e00700 1 -- 172.21.15.111:0/2750845272 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc108101190 msgr2=0x7fc1081015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:43.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.543+0000 7fc107e00700 1 --2- 172.21.15.111:0/2750845272 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc108101190 0x7fc1081015e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4009910 tx=0x7fc0f4009c20 comp rx=0 tx=0).stop 2024-09-11T00:06:43.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.543+0000 7fc107e00700 1 -- 172.21.15.111:0/2750845272 shutdown_connections 2024-09-11T00:06:43.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.543+0000 7fc107e00700 1 --2- 172.21.15.111:0/2750845272 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc108101190 0x7fc1081015e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:43.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.543+0000 7fc107e00700 1 --2- 172.21.15.111:0/2750845272 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc1080fff90 0x7fc1081003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:43.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.543+0000 7fc107e00700 1 -- 172.21.15.111:0/2750845272 >> 172.21.15.111:0/2750845272 conn(0x7fc1080fb500 msgr2=0x7fc1080fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:43.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.543+0000 7fc107e00700 1 -- 172.21.15.111:0/2750845272 shutdown_connections 2024-09-11T00:06:43.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.543+0000 7fc107e00700 1 -- 172.21.15.111:0/2750845272 wait complete. 2024-09-11T00:06:43.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.544+0000 7fc107e00700 1 Processor -- start 2024-09-11T00:06:43.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.544+0000 7fc107e00700 1 -- start start 2024-09-11T00:06:43.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.545+0000 7fc107e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc1080fff90 0x7fc1081979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:43.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.545+0000 7fc107e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc108101190 0x7fc108197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:43.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.545+0000 7fc107e00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc108198510 con 0x7fc108101190 2024-09-11T00:06:43.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.545+0000 7fc107e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc108198650 con 0x7fc1080fff90 2024-09-11T00:06:43.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.545+0000 7fc106a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc1080fff90 0x7fc1081979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:43.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.545+0000 7fc106a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc1080fff90 0x7fc1081979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.111:44702/0 (socket says 172.21.15.111:44702) 2024-09-11T00:06:43.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.545+0000 7fc106a00700 1 -- 172.21.15.111:0/3750763318 learned_addr learned my addr 172.21.15.111:0/3750763318 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:06:43.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.545+0000 7fc106000700 1 --2- 172.21.15.111:0/3750763318 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc108101190 0x7fc108197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:43.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.546+0000 7fc106a00700 1 -- 172.21.15.111:0/3750763318 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc108101190 msgr2=0x7fc108197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:43.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.546+0000 7fc106a00700 1 --2- 172.21.15.111:0/3750763318 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc108101190 0x7fc108197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:43.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.546+0000 7fc106a00700 1 -- 172.21.15.111:0/3750763318 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f40095f0 con 0x7fc1080fff90 2024-09-11T00:06:43.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.546+0000 7fc106a00700 1 --2- 172.21.15.111:0/3750763318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc1080fff90 0x7fc1081979b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800d900 tx=0x7fc0f800dc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:43.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.547+0000 7fc10ca00700 1 -- 172.21.15.111:0/3750763318 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0f80041f0 con 0x7fc1080fff90 2024-09-11T00:06:43.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.547+0000 7fc10ca00700 1 -- 172.21.15.111:0/3750763318 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc0f8004350 con 0x7fc1080fff90 2024-09-11T00:06:43.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.547+0000 7fc10ca00700 1 -- 172.21.15.111:0/3750763318 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0f8003d20 con 0x7fc1080fff90 2024-09-11T00:06:43.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.547+0000 7fc107e00700 1 -- 172.21.15.111:0/3750763318 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc10819d100 con 0x7fc1080fff90 2024-09-11T00:06:43.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.547+0000 7fc107e00700 1 -- 172.21.15.111:0/3750763318 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc10819d650 con 0x7fc1080fff90 2024-09-11T00:06:43.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.548+0000 7fc107e00700 1 -- 172.21.15.111:0/3750763318 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc108105270 con 0x7fc1080fff90 2024-09-11T00:06:43.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.549+0000 7fc10ca00700 1 -- 172.21.15.111:0/3750763318 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fc0f8009730 con 0x7fc1080fff90 2024-09-11T00:06:43.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.550+0000 7fc10ca00700 1 --2- 172.21.15.111:0/3750763318 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc0ec06c7a0 0x7fc0ec06ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:43.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.551+0000 7fc10ca00700 1 -- 172.21.15.111:0/3750763318 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fc0f808b670 con 0x7fc1080fff90 2024-09-11T00:06:43.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.551+0000 7fc106000700 1 --2- 172.21.15.111:0/3750763318 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc0ec06c7a0 0x7fc0ec06ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:43.554 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.552+0000 7fc106000700 1 --2- 172.21.15.111:0/3750763318 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc0ec06c7a0 0x7fc0ec06ec50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4006010 tx=0x7fc0f400b560 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:43.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.558+0000 7fc10ca00700 1 -- 172.21.15.111:0/3750763318 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc0f8059890 con 0x7fc1080fff90 2024-09-11T00:06:43.604 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:43 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:06:43.604 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:43 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:06:43.604 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:43 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:06:43.604 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:43 smithi203 ceph-mon[33225]: from='client.24465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:06:43.604 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:43 smithi203 ceph-mon[33225]: pgmap v311: 65 pgs: 65 active+clean; 167 MiB data, 734 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.9 MiB/s wr, 239 op/s 2024-09-11T00:06:43.604 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:43 smithi203 ceph-mon[33225]: from='client.24473 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:06:43.605 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:43 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:06:43.605 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:43 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:06:43.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:43 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:06:43.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:43 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:06:43.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:43 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:06:43.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:43 smithi111 ceph-mon[27539]: from='client.24465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:06:43.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:43 smithi111 ceph-mon[27539]: pgmap v311: 65 pgs: 65 active+clean; 167 MiB data, 734 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.9 MiB/s wr, 239 op/s 2024-09-11T00:06:43.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:43 smithi111 ceph-mon[27539]: from='client.24473 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:06:43.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:43 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:06:43.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:43 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:06:43.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.935+0000 7fc107e00700 1 -- 172.21.15.111:0/3750763318 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc108061aa0 con 0x7fc1080fff90 2024-09-11T00:06:43.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.936+0000 7fc10ca00700 1 -- 172.21.15.111:0/3750763318 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7fc0f8003e80 con 0x7fc1080fff90 2024-09-11T00:06:43.938 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:06:43.938 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-11T00:06:43.938 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-11T00:06:43.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:06:43.938 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-11T00:06:43.938 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-11T00:06:43.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:06:43.938 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-11T00:06:43.938 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-11T00:06:43.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:06:43.938 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-11T00:06:43.938 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-11T00:06:43.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:06:43.939 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-11T00:06:43.939 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-09-11T00:06:43.939 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-11T00:06:43.939 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:06:43.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.938+0000 7fc107e00700 1 -- 172.21.15.111:0/3750763318 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc0ec06c7a0 msgr2=0x7fc0ec06ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:43.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.938+0000 7fc107e00700 1 --2- 172.21.15.111:0/3750763318 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc0ec06c7a0 0x7fc0ec06ec50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4006010 tx=0x7fc0f400b560 comp rx=0 tx=0).stop 2024-09-11T00:06:43.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.938+0000 7fc107e00700 1 -- 172.21.15.111:0/3750763318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc1080fff90 msgr2=0x7fc1081979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:43.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.938+0000 7fc107e00700 1 --2- 172.21.15.111:0/3750763318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc1080fff90 0x7fc1081979b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800d900 tx=0x7fc0f800dc10 comp rx=0 tx=0).stop 2024-09-11T00:06:43.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.939+0000 7fc107e00700 1 -- 172.21.15.111:0/3750763318 shutdown_connections 2024-09-11T00:06:43.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.939+0000 7fc107e00700 1 --2- 172.21.15.111:0/3750763318 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7fc0ec06c7a0 0x7fc0ec06ec50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:43.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.939+0000 7fc107e00700 1 --2- 172.21.15.111:0/3750763318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc1080fff90 0x7fc1081979b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:43.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.939+0000 7fc107e00700 1 --2- 172.21.15.111:0/3750763318 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc108101190 0x7fc108197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:43.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.939+0000 7fc107e00700 1 -- 172.21.15.111:0/3750763318 >> 172.21.15.111:0/3750763318 conn(0x7fc1080fb500 msgr2=0x7fc1081023b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:43.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.939+0000 7fc107e00700 1 -- 172.21.15.111:0/3750763318 shutdown_connections 2024-09-11T00:06:43.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:43.939+0000 7fc107e00700 1 -- 172.21.15.111:0/3750763318 wait complete. 2024-09-11T00:06:44.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.100+0000 7f0bf6e00700 1 -- 172.21.15.111:0/1103875870 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0bf0101190 msgr2=0x7f0bf01015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:44.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.100+0000 7f0bf6e00700 1 --2- 172.21.15.111:0/1103875870 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0bf0101190 0x7f0bf01015e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc009910 tx=0x7f0bdc009c20 comp rx=0 tx=0).stop 2024-09-11T00:06:44.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.100+0000 7f0bf6e00700 1 -- 172.21.15.111:0/1103875870 shutdown_connections 2024-09-11T00:06:44.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.100+0000 7f0bf6e00700 1 --2- 172.21.15.111:0/1103875870 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0bf0101190 0x7f0bf01015e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.100+0000 7f0bf6e00700 1 --2- 172.21.15.111:0/1103875870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0bf00fff90 0x7f0bf01003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.100+0000 7f0bf6e00700 1 -- 172.21.15.111:0/1103875870 >> 172.21.15.111:0/1103875870 conn(0x7f0bf00fb500 msgr2=0x7f0bf00fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:44.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.100+0000 7f0bf6e00700 1 -- 172.21.15.111:0/1103875870 shutdown_connections 2024-09-11T00:06:44.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.101+0000 7f0bf6e00700 1 -- 172.21.15.111:0/1103875870 wait complete. 2024-09-11T00:06:44.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.102+0000 7f0bf6e00700 1 Processor -- start 2024-09-11T00:06:44.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.102+0000 7f0bf6e00700 1 -- start start 2024-09-11T00:06:44.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.102+0000 7f0bf6e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0bf00fff90 0x7f0bf01957d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:44.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.102+0000 7f0bf6e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0bf0101190 0x7f0bf0195d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:44.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.102+0000 7f0bf6e00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf0196330 con 0x7f0bf00fff90 2024-09-11T00:06:44.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.102+0000 7f0bf6e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf0196470 con 0x7f0bf0101190 2024-09-11T00:06:44.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.102+0000 7f0bf5a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0bf00fff90 0x7f0bf01957d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:44.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.102+0000 7f0bf5a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0bf00fff90 0x7f0bf01957d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44848/0 (socket says 172.21.15.111:44848) 2024-09-11T00:06:44.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.102+0000 7f0bf5a00700 1 -- 172.21.15.111:0/1319037530 learned_addr learned my addr 172.21.15.111:0/1319037530 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:06:44.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.102+0000 7f0bf5000700 1 --2- 172.21.15.111:0/1319037530 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0bf0101190 0x7f0bf0195d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:44.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.103+0000 7f0bf5a00700 1 -- 172.21.15.111:0/1319037530 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0bf0101190 msgr2=0x7f0bf0195d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:44.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.103+0000 7f0bf5a00700 1 --2- 172.21.15.111:0/1319037530 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0bf0101190 0x7f0bf0195d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.103+0000 7f0bf5a00700 1 -- 172.21.15.111:0/1319037530 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bdc0095f0 con 0x7f0bf00fff90 2024-09-11T00:06:44.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.103+0000 7f0bf5a00700 1 --2- 172.21.15.111:0/1319037530 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0bf00fff90 0x7f0bf01957d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0be400d900 tx=0x7f0be400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:44.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.103+0000 7f0bee000700 1 -- 172.21.15.111:0/1319037530 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0be40041f0 con 0x7f0bf00fff90 2024-09-11T00:06:44.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.104+0000 7f0bee000700 1 -- 172.21.15.111:0/1319037530 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0be4004350 con 0x7f0bf00fff90 2024-09-11T00:06:44.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.104+0000 7f0bf6e00700 1 -- 172.21.15.111:0/1319037530 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf019af20 con 0x7f0bf00fff90 2024-09-11T00:06:44.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.104+0000 7f0bee000700 1 -- 172.21.15.111:0/1319037530 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0be4003d20 con 0x7f0bf00fff90 2024-09-11T00:06:44.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.104+0000 7f0bf6e00700 1 -- 172.21.15.111:0/1319037530 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf019b3e0 con 0x7f0bf00fff90 2024-09-11T00:06:44.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.105+0000 7f0bf6e00700 1 -- 172.21.15.111:0/1319037530 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf0108ae0 con 0x7f0bf00fff90 2024-09-11T00:06:44.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.106+0000 7f0bee000700 1 -- 172.21.15.111:0/1319037530 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f0be4009730 con 0x7f0bf00fff90 2024-09-11T00:06:44.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.107+0000 7f0bee000700 1 --2- 172.21.15.111:0/1319037530 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f0bd806c680 0x7f0bd806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:06:44.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.107+0000 7f0bee000700 1 -- 172.21.15.111:0/1319037530 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f0be408b6f0 con 0x7f0bf00fff90 2024-09-11T00:06:44.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.108+0000 7f0bf5000700 1 --2- 172.21.15.111:0/1319037530 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f0bd806c680 0x7f0bd806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:06:44.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.108+0000 7f0bf5000700 1 --2- 172.21.15.111:0/1319037530 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f0bd806c680 0x7f0bd806eb30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc006010 tx=0x7f0bdc00b560 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:06:44.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.113+0000 7f0bee000700 1 -- 172.21.15.111:0/1319037530 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0be4059890 con 0x7f0bf00fff90 2024-09-11T00:06:44.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.367+0000 7f0bf6e00700 1 -- 172.21.15.111:0/1319037530 --> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0bf0105ae0 con 0x7f0bd806c680 2024-09-11T00:06:44.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.369+0000 7f0bee000700 1 -- 172.21.15.111:0/1319037530 <== mgr.14211 v2:172.21.15.111:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f0bf0105ae0 con 0x7f0bd806c680 2024-09-11T00:06:44.371 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:06:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e", 2024-09-11T00:06:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-11T00:06:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-11T00:06:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [], 2024-09-11T00:06:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "", 2024-09-11T00:06:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading mgr daemons", 2024-09-11T00:06:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-11T00:06:44.371 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:06:44.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.371+0000 7f0bf6e00700 1 -- 172.21.15.111:0/1319037530 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f0bd806c680 msgr2=0x7f0bd806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:44.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.371+0000 7f0bf6e00700 1 --2- 172.21.15.111:0/1319037530 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f0bd806c680 0x7f0bd806eb30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc006010 tx=0x7f0bdc00b560 comp rx=0 tx=0).stop 2024-09-11T00:06:44.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.371+0000 7f0bf6e00700 1 -- 172.21.15.111:0/1319037530 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0bf00fff90 msgr2=0x7f0bf01957d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:06:44.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.371+0000 7f0bf6e00700 1 --2- 172.21.15.111:0/1319037530 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0bf00fff90 0x7f0bf01957d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0be400d900 tx=0x7f0be400dc10 comp rx=0 tx=0).stop 2024-09-11T00:06:44.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.372+0000 7f0bf6e00700 1 -- 172.21.15.111:0/1319037530 shutdown_connections 2024-09-11T00:06:44.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.372+0000 7f0bf6e00700 1 --2- 172.21.15.111:0/1319037530 >> [v2:172.21.15.111:6800/2,v1:172.21.15.111:6801/2] conn(0x7f0bd806c680 0x7f0bd806eb30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.372+0000 7f0bf6e00700 1 --2- 172.21.15.111:0/1319037530 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0bf00fff90 0x7f0bf01957d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.372+0000 7f0bf6e00700 1 --2- 172.21.15.111:0/1319037530 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0bf0101190 0x7f0bf0195d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:06:44.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.372+0000 7f0bf6e00700 1 -- 172.21.15.111:0/1319037530 >> 172.21.15.111:0/1319037530 conn(0x7f0bf00fb500 msgr2=0x7f0bf01043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:06:44.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.372+0000 7f0bf6e00700 1 -- 172.21.15.111:0/1319037530 shutdown_connections 2024-09-11T00:06:44.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:06:44.372+0000 7f0bf6e00700 1 -- 172.21.15.111:0/1319037530 wait complete. 2024-09-11T00:06:45.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:44 smithi203 ceph-mon[33225]: from='client.24477 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:06:45.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:44 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/3750763318' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:06:45.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:44 smithi111 ceph-mon[27539]: from='client.24477 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:06:45.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:44 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/3750763318' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:06:45.988 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:45 smithi203 ceph-mon[33225]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:06:45.988 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:45 smithi203 ceph-mon[33225]: pgmap v312: 65 pgs: 65 active+clean; 174 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.1 MiB/s wr, 264 op/s 2024-09-11T00:06:45.989 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:45 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:06:46.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:45 smithi111 ceph-mon[27539]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:06:46.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:45 smithi111 ceph-mon[27539]: pgmap v312: 65 pgs: 65 active+clean; 174 MiB data, 733 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.1 MiB/s wr, 264 op/s 2024-09-11T00:06:46.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:45 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:06:48.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:47 smithi203 ceph-mon[33225]: pgmap v313: 65 pgs: 65 active+clean; 181 MiB data, 756 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.2 MiB/s wr, 279 op/s 2024-09-11T00:06:48.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:47 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:06:48.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:47 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:06:48.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:47 smithi111 ceph-mon[27539]: pgmap v313: 65 pgs: 65 active+clean; 181 MiB data, 756 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.2 MiB/s wr, 279 op/s 2024-09-11T00:06:48.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:47 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:06:48.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:47 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:06:49.730 INFO:tasks.workunit.client.1.smithi203.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-11T00:06:49.742 INFO:tasks.workunit.client.1.smithi203.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-11T00:06:49.743 INFO:tasks.workunit.client.1.smithi203.stderr:+ make 2024-09-11T00:06:49.965 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:49 smithi203 ceph-mon[33225]: pgmap v314: 65 pgs: 65 active+clean; 187 MiB data, 776 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.2 MiB/s wr, 300 op/s 2024-09-11T00:06:49.965 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:49 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:06:49.966 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:49 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:06:50.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:49 smithi111 ceph-mon[27539]: pgmap v314: 65 pgs: 65 active+clean; 187 MiB data, 776 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.2 MiB/s wr, 300 op/s 2024-09-11T00:06:50.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:49 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:06:50.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:49 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:06:50.483 INFO:tasks.workunit.client.1.smithi203.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-11T00:06:51.644 INFO:tasks.workunit.client.1.smithi203.stderr:++ readlink -f fsstress 2024-09-11T00:06:51.648 INFO:tasks.workunit.client.1.smithi203.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-11T00:06:51.648 INFO:tasks.workunit.client.1.smithi203.stderr:+ popd 2024-09-11T00:06:51.653 INFO:tasks.workunit.client.1.smithi203.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-11T00:06:51.653 INFO:tasks.workunit.client.1.smithi203.stderr:+ popd 2024-09-11T00:06:51.653 INFO:tasks.workunit.client.1.smithi203.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-11T00:06:51.653 INFO:tasks.workunit.client.1.smithi203.stderr:++ mktemp -d -p . 2024-09-11T00:06:51.657 INFO:tasks.workunit.client.1.smithi203.stderr:+ T=./tmp.5V646qK7jw 2024-09-11T00:06:51.657 INFO:tasks.workunit.client.1.smithi203.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.5V646qK7jw -l 1 -n 1000 -p 10 -v 2024-09-11T00:06:51.664 INFO:tasks.workunit.client.1.smithi203.stdout:seed = 1726676161 2024-09-11T00:06:51.671 INFO:tasks.workunit.client.1.smithi203.stdout:0/0: fdatasync - no filename 2024-09-11T00:06:51.672 INFO:tasks.workunit.client.1.smithi203.stdout:0/1: dwrite - no filename 2024-09-11T00:06:51.672 INFO:tasks.workunit.client.1.smithi203.stdout:0/2: write - no filename 2024-09-11T00:06:51.672 INFO:tasks.workunit.client.1.smithi203.stdout:0/3: dwrite - no filename 2024-09-11T00:06:51.673 INFO:tasks.workunit.client.1.smithi203.stdout:0/4: mkdir d0 0 2024-09-11T00:06:51.674 INFO:tasks.workunit.client.1.smithi203.stdout:0/5: dread - no filename 2024-09-11T00:06:51.676 INFO:tasks.workunit.client.1.smithi203.stdout:1/0: mkdir d0 0 2024-09-11T00:06:51.676 INFO:tasks.workunit.client.1.smithi203.stdout:1/1: dread - no filename 2024-09-11T00:06:51.677 INFO:tasks.workunit.client.1.smithi203.stdout:0/6: creat d0/f1 x:0 0 0 2024-09-11T00:06:51.677 INFO:tasks.workunit.client.1.smithi203.stdout:1/2: stat d0 0 2024-09-11T00:06:51.677 INFO:tasks.workunit.client.1.smithi203.stdout:1/3: unlink - no file 2024-09-11T00:06:51.679 INFO:tasks.workunit.client.1.smithi203.stdout:3/0: dwrite - no filename 2024-09-11T00:06:51.680 INFO:tasks.workunit.client.1.smithi203.stdout:2/0: creat f0 x:0 0 0 2024-09-11T00:06:51.683 INFO:tasks.workunit.client.1.smithi203.stdout:4/0: write - no filename 2024-09-11T00:06:51.683 INFO:tasks.workunit.client.1.smithi203.stdout:1/4: getdents d0 0 2024-09-11T00:06:51.683 INFO:tasks.workunit.client.1.smithi203.stdout:1/5: readlink - no filename 2024-09-11T00:06:51.683 INFO:tasks.workunit.client.1.smithi203.stdout:4/1: chown . 219 1 2024-09-11T00:06:51.683 INFO:tasks.workunit.client.1.smithi203.stdout:4/2: write - no filename 2024-09-11T00:06:51.684 INFO:tasks.workunit.client.1.smithi203.stdout:4/3: chown . 53 1 2024-09-11T00:06:51.684 INFO:tasks.workunit.client.1.smithi203.stdout:4/4: dwrite - no filename 2024-09-11T00:06:51.684 INFO:tasks.workunit.client.1.smithi203.stdout:1/6: chown d0 21404930 1 2024-09-11T00:06:51.685 INFO:tasks.workunit.client.1.smithi203.stdout:3/1: symlink l0 0 2024-09-11T00:06:51.686 INFO:tasks.workunit.client.1.smithi203.stdout:5/0: fdatasync - no filename 2024-09-11T00:06:51.686 INFO:tasks.workunit.client.1.smithi203.stdout:5/1: write - no filename 2024-09-11T00:06:51.686 INFO:tasks.workunit.client.1.smithi203.stdout:5/2: write - no filename 2024-09-11T00:06:51.686 INFO:tasks.workunit.client.1.smithi203.stdout:5/3: write - no filename 2024-09-11T00:06:51.686 INFO:tasks.workunit.client.1.smithi203.stdout:5/4: stat - no entries 2024-09-11T00:06:51.686 INFO:tasks.workunit.client.1.smithi203.stdout:5/5: unlink - no file 2024-09-11T00:06:51.686 INFO:tasks.workunit.client.1.smithi203.stdout:5/6: dread - no filename 2024-09-11T00:06:51.686 INFO:tasks.workunit.client.1.smithi203.stdout:5/7: stat - no entries 2024-09-11T00:06:51.686 INFO:tasks.workunit.client.1.smithi203.stdout:5/8: rmdir - no directory 2024-09-11T00:06:51.691 INFO:tasks.workunit.client.1.smithi203.stdout:3/2: rename l0 to l1 0 2024-09-11T00:06:51.692 INFO:tasks.workunit.client.1.smithi203.stdout:4/5: creat f0 x:0 0 0 2024-09-11T00:06:51.694 INFO:tasks.workunit.client.1.smithi203.stdout:5/9: creat f0 x:0 0 0 2024-09-11T00:06:51.695 INFO:tasks.workunit.client.1.smithi203.stdout:5/10: dread - f0 zero size 2024-09-11T00:06:51.696 INFO:tasks.workunit.client.1.smithi203.stdout:5/11: fdatasync f0 0 2024-09-11T00:06:51.697 INFO:tasks.workunit.client.1.smithi203.stdout:5/12: truncate f0 394036 0 2024-09-11T00:06:51.697 INFO:tasks.workunit.client.1.smithi203.stdout:1/7: rmdir d0 0 2024-09-11T00:06:51.698 INFO:tasks.workunit.client.1.smithi203.stdout:1/8: chown . 0 1 2024-09-11T00:06:51.698 INFO:tasks.workunit.client.1.smithi203.stdout:1/9: readlink - no filename 2024-09-11T00:06:51.698 INFO:tasks.workunit.client.1.smithi203.stdout:1/10: dwrite - no filename 2024-09-11T00:06:51.698 INFO:tasks.workunit.client.1.smithi203.stdout:1/11: write - no filename 2024-09-11T00:06:51.701 INFO:tasks.workunit.client.1.smithi203.stdout:4/6: rename f0 to f1 0 2024-09-11T00:06:51.704 INFO:tasks.workunit.client.1.smithi203.stdout:8/0: dread - no filename 2024-09-11T00:06:51.704 INFO:tasks.workunit.client.1.smithi203.stdout:8/1: write - no filename 2024-09-11T00:06:51.704 INFO:tasks.workunit.client.1.smithi203.stdout:8/2: dread - no filename 2024-09-11T00:06:51.705 INFO:tasks.workunit.client.1.smithi203.stdout:8/3: write - no filename 2024-09-11T00:06:51.705 INFO:tasks.workunit.client.1.smithi203.stdout:8/4: write - no filename 2024-09-11T00:06:51.705 INFO:tasks.workunit.client.1.smithi203.stdout:6/0: mkdir d0 0 2024-09-11T00:06:51.707 INFO:tasks.workunit.client.1.smithi203.stdout:5/13: rename f0 to f1 0 2024-09-11T00:06:51.708 INFO:tasks.workunit.client.1.smithi203.stdout:1/12: mknod c1 0 2024-09-11T00:06:51.708 INFO:tasks.workunit.client.1.smithi203.stdout:1/13: readlink - no filename 2024-09-11T00:06:51.708 INFO:tasks.workunit.client.1.smithi203.stdout:1/14: write - no filename 2024-09-11T00:06:51.708 INFO:tasks.workunit.client.1.smithi203.stdout:1/15: rmdir - no directory 2024-09-11T00:06:51.712 INFO:tasks.workunit.client.1.smithi203.stdout:7/0: mknod c0 0 2024-09-11T00:06:51.712 INFO:tasks.workunit.client.1.smithi203.stdout:7/1: fdatasync - no filename 2024-09-11T00:06:51.715 INFO:tasks.workunit.client.1.smithi203.stdout:9/0: dwrite - no filename 2024-09-11T00:06:51.717 INFO:tasks.workunit.client.1.smithi203.stdout:5/14: symlink l2 0 2024-09-11T00:06:51.719 INFO:tasks.workunit.client.1.smithi203.stdout:1/16: unlink c1 0 2024-09-11T00:06:51.719 INFO:tasks.workunit.client.1.smithi203.stdout:1/17: rmdir - no directory 2024-09-11T00:06:51.719 INFO:tasks.workunit.client.1.smithi203.stdout:1/18: fdatasync - no filename 2024-09-11T00:06:51.720 INFO:tasks.workunit.client.1.smithi203.stdout:8/5: getdents . 0 2024-09-11T00:06:51.723 INFO:tasks.workunit.client.1.smithi203.stdout:6/1: getdents d0 0 2024-09-11T00:06:51.723 INFO:tasks.workunit.client.1.smithi203.stdout:6/2: read - no filename 2024-09-11T00:06:51.723 INFO:tasks.workunit.client.1.smithi203.stdout:6/3: fsync - no filename 2024-09-11T00:06:51.723 INFO:tasks.workunit.client.1.smithi203.stdout:6/4: unlink - no file 2024-09-11T00:06:51.724 INFO:tasks.workunit.client.1.smithi203.stdout:6/5: dread - no filename 2024-09-11T00:06:51.724 INFO:tasks.workunit.client.1.smithi203.stdout:6/6: dread - no filename 2024-09-11T00:06:51.724 INFO:tasks.workunit.client.1.smithi203.stdout:6/7: read - no filename 2024-09-11T00:06:51.726 INFO:tasks.workunit.client.1.smithi203.stdout:6/8: chown d0 3 1 2024-09-11T00:06:51.726 INFO:tasks.workunit.client.1.smithi203.stdout:6/9: unlink - no file 2024-09-11T00:06:51.726 INFO:tasks.workunit.client.1.smithi203.stdout:6/10: truncate - no filename 2024-09-11T00:06:51.728 INFO:tasks.workunit.client.1.smithi203.stdout:1/19: creat f2 x:0 0 0 2024-09-11T00:06:51.731 INFO:tasks.workunit.client.1.smithi203.stdout:9/1: mknod c0 0 2024-09-11T00:06:51.731 INFO:tasks.workunit.client.1.smithi203.stdout:1/20: read - f2 zero size 2024-09-11T00:06:51.734 INFO:tasks.workunit.client.1.smithi203.stdout:7/2: link c0 c1 0 2024-09-11T00:06:51.734 INFO:tasks.workunit.client.1.smithi203.stdout:7/3: dread - no filename 2024-09-11T00:06:51.734 INFO:tasks.workunit.client.1.smithi203.stdout:7/4: fsync - no filename 2024-09-11T00:06:51.735 INFO:tasks.workunit.client.1.smithi203.stdout:9/2: chown c0 2 1 2024-09-11T00:06:51.735 INFO:tasks.workunit.client.1.smithi203.stdout:8/6: getdents . 0 2024-09-11T00:06:51.735 INFO:tasks.workunit.client.1.smithi203.stdout:8/7: rename - no filename 2024-09-11T00:06:51.738 INFO:tasks.workunit.client.1.smithi203.stdout:4/7: dwrite f1 [0,4194304] 0 2024-09-11T00:06:51.738 INFO:tasks.workunit.client.1.smithi203.stdout:6/11: creat d0/f1 x:0 0 0 2024-09-11T00:06:51.740 INFO:tasks.workunit.client.1.smithi203.stdout:9/3: mknod c1 0 2024-09-11T00:06:51.740 INFO:tasks.workunit.client.1.smithi203.stdout:9/4: dread - no filename 2024-09-11T00:06:51.740 INFO:tasks.workunit.client.1.smithi203.stdout:9/5: write - no filename 2024-09-11T00:06:51.748 INFO:tasks.workunit.client.1.smithi203.stdout:7/5: rename c1 to c2 0 2024-09-11T00:06:51.748 INFO:tasks.workunit.client.1.smithi203.stdout:7/6: dwrite - no filename 2024-09-11T00:06:51.748 INFO:tasks.workunit.client.1.smithi203.stdout:7/7: fsync - no filename 2024-09-11T00:06:51.749 INFO:tasks.workunit.client.1.smithi203.stdout:7/8: dread - no filename 2024-09-11T00:06:51.749 INFO:tasks.workunit.client.1.smithi203.stdout:7/9: write - no filename 2024-09-11T00:06:51.749 INFO:tasks.workunit.client.1.smithi203.stdout:7/10: read - no filename 2024-09-11T00:06:51.759 INFO:tasks.workunit.client.1.smithi203.stdout:8/8: mknod c0 0 2024-09-11T00:06:51.768 INFO:tasks.workunit.client.1.smithi203.stdout:8/9: mkdir d1 0 2024-09-11T00:06:51.770 INFO:tasks.workunit.client.1.smithi203.stdout:7/11: rename c0 to c3 0 2024-09-11T00:06:51.772 INFO:tasks.workunit.client.1.smithi203.stdout:5/15: dwrite f1 [0,4194304] 0 2024-09-11T00:06:51.775 INFO:tasks.workunit.client.1.smithi203.stdout:9/6: link c0 c2 0 2024-09-11T00:06:51.776 INFO:tasks.workunit.client.1.smithi203.stdout:5/16: stat l2 0 2024-09-11T00:06:51.777 INFO:tasks.workunit.client.1.smithi203.stdout:1/21: dwrite f2 [0,4194304] 0 2024-09-11T00:06:51.783 INFO:tasks.workunit.client.1.smithi203.stdout:7/12: mknod c4 0 2024-09-11T00:06:51.785 INFO:tasks.workunit.client.1.smithi203.stdout:9/7: unlink c1 0 2024-09-11T00:06:51.789 INFO:tasks.workunit.client.1.smithi203.stdout:6/12: dwrite d0/f1 [0,4194304] 0 2024-09-11T00:06:51.796 INFO:tasks.workunit.client.1.smithi203.stdout:1/22: creat f3 x:0 0 0 2024-09-11T00:06:51.796 INFO:tasks.workunit.client.1.smithi203.stdout:9/8: mkdir d3 0 2024-09-11T00:06:51.796 INFO:tasks.workunit.client.1.smithi203.stdout:9/9: write - no filename 2024-09-11T00:06:51.796 INFO:tasks.workunit.client.1.smithi203.stdout:8/10: creat d1/f2 x:0 0 0 2024-09-11T00:06:51.814 INFO:tasks.workunit.client.1.smithi203.stdout:8/11: unlink c0 0 2024-09-11T00:06:51.817 INFO:tasks.workunit.client.1.smithi203.stdout:1/23: dread f2 [0,4194304] 0 2024-09-11T00:06:51.818 INFO:tasks.workunit.client.1.smithi203.stdout:8/12: dread - d1/f2 zero size 2024-09-11T00:06:51.821 INFO:tasks.workunit.client.1.smithi203.stdout:8/13: write d1/f2 [721333,54865] 0 2024-09-11T00:06:51.821 INFO:tasks.workunit.client.1.smithi203.stdout:8/14: readlink - no filename 2024-09-11T00:06:51.823 INFO:tasks.workunit.client.1.smithi203.stdout:8/15: chown d1/f2 15125008 1 2024-09-11T00:06:51.826 INFO:tasks.workunit.client.1.smithi203.stdout:1/24: creat f4 x:0 0 0 2024-09-11T00:06:51.827 INFO:tasks.workunit.client.1.smithi203.stdout:1/25: chown f4 170187399 1 2024-09-11T00:06:51.827 INFO:tasks.workunit.client.1.smithi203.stdout:1/26: rmdir - no directory 2024-09-11T00:06:51.828 INFO:tasks.workunit.client.1.smithi203.stdout:9/10: rmdir d3 0 2024-09-11T00:06:51.839 INFO:tasks.workunit.client.1.smithi203.stdout:9/11: link c2 c4 0 2024-09-11T00:06:51.843 INFO:tasks.workunit.client.1.smithi203.stdout:9/12: creat f5 x:0 0 0 2024-09-11T00:06:51.846 INFO:tasks.workunit.client.1.smithi203.stdout:9/13: chown c4 9 1 2024-09-11T00:06:51.847 INFO:tasks.workunit.client.1.smithi203.stdout:9/14: truncate f5 58271 0 2024-09-11T00:06:51.849 INFO:tasks.workunit.client.1.smithi203.stdout:9/15: mkdir d6 0 2024-09-11T00:06:51.851 INFO:tasks.workunit.client.1.smithi203.stdout:9/16: write f5 [811398,124925] 0 2024-09-11T00:06:51.851 INFO:tasks.workunit.client.1.smithi203.stdout:9/17: chown d6 35 1 2024-09-11T00:06:51.853 INFO:tasks.workunit.client.1.smithi203.stdout:9/18: write f5 [1750946,90151] 0 2024-09-11T00:06:51.857 INFO:tasks.workunit.client.1.smithi203.stdout:9/19: chown f5 9 1 2024-09-11T00:06:51.865 INFO:tasks.workunit.client.1.smithi203.stdout:9/20: rename c0 to d6/c7 0 2024-09-11T00:06:51.947 INFO:tasks.workunit.client.1.smithi203.stdout:0/7: fsync d0/f1 0 2024-09-11T00:06:51.949 INFO:tasks.workunit.client.1.smithi203.stdout:2/1: fsync f0 0 2024-09-11T00:06:51.954 INFO:tasks.workunit.client.1.smithi203.stdout:0/8: mkdir d0/d2 0 2024-09-11T00:06:51.956 INFO:tasks.workunit.client.1.smithi203.stdout:0/9: dread - d0/f1 zero size 2024-09-11T00:06:51.964 INFO:tasks.workunit.client.1.smithi203.stdout:3/3: chown l1 256 1 2024-09-11T00:06:51.964 INFO:tasks.workunit.client.1.smithi203.stdout:3/4: dwrite - no filename 2024-09-11T00:06:51.964 INFO:tasks.workunit.client.1.smithi203.stdout:3/5: write - no filename 2024-09-11T00:06:51.967 INFO:tasks.workunit.client.1.smithi203.stdout:0/10: creat d0/d2/f3 x:0 0 0 2024-09-11T00:06:51.967 INFO:tasks.workunit.client.1.smithi203.stdout:4/8: fsync f1 0 2024-09-11T00:06:51.969 INFO:tasks.workunit.client.1.smithi203.stdout:4/9: chown f1 0 1 2024-09-11T00:06:51.973 INFO:tasks.workunit.client.1.smithi203.stdout:3/6: rename l1 to l2 0 2024-09-11T00:06:51.975 INFO:tasks.workunit.client.1.smithi203.stdout:0/11: unlink d0/f1 0 2024-09-11T00:06:51.986 INFO:tasks.workunit.client.1.smithi203.stdout:0/12: mknod d0/c4 0 2024-09-11T00:06:51.994 INFO:tasks.workunit.client.1.smithi203.stdout:6/13: fsync d0/f1 0 2024-09-11T00:06:51.996 INFO:tasks.workunit.client.1.smithi203.stdout:6/14: fsync d0/f1 0 2024-09-11T00:06:51.999 INFO:tasks.workunit.client.1.smithi203.stdout:4/10: dwrite f1 [0,4194304] 0 2024-09-11T00:06:52.010 INFO:tasks.workunit.client.1.smithi203.stdout:6/15: mknod d0/c2 0 2024-09-11T00:06:52.010 INFO:tasks.workunit.client.1.smithi203.stdout:4/11: dread f1 [0,4194304] 0 2024-09-11T00:06:52.011 INFO:tasks.workunit.client.1.smithi203.stdout:6/16: rename d0 to d0/d3 22 2024-09-11T00:06:52.013 INFO:tasks.workunit.client.1.smithi203.stdout:6/17: write d0/f1 [3599760,32029] 0 2024-09-11T00:06:52.014 INFO:tasks.workunit.client.1.smithi203.stdout:7/13: rename c2 to c5 0 2024-09-11T00:06:52.014 INFO:tasks.workunit.client.1.smithi203.stdout:7/14: rmdir - no directory 2024-09-11T00:06:52.014 INFO:tasks.workunit.client.1.smithi203.stdout:7/15: write - no filename 2024-09-11T00:06:52.017 INFO:tasks.workunit.client.1.smithi203.stdout:6/18: write d0/f1 [4689781,37256] 0 2024-09-11T00:06:52.024 INFO:tasks.workunit.client.1.smithi203.stdout:8/16: fsync d1/f2 0 2024-09-11T00:06:52.026 INFO:tasks.workunit.client.1.smithi203.stdout:8/17: write d1/f2 [832385,60978] 0 2024-09-11T00:06:52.028 INFO:tasks.workunit.client.1.smithi203.stdout:5/17: truncate f1 2052109 0 2024-09-11T00:06:52.032 INFO:tasks.workunit.client.1.smithi203.stdout:7/16: chown c3 2257 1 2024-09-11T00:06:52.032 INFO:tasks.workunit.client.1.smithi203.stdout:7/17: dread - no filename 2024-09-11T00:06:52.032 INFO:tasks.workunit.client.1.smithi203.stdout:7/18: fdatasync - no filename 2024-09-11T00:06:52.033 INFO:tasks.workunit.client.1.smithi203.stdout:7/19: write - no filename 2024-09-11T00:06:52.037 INFO:tasks.workunit.client.1.smithi203.stdout:8/18: dread d1/f2 [0,4194304] 0 2024-09-11T00:06:52.037 INFO:tasks.workunit.client.1.smithi203.stdout:1/27: getdents . 0 2024-09-11T00:06:52.037 INFO:tasks.workunit.client.1.smithi203.stdout:1/28: chown f3 352042535 1 2024-09-11T00:06:52.042 INFO:tasks.workunit.client.1.smithi203.stdout:7/20: creat f6 x:0 0 0 2024-09-11T00:06:52.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:51 smithi203 ceph-mon[33225]: pgmap v315: 65 pgs: 65 active+clean; 199 MiB data, 797 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.7 MiB/s wr, 288 op/s 2024-09-11T00:06:52.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:51 smithi203 ceph-mon[33225]: Standby manager daemon smithi203.smuspl restarted 2024-09-11T00:06:52.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:51 smithi203 ceph-mon[33225]: Standby manager daemon smithi203.smuspl started 2024-09-11T00:06:52.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:51 smithi203 ceph-mon[33225]: from='mgr.? 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.smuspl/crt"}]: dispatch 2024-09-11T00:06:52.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:51 smithi203 ceph-mon[33225]: from='mgr.? 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T00:06:52.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:51 smithi203 ceph-mon[33225]: from='mgr.? 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.smuspl/key"}]: dispatch 2024-09-11T00:06:52.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:51 smithi203 ceph-mon[33225]: from='mgr.? 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T00:06:52.045 INFO:tasks.workunit.client.1.smithi203.stdout:8/19: creat d1/f3 x:0 0 0 2024-09-11T00:06:52.046 INFO:tasks.workunit.client.1.smithi203.stdout:8/20: rename d1 to d1/d4 22 2024-09-11T00:06:52.046 INFO:tasks.workunit.client.1.smithi203.stdout:8/21: readlink - no filename 2024-09-11T00:06:52.047 INFO:tasks.workunit.client.1.smithi203.stdout:4/12: getdents . 0 2024-09-11T00:06:52.051 INFO:tasks.workunit.client.1.smithi203.stdout:1/29: rename f3 to f5 0 2024-09-11T00:06:52.053 INFO:tasks.workunit.client.1.smithi203.stdout:7/21: creat f7 x:0 0 0 2024-09-11T00:06:52.054 INFO:tasks.workunit.client.1.smithi203.stdout:7/22: stat f7 0 2024-09-11T00:06:52.055 INFO:tasks.workunit.client.1.smithi203.stdout:8/22: mknod d1/c5 0 2024-09-11T00:06:52.061 INFO:tasks.workunit.client.1.smithi203.stdout:7/23: mknod c8 0 2024-09-11T00:06:52.061 INFO:tasks.workunit.client.1.smithi203.stdout:1/30: dread f2 [0,4194304] 0 2024-09-11T00:06:52.062 INFO:tasks.workunit.client.1.smithi203.stdout:7/24: write f7 [600256,8853] 0 2024-09-11T00:06:52.062 INFO:tasks.workunit.client.1.smithi203.stdout:1/31: fdatasync f4 0 2024-09-11T00:06:52.062 INFO:tasks.workunit.client.1.smithi203.stdout:8/23: creat d1/f6 x:0 0 0 2024-09-11T00:06:52.064 INFO:tasks.workunit.client.1.smithi203.stdout:8/24: dread - d1/f3 zero size 2024-09-11T00:06:52.065 INFO:tasks.workunit.client.1.smithi203.stdout:8/25: dread - d1/f3 zero size 2024-09-11T00:06:52.065 INFO:tasks.workunit.client.1.smithi203.stdout:8/26: readlink - no filename 2024-09-11T00:06:52.066 INFO:tasks.workunit.client.1.smithi203.stdout:4/13: link f1 f2 0 2024-09-11T00:06:52.066 INFO:tasks.workunit.client.1.smithi203.stdout:4/14: readlink - no filename 2024-09-11T00:06:52.068 INFO:tasks.workunit.client.1.smithi203.stdout:9/21: rename d6/c7 to d6/c8 0 2024-09-11T00:06:52.069 INFO:tasks.workunit.client.1.smithi203.stdout:9/22: write f5 [1070701,49801] 0 2024-09-11T00:06:52.071 INFO:tasks.workunit.client.1.smithi203.stdout:9/23: fsync f5 0 2024-09-11T00:06:52.086 INFO:tasks.workunit.client.1.smithi203.stdout:7/25: link c3 c9 0 2024-09-11T00:06:52.086 INFO:tasks.workunit.client.1.smithi203.stdout:7/26: rmdir - no directory 2024-09-11T00:06:52.091 INFO:tasks.workunit.client.1.smithi203.stdout:8/27: dwrite d1/f2 [0,4194304] 0 2024-09-11T00:06:52.093 INFO:tasks.workunit.client.1.smithi203.stdout:9/24: link c4 d6/c9 0 2024-09-11T00:06:52.099 INFO:tasks.workunit.client.1.smithi203.stdout:9/25: creat d6/fa x:0 0 0 2024-09-11T00:06:52.102 INFO:tasks.workunit.client.1.smithi203.stdout:9/26: mknod d6/cb 0 2024-09-11T00:06:52.107 INFO:tasks.workunit.client.1.smithi203.stdout:9/27: symlink d6/lc 0 2024-09-11T00:06:52.107 INFO:tasks.workunit.client.1.smithi203.stdout:7/27: dwrite f7 [0,4194304] 0 2024-09-11T00:06:52.110 INFO:tasks.workunit.client.1.smithi203.stdout:9/28: mknod d6/cd 0 2024-09-11T00:06:52.113 INFO:tasks.workunit.client.1.smithi203.stdout:9/29: write d6/fa [305198,90201] 0 2024-09-11T00:06:52.116 INFO:tasks.workunit.client.1.smithi203.stdout:9/30: write d6/fa [1200668,73755] 0 2024-09-11T00:06:52.126 INFO:tasks.workunit.client.1.smithi203.stdout:9/31: chown d6/c9 12968 1 2024-09-11T00:06:52.128 INFO:tasks.workunit.client.1.smithi203.stdout:9/32: write d6/fa [1961749,76483] 0 2024-09-11T00:06:52.142 INFO:tasks.workunit.client.1.smithi203.stdout:3/7: getdents . 0 2024-09-11T00:06:52.142 INFO:tasks.workunit.client.1.smithi203.stdout:3/8: write - no filename 2024-09-11T00:06:52.144 INFO:tasks.workunit.client.1.smithi203.stdout:3/9: symlink l3 0 2024-09-11T00:06:52.147 INFO:tasks.workunit.client.1.smithi203.stdout:3/10: mknod c4 0 2024-09-11T00:06:52.147 INFO:tasks.workunit.client.1.smithi203.stdout:3/11: chown l3 0 1 2024-09-11T00:06:52.150 INFO:tasks.workunit.client.1.smithi203.stdout:3/12: symlink l5 0 2024-09-11T00:06:52.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:51 smithi111 ceph-mon[27539]: pgmap v315: 65 pgs: 65 active+clean; 199 MiB data, 797 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.7 MiB/s wr, 288 op/s 2024-09-11T00:06:52.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:51 smithi111 ceph-mon[27539]: Standby manager daemon smithi203.smuspl restarted 2024-09-11T00:06:52.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:51 smithi111 ceph-mon[27539]: Standby manager daemon smithi203.smuspl started 2024-09-11T00:06:52.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:51 smithi111 ceph-mon[27539]: from='mgr.? 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.smuspl/crt"}]: dispatch 2024-09-11T00:06:52.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:51 smithi111 ceph-mon[27539]: from='mgr.? 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T00:06:52.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:51 smithi111 ceph-mon[27539]: from='mgr.? 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.smuspl/key"}]: dispatch 2024-09-11T00:06:52.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:51 smithi111 ceph-mon[27539]: from='mgr.? 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T00:06:52.155 INFO:tasks.workunit.client.1.smithi203.stdout:3/13: rename l2 to l6 0 2024-09-11T00:06:52.155 INFO:tasks.workunit.client.1.smithi203.stdout:3/14: stat l5 0 2024-09-11T00:06:52.157 INFO:tasks.workunit.client.1.smithi203.stdout:6/19: rmdir d0 39 2024-09-11T00:06:52.162 INFO:tasks.workunit.client.1.smithi203.stdout:3/15: link c4 c7 0 2024-09-11T00:06:52.165 INFO:tasks.workunit.client.1.smithi203.stdout:3/16: mkdir d8 0 2024-09-11T00:06:52.169 INFO:tasks.workunit.client.1.smithi203.stdout:3/17: unlink l5 0 2024-09-11T00:06:52.175 INFO:tasks.workunit.client.1.smithi203.stdout:3/18: mkdir d8/d9 0 2024-09-11T00:06:52.175 INFO:tasks.workunit.client.1.smithi203.stdout:3/19: fdatasync - no filename 2024-09-11T00:06:52.176 INFO:tasks.workunit.client.1.smithi203.stdout:1/32: getdents . 0 2024-09-11T00:06:52.178 INFO:tasks.workunit.client.1.smithi203.stdout:6/20: dwrite d0/f1 [0,4194304] 0 2024-09-11T00:06:52.179 INFO:tasks.workunit.client.1.smithi203.stdout:7/28: fsync f7 0 2024-09-11T00:06:52.181 INFO:tasks.workunit.client.1.smithi203.stdout:1/33: creat f6 x:0 0 0 2024-09-11T00:06:52.182 INFO:tasks.workunit.client.1.smithi203.stdout:7/29: chown c8 2922 1 2024-09-11T00:06:52.182 INFO:tasks.workunit.client.1.smithi203.stdout:5/18: dwrite f1 [0,4194304] 0 2024-09-11T00:06:52.185 INFO:tasks.workunit.client.1.smithi203.stdout:5/19: read f1 [1662495,33509] 0 2024-09-11T00:06:52.189 INFO:tasks.workunit.client.1.smithi203.stdout:3/20: rename d8/d9 to d8/da 0 2024-09-11T00:06:52.189 INFO:tasks.workunit.client.1.smithi203.stdout:6/21: creat d0/f4 x:0 0 0 2024-09-11T00:06:52.197 INFO:tasks.workunit.client.1.smithi203.stdout:1/34: rename f2 to f7 0 2024-09-11T00:06:52.198 INFO:tasks.workunit.client.1.smithi203.stdout:5/20: rename l2 to l3 0 2024-09-11T00:06:52.202 INFO:tasks.workunit.client.1.smithi203.stdout:3/21: creat d8/fb x:0 0 0 2024-09-11T00:06:52.203 INFO:tasks.workunit.client.1.smithi203.stdout:7/30: rename c3 to ca 0 2024-09-11T00:06:52.203 INFO:tasks.workunit.client.1.smithi203.stdout:7/31: stat f6 0 2024-09-11T00:06:52.204 INFO:tasks.workunit.client.1.smithi203.stdout:3/22: chown d8/da 712384742 1 2024-09-11T00:06:52.205 INFO:tasks.workunit.client.1.smithi203.stdout:1/35: mkdir d8 0 2024-09-11T00:06:52.206 INFO:tasks.workunit.client.1.smithi203.stdout:1/36: dread - f6 zero size 2024-09-11T00:06:52.216 INFO:tasks.workunit.client.1.smithi203.stdout:1/37: mkdir d8/d9 0 2024-09-11T00:06:52.218 INFO:tasks.workunit.client.1.smithi203.stdout:7/32: link c5 cb 0 2024-09-11T00:06:52.222 INFO:tasks.workunit.client.1.smithi203.stdout:7/33: chown f7 27873 1 2024-09-11T00:06:52.224 INFO:tasks.workunit.client.1.smithi203.stdout:7/34: fsync f7 0 2024-09-11T00:06:52.226 INFO:tasks.workunit.client.1.smithi203.stdout:7/35: dread - f6 zero size 2024-09-11T00:06:52.230 INFO:tasks.workunit.client.1.smithi203.stdout:7/36: creat fc x:0 0 0 2024-09-11T00:06:52.231 INFO:tasks.workunit.client.1.smithi203.stdout:3/23: dwrite d8/fb [0,4194304] 0 2024-09-11T00:06:52.236 INFO:tasks.workunit.client.1.smithi203.stdout:5/21: dwrite f1 [0,4194304] 0 2024-09-11T00:06:52.236 INFO:tasks.workunit.client.1.smithi203.stdout:3/24: chown d8 46580 1 2024-09-11T00:06:52.238 INFO:tasks.workunit.client.1.smithi203.stdout:9/33: truncate d6/fa 911282 0 2024-09-11T00:06:52.238 INFO:tasks.workunit.client.1.smithi203.stdout:5/22: chown f1 260155 1 2024-09-11T00:06:52.266 INFO:tasks.workunit.client.1.smithi203.stdout:6/22: getdents d0 0 2024-09-11T00:06:52.266 INFO:tasks.workunit.client.1.smithi203.stdout:7/37: dwrite fc [0,4194304] 0 2024-09-11T00:06:52.269 INFO:tasks.workunit.client.1.smithi203.stdout:7/38: write fc [927911,26754] 0 2024-09-11T00:06:52.269 INFO:tasks.workunit.client.1.smithi203.stdout:1/38: rename f7 to d8/d9/fa 0 2024-09-11T00:06:52.270 INFO:tasks.workunit.client.1.smithi203.stdout:3/25: dread d8/fb [0,4194304] 0 2024-09-11T00:06:52.271 INFO:tasks.workunit.client.1.smithi203.stdout:5/23: dread f1 [0,4194304] 0 2024-09-11T00:06:52.272 INFO:tasks.workunit.client.1.smithi203.stdout:1/39: write f4 [942574,70187] 0 2024-09-11T00:06:52.272 INFO:tasks.workunit.client.1.smithi203.stdout:7/39: write f7 [4260941,15340] 0 2024-09-11T00:06:52.275 INFO:tasks.workunit.client.1.smithi203.stdout:5/24: chown f1 14 1 2024-09-11T00:06:52.277 INFO:tasks.workunit.client.1.smithi203.stdout:6/23: dread d0/f1 [4194304,4194304] 0 2024-09-11T00:06:52.290 INFO:tasks.workunit.client.1.smithi203.stdout:3/26: dread d8/fb [0,4194304] 0 2024-09-11T00:06:52.294 INFO:tasks.workunit.client.1.smithi203.stdout:6/24: dread d0/f1 [0,4194304] 0 2024-09-11T00:06:52.295 INFO:tasks.workunit.client.1.smithi203.stdout:6/25: fdatasync d0/f4 0 2024-09-11T00:06:52.296 INFO:tasks.workunit.client.1.smithi203.stdout:5/25: dwrite f1 [0,4194304] 0 2024-09-11T00:06:52.319 INFO:tasks.workunit.client.1.smithi203.stdout:6/26: dwrite d0/f1 [4194304,4194304] 0 2024-09-11T00:06:52.398 INFO:tasks.workunit.client.1.smithi203.stdout:9/34: mkdir d6/de 0 2024-09-11T00:06:52.398 INFO:tasks.workunit.client.1.smithi203.stdout:9/35: chown d6 4964274 1 2024-09-11T00:06:52.401 INFO:tasks.workunit.client.1.smithi203.stdout:7/40: mkdir dd 0 2024-09-11T00:06:52.405 INFO:tasks.workunit.client.1.smithi203.stdout:3/27: mknod d8/da/cc 0 2024-09-11T00:06:52.407 INFO:tasks.workunit.client.1.smithi203.stdout:6/27: creat d0/f5 x:0 0 0 2024-09-11T00:06:52.407 INFO:tasks.workunit.client.1.smithi203.stdout:5/26: creat f4 x:0 0 0 2024-09-11T00:06:52.413 INFO:tasks.workunit.client.1.smithi203.stdout:6/28: mkdir d0/d6 0 2024-09-11T00:06:52.415 INFO:tasks.workunit.client.1.smithi203.stdout:5/27: creat f5 x:0 0 0 2024-09-11T00:06:52.417 INFO:tasks.workunit.client.1.smithi203.stdout:9/36: mkdir d6/de/df 0 2024-09-11T00:06:52.418 INFO:tasks.workunit.client.1.smithi203.stdout:7/41: getdents dd 0 2024-09-11T00:06:52.420 INFO:tasks.workunit.client.1.smithi203.stdout:6/29: mknod d0/c7 0 2024-09-11T00:06:52.422 INFO:tasks.workunit.client.1.smithi203.stdout:5/28: chown l3 201 1 2024-09-11T00:06:52.424 INFO:tasks.workunit.client.1.smithi203.stdout:5/29: chown l3 3904 1 2024-09-11T00:06:52.426 INFO:tasks.workunit.client.1.smithi203.stdout:9/37: creat d6/de/f10 x:0 0 0 2024-09-11T00:06:52.426 INFO:tasks.workunit.client.1.smithi203.stdout:5/30: dread - f5 zero size 2024-09-11T00:06:52.426 INFO:tasks.workunit.client.1.smithi203.stdout:1/40: dwrite f5 [0,4194304] 0 2024-09-11T00:06:52.428 INFO:tasks.workunit.client.1.smithi203.stdout:9/38: dread - d6/de/f10 zero size 2024-09-11T00:06:52.432 INFO:tasks.workunit.client.1.smithi203.stdout:7/42: rename ca to dd/ce 0 2024-09-11T00:06:52.432 INFO:tasks.workunit.client.1.smithi203.stdout:1/41: mkdir d8/d9/db 0 2024-09-11T00:06:52.442 INFO:tasks.workunit.client.1.smithi203.stdout:9/39: rename c4 to d6/de/c11 0 2024-09-11T00:06:52.451 INFO:tasks.workunit.client.1.smithi203.stdout:1/42: rename f6 to d8/d9/db/fc 0 2024-09-11T00:06:52.455 INFO:tasks.workunit.client.1.smithi203.stdout:5/31: dwrite f4 [0,4194304] 0 2024-09-11T00:06:52.458 INFO:tasks.workunit.client.1.smithi203.stdout:1/43: creat d8/d9/fd x:0 0 0 2024-09-11T00:06:52.458 INFO:tasks.workunit.client.1.smithi203.stdout:7/43: dwrite fc [0,4194304] 0 2024-09-11T00:06:52.460 INFO:tasks.workunit.client.1.smithi203.stdout:7/44: dread - f6 zero size 2024-09-11T00:06:52.462 INFO:tasks.workunit.client.1.smithi203.stdout:7/45: truncate fc 4596199 0 2024-09-11T00:06:52.469 INFO:tasks.workunit.client.1.smithi203.stdout:7/46: creat dd/ff x:0 0 0 2024-09-11T00:06:52.477 INFO:tasks.workunit.client.1.smithi203.stdout:1/44: dread d8/d9/fa [0,4194304] 0 2024-09-11T00:06:52.477 INFO:tasks.workunit.client.1.smithi203.stdout:5/32: dread f4 [0,4194304] 0 2024-09-11T00:06:52.477 INFO:tasks.workunit.client.1.smithi203.stdout:7/47: link fc dd/f10 0 2024-09-11T00:06:52.481 INFO:tasks.workunit.client.1.smithi203.stdout:5/33: symlink l6 0 2024-09-11T00:06:52.483 INFO:tasks.workunit.client.1.smithi203.stdout:1/45: mkdir d8/d9/de 0 2024-09-11T00:06:52.487 INFO:tasks.workunit.client.1.smithi203.stdout:1/46: write d8/d9/fa [3657953,113117] 0 2024-09-11T00:06:52.491 INFO:tasks.workunit.client.1.smithi203.stdout:1/47: symlink d8/d9/lf 0 2024-09-11T00:06:52.499 INFO:tasks.workunit.client.1.smithi203.stdout:5/34: dwrite f4 [0,4194304] 0 2024-09-11T00:06:52.518 INFO:tasks.workunit.client.1.smithi203.stdout:5/35: fdatasync f4 0 2024-09-11T00:06:52.523 INFO:tasks.workunit.client.1.smithi203.stdout:5/36: link l3 l7 0 2024-09-11T00:06:52.524 INFO:tasks.workunit.client.1.smithi203.stdout:5/37: write f4 [76800,37089] 0 2024-09-11T00:06:52.527 INFO:tasks.workunit.client.1.smithi203.stdout:5/38: creat f8 x:0 0 0 2024-09-11T00:06:52.527 INFO:tasks.workunit.client.1.smithi203.stdout:5/39: stat f4 0 2024-09-11T00:06:52.531 INFO:tasks.workunit.client.1.smithi203.stdout:5/40: chown l7 6 1 2024-09-11T00:06:52.535 INFO:tasks.workunit.client.1.smithi203.stdout:5/41: rename l7 to l9 0 2024-09-11T00:06:52.537 INFO:tasks.workunit.client.1.smithi203.stdout:5/42: rename f1 to fa 0 2024-09-11T00:06:52.557 INFO:tasks.workunit.client.1.smithi203.stdout:3/28: rmdir d8 39 2024-09-11T00:06:52.569 INFO:tasks.workunit.client.1.smithi203.stdout:3/29: dread d8/fb [0,4194304] 0 2024-09-11T00:06:52.570 INFO:tasks.workunit.client.1.smithi203.stdout:3/30: fdatasync d8/fb 0 2024-09-11T00:06:52.572 INFO:tasks.workunit.client.1.smithi203.stdout:3/31: mknod d8/cd 0 2024-09-11T00:06:52.577 INFO:tasks.workunit.client.1.smithi203.stdout:7/48: rmdir dd 39 2024-09-11T00:06:52.590 INFO:tasks.workunit.client.1.smithi203.stdout:5/43: chown l9 487554003 1 2024-09-11T00:06:52.592 INFO:tasks.workunit.client.1.smithi203.stdout:7/49: dread fc [0,4194304] 0 2024-09-11T00:06:52.595 INFO:tasks.workunit.client.1.smithi203.stdout:3/32: getdents d8 0 2024-09-11T00:06:52.597 INFO:tasks.workunit.client.1.smithi203.stdout:7/50: creat dd/f11 x:0 0 0 2024-09-11T00:06:52.598 INFO:tasks.workunit.client.1.smithi203.stdout:3/33: symlink d8/le 0 2024-09-11T00:06:52.599 INFO:tasks.workunit.client.1.smithi203.stdout:7/51: fsync dd/f10 0 2024-09-11T00:06:52.603 INFO:tasks.workunit.client.1.smithi203.stdout:7/52: write dd/ff [803803,17594] 0 2024-09-11T00:06:52.607 INFO:tasks.workunit.client.1.smithi203.stdout:7/53: creat dd/f12 x:0 0 0 2024-09-11T00:06:52.610 INFO:tasks.workunit.client.1.smithi203.stdout:7/54: truncate dd/f11 272005 0 2024-09-11T00:06:52.611 INFO:tasks.workunit.client.1.smithi203.stdout:5/44: dwrite f5 [0,4194304] 0 2024-09-11T00:06:52.612 INFO:tasks.workunit.client.1.smithi203.stdout:5/45: chown l9 58 1 2024-09-11T00:06:52.614 INFO:tasks.workunit.client.1.smithi203.stdout:3/34: dread d8/fb [0,4194304] 0 2024-09-11T00:06:52.622 INFO:tasks.workunit.client.1.smithi203.stdout:7/55: rename f6 to dd/f13 0 2024-09-11T00:06:52.625 INFO:tasks.workunit.client.1.smithi203.stdout:7/56: chown dd/f10 17159 1 2024-09-11T00:06:52.629 INFO:tasks.workunit.client.1.smithi203.stdout:7/57: creat dd/f14 x:0 0 0 2024-09-11T00:06:52.632 INFO:tasks.workunit.client.1.smithi203.stdout:7/58: dread - dd/f12 zero size 2024-09-11T00:06:52.639 INFO:tasks.workunit.client.1.smithi203.stdout:7/59: dread dd/f11 [0,4194304] 0 2024-09-11T00:06:52.639 INFO:tasks.workunit.client.1.smithi203.stdout:5/46: dwrite f8 [0,4194304] 0 2024-09-11T00:06:52.643 INFO:tasks.workunit.client.1.smithi203.stdout:3/35: dwrite d8/fb [0,4194304] 0 2024-09-11T00:06:52.646 INFO:tasks.workunit.client.1.smithi203.stdout:7/60: rmdir dd 39 2024-09-11T00:06:52.654 INFO:tasks.workunit.client.1.smithi203.stdout:3/36: creat d8/ff x:0 0 0 2024-09-11T00:06:52.656 INFO:tasks.workunit.client.1.smithi203.stdout:3/37: chown d8/le 1 1 2024-09-11T00:06:52.656 INFO:tasks.workunit.client.1.smithi203.stdout:5/47: link l3 lb 0 2024-09-11T00:06:52.659 INFO:tasks.workunit.client.1.smithi203.stdout:5/48: mkdir dc 0 2024-09-11T00:06:52.660 INFO:tasks.workunit.client.1.smithi203.stdout:3/38: mknod d8/da/c10 0 2024-09-11T00:06:52.663 INFO:tasks.workunit.client.1.smithi203.stdout:3/39: mkdir d8/da/d11 0 2024-09-11T00:06:52.669 INFO:tasks.workunit.client.1.smithi203.stdout:3/40: rename d8/da/c10 to d8/c12 0 2024-09-11T00:06:52.673 INFO:tasks.workunit.client.1.smithi203.stdout:5/49: truncate f5 1656431 0 2024-09-11T00:06:52.676 INFO:tasks.workunit.client.1.smithi203.stdout:7/61: dwrite dd/f14 [0,4194304] 0 2024-09-11T00:06:52.683 INFO:tasks.workunit.client.1.smithi203.stdout:7/62: symlink dd/l15 0 2024-09-11T00:06:52.687 INFO:tasks.workunit.client.1.smithi203.stdout:3/41: truncate d8/fb 3446419 0 2024-09-11T00:06:52.690 INFO:tasks.workunit.client.1.smithi203.stdout:7/63: creat dd/f16 x:0 0 0 2024-09-11T00:06:52.692 INFO:tasks.workunit.client.1.smithi203.stdout:7/64: symlink dd/l17 0 2024-09-11T00:06:52.695 INFO:tasks.workunit.client.1.smithi203.stdout:5/50: dread f5 [0,4194304] 0 2024-09-11T00:06:52.696 INFO:tasks.workunit.client.1.smithi203.stdout:7/65: creat dd/f18 x:0 0 0 2024-09-11T00:06:52.699 INFO:tasks.workunit.client.1.smithi203.stdout:5/51: mkdir dc/dd 0 2024-09-11T00:06:52.701 INFO:tasks.workunit.client.1.smithi203.stdout:5/52: fsync f8 0 2024-09-11T00:06:52.704 INFO:tasks.workunit.client.1.smithi203.stdout:7/66: fsync dd/f16 0 2024-09-11T00:06:52.704 INFO:tasks.workunit.client.1.smithi203.stdout:5/53: truncate f5 2134141 0 2024-09-11T00:06:52.705 INFO:tasks.workunit.client.1.smithi203.stdout:7/67: fsync dd/f16 0 2024-09-11T00:06:52.708 INFO:tasks.workunit.client.1.smithi203.stdout:3/42: dwrite d8/ff [0,4194304] 0 2024-09-11T00:06:52.711 INFO:tasks.workunit.client.1.smithi203.stdout:3/43: write d8/ff [433543,130496] 0 2024-09-11T00:06:52.712 INFO:tasks.workunit.client.1.smithi203.stdout:5/54: symlink dc/dd/le 0 2024-09-11T00:06:52.717 INFO:tasks.workunit.client.1.smithi203.stdout:3/44: rename d8/cd to d8/c13 0 2024-09-11T00:06:52.720 INFO:tasks.workunit.client.1.smithi203.stdout:7/68: link c8 dd/c19 0 2024-09-11T00:06:52.721 INFO:tasks.workunit.client.1.smithi203.stdout:7/69: fdatasync dd/f14 0 2024-09-11T00:06:52.722 INFO:tasks.workunit.client.1.smithi203.stdout:7/70: dread - dd/f16 zero size 2024-09-11T00:06:52.722 INFO:tasks.workunit.client.1.smithi203.stdout:5/55: getdents dc 0 2024-09-11T00:06:52.725 INFO:tasks.workunit.client.1.smithi203.stdout:7/71: creat dd/f1a x:0 0 0 2024-09-11T00:06:52.726 INFO:tasks.workunit.client.1.smithi203.stdout:3/45: fdatasync d8/ff 0 2024-09-11T00:06:52.726 INFO:tasks.workunit.client.1.smithi203.stdout:5/56: mkdir dc/dd/df 0 2024-09-11T00:06:52.727 INFO:tasks.workunit.client.1.smithi203.stdout:7/72: readlink dd/l15 0 2024-09-11T00:06:52.729 INFO:tasks.workunit.client.1.smithi203.stdout:5/57: unlink f4 0 2024-09-11T00:06:52.730 INFO:tasks.workunit.client.1.smithi203.stdout:5/58: readlink l6 0 2024-09-11T00:06:52.731 INFO:tasks.workunit.client.1.smithi203.stdout:3/46: read d8/fb [883394,78309] 0 2024-09-11T00:06:52.736 INFO:tasks.workunit.client.1.smithi203.stdout:3/47: mknod d8/c14 0 2024-09-11T00:06:52.738 INFO:tasks.workunit.client.1.smithi203.stdout:7/73: rmdir dd 39 2024-09-11T00:06:52.740 INFO:tasks.workunit.client.1.smithi203.stdout:5/59: truncate f8 605536 0 2024-09-11T00:06:52.741 INFO:tasks.workunit.client.1.smithi203.stdout:3/48: truncate d8/fb 1520993 0 2024-09-11T00:06:52.745 INFO:tasks.workunit.client.1.smithi203.stdout:3/49: symlink d8/l15 0 2024-09-11T00:06:52.746 INFO:tasks.workunit.client.1.smithi203.stdout:7/74: mknod dd/c1b 0 2024-09-11T00:06:52.748 INFO:tasks.workunit.client.1.smithi203.stdout:3/50: creat d8/f16 x:0 0 0 2024-09-11T00:06:52.749 INFO:tasks.workunit.client.1.smithi203.stdout:5/60: rmdir dc/dd/df 0 2024-09-11T00:06:52.750 INFO:tasks.workunit.client.1.smithi203.stdout:7/75: mkdir dd/d1c 0 2024-09-11T00:06:52.751 INFO:tasks.workunit.client.1.smithi203.stdout:3/51: mkdir d8/d17 0 2024-09-11T00:06:52.752 INFO:tasks.workunit.client.1.smithi203.stdout:3/52: stat d8/l15 0 2024-09-11T00:06:52.753 INFO:tasks.workunit.client.1.smithi203.stdout:7/76: mknod dd/c1d 0 2024-09-11T00:06:52.754 INFO:tasks.workunit.client.1.smithi203.stdout:5/61: mkdir dc/d10 0 2024-09-11T00:06:52.754 INFO:tasks.workunit.client.1.smithi203.stdout:3/53: write d8/ff [4682059,20171] 0 2024-09-11T00:06:52.757 INFO:tasks.workunit.client.1.smithi203.stdout:7/77: creat dd/f1e x:0 0 0 2024-09-11T00:06:52.758 INFO:tasks.workunit.client.1.smithi203.stdout:5/62: unlink l3 0 2024-09-11T00:06:52.760 INFO:tasks.workunit.client.1.smithi203.stdout:3/54: creat d8/da/f18 x:0 0 0 2024-09-11T00:06:52.762 INFO:tasks.workunit.client.1.smithi203.stdout:7/78: rename dd/f16 to dd/d1c/f1f 0 2024-09-11T00:06:52.765 INFO:tasks.workunit.client.1.smithi203.stdout:5/63: fsync f8 0 2024-09-11T00:06:52.768 INFO:tasks.workunit.client.1.smithi203.stdout:5/64: dread f8 [0,4194304] 0 2024-09-11T00:06:52.788 INFO:tasks.workunit.client.1.smithi203.stdout:5/65: write f8 [1226668,107952] 0 2024-09-11T00:06:52.790 INFO:tasks.workunit.client.1.smithi203.stdout:3/55: write d8/fb [1892932,8519] 0 2024-09-11T00:06:52.799 INFO:tasks.workunit.client.1.smithi203.stdout:5/66: dread f5 [0,4194304] 0 2024-09-11T00:06:52.801 INFO:tasks.workunit.client.1.smithi203.stdout:7/79: dwrite dd/f11 [0,4194304] 0 2024-09-11T00:06:52.808 INFO:tasks.workunit.client.1.smithi203.stdout:7/80: creat dd/d1c/f20 x:0 0 0 2024-09-11T00:06:52.808 INFO:tasks.workunit.client.1.smithi203.stdout:7/81: dread - dd/d1c/f20 zero size 2024-09-11T00:06:52.814 INFO:tasks.workunit.client.1.smithi203.stdout:7/82: creat dd/d1c/f21 x:0 0 0 2024-09-11T00:06:52.815 INFO:tasks.workunit.client.1.smithi203.stdout:7/83: write dd/d1c/f20 [171976,98604] 0 2024-09-11T00:06:52.819 INFO:tasks.workunit.client.1.smithi203.stdout:5/67: dwrite fa [0,4194304] 0 2024-09-11T00:06:52.833 INFO:tasks.workunit.client.1.smithi203.stdout:5/68: dread f5 [0,4194304] 0 2024-09-11T00:06:52.837 INFO:tasks.workunit.client.1.smithi203.stdout:5/69: rename dc to dc/dd/d11 22 2024-09-11T00:06:52.838 INFO:tasks.workunit.client.1.smithi203.stdout:7/84: dwrite dd/f11 [0,4194304] 0 2024-09-11T00:06:52.840 INFO:tasks.workunit.client.1.smithi203.stdout:7/85: truncate dd/f18 386290 0 2024-09-11T00:06:52.842 INFO:tasks.workunit.client.1.smithi203.stdout:5/70: creat dc/f12 x:0 0 0 2024-09-11T00:06:52.844 INFO:tasks.workunit.client.1.smithi203.stdout:5/71: fsync f8 0 2024-09-11T00:06:52.845 INFO:tasks.workunit.client.1.smithi203.stdout:7/86: link dd/f1e dd/f22 0 2024-09-11T00:06:52.848 INFO:tasks.workunit.client.1.smithi203.stdout:7/87: creat dd/d1c/f23 x:0 0 0 2024-09-11T00:06:52.852 INFO:tasks.workunit.client.1.smithi203.stdout:5/72: dread f5 [0,4194304] 0 2024-09-11T00:06:52.853 INFO:tasks.workunit.client.1.smithi203.stdout:7/88: symlink dd/d1c/l24 0 2024-09-11T00:06:52.853 INFO:tasks.workunit.client.1.smithi203.stdout:5/73: chown fa 0 1 2024-09-11T00:06:52.860 INFO:tasks.workunit.client.1.smithi203.stdout:5/74: rmdir dc/d10 0 2024-09-11T00:06:52.861 INFO:tasks.workunit.client.1.smithi203.stdout:5/75: chown fa 2 1 2024-09-11T00:06:52.873 INFO:tasks.workunit.client.1.smithi203.stdout:7/89: getdents dd 0 2024-09-11T00:06:52.881 INFO:tasks.workunit.client.1.smithi203.stdout:7/90: write dd/d1c/f1f [716015,41989] 0 2024-09-11T00:06:52.881 INFO:tasks.workunit.client.1.smithi203.stdout:5/76: dwrite f5 [0,4194304] 0 2024-09-11T00:06:52.881 INFO:tasks.workunit.client.1.smithi203.stdout:5/77: stat f5 0 2024-09-11T00:06:52.882 INFO:tasks.workunit.client.1.smithi203.stdout:5/78: truncate f8 1801636 0 2024-09-11T00:06:52.887 INFO:tasks.workunit.client.1.smithi203.stdout:5/79: mkdir dc/dd/d13 0 2024-09-11T00:06:52.888 INFO:tasks.workunit.client.1.smithi203.stdout:5/80: chown dc/dd/d13 58546335 1 2024-09-11T00:06:52.889 INFO:tasks.workunit.client.1.smithi203.stdout:7/91: rename dd/ce to dd/d1c/c25 0 2024-09-11T00:06:52.890 INFO:tasks.workunit.client.1.smithi203.stdout:7/92: chown dd/f1a 59573802 1 2024-09-11T00:06:52.907 INFO:tasks.workunit.client.1.smithi203.stdout:7/93: dwrite f7 [4194304,4194304] 0 2024-09-11T00:06:52.908 INFO:tasks.workunit.client.1.smithi203.stdout:5/81: dwrite fa [0,4194304] 0 2024-09-11T00:06:52.921 INFO:tasks.workunit.client.1.smithi203.stdout:5/82: creat dc/dd/d13/f14 x:0 0 0 2024-09-11T00:06:52.937 INFO:tasks.workunit.client.1.smithi203.stdout:5/83: dwrite f8 [0,4194304] 0 2024-09-11T00:06:52.941 INFO:tasks.workunit.client.1.smithi203.stdout:5/84: readlink lb 0 2024-09-11T00:06:52.944 INFO:tasks.workunit.client.1.smithi203.stdout:5/85: chown l9 12 1 2024-09-11T00:06:52.960 INFO:tasks.workunit.client.1.smithi203.stdout:5/86: dwrite f5 [0,4194304] 0 2024-09-11T00:06:52.967 INFO:tasks.workunit.client.1.smithi203.stdout:5/87: mkdir dc/dd/d15 0 2024-09-11T00:06:52.995 INFO:tasks.workunit.client.1.smithi203.stdout:7/94: write dd/f10 [2598786,60038] 0 2024-09-11T00:06:52.999 INFO:tasks.workunit.client.1.smithi203.stdout:7/95: mkdir dd/d1c/d26 0 2024-09-11T00:06:53.006 INFO:tasks.workunit.client.1.smithi203.stdout:7/96: rename c9 to dd/d1c/c27 0 2024-09-11T00:06:53.011 INFO:tasks.workunit.client.1.smithi203.stdout:7/97: symlink dd/d1c/d26/l28 0 2024-09-11T00:06:53.026 INFO:tasks.workunit.client.1.smithi203.stdout:7/98: dwrite dd/f18 [0,4194304] 0 2024-09-11T00:06:53.031 INFO:tasks.workunit.client.1.smithi203.stdout:7/99: rmdir dd 39 2024-09-11T00:06:53.037 INFO:tasks.workunit.client.1.smithi203.stdout:7/100: creat dd/d1c/f29 x:0 0 0 2024-09-11T00:06:53.038 INFO:tasks.workunit.client.1.smithi203.stdout:7/101: dread - dd/d1c/f23 zero size 2024-09-11T00:06:53.041 INFO:tasks.workunit.client.1.smithi203.stdout:7/102: creat dd/f2a x:0 0 0 2024-09-11T00:06:53.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:52 smithi203 ceph-mon[33225]: mgrmap e20: smithi111.ypucji(active, since 9m), standbys: smithi203.smuspl 2024-09-11T00:06:53.060 INFO:tasks.workunit.client.1.smithi203.stdout:7/103: getdents dd/d1c/d26 0 2024-09-11T00:06:53.061 INFO:tasks.workunit.client.1.smithi203.stdout:7/104: chown dd/f11 303411 1 2024-09-11T00:06:53.063 INFO:tasks.workunit.client.1.smithi203.stdout:7/105: creat dd/d1c/f2b x:0 0 0 2024-09-11T00:06:53.068 INFO:tasks.workunit.client.1.smithi203.stdout:7/106: rename dd/d1c/f1f to dd/d1c/d26/f2c 0 2024-09-11T00:06:53.069 INFO:tasks.workunit.client.1.smithi203.stdout:7/107: read fc [1625361,85221] 0 2024-09-11T00:06:53.086 INFO:tasks.workunit.client.1.smithi203.stdout:7/108: dwrite dd/f18 [0,4194304] 0 2024-09-11T00:06:53.091 INFO:tasks.workunit.client.1.smithi203.stdout:7/109: rmdir dd/d1c 39 2024-09-11T00:06:53.092 INFO:tasks.workunit.client.1.smithi203.stdout:7/110: truncate dd/f12 627616 0 2024-09-11T00:06:53.098 INFO:tasks.workunit.client.1.smithi203.stdout:7/111: creat dd/d1c/f2d x:0 0 0 2024-09-11T00:06:53.101 INFO:tasks.workunit.client.1.smithi203.stdout:7/112: mknod dd/d1c/d26/c2e 0 2024-09-11T00:06:53.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:52 smithi111 ceph-mon[27539]: mgrmap e20: smithi111.ypucji(active, since 9m), standbys: smithi203.smuspl 2024-09-11T00:06:54.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:53 smithi203 ceph-mon[33225]: pgmap v316: 65 pgs: 65 active+clean; 213 MiB data, 831 MiB used, 536 GiB / 536 GiB avail; 104 KiB/s rd, 4.3 MiB/s wr, 260 op/s 2024-09-11T00:06:54.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:53 smithi111 ceph-mon[27539]: pgmap v316: 65 pgs: 65 active+clean; 213 MiB data, 831 MiB used, 536 GiB / 536 GiB avail; 104 KiB/s rd, 4.3 MiB/s wr, 260 op/s 2024-09-11T00:06:56.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:55 smithi203 ceph-mon[33225]: pgmap v317: 65 pgs: 65 active+clean; 237 MiB data, 882 MiB used, 536 GiB / 536 GiB avail; 104 KiB/s rd, 7.8 MiB/s wr, 276 op/s 2024-09-11T00:06:56.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:55 smithi111 ceph-mon[27539]: pgmap v317: 65 pgs: 65 active+clean; 237 MiB data, 882 MiB used, 536 GiB / 536 GiB avail; 104 KiB/s rd, 7.8 MiB/s wr, 276 op/s 2024-09-11T00:06:57.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:57 smithi111 ceph-mon[27539]: pgmap v318: 65 pgs: 65 active+clean; 272 MiB data, 1024 MiB used, 535 GiB / 536 GiB avail; 104 KiB/s rd, 12 MiB/s wr, 265 op/s 2024-09-11T00:06:58.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:57 smithi203 ceph-mon[33225]: pgmap v318: 65 pgs: 65 active+clean; 272 MiB data, 1024 MiB used, 535 GiB / 536 GiB avail; 104 KiB/s rd, 12 MiB/s wr, 265 op/s 2024-09-11T00:06:58.047 INFO:tasks.workunit.client.0.smithi111.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-11T00:06:58.055 INFO:tasks.workunit.client.0.smithi111.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-11T00:06:58.056 INFO:tasks.workunit.client.0.smithi111.stderr:+ make 2024-09-11T00:06:58.281 INFO:tasks.workunit.client.0.smithi111.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-11T00:06:58.839 INFO:tasks.workunit.client.0.smithi111.stderr:++ readlink -f fsstress 2024-09-11T00:06:58.842 INFO:tasks.workunit.client.0.smithi111.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-11T00:06:58.843 INFO:tasks.workunit.client.0.smithi111.stderr:+ popd 2024-09-11T00:06:58.845 INFO:tasks.workunit.client.0.smithi111.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-11T00:06:58.845 INFO:tasks.workunit.client.0.smithi111.stderr:+ popd 2024-09-11T00:06:58.846 INFO:tasks.workunit.client.0.smithi111.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-11T00:06:58.847 INFO:tasks.workunit.client.0.smithi111.stderr:++ mktemp -d -p . 2024-09-11T00:06:58.850 INFO:tasks.workunit.client.0.smithi111.stderr:+ T=./tmp.ohsekhRNzU 2024-09-11T00:06:58.850 INFO:tasks.workunit.client.0.smithi111.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.ohsekhRNzU -l 1 -n 1000 -p 10 -v 2024-09-11T00:06:58.856 INFO:tasks.workunit.client.0.smithi111.stdout:seed = 1726861504 2024-09-11T00:06:59.331 INFO:tasks.workunit.client.0.smithi111.stdout:1/0: dread - no filename 2024-09-11T00:06:59.331 INFO:tasks.workunit.client.0.smithi111.stdout:1/1: dwrite - no filename 2024-09-11T00:06:59.332 INFO:tasks.workunit.client.0.smithi111.stdout:1/2: truncate - no filename 2024-09-11T00:06:59.332 INFO:tasks.workunit.client.0.smithi111.stdout:1/3: truncate - no filename 2024-09-11T00:06:59.332 INFO:tasks.workunit.client.0.smithi111.stdout:0/0: creat f0 x:0 0 0 2024-09-11T00:06:59.332 INFO:tasks.workunit.client.0.smithi111.stdout:0/1: dread - f0 zero size 2024-09-11T00:06:59.333 INFO:tasks.workunit.client.0.smithi111.stdout:1/4: symlink l0 0 2024-09-11T00:06:59.334 INFO:tasks.workunit.client.0.smithi111.stdout:2/0: rename - no filename 2024-09-11T00:06:59.334 INFO:tasks.workunit.client.0.smithi111.stdout:2/1: dread - no filename 2024-09-11T00:06:59.334 INFO:tasks.workunit.client.0.smithi111.stdout:0/2: creat f1 x:0 0 0 2024-09-11T00:06:59.338 INFO:tasks.workunit.client.0.smithi111.stdout:2/2: getdents . 0 2024-09-11T00:06:59.339 INFO:tasks.workunit.client.0.smithi111.stdout:2/3: dwrite - no filename 2024-09-11T00:06:59.339 INFO:tasks.workunit.client.0.smithi111.stdout:2/4: chown . 14375 1 2024-09-11T00:06:59.339 INFO:tasks.workunit.client.0.smithi111.stdout:4/0: dwrite - no filename 2024-09-11T00:06:59.339 INFO:tasks.workunit.client.0.smithi111.stdout:2/5: chown . 93780503 1 2024-09-11T00:06:59.339 INFO:tasks.workunit.client.0.smithi111.stdout:2/6: truncate - no filename 2024-09-11T00:06:59.339 INFO:tasks.workunit.client.0.smithi111.stdout:2/7: dread - no filename 2024-09-11T00:06:59.339 INFO:tasks.workunit.client.0.smithi111.stdout:2/8: dread - no filename 2024-09-11T00:06:59.340 INFO:tasks.workunit.client.0.smithi111.stdout:3/0: symlink l0 0 2024-09-11T00:06:59.341 INFO:tasks.workunit.client.0.smithi111.stdout:5/0: dwrite - no filename 2024-09-11T00:06:59.341 INFO:tasks.workunit.client.0.smithi111.stdout:5/1: chown . 501961841 1 2024-09-11T00:06:59.342 INFO:tasks.workunit.client.0.smithi111.stdout:3/1: creat f1 x:0 0 0 2024-09-11T00:06:59.343 INFO:tasks.workunit.client.0.smithi111.stdout:4/1: symlink l0 0 2024-09-11T00:06:59.344 INFO:tasks.workunit.client.0.smithi111.stdout:2/9: mkdir d0 0 2024-09-11T00:06:59.347 INFO:tasks.workunit.client.0.smithi111.stdout:4/2: symlink l1 0 2024-09-11T00:06:59.347 INFO:tasks.workunit.client.0.smithi111.stdout:4/3: truncate - no filename 2024-09-11T00:06:59.348 INFO:tasks.workunit.client.0.smithi111.stdout:6/0: chown . 103066 1 2024-09-11T00:06:59.349 INFO:tasks.workunit.client.0.smithi111.stdout:6/1: rename - no filename 2024-09-11T00:06:59.349 INFO:tasks.workunit.client.0.smithi111.stdout:6/2: dwrite - no filename 2024-09-11T00:06:59.349 INFO:tasks.workunit.client.0.smithi111.stdout:6/3: rename - no filename 2024-09-11T00:06:59.349 INFO:tasks.workunit.client.0.smithi111.stdout:5/2: creat f0 x:0 0 0 2024-09-11T00:06:59.349 INFO:tasks.workunit.client.0.smithi111.stdout:6/4: chown . 50632 1 2024-09-11T00:06:59.349 INFO:tasks.workunit.client.0.smithi111.stdout:2/10: symlink d0/l1 0 2024-09-11T00:06:59.349 INFO:tasks.workunit.client.0.smithi111.stdout:2/11: dwrite - no filename 2024-09-11T00:06:59.350 INFO:tasks.workunit.client.0.smithi111.stdout:2/12: truncate - no filename 2024-09-11T00:06:59.350 INFO:tasks.workunit.client.0.smithi111.stdout:4/4: symlink l2 0 2024-09-11T00:06:59.350 INFO:tasks.workunit.client.0.smithi111.stdout:4/5: dwrite - no filename 2024-09-11T00:06:59.350 INFO:tasks.workunit.client.0.smithi111.stdout:6/5: chown . 191667049 1 2024-09-11T00:06:59.351 INFO:tasks.workunit.client.0.smithi111.stdout:6/6: chown . 689442 1 2024-09-11T00:06:59.351 INFO:tasks.workunit.client.0.smithi111.stdout:6/7: dread - no filename 2024-09-11T00:06:59.351 INFO:tasks.workunit.client.0.smithi111.stdout:6/8: write - no filename 2024-09-11T00:06:59.352 INFO:tasks.workunit.client.0.smithi111.stdout:6/9: dread - no filename 2024-09-11T00:06:59.352 INFO:tasks.workunit.client.0.smithi111.stdout:6/10: dwrite - no filename 2024-09-11T00:06:59.352 INFO:tasks.workunit.client.0.smithi111.stdout:6/11: unlink - no file 2024-09-11T00:06:59.352 INFO:tasks.workunit.client.0.smithi111.stdout:6/12: dwrite - no filename 2024-09-11T00:06:59.352 INFO:tasks.workunit.client.0.smithi111.stdout:6/13: write - no filename 2024-09-11T00:06:59.352 INFO:tasks.workunit.client.0.smithi111.stdout:7/0: write - no filename 2024-09-11T00:06:59.352 INFO:tasks.workunit.client.0.smithi111.stdout:7/1: dwrite - no filename 2024-09-11T00:06:59.352 INFO:tasks.workunit.client.0.smithi111.stdout:2/13: stat d0 0 2024-09-11T00:06:59.352 INFO:tasks.workunit.client.0.smithi111.stdout:5/3: write f0 [958616,120503] 0 2024-09-11T00:06:59.357 INFO:tasks.workunit.client.0.smithi111.stdout:2/14: chown d0/l1 969 1 2024-09-11T00:06:59.357 INFO:tasks.workunit.client.0.smithi111.stdout:2/15: write - no filename 2024-09-11T00:06:59.357 INFO:tasks.workunit.client.0.smithi111.stdout:8/0: chown . 20 1 2024-09-11T00:06:59.359 INFO:tasks.workunit.client.0.smithi111.stdout:6/14: creat f0 x:0 0 0 2024-09-11T00:06:59.360 INFO:tasks.workunit.client.0.smithi111.stdout:7/2: getdents . 0 2024-09-11T00:06:59.360 INFO:tasks.workunit.client.0.smithi111.stdout:7/3: dwrite - no filename 2024-09-11T00:06:59.361 INFO:tasks.workunit.client.0.smithi111.stdout:7/4: rename - no filename 2024-09-11T00:06:59.361 INFO:tasks.workunit.client.0.smithi111.stdout:7/5: link - no file 2024-09-11T00:06:59.361 INFO:tasks.workunit.client.0.smithi111.stdout:7/6: dwrite - no filename 2024-09-11T00:06:59.361 INFO:tasks.workunit.client.0.smithi111.stdout:7/7: write - no filename 2024-09-11T00:06:59.361 INFO:tasks.workunit.client.0.smithi111.stdout:5/4: creat f1 x:0 0 0 2024-09-11T00:06:59.362 INFO:tasks.workunit.client.0.smithi111.stdout:6/15: dread - f0 zero size 2024-09-11T00:06:59.362 INFO:tasks.workunit.client.0.smithi111.stdout:4/6: link l1 l3 0 2024-09-11T00:06:59.364 INFO:tasks.workunit.client.0.smithi111.stdout:2/16: rmdir d0 39 2024-09-11T00:06:59.364 INFO:tasks.workunit.client.0.smithi111.stdout:2/17: fsync - no filename 2024-09-11T00:06:59.364 INFO:tasks.workunit.client.0.smithi111.stdout:2/18: write - no filename 2024-09-11T00:06:59.367 INFO:tasks.workunit.client.0.smithi111.stdout:8/1: getdents . 0 2024-09-11T00:06:59.367 INFO:tasks.workunit.client.0.smithi111.stdout:8/2: dread - no filename 2024-09-11T00:06:59.368 INFO:tasks.workunit.client.0.smithi111.stdout:8/3: dread - no filename 2024-09-11T00:06:59.368 INFO:tasks.workunit.client.0.smithi111.stdout:0/3: dwrite f1 [0,4194304] 0 2024-09-11T00:06:59.368 INFO:tasks.workunit.client.0.smithi111.stdout:4/7: chown l2 59088637 1 2024-09-11T00:06:59.371 INFO:tasks.workunit.client.0.smithi111.stdout:7/8: creat f0 x:0 0 0 2024-09-11T00:06:59.373 INFO:tasks.workunit.client.0.smithi111.stdout:9/0: mknod c0 0 2024-09-11T00:06:59.376 INFO:tasks.workunit.client.0.smithi111.stdout:3/2: dwrite f1 [0,4194304] 0 2024-09-11T00:06:59.377 INFO:tasks.workunit.client.0.smithi111.stdout:7/9: chown f0 3 1 2024-09-11T00:06:59.377 INFO:tasks.workunit.client.0.smithi111.stdout:9/1: stat c0 0 2024-09-11T00:06:59.377 INFO:tasks.workunit.client.0.smithi111.stdout:9/2: dread - no filename 2024-09-11T00:06:59.381 INFO:tasks.workunit.client.0.smithi111.stdout:9/3: stat c0 0 2024-09-11T00:06:59.381 INFO:tasks.workunit.client.0.smithi111.stdout:9/4: dread - no filename 2024-09-11T00:06:59.381 INFO:tasks.workunit.client.0.smithi111.stdout:9/5: fdatasync - no filename 2024-09-11T00:06:59.382 INFO:tasks.workunit.client.0.smithi111.stdout:9/6: dwrite - no filename 2024-09-11T00:06:59.383 INFO:tasks.workunit.client.0.smithi111.stdout:3/3: truncate f1 5105031 0 2024-09-11T00:06:59.386 INFO:tasks.workunit.client.0.smithi111.stdout:8/4: creat f0 x:0 0 0 2024-09-11T00:06:59.386 INFO:tasks.workunit.client.1.smithi203.stdout:2/2: sync 2024-09-11T00:06:59.389 INFO:tasks.workunit.client.0.smithi111.stdout:9/7: chown c0 103 1 2024-09-11T00:06:59.392 INFO:tasks.workunit.client.0.smithi111.stdout:9/8: chown c0 3 1 2024-09-11T00:06:59.393 INFO:tasks.workunit.client.0.smithi111.stdout:8/5: write f0 [369017,91698] 0 2024-09-11T00:06:59.398 INFO:tasks.workunit.client.0.smithi111.stdout:7/10: rename f0 to f1 0 2024-09-11T00:06:59.401 INFO:tasks.workunit.client.0.smithi111.stdout:3/4: creat f2 x:0 0 0 2024-09-11T00:06:59.403 INFO:tasks.workunit.client.0.smithi111.stdout:5/5: dwrite f1 [0,4194304] 0 2024-09-11T00:06:59.405 INFO:tasks.workunit.client.0.smithi111.stdout:9/9: symlink l1 0 2024-09-11T00:06:59.406 INFO:tasks.workunit.client.0.smithi111.stdout:6/16: dwrite f0 [0,4194304] 0 2024-09-11T00:06:59.406 INFO:tasks.workunit.client.0.smithi111.stdout:7/11: truncate f1 800777 0 2024-09-11T00:06:59.406 INFO:tasks.workunit.client.0.smithi111.stdout:8/6: dread f0 [0,4194304] 0 2024-09-11T00:06:59.409 INFO:tasks.workunit.client.0.smithi111.stdout:3/5: creat f3 x:0 0 0 2024-09-11T00:06:59.410 INFO:tasks.workunit.client.0.smithi111.stdout:3/6: stat f2 0 2024-09-11T00:06:59.410 INFO:tasks.workunit.client.0.smithi111.stdout:9/10: mknod c2 0 2024-09-11T00:06:59.411 INFO:tasks.workunit.client.0.smithi111.stdout:9/11: dwrite - no filename 2024-09-11T00:06:59.411 INFO:tasks.workunit.client.0.smithi111.stdout:9/12: rmdir - no directory 2024-09-11T00:06:59.411 INFO:tasks.workunit.client.0.smithi111.stdout:9/13: truncate - no filename 2024-09-11T00:06:59.411 INFO:tasks.workunit.client.0.smithi111.stdout:9/14: dwrite - no filename 2024-09-11T00:06:59.412 INFO:tasks.workunit.client.0.smithi111.stdout:0/4: fdatasync f1 0 2024-09-11T00:06:59.413 INFO:tasks.workunit.client.0.smithi111.stdout:0/5: dread - f0 zero size 2024-09-11T00:06:59.414 INFO:tasks.workunit.client.0.smithi111.stdout:7/12: write f1 [126556,59950] 0 2024-09-11T00:06:59.415 INFO:tasks.workunit.client.0.smithi111.stdout:3/7: dread f1 [4194304,4194304] 0 2024-09-11T00:06:59.415 INFO:tasks.workunit.client.0.smithi111.stdout:8/7: creat f1 x:0 0 0 2024-09-11T00:06:59.416 INFO:tasks.workunit.client.0.smithi111.stdout:5/6: link f0 f2 0 2024-09-11T00:06:59.416 INFO:tasks.workunit.client.0.smithi111.stdout:3/8: chown l0 38 1 2024-09-11T00:06:59.417 INFO:tasks.workunit.client.0.smithi111.stdout:3/9: truncate f3 908426 0 2024-09-11T00:06:59.420 INFO:tasks.workunit.client.0.smithi111.stdout:9/15: unlink c0 0 2024-09-11T00:06:59.420 INFO:tasks.workunit.client.0.smithi111.stdout:9/16: write - no filename 2024-09-11T00:06:59.420 INFO:tasks.workunit.client.0.smithi111.stdout:9/17: dread - no filename 2024-09-11T00:06:59.420 INFO:tasks.workunit.client.0.smithi111.stdout:9/18: write - no filename 2024-09-11T00:06:59.421 INFO:tasks.workunit.client.0.smithi111.stdout:9/19: fdatasync - no filename 2024-09-11T00:06:59.421 INFO:tasks.workunit.client.0.smithi111.stdout:9/20: dwrite - no filename 2024-09-11T00:06:59.421 INFO:tasks.workunit.client.0.smithi111.stdout:9/21: write - no filename 2024-09-11T00:06:59.422 INFO:tasks.workunit.client.0.smithi111.stdout:6/17: link f0 f1 0 2024-09-11T00:06:59.425 INFO:tasks.workunit.client.0.smithi111.stdout:7/13: mknod c2 0 2024-09-11T00:06:59.427 INFO:tasks.workunit.client.0.smithi111.stdout:8/8: rename f0 to f2 0 2024-09-11T00:06:59.429 INFO:tasks.workunit.client.0.smithi111.stdout:5/7: mkdir d3 0 2024-09-11T00:06:59.433 INFO:tasks.workunit.client.0.smithi111.stdout:9/22: rename c2 to c3 0 2024-09-11T00:06:59.433 INFO:tasks.workunit.client.0.smithi111.stdout:9/23: truncate - no filename 2024-09-11T00:06:59.433 INFO:tasks.workunit.client.0.smithi111.stdout:9/24: dread - no filename 2024-09-11T00:06:59.435 INFO:tasks.workunit.client.0.smithi111.stdout:0/6: link f0 f2 0 2024-09-11T00:06:59.436 INFO:tasks.workunit.client.0.smithi111.stdout:7/14: mknod c3 0 2024-09-11T00:06:59.436 INFO:tasks.workunit.client.0.smithi111.stdout:7/15: rmdir - no directory 2024-09-11T00:06:59.437 INFO:tasks.workunit.client.0.smithi111.stdout:0/7: write f1 [378878,124242] 0 2024-09-11T00:06:59.439 INFO:tasks.workunit.client.0.smithi111.stdout:9/25: symlink l4 0 2024-09-11T00:06:59.440 INFO:tasks.workunit.client.0.smithi111.stdout:5/8: write f2 [399194,42342] 0 2024-09-11T00:06:59.441 INFO:tasks.workunit.client.0.smithi111.stdout:5/9: readlink - no filename 2024-09-11T00:06:59.442 INFO:tasks.workunit.client.0.smithi111.stdout:9/26: chown l4 57620 1 2024-09-11T00:06:59.442 INFO:tasks.workunit.client.0.smithi111.stdout:9/27: dwrite - no filename 2024-09-11T00:06:59.444 INFO:tasks.workunit.client.0.smithi111.stdout:5/10: write f2 [249810,123854] 0 2024-09-11T00:06:59.447 INFO:tasks.workunit.client.0.smithi111.stdout:9/28: creat f5 x:0 0 0 2024-09-11T00:06:59.447 INFO:tasks.workunit.client.0.smithi111.stdout:0/8: write f2 [627863,11197] 0 2024-09-11T00:06:59.448 INFO:tasks.workunit.client.0.smithi111.stdout:7/16: dread f1 [0,4194304] 0 2024-09-11T00:06:59.453 INFO:tasks.workunit.client.0.smithi111.stdout:0/9: mkdir d3 0 2024-09-11T00:06:59.455 INFO:tasks.workunit.client.0.smithi111.stdout:3/10: dwrite f1 [0,4194304] 0 2024-09-11T00:06:59.455 INFO:tasks.workunit.client.0.smithi111.stdout:5/11: rmdir d3 0 2024-09-11T00:06:59.457 INFO:tasks.workunit.client.0.smithi111.stdout:7/17: write f1 [373668,35612] 0 2024-09-11T00:06:59.457 INFO:tasks.workunit.client.0.smithi111.stdout:0/10: mknod d3/c4 0 2024-09-11T00:06:59.459 INFO:tasks.workunit.client.0.smithi111.stdout:5/12: chown f1 190879 1 2024-09-11T00:06:59.461 INFO:tasks.workunit.client.0.smithi111.stdout:3/11: read f1 [2910513,80479] 0 2024-09-11T00:06:59.461 INFO:tasks.workunit.client.0.smithi111.stdout:6/18: dwrite f0 [0,4194304] 0 2024-09-11T00:06:59.466 INFO:tasks.workunit.client.0.smithi111.stdout:5/13: symlink l4 0 2024-09-11T00:06:59.466 INFO:tasks.workunit.client.0.smithi111.stdout:7/18: creat f4 x:0 0 0 2024-09-11T00:06:59.467 INFO:tasks.workunit.client.0.smithi111.stdout:6/19: creat f2 x:0 0 0 2024-09-11T00:06:59.468 INFO:tasks.workunit.client.0.smithi111.stdout:3/12: rename f1 to f4 0 2024-09-11T00:06:59.468 INFO:tasks.workunit.client.0.smithi111.stdout:7/19: dread - f4 zero size 2024-09-11T00:06:59.469 INFO:tasks.workunit.client.0.smithi111.stdout:5/14: chown f2 1071112 1 2024-09-11T00:06:59.471 INFO:tasks.workunit.client.0.smithi111.stdout:7/20: write f4 [1045175,91665] 0 2024-09-11T00:06:59.473 INFO:tasks.workunit.client.0.smithi111.stdout:9/29: dwrite f5 [0,4194304] 0 2024-09-11T00:06:59.476 INFO:tasks.workunit.client.0.smithi111.stdout:3/13: creat f5 x:0 0 0 2024-09-11T00:06:59.478 INFO:tasks.workunit.client.0.smithi111.stdout:5/15: creat f5 x:0 0 0 2024-09-11T00:06:59.479 INFO:tasks.workunit.client.0.smithi111.stdout:7/21: mknod c5 0 2024-09-11T00:06:59.481 INFO:tasks.workunit.client.0.smithi111.stdout:7/22: write f1 [410525,23885] 0 2024-09-11T00:06:59.482 INFO:tasks.workunit.client.0.smithi111.stdout:3/14: creat f6 x:0 0 0 2024-09-11T00:06:59.483 INFO:tasks.workunit.client.0.smithi111.stdout:7/23: write f4 [158415,122716] 0 2024-09-11T00:06:59.483 INFO:tasks.workunit.client.0.smithi111.stdout:3/15: dread - f6 zero size 2024-09-11T00:06:59.485 INFO:tasks.workunit.client.0.smithi111.stdout:7/24: chown f1 359839701 1 2024-09-11T00:06:59.486 INFO:tasks.workunit.client.1.smithi203.stdout:5/88: sync 2024-09-11T00:06:59.486 INFO:tasks.workunit.client.1.smithi203.stdout:3/56: sync 2024-09-11T00:06:59.486 INFO:tasks.workunit.client.1.smithi203.stdout:4/15: sync 2024-09-11T00:06:59.486 INFO:tasks.workunit.client.1.smithi203.stdout:0/13: sync 2024-09-11T00:06:59.486 INFO:tasks.workunit.client.1.smithi203.stdout:6/30: sync 2024-09-11T00:06:59.487 INFO:tasks.workunit.client.1.smithi203.stdout:9/40: sync 2024-09-11T00:06:59.487 INFO:tasks.workunit.client.1.smithi203.stdout:7/113: sync 2024-09-11T00:06:59.487 INFO:tasks.workunit.client.1.smithi203.stdout:8/28: sync 2024-09-11T00:06:59.487 INFO:tasks.workunit.client.1.smithi203.stdout:1/48: sync 2024-09-11T00:06:59.487 INFO:tasks.workunit.client.0.smithi111.stdout:6/20: fdatasync f1 0 2024-09-11T00:06:59.491 INFO:tasks.workunit.client.0.smithi111.stdout:3/16: rename l0 to l7 0 2024-09-11T00:06:59.491 INFO:tasks.workunit.client.1.smithi203.stdout:9/41: readlink d6/lc 0 2024-09-11T00:06:59.494 INFO:tasks.workunit.client.1.smithi203.stdout:6/31: creat d0/f8 x:0 0 0 2024-09-11T00:06:59.495 INFO:tasks.workunit.client.0.smithi111.stdout:6/21: creat f3 x:0 0 0 2024-09-11T00:06:59.498 INFO:tasks.workunit.client.0.smithi111.stdout:7/25: link f4 f6 0 2024-09-11T00:06:59.500 INFO:tasks.workunit.client.0.smithi111.stdout:5/16: dwrite f2 [0,4194304] 0 2024-09-11T00:06:59.501 INFO:tasks.workunit.client.0.smithi111.stdout:2/19: creat d0/f2 x:0 0 0 2024-09-11T00:06:59.501 INFO:tasks.workunit.client.0.smithi111.stdout:5/17: dread - f5 zero size 2024-09-11T00:06:59.504 INFO:tasks.workunit.client.0.smithi111.stdout:4/8: getdents . 0 2024-09-11T00:06:59.504 INFO:tasks.workunit.client.0.smithi111.stdout:4/9: dread - no filename 2024-09-11T00:06:59.509 INFO:tasks.workunit.client.0.smithi111.stdout:6/22: mknod c4 0 2024-09-11T00:06:59.510 INFO:tasks.workunit.client.1.smithi203.stdout:5/89: truncate f8 2715452 0 2024-09-11T00:06:59.510 INFO:tasks.workunit.client.1.smithi203.stdout:1/49: creat d8/f10 x:0 0 0 2024-09-11T00:06:59.513 INFO:tasks.workunit.client.0.smithi111.stdout:2/20: mkdir d0/d3 0 2024-09-11T00:06:59.515 INFO:tasks.workunit.client.1.smithi203.stdout:4/16: mknod c3 0 2024-09-11T00:06:59.516 INFO:tasks.workunit.client.1.smithi203.stdout:9/42: dread - d6/de/f10 zero size 2024-09-11T00:06:59.518 INFO:tasks.workunit.client.0.smithi111.stdout:4/10: symlink l4 0 2024-09-11T00:06:59.518 INFO:tasks.workunit.client.0.smithi111.stdout:4/11: fdatasync - no filename 2024-09-11T00:06:59.520 INFO:tasks.workunit.client.0.smithi111.stdout:6/23: symlink l5 0 2024-09-11T00:06:59.520 INFO:tasks.workunit.client.1.smithi203.stdout:7/114: symlink dd/l2f 0 2024-09-11T00:06:59.524 INFO:tasks.workunit.client.0.smithi111.stdout:4/12: creat f5 x:0 0 0 2024-09-11T00:06:59.526 INFO:tasks.workunit.client.0.smithi111.stdout:4/13: dread - f5 zero size 2024-09-11T00:06:59.527 INFO:tasks.workunit.client.0.smithi111.stdout:5/18: link l4 l6 0 2024-09-11T00:06:59.528 INFO:tasks.workunit.client.1.smithi203.stdout:2/3: dwrite f0 [0,4194304] 0 2024-09-11T00:06:59.529 INFO:tasks.workunit.client.0.smithi111.stdout:4/14: fdatasync f5 0 2024-09-11T00:06:59.529 INFO:tasks.workunit.client.1.smithi203.stdout:2/4: truncate f0 4782322 0 2024-09-11T00:06:59.529 INFO:tasks.workunit.client.1.smithi203.stdout:2/5: readlink - no filename 2024-09-11T00:06:59.532 INFO:tasks.workunit.client.0.smithi111.stdout:4/15: dread - f5 zero size 2024-09-11T00:06:59.535 INFO:tasks.workunit.client.0.smithi111.stdout:7/26: dwrite f6 [0,4194304] 0 2024-09-11T00:06:59.537 INFO:tasks.workunit.client.1.smithi203.stdout:9/43: fdatasync d6/fa 0 2024-09-11T00:06:59.537 INFO:tasks.workunit.client.1.smithi203.stdout:9/44: fsync d6/fa 0 2024-09-11T00:06:59.538 INFO:tasks.workunit.client.0.smithi111.stdout:2/21: dwrite d0/f2 [0,4194304] 0 2024-09-11T00:06:59.539 INFO:tasks.workunit.client.0.smithi111.stdout:4/16: mknod c6 0 2024-09-11T00:06:59.540 INFO:tasks.workunit.client.0.smithi111.stdout:2/22: write d0/f2 [2727441,107221] 0 2024-09-11T00:06:59.540 INFO:tasks.workunit.client.1.smithi203.stdout:7/115: fsync dd/f1a 0 2024-09-11T00:06:59.541 INFO:tasks.workunit.client.0.smithi111.stdout:4/17: write f5 [330738,104159] 0 2024-09-11T00:06:59.542 INFO:tasks.workunit.client.1.smithi203.stdout:9/45: write d6/fa [951846,91813] 0 2024-09-11T00:06:59.543 INFO:tasks.workunit.client.0.smithi111.stdout:7/27: creat f7 x:0 0 0 2024-09-11T00:06:59.545 INFO:tasks.workunit.client.0.smithi111.stdout:7/28: write f1 [1009624,53457] 0 2024-09-11T00:06:59.552 INFO:tasks.workunit.client.0.smithi111.stdout:8/9: truncate f2 173252 0 2024-09-11T00:06:59.552 INFO:tasks.workunit.client.0.smithi111.stdout:2/23: creat d0/f4 x:0 0 0 2024-09-11T00:06:59.554 INFO:tasks.workunit.client.0.smithi111.stdout:4/18: dread f5 [0,4194304] 0 2024-09-11T00:06:59.556 INFO:tasks.workunit.client.1.smithi203.stdout:2/6: creat f1 x:0 0 0 2024-09-11T00:06:59.566 INFO:tasks.workunit.client.0.smithi111.stdout:7/29: rename f4 to f8 0 2024-09-11T00:06:59.567 INFO:tasks.workunit.client.0.smithi111.stdout:3/17: rename f4 to f8 0 2024-09-11T00:06:59.569 INFO:tasks.workunit.client.0.smithi111.stdout:6/24: truncate f0 327666 0 2024-09-11T00:06:59.571 INFO:tasks.workunit.client.1.smithi203.stdout:9/46: unlink d6/fa 0 2024-09-11T00:06:59.572 INFO:tasks.workunit.client.0.smithi111.stdout:0/11: truncate f1 2850128 0 2024-09-11T00:06:59.573 INFO:tasks.workunit.client.0.smithi111.stdout:0/12: fsync f0 0 2024-09-11T00:06:59.575 INFO:tasks.workunit.client.0.smithi111.stdout:4/19: write f5 [1410012,25019] 0 2024-09-11T00:06:59.575 INFO:tasks.workunit.client.1.smithi203.stdout:5/90: link dc/dd/le dc/dd/d15/l16 0 2024-09-11T00:06:59.576 INFO:tasks.workunit.client.1.smithi203.stdout:5/91: chown f5 737864618 1 2024-09-11T00:06:59.577 INFO:tasks.workunit.client.1.smithi203.stdout:1/50: rmdir d8/d9/de 0 2024-09-11T00:06:59.579 INFO:tasks.workunit.client.1.smithi203.stdout:0/14: getdents d0/d2 0 2024-09-11T00:06:59.580 INFO:tasks.workunit.client.0.smithi111.stdout:9/30: dwrite f5 [4194304,4194304] 0 2024-09-11T00:06:59.581 INFO:tasks.workunit.client.1.smithi203.stdout:2/7: creat f2 x:0 0 0 2024-09-11T00:06:59.584 INFO:tasks.workunit.client.1.smithi203.stdout:6/32: getdents d0 0 2024-09-11T00:06:59.586 INFO:tasks.workunit.client.0.smithi111.stdout:3/18: creat f9 x:0 0 0 2024-09-11T00:06:59.586 INFO:tasks.workunit.client.0.smithi111.stdout:6/25: rename f2 to f6 0 2024-09-11T00:06:59.586 INFO:tasks.workunit.client.0.smithi111.stdout:6/26: rmdir - no directory 2024-09-11T00:06:59.586 INFO:tasks.workunit.client.0.smithi111.stdout:7/30: dwrite f1 [0,4194304] 0 2024-09-11T00:06:59.587 INFO:tasks.workunit.client.0.smithi111.stdout:3/19: dread - f6 zero size 2024-09-11T00:06:59.588 INFO:tasks.workunit.client.0.smithi111.stdout:7/31: read - f7 zero size 2024-09-11T00:06:59.588 INFO:tasks.workunit.client.0.smithi111.stdout:7/32: read - f7 zero size 2024-09-11T00:06:59.589 INFO:tasks.workunit.client.1.smithi203.stdout:3/57: write d8/fb [2907762,55296] 0 2024-09-11T00:06:59.589 INFO:tasks.workunit.client.0.smithi111.stdout:7/33: stat f6 0 2024-09-11T00:06:59.595 INFO:tasks.workunit.client.1.smithi203.stdout:8/29: write d1/f3 [515997,130952] 0 2024-09-11T00:06:59.598 INFO:tasks.workunit.client.1.smithi203.stdout:5/92: mknod dc/dd/c17 0 2024-09-11T00:06:59.598 INFO:tasks.workunit.client.0.smithi111.stdout:4/20: creat f7 x:0 0 0 2024-09-11T00:06:59.599 INFO:tasks.workunit.client.0.smithi111.stdout:4/21: dread - f7 zero size 2024-09-11T00:06:59.602 INFO:tasks.workunit.client.1.smithi203.stdout:8/30: fsync d1/f3 0 2024-09-11T00:06:59.603 INFO:tasks.workunit.client.1.smithi203.stdout:1/51: unlink d8/d9/db/fc 0 2024-09-11T00:06:59.605 INFO:tasks.workunit.client.0.smithi111.stdout:9/31: mkdir d6 0 2024-09-11T00:06:59.607 INFO:tasks.workunit.client.1.smithi203.stdout:2/8: mknod c3 0 2024-09-11T00:06:59.608 INFO:tasks.workunit.client.1.smithi203.stdout:2/9: chown c3 48330651 1 2024-09-11T00:06:59.609 INFO:tasks.workunit.client.1.smithi203.stdout:2/10: dread - f1 zero size 2024-09-11T00:06:59.611 INFO:tasks.workunit.client.1.smithi203.stdout:9/47: symlink d6/de/df/l12 0 2024-09-11T00:06:59.612 INFO:tasks.workunit.client.0.smithi111.stdout:6/27: write f6 [322548,20455] 0 2024-09-11T00:06:59.615 INFO:tasks.workunit.client.0.smithi111.stdout:6/28: readlink l5 0 2024-09-11T00:06:59.620 INFO:tasks.workunit.client.1.smithi203.stdout:4/17: dwrite f1 [0,4194304] 0 2024-09-11T00:06:59.622 INFO:tasks.workunit.client.0.smithi111.stdout:5/19: truncate f1 1100979 0 2024-09-11T00:06:59.624 INFO:tasks.workunit.client.0.smithi111.stdout:4/22: dwrite f5 [0,4194304] 0 2024-09-11T00:06:59.625 INFO:tasks.workunit.client.0.smithi111.stdout:5/20: fsync f0 0 2024-09-11T00:06:59.628 INFO:tasks.workunit.client.0.smithi111.stdout:4/23: write f5 [2850199,123739] 0 2024-09-11T00:06:59.629 INFO:tasks.workunit.client.1.smithi203.stdout:8/31: symlink d1/l7 0 2024-09-11T00:06:59.632 INFO:tasks.workunit.client.0.smithi111.stdout:9/32: dwrite f5 [4194304,4194304] 0 2024-09-11T00:06:59.632 INFO:tasks.workunit.client.0.smithi111.stdout:2/24: dwrite d0/f2 [4194304,4194304] 0 2024-09-11T00:06:59.636 INFO:tasks.workunit.client.1.smithi203.stdout:2/11: dwrite f2 [0,4194304] 0 2024-09-11T00:06:59.638 INFO:tasks.workunit.client.0.smithi111.stdout:6/29: mkdir d7 0 2024-09-11T00:06:59.643 INFO:tasks.workunit.client.1.smithi203.stdout:9/48: mkdir d6/de/df/d13 0 2024-09-11T00:06:59.653 INFO:tasks.workunit.client.1.smithi203.stdout:7/116: getdents dd/d1c 0 2024-09-11T00:06:59.655 INFO:tasks.workunit.client.1.smithi203.stdout:4/18: symlink l4 0 2024-09-11T00:06:59.657 INFO:tasks.workunit.client.0.smithi111.stdout:7/34: dwrite f6 [4194304,4194304] 0 2024-09-11T00:06:59.661 INFO:tasks.workunit.client.0.smithi111.stdout:4/24: readlink l1 0 2024-09-11T00:06:59.670 INFO:tasks.workunit.client.1.smithi203.stdout:8/32: creat d1/f8 x:0 0 0 2024-09-11T00:06:59.673 INFO:tasks.workunit.client.1.smithi203.stdout:8/33: read d1/f3 [69582,4394] 0 2024-09-11T00:06:59.674 INFO:tasks.workunit.client.1.smithi203.stdout:2/12: rename f1 to f4 0 2024-09-11T00:06:59.675 INFO:tasks.workunit.client.0.smithi111.stdout:0/13: getdents d3 0 2024-09-11T00:06:59.675 INFO:tasks.workunit.client.1.smithi203.stdout:2/13: chown f2 822369 1 2024-09-11T00:06:59.677 INFO:tasks.workunit.client.1.smithi203.stdout:3/58: write d8/ff [3863129,34376] 0 2024-09-11T00:06:59.679 INFO:tasks.workunit.client.0.smithi111.stdout:2/25: mknod d0/c5 0 2024-09-11T00:06:59.679 INFO:tasks.workunit.client.0.smithi111.stdout:2/26: chown d0 27282 1 2024-09-11T00:06:59.680 INFO:tasks.workunit.client.0.smithi111.stdout:4/25: dwrite f7 [0,4194304] 0 2024-09-11T00:06:59.680 INFO:tasks.workunit.client.1.smithi203.stdout:6/33: link d0/c7 d0/c9 0 2024-09-11T00:06:59.681 INFO:tasks.workunit.client.1.smithi203.stdout:6/34: chown d0/f4 3567 1 2024-09-11T00:06:59.681 INFO:tasks.workunit.client.1.smithi203.stdout:6/35: fsync d0/f8 0 2024-09-11T00:06:59.682 INFO:tasks.workunit.client.0.smithi111.stdout:2/27: chown d0/d3 267399013 1 2024-09-11T00:06:59.682 INFO:tasks.workunit.client.0.smithi111.stdout:2/28: dread - d0/f4 zero size 2024-09-11T00:06:59.682 INFO:tasks.workunit.client.0.smithi111.stdout:2/29: dread - d0/f4 zero size 2024-09-11T00:06:59.683 INFO:tasks.workunit.client.0.smithi111.stdout:2/30: write d0/f4 [483897,51874] 0 2024-09-11T00:06:59.687 INFO:tasks.workunit.client.1.smithi203.stdout:4/19: mknod c5 0 2024-09-11T00:06:59.689 INFO:tasks.workunit.client.1.smithi203.stdout:4/20: readlink l4 0 2024-09-11T00:06:59.690 INFO:tasks.workunit.client.0.smithi111.stdout:7/35: mknod c9 0 2024-09-11T00:06:59.690 INFO:tasks.workunit.client.1.smithi203.stdout:4/21: chown c3 8026058 1 2024-09-11T00:06:59.692 INFO:tasks.workunit.client.1.smithi203.stdout:4/22: chown l4 85718 1 2024-09-11T00:06:59.693 INFO:tasks.workunit.client.0.smithi111.stdout:7/36: write f7 [130873,13674] 0 2024-09-11T00:06:59.693 INFO:tasks.workunit.client.0.smithi111.stdout:5/21: unlink l4 0 2024-09-11T00:06:59.696 INFO:tasks.workunit.client.0.smithi111.stdout:3/20: getdents . 0 2024-09-11T00:06:59.697 INFO:tasks.workunit.client.0.smithi111.stdout:8/10: dwrite f2 [0,4194304] 0 2024-09-11T00:06:59.698 INFO:tasks.workunit.client.0.smithi111.stdout:3/21: dread - f6 zero size 2024-09-11T00:06:59.698 INFO:tasks.workunit.client.1.smithi203.stdout:0/15: getdents d0 0 2024-09-11T00:06:59.700 INFO:tasks.workunit.client.1.smithi203.stdout:3/59: rename d8/da/f18 to d8/da/f19 0 2024-09-11T00:06:59.701 INFO:tasks.workunit.client.1.smithi203.stdout:1/52: dwrite f5 [0,4194304] 0 2024-09-11T00:06:59.701 INFO:tasks.workunit.client.1.smithi203.stdout:0/16: stat d0 0 2024-09-11T00:06:59.702 INFO:tasks.workunit.client.0.smithi111.stdout:0/14: creat d3/f5 x:0 0 0 2024-09-11T00:06:59.705 INFO:tasks.workunit.client.0.smithi111.stdout:9/33: mknod d6/c7 0 2024-09-11T00:06:59.708 INFO:tasks.workunit.client.0.smithi111.stdout:4/26: creat f8 x:0 0 0 2024-09-11T00:06:59.711 INFO:tasks.workunit.client.1.smithi203.stdout:9/49: write f5 [393087,73694] 0 2024-09-11T00:06:59.712 INFO:tasks.workunit.client.1.smithi203.stdout:7/117: write dd/f22 [463215,22158] 0 2024-09-11T00:06:59.712 INFO:tasks.workunit.client.1.smithi203.stdout:4/23: dread f2 [0,4194304] 0 2024-09-11T00:06:59.714 INFO:tasks.workunit.client.1.smithi203.stdout:9/50: write f5 [2135512,97084] 0 2024-09-11T00:06:59.717 INFO:tasks.workunit.client.1.smithi203.stdout:3/60: dread d8/ff [0,4194304] 0 2024-09-11T00:06:59.719 INFO:tasks.workunit.client.1.smithi203.stdout:1/53: dread f5 [0,4194304] 0 2024-09-11T00:06:59.720 INFO:tasks.workunit.client.0.smithi111.stdout:2/31: mknod d0/c6 0 2024-09-11T00:06:59.721 INFO:tasks.workunit.client.1.smithi203.stdout:6/36: write d0/f5 [479937,75438] 0 2024-09-11T00:06:59.721 INFO:tasks.workunit.client.1.smithi203.stdout:1/54: chown d8/f10 126324 1 2024-09-11T00:06:59.721 INFO:tasks.workunit.client.1.smithi203.stdout:6/37: readlink - no filename 2024-09-11T00:06:59.722 INFO:tasks.workunit.client.0.smithi111.stdout:2/32: chown d0/f4 10591073 1 2024-09-11T00:06:59.723 INFO:tasks.workunit.client.1.smithi203.stdout:6/38: chown d0 198986289 1 2024-09-11T00:06:59.725 INFO:tasks.workunit.client.0.smithi111.stdout:2/33: chown d0/f2 75917 1 2024-09-11T00:06:59.725 INFO:tasks.workunit.client.1.smithi203.stdout:6/39: truncate d0/f5 1322573 0 2024-09-11T00:06:59.726 INFO:tasks.workunit.client.1.smithi203.stdout:1/55: write d8/f10 [783767,87253] 0 2024-09-11T00:06:59.726 INFO:tasks.workunit.client.0.smithi111.stdout:8/11: dwrite f1 [0,4194304] 0 2024-09-11T00:06:59.728 INFO:tasks.workunit.client.1.smithi203.stdout:4/24: dread f1 [0,4194304] 0 2024-09-11T00:06:59.728 INFO:tasks.workunit.client.0.smithi111.stdout:4/27: dread f5 [0,4194304] 0 2024-09-11T00:06:59.728 INFO:tasks.workunit.client.1.smithi203.stdout:1/56: write d8/f10 [295037,79368] 0 2024-09-11T00:06:59.731 INFO:tasks.workunit.client.0.smithi111.stdout:7/37: creat fa x:0 0 0 2024-09-11T00:06:59.732 INFO:tasks.workunit.client.0.smithi111.stdout:5/22: creat f7 x:0 0 0 2024-09-11T00:06:59.733 INFO:tasks.workunit.client.0.smithi111.stdout:3/22: creat fa x:0 0 0 2024-09-11T00:06:59.738 INFO:tasks.workunit.client.0.smithi111.stdout:9/34: unlink l4 0 2024-09-11T00:06:59.739 INFO:tasks.workunit.client.0.smithi111.stdout:6/30: truncate f6 172172 0 2024-09-11T00:06:59.741 INFO:tasks.workunit.client.1.smithi203.stdout:1/57: dread f5 [0,4194304] 0 2024-09-11T00:06:59.743 INFO:tasks.workunit.client.1.smithi203.stdout:1/58: chown f4 59 1 2024-09-11T00:06:59.743 INFO:tasks.workunit.client.0.smithi111.stdout:8/12: dread f2 [0,4194304] 0 2024-09-11T00:06:59.745 INFO:tasks.workunit.client.1.smithi203.stdout:3/61: dread - d8/da/f19 zero size 2024-09-11T00:06:59.747 INFO:tasks.workunit.client.1.smithi203.stdout:3/62: chown d8/ff 227854 1 2024-09-11T00:06:59.747 INFO:tasks.workunit.client.0.smithi111.stdout:4/28: creat f9 x:0 0 0 2024-09-11T00:06:59.748 INFO:tasks.workunit.client.0.smithi111.stdout:2/34: dwrite d0/f4 [0,4194304] 0 2024-09-11T00:06:59.749 INFO:tasks.workunit.client.0.smithi111.stdout:7/38: dread f1 [0,4194304] 0 2024-09-11T00:06:59.749 INFO:tasks.workunit.client.0.smithi111.stdout:2/35: read d0/f4 [1177350,55155] 0 2024-09-11T00:06:59.750 INFO:tasks.workunit.client.1.smithi203.stdout:4/25: creat f6 x:0 0 0 2024-09-11T00:06:59.750 INFO:tasks.workunit.client.1.smithi203.stdout:4/26: rmdir - no directory 2024-09-11T00:06:59.752 INFO:tasks.workunit.client.1.smithi203.stdout:4/27: chown f2 8523291 1 2024-09-11T00:06:59.752 INFO:tasks.workunit.client.0.smithi111.stdout:3/23: creat fb x:0 0 0 2024-09-11T00:06:59.753 INFO:tasks.workunit.client.0.smithi111.stdout:3/24: chown f2 104595523 1 2024-09-11T00:06:59.754 INFO:tasks.workunit.client.0.smithi111.stdout:3/25: fdatasync f5 0 2024-09-11T00:06:59.755 INFO:tasks.workunit.client.1.smithi203.stdout:9/51: getdents d6/de/df/d13 0 2024-09-11T00:06:59.755 INFO:tasks.workunit.client.0.smithi111.stdout:3/26: chown f2 120 1 2024-09-11T00:06:59.755 INFO:tasks.workunit.client.0.smithi111.stdout:3/27: read - fa zero size 2024-09-11T00:06:59.756 INFO:tasks.workunit.client.0.smithi111.stdout:8/13: dread f2 [0,4194304] 0 2024-09-11T00:06:59.756 INFO:tasks.workunit.client.0.smithi111.stdout:9/35: symlink d6/l8 0 2024-09-11T00:06:59.757 INFO:tasks.workunit.client.0.smithi111.stdout:3/28: write fb [340657,93997] 0 2024-09-11T00:06:59.757 INFO:tasks.workunit.client.1.smithi203.stdout:8/34: getdents d1 0 2024-09-11T00:06:59.758 INFO:tasks.workunit.client.1.smithi203.stdout:0/17: dwrite d0/d2/f3 [0,4194304] 0 2024-09-11T00:06:59.759 INFO:tasks.workunit.client.0.smithi111.stdout:3/29: write f9 [887675,74952] 0 2024-09-11T00:06:59.759 INFO:tasks.workunit.client.0.smithi111.stdout:3/30: rmdir - no directory 2024-09-11T00:06:59.760 INFO:tasks.workunit.client.0.smithi111.stdout:3/31: chown f6 35036108 1 2024-09-11T00:06:59.761 INFO:tasks.workunit.client.1.smithi203.stdout:1/59: mkdir d8/d11 0 2024-09-11T00:06:59.764 INFO:tasks.workunit.client.1.smithi203.stdout:6/40: symlink d0/d6/la 0 2024-09-11T00:06:59.767 INFO:tasks.workunit.client.1.smithi203.stdout:6/41: truncate d0/f8 351655 0 2024-09-11T00:06:59.768 INFO:tasks.workunit.client.0.smithi111.stdout:4/29: rename l2 to la 0 2024-09-11T00:06:59.770 INFO:tasks.workunit.client.0.smithi111.stdout:4/30: write f8 [946815,18210] 0 2024-09-11T00:06:59.773 INFO:tasks.workunit.client.1.smithi203.stdout:7/118: creat dd/f30 x:0 0 0 2024-09-11T00:06:59.776 INFO:tasks.workunit.client.1.smithi203.stdout:4/28: rename l4 to l7 0 2024-09-11T00:06:59.776 INFO:tasks.workunit.client.1.smithi203.stdout:7/119: write dd/f22 [945475,80260] 0 2024-09-11T00:06:59.777 INFO:tasks.workunit.client.0.smithi111.stdout:0/15: truncate f0 367 0 2024-09-11T00:06:59.777 INFO:tasks.workunit.client.1.smithi203.stdout:4/29: chown f2 393162 1 2024-09-11T00:06:59.779 INFO:tasks.workunit.client.1.smithi203.stdout:9/52: rmdir d6 39 2024-09-11T00:06:59.780 INFO:tasks.workunit.client.0.smithi111.stdout:3/32: dwrite fa [0,4194304] 0 2024-09-11T00:06:59.781 INFO:tasks.workunit.client.1.smithi203.stdout:8/35: creat d1/f9 x:0 0 0 2024-09-11T00:06:59.786 INFO:tasks.workunit.client.1.smithi203.stdout:0/18: creat d0/f5 x:0 0 0 2024-09-11T00:06:59.788 INFO:tasks.workunit.client.0.smithi111.stdout:8/14: mknod c3 0 2024-09-11T00:06:59.791 INFO:tasks.workunit.client.0.smithi111.stdout:9/36: creat d6/f9 x:0 0 0 2024-09-11T00:06:59.793 INFO:tasks.workunit.client.1.smithi203.stdout:1/60: symlink d8/d9/l12 0 2024-09-11T00:06:59.793 INFO:tasks.workunit.client.1.smithi203.stdout:3/63: mknod d8/d17/c1a 0 2024-09-11T00:06:59.794 INFO:tasks.workunit.client.0.smithi111.stdout:5/23: unlink f0 0 2024-09-11T00:06:59.800 INFO:tasks.workunit.client.1.smithi203.stdout:4/30: fdatasync f1 0 2024-09-11T00:06:59.803 INFO:tasks.workunit.client.1.smithi203.stdout:1/61: symlink d8/d9/l13 0 2024-09-11T00:06:59.806 INFO:tasks.workunit.client.1.smithi203.stdout:3/64: rename d8/d17/c1a to d8/da/c1b 0 2024-09-11T00:06:59.807 INFO:tasks.workunit.client.1.smithi203.stdout:8/36: dwrite d1/f3 [0,4194304] 0 2024-09-11T00:06:59.808 INFO:tasks.workunit.client.0.smithi111.stdout:3/33: mknod cc 0 2024-09-11T00:06:59.810 INFO:tasks.workunit.client.1.smithi203.stdout:4/31: mknod c8 0 2024-09-11T00:06:59.810 INFO:tasks.workunit.client.0.smithi111.stdout:6/31: dwrite f0 [0,4194304] 0 2024-09-11T00:06:59.811 INFO:tasks.workunit.client.1.smithi203.stdout:4/32: stat c8 0 2024-09-11T00:06:59.811 INFO:tasks.workunit.client.0.smithi111.stdout:3/34: truncate f6 474980 0 2024-09-11T00:06:59.814 INFO:tasks.workunit.client.1.smithi203.stdout:0/19: link d0/f5 d0/d2/f6 0 2024-09-11T00:06:59.816 INFO:tasks.workunit.client.1.smithi203.stdout:9/53: creat d6/f14 x:0 0 0 2024-09-11T00:06:59.817 INFO:tasks.workunit.client.1.smithi203.stdout:9/54: write d6/f14 [449945,51785] 0 2024-09-11T00:06:59.821 INFO:tasks.workunit.client.0.smithi111.stdout:9/37: rename d6/c7 to d6/ca 0 2024-09-11T00:06:59.825 INFO:tasks.workunit.client.1.smithi203.stdout:3/65: creat d8/d17/f1c x:0 0 0 2024-09-11T00:06:59.825 INFO:tasks.workunit.client.1.smithi203.stdout:7/120: dread dd/f11 [0,4194304] 0 2024-09-11T00:06:59.829 INFO:tasks.workunit.client.0.smithi111.stdout:4/31: link f8 fb 0 2024-09-11T00:06:59.830 INFO:tasks.workunit.client.0.smithi111.stdout:7/39: link c3 cb 0 2024-09-11T00:06:59.834 INFO:tasks.workunit.client.1.smithi203.stdout:0/20: creat d0/f7 x:0 0 0 2024-09-11T00:06:59.840 INFO:tasks.workunit.client.1.smithi203.stdout:3/66: mknod d8/d17/c1d 0 2024-09-11T00:06:59.847 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:06:59 smithi203 ceph-mon[33225]: pgmap v319: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 104 KiB/s rd, 14 MiB/s wr, 248 op/s 2024-09-11T00:06:59.853 INFO:tasks.workunit.client.0.smithi111.stdout:9/38: mkdir d6/db 0 2024-09-11T00:06:59.854 INFO:tasks.workunit.client.1.smithi203.stdout:0/21: dread - d0/d2/f6 zero size 2024-09-11T00:06:59.856 INFO:tasks.workunit.client.0.smithi111.stdout:7/40: creat fc x:0 0 0 2024-09-11T00:06:59.857 INFO:tasks.workunit.client.1.smithi203.stdout:9/55: creat d6/de/df/d13/f15 x:0 0 0 2024-09-11T00:06:59.858 INFO:tasks.workunit.client.1.smithi203.stdout:8/37: dwrite d1/f6 [0,4194304] 0 2024-09-11T00:06:59.859 INFO:tasks.workunit.client.0.smithi111.stdout:2/36: getdents d0 0 2024-09-11T00:06:59.859 INFO:tasks.workunit.client.1.smithi203.stdout:1/62: link d8/d9/lf d8/l14 0 2024-09-11T00:06:59.859 INFO:tasks.workunit.client.1.smithi203.stdout:0/22: dread - d0/f7 zero size 2024-09-11T00:06:59.860 INFO:tasks.workunit.client.0.smithi111.stdout:6/32: symlink d7/l8 0 2024-09-11T00:06:59.862 INFO:tasks.workunit.client.0.smithi111.stdout:3/35: dwrite f8 [0,4194304] 0 2024-09-11T00:06:59.865 INFO:tasks.workunit.client.1.smithi203.stdout:9/56: symlink d6/l16 0 2024-09-11T00:06:59.867 INFO:tasks.workunit.client.1.smithi203.stdout:8/38: write d1/f9 [463708,30179] 0 2024-09-11T00:06:59.867 INFO:tasks.workunit.client.1.smithi203.stdout:0/23: chown d0/d2/f6 74952930 1 2024-09-11T00:06:59.869 INFO:tasks.workunit.client.0.smithi111.stdout:7/41: mkdir dd 0 2024-09-11T00:06:59.871 INFO:tasks.workunit.client.0.smithi111.stdout:0/16: getdents d3 0 2024-09-11T00:06:59.871 INFO:tasks.workunit.client.0.smithi111.stdout:4/32: write f8 [1348368,6105] 0 2024-09-11T00:06:59.876 INFO:tasks.workunit.client.1.smithi203.stdout:8/39: chown d1/f9 41 1 2024-09-11T00:06:59.879 INFO:tasks.workunit.client.0.smithi111.stdout:8/15: getdents . 0 2024-09-11T00:06:59.880 INFO:tasks.workunit.client.0.smithi111.stdout:8/16: chown c3 11 1 2024-09-11T00:06:59.882 INFO:tasks.workunit.client.1.smithi203.stdout:4/33: getdents . 0 2024-09-11T00:06:59.883 INFO:tasks.workunit.client.0.smithi111.stdout:3/36: rename l7 to ld 0 2024-09-11T00:06:59.883 INFO:tasks.workunit.client.1.smithi203.stdout:7/121: dwrite dd/d1c/f23 [0,4194304] 0 2024-09-11T00:06:59.886 INFO:tasks.workunit.client.1.smithi203.stdout:8/40: truncate d1/f6 4204706 0 2024-09-11T00:06:59.889 INFO:tasks.workunit.client.0.smithi111.stdout:2/37: mkdir d0/d3/d7 0 2024-09-11T00:06:59.891 INFO:tasks.workunit.client.0.smithi111.stdout:4/33: fdatasync f5 0 2024-09-11T00:06:59.892 INFO:tasks.workunit.client.0.smithi111.stdout:0/17: creat d3/f6 x:0 0 0 2024-09-11T00:06:59.897 INFO:tasks.workunit.client.0.smithi111.stdout:5/24: dwrite f2 [0,4194304] 0 2024-09-11T00:06:59.900 INFO:tasks.workunit.client.1.smithi203.stdout:1/63: rmdir d8/d9/db 0 2024-09-11T00:06:59.903 INFO:tasks.workunit.client.0.smithi111.stdout:9/39: getdents d6 0 2024-09-11T00:06:59.905 INFO:tasks.workunit.client.1.smithi203.stdout:9/57: dread f5 [0,4194304] 0 2024-09-11T00:06:59.906 INFO:tasks.workunit.client.1.smithi203.stdout:7/122: getdents dd/d1c 0 2024-09-11T00:06:59.907 INFO:tasks.workunit.client.0.smithi111.stdout:8/17: dwrite f1 [0,4194304] 0 2024-09-11T00:06:59.907 INFO:tasks.workunit.client.0.smithi111.stdout:5/25: symlink l8 0 2024-09-11T00:06:59.908 INFO:tasks.workunit.client.1.smithi203.stdout:3/67: dwrite d8/da/f19 [0,4194304] 0 2024-09-11T00:06:59.908 INFO:tasks.workunit.client.0.smithi111.stdout:9/40: mkdir d6/dc 0 2024-09-11T00:06:59.909 INFO:tasks.workunit.client.0.smithi111.stdout:3/37: dwrite f3 [0,4194304] 0 2024-09-11T00:06:59.910 INFO:tasks.workunit.client.0.smithi111.stdout:0/18: dread f0 [0,4194304] 0 2024-09-11T00:06:59.913 INFO:tasks.workunit.client.1.smithi203.stdout:1/64: mkdir d8/d9/d15 0 2024-09-11T00:06:59.913 INFO:tasks.workunit.client.1.smithi203.stdout:0/24: getdents d0 0 2024-09-11T00:06:59.913 INFO:tasks.workunit.client.1.smithi203.stdout:0/25: readlink - no filename 2024-09-11T00:06:59.916 INFO:tasks.workunit.client.0.smithi111.stdout:3/38: chown cc 10657779 1 2024-09-11T00:06:59.924 INFO:tasks.workunit.client.1.smithi203.stdout:3/68: dread - d8/f16 zero size 2024-09-11T00:06:59.927 INFO:tasks.workunit.client.1.smithi203.stdout:1/65: rename d8/l14 to d8/d11/l16 0 2024-09-11T00:06:59.929 INFO:tasks.workunit.client.1.smithi203.stdout:0/26: rmdir d0/d2 39 2024-09-11T00:06:59.935 INFO:tasks.workunit.client.0.smithi111.stdout:5/26: unlink l6 0 2024-09-11T00:06:59.935 INFO:tasks.workunit.client.0.smithi111.stdout:5/27: rmdir - no directory 2024-09-11T00:06:59.935 INFO:tasks.workunit.client.0.smithi111.stdout:0/19: truncate d3/f5 279896 0 2024-09-11T00:06:59.936 INFO:tasks.workunit.client.0.smithi111.stdout:5/28: stat f7 0 2024-09-11T00:06:59.936 INFO:tasks.workunit.client.0.smithi111.stdout:2/38: dwrite d0/f2 [0,4194304] 0 2024-09-11T00:06:59.939 INFO:tasks.workunit.client.1.smithi203.stdout:1/66: mknod d8/d9/c17 0 2024-09-11T00:06:59.942 INFO:tasks.workunit.client.1.smithi203.stdout:9/58: dwrite d6/de/df/d13/f15 [0,4194304] 0 2024-09-11T00:06:59.948 INFO:tasks.workunit.client.1.smithi203.stdout:1/67: symlink d8/d9/l18 0 2024-09-11T00:06:59.951 INFO:tasks.workunit.client.1.smithi203.stdout:7/123: dread f7 [0,4194304] 0 2024-09-11T00:06:59.952 INFO:tasks.workunit.client.1.smithi203.stdout:0/27: creat d0/d2/f8 x:0 0 0 2024-09-11T00:06:59.952 INFO:tasks.workunit.client.1.smithi203.stdout:3/69: link c7 d8/c1e 0 2024-09-11T00:06:59.953 INFO:tasks.workunit.client.1.smithi203.stdout:7/124: chown f7 752372 1 2024-09-11T00:06:59.958 INFO:tasks.workunit.client.1.smithi203.stdout:3/70: truncate d8/d17/f1c 113206 0 2024-09-11T00:06:59.959 INFO:tasks.workunit.client.1.smithi203.stdout:3/71: stat d8/da/cc 0 2024-09-11T00:06:59.962 INFO:tasks.workunit.client.1.smithi203.stdout:7/125: dread dd/f1e [0,4194304] 0 2024-09-11T00:06:59.965 INFO:tasks.workunit.client.1.smithi203.stdout:9/59: unlink d6/c8 0 2024-09-11T00:06:59.981 INFO:tasks.workunit.client.1.smithi203.stdout:9/60: link c2 d6/de/c17 0 2024-09-11T00:06:59.983 INFO:tasks.workunit.client.1.smithi203.stdout:9/61: rename d6/de/df to d6/de/df/d13/d18 22 2024-09-11T00:06:59.984 INFO:tasks.workunit.client.1.smithi203.stdout:9/62: chown d6/l16 0 1 2024-09-11T00:06:59.990 INFO:tasks.workunit.client.1.smithi203.stdout:9/63: rename d6/de/df to d6/de/d19 0 2024-09-11T00:06:59.991 INFO:tasks.workunit.client.1.smithi203.stdout:1/68: rmdir d8 39 2024-09-11T00:06:59.999 INFO:tasks.workunit.client.1.smithi203.stdout:1/69: mkdir d8/d19 0 2024-09-11T00:07:00.004 INFO:tasks.workunit.client.1.smithi203.stdout:1/70: creat d8/f1a x:0 0 0 2024-09-11T00:07:00.005 INFO:tasks.workunit.client.1.smithi203.stdout:3/72: write d8/f16 [548454,60532] 0 2024-09-11T00:07:00.009 INFO:tasks.workunit.client.1.smithi203.stdout:0/28: write d0/f5 [675509,95537] 0 2024-09-11T00:07:00.012 INFO:tasks.workunit.client.1.smithi203.stdout:9/64: dwrite d6/de/d19/d13/f15 [0,4194304] 0 2024-09-11T00:07:00.013 INFO:tasks.workunit.client.1.smithi203.stdout:0/29: write d0/d2/f3 [3786853,111561] 0 2024-09-11T00:07:00.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:06:59 smithi111 ceph-mon[27539]: pgmap v319: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 104 KiB/s rd, 14 MiB/s wr, 248 op/s 2024-09-11T00:07:00.172 INFO:tasks.workunit.client.1.smithi203.stdout:3/73: symlink d8/da/l1f 0 2024-09-11T00:07:00.179 INFO:tasks.workunit.client.1.smithi203.stdout:0/30: fsync d0/f7 0 2024-09-11T00:07:00.181 INFO:tasks.workunit.client.1.smithi203.stdout:1/71: creat d8/d19/f1b x:0 0 0 2024-09-11T00:07:00.185 INFO:tasks.workunit.client.1.smithi203.stdout:9/65: readlink d6/de/d19/l12 0 2024-09-11T00:07:00.189 INFO:tasks.workunit.client.1.smithi203.stdout:1/72: creat d8/d9/f1c x:0 0 0 2024-09-11T00:07:00.191 INFO:tasks.workunit.client.1.smithi203.stdout:1/73: stat d8/d9/f1c 0 2024-09-11T00:07:00.191 INFO:tasks.workunit.client.1.smithi203.stdout:3/74: getdents d8/da/d11 0 2024-09-11T00:07:00.193 INFO:tasks.workunit.client.1.smithi203.stdout:1/74: chown d8/f1a 0 1 2024-09-11T00:07:00.198 INFO:tasks.workunit.client.1.smithi203.stdout:0/31: dwrite d0/d2/f6 [0,4194304] 0 2024-09-11T00:07:00.205 INFO:tasks.workunit.client.1.smithi203.stdout:9/66: symlink d6/l1a 0 2024-09-11T00:07:00.213 INFO:tasks.workunit.client.1.smithi203.stdout:1/75: rename d8/d11/l16 to d8/d9/l1d 0 2024-09-11T00:07:00.215 INFO:tasks.workunit.client.1.smithi203.stdout:9/67: truncate d6/f14 1164127 0 2024-09-11T00:07:00.217 INFO:tasks.workunit.client.1.smithi203.stdout:1/76: creat d8/d9/f1e x:0 0 0 2024-09-11T00:07:00.221 INFO:tasks.workunit.client.1.smithi203.stdout:3/75: link l6 d8/da/l20 0 2024-09-11T00:07:00.222 INFO:tasks.workunit.client.1.smithi203.stdout:3/76: chown d8/l15 4064301 1 2024-09-11T00:07:00.224 INFO:tasks.workunit.client.1.smithi203.stdout:3/77: write d8/fb [537219,69699] 0 2024-09-11T00:07:00.225 INFO:tasks.workunit.client.1.smithi203.stdout:1/77: mknod d8/c1f 0 2024-09-11T00:07:00.226 INFO:tasks.workunit.client.1.smithi203.stdout:0/32: fdatasync d0/f5 0 2024-09-11T00:07:00.229 INFO:tasks.workunit.client.1.smithi203.stdout:0/33: write d0/d2/f3 [1438287,98987] 0 2024-09-11T00:07:00.247 INFO:tasks.workunit.client.1.smithi203.stdout:0/34: getdents d0/d2 0 2024-09-11T00:07:00.255 INFO:tasks.workunit.client.1.smithi203.stdout:9/68: dwrite f5 [0,4194304] 0 2024-09-11T00:07:00.255 INFO:tasks.workunit.client.1.smithi203.stdout:1/78: dwrite d8/d9/f1c [0,4194304] 0 2024-09-11T00:07:00.256 INFO:tasks.workunit.client.1.smithi203.stdout:3/78: truncate d8/fb 600766 0 2024-09-11T00:07:00.260 INFO:tasks.workunit.client.1.smithi203.stdout:5/93: sync 2024-09-11T00:07:00.264 INFO:tasks.workunit.client.1.smithi203.stdout:1/79: creat d8/d11/f20 x:0 0 0 2024-09-11T00:07:00.265 INFO:tasks.workunit.client.1.smithi203.stdout:0/35: dread d0/d2/f3 [0,4194304] 0 2024-09-11T00:07:00.266 INFO:tasks.workunit.client.1.smithi203.stdout:3/79: mknod d8/d17/c21 0 2024-09-11T00:07:00.267 INFO:tasks.workunit.client.1.smithi203.stdout:1/80: write d8/d19/f1b [142570,45049] 0 2024-09-11T00:07:00.278 INFO:tasks.workunit.client.1.smithi203.stdout:1/81: unlink d8/d9/fa 0 2024-09-11T00:07:00.281 INFO:tasks.workunit.client.1.smithi203.stdout:0/36: mknod d0/c9 0 2024-09-11T00:07:00.282 INFO:tasks.workunit.client.1.smithi203.stdout:1/82: write d8/f1a [429525,95080] 0 2024-09-11T00:07:00.284 INFO:tasks.workunit.client.1.smithi203.stdout:0/37: chown d0/c9 4568 1 2024-09-11T00:07:00.286 INFO:tasks.workunit.client.1.smithi203.stdout:5/94: getdents dc/dd/d15 0 2024-09-11T00:07:00.291 INFO:tasks.workunit.client.1.smithi203.stdout:9/69: dread d6/de/d19/d13/f15 [0,4194304] 0 2024-09-11T00:07:00.304 INFO:tasks.workunit.client.1.smithi203.stdout:0/38: dwrite d0/d2/f6 [0,4194304] 0 2024-09-11T00:07:00.310 INFO:tasks.workunit.client.1.smithi203.stdout:0/39: symlink d0/d2/la 0 2024-09-11T00:07:00.314 INFO:tasks.workunit.client.1.smithi203.stdout:0/40: read d0/d2/f3 [430658,108099] 0 2024-09-11T00:07:00.314 INFO:tasks.workunit.client.1.smithi203.stdout:9/70: dwrite f5 [0,4194304] 0 2024-09-11T00:07:00.316 INFO:tasks.workunit.client.1.smithi203.stdout:1/83: rmdir d8 39 2024-09-11T00:07:00.323 INFO:tasks.workunit.client.1.smithi203.stdout:3/80: dwrite d8/ff [0,4194304] 0 2024-09-11T00:07:00.324 INFO:tasks.workunit.client.1.smithi203.stdout:0/41: fsync d0/d2/f3 0 2024-09-11T00:07:00.328 INFO:tasks.workunit.client.1.smithi203.stdout:0/42: fdatasync d0/d2/f3 0 2024-09-11T00:07:00.330 INFO:tasks.workunit.client.1.smithi203.stdout:1/84: symlink d8/d11/l21 0 2024-09-11T00:07:00.333 INFO:tasks.workunit.client.1.smithi203.stdout:3/81: creat d8/f22 x:0 0 0 2024-09-11T00:07:00.337 INFO:tasks.workunit.client.1.smithi203.stdout:0/43: creat d0/d2/fb x:0 0 0 2024-09-11T00:07:00.337 INFO:tasks.workunit.client.1.smithi203.stdout:3/82: chown d8/c14 5 1 2024-09-11T00:07:00.341 INFO:tasks.workunit.client.1.smithi203.stdout:3/83: chown d8/da/d11 18070294 1 2024-09-11T00:07:00.341 INFO:tasks.workunit.client.1.smithi203.stdout:9/71: dwrite d6/f14 [0,4194304] 0 2024-09-11T00:07:00.341 INFO:tasks.workunit.client.1.smithi203.stdout:0/44: read d0/d2/f6 [1150653,5594] 0 2024-09-11T00:07:00.342 INFO:tasks.workunit.client.1.smithi203.stdout:1/85: creat d8/d9/d15/f22 x:0 0 0 2024-09-11T00:07:00.348 INFO:tasks.workunit.client.1.smithi203.stdout:0/45: rmdir d0 39 2024-09-11T00:07:00.351 INFO:tasks.workunit.client.1.smithi203.stdout:5/95: dwrite fa [0,4194304] 0 2024-09-11T00:07:00.358 INFO:tasks.workunit.client.1.smithi203.stdout:1/86: mknod d8/c23 0 2024-09-11T00:07:00.359 INFO:tasks.workunit.client.1.smithi203.stdout:0/46: dread - d0/d2/f8 zero size 2024-09-11T00:07:00.366 INFO:tasks.workunit.client.1.smithi203.stdout:2/14: sync 2024-09-11T00:07:00.394 INFO:tasks.workunit.client.1.smithi203.stdout:3/84: symlink d8/da/d11/l23 0 2024-09-11T00:07:00.399 INFO:tasks.workunit.client.1.smithi203.stdout:5/96: creat dc/dd/d13/f18 x:0 0 0 2024-09-11T00:07:00.401 INFO:tasks.workunit.client.1.smithi203.stdout:5/97: chown dc/dd/c17 19703229 1 2024-09-11T00:07:00.403 INFO:tasks.workunit.client.1.smithi203.stdout:2/15: symlink l5 0 2024-09-11T00:07:00.404 INFO:tasks.workunit.client.1.smithi203.stdout:2/16: fdatasync f0 0 2024-09-11T00:07:00.411 INFO:tasks.workunit.client.1.smithi203.stdout:5/98: truncate f5 5119485 0 2024-09-11T00:07:00.420 INFO:tasks.workunit.client.1.smithi203.stdout:5/99: creat dc/dd/d15/f19 x:0 0 0 2024-09-11T00:07:00.420 INFO:tasks.workunit.client.1.smithi203.stdout:2/17: dread f2 [0,4194304] 0 2024-09-11T00:07:00.430 INFO:tasks.workunit.client.1.smithi203.stdout:2/18: mknod c6 0 2024-09-11T00:07:00.431 INFO:tasks.workunit.client.1.smithi203.stdout:2/19: write f0 [3816644,119295] 0 2024-09-11T00:07:00.434 INFO:tasks.workunit.client.1.smithi203.stdout:2/20: write f0 [1184488,84251] 0 2024-09-11T00:07:00.435 INFO:tasks.workunit.client.1.smithi203.stdout:2/21: read - f4 zero size 2024-09-11T00:07:00.452 INFO:tasks.workunit.client.1.smithi203.stdout:9/72: dwrite d6/f14 [4194304,4194304] 0 2024-09-11T00:07:00.480 INFO:tasks.workunit.client.1.smithi203.stdout:9/73: dwrite d6/f14 [4194304,4194304] 0 2024-09-11T00:07:00.480 INFO:tasks.workunit.client.1.smithi203.stdout:9/74: chown d6/de/d19/d13 1405 1 2024-09-11T00:07:00.489 INFO:tasks.workunit.client.1.smithi203.stdout:9/75: unlink d6/de/f10 0 2024-09-11T00:07:00.510 INFO:tasks.workunit.client.1.smithi203.stdout:9/76: dwrite d6/de/d19/d13/f15 [0,4194304] 0 2024-09-11T00:07:00.515 INFO:tasks.workunit.client.1.smithi203.stdout:9/77: creat d6/de/d19/f1b x:0 0 0 2024-09-11T00:07:00.522 INFO:tasks.workunit.client.1.smithi203.stdout:1/87: rename d8/d9/l13 to d8/d11/l24 0 2024-09-11T00:07:00.522 INFO:tasks.workunit.client.1.smithi203.stdout:9/78: write d6/de/d19/f1b [930327,85042] 0 2024-09-11T00:07:00.524 INFO:tasks.workunit.client.1.smithi203.stdout:9/79: readlink d6/de/d19/l12 0 2024-09-11T00:07:00.527 INFO:tasks.workunit.client.1.smithi203.stdout:5/100: write dc/f12 [888092,21867] 0 2024-09-11T00:07:00.529 INFO:tasks.workunit.client.1.smithi203.stdout:9/80: truncate d6/de/d19/f1b 1959954 0 2024-09-11T00:07:00.535 INFO:tasks.workunit.client.1.smithi203.stdout:5/101: creat dc/dd/d13/f1a x:0 0 0 2024-09-11T00:07:00.535 INFO:tasks.workunit.client.1.smithi203.stdout:0/47: creat d0/fc x:0 0 0 2024-09-11T00:07:00.542 INFO:tasks.workunit.client.1.smithi203.stdout:9/81: link d6/de/d19/d13/f15 d6/de/d19/f1c 0 2024-09-11T00:07:00.546 INFO:tasks.workunit.client.1.smithi203.stdout:0/48: fdatasync d0/d2/f6 0 2024-09-11T00:07:00.559 INFO:tasks.workunit.client.1.smithi203.stdout:9/82: getdents d6 0 2024-09-11T00:07:00.560 INFO:tasks.workunit.client.1.smithi203.stdout:0/49: getdents d0/d2 0 2024-09-11T00:07:00.563 INFO:tasks.workunit.client.1.smithi203.stdout:0/50: fdatasync d0/d2/f6 0 2024-09-11T00:07:00.565 INFO:tasks.workunit.client.1.smithi203.stdout:0/51: dread - d0/d2/fb zero size 2024-09-11T00:07:00.568 INFO:tasks.workunit.client.0.smithi111.stdout:3/39: unlink fa 0 2024-09-11T00:07:00.569 INFO:tasks.workunit.client.0.smithi111.stdout:3/40: chown f8 7442094 1 2024-09-11T00:07:00.569 INFO:tasks.workunit.client.0.smithi111.stdout:9/41: creat d6/db/fd x:0 0 0 2024-09-11T00:07:00.570 INFO:tasks.workunit.client.0.smithi111.stdout:3/41: write f8 [4541349,76033] 0 2024-09-11T00:07:00.570 INFO:tasks.workunit.client.0.smithi111.stdout:9/42: chown d6/ca 3 1 2024-09-11T00:07:00.570 INFO:tasks.workunit.client.0.smithi111.stdout:0/20: creat d3/f7 x:0 0 0 2024-09-11T00:07:00.571 INFO:tasks.workunit.client.0.smithi111.stdout:2/39: symlink d0/d3/l8 0 2024-09-11T00:07:00.572 INFO:tasks.workunit.client.1.smithi203.stdout:9/83: link d6/de/d19/l12 d6/de/l1d 0 2024-09-11T00:07:00.572 INFO:tasks.workunit.client.0.smithi111.stdout:2/40: fsync d0/f2 0 2024-09-11T00:07:00.572 INFO:tasks.workunit.client.0.smithi111.stdout:0/21: dread f2 [0,4194304] 0 2024-09-11T00:07:00.573 INFO:tasks.workunit.client.0.smithi111.stdout:8/18: link c3 c4 0 2024-09-11T00:07:00.576 INFO:tasks.workunit.client.0.smithi111.stdout:5/29: symlink l9 0 2024-09-11T00:07:00.577 INFO:tasks.workunit.client.0.smithi111.stdout:3/42: creat fe x:0 0 0 2024-09-11T00:07:00.578 INFO:tasks.workunit.client.0.smithi111.stdout:3/43: chown f3 2940 1 2024-09-11T00:07:00.578 INFO:tasks.workunit.client.1.smithi203.stdout:9/84: symlink d6/de/l1e 0 2024-09-11T00:07:00.580 INFO:tasks.workunit.client.0.smithi111.stdout:8/19: mkdir d5 0 2024-09-11T00:07:00.580 INFO:tasks.workunit.client.0.smithi111.stdout:8/20: readlink - no filename 2024-09-11T00:07:00.581 INFO:tasks.workunit.client.0.smithi111.stdout:0/22: symlink d3/l8 0 2024-09-11T00:07:00.582 INFO:tasks.workunit.client.0.smithi111.stdout:8/21: write f1 [3706696,123607] 0 2024-09-11T00:07:00.584 INFO:tasks.workunit.client.0.smithi111.stdout:2/41: dread d0/f2 [4194304,4194304] 0 2024-09-11T00:07:00.584 INFO:tasks.workunit.client.0.smithi111.stdout:0/23: write d3/f5 [116112,75450] 0 2024-09-11T00:07:00.589 INFO:tasks.workunit.client.0.smithi111.stdout:5/30: link l9 la 0 2024-09-11T00:07:00.589 INFO:tasks.workunit.client.0.smithi111.stdout:9/43: dwrite d6/f9 [0,4194304] 0 2024-09-11T00:07:00.590 INFO:tasks.workunit.client.0.smithi111.stdout:8/22: rmdir d5 0 2024-09-11T00:07:00.595 INFO:tasks.workunit.client.0.smithi111.stdout:8/23: creat f6 x:0 0 0 2024-09-11T00:07:00.596 INFO:tasks.workunit.client.0.smithi111.stdout:2/42: rmdir d0/d3/d7 0 2024-09-11T00:07:00.597 INFO:tasks.workunit.client.0.smithi111.stdout:8/24: dread - f6 zero size 2024-09-11T00:07:00.599 INFO:tasks.workunit.client.0.smithi111.stdout:3/44: dwrite f9 [0,4194304] 0 2024-09-11T00:07:00.600 INFO:tasks.workunit.client.0.smithi111.stdout:8/25: read f1 [3867482,90727] 0 2024-09-11T00:07:00.603 INFO:tasks.workunit.client.1.smithi203.stdout:8/41: sync 2024-09-11T00:07:00.603 INFO:tasks.workunit.client.1.smithi203.stdout:7/126: sync 2024-09-11T00:07:00.603 INFO:tasks.workunit.client.1.smithi203.stdout:6/42: sync 2024-09-11T00:07:00.603 INFO:tasks.workunit.client.1.smithi203.stdout:4/34: sync 2024-09-11T00:07:00.608 INFO:tasks.workunit.client.0.smithi111.stdout:3/45: creat ff x:0 0 0 2024-09-11T00:07:00.615 INFO:tasks.workunit.client.1.smithi203.stdout:8/42: symlink d1/la 0 2024-09-11T00:07:00.619 INFO:tasks.workunit.client.1.smithi203.stdout:7/127: write dd/f13 [825730,2152] 0 2024-09-11T00:07:00.625 INFO:tasks.workunit.client.0.smithi111.stdout:5/31: dwrite f7 [0,4194304] 0 2024-09-11T00:07:00.626 INFO:tasks.workunit.client.1.smithi203.stdout:7/128: unlink dd/d1c/l24 0 2024-09-11T00:07:00.626 INFO:tasks.workunit.client.0.smithi111.stdout:9/44: dwrite d6/f9 [0,4194304] 0 2024-09-11T00:07:00.628 INFO:tasks.workunit.client.0.smithi111.stdout:2/43: dread d0/f4 [0,4194304] 0 2024-09-11T00:07:00.630 INFO:tasks.workunit.client.0.smithi111.stdout:2/44: chown d0 1715954 1 2024-09-11T00:07:00.631 INFO:tasks.workunit.client.1.smithi203.stdout:7/129: mkdir dd/d1c/d26/d31 0 2024-09-11T00:07:00.633 INFO:tasks.workunit.client.1.smithi203.stdout:7/130: fdatasync dd/d1c/f23 0 2024-09-11T00:07:00.634 INFO:tasks.workunit.client.0.smithi111.stdout:9/45: symlink d6/le 0 2024-09-11T00:07:00.641 INFO:tasks.workunit.client.0.smithi111.stdout:9/46: truncate d6/db/fd 884010 0 2024-09-11T00:07:00.642 INFO:tasks.workunit.client.0.smithi111.stdout:3/46: dwrite f3 [4194304,4194304] 0 2024-09-11T00:07:00.645 INFO:tasks.workunit.client.0.smithi111.stdout:5/32: rename la to lb 0 2024-09-11T00:07:00.651 INFO:tasks.workunit.client.0.smithi111.stdout:9/47: link d6/f9 d6/db/ff 0 2024-09-11T00:07:00.651 INFO:tasks.workunit.client.0.smithi111.stdout:2/45: dread d0/f2 [0,4194304] 0 2024-09-11T00:07:00.656 INFO:tasks.workunit.client.0.smithi111.stdout:2/46: mknod d0/d3/c9 0 2024-09-11T00:07:00.659 INFO:tasks.workunit.client.1.smithi203.stdout:5/102: symlink dc/l1b 0 2024-09-11T00:07:00.661 INFO:tasks.workunit.client.0.smithi111.stdout:3/47: dwrite f5 [0,4194304] 0 2024-09-11T00:07:00.662 INFO:tasks.workunit.client.0.smithi111.stdout:3/48: read - fe zero size 2024-09-11T00:07:00.663 INFO:tasks.workunit.client.1.smithi203.stdout:5/103: mknod dc/c1c 0 2024-09-11T00:07:00.664 INFO:tasks.workunit.client.0.smithi111.stdout:9/48: write d6/db/fd [1699,8808] 0 2024-09-11T00:07:00.668 INFO:tasks.workunit.client.0.smithi111.stdout:9/49: unlink f5 0 2024-09-11T00:07:00.670 INFO:tasks.workunit.client.0.smithi111.stdout:2/47: link d0/c5 d0/d3/ca 0 2024-09-11T00:07:00.675 INFO:tasks.workunit.client.0.smithi111.stdout:2/48: write d0/f4 [657714,119284] 0 2024-09-11T00:07:00.677 INFO:tasks.workunit.client.0.smithi111.stdout:9/50: unlink c3 0 2024-09-11T00:07:00.680 INFO:tasks.workunit.client.0.smithi111.stdout:3/49: dwrite f9 [0,4194304] 0 2024-09-11T00:07:00.680 INFO:tasks.workunit.client.0.smithi111.stdout:9/51: write d6/db/ff [3175965,10534] 0 2024-09-11T00:07:00.682 INFO:tasks.workunit.client.0.smithi111.stdout:3/50: write f9 [3459385,35772] 0 2024-09-11T00:07:00.683 INFO:tasks.workunit.client.0.smithi111.stdout:2/49: rename d0/d3/c9 to d0/cb 0 2024-09-11T00:07:00.686 INFO:tasks.workunit.client.0.smithi111.stdout:2/50: rmdir d0/d3 39 2024-09-11T00:07:00.692 INFO:tasks.workunit.client.0.smithi111.stdout:2/51: write d0/f2 [7287501,103793] 0 2024-09-11T00:07:00.694 INFO:tasks.workunit.client.0.smithi111.stdout:2/52: write d0/f2 [3106790,117573] 0 2024-09-11T00:07:00.696 INFO:tasks.workunit.client.1.smithi203.stdout:1/88: rename f4 to d8/d9/d15/f25 0 2024-09-11T00:07:00.699 INFO:tasks.workunit.client.1.smithi203.stdout:9/85: rename d6/cb to d6/de/d19/c1f 0 2024-09-11T00:07:00.699 INFO:tasks.workunit.client.0.smithi111.stdout:3/51: dread f9 [0,4194304] 0 2024-09-11T00:07:00.704 INFO:tasks.workunit.client.1.smithi203.stdout:5/104: rename dc/f12 to dc/dd/d15/f1d 0 2024-09-11T00:07:00.708 INFO:tasks.workunit.client.0.smithi111.stdout:2/53: link d0/f4 d0/fc 0 2024-09-11T00:07:00.709 INFO:tasks.workunit.client.1.smithi203.stdout:5/105: truncate dc/dd/d13/f14 176863 0 2024-09-11T00:07:00.711 INFO:tasks.workunit.client.1.smithi203.stdout:5/106: mkdir dc/dd/d1e 0 2024-09-11T00:07:00.713 INFO:tasks.workunit.client.1.smithi203.stdout:5/107: chown dc/dd/d15/f1d 314061762 1 2024-09-11T00:07:00.714 INFO:tasks.workunit.client.0.smithi111.stdout:3/52: dwrite f3 [0,4194304] 0 2024-09-11T00:07:00.715 INFO:tasks.workunit.client.0.smithi111.stdout:2/54: rename d0/f2 to d0/d3/fd 0 2024-09-11T00:07:00.719 INFO:tasks.workunit.client.1.smithi203.stdout:0/52: truncate d0/f5 1992853 0 2024-09-11T00:07:00.719 INFO:tasks.workunit.client.0.smithi111.stdout:3/53: chown ld 1703844930 1 2024-09-11T00:07:00.726 INFO:tasks.workunit.client.0.smithi111.stdout:2/55: dread d0/f4 [0,4194304] 0 2024-09-11T00:07:00.730 INFO:tasks.workunit.client.0.smithi111.stdout:3/54: dread f8 [0,4194304] 0 2024-09-11T00:07:00.733 INFO:tasks.workunit.client.0.smithi111.stdout:3/55: creat f10 x:0 0 0 2024-09-11T00:07:00.736 INFO:tasks.workunit.client.1.smithi203.stdout:5/108: dwrite dc/dd/d15/f1d [0,4194304] 0 2024-09-11T00:07:00.737 INFO:tasks.workunit.client.0.smithi111.stdout:0/24: write f0 [1008293,46840] 0 2024-09-11T00:07:00.741 INFO:tasks.workunit.client.0.smithi111.stdout:0/25: mkdir d3/d9 0 2024-09-11T00:07:00.749 INFO:tasks.workunit.client.0.smithi111.stdout:8/26: truncate f1 623714 0 2024-09-11T00:07:00.749 INFO:tasks.workunit.client.1.smithi203.stdout:6/43: truncate d0/f5 1316817 0 2024-09-11T00:07:00.749 INFO:tasks.workunit.client.0.smithi111.stdout:3/56: dwrite f8 [4194304,4194304] 0 2024-09-11T00:07:00.754 INFO:tasks.workunit.client.1.smithi203.stdout:6/44: creat d0/d6/fb x:0 0 0 2024-09-11T00:07:00.756 INFO:tasks.workunit.client.0.smithi111.stdout:5/33: write f1 [740017,6165] 0 2024-09-11T00:07:00.762 INFO:tasks.workunit.client.0.smithi111.stdout:0/26: dwrite d3/f5 [0,4194304] 0 2024-09-11T00:07:00.763 INFO:tasks.workunit.client.0.smithi111.stdout:3/57: dread f8 [4194304,4194304] 0 2024-09-11T00:07:00.764 INFO:tasks.workunit.client.1.smithi203.stdout:6/45: chown d0/c7 768643 1 2024-09-11T00:07:00.764 INFO:tasks.workunit.client.0.smithi111.stdout:3/58: chown f3 84 1 2024-09-11T00:07:00.765 INFO:tasks.workunit.client.0.smithi111.stdout:5/34: unlink lb 0 2024-09-11T00:07:00.765 INFO:tasks.workunit.client.1.smithi203.stdout:8/43: dwrite d1/f2 [4194304,4194304] 0 2024-09-11T00:07:00.766 INFO:tasks.workunit.client.0.smithi111.stdout:3/59: chown f10 21 1 2024-09-11T00:07:00.766 INFO:tasks.workunit.client.1.smithi203.stdout:6/46: dread - d0/d6/fb zero size 2024-09-11T00:07:00.767 INFO:tasks.workunit.client.0.smithi111.stdout:0/27: mkdir d3/da 0 2024-09-11T00:07:00.767 INFO:tasks.workunit.client.0.smithi111.stdout:3/60: chown f9 115 1 2024-09-11T00:07:00.768 INFO:tasks.workunit.client.0.smithi111.stdout:3/61: truncate ff 761237 0 2024-09-11T00:07:00.768 INFO:tasks.workunit.client.0.smithi111.stdout:0/28: truncate d3/f7 797632 0 2024-09-11T00:07:00.770 INFO:tasks.workunit.client.1.smithi203.stdout:5/109: dwrite dc/dd/d15/f1d [0,4194304] 0 2024-09-11T00:07:00.771 INFO:tasks.workunit.client.0.smithi111.stdout:3/62: creat f11 x:0 0 0 2024-09-11T00:07:00.774 INFO:tasks.workunit.client.1.smithi203.stdout:8/44: write d1/f3 [2869945,19805] 0 2024-09-11T00:07:00.775 INFO:tasks.workunit.client.1.smithi203.stdout:6/47: rmdir d0 39 2024-09-11T00:07:00.785 INFO:tasks.workunit.client.0.smithi111.stdout:5/35: creat fc x:0 0 0 2024-09-11T00:07:00.790 INFO:tasks.workunit.client.1.smithi203.stdout:1/89: dread d8/d9/d15/f25 [0,4194304] 0 2024-09-11T00:07:00.791 INFO:tasks.workunit.client.0.smithi111.stdout:2/56: getdents d0/d3 0 2024-09-11T00:07:00.801 INFO:tasks.workunit.client.0.smithi111.stdout:0/29: dwrite d3/f6 [0,4194304] 0 2024-09-11T00:07:00.805 INFO:tasks.workunit.client.1.smithi203.stdout:8/45: dwrite d1/f8 [0,4194304] 0 2024-09-11T00:07:00.805 INFO:tasks.workunit.client.0.smithi111.stdout:3/63: dwrite f11 [0,4194304] 0 2024-09-11T00:07:00.805 INFO:tasks.workunit.client.0.smithi111.stdout:3/64: write fb [603578,46574] 0 2024-09-11T00:07:00.809 INFO:tasks.workunit.client.0.smithi111.stdout:3/65: write ff [1439303,8013] 0 2024-09-11T00:07:00.809 INFO:tasks.workunit.client.0.smithi111.stdout:3/66: stat cc 0 2024-09-11T00:07:00.814 INFO:tasks.workunit.client.1.smithi203.stdout:9/86: dread d6/de/d19/d13/f15 [0,4194304] 0 2024-09-11T00:07:00.815 INFO:tasks.workunit.client.1.smithi203.stdout:5/110: fdatasync dc/dd/d15/f1d 0 2024-09-11T00:07:00.869 INFO:tasks.workunit.client.1.smithi203.stdout:3/85: sync 2024-09-11T00:07:00.875 INFO:tasks.workunit.client.0.smithi111.stdout:2/57: mkdir d0/d3/de 0 2024-09-11T00:07:00.883 INFO:tasks.workunit.client.1.smithi203.stdout:1/90: rename d8/f10 to d8/d19/f26 0 2024-09-11T00:07:00.884 INFO:tasks.workunit.client.0.smithi111.stdout:2/58: dread d0/d3/fd [0,4194304] 0 2024-09-11T00:07:00.887 INFO:tasks.workunit.client.0.smithi111.stdout:3/67: fsync f9 0 2024-09-11T00:07:00.888 INFO:tasks.workunit.client.1.smithi203.stdout:8/46: mkdir d1/db 0 2024-09-11T00:07:00.893 INFO:tasks.workunit.client.0.smithi111.stdout:0/30: mknod d3/d9/cb 0 2024-09-11T00:07:00.894 INFO:tasks.workunit.client.0.smithi111.stdout:8/27: write f1 [1526474,100846] 0 2024-09-11T00:07:00.895 INFO:tasks.workunit.client.0.smithi111.stdout:2/59: rename d0/d3/l8 to d0/d3/lf 0 2024-09-11T00:07:00.896 INFO:tasks.workunit.client.1.smithi203.stdout:0/53: truncate d0/d2/f6 774083 0 2024-09-11T00:07:00.896 INFO:tasks.workunit.client.1.smithi203.stdout:6/48: write d0/f5 [2206882,122737] 0 2024-09-11T00:07:00.897 INFO:tasks.workunit.client.0.smithi111.stdout:3/68: creat f12 x:0 0 0 2024-09-11T00:07:00.898 INFO:tasks.workunit.client.0.smithi111.stdout:3/69: write f10 [53182,110721] 0 2024-09-11T00:07:00.899 INFO:tasks.workunit.client.1.smithi203.stdout:6/49: dread d0/f8 [0,4194304] 0 2024-09-11T00:07:00.900 INFO:tasks.workunit.client.0.smithi111.stdout:5/36: getdents . 0 2024-09-11T00:07:00.901 INFO:tasks.workunit.client.0.smithi111.stdout:5/37: dread - f5 zero size 2024-09-11T00:07:00.901 INFO:tasks.workunit.client.0.smithi111.stdout:5/38: chown f7 60 1 2024-09-11T00:07:00.902 INFO:tasks.workunit.client.0.smithi111.stdout:0/31: mkdir d3/dc 0 2024-09-11T00:07:00.902 INFO:tasks.workunit.client.1.smithi203.stdout:1/91: fsync d8/d19/f26 0 2024-09-11T00:07:00.903 INFO:tasks.workunit.client.0.smithi111.stdout:0/32: chown d3/l8 15511 1 2024-09-11T00:07:00.903 INFO:tasks.workunit.client.0.smithi111.stdout:8/28: dread f2 [0,4194304] 0 2024-09-11T00:07:00.905 INFO:tasks.workunit.client.0.smithi111.stdout:5/39: dread f1 [0,4194304] 0 2024-09-11T00:07:00.906 INFO:tasks.workunit.client.0.smithi111.stdout:5/40: write f5 [808630,22204] 0 2024-09-11T00:07:00.907 INFO:tasks.workunit.client.0.smithi111.stdout:5/41: dread - fc zero size 2024-09-11T00:07:00.909 INFO:tasks.workunit.client.0.smithi111.stdout:2/60: readlink d0/d3/lf 0 2024-09-11T00:07:00.911 INFO:tasks.workunit.client.0.smithi111.stdout:5/42: dread f1 [0,4194304] 0 2024-09-11T00:07:00.912 INFO:tasks.workunit.client.0.smithi111.stdout:5/43: dread - fc zero size 2024-09-11T00:07:00.913 INFO:tasks.workunit.client.0.smithi111.stdout:0/33: dread f1 [0,4194304] 0 2024-09-11T00:07:00.914 INFO:tasks.workunit.client.1.smithi203.stdout:5/111: rename l6 to dc/dd/d15/l1f 0 2024-09-11T00:07:00.915 INFO:tasks.workunit.client.0.smithi111.stdout:8/29: rename f2 to f7 0 2024-09-11T00:07:00.918 INFO:tasks.workunit.client.1.smithi203.stdout:5/112: write dc/dd/d15/f19 [529148,52518] 0 2024-09-11T00:07:00.923 INFO:tasks.workunit.client.1.smithi203.stdout:9/87: creat d6/de/f20 x:0 0 0 2024-09-11T00:07:00.924 INFO:tasks.workunit.client.0.smithi111.stdout:5/44: creat fd x:0 0 0 2024-09-11T00:07:00.926 INFO:tasks.workunit.client.1.smithi203.stdout:1/92: dwrite d8/d9/f1e [0,4194304] 0 2024-09-11T00:07:00.926 INFO:tasks.workunit.client.0.smithi111.stdout:0/34: dwrite d3/f6 [0,4194304] 0 2024-09-11T00:07:00.928 INFO:tasks.workunit.client.1.smithi203.stdout:8/47: truncate d1/f2 7406168 0 2024-09-11T00:07:00.931 INFO:tasks.workunit.client.0.smithi111.stdout:8/30: rename f6 to f8 0 2024-09-11T00:07:00.933 INFO:tasks.workunit.client.1.smithi203.stdout:3/86: rename d8/da/l1f to d8/l24 0 2024-09-11T00:07:00.939 INFO:tasks.workunit.client.1.smithi203.stdout:6/50: link d0/d6/fb d0/d6/fc 0 2024-09-11T00:07:00.942 INFO:tasks.workunit.client.1.smithi203.stdout:3/87: truncate d8/d17/f1c 377597 0 2024-09-11T00:07:00.944 INFO:tasks.workunit.client.0.smithi111.stdout:3/70: getdents . 0 2024-09-11T00:07:00.945 INFO:tasks.workunit.client.0.smithi111.stdout:8/31: chown c3 0 1 2024-09-11T00:07:00.945 INFO:tasks.workunit.client.0.smithi111.stdout:3/71: write f3 [8865823,116736] 0 2024-09-11T00:07:00.946 INFO:tasks.workunit.client.0.smithi111.stdout:8/32: chown f7 22 1 2024-09-11T00:07:00.948 INFO:tasks.workunit.client.0.smithi111.stdout:3/72: dread f10 [0,4194304] 0 2024-09-11T00:07:00.951 INFO:tasks.workunit.client.1.smithi203.stdout:3/88: write d8/da/f19 [4011067,99695] 0 2024-09-11T00:07:00.952 INFO:tasks.workunit.client.1.smithi203.stdout:1/93: mkdir d8/d9/d15/d27 0 2024-09-11T00:07:00.957 INFO:tasks.workunit.client.1.smithi203.stdout:9/88: dwrite d6/de/f20 [0,4194304] 0 2024-09-11T00:07:00.960 INFO:tasks.workunit.client.1.smithi203.stdout:1/94: chown d8/d9/d15/f22 0 1 2024-09-11T00:07:00.969 INFO:tasks.workunit.client.1.smithi203.stdout:5/113: dread f8 [0,4194304] 0 2024-09-11T00:07:00.972 INFO:tasks.workunit.client.1.smithi203.stdout:3/89: mknod d8/c25 0 2024-09-11T00:07:00.974 INFO:tasks.workunit.client.1.smithi203.stdout:9/89: mkdir d6/de/d19/d21 0 2024-09-11T00:07:00.977 INFO:tasks.workunit.client.1.smithi203.stdout:8/48: rmdir d1/db 0 2024-09-11T00:07:00.984 INFO:tasks.workunit.client.1.smithi203.stdout:0/54: dwrite d0/d2/f6 [0,4194304] 0 2024-09-11T00:07:00.984 INFO:tasks.workunit.client.1.smithi203.stdout:5/114: symlink dc/l20 0 2024-09-11T00:07:00.992 INFO:tasks.workunit.client.1.smithi203.stdout:6/51: dwrite d0/f8 [0,4194304] 0 2024-09-11T00:07:00.998 INFO:tasks.workunit.client.1.smithi203.stdout:6/52: rename d0 to d0/dd 22 2024-09-11T00:07:00.998 INFO:tasks.workunit.client.1.smithi203.stdout:5/115: chown dc/dd/c17 0 1 2024-09-11T00:07:01.001 INFO:tasks.workunit.client.1.smithi203.stdout:3/90: chown d8/c1e 926896 1 2024-09-11T00:07:01.006 INFO:tasks.workunit.client.1.smithi203.stdout:8/49: rename d1/f3 to d1/fc 0 2024-09-11T00:07:01.011 INFO:tasks.workunit.client.1.smithi203.stdout:1/95: dwrite d8/d19/f1b [0,4194304] 0 2024-09-11T00:07:01.017 INFO:tasks.workunit.client.1.smithi203.stdout:0/55: dread d0/f5 [0,4194304] 0 2024-09-11T00:07:01.019 INFO:tasks.workunit.client.1.smithi203.stdout:6/53: symlink d0/d6/le 0 2024-09-11T00:07:01.020 INFO:tasks.workunit.client.1.smithi203.stdout:0/56: write d0/d2/fb [727219,4294] 0 2024-09-11T00:07:01.027 INFO:tasks.workunit.client.1.smithi203.stdout:3/91: mknod d8/da/c26 0 2024-09-11T00:07:01.033 INFO:tasks.workunit.client.1.smithi203.stdout:8/50: creat d1/fd x:0 0 0 2024-09-11T00:07:01.039 INFO:tasks.workunit.client.1.smithi203.stdout:9/90: creat d6/de/f22 x:0 0 0 2024-09-11T00:07:01.040 INFO:tasks.workunit.client.1.smithi203.stdout:6/54: mknod d0/cf 0 2024-09-11T00:07:01.043 INFO:tasks.workunit.client.1.smithi203.stdout:0/57: creat d0/d2/fd x:0 0 0 2024-09-11T00:07:01.046 INFO:tasks.workunit.client.1.smithi203.stdout:5/116: creat dc/dd/d1e/f21 x:0 0 0 2024-09-11T00:07:01.048 INFO:tasks.workunit.client.1.smithi203.stdout:8/51: creat d1/fe x:0 0 0 2024-09-11T00:07:01.049 INFO:tasks.workunit.client.0.smithi111.stdout:1/5: sync 2024-09-11T00:07:01.053 INFO:tasks.workunit.client.1.smithi203.stdout:1/96: unlink d8/d11/l24 0 2024-09-11T00:07:01.054 INFO:tasks.workunit.client.1.smithi203.stdout:6/55: dread d0/f8 [0,4194304] 0 2024-09-11T00:07:01.054 INFO:tasks.workunit.client.1.smithi203.stdout:8/52: dread d1/f9 [0,4194304] 0 2024-09-11T00:07:01.058 INFO:tasks.workunit.client.1.smithi203.stdout:0/58: dread d0/d2/f6 [0,4194304] 0 2024-09-11T00:07:01.064 INFO:tasks.workunit.client.1.smithi203.stdout:5/117: mknod dc/dd/c22 0 2024-09-11T00:07:01.077 INFO:tasks.workunit.client.1.smithi203.stdout:8/53: rename d1/la to d1/lf 0 2024-09-11T00:07:01.079 INFO:tasks.workunit.client.1.smithi203.stdout:1/97: dwrite d8/d9/d15/f22 [0,4194304] 0 2024-09-11T00:07:01.084 INFO:tasks.workunit.client.1.smithi203.stdout:1/98: chown d8/d11/f20 66538916 1 2024-09-11T00:07:01.085 INFO:tasks.workunit.client.1.smithi203.stdout:4/35: sync 2024-09-11T00:07:01.085 INFO:tasks.workunit.client.1.smithi203.stdout:2/22: sync 2024-09-11T00:07:01.085 INFO:tasks.workunit.client.1.smithi203.stdout:7/131: sync 2024-09-11T00:07:01.086 INFO:tasks.workunit.client.1.smithi203.stdout:7/132: readlink dd/l17 0 2024-09-11T00:07:01.086 INFO:tasks.workunit.client.1.smithi203.stdout:4/36: chown c3 8890998 1 2024-09-11T00:07:01.088 INFO:tasks.workunit.client.1.smithi203.stdout:1/99: write d8/d11/f20 [672382,112430] 0 2024-09-11T00:07:01.092 INFO:tasks.workunit.client.1.smithi203.stdout:3/92: getdents d8 0 2024-09-11T00:07:01.094 INFO:tasks.workunit.client.1.smithi203.stdout:8/54: rename d1/c5 to d1/c10 0 2024-09-11T00:07:01.095 INFO:tasks.workunit.client.1.smithi203.stdout:1/100: write d8/d9/d15/f22 [1827363,30116] 0 2024-09-11T00:07:01.099 INFO:tasks.workunit.client.1.smithi203.stdout:2/23: creat f7 x:0 0 0 2024-09-11T00:07:01.103 INFO:tasks.workunit.client.1.smithi203.stdout:1/101: read d8/d9/f1c [2945716,81850] 0 2024-09-11T00:07:01.112 INFO:tasks.workunit.client.1.smithi203.stdout:3/93: mknod d8/da/d11/c27 0 2024-09-11T00:07:01.112 INFO:tasks.workunit.client.1.smithi203.stdout:6/56: dwrite d0/d6/fc [0,4194304] 0 2024-09-11T00:07:01.116 INFO:tasks.workunit.client.1.smithi203.stdout:4/37: dread f2 [0,4194304] 0 2024-09-11T00:07:01.117 INFO:tasks.workunit.client.1.smithi203.stdout:9/91: truncate d6/f14 1347659 0 2024-09-11T00:07:01.118 INFO:tasks.workunit.client.1.smithi203.stdout:8/55: rename d1/f6 to d1/f11 0 2024-09-11T00:07:01.118 INFO:tasks.workunit.client.1.smithi203.stdout:4/38: dread - f6 zero size 2024-09-11T00:07:01.125 INFO:tasks.workunit.client.1.smithi203.stdout:7/133: write dd/f10 [4878196,54381] 0 2024-09-11T00:07:01.125 INFO:tasks.workunit.client.1.smithi203.stdout:2/24: creat f8 x:0 0 0 2024-09-11T00:07:01.127 INFO:tasks.workunit.client.1.smithi203.stdout:2/25: readlink l5 0 2024-09-11T00:07:01.127 INFO:tasks.workunit.client.1.smithi203.stdout:1/102: mkdir d8/d28 0 2024-09-11T00:07:01.131 INFO:tasks.workunit.client.1.smithi203.stdout:0/59: getdents d0 0 2024-09-11T00:07:01.135 INFO:tasks.workunit.client.1.smithi203.stdout:5/118: dwrite f5 [0,4194304] 0 2024-09-11T00:07:01.138 INFO:tasks.workunit.client.1.smithi203.stdout:3/94: mknod d8/d17/c28 0 2024-09-11T00:07:01.139 INFO:tasks.workunit.client.0.smithi111.stdout:4/34: sync 2024-09-11T00:07:01.139 INFO:tasks.workunit.client.0.smithi111.stdout:6/33: sync 2024-09-11T00:07:01.139 INFO:tasks.workunit.client.0.smithi111.stdout:9/52: sync 2024-09-11T00:07:01.139 INFO:tasks.workunit.client.0.smithi111.stdout:7/42: sync 2024-09-11T00:07:01.139 INFO:tasks.workunit.client.0.smithi111.stdout:9/53: stat d6 0 2024-09-11T00:07:01.140 INFO:tasks.workunit.client.1.smithi203.stdout:6/57: creat d0/f10 x:0 0 0 2024-09-11T00:07:01.140 INFO:tasks.workunit.client.1.smithi203.stdout:5/119: readlink l9 0 2024-09-11T00:07:01.141 INFO:tasks.workunit.client.1.smithi203.stdout:6/58: chown d0/c9 9213708 1 2024-09-11T00:07:01.143 INFO:tasks.workunit.client.1.smithi203.stdout:5/120: write dc/dd/d13/f1a [596514,125567] 0 2024-09-11T00:07:01.144 INFO:tasks.workunit.client.0.smithi111.stdout:9/54: dread d6/db/fd [0,4194304] 0 2024-09-11T00:07:01.146 INFO:tasks.workunit.client.1.smithi203.stdout:4/39: unlink l7 0 2024-09-11T00:07:01.146 INFO:tasks.workunit.client.0.smithi111.stdout:9/55: read d6/db/fd [248565,63573] 0 2024-09-11T00:07:01.148 INFO:tasks.workunit.client.1.smithi203.stdout:8/56: rename d1/fd to d1/f12 0 2024-09-11T00:07:01.149 INFO:tasks.workunit.client.1.smithi203.stdout:4/40: write f6 [981092,26383] 0 2024-09-11T00:07:01.153 INFO:tasks.workunit.client.1.smithi203.stdout:7/134: rename f7 to dd/d1c/f32 0 2024-09-11T00:07:01.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:00 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:07:01.155 INFO:tasks.workunit.client.1.smithi203.stdout:1/103: unlink d8/d9/l12 0 2024-09-11T00:07:01.159 INFO:tasks.workunit.client.1.smithi203.stdout:3/95: dwrite d8/f16 [0,4194304] 0 2024-09-11T00:07:01.162 INFO:tasks.workunit.client.1.smithi203.stdout:0/60: rename d0/d2/f6 to d0/d2/fe 0 2024-09-11T00:07:01.162 INFO:tasks.workunit.client.1.smithi203.stdout:3/96: write d8/d17/f1c [558547,93885] 0 2024-09-11T00:07:01.164 INFO:tasks.workunit.client.1.smithi203.stdout:3/97: chown d8/da/f19 94928 1 2024-09-11T00:07:01.168 INFO:tasks.workunit.client.1.smithi203.stdout:1/104: dread d8/f1a [0,4194304] 0 2024-09-11T00:07:01.173 INFO:tasks.workunit.client.1.smithi203.stdout:4/41: creat f9 x:0 0 0 2024-09-11T00:07:01.175 INFO:tasks.workunit.client.1.smithi203.stdout:0/61: dread d0/d2/f3 [0,4194304] 0 2024-09-11T00:07:01.176 INFO:tasks.workunit.client.1.smithi203.stdout:0/62: stat d0/d2/fe 0 2024-09-11T00:07:01.178 INFO:tasks.workunit.client.1.smithi203.stdout:3/98: fsync d8/d17/f1c 0 2024-09-11T00:07:01.180 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:00 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:07:01.183 INFO:tasks.workunit.client.1.smithi203.stdout:5/121: rename fa to dc/dd/d15/f23 0 2024-09-11T00:07:01.183 INFO:tasks.workunit.client.1.smithi203.stdout:8/57: dread d1/f2 [4194304,4194304] 0 2024-09-11T00:07:01.184 INFO:tasks.workunit.client.1.smithi203.stdout:7/135: dread dd/f1e [0,4194304] 0 2024-09-11T00:07:01.195 INFO:tasks.workunit.client.1.smithi203.stdout:1/105: mkdir d8/d11/d29 0 2024-09-11T00:07:01.195 INFO:tasks.workunit.client.1.smithi203.stdout:0/63: symlink d0/lf 0 2024-09-11T00:07:01.202 INFO:tasks.workunit.client.1.smithi203.stdout:5/122: truncate f8 2455627 0 2024-09-11T00:07:01.203 INFO:tasks.workunit.client.1.smithi203.stdout:7/136: truncate dd/f22 204921 0 2024-09-11T00:07:01.203 INFO:tasks.workunit.client.0.smithi111.stdout:2/61: sync 2024-09-11T00:07:01.205 INFO:tasks.workunit.client.1.smithi203.stdout:4/42: dwrite f9 [0,4194304] 0 2024-09-11T00:07:01.218 INFO:tasks.workunit.client.1.smithi203.stdout:3/99: dwrite d8/f22 [0,4194304] 0 2024-09-11T00:07:01.220 INFO:tasks.workunit.client.1.smithi203.stdout:3/100: stat d8/da 0 2024-09-11T00:07:01.231 INFO:tasks.workunit.client.1.smithi203.stdout:4/43: creat fa x:0 0 0 2024-09-11T00:07:01.248 INFO:tasks.workunit.client.1.smithi203.stdout:7/137: getdents dd 0 2024-09-11T00:07:01.252 INFO:tasks.workunit.client.1.smithi203.stdout:3/101: dwrite d8/d17/f1c [0,4194304] 0 2024-09-11T00:07:01.253 INFO:tasks.workunit.client.1.smithi203.stdout:7/138: stat dd/d1c/d26/d31 0 2024-09-11T00:07:01.270 INFO:tasks.workunit.client.1.smithi203.stdout:4/44: dwrite f6 [0,4194304] 0 2024-09-11T00:07:01.270 INFO:tasks.workunit.client.1.smithi203.stdout:4/45: rmdir - no directory 2024-09-11T00:07:01.280 INFO:tasks.workunit.client.1.smithi203.stdout:4/46: mkdir db 0 2024-09-11T00:07:01.282 INFO:tasks.workunit.client.1.smithi203.stdout:4/47: chown c3 76148188 1 2024-09-11T00:07:01.284 INFO:tasks.workunit.client.1.smithi203.stdout:7/139: dread dd/f18 [0,4194304] 0 2024-09-11T00:07:01.285 INFO:tasks.workunit.client.1.smithi203.stdout:3/102: dwrite d8/f16 [0,4194304] 0 2024-09-11T00:07:01.294 INFO:tasks.workunit.client.1.smithi203.stdout:5/123: dread f8 [0,4194304] 0 2024-09-11T00:07:01.299 INFO:tasks.workunit.client.1.smithi203.stdout:5/124: write dc/dd/d13/f1a [1356283,117707] 0 2024-09-11T00:07:01.306 INFO:tasks.workunit.client.1.smithi203.stdout:8/58: truncate d1/f11 3204102 0 2024-09-11T00:07:01.310 INFO:tasks.workunit.client.1.smithi203.stdout:4/48: dread f6 [0,4194304] 0 2024-09-11T00:07:01.310 INFO:tasks.workunit.client.1.smithi203.stdout:3/103: creat d8/f29 x:0 0 0 2024-09-11T00:07:01.314 INFO:tasks.workunit.client.1.smithi203.stdout:4/49: write f2 [2507691,76287] 0 2024-09-11T00:07:01.316 INFO:tasks.workunit.client.1.smithi203.stdout:0/64: dwrite d0/f7 [0,4194304] 0 2024-09-11T00:07:01.319 INFO:tasks.workunit.client.1.smithi203.stdout:3/104: dread d8/fb [0,4194304] 0 2024-09-11T00:07:01.329 INFO:tasks.workunit.client.1.smithi203.stdout:1/106: dwrite d8/d9/fd [0,4194304] 0 2024-09-11T00:07:01.335 INFO:tasks.workunit.client.1.smithi203.stdout:8/59: fdatasync d1/f9 0 2024-09-11T00:07:01.381 INFO:tasks.workunit.client.1.smithi203.stdout:3/105: mkdir d8/d2a 0 2024-09-11T00:07:01.382 INFO:tasks.workunit.client.1.smithi203.stdout:3/106: fdatasync d8/f22 0 2024-09-11T00:07:01.384 INFO:tasks.workunit.client.1.smithi203.stdout:4/50: rename c3 to db/cc 0 2024-09-11T00:07:01.385 INFO:tasks.workunit.client.1.smithi203.stdout:4/51: fdatasync f9 0 2024-09-11T00:07:01.385 INFO:tasks.workunit.client.1.smithi203.stdout:0/65: rename d0/d2 to d0/d2/d10 22 2024-09-11T00:07:01.388 INFO:tasks.workunit.client.1.smithi203.stdout:0/66: fdatasync d0/d2/f8 0 2024-09-11T00:07:01.389 INFO:tasks.workunit.client.1.smithi203.stdout:1/107: creat d8/f2a x:0 0 0 2024-09-11T00:07:01.392 INFO:tasks.workunit.client.1.smithi203.stdout:8/60: mkdir d1/d13 0 2024-09-11T00:07:01.399 INFO:tasks.workunit.client.1.smithi203.stdout:4/52: dread f1 [0,4194304] 0 2024-09-11T00:07:01.400 INFO:tasks.workunit.client.1.smithi203.stdout:3/107: rename d8/c12 to d8/c2b 0 2024-09-11T00:07:01.410 INFO:tasks.workunit.client.1.smithi203.stdout:1/108: dwrite d8/f2a [0,4194304] 0 2024-09-11T00:07:01.414 INFO:tasks.workunit.client.1.smithi203.stdout:8/61: mknod d1/c14 0 2024-09-11T00:07:01.415 INFO:tasks.workunit.client.1.smithi203.stdout:8/62: rename d1 to d1/d13/d15 22 2024-09-11T00:07:01.417 INFO:tasks.workunit.client.1.smithi203.stdout:3/108: stat l6 0 2024-09-11T00:07:01.418 INFO:tasks.workunit.client.1.smithi203.stdout:3/109: chown l6 12512 1 2024-09-11T00:07:01.425 INFO:tasks.workunit.client.1.smithi203.stdout:5/125: link dc/dd/d15/l1f dc/dd/d1e/l24 0 2024-09-11T00:07:01.430 INFO:tasks.workunit.client.1.smithi203.stdout:4/53: stat db/cc 0 2024-09-11T00:07:01.435 INFO:tasks.workunit.client.1.smithi203.stdout:3/110: creat d8/f2c x:0 0 0 2024-09-11T00:07:01.437 INFO:tasks.workunit.client.1.smithi203.stdout:1/109: mkdir d8/d11/d29/d2b 0 2024-09-11T00:07:01.442 INFO:tasks.workunit.client.1.smithi203.stdout:4/54: mkdir db/dd 0 2024-09-11T00:07:01.448 INFO:tasks.workunit.client.1.smithi203.stdout:3/111: creat d8/f2d x:0 0 0 2024-09-11T00:07:01.449 INFO:tasks.workunit.client.1.smithi203.stdout:0/67: dwrite d0/f5 [4194304,4194304] 0 2024-09-11T00:07:01.450 INFO:tasks.workunit.client.1.smithi203.stdout:3/112: chown d8/da/cc 2038018 1 2024-09-11T00:07:01.451 INFO:tasks.workunit.client.1.smithi203.stdout:3/113: stat d8/l15 0 2024-09-11T00:07:01.461 INFO:tasks.workunit.client.1.smithi203.stdout:8/63: link d1/f9 d1/f16 0 2024-09-11T00:07:01.465 INFO:tasks.workunit.client.1.smithi203.stdout:0/68: dread d0/d2/fb [0,4194304] 0 2024-09-11T00:07:01.468 INFO:tasks.workunit.client.1.smithi203.stdout:5/126: truncate dc/dd/d15/f1d 2267469 0 2024-09-11T00:07:01.485 INFO:tasks.workunit.client.1.smithi203.stdout:0/69: mknod d0/c11 0 2024-09-11T00:07:01.508 INFO:tasks.workunit.client.1.smithi203.stdout:3/114: dwrite d8/ff [4194304,4194304] 0 2024-09-11T00:07:01.511 INFO:tasks.workunit.client.1.smithi203.stdout:0/70: write d0/d2/fe [4250900,126318] 0 2024-09-11T00:07:01.511 INFO:tasks.workunit.client.1.smithi203.stdout:1/110: dwrite d8/d9/f1c [4194304,4194304] 0 2024-09-11T00:07:01.521 INFO:tasks.workunit.client.1.smithi203.stdout:8/64: dwrite d1/fe [0,4194304] 0 2024-09-11T00:07:01.523 INFO:tasks.workunit.client.1.smithi203.stdout:3/115: mknod d8/da/c2e 0 2024-09-11T00:07:01.529 INFO:tasks.workunit.client.1.smithi203.stdout:5/127: dwrite f5 [4194304,4194304] 0 2024-09-11T00:07:01.536 INFO:tasks.workunit.client.1.smithi203.stdout:0/71: creat d0/d2/f12 x:0 0 0 2024-09-11T00:07:01.536 INFO:tasks.workunit.client.1.smithi203.stdout:4/55: dwrite f1 [0,4194304] 0 2024-09-11T00:07:01.539 INFO:tasks.workunit.client.1.smithi203.stdout:1/111: unlink d8/f2a 0 2024-09-11T00:07:01.543 INFO:tasks.workunit.client.1.smithi203.stdout:3/116: creat d8/da/f2f x:0 0 0 2024-09-11T00:07:01.556 INFO:tasks.workunit.client.1.smithi203.stdout:1/112: mknod d8/d9/d15/c2c 0 2024-09-11T00:07:01.558 INFO:tasks.workunit.client.1.smithi203.stdout:8/65: mkdir d1/d13/d17 0 2024-09-11T00:07:01.561 INFO:tasks.workunit.client.1.smithi203.stdout:3/117: rename d8/l15 to d8/d17/l30 0 2024-09-11T00:07:01.561 INFO:tasks.workunit.client.1.smithi203.stdout:3/118: chown d8/da 3100 1 2024-09-11T00:07:01.567 INFO:tasks.workunit.client.1.smithi203.stdout:4/56: getdents db/dd 0 2024-09-11T00:07:01.568 INFO:tasks.workunit.client.1.smithi203.stdout:4/57: chown c8 0 1 2024-09-11T00:07:01.568 INFO:tasks.workunit.client.1.smithi203.stdout:0/72: link d0/d2/f3 d0/d2/f13 0 2024-09-11T00:07:01.568 INFO:tasks.workunit.client.0.smithi111.stdout:0/35: getdents d3/dc 0 2024-09-11T00:07:01.569 INFO:tasks.workunit.client.1.smithi203.stdout:4/58: chown db/cc 23303341 1 2024-09-11T00:07:01.570 INFO:tasks.workunit.client.1.smithi203.stdout:1/113: mknod d8/d19/c2d 0 2024-09-11T00:07:01.578 INFO:tasks.workunit.client.0.smithi111.stdout:8/33: rename f1 to f9 0 2024-09-11T00:07:01.579 INFO:tasks.workunit.client.0.smithi111.stdout:5/45: dwrite f1 [0,4194304] 0 2024-09-11T00:07:01.583 INFO:tasks.workunit.client.1.smithi203.stdout:1/114: dread d8/d9/fd [0,4194304] 0 2024-09-11T00:07:01.585 INFO:tasks.workunit.client.0.smithi111.stdout:1/6: symlink l1 0 2024-09-11T00:07:01.585 INFO:tasks.workunit.client.0.smithi111.stdout:1/7: fsync - no filename 2024-09-11T00:07:01.586 INFO:tasks.workunit.client.1.smithi203.stdout:1/115: write d8/d19/f26 [840838,46316] 0 2024-09-11T00:07:01.586 INFO:tasks.workunit.client.0.smithi111.stdout:1/8: stat l0 0 2024-09-11T00:07:01.587 INFO:tasks.workunit.client.0.smithi111.stdout:0/36: dwrite d3/f6 [0,4194304] 0 2024-09-11T00:07:01.589 INFO:tasks.workunit.client.0.smithi111.stdout:7/43: unlink f1 0 2024-09-11T00:07:01.590 INFO:tasks.workunit.client.0.smithi111.stdout:7/44: write f6 [9216543,92125] 0 2024-09-11T00:07:01.591 INFO:tasks.workunit.client.0.smithi111.stdout:6/34: creat d7/f9 x:0 0 0 2024-09-11T00:07:01.592 INFO:tasks.workunit.client.0.smithi111.stdout:8/34: dread f7 [0,4194304] 0 2024-09-11T00:07:01.598 INFO:tasks.workunit.client.0.smithi111.stdout:4/35: rename l3 to lc 0 2024-09-11T00:07:01.600 INFO:tasks.workunit.client.1.smithi203.stdout:8/66: truncate d1/f9 1475307 0 2024-09-11T00:07:01.608 INFO:tasks.workunit.client.1.smithi203.stdout:5/128: getdents dc/dd/d15 0 2024-09-11T00:07:01.609 INFO:tasks.workunit.client.0.smithi111.stdout:4/36: dwrite f9 [0,4194304] 0 2024-09-11T00:07:01.610 INFO:tasks.workunit.client.0.smithi111.stdout:4/37: chown l4 169186460 1 2024-09-11T00:07:01.613 INFO:tasks.workunit.client.1.smithi203.stdout:1/116: write d8/d19/f1b [2837395,15802] 0 2024-09-11T00:07:01.621 INFO:tasks.workunit.client.1.smithi203.stdout:4/59: creat db/dd/fe x:0 0 0 2024-09-11T00:07:01.628 INFO:tasks.workunit.client.1.smithi203.stdout:8/67: write d1/f12 [947924,43991] 0 2024-09-11T00:07:01.631 INFO:tasks.workunit.client.1.smithi203.stdout:5/129: creat dc/dd/d15/f25 x:0 0 0 2024-09-11T00:07:01.634 INFO:tasks.workunit.client.0.smithi111.stdout:3/73: link f12 f13 0 2024-09-11T00:07:01.641 INFO:tasks.workunit.client.0.smithi111.stdout:0/37: rename d3/f5 to d3/fd 0 2024-09-11T00:07:01.643 INFO:tasks.workunit.client.0.smithi111.stdout:3/74: dread f11 [0,4194304] 0 2024-09-11T00:07:01.643 INFO:tasks.workunit.client.1.smithi203.stdout:5/130: symlink dc/dd/l26 0 2024-09-11T00:07:01.645 INFO:tasks.workunit.client.1.smithi203.stdout:0/73: link d0/c9 d0/d2/c14 0 2024-09-11T00:07:01.650 INFO:tasks.workunit.client.0.smithi111.stdout:6/35: symlink d7/la 0 2024-09-11T00:07:01.651 INFO:tasks.workunit.client.1.smithi203.stdout:4/60: dwrite db/dd/fe [0,4194304] 0 2024-09-11T00:07:01.651 INFO:tasks.workunit.client.0.smithi111.stdout:6/36: dread - f3 zero size 2024-09-11T00:07:01.652 INFO:tasks.workunit.client.0.smithi111.stdout:8/35: write f7 [641310,94611] 0 2024-09-11T00:07:01.652 INFO:tasks.workunit.client.1.smithi203.stdout:4/61: dread - fa zero size 2024-09-11T00:07:01.658 INFO:tasks.workunit.client.0.smithi111.stdout:9/56: mknod d6/dc/c10 0 2024-09-11T00:07:01.660 INFO:tasks.workunit.client.1.smithi203.stdout:5/131: creat dc/dd/d1e/f27 x:0 0 0 2024-09-11T00:07:01.664 INFO:tasks.workunit.client.0.smithi111.stdout:2/62: mknod d0/c10 0 2024-09-11T00:07:01.665 INFO:tasks.workunit.client.1.smithi203.stdout:3/119: truncate d8/d17/f1c 2623949 0 2024-09-11T00:07:01.669 INFO:tasks.workunit.client.1.smithi203.stdout:0/74: creat d0/f15 x:0 0 0 2024-09-11T00:07:01.672 INFO:tasks.workunit.client.1.smithi203.stdout:8/68: dwrite d1/fc [4194304,4194304] 0 2024-09-11T00:07:01.672 INFO:tasks.workunit.client.0.smithi111.stdout:4/38: rename c6 to cd 0 2024-09-11T00:07:01.680 INFO:tasks.workunit.client.1.smithi203.stdout:3/120: symlink d8/l31 0 2024-09-11T00:07:01.680 INFO:tasks.workunit.client.1.smithi203.stdout:4/62: dread f6 [0,4194304] 0 2024-09-11T00:07:01.683 INFO:tasks.workunit.client.0.smithi111.stdout:5/46: mknod ce 0 2024-09-11T00:07:01.685 INFO:tasks.workunit.client.1.smithi203.stdout:5/132: dread dc/dd/d15/f23 [0,4194304] 0 2024-09-11T00:07:01.692 INFO:tasks.workunit.client.0.smithi111.stdout:5/47: dread f1 [0,4194304] 0 2024-09-11T00:07:01.692 INFO:tasks.workunit.client.1.smithi203.stdout:8/69: symlink d1/l18 0 2024-09-11T00:07:01.697 INFO:tasks.workunit.client.1.smithi203.stdout:4/63: mknod db/cf 0 2024-09-11T00:07:01.701 INFO:tasks.workunit.client.0.smithi111.stdout:3/75: mknod c14 0 2024-09-11T00:07:01.704 INFO:tasks.workunit.client.0.smithi111.stdout:7/45: symlink dd/le 0 2024-09-11T00:07:01.704 INFO:tasks.workunit.client.0.smithi111.stdout:7/46: stat dd 0 2024-09-11T00:07:01.707 INFO:tasks.workunit.client.0.smithi111.stdout:6/37: creat d7/fb x:0 0 0 2024-09-11T00:07:01.709 INFO:tasks.workunit.client.1.smithi203.stdout:8/70: creat d1/d13/f19 x:0 0 0 2024-09-11T00:07:01.710 INFO:tasks.workunit.client.0.smithi111.stdout:8/36: mknod ca 0 2024-09-11T00:07:01.710 INFO:tasks.workunit.client.0.smithi111.stdout:8/37: fdatasync f7 0 2024-09-11T00:07:01.711 INFO:tasks.workunit.client.1.smithi203.stdout:8/71: write d1/f8 [3611852,102773] 0 2024-09-11T00:07:01.711 INFO:tasks.workunit.client.1.smithi203.stdout:8/72: readlink d1/l7 0 2024-09-11T00:07:01.714 INFO:tasks.workunit.client.0.smithi111.stdout:9/57: unlink d6/f9 0 2024-09-11T00:07:01.715 INFO:tasks.workunit.client.1.smithi203.stdout:4/64: rmdir db 39 2024-09-11T00:07:01.719 INFO:tasks.workunit.client.0.smithi111.stdout:4/39: creat fe x:0 0 0 2024-09-11T00:07:01.726 INFO:tasks.workunit.client.0.smithi111.stdout:5/48: fdatasync fc 0 2024-09-11T00:07:01.726 INFO:tasks.workunit.client.0.smithi111.stdout:5/49: fdatasync f2 0 2024-09-11T00:07:01.727 INFO:tasks.workunit.client.0.smithi111.stdout:5/50: write f2 [2101459,38091] 0 2024-09-11T00:07:01.729 INFO:tasks.workunit.client.1.smithi203.stdout:0/75: link d0/d2/la d0/l16 0 2024-09-11T00:07:01.730 INFO:tasks.workunit.client.0.smithi111.stdout:3/76: rename fe to f15 0 2024-09-11T00:07:01.731 INFO:tasks.workunit.client.0.smithi111.stdout:3/77: write f2 [549743,62491] 0 2024-09-11T00:07:01.734 INFO:tasks.workunit.client.1.smithi203.stdout:8/73: fsync d1/f11 0 2024-09-11T00:07:01.737 INFO:tasks.workunit.client.1.smithi203.stdout:4/65: dwrite f2 [0,4194304] 0 2024-09-11T00:07:01.738 INFO:tasks.workunit.client.0.smithi111.stdout:6/38: mknod d7/cc 0 2024-09-11T00:07:01.739 INFO:tasks.workunit.client.0.smithi111.stdout:6/39: write f3 [301883,14578] 0 2024-09-11T00:07:01.739 INFO:tasks.workunit.client.0.smithi111.stdout:6/40: chown f0 6048 1 2024-09-11T00:07:01.740 INFO:tasks.workunit.client.0.smithi111.stdout:6/41: read f0 [2319256,119431] 0 2024-09-11T00:07:01.741 INFO:tasks.workunit.client.1.smithi203.stdout:8/74: read d1/f12 [822414,110298] 0 2024-09-11T00:07:01.749 INFO:tasks.workunit.client.1.smithi203.stdout:3/121: truncate d8/ff 6522579 0 2024-09-11T00:07:01.749 INFO:tasks.workunit.client.1.smithi203.stdout:0/76: mknod d0/c17 0 2024-09-11T00:07:01.751 INFO:tasks.workunit.client.1.smithi203.stdout:3/122: chown d8/c1e 8875843 1 2024-09-11T00:07:01.752 INFO:tasks.workunit.client.1.smithi203.stdout:5/133: truncate f5 4114383 0 2024-09-11T00:07:01.757 INFO:tasks.workunit.client.1.smithi203.stdout:9/92: sync 2024-09-11T00:07:01.759 INFO:tasks.workunit.client.0.smithi111.stdout:9/58: mknod d6/c11 0 2024-09-11T00:07:01.761 INFO:tasks.workunit.client.0.smithi111.stdout:8/38: dwrite f9 [0,4194304] 0 2024-09-11T00:07:01.762 INFO:tasks.workunit.client.0.smithi111.stdout:8/39: write f7 [1684135,46086] 0 2024-09-11T00:07:01.763 INFO:tasks.workunit.client.1.smithi203.stdout:9/93: truncate d6/de/d19/f1b 2714304 0 2024-09-11T00:07:01.763 INFO:tasks.workunit.client.0.smithi111.stdout:2/63: creat d0/d3/de/f11 x:0 0 0 2024-09-11T00:07:01.765 INFO:tasks.workunit.client.1.smithi203.stdout:8/75: dwrite d1/fe [4194304,4194304] 0 2024-09-11T00:07:01.767 INFO:tasks.workunit.client.1.smithi203.stdout:8/76: write d1/fc [3846513,81549] 0 2024-09-11T00:07:01.771 INFO:tasks.workunit.client.0.smithi111.stdout:4/40: mknod cf 0 2024-09-11T00:07:01.774 INFO:tasks.workunit.client.0.smithi111.stdout:4/41: write fb [1532395,14302] 0 2024-09-11T00:07:01.774 INFO:tasks.workunit.client.1.smithi203.stdout:3/123: symlink d8/d17/l32 0 2024-09-11T00:07:01.774 INFO:tasks.workunit.client.1.smithi203.stdout:5/134: creat dc/dd/f28 x:0 0 0 2024-09-11T00:07:01.776 INFO:tasks.workunit.client.0.smithi111.stdout:4/42: fsync f7 0 2024-09-11T00:07:01.776 INFO:tasks.workunit.client.1.smithi203.stdout:3/124: fdatasync d8/f22 0 2024-09-11T00:07:01.778 INFO:tasks.workunit.client.0.smithi111.stdout:1/9: getdents . 0 2024-09-11T00:07:01.778 INFO:tasks.workunit.client.0.smithi111.stdout:1/10: readlink l1 0 2024-09-11T00:07:01.778 INFO:tasks.workunit.client.0.smithi111.stdout:1/11: read - no filename 2024-09-11T00:07:01.778 INFO:tasks.workunit.client.0.smithi111.stdout:1/12: read - no filename 2024-09-11T00:07:01.778 INFO:tasks.workunit.client.0.smithi111.stdout:1/13: fdatasync - no filename 2024-09-11T00:07:01.783 INFO:tasks.workunit.client.0.smithi111.stdout:2/64: dwrite d0/d3/de/f11 [0,4194304] 0 2024-09-11T00:07:01.783 INFO:tasks.workunit.client.0.smithi111.stdout:0/38: link d3/d9/cb d3/da/ce 0 2024-09-11T00:07:01.785 INFO:tasks.workunit.client.0.smithi111.stdout:0/39: chown d3/da/ce 384281299 1 2024-09-11T00:07:01.789 INFO:tasks.workunit.client.1.smithi203.stdout:9/94: fsync d6/de/d19/f1c 0 2024-09-11T00:07:01.789 INFO:tasks.workunit.client.0.smithi111.stdout:5/51: write f1 [941290,75141] 0 2024-09-11T00:07:01.789 INFO:tasks.workunit.client.0.smithi111.stdout:5/52: rmdir - no directory 2024-09-11T00:07:01.791 INFO:tasks.workunit.client.1.smithi203.stdout:9/95: chown d6/de/d19/d13 74481020 1 2024-09-11T00:07:01.795 INFO:tasks.workunit.client.0.smithi111.stdout:3/78: symlink l16 0 2024-09-11T00:07:01.795 INFO:tasks.workunit.client.0.smithi111.stdout:3/79: rmdir - no directory 2024-09-11T00:07:01.795 INFO:tasks.workunit.client.0.smithi111.stdout:0/40: dread d3/fd [0,4194304] 0 2024-09-11T00:07:01.796 INFO:tasks.workunit.client.0.smithi111.stdout:0/41: chown d3 13832 1 2024-09-11T00:07:01.796 INFO:tasks.workunit.client.1.smithi203.stdout:8/77: dwrite d1/fc [8388608,4194304] 0 2024-09-11T00:07:01.797 INFO:tasks.workunit.client.0.smithi111.stdout:0/42: chown d3/da/ce 1505 1 2024-09-11T00:07:01.799 INFO:tasks.workunit.client.0.smithi111.stdout:0/43: write d3/f7 [1738619,85344] 0 2024-09-11T00:07:01.806 INFO:tasks.workunit.client.0.smithi111.stdout:6/42: rmdir d7 39 2024-09-11T00:07:01.808 INFO:tasks.workunit.client.1.smithi203.stdout:4/66: link f2 db/f10 0 2024-09-11T00:07:01.812 INFO:tasks.workunit.client.1.smithi203.stdout:6/59: sync 2024-09-11T00:07:01.812 INFO:tasks.workunit.client.1.smithi203.stdout:7/140: sync 2024-09-11T00:07:01.812 INFO:tasks.workunit.client.1.smithi203.stdout:2/26: sync 2024-09-11T00:07:01.812 INFO:tasks.workunit.client.1.smithi203.stdout:1/117: sync 2024-09-11T00:07:01.813 INFO:tasks.workunit.client.0.smithi111.stdout:9/59: mknod d6/c12 0 2024-09-11T00:07:01.815 INFO:tasks.workunit.client.1.smithi203.stdout:6/60: read - d0/f4 zero size 2024-09-11T00:07:01.816 INFO:tasks.workunit.client.1.smithi203.stdout:2/27: write f8 [506582,42808] 0 2024-09-11T00:07:01.817 INFO:tasks.workunit.client.0.smithi111.stdout:8/40: creat fb x:0 0 0 2024-09-11T00:07:01.817 INFO:tasks.workunit.client.0.smithi111.stdout:8/41: dread - fb zero size 2024-09-11T00:07:01.818 INFO:tasks.workunit.client.0.smithi111.stdout:8/42: write f7 [2385151,8340] 0 2024-09-11T00:07:01.829 INFO:tasks.workunit.client.1.smithi203.stdout:3/125: symlink d8/d2a/l33 0 2024-09-11T00:07:01.831 INFO:tasks.workunit.client.1.smithi203.stdout:4/67: creat db/dd/f11 x:0 0 0 2024-09-11T00:07:01.834 INFO:tasks.workunit.client.0.smithi111.stdout:1/14: mkdir d2 0 2024-09-11T00:07:01.834 INFO:tasks.workunit.client.0.smithi111.stdout:1/15: dwrite - no filename 2024-09-11T00:07:01.835 INFO:tasks.workunit.client.1.smithi203.stdout:0/77: truncate d0/d2/fe 6215338 0 2024-09-11T00:07:01.837 INFO:tasks.workunit.client.0.smithi111.stdout:2/65: mkdir d0/d3/d12 0 2024-09-11T00:07:01.839 INFO:tasks.workunit.client.1.smithi203.stdout:6/61: symlink d0/l11 0 2024-09-11T00:07:01.841 INFO:tasks.workunit.client.1.smithi203.stdout:6/62: fsync d0/d6/fb 0 2024-09-11T00:07:01.845 INFO:tasks.workunit.client.0.smithi111.stdout:3/80: rename f11 to f17 0 2024-09-11T00:07:01.848 INFO:tasks.workunit.client.1.smithi203.stdout:9/96: mknod d6/de/d19/d21/c23 0 2024-09-11T00:07:01.848 INFO:tasks.workunit.client.1.smithi203.stdout:2/28: creat f9 x:0 0 0 2024-09-11T00:07:01.852 INFO:tasks.workunit.client.0.smithi111.stdout:0/44: rmdir d3/da 39 2024-09-11T00:07:01.855 INFO:tasks.workunit.client.1.smithi203.stdout:3/126: mkdir d8/da/d34 0 2024-09-11T00:07:01.858 INFO:tasks.workunit.client.1.smithi203.stdout:1/118: dread d8/d9/fd [0,4194304] 0 2024-09-11T00:07:01.858 INFO:tasks.workunit.client.1.smithi203.stdout:3/127: write d8/f2d [494684,11668] 0 2024-09-11T00:07:01.858 INFO:tasks.workunit.client.1.smithi203.stdout:4/68: fdatasync f6 0 2024-09-11T00:07:01.860 INFO:tasks.workunit.client.0.smithi111.stdout:9/60: mkdir d6/dc/d13 0 2024-09-11T00:07:01.870 INFO:tasks.workunit.client.1.smithi203.stdout:9/97: dread d6/de/d19/f1b [0,4194304] 0 2024-09-11T00:07:01.870 INFO:tasks.workunit.client.1.smithi203.stdout:6/63: rename d0/l11 to d0/l12 0 2024-09-11T00:07:01.874 INFO:tasks.workunit.client.0.smithi111.stdout:4/43: unlink l1 0 2024-09-11T00:07:01.879 INFO:tasks.workunit.client.1.smithi203.stdout:2/29: mknod ca 0 2024-09-11T00:07:01.880 INFO:tasks.workunit.client.1.smithi203.stdout:7/141: dwrite dd/d1c/f2d [0,4194304] 0 2024-09-11T00:07:01.881 INFO:tasks.workunit.client.0.smithi111.stdout:5/53: mknod cf 0 2024-09-11T00:07:01.884 INFO:tasks.workunit.client.0.smithi111.stdout:5/54: write fc [961998,124470] 0 2024-09-11T00:07:01.887 INFO:tasks.workunit.client.0.smithi111.stdout:7/47: getdents dd 0 2024-09-11T00:07:01.887 INFO:tasks.workunit.client.0.smithi111.stdout:4/44: dwrite f9 [0,4194304] 0 2024-09-11T00:07:01.892 INFO:tasks.workunit.client.1.smithi203.stdout:5/135: dwrite f5 [0,4194304] 0 2024-09-11T00:07:01.894 INFO:tasks.workunit.client.0.smithi111.stdout:8/43: link fb fc 0 2024-09-11T00:07:01.897 INFO:tasks.workunit.client.1.smithi203.stdout:1/119: dread d8/f1a [0,4194304] 0 2024-09-11T00:07:01.899 INFO:tasks.workunit.client.1.smithi203.stdout:4/69: mkdir db/d12 0 2024-09-11T00:07:01.899 INFO:tasks.workunit.client.1.smithi203.stdout:9/98: dread d6/de/d19/d13/f15 [0,4194304] 0 2024-09-11T00:07:01.905 INFO:tasks.workunit.client.1.smithi203.stdout:1/120: chown d8/d11/d29 49195 1 2024-09-11T00:07:01.906 INFO:tasks.workunit.client.0.smithi111.stdout:2/66: truncate d0/f4 2164214 0 2024-09-11T00:07:01.906 INFO:tasks.workunit.client.1.smithi203.stdout:3/128: rename d8/f2d to d8/da/d34/f35 0 2024-09-11T00:07:01.907 INFO:tasks.workunit.client.0.smithi111.stdout:2/67: fdatasync d0/d3/de/f11 0 2024-09-11T00:07:01.909 INFO:tasks.workunit.client.0.smithi111.stdout:7/48: creat dd/ff x:0 0 0 2024-09-11T00:07:01.910 INFO:tasks.workunit.client.0.smithi111.stdout:7/49: read f8 [1138115,10646] 0 2024-09-11T00:07:01.911 INFO:tasks.workunit.client.1.smithi203.stdout:7/142: mknod dd/d1c/d26/c33 0 2024-09-11T00:07:01.911 INFO:tasks.workunit.client.1.smithi203.stdout:1/121: readlink d8/d9/l18 0 2024-09-11T00:07:01.911 INFO:tasks.workunit.client.0.smithi111.stdout:4/45: chown la 695540 1 2024-09-11T00:07:01.912 INFO:tasks.workunit.client.1.smithi203.stdout:3/129: readlink d8/d17/l32 0 2024-09-11T00:07:01.912 INFO:tasks.workunit.client.0.smithi111.stdout:7/50: write f7 [634317,53672] 0 2024-09-11T00:07:01.912 INFO:tasks.workunit.client.0.smithi111.stdout:4/46: fdatasync fe 0 2024-09-11T00:07:01.912 INFO:tasks.workunit.client.0.smithi111.stdout:7/51: read - fc zero size 2024-09-11T00:07:01.913 INFO:tasks.workunit.client.1.smithi203.stdout:5/136: truncate dc/dd/d15/f23 4508060 0 2024-09-11T00:07:01.913 INFO:tasks.workunit.client.0.smithi111.stdout:0/45: creat d3/da/ff x:0 0 0 2024-09-11T00:07:01.914 INFO:tasks.workunit.client.0.smithi111.stdout:7/52: write f7 [1172694,124478] 0 2024-09-11T00:07:01.916 INFO:tasks.workunit.client.0.smithi111.stdout:7/53: write f6 [10073108,48133] 0 2024-09-11T00:07:01.918 INFO:tasks.workunit.client.1.smithi203.stdout:0/78: creat d0/f18 x:0 0 0 2024-09-11T00:07:01.919 INFO:tasks.workunit.client.1.smithi203.stdout:8/78: getdents d1 0 2024-09-11T00:07:01.922 INFO:tasks.workunit.client.1.smithi203.stdout:2/30: dwrite f8 [0,4194304] 0 2024-09-11T00:07:01.922 INFO:tasks.workunit.client.0.smithi111.stdout:8/44: creat fd x:0 0 0 2024-09-11T00:07:01.924 INFO:tasks.workunit.client.0.smithi111.stdout:8/45: fdatasync f9 0 2024-09-11T00:07:01.924 INFO:tasks.workunit.client.0.smithi111.stdout:5/55: mkdir d10 0 2024-09-11T00:07:01.925 INFO:tasks.workunit.client.0.smithi111.stdout:5/56: chown ce 1 1 2024-09-11T00:07:01.925 INFO:tasks.workunit.client.0.smithi111.stdout:8/46: write fd [598151,10384] 0 2024-09-11T00:07:01.927 INFO:tasks.workunit.client.0.smithi111.stdout:9/61: dread d6/db/ff [0,4194304] 0 2024-09-11T00:07:01.927 INFO:tasks.workunit.client.0.smithi111.stdout:4/47: dwrite fb [0,4194304] 0 2024-09-11T00:07:01.928 INFO:tasks.workunit.client.0.smithi111.stdout:4/48: fdatasync fe 0 2024-09-11T00:07:01.929 INFO:tasks.workunit.client.0.smithi111.stdout:9/62: rename d6/dc to d6/dc/d14 22 2024-09-11T00:07:01.931 INFO:tasks.workunit.client.1.smithi203.stdout:4/70: dread f2 [0,4194304] 0 2024-09-11T00:07:01.937 INFO:tasks.workunit.client.1.smithi203.stdout:9/99: mkdir d6/de/d19/d24 0 2024-09-11T00:07:01.939 INFO:tasks.workunit.client.0.smithi111.stdout:5/57: dread f7 [0,4194304] 0 2024-09-11T00:07:01.943 INFO:tasks.workunit.client.0.smithi111.stdout:9/63: dread d6/db/ff [0,4194304] 0 2024-09-11T00:07:01.948 INFO:tasks.workunit.client.1.smithi203.stdout:5/137: creat dc/dd/d1e/f29 x:0 0 0 2024-09-11T00:07:01.959 INFO:tasks.workunit.client.1.smithi203.stdout:7/143: symlink dd/d1c/l34 0 2024-09-11T00:07:01.959 INFO:tasks.workunit.client.0.smithi111.stdout:3/81: write f12 [635414,31029] 0 2024-09-11T00:07:01.960 INFO:tasks.workunit.client.1.smithi203.stdout:7/144: readlink dd/l17 0 2024-09-11T00:07:01.962 INFO:tasks.workunit.client.1.smithi203.stdout:8/79: fsync d1/f2 0 2024-09-11T00:07:01.962 INFO:tasks.workunit.client.0.smithi111.stdout:4/49: dwrite fe [0,4194304] 0 2024-09-11T00:07:01.964 INFO:tasks.workunit.client.0.smithi111.stdout:1/16: sync 2024-09-11T00:07:01.965 INFO:tasks.workunit.client.0.smithi111.stdout:7/54: creat dd/f10 x:0 0 0 2024-09-11T00:07:01.965 INFO:tasks.workunit.client.1.smithi203.stdout:8/80: read d1/fc [7044140,69772] 0 2024-09-11T00:07:01.975 INFO:tasks.workunit.client.1.smithi203.stdout:3/130: rename d8/f22 to d8/da/d34/f36 0 2024-09-11T00:07:01.979 INFO:tasks.workunit.client.0.smithi111.stdout:3/82: dwrite f13 [0,4194304] 0 2024-09-11T00:07:01.982 INFO:tasks.workunit.client.0.smithi111.stdout:8/47: creat fe x:0 0 0 2024-09-11T00:07:01.988 INFO:tasks.workunit.client.1.smithi203.stdout:9/100: creat d6/de/d19/d21/f25 x:0 0 0 2024-09-11T00:07:01.992 INFO:tasks.workunit.client.1.smithi203.stdout:5/138: truncate dc/dd/d15/f1d 2132997 0 2024-09-11T00:07:01.995 INFO:tasks.workunit.client.1.smithi203.stdout:6/64: truncate d0/d6/fb 4127224 0 2024-09-11T00:07:02.001 INFO:tasks.workunit.client.1.smithi203.stdout:7/145: unlink dd/ff 0 2024-09-11T00:07:02.019 INFO:tasks.workunit.client.1.smithi203.stdout:3/131: mkdir d8/da/d37 0 2024-09-11T00:07:02.026 INFO:tasks.workunit.client.1.smithi203.stdout:1/122: rmdir d8/d11/d29/d2b 0 2024-09-11T00:07:02.030 INFO:tasks.workunit.client.1.smithi203.stdout:5/139: rename dc/dd/c17 to dc/dd/d13/c2a 0 2024-09-11T00:07:02.033 INFO:tasks.workunit.client.1.smithi203.stdout:0/79: creat d0/f19 x:0 0 0 2024-09-11T00:07:02.035 INFO:tasks.workunit.client.1.smithi203.stdout:0/80: chown d0/d2/f8 1375872 1 2024-09-11T00:07:02.037 INFO:tasks.workunit.client.1.smithi203.stdout:0/81: dread - d0/d2/f12 zero size 2024-09-11T00:07:02.038 INFO:tasks.workunit.client.1.smithi203.stdout:1/123: dread d8/d9/fd [0,4194304] 0 2024-09-11T00:07:02.042 INFO:tasks.workunit.client.1.smithi203.stdout:1/124: write d8/d9/f1e [3552576,14714] 0 2024-09-11T00:07:02.044 INFO:tasks.workunit.client.1.smithi203.stdout:8/81: symlink d1/d13/d17/l1a 0 2024-09-11T00:07:02.057 INFO:tasks.workunit.client.1.smithi203.stdout:7/146: dread - dd/d1c/f2b zero size 2024-09-11T00:07:02.061 INFO:tasks.workunit.client.1.smithi203.stdout:0/82: creat d0/d2/f1a x:0 0 0 2024-09-11T00:07:02.063 INFO:tasks.workunit.client.1.smithi203.stdout:2/31: getdents . 0 2024-09-11T00:07:02.065 INFO:tasks.workunit.client.1.smithi203.stdout:2/32: write f8 [1693959,99458] 0 2024-09-11T00:07:02.069 INFO:tasks.workunit.client.1.smithi203.stdout:1/125: chown d8/d9/l1d 9647 1 2024-09-11T00:07:02.071 INFO:tasks.workunit.client.1.smithi203.stdout:8/82: fsync d1/f11 0 2024-09-11T00:07:02.073 INFO:tasks.workunit.client.1.smithi203.stdout:8/83: read d1/fe [7500479,116146] 0 2024-09-11T00:07:02.075 INFO:tasks.workunit.client.1.smithi203.stdout:4/71: getdents db 0 2024-09-11T00:07:02.075 INFO:tasks.workunit.client.1.smithi203.stdout:3/132: fdatasync d8/d17/f1c 0 2024-09-11T00:07:02.082 INFO:tasks.workunit.client.1.smithi203.stdout:2/33: dread f8 [0,4194304] 0 2024-09-11T00:07:02.093 INFO:tasks.workunit.client.1.smithi203.stdout:0/83: chown d0/d2/la 360961 1 2024-09-11T00:07:02.095 INFO:tasks.workunit.client.1.smithi203.stdout:3/133: dwrite d8/f16 [4194304,4194304] 0 2024-09-11T00:07:02.105 INFO:tasks.workunit.client.1.smithi203.stdout:4/72: creat db/dd/f13 x:0 0 0 2024-09-11T00:07:02.111 INFO:tasks.workunit.client.1.smithi203.stdout:4/73: read - fa zero size 2024-09-11T00:07:02.114 INFO:tasks.workunit.client.1.smithi203.stdout:0/84: dread d0/d2/f13 [0,4194304] 0 2024-09-11T00:07:02.114 INFO:tasks.workunit.client.1.smithi203.stdout:4/74: chown c8 0 1 2024-09-11T00:07:02.115 INFO:tasks.workunit.client.1.smithi203.stdout:9/101: link d6/de/c11 d6/de/d19/d21/c26 0 2024-09-11T00:07:02.115 INFO:tasks.workunit.client.1.smithi203.stdout:3/134: dwrite d8/f16 [0,4194304] 0 2024-09-11T00:07:02.117 INFO:tasks.workunit.client.1.smithi203.stdout:3/135: fsync d8/f29 0 2024-09-11T00:07:02.119 INFO:tasks.workunit.client.1.smithi203.stdout:2/34: rename l5 to lb 0 2024-09-11T00:07:02.124 INFO:tasks.workunit.client.1.smithi203.stdout:7/147: rename dd/f13 to dd/d1c/f35 0 2024-09-11T00:07:02.125 INFO:tasks.workunit.client.1.smithi203.stdout:6/65: write d0/d6/fc [3909970,28296] 0 2024-09-11T00:07:02.135 INFO:tasks.workunit.client.1.smithi203.stdout:1/126: creat d8/d9/d15/d27/f2e x:0 0 0 2024-09-11T00:07:02.150 INFO:tasks.workunit.client.1.smithi203.stdout:4/75: dwrite fa [0,4194304] 0 2024-09-11T00:07:02.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:01 smithi111 ceph-mon[27539]: pgmap v320: 65 pgs: 65 active+clean; 327 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 250 KiB/s rd, 18 MiB/s wr, 214 op/s 2024-09-11T00:07:02.154 INFO:tasks.workunit.client.1.smithi203.stdout:4/76: chown c8 438 1 2024-09-11T00:07:02.155 INFO:tasks.workunit.client.1.smithi203.stdout:4/77: stat f1 0 2024-09-11T00:07:02.157 INFO:tasks.workunit.client.1.smithi203.stdout:1/127: dread d8/d11/f20 [0,4194304] 0 2024-09-11T00:07:02.157 INFO:tasks.workunit.client.1.smithi203.stdout:3/136: dwrite d8/da/f2f [0,4194304] 0 2024-09-11T00:07:02.159 INFO:tasks.workunit.client.1.smithi203.stdout:6/66: dwrite d0/f10 [0,4194304] 0 2024-09-11T00:07:02.162 INFO:tasks.workunit.client.1.smithi203.stdout:1/128: chown d8/d9/d15/f22 10271727 1 2024-09-11T00:07:02.168 INFO:tasks.workunit.client.1.smithi203.stdout:8/84: rename d1/f12 to d1/d13/f1b 0 2024-09-11T00:07:02.169 INFO:tasks.workunit.client.1.smithi203.stdout:9/102: write d6/de/d19/d13/f15 [838225,83598] 0 2024-09-11T00:07:02.181 INFO:tasks.workunit.client.1.smithi203.stdout:4/78: symlink db/dd/l14 0 2024-09-11T00:07:02.193 INFO:tasks.workunit.client.1.smithi203.stdout:3/137: symlink d8/d17/l38 0 2024-09-11T00:07:02.196 INFO:tasks.workunit.client.1.smithi203.stdout:4/79: dread fa [0,4194304] 0 2024-09-11T00:07:02.197 INFO:tasks.workunit.client.1.smithi203.stdout:7/148: dread dd/f18 [0,4194304] 0 2024-09-11T00:07:02.207 INFO:tasks.workunit.client.1.smithi203.stdout:2/35: link ca cc 0 2024-09-11T00:07:02.209 INFO:tasks.workunit.client.1.smithi203.stdout:8/85: dread d1/f16 [0,4194304] 0 2024-09-11T00:07:02.209 INFO:tasks.workunit.client.1.smithi203.stdout:2/36: truncate f4 933819 0 2024-09-11T00:07:02.210 INFO:tasks.workunit.client.1.smithi203.stdout:0/85: write d0/f5 [6727268,37413] 0 2024-09-11T00:07:02.211 INFO:tasks.workunit.client.1.smithi203.stdout:8/86: chown d1/c10 169 1 2024-09-11T00:07:02.217 INFO:tasks.workunit.client.1.smithi203.stdout:4/80: dwrite f9 [0,4194304] 0 2024-09-11T00:07:02.221 INFO:tasks.workunit.client.1.smithi203.stdout:3/138: creat d8/da/d34/f39 x:0 0 0 2024-09-11T00:07:02.222 INFO:tasks.workunit.client.1.smithi203.stdout:1/129: write d8/d9/fd [1274756,103844] 0 2024-09-11T00:07:02.229 INFO:tasks.workunit.client.1.smithi203.stdout:9/103: write d6/de/d19/f1b [2312140,38726] 0 2024-09-11T00:07:02.232 INFO:tasks.workunit.client.1.smithi203.stdout:9/104: read f5 [1210130,10531] 0 2024-09-11T00:07:02.235 INFO:tasks.workunit.client.1.smithi203.stdout:9/105: write d6/de/d19/f1b [1799766,11576] 0 2024-09-11T00:07:02.237 INFO:tasks.workunit.client.1.smithi203.stdout:8/87: dread d1/f8 [0,4194304] 0 2024-09-11T00:07:02.238 INFO:tasks.workunit.client.1.smithi203.stdout:2/37: creat fd x:0 0 0 2024-09-11T00:07:02.241 INFO:tasks.workunit.client.1.smithi203.stdout:0/86: truncate d0/d2/fb 1037549 0 2024-09-11T00:07:02.243 INFO:tasks.workunit.client.1.smithi203.stdout:0/87: fdatasync d0/f5 0 2024-09-11T00:07:02.249 INFO:tasks.workunit.client.1.smithi203.stdout:3/139: rename d8/da/c26 to d8/c3a 0 2024-09-11T00:07:02.252 INFO:tasks.workunit.client.1.smithi203.stdout:1/130: symlink d8/d9/d15/d27/l2f 0 2024-09-11T00:07:02.253 INFO:tasks.workunit.client.1.smithi203.stdout:1/131: chown d8/d9 1396245 1 2024-09-11T00:07:02.258 INFO:tasks.workunit.client.1.smithi203.stdout:8/88: fdatasync d1/f16 0 2024-09-11T00:07:02.270 INFO:tasks.workunit.client.1.smithi203.stdout:6/67: getdents d0 0 2024-09-11T00:07:02.274 INFO:tasks.workunit.client.1.smithi203.stdout:0/88: symlink d0/d2/l1b 0 2024-09-11T00:07:02.275 INFO:tasks.workunit.client.1.smithi203.stdout:4/81: mkdir db/d12/d15 0 2024-09-11T00:07:02.277 INFO:tasks.workunit.client.1.smithi203.stdout:0/89: truncate d0/d2/f8 570165 0 2024-09-11T00:07:02.278 INFO:tasks.workunit.client.1.smithi203.stdout:7/149: creat dd/d1c/d26/d31/f36 x:0 0 0 2024-09-11T00:07:02.278 INFO:tasks.workunit.client.1.smithi203.stdout:5/140: sync 2024-09-11T00:07:02.279 INFO:tasks.workunit.client.1.smithi203.stdout:0/90: read d0/f5 [4750272,101429] 0 2024-09-11T00:07:02.280 INFO:tasks.workunit.client.1.smithi203.stdout:3/140: creat d8/d17/f3b x:0 0 0 2024-09-11T00:07:02.285 INFO:tasks.workunit.client.1.smithi203.stdout:2/38: dwrite f4 [0,4194304] 0 2024-09-11T00:07:02.292 INFO:tasks.workunit.client.1.smithi203.stdout:8/89: mknod d1/d13/c1c 0 2024-09-11T00:07:02.295 INFO:tasks.workunit.client.1.smithi203.stdout:9/106: creat d6/de/d19/d24/f27 x:0 0 0 2024-09-11T00:07:02.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:01 smithi203 ceph-mon[33225]: pgmap v320: 65 pgs: 65 active+clean; 327 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 250 KiB/s rd, 18 MiB/s wr, 214 op/s 2024-09-11T00:07:02.298 INFO:tasks.workunit.client.1.smithi203.stdout:5/141: dread f5 [0,4194304] 0 2024-09-11T00:07:02.301 INFO:tasks.workunit.client.1.smithi203.stdout:6/68: fsync d0/f4 0 2024-09-11T00:07:02.307 INFO:tasks.workunit.client.1.smithi203.stdout:6/69: write d0/d6/fb [3800447,13938] 0 2024-09-11T00:07:02.307 INFO:tasks.workunit.client.1.smithi203.stdout:4/82: dread db/f10 [0,4194304] 0 2024-09-11T00:07:02.311 INFO:tasks.workunit.client.1.smithi203.stdout:5/142: dread f8 [0,4194304] 0 2024-09-11T00:07:02.312 INFO:tasks.workunit.client.1.smithi203.stdout:1/132: write d8/d11/f20 [883090,23600] 0 2024-09-11T00:07:02.316 INFO:tasks.workunit.client.1.smithi203.stdout:0/91: rmdir d0/d2 39 2024-09-11T00:07:02.316 INFO:tasks.workunit.client.1.smithi203.stdout:1/133: write d8/d11/f20 [452433,3424] 0 2024-09-11T00:07:02.320 INFO:tasks.workunit.client.1.smithi203.stdout:1/134: stat d8/d9/d15 0 2024-09-11T00:07:02.321 INFO:tasks.workunit.client.1.smithi203.stdout:2/39: dwrite f9 [0,4194304] 0 2024-09-11T00:07:02.324 INFO:tasks.workunit.client.1.smithi203.stdout:3/141: mkdir d8/d3c 0 2024-09-11T00:07:02.333 INFO:tasks.workunit.client.1.smithi203.stdout:8/90: creat d1/d13/f1d x:0 0 0 2024-09-11T00:07:02.337 INFO:tasks.workunit.client.1.smithi203.stdout:7/150: fdatasync dd/f22 0 2024-09-11T00:07:02.342 INFO:tasks.workunit.client.1.smithi203.stdout:6/70: rename d0/d6/fc to d0/f13 0 2024-09-11T00:07:02.347 INFO:tasks.workunit.client.1.smithi203.stdout:5/143: stat dc/dd/d15/f1d 0 2024-09-11T00:07:02.351 INFO:tasks.workunit.client.1.smithi203.stdout:3/142: creat d8/f3d x:0 0 0 2024-09-11T00:07:02.352 INFO:tasks.workunit.client.1.smithi203.stdout:3/143: fdatasync d8/d17/f3b 0 2024-09-11T00:07:02.354 INFO:tasks.workunit.client.1.smithi203.stdout:8/91: creat d1/d13/d17/f1e x:0 0 0 2024-09-11T00:07:02.355 INFO:tasks.workunit.client.1.smithi203.stdout:4/83: dwrite fa [0,4194304] 0 2024-09-11T00:07:02.357 INFO:tasks.workunit.client.1.smithi203.stdout:9/107: symlink d6/l28 0 2024-09-11T00:07:02.358 INFO:tasks.workunit.client.1.smithi203.stdout:4/84: stat db/dd/l14 0 2024-09-11T00:07:02.376 INFO:tasks.workunit.client.1.smithi203.stdout:6/71: creat d0/f14 x:0 0 0 2024-09-11T00:07:02.378 INFO:tasks.workunit.client.1.smithi203.stdout:5/144: mkdir dc/d2b 0 2024-09-11T00:07:02.379 INFO:tasks.workunit.client.1.smithi203.stdout:8/92: dwrite d1/d13/f1d [0,4194304] 0 2024-09-11T00:07:02.380 INFO:tasks.workunit.client.1.smithi203.stdout:5/145: readlink dc/dd/l26 0 2024-09-11T00:07:02.382 INFO:tasks.workunit.client.1.smithi203.stdout:0/92: mkdir d0/d1c 0 2024-09-11T00:07:02.382 INFO:tasks.workunit.client.1.smithi203.stdout:3/144: symlink d8/l3e 0 2024-09-11T00:07:02.384 INFO:tasks.workunit.client.1.smithi203.stdout:5/146: write dc/dd/f28 [101398,29880] 0 2024-09-11T00:07:02.386 INFO:tasks.workunit.client.1.smithi203.stdout:3/145: chown d8/f16 2 1 2024-09-11T00:07:02.388 INFO:tasks.workunit.client.1.smithi203.stdout:4/85: mkdir db/dd/d16 0 2024-09-11T00:07:02.391 INFO:tasks.workunit.client.1.smithi203.stdout:5/147: write dc/dd/d1e/f27 [221301,31079] 0 2024-09-11T00:07:02.392 INFO:tasks.workunit.client.1.smithi203.stdout:3/146: fdatasync d8/f3d 0 2024-09-11T00:07:02.397 INFO:tasks.workunit.client.1.smithi203.stdout:8/93: truncate d1/f2 825648 0 2024-09-11T00:07:02.399 INFO:tasks.workunit.client.1.smithi203.stdout:3/147: fsync d8/f16 0 2024-09-11T00:07:02.399 INFO:tasks.workunit.client.1.smithi203.stdout:0/93: mkdir d0/d1d 0 2024-09-11T00:07:02.403 INFO:tasks.workunit.client.1.smithi203.stdout:7/151: rename dd/f2a to dd/f37 0 2024-09-11T00:07:02.408 INFO:tasks.workunit.client.1.smithi203.stdout:5/148: rename f5 to dc/dd/d15/f2c 0 2024-09-11T00:07:02.409 INFO:tasks.workunit.client.1.smithi203.stdout:7/152: chown dd/d1c/d26/l28 496902 1 2024-09-11T00:07:02.410 INFO:tasks.workunit.client.1.smithi203.stdout:0/94: dread - d0/fc zero size 2024-09-11T00:07:02.413 INFO:tasks.workunit.client.1.smithi203.stdout:0/95: chown d0/l16 10 1 2024-09-11T00:07:02.416 INFO:tasks.workunit.client.1.smithi203.stdout:8/94: truncate d1/f9 715466 0 2024-09-11T00:07:02.418 INFO:tasks.workunit.client.1.smithi203.stdout:8/95: fdatasync d1/d13/f1d 0 2024-09-11T00:07:02.419 INFO:tasks.workunit.client.1.smithi203.stdout:9/108: dwrite d6/de/f22 [0,4194304] 0 2024-09-11T00:07:02.419 INFO:tasks.workunit.client.1.smithi203.stdout:3/148: creat d8/da/d37/f3f x:0 0 0 2024-09-11T00:07:02.422 INFO:tasks.workunit.client.1.smithi203.stdout:4/86: dread f2 [0,4194304] 0 2024-09-11T00:07:02.429 INFO:tasks.workunit.client.1.smithi203.stdout:6/72: getdents d0 0 2024-09-11T00:07:02.432 INFO:tasks.workunit.client.1.smithi203.stdout:6/73: readlink d0/d6/le 0 2024-09-11T00:07:02.434 INFO:tasks.workunit.client.1.smithi203.stdout:3/149: creat d8/d2a/f40 x:0 0 0 2024-09-11T00:07:02.437 INFO:tasks.workunit.client.1.smithi203.stdout:9/109: mkdir d6/de/d19/d13/d29 0 2024-09-11T00:07:02.442 INFO:tasks.workunit.client.1.smithi203.stdout:9/110: dread - d6/de/d19/d21/f25 zero size 2024-09-11T00:07:02.449 INFO:tasks.workunit.client.1.smithi203.stdout:5/149: getdents dc/d2b 0 2024-09-11T00:07:02.449 INFO:tasks.workunit.client.1.smithi203.stdout:4/87: truncate db/f10 5102967 0 2024-09-11T00:07:02.450 INFO:tasks.workunit.client.1.smithi203.stdout:0/96: mknod d0/d1d/c1e 0 2024-09-11T00:07:02.452 INFO:tasks.workunit.client.1.smithi203.stdout:5/150: stat lb 0 2024-09-11T00:07:02.455 INFO:tasks.workunit.client.1.smithi203.stdout:0/97: chown d0/d1d/c1e 258 1 2024-09-11T00:07:02.459 INFO:tasks.workunit.client.1.smithi203.stdout:8/96: link d1/fc d1/d13/f1f 0 2024-09-11T00:07:02.460 INFO:tasks.workunit.client.1.smithi203.stdout:3/150: dwrite d8/da/d34/f39 [0,4194304] 0 2024-09-11T00:07:02.465 INFO:tasks.workunit.client.1.smithi203.stdout:6/74: dread d0/f5 [0,4194304] 0 2024-09-11T00:07:02.485 INFO:tasks.workunit.client.1.smithi203.stdout:9/111: dwrite d6/de/d19/d13/f15 [0,4194304] 0 2024-09-11T00:07:02.486 INFO:tasks.workunit.client.1.smithi203.stdout:0/98: truncate d0/d2/f8 792602 0 2024-09-11T00:07:02.487 INFO:tasks.workunit.client.1.smithi203.stdout:6/75: fsync d0/f13 0 2024-09-11T00:07:02.492 INFO:tasks.workunit.client.1.smithi203.stdout:6/76: chown d0/f1 51664632 1 2024-09-11T00:07:02.496 INFO:tasks.workunit.client.1.smithi203.stdout:3/151: dwrite d8/f16 [0,4194304] 0 2024-09-11T00:07:02.496 INFO:tasks.workunit.client.1.smithi203.stdout:5/151: dwrite dc/dd/d13/f18 [0,4194304] 0 2024-09-11T00:07:02.496 INFO:tasks.workunit.client.1.smithi203.stdout:6/77: chown d0/c2 259752761 1 2024-09-11T00:07:02.504 INFO:tasks.workunit.client.1.smithi203.stdout:6/78: chown d0/f10 81502291 1 2024-09-11T00:07:02.504 INFO:tasks.workunit.client.1.smithi203.stdout:0/99: creat d0/d2/f1f x:0 0 0 2024-09-11T00:07:02.510 INFO:tasks.workunit.client.1.smithi203.stdout:9/112: creat d6/de/d19/d13/f2a x:0 0 0 2024-09-11T00:07:02.511 INFO:tasks.workunit.client.1.smithi203.stdout:5/152: dread dc/dd/d1e/f27 [0,4194304] 0 2024-09-11T00:07:02.517 INFO:tasks.workunit.client.1.smithi203.stdout:3/152: fdatasync d8/d17/f1c 0 2024-09-11T00:07:02.519 INFO:tasks.workunit.client.1.smithi203.stdout:3/153: chown d8/fb 2688 1 2024-09-11T00:07:02.535 INFO:tasks.workunit.client.1.smithi203.stdout:0/100: mknod d0/d1d/c20 0 2024-09-11T00:07:02.549 INFO:tasks.workunit.client.1.smithi203.stdout:3/154: symlink d8/l41 0 2024-09-11T00:07:02.550 INFO:tasks.workunit.client.1.smithi203.stdout:6/79: dwrite d0/f5 [0,4194304] 0 2024-09-11T00:07:02.553 INFO:tasks.workunit.client.1.smithi203.stdout:6/80: write d0/d6/fb [1223687,75197] 0 2024-09-11T00:07:02.555 INFO:tasks.workunit.client.1.smithi203.stdout:7/153: dwrite dd/f37 [0,4194304] 0 2024-09-11T00:07:02.558 INFO:tasks.workunit.client.1.smithi203.stdout:9/113: creat d6/de/d19/d13/d29/f2b x:0 0 0 2024-09-11T00:07:02.563 INFO:tasks.workunit.client.1.smithi203.stdout:3/155: mknod d8/da/d11/c42 0 2024-09-11T00:07:02.566 INFO:tasks.workunit.client.1.smithi203.stdout:6/81: fdatasync d0/f13 0 2024-09-11T00:07:02.567 INFO:tasks.workunit.client.1.smithi203.stdout:6/82: fsync d0/f14 0 2024-09-11T00:07:02.568 INFO:tasks.workunit.client.1.smithi203.stdout:6/83: stat d0/f10 0 2024-09-11T00:07:02.569 INFO:tasks.workunit.client.1.smithi203.stdout:6/84: chown d0/l12 45483852 1 2024-09-11T00:07:02.576 INFO:tasks.workunit.client.1.smithi203.stdout:0/101: rename d0/f7 to d0/d1d/f21 0 2024-09-11T00:07:02.577 INFO:tasks.workunit.client.1.smithi203.stdout:0/102: stat d0/d2 0 2024-09-11T00:07:02.578 INFO:tasks.workunit.client.1.smithi203.stdout:0/103: read - d0/d2/f12 zero size 2024-09-11T00:07:02.578 INFO:tasks.workunit.client.1.smithi203.stdout:7/154: symlink dd/d1c/d26/d31/l38 0 2024-09-11T00:07:02.580 INFO:tasks.workunit.client.1.smithi203.stdout:9/114: creat d6/de/d19/d24/f2c x:0 0 0 2024-09-11T00:07:02.590 INFO:tasks.workunit.client.1.smithi203.stdout:3/156: truncate d8/fb 155346 0 2024-09-11T00:07:02.593 INFO:tasks.workunit.client.1.smithi203.stdout:3/157: chown d8/f16 14 1 2024-09-11T00:07:02.604 INFO:tasks.workunit.client.1.smithi203.stdout:6/85: mknod d0/c15 0 2024-09-11T00:07:02.604 INFO:tasks.workunit.client.1.smithi203.stdout:7/155: dwrite dd/d1c/f2d [0,4194304] 0 2024-09-11T00:07:02.605 INFO:tasks.workunit.client.1.smithi203.stdout:5/153: link dc/dd/d13/c2a dc/dd/d15/c2d 0 2024-09-11T00:07:02.606 INFO:tasks.workunit.client.1.smithi203.stdout:5/154: write dc/dd/d13/f1a [443336,99298] 0 2024-09-11T00:07:02.608 INFO:tasks.workunit.client.1.smithi203.stdout:6/86: dread d0/f8 [0,4194304] 0 2024-09-11T00:07:02.611 INFO:tasks.workunit.client.1.smithi203.stdout:9/115: creat d6/de/d19/d24/f2d x:0 0 0 2024-09-11T00:07:02.613 INFO:tasks.workunit.client.1.smithi203.stdout:8/97: link d1/f9 d1/f20 0 2024-09-11T00:07:02.619 INFO:tasks.workunit.client.1.smithi203.stdout:3/158: creat d8/da/d11/f43 x:0 0 0 2024-09-11T00:07:02.628 INFO:tasks.workunit.client.1.smithi203.stdout:5/155: mknod dc/dd/c2e 0 2024-09-11T00:07:02.629 INFO:tasks.workunit.client.1.smithi203.stdout:5/156: chown dc/d2b 5896 1 2024-09-11T00:07:02.631 INFO:tasks.workunit.client.1.smithi203.stdout:1/135: sync 2024-09-11T00:07:02.631 INFO:tasks.workunit.client.1.smithi203.stdout:2/40: sync 2024-09-11T00:07:02.634 INFO:tasks.workunit.client.1.smithi203.stdout:1/136: stat d8/d11/d29 0 2024-09-11T00:07:02.635 INFO:tasks.workunit.client.1.smithi203.stdout:0/104: rmdir d0/d1c 0 2024-09-11T00:07:02.636 INFO:tasks.workunit.client.1.smithi203.stdout:1/137: write d8/d19/f1b [4410279,97572] 0 2024-09-11T00:07:02.637 INFO:tasks.workunit.client.1.smithi203.stdout:0/105: fdatasync d0/d2/fe 0 2024-09-11T00:07:02.638 INFO:tasks.workunit.client.1.smithi203.stdout:3/159: dwrite d8/d2a/f40 [0,4194304] 0 2024-09-11T00:07:02.639 INFO:tasks.workunit.client.1.smithi203.stdout:6/87: link d0/f5 d0/f16 0 2024-09-11T00:07:02.646 INFO:tasks.workunit.client.1.smithi203.stdout:2/41: symlink le 0 2024-09-11T00:07:02.647 INFO:tasks.workunit.client.1.smithi203.stdout:2/42: readlink le 0 2024-09-11T00:07:02.649 INFO:tasks.workunit.client.1.smithi203.stdout:9/116: truncate d6/f14 1327466 0 2024-09-11T00:07:02.655 INFO:tasks.workunit.client.1.smithi203.stdout:1/138: rmdir d8/d9/d15 39 2024-09-11T00:07:02.661 INFO:tasks.workunit.client.1.smithi203.stdout:3/160: creat d8/da/f44 x:0 0 0 2024-09-11T00:07:02.665 INFO:tasks.workunit.client.1.smithi203.stdout:5/157: unlink dc/dd/le 0 2024-09-11T00:07:02.666 INFO:tasks.workunit.client.1.smithi203.stdout:5/158: fdatasync dc/dd/d1e/f21 0 2024-09-11T00:07:02.668 INFO:tasks.workunit.client.0.smithi111.stdout:2/68: fsync d0/f4 0 2024-09-11T00:07:02.671 INFO:tasks.workunit.client.1.smithi203.stdout:0/106: write d0/d2/f13 [4486498,90056] 0 2024-09-11T00:07:02.672 INFO:tasks.workunit.client.0.smithi111.stdout:0/46: symlink d3/dc/l10 0 2024-09-11T00:07:02.673 INFO:tasks.workunit.client.0.smithi111.stdout:0/47: chown f1 25 1 2024-09-11T00:07:02.673 INFO:tasks.workunit.client.0.smithi111.stdout:0/48: readlink d3/dc/l10 0 2024-09-11T00:07:02.674 INFO:tasks.workunit.client.1.smithi203.stdout:2/43: write f8 [213248,13527] 0 2024-09-11T00:07:02.674 INFO:tasks.workunit.client.0.smithi111.stdout:6/43: getdents d7 0 2024-09-11T00:07:02.674 INFO:tasks.workunit.client.0.smithi111.stdout:6/44: stat f3 0 2024-09-11T00:07:02.676 INFO:tasks.workunit.client.1.smithi203.stdout:2/44: chown f8 9919752 1 2024-09-11T00:07:02.677 INFO:tasks.workunit.client.1.smithi203.stdout:9/117: unlink d6/de/d19/d21/c23 0 2024-09-11T00:07:02.678 INFO:tasks.workunit.client.1.smithi203.stdout:2/45: truncate f0 5566879 0 2024-09-11T00:07:02.679 INFO:tasks.workunit.client.1.smithi203.stdout:9/118: fsync d6/de/d19/d21/f25 0 2024-09-11T00:07:02.680 INFO:tasks.workunit.client.1.smithi203.stdout:2/46: write f8 [4188663,87512] 0 2024-09-11T00:07:02.682 INFO:tasks.workunit.client.1.smithi203.stdout:9/119: write d6/de/d19/d13/f15 [1574681,40028] 0 2024-09-11T00:07:02.685 INFO:tasks.workunit.client.1.smithi203.stdout:9/120: write d6/de/d19/d24/f2d [574114,14532] 0 2024-09-11T00:07:02.685 INFO:tasks.workunit.client.0.smithi111.stdout:9/64: rename d6/le to d6/dc/d13/l15 0 2024-09-11T00:07:02.691 INFO:tasks.workunit.client.1.smithi203.stdout:3/161: mknod d8/da/c45 0 2024-09-11T00:07:02.694 INFO:tasks.workunit.client.0.smithi111.stdout:9/65: dread d6/db/ff [0,4194304] 0 2024-09-11T00:07:02.694 INFO:tasks.workunit.client.0.smithi111.stdout:7/55: symlink dd/l11 0 2024-09-11T00:07:02.697 INFO:tasks.workunit.client.1.smithi203.stdout:8/98: getdents d1 0 2024-09-11T00:07:02.700 INFO:tasks.workunit.client.1.smithi203.stdout:1/139: dwrite d8/d9/d15/f22 [0,4194304] 0 2024-09-11T00:07:02.701 INFO:tasks.workunit.client.1.smithi203.stdout:0/107: mknod d0/d2/c22 0 2024-09-11T00:07:02.701 INFO:tasks.workunit.client.0.smithi111.stdout:3/83: mknod c18 0 2024-09-11T00:07:02.702 INFO:tasks.workunit.client.1.smithi203.stdout:8/99: dread d1/f16 [0,4194304] 0 2024-09-11T00:07:02.703 INFO:tasks.workunit.client.1.smithi203.stdout:0/108: write d0/f18 [623013,114155] 0 2024-09-11T00:07:02.704 INFO:tasks.workunit.client.1.smithi203.stdout:0/109: stat d0/d2/fd 0 2024-09-11T00:07:02.705 INFO:tasks.workunit.client.0.smithi111.stdout:8/48: creat ff x:0 0 0 2024-09-11T00:07:02.706 INFO:tasks.workunit.client.0.smithi111.stdout:5/58: symlink d10/l11 0 2024-09-11T00:07:02.707 INFO:tasks.workunit.client.1.smithi203.stdout:2/47: symlink lf 0 2024-09-11T00:07:02.708 INFO:tasks.workunit.client.0.smithi111.stdout:5/59: read f1 [3962086,122705] 0 2024-09-11T00:07:02.708 INFO:tasks.workunit.client.0.smithi111.stdout:2/69: fsync d0/fc 0 2024-09-11T00:07:02.710 INFO:tasks.workunit.client.1.smithi203.stdout:9/121: fdatasync f5 0 2024-09-11T00:07:02.711 INFO:tasks.workunit.client.1.smithi203.stdout:2/48: read f0 [656859,91241] 0 2024-09-11T00:07:02.716 INFO:tasks.workunit.client.0.smithi111.stdout:4/50: mknod c10 0 2024-09-11T00:07:02.716 INFO:tasks.workunit.client.1.smithi203.stdout:3/162: stat d8/c3a 0 2024-09-11T00:07:02.716 INFO:tasks.workunit.client.1.smithi203.stdout:2/49: truncate f7 118568 0 2024-09-11T00:07:02.717 INFO:tasks.workunit.client.1.smithi203.stdout:9/122: write d6/de/d19/f1b [1946807,106542] 0 2024-09-11T00:07:02.720 INFO:tasks.workunit.client.1.smithi203.stdout:2/50: write f9 [747240,35257] 0 2024-09-11T00:07:02.721 INFO:tasks.workunit.client.1.smithi203.stdout:9/123: write d6/de/d19/d13/f2a [789621,121323] 0 2024-09-11T00:07:02.722 INFO:tasks.workunit.client.1.smithi203.stdout:2/51: write f4 [3054578,3157] 0 2024-09-11T00:07:02.725 INFO:tasks.workunit.client.1.smithi203.stdout:2/52: write fd [186855,44742] 0 2024-09-11T00:07:02.730 INFO:tasks.workunit.client.0.smithi111.stdout:2/70: dwrite d0/d3/de/f11 [0,4194304] 0 2024-09-11T00:07:02.730 INFO:tasks.workunit.client.0.smithi111.stdout:6/45: dwrite f0 [0,4194304] 0 2024-09-11T00:07:02.731 INFO:tasks.workunit.client.0.smithi111.stdout:3/84: creat f19 x:0 0 0 2024-09-11T00:07:02.732 INFO:tasks.workunit.client.0.smithi111.stdout:3/85: truncate f8 9017072 0 2024-09-11T00:07:02.732 INFO:tasks.workunit.client.0.smithi111.stdout:6/46: write f0 [2371787,106610] 0 2024-09-11T00:07:02.734 INFO:tasks.workunit.client.0.smithi111.stdout:6/47: chown c4 0 1 2024-09-11T00:07:02.738 INFO:tasks.workunit.client.1.smithi203.stdout:6/88: getdents d0 0 2024-09-11T00:07:02.740 INFO:tasks.workunit.client.0.smithi111.stdout:5/60: symlink d10/l12 0 2024-09-11T00:07:02.746 INFO:tasks.workunit.client.1.smithi203.stdout:3/163: creat d8/da/f46 x:0 0 0 2024-09-11T00:07:02.749 INFO:tasks.workunit.client.1.smithi203.stdout:3/164: write d8/da/d37/f3f [168912,10716] 0 2024-09-11T00:07:02.749 INFO:tasks.workunit.client.1.smithi203.stdout:8/100: link d1/d13/f1d d1/d13/f21 0 2024-09-11T00:07:02.751 INFO:tasks.workunit.client.0.smithi111.stdout:1/17: link l0 d2/l3 0 2024-09-11T00:07:02.752 INFO:tasks.workunit.client.0.smithi111.stdout:1/18: write - no filename 2024-09-11T00:07:02.752 INFO:tasks.workunit.client.0.smithi111.stdout:7/56: write f8 [8990765,75552] 0 2024-09-11T00:07:02.755 INFO:tasks.workunit.client.0.smithi111.stdout:1/19: chown l1 7423 1 2024-09-11T00:07:02.756 INFO:tasks.workunit.client.1.smithi203.stdout:9/124: mknod d6/de/d19/d21/c2e 0 2024-09-11T00:07:02.756 INFO:tasks.workunit.client.0.smithi111.stdout:7/57: truncate dd/ff 682324 0 2024-09-11T00:07:02.758 INFO:tasks.workunit.client.0.smithi111.stdout:2/71: creat d0/d3/f13 x:0 0 0 2024-09-11T00:07:02.759 INFO:tasks.workunit.client.1.smithi203.stdout:9/125: truncate d6/de/d19/d24/f2c 291282 0 2024-09-11T00:07:02.761 INFO:tasks.workunit.client.0.smithi111.stdout:3/86: creat f1a x:0 0 0 2024-09-11T00:07:02.761 INFO:tasks.workunit.client.0.smithi111.stdout:9/66: dwrite d6/db/ff [4194304,4194304] 0 2024-09-11T00:07:02.761 INFO:tasks.workunit.client.1.smithi203.stdout:6/89: symlink d0/d6/l17 0 2024-09-11T00:07:02.762 INFO:tasks.workunit.client.0.smithi111.stdout:3/87: fsync f19 0 2024-09-11T00:07:02.764 INFO:tasks.workunit.client.0.smithi111.stdout:6/48: creat d7/fd x:0 0 0 2024-09-11T00:07:02.765 INFO:tasks.workunit.client.0.smithi111.stdout:3/88: dread - f1a zero size 2024-09-11T00:07:02.765 INFO:tasks.workunit.client.1.smithi203.stdout:8/101: mkdir d1/d13/d22 0 2024-09-11T00:07:02.766 INFO:tasks.workunit.client.1.smithi203.stdout:8/102: truncate d1/d13/f19 430648 0 2024-09-11T00:07:02.768 INFO:tasks.workunit.client.0.smithi111.stdout:8/49: dwrite fc [0,4194304] 0 2024-09-11T00:07:02.768 INFO:tasks.workunit.client.1.smithi203.stdout:3/165: creat d8/da/d37/f47 x:0 0 0 2024-09-11T00:07:02.770 INFO:tasks.workunit.client.1.smithi203.stdout:3/166: chown d8/l24 1014926 1 2024-09-11T00:07:02.771 INFO:tasks.workunit.client.1.smithi203.stdout:0/110: creat d0/f23 x:0 0 0 2024-09-11T00:07:02.773 INFO:tasks.workunit.client.1.smithi203.stdout:2/53: unlink lb 0 2024-09-11T00:07:02.774 INFO:tasks.workunit.client.1.smithi203.stdout:0/111: truncate d0/d2/f1a 792338 0 2024-09-11T00:07:02.775 INFO:tasks.workunit.client.0.smithi111.stdout:0/49: link f0 d3/f11 0 2024-09-11T00:07:02.780 INFO:tasks.workunit.client.0.smithi111.stdout:4/51: unlink fe 0 2024-09-11T00:07:02.780 INFO:tasks.workunit.client.1.smithi203.stdout:6/90: creat d0/d6/f18 x:0 0 0 2024-09-11T00:07:02.781 INFO:tasks.workunit.client.1.smithi203.stdout:6/91: fsync d0/f13 0 2024-09-11T00:07:02.781 INFO:tasks.workunit.client.0.smithi111.stdout:7/58: creat dd/f12 x:0 0 0 2024-09-11T00:07:02.782 INFO:tasks.workunit.client.0.smithi111.stdout:7/59: chown dd/f10 0 1 2024-09-11T00:07:02.783 INFO:tasks.workunit.client.1.smithi203.stdout:3/167: symlink d8/d2a/l48 0 2024-09-11T00:07:02.784 INFO:tasks.workunit.client.1.smithi203.stdout:9/126: mknod d6/c2f 0 2024-09-11T00:07:02.785 INFO:tasks.workunit.client.0.smithi111.stdout:7/60: dread dd/ff [0,4194304] 0 2024-09-11T00:07:02.785 INFO:tasks.workunit.client.0.smithi111.stdout:7/61: fsync f6 0 2024-09-11T00:07:02.786 INFO:tasks.workunit.client.1.smithi203.stdout:3/168: stat d8/da/d34 0 2024-09-11T00:07:02.786 INFO:tasks.workunit.client.1.smithi203.stdout:9/127: dread - d6/de/d19/d21/f25 zero size 2024-09-11T00:07:02.786 INFO:tasks.workunit.client.0.smithi111.stdout:7/62: readlink dd/le 0 2024-09-11T00:07:02.786 INFO:tasks.workunit.client.0.smithi111.stdout:2/72: symlink d0/d3/l14 0 2024-09-11T00:07:02.787 INFO:tasks.workunit.client.1.smithi203.stdout:8/103: mknod d1/d13/d22/c23 0 2024-09-11T00:07:02.788 INFO:tasks.workunit.client.0.smithi111.stdout:7/63: chown f8 1 1 2024-09-11T00:07:02.789 INFO:tasks.workunit.client.1.smithi203.stdout:2/54: dread f2 [0,4194304] 0 2024-09-11T00:07:02.789 INFO:tasks.workunit.client.0.smithi111.stdout:9/67: mknod d6/c16 0 2024-09-11T00:07:02.792 INFO:tasks.workunit.client.0.smithi111.stdout:3/89: symlink l1b 0 2024-09-11T00:07:02.793 INFO:tasks.workunit.client.1.smithi203.stdout:9/128: write d6/de/d19/d13/d29/f2b [659295,29441] 0 2024-09-11T00:07:02.793 INFO:tasks.workunit.client.1.smithi203.stdout:6/92: creat d0/d6/f19 x:0 0 0 2024-09-11T00:07:02.797 INFO:tasks.workunit.client.1.smithi203.stdout:3/169: rename d8/c3a to d8/d3c/c49 0 2024-09-11T00:07:02.797 INFO:tasks.workunit.client.0.smithi111.stdout:8/50: creat f10 x:0 0 0 2024-09-11T00:07:02.798 INFO:tasks.workunit.client.1.smithi203.stdout:2/55: creat f10 x:0 0 0 2024-09-11T00:07:02.800 INFO:tasks.workunit.client.0.smithi111.stdout:9/68: dread d6/db/ff [4194304,4194304] 0 2024-09-11T00:07:02.800 INFO:tasks.workunit.client.0.smithi111.stdout:5/61: link f7 d10/f13 0 2024-09-11T00:07:02.802 INFO:tasks.workunit.client.0.smithi111.stdout:5/62: chown ce 0 1 2024-09-11T00:07:02.803 INFO:tasks.workunit.client.0.smithi111.stdout:2/73: dwrite d0/d3/de/f11 [4194304,4194304] 0 2024-09-11T00:07:02.803 INFO:tasks.workunit.client.1.smithi203.stdout:9/129: chown d6/l1a 5584290 1 2024-09-11T00:07:02.804 INFO:tasks.workunit.client.0.smithi111.stdout:0/50: creat d3/dc/f12 x:0 0 0 2024-09-11T00:07:02.806 INFO:tasks.workunit.client.1.smithi203.stdout:6/93: dread d0/d6/fb [0,4194304] 0 2024-09-11T00:07:02.807 INFO:tasks.workunit.client.0.smithi111.stdout:1/20: mknod d2/c4 0 2024-09-11T00:07:02.807 INFO:tasks.workunit.client.0.smithi111.stdout:1/21: write - no filename 2024-09-11T00:07:02.808 INFO:tasks.workunit.client.1.smithi203.stdout:2/56: write f0 [2380999,43809] 0 2024-09-11T00:07:02.810 INFO:tasks.workunit.client.0.smithi111.stdout:3/90: dwrite f9 [0,4194304] 0 2024-09-11T00:07:02.811 INFO:tasks.workunit.client.1.smithi203.stdout:3/170: fdatasync d8/fb 0 2024-09-11T00:07:02.812 INFO:tasks.workunit.client.0.smithi111.stdout:3/91: write f2 [1277801,29099] 0 2024-09-11T00:07:02.817 INFO:tasks.workunit.client.1.smithi203.stdout:2/57: creat f11 x:0 0 0 2024-09-11T00:07:02.819 INFO:tasks.workunit.client.1.smithi203.stdout:2/58: write f11 [468446,103511] 0 2024-09-11T00:07:02.821 INFO:tasks.workunit.client.1.smithi203.stdout:2/59: chown le 0 1 2024-09-11T00:07:02.822 INFO:tasks.workunit.client.0.smithi111.stdout:7/64: symlink dd/l13 0 2024-09-11T00:07:02.822 INFO:tasks.workunit.client.0.smithi111.stdout:9/69: dwrite d6/db/ff [4194304,4194304] 0 2024-09-11T00:07:02.825 INFO:tasks.workunit.client.1.smithi203.stdout:3/171: symlink d8/d2a/l4a 0 2024-09-11T00:07:02.826 INFO:tasks.workunit.client.1.smithi203.stdout:9/130: dwrite d6/de/d19/d21/f25 [0,4194304] 0 2024-09-11T00:07:02.828 INFO:tasks.workunit.client.1.smithi203.stdout:3/172: rename d8 to d8/d17/d4b 22 2024-09-11T00:07:02.829 INFO:tasks.workunit.client.0.smithi111.stdout:8/51: mkdir d11 0 2024-09-11T00:07:02.833 INFO:tasks.workunit.client.1.smithi203.stdout:0/112: truncate d0/f18 219048 0 2024-09-11T00:07:02.834 INFO:tasks.workunit.client.0.smithi111.stdout:8/52: dread - f10 zero size 2024-09-11T00:07:02.834 INFO:tasks.workunit.client.0.smithi111.stdout:8/53: dread - f10 zero size 2024-09-11T00:07:02.835 INFO:tasks.workunit.client.0.smithi111.stdout:5/63: mknod d10/c14 0 2024-09-11T00:07:02.836 INFO:tasks.workunit.client.0.smithi111.stdout:3/92: dwrite f6 [0,4194304] 0 2024-09-11T00:07:02.837 INFO:tasks.workunit.client.0.smithi111.stdout:2/74: unlink d0/d3/fd 0 2024-09-11T00:07:02.837 INFO:tasks.workunit.client.0.smithi111.stdout:5/64: readlink d10/l11 0 2024-09-11T00:07:02.837 INFO:tasks.workunit.client.1.smithi203.stdout:9/131: mkdir d6/de/d19/d30 0 2024-09-11T00:07:02.839 INFO:tasks.workunit.client.0.smithi111.stdout:3/93: write f5 [5155532,78763] 0 2024-09-11T00:07:02.841 INFO:tasks.workunit.client.1.smithi203.stdout:9/132: chown d6/de/d19/d13/d29 31513 1 2024-09-11T00:07:02.841 INFO:tasks.workunit.client.0.smithi111.stdout:2/75: write d0/d3/f13 [249615,56423] 0 2024-09-11T00:07:02.841 INFO:tasks.workunit.client.0.smithi111.stdout:3/94: chown f19 91 1 2024-09-11T00:07:02.845 INFO:tasks.workunit.client.0.smithi111.stdout:3/95: write ff [1593245,44059] 0 2024-09-11T00:07:02.845 INFO:tasks.workunit.client.1.smithi203.stdout:9/133: write d6/de/d19/d24/f2d [266586,78228] 0 2024-09-11T00:07:02.845 INFO:tasks.workunit.client.1.smithi203.stdout:6/94: getdents d0/d6 0 2024-09-11T00:07:02.846 INFO:tasks.workunit.client.0.smithi111.stdout:4/52: mknod c11 0 2024-09-11T00:07:02.854 INFO:tasks.workunit.client.1.smithi203.stdout:0/113: dread d0/f5 [0,4194304] 0 2024-09-11T00:07:02.854 INFO:tasks.workunit.client.1.smithi203.stdout:0/114: dread - d0/d2/f1f zero size 2024-09-11T00:07:02.855 INFO:tasks.workunit.client.0.smithi111.stdout:8/54: dwrite fd [0,4194304] 0 2024-09-11T00:07:02.857 INFO:tasks.workunit.client.0.smithi111.stdout:8/55: write f10 [497979,130995] 0 2024-09-11T00:07:02.858 INFO:tasks.workunit.client.1.smithi203.stdout:3/173: dwrite d8/da/d34/f36 [0,4194304] 0 2024-09-11T00:07:02.859 INFO:tasks.workunit.client.0.smithi111.stdout:0/51: dwrite d3/fd [0,4194304] 0 2024-09-11T00:07:02.859 INFO:tasks.workunit.client.0.smithi111.stdout:0/52: stat d3/dc 0 2024-09-11T00:07:02.879 INFO:tasks.workunit.client.0.smithi111.stdout:8/56: dwrite f7 [0,4194304] 0 2024-09-11T00:07:02.880 INFO:tasks.workunit.client.0.smithi111.stdout:0/53: dwrite d3/f7 [0,4194304] 0 2024-09-11T00:07:02.882 INFO:tasks.workunit.client.1.smithi203.stdout:4/88: sync 2024-09-11T00:07:02.885 INFO:tasks.workunit.client.0.smithi111.stdout:6/49: link l5 d7/le 0 2024-09-11T00:07:02.889 INFO:tasks.workunit.client.0.smithi111.stdout:5/65: creat d10/f15 x:0 0 0 2024-09-11T00:07:02.900 INFO:tasks.workunit.client.1.smithi203.stdout:6/95: dwrite d0/d6/f18 [0,4194304] 0 2024-09-11T00:07:02.901 INFO:tasks.workunit.client.0.smithi111.stdout:0/54: dread d3/fd [0,4194304] 0 2024-09-11T00:07:02.904 INFO:tasks.workunit.client.0.smithi111.stdout:0/55: chown d3/dc 3 1 2024-09-11T00:07:02.904 INFO:tasks.workunit.client.0.smithi111.stdout:8/57: dwrite fd [0,4194304] 0 2024-09-11T00:07:02.904 INFO:tasks.workunit.client.1.smithi203.stdout:2/60: getdents . 0 2024-09-11T00:07:02.905 INFO:tasks.workunit.client.0.smithi111.stdout:0/56: read d3/fd [2008760,26772] 0 2024-09-11T00:07:02.905 INFO:tasks.workunit.client.1.smithi203.stdout:9/134: dwrite d6/de/d19/d13/d29/f2b [0,4194304] 0 2024-09-11T00:07:02.906 INFO:tasks.workunit.client.0.smithi111.stdout:8/58: chown ca 82082498 1 2024-09-11T00:07:02.907 INFO:tasks.workunit.client.1.smithi203.stdout:6/96: read - d0/f4 zero size 2024-09-11T00:07:02.907 INFO:tasks.workunit.client.0.smithi111.stdout:7/65: rmdir dd 39 2024-09-11T00:07:02.908 INFO:tasks.workunit.client.1.smithi203.stdout:4/89: symlink db/dd/d16/l17 0 2024-09-11T00:07:02.912 INFO:tasks.workunit.client.1.smithi203.stdout:6/97: write d0/d6/f19 [793585,24904] 0 2024-09-11T00:07:02.918 INFO:tasks.workunit.client.1.smithi203.stdout:2/61: mknod c12 0 2024-09-11T00:07:02.922 INFO:tasks.workunit.client.1.smithi203.stdout:9/135: creat d6/de/d19/f31 x:0 0 0 2024-09-11T00:07:02.923 INFO:tasks.workunit.client.0.smithi111.stdout:3/96: dwrite f17 [0,4194304] 0 2024-09-11T00:07:02.928 INFO:tasks.workunit.client.1.smithi203.stdout:4/90: symlink db/dd/d16/l18 0 2024-09-11T00:07:02.933 INFO:tasks.workunit.client.1.smithi203.stdout:4/91: write f9 [855108,130324] 0 2024-09-11T00:07:02.935 INFO:tasks.workunit.client.1.smithi203.stdout:2/62: mkdir d13 0 2024-09-11T00:07:02.941 INFO:tasks.workunit.client.1.smithi203.stdout:6/98: dwrite d0/f14 [0,4194304] 0 2024-09-11T00:07:02.943 INFO:tasks.workunit.client.0.smithi111.stdout:6/50: unlink d7/cc 0 2024-09-11T00:07:02.947 INFO:tasks.workunit.client.1.smithi203.stdout:0/115: dwrite d0/f18 [0,4194304] 0 2024-09-11T00:07:02.953 INFO:tasks.workunit.client.0.smithi111.stdout:2/76: mknod d0/d3/d12/c15 0 2024-09-11T00:07:02.953 INFO:tasks.workunit.client.0.smithi111.stdout:6/51: dread f3 [0,4194304] 0 2024-09-11T00:07:02.955 INFO:tasks.workunit.client.0.smithi111.stdout:6/52: chown d7/fd 6 1 2024-09-11T00:07:02.955 INFO:tasks.workunit.client.0.smithi111.stdout:2/77: write d0/f4 [2601077,121452] 0 2024-09-11T00:07:02.956 INFO:tasks.workunit.client.1.smithi203.stdout:9/136: mkdir d6/de/d32 0 2024-09-11T00:07:02.961 INFO:tasks.workunit.client.1.smithi203.stdout:6/99: mknod d0/d6/c1a 0 2024-09-11T00:07:02.963 INFO:tasks.workunit.client.1.smithi203.stdout:2/63: creat d13/f14 x:0 0 0 2024-09-11T00:07:02.964 INFO:tasks.workunit.client.0.smithi111.stdout:4/53: symlink l12 0 2024-09-11T00:07:02.965 INFO:tasks.workunit.client.0.smithi111.stdout:5/66: dread f1 [0,4194304] 0 2024-09-11T00:07:02.965 INFO:tasks.workunit.client.0.smithi111.stdout:3/97: mkdir d1c 0 2024-09-11T00:07:02.966 INFO:tasks.workunit.client.0.smithi111.stdout:3/98: chown f3 1 1 2024-09-11T00:07:02.967 INFO:tasks.workunit.client.1.smithi203.stdout:4/92: truncate f2 1199317 0 2024-09-11T00:07:02.967 INFO:tasks.workunit.client.1.smithi203.stdout:9/137: dread d6/de/d19/d24/f2d [0,4194304] 0 2024-09-11T00:07:02.970 INFO:tasks.workunit.client.1.smithi203.stdout:4/93: dread - db/dd/f13 zero size 2024-09-11T00:07:02.972 INFO:tasks.workunit.client.0.smithi111.stdout:2/78: dwrite d0/fc [0,4194304] 0 2024-09-11T00:07:02.973 INFO:tasks.workunit.client.0.smithi111.stdout:1/22: getdents d2 0 2024-09-11T00:07:02.973 INFO:tasks.workunit.client.0.smithi111.stdout:1/23: readlink l0 0 2024-09-11T00:07:02.974 INFO:tasks.workunit.client.0.smithi111.stdout:1/24: chown l1 655842 1 2024-09-11T00:07:02.977 INFO:tasks.workunit.client.0.smithi111.stdout:0/57: mkdir d3/d13 0 2024-09-11T00:07:02.977 INFO:tasks.workunit.client.1.smithi203.stdout:0/116: dwrite d0/fc [0,4194304] 0 2024-09-11T00:07:02.978 INFO:tasks.workunit.client.0.smithi111.stdout:0/58: chown d3/dc/l10 181055 1 2024-09-11T00:07:02.978 INFO:tasks.workunit.client.0.smithi111.stdout:0/59: fsync d3/da/ff 0 2024-09-11T00:07:02.979 INFO:tasks.workunit.client.1.smithi203.stdout:6/100: dread d0/f10 [0,4194304] 0 2024-09-11T00:07:02.984 INFO:tasks.workunit.client.0.smithi111.stdout:8/59: creat d11/f12 x:0 0 0 2024-09-11T00:07:02.985 INFO:tasks.workunit.client.0.smithi111.stdout:8/60: write fe [760678,5668] 0 2024-09-11T00:07:02.987 INFO:tasks.workunit.client.0.smithi111.stdout:8/61: fsync fb 0 2024-09-11T00:07:02.987 INFO:tasks.workunit.client.0.smithi111.stdout:6/53: creat d7/ff x:0 0 0 2024-09-11T00:07:02.987 INFO:tasks.workunit.client.0.smithi111.stdout:2/79: dwrite d0/d3/f13 [0,4194304] 0 2024-09-11T00:07:02.988 INFO:tasks.workunit.client.1.smithi203.stdout:2/64: dwrite f9 [4194304,4194304] 0 2024-09-11T00:07:02.990 INFO:tasks.workunit.client.1.smithi203.stdout:9/138: readlink d6/de/d19/l12 0 2024-09-11T00:07:03.000 INFO:tasks.workunit.client.0.smithi111.stdout:7/66: creat dd/f14 x:0 0 0 2024-09-11T00:07:03.001 INFO:tasks.workunit.client.0.smithi111.stdout:7/67: truncate dd/f14 393159 0 2024-09-11T00:07:03.002 INFO:tasks.workunit.client.1.smithi203.stdout:0/117: dwrite d0/d2/f12 [0,4194304] 0 2024-09-11T00:07:03.006 INFO:tasks.workunit.client.1.smithi203.stdout:6/101: rmdir d0/d6 39 2024-09-11T00:07:03.006 INFO:tasks.workunit.client.1.smithi203.stdout:2/65: unlink c6 0 2024-09-11T00:07:03.009 INFO:tasks.workunit.client.1.smithi203.stdout:2/66: write f4 [5200470,98923] 0 2024-09-11T00:07:03.015 INFO:tasks.workunit.client.0.smithi111.stdout:9/70: dwrite d6/db/fd [0,4194304] 0 2024-09-11T00:07:03.016 INFO:tasks.workunit.client.1.smithi203.stdout:0/118: dread d0/d2/f3 [4194304,4194304] 0 2024-09-11T00:07:03.021 INFO:tasks.workunit.client.1.smithi203.stdout:4/94: read db/f10 [1160095,30285] 0 2024-09-11T00:07:03.025 INFO:tasks.workunit.client.1.smithi203.stdout:4/95: dread - db/dd/f11 zero size 2024-09-11T00:07:03.030 INFO:tasks.workunit.client.1.smithi203.stdout:4/96: write db/dd/f13 [543212,70985] 0 2024-09-11T00:07:03.033 INFO:tasks.workunit.client.1.smithi203.stdout:6/102: mknod d0/c1b 0 2024-09-11T00:07:03.034 INFO:tasks.workunit.client.1.smithi203.stdout:2/67: dwrite f11 [0,4194304] 0 2024-09-11T00:07:03.037 INFO:tasks.workunit.client.1.smithi203.stdout:0/119: unlink d0/d1d/f21 0 2024-09-11T00:07:03.042 INFO:tasks.workunit.client.1.smithi203.stdout:4/97: mkdir db/dd/d19 0 2024-09-11T00:07:03.046 INFO:tasks.workunit.client.1.smithi203.stdout:6/103: fsync d0/f8 0 2024-09-11T00:07:03.057 INFO:tasks.workunit.client.1.smithi203.stdout:2/68: dwrite fd [0,4194304] 0 2024-09-11T00:07:03.068 INFO:tasks.workunit.client.1.smithi203.stdout:2/69: mkdir d13/d15 0 2024-09-11T00:07:03.073 INFO:tasks.workunit.client.1.smithi203.stdout:0/120: link d0/d2/fd d0/f24 0 2024-09-11T00:07:03.076 INFO:tasks.workunit.client.1.smithi203.stdout:6/104: dwrite d0/d6/f18 [4194304,4194304] 0 2024-09-11T00:07:03.082 INFO:tasks.workunit.client.1.smithi203.stdout:6/105: creat d0/d6/f1c x:0 0 0 2024-09-11T00:07:03.087 INFO:tasks.workunit.client.1.smithi203.stdout:2/70: dwrite f11 [0,4194304] 0 2024-09-11T00:07:03.090 INFO:tasks.workunit.client.1.smithi203.stdout:4/98: truncate f9 2064550 0 2024-09-11T00:07:03.090 INFO:tasks.workunit.client.1.smithi203.stdout:4/99: rename db to db/d12/d15/d1a 22 2024-09-11T00:07:03.093 INFO:tasks.workunit.client.1.smithi203.stdout:6/106: fdatasync d0/f1 0 2024-09-11T00:07:03.094 INFO:tasks.workunit.client.1.smithi203.stdout:2/71: unlink f9 0 2024-09-11T00:07:03.112 INFO:tasks.workunit.client.1.smithi203.stdout:4/100: link db/dd/fe db/dd/d19/f1b 0 2024-09-11T00:07:03.113 INFO:tasks.workunit.client.1.smithi203.stdout:6/107: dwrite d0/f14 [0,4194304] 0 2024-09-11T00:07:03.114 INFO:tasks.workunit.client.1.smithi203.stdout:2/72: getdents d13/d15 0 2024-09-11T00:07:03.115 INFO:tasks.workunit.client.1.smithi203.stdout:2/73: readlink le 0 2024-09-11T00:07:03.125 INFO:tasks.workunit.client.1.smithi203.stdout:6/108: dread d0/d6/f18 [4194304,4194304] 0 2024-09-11T00:07:03.131 INFO:tasks.workunit.client.1.smithi203.stdout:0/121: write d0/d2/fb [1168122,74868] 0 2024-09-11T00:07:03.135 INFO:tasks.workunit.client.1.smithi203.stdout:2/74: symlink d13/d15/l16 0 2024-09-11T00:07:03.146 INFO:tasks.workunit.client.1.smithi203.stdout:4/101: dwrite f9 [0,4194304] 0 2024-09-11T00:07:03.150 INFO:tasks.workunit.client.1.smithi203.stdout:6/109: dwrite d0/d6/f19 [0,4194304] 0 2024-09-11T00:07:03.161 INFO:tasks.workunit.client.1.smithi203.stdout:2/75: dwrite fd [0,4194304] 0 2024-09-11T00:07:03.168 INFO:tasks.workunit.client.1.smithi203.stdout:2/76: creat d13/f17 x:0 0 0 2024-09-11T00:07:03.172 INFO:tasks.workunit.client.1.smithi203.stdout:7/156: sync 2024-09-11T00:07:03.172 INFO:tasks.workunit.client.1.smithi203.stdout:5/159: sync 2024-09-11T00:07:03.176 INFO:tasks.workunit.client.1.smithi203.stdout:2/77: rename le to d13/l18 0 2024-09-11T00:07:03.176 INFO:tasks.workunit.client.1.smithi203.stdout:6/110: dwrite d0/d6/f19 [0,4194304] 0 2024-09-11T00:07:03.185 INFO:tasks.workunit.client.1.smithi203.stdout:0/122: truncate d0/f18 1832518 0 2024-09-11T00:07:03.186 INFO:tasks.workunit.client.0.smithi111.stdout:1/25: symlink d2/l5 0 2024-09-11T00:07:03.186 INFO:tasks.workunit.client.0.smithi111.stdout:1/26: dread - no filename 2024-09-11T00:07:03.186 INFO:tasks.workunit.client.0.smithi111.stdout:1/27: write - no filename 2024-09-11T00:07:03.187 INFO:tasks.workunit.client.1.smithi203.stdout:6/111: rename d0/d6/l17 to d0/d6/l1d 0 2024-09-11T00:07:03.188 INFO:tasks.workunit.client.0.smithi111.stdout:0/60: truncate f1 1438999 0 2024-09-11T00:07:03.189 INFO:tasks.workunit.client.0.smithi111.stdout:0/61: chown d3/da 292218 1 2024-09-11T00:07:03.191 INFO:tasks.workunit.client.1.smithi203.stdout:5/160: write dc/dd/d15/f19 [1196771,124617] 0 2024-09-11T00:07:03.193 INFO:tasks.workunit.client.1.smithi203.stdout:7/157: link dd/f30 dd/d1c/d26/d31/f39 0 2024-09-11T00:07:03.194 INFO:tasks.workunit.client.0.smithi111.stdout:6/54: symlink d7/l10 0 2024-09-11T00:07:03.197 INFO:tasks.workunit.client.0.smithi111.stdout:2/80: mknod d0/d3/de/c16 0 2024-09-11T00:07:03.198 INFO:tasks.workunit.client.0.smithi111.stdout:2/81: readlink d0/d3/lf 0 2024-09-11T00:07:03.198 INFO:tasks.workunit.client.0.smithi111.stdout:0/62: dread d3/fd [0,4194304] 0 2024-09-11T00:07:03.199 INFO:tasks.workunit.client.0.smithi111.stdout:2/82: fdatasync d0/d3/f13 0 2024-09-11T00:07:03.200 INFO:tasks.workunit.client.1.smithi203.stdout:7/158: creat dd/d1c/f3a x:0 0 0 2024-09-11T00:07:03.201 INFO:tasks.workunit.client.0.smithi111.stdout:2/83: chown d0/d3/de/c16 30 1 2024-09-11T00:07:03.204 INFO:tasks.workunit.client.0.smithi111.stdout:9/71: creat d6/dc/f17 x:0 0 0 2024-09-11T00:07:03.205 INFO:tasks.workunit.client.1.smithi203.stdout:0/123: dwrite d0/f5 [4194304,4194304] 0 2024-09-11T00:07:03.207 INFO:tasks.workunit.client.1.smithi203.stdout:6/112: creat d0/f1e x:0 0 0 2024-09-11T00:07:03.208 INFO:tasks.workunit.client.1.smithi203.stdout:2/78: rmdir d13 39 2024-09-11T00:07:03.209 INFO:tasks.workunit.client.0.smithi111.stdout:2/84: dread d0/fc [0,4194304] 0 2024-09-11T00:07:03.210 INFO:tasks.workunit.client.1.smithi203.stdout:4/102: dwrite f1 [0,4194304] 0 2024-09-11T00:07:03.211 INFO:tasks.workunit.client.1.smithi203.stdout:5/161: link dc/dd/d13/f1a dc/dd/f2f 0 2024-09-11T00:07:03.215 INFO:tasks.workunit.client.0.smithi111.stdout:3/99: mkdir d1c/d1d 0 2024-09-11T00:07:03.219 INFO:tasks.workunit.client.0.smithi111.stdout:2/85: dread d0/f4 [0,4194304] 0 2024-09-11T00:07:03.219 INFO:tasks.workunit.client.0.smithi111.stdout:2/86: chown d0/d3/de 61402908 1 2024-09-11T00:07:03.220 INFO:tasks.workunit.client.1.smithi203.stdout:0/124: rmdir d0/d1d 39 2024-09-11T00:07:03.224 INFO:tasks.workunit.client.0.smithi111.stdout:1/28: symlink d2/l6 0 2024-09-11T00:07:03.224 INFO:tasks.workunit.client.0.smithi111.stdout:1/29: dread - no filename 2024-09-11T00:07:03.225 INFO:tasks.workunit.client.1.smithi203.stdout:0/125: dread - d0/f15 zero size 2024-09-11T00:07:03.228 INFO:tasks.workunit.client.1.smithi203.stdout:4/103: dread f1 [0,4194304] 0 2024-09-11T00:07:03.229 INFO:tasks.workunit.client.1.smithi203.stdout:0/126: chown d0/f23 1 1 2024-09-11T00:07:03.230 INFO:tasks.workunit.client.0.smithi111.stdout:6/55: truncate f3 264868 0 2024-09-11T00:07:03.234 INFO:tasks.workunit.client.1.smithi203.stdout:6/113: dwrite d0/f1e [0,4194304] 0 2024-09-11T00:07:03.242 INFO:tasks.workunit.client.1.smithi203.stdout:0/127: unlink d0/fc 0 2024-09-11T00:07:03.252 INFO:tasks.workunit.client.1.smithi203.stdout:4/104: dwrite db/dd/f11 [0,4194304] 0 2024-09-11T00:07:03.254 INFO:tasks.workunit.client.1.smithi203.stdout:6/114: symlink d0/l1f 0 2024-09-11T00:07:03.256 INFO:tasks.workunit.client.1.smithi203.stdout:0/128: symlink d0/d1d/l25 0 2024-09-11T00:07:03.256 INFO:tasks.workunit.client.1.smithi203.stdout:5/162: getdents dc/dd/d15 0 2024-09-11T00:07:03.258 INFO:tasks.workunit.client.1.smithi203.stdout:4/105: mknod db/dd/c1c 0 2024-09-11T00:07:03.258 INFO:tasks.workunit.client.1.smithi203.stdout:5/163: fsync dc/dd/d13/f18 0 2024-09-11T00:07:03.261 INFO:tasks.workunit.client.1.smithi203.stdout:4/106: truncate f2 4216816 0 2024-09-11T00:07:03.262 INFO:tasks.workunit.client.0.smithi111.stdout:7/68: rename dd/f14 to dd/f15 0 2024-09-11T00:07:03.262 INFO:tasks.workunit.client.0.smithi111.stdout:6/56: fsync d7/fb 0 2024-09-11T00:07:03.263 INFO:tasks.workunit.client.0.smithi111.stdout:9/72: readlink d6/dc/d13/l15 0 2024-09-11T00:07:03.263 INFO:tasks.workunit.client.0.smithi111.stdout:2/87: symlink d0/d3/d12/l17 0 2024-09-11T00:07:03.263 INFO:tasks.workunit.client.0.smithi111.stdout:1/30: rename d2/l3 to d2/l7 0 2024-09-11T00:07:03.264 INFO:tasks.workunit.client.0.smithi111.stdout:1/31: fdatasync - no filename 2024-09-11T00:07:03.265 INFO:tasks.workunit.client.0.smithi111.stdout:6/57: write d7/ff [537599,125622] 0 2024-09-11T00:07:03.265 INFO:tasks.workunit.client.0.smithi111.stdout:4/54: getdents . 0 2024-09-11T00:07:03.266 INFO:tasks.workunit.client.1.smithi203.stdout:5/164: write dc/dd/d15/f19 [1264418,129439] 0 2024-09-11T00:07:03.266 INFO:tasks.workunit.client.0.smithi111.stdout:5/67: getdents d10 0 2024-09-11T00:07:03.268 INFO:tasks.workunit.client.0.smithi111.stdout:3/100: creat d1c/d1d/f1e x:0 0 0 2024-09-11T00:07:03.268 INFO:tasks.workunit.client.0.smithi111.stdout:8/62: getdents d11 0 2024-09-11T00:07:03.269 INFO:tasks.workunit.client.0.smithi111.stdout:7/69: fsync dd/ff 0 2024-09-11T00:07:03.272 INFO:tasks.workunit.client.0.smithi111.stdout:1/32: unlink l1 0 2024-09-11T00:07:03.274 INFO:tasks.workunit.client.0.smithi111.stdout:4/55: unlink l12 0 2024-09-11T00:07:03.275 INFO:tasks.workunit.client.0.smithi111.stdout:4/56: rmdir - no directory 2024-09-11T00:07:03.276 INFO:tasks.workunit.client.0.smithi111.stdout:5/68: creat d10/f16 x:0 0 0 2024-09-11T00:07:03.278 INFO:tasks.workunit.client.1.smithi203.stdout:5/165: link dc/dd/l26 dc/dd/d13/l30 0 2024-09-11T00:07:03.278 INFO:tasks.workunit.client.1.smithi203.stdout:6/115: dwrite d0/d6/f1c [0,4194304] 0 2024-09-11T00:07:03.282 INFO:tasks.workunit.client.1.smithi203.stdout:6/116: stat d0/f4 0 2024-09-11T00:07:03.283 INFO:tasks.workunit.client.1.smithi203.stdout:0/129: dwrite d0/d2/f3 [0,4194304] 0 2024-09-11T00:07:03.286 INFO:tasks.workunit.client.1.smithi203.stdout:6/117: read d0/f5 [2250886,83706] 0 2024-09-11T00:07:03.289 INFO:tasks.workunit.client.1.smithi203.stdout:4/107: dwrite db/dd/f13 [0,4194304] 0 2024-09-11T00:07:03.296 INFO:tasks.workunit.client.1.smithi203.stdout:4/108: symlink db/d12/d15/l1d 0 2024-09-11T00:07:03.301 INFO:tasks.workunit.client.1.smithi203.stdout:4/109: creat db/d12/f1e x:0 0 0 2024-09-11T00:07:03.302 INFO:tasks.workunit.client.1.smithi203.stdout:4/110: chown db/dd/d16 35111702 1 2024-09-11T00:07:03.303 INFO:tasks.workunit.client.1.smithi203.stdout:0/130: dread d0/f5 [4194304,4194304] 0 2024-09-11T00:07:03.303 INFO:tasks.workunit.client.1.smithi203.stdout:5/166: dwrite dc/dd/d1e/f29 [0,4194304] 0 2024-09-11T00:07:03.304 INFO:tasks.workunit.client.1.smithi203.stdout:4/111: chown db/dd/d16/l18 442 1 2024-09-11T00:07:03.306 INFO:tasks.workunit.client.1.smithi203.stdout:4/112: read f9 [3328598,80206] 0 2024-09-11T00:07:03.309 INFO:tasks.workunit.client.1.smithi203.stdout:5/167: truncate dc/dd/d15/f1d 1568601 0 2024-09-11T00:07:03.310 INFO:tasks.workunit.client.1.smithi203.stdout:4/113: symlink db/l1f 0 2024-09-11T00:07:03.314 INFO:tasks.workunit.client.1.smithi203.stdout:5/168: getdents dc/d2b 0 2024-09-11T00:07:03.320 INFO:tasks.workunit.client.1.smithi203.stdout:5/169: symlink dc/dd/d1e/l31 0 2024-09-11T00:07:03.325 INFO:tasks.workunit.client.1.smithi203.stdout:5/170: write dc/dd/d1e/f27 [17879,106107] 0 2024-09-11T00:07:03.339 INFO:tasks.workunit.client.0.smithi111.stdout:2/88: mknod d0/c18 0 2024-09-11T00:07:03.339 INFO:tasks.workunit.client.0.smithi111.stdout:8/63: getdents d11 0 2024-09-11T00:07:03.340 INFO:tasks.workunit.client.0.smithi111.stdout:5/69: creat d10/f17 x:0 0 0 2024-09-11T00:07:03.340 INFO:tasks.workunit.client.0.smithi111.stdout:2/89: chown d0/c18 2524931 1 2024-09-11T00:07:03.341 INFO:tasks.workunit.client.0.smithi111.stdout:9/73: creat d6/db/f18 x:0 0 0 2024-09-11T00:07:03.342 INFO:tasks.workunit.client.0.smithi111.stdout:7/70: dwrite f6 [8388608,4194304] 0 2024-09-11T00:07:03.343 INFO:tasks.workunit.client.0.smithi111.stdout:9/74: dread - d6/dc/f17 zero size 2024-09-11T00:07:03.346 INFO:tasks.workunit.client.0.smithi111.stdout:5/70: read f5 [452016,87154] 0 2024-09-11T00:07:03.348 INFO:tasks.workunit.client.0.smithi111.stdout:8/64: rename fc to d11/f13 0 2024-09-11T00:07:03.349 INFO:tasks.workunit.client.0.smithi111.stdout:8/65: dread - f8 zero size 2024-09-11T00:07:03.350 INFO:tasks.workunit.client.0.smithi111.stdout:8/66: chown f9 5437 1 2024-09-11T00:07:03.352 INFO:tasks.workunit.client.0.smithi111.stdout:4/57: dread f7 [0,4194304] 0 2024-09-11T00:07:03.352 INFO:tasks.workunit.client.0.smithi111.stdout:7/71: symlink dd/l16 0 2024-09-11T00:07:03.353 INFO:tasks.workunit.client.0.smithi111.stdout:7/72: write dd/f10 [839815,65251] 0 2024-09-11T00:07:03.355 INFO:tasks.workunit.client.0.smithi111.stdout:9/75: creat d6/dc/d13/f19 x:0 0 0 2024-09-11T00:07:03.355 INFO:tasks.workunit.client.0.smithi111.stdout:7/73: chown dd/f15 4742 1 2024-09-11T00:07:03.356 INFO:tasks.workunit.client.0.smithi111.stdout:9/76: read d6/db/ff [7767350,110082] 0 2024-09-11T00:07:03.356 INFO:tasks.workunit.client.0.smithi111.stdout:5/71: mknod d10/c18 0 2024-09-11T00:07:03.361 INFO:tasks.workunit.client.0.smithi111.stdout:8/67: unlink fe 0 2024-09-11T00:07:03.364 INFO:tasks.workunit.client.0.smithi111.stdout:7/74: dread f6 [8388608,4194304] 0 2024-09-11T00:07:03.364 INFO:tasks.workunit.client.1.smithi203.stdout:2/79: truncate f8 1523144 0 2024-09-11T00:07:03.365 INFO:tasks.workunit.client.1.smithi203.stdout:2/80: chown f10 4090140 1 2024-09-11T00:07:03.365 INFO:tasks.workunit.client.0.smithi111.stdout:5/72: creat d10/f19 x:0 0 0 2024-09-11T00:07:03.366 INFO:tasks.workunit.client.0.smithi111.stdout:2/90: link d0/l1 d0/d3/de/l19 0 2024-09-11T00:07:03.366 INFO:tasks.workunit.client.0.smithi111.stdout:5/73: stat f2 0 2024-09-11T00:07:03.368 INFO:tasks.workunit.client.0.smithi111.stdout:8/68: fsync f8 0 2024-09-11T00:07:03.371 INFO:tasks.workunit.client.1.smithi203.stdout:2/81: readlink d13/l18 0 2024-09-11T00:07:03.371 INFO:tasks.workunit.client.0.smithi111.stdout:1/33: getdents d2 0 2024-09-11T00:07:03.373 INFO:tasks.workunit.client.1.smithi203.stdout:6/118: getdents d0 0 2024-09-11T00:07:03.375 INFO:tasks.workunit.client.0.smithi111.stdout:7/75: creat dd/f17 x:0 0 0 2024-09-11T00:07:03.377 INFO:tasks.workunit.client.0.smithi111.stdout:7/76: read dd/ff [483126,76806] 0 2024-09-11T00:07:03.380 INFO:tasks.workunit.client.1.smithi203.stdout:6/119: symlink d0/l20 0 2024-09-11T00:07:03.380 INFO:tasks.workunit.client.0.smithi111.stdout:0/63: sync 2024-09-11T00:07:03.381 INFO:tasks.workunit.client.0.smithi111.stdout:8/69: dwrite f7 [4194304,4194304] 0 2024-09-11T00:07:03.381 INFO:tasks.workunit.client.0.smithi111.stdout:0/64: chown f0 18662083 1 2024-09-11T00:07:03.382 INFO:tasks.workunit.client.0.smithi111.stdout:3/101: rmdir d1c/d1d 39 2024-09-11T00:07:03.386 INFO:tasks.workunit.client.0.smithi111.stdout:3/102: dread - f19 zero size 2024-09-11T00:07:03.386 INFO:tasks.workunit.client.0.smithi111.stdout:1/34: symlink d2/l8 0 2024-09-11T00:07:03.386 INFO:tasks.workunit.client.0.smithi111.stdout:1/35: write - no filename 2024-09-11T00:07:03.386 INFO:tasks.workunit.client.0.smithi111.stdout:1/36: dread - no filename 2024-09-11T00:07:03.386 INFO:tasks.workunit.client.0.smithi111.stdout:1/37: fdatasync - no filename 2024-09-11T00:07:03.391 INFO:tasks.workunit.client.1.smithi203.stdout:5/171: rmdir dc/dd/d13 39 2024-09-11T00:07:03.391 INFO:tasks.workunit.client.0.smithi111.stdout:4/58: unlink fb 0 2024-09-11T00:07:03.391 INFO:tasks.workunit.client.0.smithi111.stdout:2/91: dread d0/fc [0,4194304] 0 2024-09-11T00:07:03.391 INFO:tasks.workunit.client.1.smithi203.stdout:6/120: fdatasync d0/f4 0 2024-09-11T00:07:03.394 INFO:tasks.workunit.client.0.smithi111.stdout:7/77: dread f7 [0,4194304] 0 2024-09-11T00:07:03.396 INFO:tasks.workunit.client.0.smithi111.stdout:1/38: unlink d2/c4 0 2024-09-11T00:07:03.399 INFO:tasks.workunit.client.0.smithi111.stdout:9/77: getdents d6 0 2024-09-11T00:07:03.401 INFO:tasks.workunit.client.1.smithi203.stdout:0/131: write d0/d2/fd [875305,65098] 0 2024-09-11T00:07:03.404 INFO:tasks.workunit.client.0.smithi111.stdout:9/78: chown l1 12557 1 2024-09-11T00:07:03.404 INFO:tasks.workunit.client.1.smithi203.stdout:5/172: creat dc/dd/f32 x:0 0 0 2024-09-11T00:07:03.406 INFO:tasks.workunit.client.0.smithi111.stdout:4/59: write f9 [4971447,114972] 0 2024-09-11T00:07:03.407 INFO:tasks.workunit.client.1.smithi203.stdout:0/132: mknod d0/d1d/c26 0 2024-09-11T00:07:03.411 INFO:tasks.workunit.client.0.smithi111.stdout:8/70: dwrite f8 [0,4194304] 0 2024-09-11T00:07:03.411 INFO:tasks.workunit.client.0.smithi111.stdout:8/71: readlink - no filename 2024-09-11T00:07:03.411 INFO:tasks.workunit.client.0.smithi111.stdout:0/65: dwrite d3/da/ff [0,4194304] 0 2024-09-11T00:07:03.412 INFO:tasks.workunit.client.0.smithi111.stdout:9/79: dread - d6/dc/d13/f19 zero size 2024-09-11T00:07:03.413 INFO:tasks.workunit.client.0.smithi111.stdout:3/103: dwrite f6 [0,4194304] 0 2024-09-11T00:07:03.413 INFO:tasks.workunit.client.0.smithi111.stdout:9/80: chown d6/dc 1 1 2024-09-11T00:07:03.415 INFO:tasks.workunit.client.1.smithi203.stdout:0/133: write d0/d2/f8 [1717686,117154] 0 2024-09-11T00:07:03.418 INFO:tasks.workunit.client.1.smithi203.stdout:0/134: chown d0/d2/f13 965 1 2024-09-11T00:07:03.423 INFO:tasks.workunit.client.1.smithi203.stdout:5/173: mknod dc/dd/d13/c33 0 2024-09-11T00:07:03.426 INFO:tasks.workunit.client.1.smithi203.stdout:2/82: write f8 [2065725,24722] 0 2024-09-11T00:07:03.427 INFO:tasks.workunit.client.1.smithi203.stdout:2/83: stat f7 0 2024-09-11T00:07:03.428 INFO:tasks.workunit.client.1.smithi203.stdout:2/84: stat f8 0 2024-09-11T00:07:03.430 INFO:tasks.workunit.client.0.smithi111.stdout:0/66: write d3/fd [3680583,62891] 0 2024-09-11T00:07:03.431 INFO:tasks.workunit.client.0.smithi111.stdout:8/72: dwrite f9 [4194304,4194304] 0 2024-09-11T00:07:03.431 INFO:tasks.workunit.client.0.smithi111.stdout:8/73: chown f8 8584 1 2024-09-11T00:07:03.431 INFO:tasks.workunit.client.0.smithi111.stdout:8/74: readlink - no filename 2024-09-11T00:07:03.433 INFO:tasks.workunit.client.0.smithi111.stdout:8/75: chown d11/f13 15 1 2024-09-11T00:07:03.434 INFO:tasks.workunit.client.1.smithi203.stdout:5/174: rename dc/l20 to dc/dd/d15/l34 0 2024-09-11T00:07:03.437 INFO:tasks.workunit.client.0.smithi111.stdout:9/81: symlink d6/dc/l1a 0 2024-09-11T00:07:03.441 INFO:tasks.workunit.client.1.smithi203.stdout:6/121: getdents d0 0 2024-09-11T00:07:03.443 INFO:tasks.workunit.client.0.smithi111.stdout:2/92: creat d0/f1a x:0 0 0 2024-09-11T00:07:03.444 INFO:tasks.workunit.client.1.smithi203.stdout:2/85: mkdir d13/d15/d19 0 2024-09-11T00:07:03.447 INFO:tasks.workunit.client.1.smithi203.stdout:1/140: sync 2024-09-11T00:07:03.447 INFO:tasks.workunit.client.1.smithi203.stdout:0/135: dwrite d0/d2/fe [0,4194304] 0 2024-09-11T00:07:03.448 INFO:tasks.workunit.client.0.smithi111.stdout:5/74: dwrite d10/f13 [0,4194304] 0 2024-09-11T00:07:03.448 INFO:tasks.workunit.client.0.smithi111.stdout:0/67: dread f2 [0,4194304] 0 2024-09-11T00:07:03.452 INFO:tasks.workunit.client.1.smithi203.stdout:5/175: creat dc/dd/d13/f35 x:0 0 0 2024-09-11T00:07:03.452 INFO:tasks.workunit.client.1.smithi203.stdout:6/122: creat d0/f21 x:0 0 0 2024-09-11T00:07:03.455 INFO:tasks.workunit.client.1.smithi203.stdout:2/86: rename f10 to d13/d15/f1a 0 2024-09-11T00:07:03.461 INFO:tasks.workunit.client.0.smithi111.stdout:8/76: symlink d11/l14 0 2024-09-11T00:07:03.463 INFO:tasks.workunit.client.1.smithi203.stdout:0/136: symlink d0/d2/l27 0 2024-09-11T00:07:03.466 INFO:tasks.workunit.client.0.smithi111.stdout:3/104: rename f13 to d1c/d1d/f1f 0 2024-09-11T00:07:03.469 INFO:tasks.workunit.client.0.smithi111.stdout:1/39: getdents d2 0 2024-09-11T00:07:03.478 INFO:tasks.workunit.client.1.smithi203.stdout:0/137: symlink d0/d2/l28 0 2024-09-11T00:07:03.479 INFO:tasks.workunit.client.0.smithi111.stdout:4/60: truncate f7 1458964 0 2024-09-11T00:07:03.482 INFO:tasks.workunit.client.1.smithi203.stdout:1/141: write d8/d9/d15/f25 [1602052,1024] 0 2024-09-11T00:07:03.485 INFO:tasks.workunit.client.0.smithi111.stdout:8/77: rename fb to d11/f15 0 2024-09-11T00:07:03.487 INFO:tasks.workunit.client.1.smithi203.stdout:2/87: link f8 d13/d15/f1b 0 2024-09-11T00:07:03.488 INFO:tasks.workunit.client.0.smithi111.stdout:9/82: mkdir d6/db/d1b 0 2024-09-11T00:07:03.490 INFO:tasks.workunit.client.0.smithi111.stdout:9/83: read d6/db/fd [82040,55897] 0 2024-09-11T00:07:03.491 INFO:tasks.workunit.client.0.smithi111.stdout:1/40: creat d2/f9 x:0 0 0 2024-09-11T00:07:03.492 INFO:tasks.workunit.client.0.smithi111.stdout:9/84: readlink d6/dc/l1a 0 2024-09-11T00:07:03.493 INFO:tasks.workunit.client.1.smithi203.stdout:1/142: dread d8/d9/fd [0,4194304] 0 2024-09-11T00:07:03.494 INFO:tasks.workunit.client.0.smithi111.stdout:0/68: mknod d3/d13/c14 0 2024-09-11T00:07:03.494 INFO:tasks.workunit.client.0.smithi111.stdout:1/41: truncate d2/f9 194475 0 2024-09-11T00:07:03.497 INFO:tasks.workunit.client.0.smithi111.stdout:4/61: readlink l4 0 2024-09-11T00:07:03.499 INFO:tasks.workunit.client.0.smithi111.stdout:3/105: rename f15 to d1c/d1d/f20 0 2024-09-11T00:07:03.500 INFO:tasks.workunit.client.0.smithi111.stdout:4/62: write f9 [5794822,105797] 0 2024-09-11T00:07:03.500 INFO:tasks.workunit.client.0.smithi111.stdout:3/106: fsync fb 0 2024-09-11T00:07:03.501 INFO:tasks.workunit.client.0.smithi111.stdout:8/78: unlink d11/l14 0 2024-09-11T00:07:03.502 INFO:tasks.workunit.client.0.smithi111.stdout:2/93: dwrite d0/fc [0,4194304] 0 2024-09-11T00:07:03.503 INFO:tasks.workunit.client.1.smithi203.stdout:6/123: dwrite d0/f16 [0,4194304] 0 2024-09-11T00:07:03.504 INFO:tasks.workunit.client.0.smithi111.stdout:5/75: dwrite f5 [0,4194304] 0 2024-09-11T00:07:03.507 INFO:tasks.workunit.client.1.smithi203.stdout:5/176: dwrite dc/dd/d15/f2c [0,4194304] 0 2024-09-11T00:07:03.508 INFO:tasks.workunit.client.1.smithi203.stdout:0/138: link d0/d2/f8 d0/f29 0 2024-09-11T00:07:03.509 INFO:tasks.workunit.client.0.smithi111.stdout:5/76: write d10/f19 [910595,118251] 0 2024-09-11T00:07:03.510 INFO:tasks.workunit.client.0.smithi111.stdout:6/58: sync 2024-09-11T00:07:03.512 INFO:tasks.workunit.client.0.smithi111.stdout:6/59: write d7/f9 [344626,124479] 0 2024-09-11T00:07:03.518 INFO:tasks.workunit.client.1.smithi203.stdout:6/124: readlink d0/l12 0 2024-09-11T00:07:03.526 INFO:tasks.workunit.client.0.smithi111.stdout:1/42: creat d2/fa x:0 0 0 2024-09-11T00:07:03.527 INFO:tasks.workunit.client.1.smithi203.stdout:1/143: dwrite d8/d9/fd [0,4194304] 0 2024-09-11T00:07:03.532 INFO:tasks.workunit.client.1.smithi203.stdout:0/139: symlink d0/d2/l2a 0 2024-09-11T00:07:03.534 INFO:tasks.workunit.client.0.smithi111.stdout:8/79: dwrite f10 [0,4194304] 0 2024-09-11T00:07:03.534 INFO:tasks.workunit.client.0.smithi111.stdout:8/80: readlink - no filename 2024-09-11T00:07:03.534 INFO:tasks.workunit.client.1.smithi203.stdout:0/140: chown d0/d1d/c20 235 1 2024-09-11T00:07:03.541 INFO:tasks.workunit.client.1.smithi203.stdout:6/125: dwrite d0/f16 [0,4194304] 0 2024-09-11T00:07:03.542 INFO:tasks.workunit.client.0.smithi111.stdout:7/78: sync 2024-09-11T00:07:03.547 INFO:tasks.workunit.client.1.smithi203.stdout:2/88: truncate f0 2507178 0 2024-09-11T00:07:03.554 INFO:tasks.workunit.client.0.smithi111.stdout:2/94: mknod d0/d3/d12/c1b 0 2024-09-11T00:07:03.555 INFO:tasks.workunit.client.0.smithi111.stdout:9/85: symlink d6/db/d1b/l1c 0 2024-09-11T00:07:03.556 INFO:tasks.workunit.client.0.smithi111.stdout:9/86: dread - d6/db/f18 zero size 2024-09-11T00:07:03.557 INFO:tasks.workunit.client.1.smithi203.stdout:0/141: mknod d0/c2b 0 2024-09-11T00:07:03.558 INFO:tasks.workunit.client.0.smithi111.stdout:5/77: unlink d10/c14 0 2024-09-11T00:07:03.562 INFO:tasks.workunit.client.1.smithi203.stdout:6/126: mknod d0/d6/c22 0 2024-09-11T00:07:03.562 INFO:tasks.workunit.client.0.smithi111.stdout:6/60: rmdir d7 39 2024-09-11T00:07:03.563 INFO:tasks.workunit.client.1.smithi203.stdout:2/89: dread f8 [0,4194304] 0 2024-09-11T00:07:03.565 INFO:tasks.workunit.client.0.smithi111.stdout:1/43: symlink d2/lb 0 2024-09-11T00:07:03.567 INFO:tasks.workunit.client.0.smithi111.stdout:8/81: mknod d11/c16 0 2024-09-11T00:07:03.569 INFO:tasks.workunit.client.1.smithi203.stdout:1/144: dwrite f5 [0,4194304] 0 2024-09-11T00:07:03.569 INFO:tasks.workunit.client.1.smithi203.stdout:5/177: dwrite dc/dd/d15/f23 [4194304,4194304] 0 2024-09-11T00:07:03.571 INFO:tasks.workunit.client.1.smithi203.stdout:0/142: mknod d0/c2c 0 2024-09-11T00:07:03.574 INFO:tasks.workunit.client.1.smithi203.stdout:0/143: write d0/f5 [5287964,21943] 0 2024-09-11T00:07:03.576 INFO:tasks.workunit.client.0.smithi111.stdout:3/107: mkdir d1c/d21 0 2024-09-11T00:07:03.578 INFO:tasks.workunit.client.0.smithi111.stdout:8/82: dread f9 [0,4194304] 0 2024-09-11T00:07:03.580 INFO:tasks.workunit.client.0.smithi111.stdout:9/87: creat d6/dc/d13/f1d x:0 0 0 2024-09-11T00:07:03.580 INFO:tasks.workunit.client.0.smithi111.stdout:8/83: chown d11/f15 6602420 1 2024-09-11T00:07:03.583 INFO:tasks.workunit.client.0.smithi111.stdout:9/88: chown d6/l8 13112 1 2024-09-11T00:07:03.586 INFO:tasks.workunit.client.0.smithi111.stdout:0/69: creat d3/f15 x:0 0 0 2024-09-11T00:07:03.587 INFO:tasks.workunit.client.1.smithi203.stdout:6/127: dread d0/d6/f19 [0,4194304] 0 2024-09-11T00:07:03.588 INFO:tasks.workunit.client.1.smithi203.stdout:2/90: dread f2 [0,4194304] 0 2024-09-11T00:07:03.589 INFO:tasks.workunit.client.1.smithi203.stdout:2/91: read - d13/d15/f1a zero size 2024-09-11T00:07:03.590 INFO:tasks.workunit.client.0.smithi111.stdout:1/44: creat d2/fc x:0 0 0 2024-09-11T00:07:03.590 INFO:tasks.workunit.client.1.smithi203.stdout:2/92: readlink d13/l18 0 2024-09-11T00:07:03.593 INFO:tasks.workunit.client.1.smithi203.stdout:0/144: dread d0/f5 [0,4194304] 0 2024-09-11T00:07:03.594 INFO:tasks.workunit.client.1.smithi203.stdout:5/178: symlink dc/d2b/l36 0 2024-09-11T00:07:03.595 INFO:tasks.workunit.client.0.smithi111.stdout:3/108: dwrite fb [0,4194304] 0 2024-09-11T00:07:03.602 INFO:tasks.workunit.client.0.smithi111.stdout:8/84: symlink d11/l17 0 2024-09-11T00:07:03.602 INFO:tasks.workunit.client.0.smithi111.stdout:8/85: chown c3 28 1 2024-09-11T00:07:03.603 INFO:tasks.workunit.client.1.smithi203.stdout:1/145: write d8/f1a [911153,46077] 0 2024-09-11T00:07:03.605 INFO:tasks.workunit.client.0.smithi111.stdout:9/89: write d6/db/ff [8039366,92008] 0 2024-09-11T00:07:03.605 INFO:tasks.workunit.client.1.smithi203.stdout:1/146: write d8/d9/f1e [4379497,121912] 0 2024-09-11T00:07:03.606 INFO:tasks.workunit.client.1.smithi203.stdout:0/145: dread d0/d2/fb [0,4194304] 0 2024-09-11T00:07:03.606 INFO:tasks.workunit.client.0.smithi111.stdout:9/90: chown d6/dc/f17 31080 1 2024-09-11T00:07:03.608 INFO:tasks.workunit.client.0.smithi111.stdout:9/91: chown d6/dc/l1a 268 1 2024-09-11T00:07:03.613 INFO:tasks.workunit.client.0.smithi111.stdout:0/70: fdatasync f0 0 2024-09-11T00:07:03.614 INFO:tasks.workunit.client.0.smithi111.stdout:8/86: dread f10 [0,4194304] 0 2024-09-11T00:07:03.616 INFO:tasks.workunit.client.1.smithi203.stdout:2/93: mkdir d13/d15/d19/d1c 0 2024-09-11T00:07:03.617 INFO:tasks.workunit.client.0.smithi111.stdout:1/45: creat d2/fd x:0 0 0 2024-09-11T00:07:03.619 INFO:tasks.workunit.client.0.smithi111.stdout:7/79: truncate f6 4276183 0 2024-09-11T00:07:03.620 INFO:tasks.workunit.client.0.smithi111.stdout:5/78: truncate f2 3067788 0 2024-09-11T00:07:03.622 INFO:tasks.workunit.client.1.smithi203.stdout:1/147: dwrite d8/d9/fd [0,4194304] 0 2024-09-11T00:07:03.623 INFO:tasks.workunit.client.1.smithi203.stdout:0/146: symlink d0/d1d/l2d 0 2024-09-11T00:07:03.624 INFO:tasks.workunit.client.0.smithi111.stdout:3/109: mkdir d1c/d1d/d22 0 2024-09-11T00:07:03.625 INFO:tasks.workunit.client.1.smithi203.stdout:1/148: chown d8/d9/lf 22 1 2024-09-11T00:07:03.626 INFO:tasks.workunit.client.1.smithi203.stdout:1/149: readlink d8/d9/lf 0 2024-09-11T00:07:03.628 INFO:tasks.workunit.client.0.smithi111.stdout:6/61: link f0 d7/f11 0 2024-09-11T00:07:03.629 INFO:tasks.workunit.client.1.smithi203.stdout:1/150: chown d8/d19/c2d 7447 1 2024-09-11T00:07:03.630 INFO:tasks.workunit.client.1.smithi203.stdout:6/128: rename d0/d6/fb to d0/f23 0 2024-09-11T00:07:03.632 INFO:tasks.workunit.client.0.smithi111.stdout:9/92: creat d6/db/d1b/f1e x:0 0 0 2024-09-11T00:07:03.633 INFO:tasks.workunit.client.1.smithi203.stdout:2/94: fdatasync d13/d15/f1b 0 2024-09-11T00:07:03.634 INFO:tasks.workunit.client.1.smithi203.stdout:2/95: chown f8 1816 1 2024-09-11T00:07:03.638 INFO:tasks.workunit.client.1.smithi203.stdout:0/147: creat d0/d1d/f2e x:0 0 0 2024-09-11T00:07:03.641 INFO:tasks.workunit.client.1.smithi203.stdout:5/179: creat dc/dd/d15/f37 x:0 0 0 2024-09-11T00:07:03.642 INFO:tasks.workunit.client.0.smithi111.stdout:0/71: symlink d3/dc/l16 0 2024-09-11T00:07:03.643 INFO:tasks.workunit.client.1.smithi203.stdout:5/180: write dc/dd/d13/f35 [224569,83764] 0 2024-09-11T00:07:03.644 INFO:tasks.workunit.client.0.smithi111.stdout:6/62: dwrite d7/fd [0,4194304] 0 2024-09-11T00:07:03.645 INFO:tasks.workunit.client.0.smithi111.stdout:1/46: mkdir d2/de 0 2024-09-11T00:07:03.646 INFO:tasks.workunit.client.1.smithi203.stdout:1/151: unlink d8/c1f 0 2024-09-11T00:07:03.648 INFO:tasks.workunit.client.0.smithi111.stdout:7/80: rename dd/f17 to dd/f18 0 2024-09-11T00:07:03.649 INFO:tasks.workunit.client.1.smithi203.stdout:6/129: fsync d0/f5 0 2024-09-11T00:07:03.651 INFO:tasks.workunit.client.1.smithi203.stdout:6/130: chown d0/l12 0 1 2024-09-11T00:07:03.651 INFO:tasks.workunit.client.0.smithi111.stdout:5/79: creat d10/f1a x:0 0 0 2024-09-11T00:07:03.651 INFO:tasks.workunit.client.1.smithi203.stdout:8/104: sync 2024-09-11T00:07:03.652 INFO:tasks.workunit.client.1.smithi203.stdout:3/174: sync 2024-09-11T00:07:03.653 INFO:tasks.workunit.client.0.smithi111.stdout:5/80: read - d10/f15 zero size 2024-09-11T00:07:03.653 INFO:tasks.workunit.client.0.smithi111.stdout:4/63: link c11 c13 0 2024-09-11T00:07:03.653 INFO:tasks.workunit.client.1.smithi203.stdout:6/131: read d0/d6/f18 [2463801,80155] 0 2024-09-11T00:07:03.654 INFO:tasks.workunit.client.1.smithi203.stdout:3/175: write d8/da/f46 [144893,33795] 0 2024-09-11T00:07:03.654 INFO:tasks.workunit.client.0.smithi111.stdout:8/87: dread f9 [4194304,4194304] 0 2024-09-11T00:07:03.655 INFO:tasks.workunit.client.1.smithi203.stdout:8/105: rename d1/d13 to d1/d13/d22/d24 22 2024-09-11T00:07:03.655 INFO:tasks.workunit.client.1.smithi203.stdout:6/132: fdatasync d0/d6/f1c 0 2024-09-11T00:07:03.656 INFO:tasks.workunit.client.0.smithi111.stdout:0/72: dread d3/f6 [0,4194304] 0 2024-09-11T00:07:03.659 INFO:tasks.workunit.client.1.smithi203.stdout:0/148: unlink d0/f24 0 2024-09-11T00:07:03.660 INFO:tasks.workunit.client.1.smithi203.stdout:1/152: dread d8/d19/f26 [0,4194304] 0 2024-09-11T00:07:03.661 INFO:tasks.workunit.client.0.smithi111.stdout:9/93: write d6/db/fd [4083887,74230] 0 2024-09-11T00:07:03.662 INFO:tasks.workunit.client.1.smithi203.stdout:5/181: write dc/dd/d15/f23 [2338492,59265] 0 2024-09-11T00:07:03.670 INFO:tasks.workunit.client.1.smithi203.stdout:2/96: truncate f8 1092097 0 2024-09-11T00:07:03.671 INFO:tasks.workunit.client.1.smithi203.stdout:8/106: symlink d1/d13/d22/l25 0 2024-09-11T00:07:03.671 INFO:tasks.workunit.client.1.smithi203.stdout:2/97: dread - d13/f17 zero size 2024-09-11T00:07:03.672 INFO:tasks.workunit.client.1.smithi203.stdout:2/98: readlink d13/d15/l16 0 2024-09-11T00:07:03.674 INFO:tasks.workunit.client.1.smithi203.stdout:6/133: rename d0/d6/f1c to d0/d6/f24 0 2024-09-11T00:07:03.676 INFO:tasks.workunit.client.0.smithi111.stdout:9/94: dwrite d6/db/f18 [0,4194304] 0 2024-09-11T00:07:03.678 INFO:tasks.workunit.client.1.smithi203.stdout:1/153: unlink f5 0 2024-09-11T00:07:03.679 INFO:tasks.workunit.client.0.smithi111.stdout:5/81: creat d10/f1b x:0 0 0 2024-09-11T00:07:03.681 INFO:tasks.workunit.client.1.smithi203.stdout:0/149: rename d0/d2/c22 to d0/d1d/c2f 0 2024-09-11T00:07:03.682 INFO:tasks.workunit.client.0.smithi111.stdout:8/88: symlink d11/l18 0 2024-09-11T00:07:03.683 INFO:tasks.workunit.client.0.smithi111.stdout:8/89: chown d11/f12 379 1 2024-09-11T00:07:03.684 INFO:tasks.workunit.client.0.smithi111.stdout:8/90: write f8 [1774641,118751] 0 2024-09-11T00:07:03.685 INFO:tasks.workunit.client.0.smithi111.stdout:8/91: write d11/f12 [260433,94457] 0 2024-09-11T00:07:03.686 INFO:tasks.workunit.client.0.smithi111.stdout:8/92: stat d11 0 2024-09-11T00:07:03.686 INFO:tasks.workunit.client.1.smithi203.stdout:5/182: fdatasync dc/dd/f2f 0 2024-09-11T00:07:03.687 INFO:tasks.workunit.client.0.smithi111.stdout:8/93: write f7 [2617618,109796] 0 2024-09-11T00:07:03.688 INFO:tasks.workunit.client.0.smithi111.stdout:0/73: creat d3/d13/f17 x:0 0 0 2024-09-11T00:07:03.690 INFO:tasks.workunit.client.1.smithi203.stdout:8/107: creat d1/d13/d17/f26 x:0 0 0 2024-09-11T00:07:03.696 INFO:tasks.workunit.client.0.smithi111.stdout:2/95: sync 2024-09-11T00:07:03.696 INFO:tasks.workunit.client.0.smithi111.stdout:1/47: creat d2/de/ff x:0 0 0 2024-09-11T00:07:03.698 INFO:tasks.workunit.client.1.smithi203.stdout:6/134: write d0/d6/f18 [7978515,93536] 0 2024-09-11T00:07:03.698 INFO:tasks.workunit.client.0.smithi111.stdout:1/48: truncate d2/fc 544722 0 2024-09-11T00:07:03.699 INFO:tasks.workunit.client.1.smithi203.stdout:6/135: stat d0 0 2024-09-11T00:07:03.703 INFO:tasks.workunit.client.1.smithi203.stdout:1/154: mkdir d8/d9/d15/d30 0 2024-09-11T00:07:03.705 INFO:tasks.workunit.client.1.smithi203.stdout:0/150: symlink d0/d2/l30 0 2024-09-11T00:07:03.705 INFO:tasks.workunit.client.1.smithi203.stdout:1/155: fdatasync d8/f1a 0 2024-09-11T00:07:03.706 INFO:tasks.workunit.client.0.smithi111.stdout:5/82: creat d10/f1c x:0 0 0 2024-09-11T00:07:03.708 INFO:tasks.workunit.client.0.smithi111.stdout:3/110: truncate d1c/d1d/f1f 2874809 0 2024-09-11T00:07:03.712 INFO:tasks.workunit.client.0.smithi111.stdout:8/94: rename f9 to d11/f19 0 2024-09-11T00:07:03.712 INFO:tasks.workunit.client.0.smithi111.stdout:2/96: dwrite d0/d3/de/f11 [8388608,4194304] 0 2024-09-11T00:07:03.713 INFO:tasks.workunit.client.1.smithi203.stdout:2/99: dread f0 [0,4194304] 0 2024-09-11T00:07:03.715 INFO:tasks.workunit.client.0.smithi111.stdout:6/63: sync 2024-09-11T00:07:03.715 INFO:tasks.workunit.client.0.smithi111.stdout:0/74: symlink d3/dc/l18 0 2024-09-11T00:07:03.715 INFO:tasks.workunit.client.0.smithi111.stdout:6/64: read - d7/fb zero size 2024-09-11T00:07:03.717 INFO:tasks.workunit.client.1.smithi203.stdout:6/136: write d0/f1e [3603902,36101] 0 2024-09-11T00:07:03.720 INFO:tasks.workunit.client.0.smithi111.stdout:7/81: write f8 [1047671,8033] 0 2024-09-11T00:07:03.721 INFO:tasks.workunit.client.0.smithi111.stdout:6/65: dread d7/f9 [0,4194304] 0 2024-09-11T00:07:03.725 INFO:tasks.workunit.client.0.smithi111.stdout:1/49: creat d2/f10 x:0 0 0 2024-09-11T00:07:03.726 INFO:tasks.workunit.client.1.smithi203.stdout:0/151: unlink d0/d2/f1f 0 2024-09-11T00:07:03.726 INFO:tasks.workunit.client.0.smithi111.stdout:3/111: dwrite f2 [0,4194304] 0 2024-09-11T00:07:03.727 INFO:tasks.workunit.client.0.smithi111.stdout:4/64: creat f14 x:0 0 0 2024-09-11T00:07:03.727 INFO:tasks.workunit.client.0.smithi111.stdout:1/50: write d2/de/ff [1029435,51988] 0 2024-09-11T00:07:03.729 INFO:tasks.workunit.client.0.smithi111.stdout:9/95: link d6/db/ff d6/dc/f1f 0 2024-09-11T00:07:03.730 INFO:tasks.workunit.client.1.smithi203.stdout:1/156: mkdir d8/d19/d31 0 2024-09-11T00:07:03.731 INFO:tasks.workunit.client.0.smithi111.stdout:9/96: stat d6/dc/d13/l15 0 2024-09-11T00:07:03.731 INFO:tasks.workunit.client.1.smithi203.stdout:5/183: mknod dc/dd/c38 0 2024-09-11T00:07:03.734 INFO:tasks.workunit.client.0.smithi111.stdout:9/97: dread - d6/db/d1b/f1e zero size 2024-09-11T00:07:03.735 INFO:tasks.workunit.client.1.smithi203.stdout:3/176: getdents d8/d17 0 2024-09-11T00:07:03.737 INFO:tasks.workunit.client.0.smithi111.stdout:8/95: write d11/f13 [1912459,28552] 0 2024-09-11T00:07:03.738 INFO:tasks.workunit.client.0.smithi111.stdout:9/98: dread - d6/dc/d13/f1d zero size 2024-09-11T00:07:03.738 INFO:tasks.workunit.client.0.smithi111.stdout:2/97: unlink d0/d3/d12/c15 0 2024-09-11T00:07:03.747 INFO:tasks.workunit.client.0.smithi111.stdout:6/66: dwrite d7/f9 [0,4194304] 0 2024-09-11T00:07:03.751 INFO:tasks.workunit.client.0.smithi111.stdout:1/51: rename d2/fc to d2/de/f11 0 2024-09-11T00:07:03.752 INFO:tasks.workunit.client.1.smithi203.stdout:1/157: dwrite d8/f1a [0,4194304] 0 2024-09-11T00:07:03.753 INFO:tasks.workunit.client.1.smithi203.stdout:3/177: rmdir d8/da/d34 39 2024-09-11T00:07:03.757 INFO:tasks.workunit.client.0.smithi111.stdout:2/98: dwrite d0/d3/de/f11 [8388608,4194304] 0 2024-09-11T00:07:03.758 INFO:tasks.workunit.client.0.smithi111.stdout:2/99: fdatasync d0/f1a 0 2024-09-11T00:07:03.758 INFO:tasks.workunit.client.1.smithi203.stdout:6/137: dread d0/f14 [0,4194304] 0 2024-09-11T00:07:03.763 INFO:tasks.workunit.client.0.smithi111.stdout:8/96: chown d11/f19 2 1 2024-09-11T00:07:03.769 INFO:tasks.workunit.client.0.smithi111.stdout:9/99: creat d6/dc/f20 x:0 0 0 2024-09-11T00:07:03.771 INFO:tasks.workunit.client.1.smithi203.stdout:8/108: getdents d1/d13 0 2024-09-11T00:07:03.774 INFO:tasks.workunit.client.1.smithi203.stdout:8/109: stat d1/d13 0 2024-09-11T00:07:03.775 INFO:tasks.workunit.client.1.smithi203.stdout:0/152: fdatasync d0/f18 0 2024-09-11T00:07:03.778 INFO:tasks.workunit.client.0.smithi111.stdout:0/75: mknod d3/c19 0 2024-09-11T00:07:03.779 INFO:tasks.workunit.client.1.smithi203.stdout:1/158: symlink d8/d9/d15/l32 0 2024-09-11T00:07:03.782 INFO:tasks.workunit.client.1.smithi203.stdout:1/159: truncate d8/d9/fd 4240306 0 2024-09-11T00:07:03.784 INFO:tasks.workunit.client.1.smithi203.stdout:8/110: dread d1/f2 [0,4194304] 0 2024-09-11T00:07:03.785 INFO:tasks.workunit.client.0.smithi111.stdout:4/65: unlink lc 0 2024-09-11T00:07:03.786 INFO:tasks.workunit.client.0.smithi111.stdout:3/112: mkdir d1c/d1d/d22/d23 0 2024-09-11T00:07:03.788 INFO:tasks.workunit.client.1.smithi203.stdout:0/153: symlink d0/d1d/l31 0 2024-09-11T00:07:03.791 INFO:tasks.workunit.client.0.smithi111.stdout:7/82: dwrite dd/ff [0,4194304] 0 2024-09-11T00:07:03.791 INFO:tasks.workunit.client.0.smithi111.stdout:1/52: mkdir d2/de/d12 0 2024-09-11T00:07:03.792 INFO:tasks.workunit.client.1.smithi203.stdout:8/111: symlink d1/d13/d22/l27 0 2024-09-11T00:07:03.794 INFO:tasks.workunit.client.1.smithi203.stdout:3/178: link d8/le d8/d3c/l4c 0 2024-09-11T00:07:03.795 INFO:tasks.workunit.client.0.smithi111.stdout:8/97: creat d11/f1a x:0 0 0 2024-09-11T00:07:03.796 INFO:tasks.workunit.client.0.smithi111.stdout:5/83: dwrite f2 [0,4194304] 0 2024-09-11T00:07:03.797 INFO:tasks.workunit.client.0.smithi111.stdout:8/98: write f7 [4697405,53756] 0 2024-09-11T00:07:03.800 INFO:tasks.workunit.client.0.smithi111.stdout:0/76: fdatasync f2 0 2024-09-11T00:07:03.801 INFO:tasks.workunit.client.1.smithi203.stdout:3/179: chown d8/d3c/c49 236 1 2024-09-11T00:07:03.804 INFO:tasks.workunit.client.0.smithi111.stdout:7/83: rmdir dd 39 2024-09-11T00:07:03.805 INFO:tasks.workunit.client.1.smithi203.stdout:3/180: chown d8/da/d37/f3f 761494974 1 2024-09-11T00:07:03.806 INFO:tasks.workunit.client.0.smithi111.stdout:1/53: chown d2/l7 63 1 2024-09-11T00:07:03.807 INFO:tasks.workunit.client.0.smithi111.stdout:5/84: symlink d10/l1d 0 2024-09-11T00:07:03.808 INFO:tasks.workunit.client.0.smithi111.stdout:3/113: dwrite ff [0,4194304] 0 2024-09-11T00:07:03.808 INFO:tasks.workunit.client.0.smithi111.stdout:1/54: dread - d2/f10 zero size 2024-09-11T00:07:03.811 INFO:tasks.workunit.client.0.smithi111.stdout:3/114: dread - d1c/d1d/f1e zero size 2024-09-11T00:07:03.812 INFO:tasks.workunit.client.0.smithi111.stdout:3/115: readlink ld 0 2024-09-11T00:07:03.813 INFO:tasks.workunit.client.1.smithi203.stdout:3/181: creat d8/da/d34/f4d x:0 0 0 2024-09-11T00:07:03.814 INFO:tasks.workunit.client.1.smithi203.stdout:3/182: stat d8/d17/f1c 0 2024-09-11T00:07:03.815 INFO:tasks.workunit.client.0.smithi111.stdout:0/77: creat d3/dc/f1a x:0 0 0 2024-09-11T00:07:03.815 INFO:tasks.workunit.client.1.smithi203.stdout:8/112: dwrite d1/d13/d17/f26 [0,4194304] 0 2024-09-11T00:07:03.816 INFO:tasks.workunit.client.0.smithi111.stdout:0/78: read d3/f7 [4145320,99492] 0 2024-09-11T00:07:03.820 INFO:tasks.workunit.client.0.smithi111.stdout:9/100: creat d6/db/f21 x:0 0 0 2024-09-11T00:07:03.824 INFO:tasks.workunit.client.1.smithi203.stdout:3/183: unlink d8/da/d34/f36 0 2024-09-11T00:07:03.824 INFO:tasks.workunit.client.0.smithi111.stdout:9/101: read - d6/dc/f17 zero size 2024-09-11T00:07:03.825 INFO:tasks.workunit.client.1.smithi203.stdout:3/184: dread - d8/da/d11/f43 zero size 2024-09-11T00:07:03.826 INFO:tasks.workunit.client.1.smithi203.stdout:8/113: rename d1/l7 to d1/d13/d22/l28 0 2024-09-11T00:07:03.827 INFO:tasks.workunit.client.0.smithi111.stdout:6/67: getdents d7 0 2024-09-11T00:07:03.831 INFO:tasks.workunit.client.0.smithi111.stdout:7/84: creat dd/f19 x:0 0 0 2024-09-11T00:07:03.831 INFO:tasks.workunit.client.1.smithi203.stdout:3/185: rename d8/l41 to d8/d17/l4e 0 2024-09-11T00:07:03.832 INFO:tasks.workunit.client.0.smithi111.stdout:1/55: mkdir d2/de/d12/d13 0 2024-09-11T00:07:03.834 INFO:tasks.workunit.client.1.smithi203.stdout:8/114: creat d1/d13/d22/f29 x:0 0 0 2024-09-11T00:07:03.834 INFO:tasks.workunit.client.0.smithi111.stdout:9/102: dread - d6/dc/d13/f19 zero size 2024-09-11T00:07:03.836 INFO:tasks.workunit.client.0.smithi111.stdout:3/116: dread f8 [4194304,4194304] 0 2024-09-11T00:07:03.837 INFO:tasks.workunit.client.1.smithi203.stdout:3/186: rename d8/d3c/c49 to d8/d17/c4f 0 2024-09-11T00:07:03.837 INFO:tasks.workunit.client.0.smithi111.stdout:6/68: write d7/ff [375928,109121] 0 2024-09-11T00:07:03.839 INFO:tasks.workunit.client.0.smithi111.stdout:5/85: dwrite f2 [0,4194304] 0 2024-09-11T00:07:03.841 INFO:tasks.workunit.client.0.smithi111.stdout:7/85: creat dd/f1a x:0 0 0 2024-09-11T00:07:03.841 INFO:tasks.workunit.client.1.smithi203.stdout:3/187: mknod d8/da/d34/c50 0 2024-09-11T00:07:03.842 INFO:tasks.workunit.client.1.smithi203.stdout:3/188: stat l3 0 2024-09-11T00:07:03.843 INFO:tasks.workunit.client.0.smithi111.stdout:1/56: creat d2/de/f14 x:0 0 0 2024-09-11T00:07:03.844 INFO:tasks.workunit.client.1.smithi203.stdout:3/189: chown d8/da/d37/f47 195802472 1 2024-09-11T00:07:03.844 INFO:tasks.workunit.client.1.smithi203.stdout:3/190: chown d8/c1e 1680 1 2024-09-11T00:07:03.845 INFO:tasks.workunit.client.0.smithi111.stdout:6/69: chown f3 3 1 2024-09-11T00:07:03.848 INFO:tasks.workunit.client.1.smithi203.stdout:3/191: write d8/da/d34/f4d [224231,23331] 0 2024-09-11T00:07:03.849 INFO:tasks.workunit.client.1.smithi203.stdout:3/192: stat d8/da/d34/f4d 0 2024-09-11T00:07:03.850 INFO:tasks.workunit.client.1.smithi203.stdout:3/193: chown d8/da/d34 238715 1 2024-09-11T00:07:03.851 INFO:tasks.workunit.client.0.smithi111.stdout:7/86: creat dd/f1b x:0 0 0 2024-09-11T00:07:03.851 INFO:tasks.workunit.client.0.smithi111.stdout:1/57: write d2/de/ff [529964,86514] 0 2024-09-11T00:07:03.851 INFO:tasks.workunit.client.0.smithi111.stdout:0/79: dwrite d3/fd [0,4194304] 0 2024-09-11T00:07:03.851 INFO:tasks.workunit.client.0.smithi111.stdout:9/103: rename d6/db/ff to d6/db/d1b/f22 0 2024-09-11T00:07:03.851 INFO:tasks.workunit.client.0.smithi111.stdout:1/58: fsync d2/fa 0 2024-09-11T00:07:03.852 INFO:tasks.workunit.client.1.smithi203.stdout:3/194: chown d8/da/d34/f35 27972 1 2024-09-11T00:07:03.852 INFO:tasks.workunit.client.0.smithi111.stdout:9/104: read d6/db/d1b/f22 [7892766,111861] 0 2024-09-11T00:07:03.853 INFO:tasks.workunit.client.0.smithi111.stdout:1/59: dread - d2/fa zero size 2024-09-11T00:07:03.853 INFO:tasks.workunit.client.0.smithi111.stdout:3/117: creat d1c/f24 x:0 0 0 2024-09-11T00:07:03.856 INFO:tasks.workunit.client.1.smithi203.stdout:3/195: unlink d8/l24 0 2024-09-11T00:07:03.857 INFO:tasks.workunit.client.0.smithi111.stdout:5/86: dread f5 [0,4194304] 0 2024-09-11T00:07:03.858 INFO:tasks.workunit.client.1.smithi203.stdout:3/196: write d8/d2a/f40 [2827449,2919] 0 2024-09-11T00:07:03.862 INFO:tasks.workunit.client.1.smithi203.stdout:3/197: symlink d8/da/d34/l51 0 2024-09-11T00:07:03.866 INFO:tasks.workunit.client.0.smithi111.stdout:1/60: rename d2/l8 to d2/de/d12/d13/l15 0 2024-09-11T00:07:03.867 INFO:tasks.workunit.client.1.smithi203.stdout:3/198: readlink d8/le 0 2024-09-11T00:07:03.867 INFO:tasks.workunit.client.0.smithi111.stdout:5/87: chown l9 0 1 2024-09-11T00:07:03.868 INFO:tasks.workunit.client.0.smithi111.stdout:1/61: write d2/fa [617789,20918] 0 2024-09-11T00:07:03.868 INFO:tasks.workunit.client.0.smithi111.stdout:3/118: creat d1c/d1d/d22/d23/f25 x:0 0 0 2024-09-11T00:07:03.868 INFO:tasks.workunit.client.1.smithi203.stdout:3/199: stat d8/d17/c28 0 2024-09-11T00:07:03.869 INFO:tasks.workunit.client.1.smithi203.stdout:3/200: chown d8/f29 823674 1 2024-09-11T00:07:03.871 INFO:tasks.workunit.client.0.smithi111.stdout:5/88: mkdir d10/d1e 0 2024-09-11T00:07:03.871 INFO:tasks.workunit.client.0.smithi111.stdout:1/62: creat d2/de/f16 x:0 0 0 2024-09-11T00:07:03.872 INFO:tasks.workunit.client.0.smithi111.stdout:1/63: dread - d2/fd zero size 2024-09-11T00:07:03.873 INFO:tasks.workunit.client.1.smithi203.stdout:3/201: rename d8/da/d34/l51 to d8/d3c/l52 0 2024-09-11T00:07:03.873 INFO:tasks.workunit.client.0.smithi111.stdout:5/89: creat d10/f1f x:0 0 0 2024-09-11T00:07:03.876 INFO:tasks.workunit.client.0.smithi111.stdout:5/90: mknod d10/c20 0 2024-09-11T00:07:03.877 INFO:tasks.workunit.client.0.smithi111.stdout:5/91: fsync d10/f19 0 2024-09-11T00:07:03.880 INFO:tasks.workunit.client.0.smithi111.stdout:5/92: creat d10/d1e/f21 x:0 0 0 2024-09-11T00:07:03.883 INFO:tasks.workunit.client.0.smithi111.stdout:5/93: creat d10/f22 x:0 0 0 2024-09-11T00:07:03.886 INFO:tasks.workunit.client.1.smithi203.stdout:3/202: dwrite d8/f2c [0,4194304] 0 2024-09-11T00:07:03.889 INFO:tasks.workunit.client.1.smithi203.stdout:3/203: mkdir d8/da/d37/d53 0 2024-09-11T00:07:03.889 INFO:tasks.workunit.client.0.smithi111.stdout:1/64: dwrite d2/f10 [0,4194304] 0 2024-09-11T00:07:03.890 INFO:tasks.workunit.client.0.smithi111.stdout:1/65: truncate d2/fa 736690 0 2024-09-11T00:07:03.892 INFO:tasks.workunit.client.0.smithi111.stdout:1/66: dread - d2/de/f14 zero size 2024-09-11T00:07:03.900 INFO:tasks.workunit.client.0.smithi111.stdout:5/94: dwrite f5 [0,4194304] 0 2024-09-11T00:07:03.901 INFO:tasks.workunit.client.0.smithi111.stdout:5/95: chown fd 0 1 2024-09-11T00:07:03.902 INFO:tasks.workunit.client.0.smithi111.stdout:5/96: stat d10/l1d 0 2024-09-11T00:07:03.903 INFO:tasks.workunit.client.1.smithi203.stdout:9/139: sync 2024-09-11T00:07:03.903 INFO:tasks.workunit.client.1.smithi203.stdout:7/159: sync 2024-09-11T00:07:03.903 INFO:tasks.workunit.client.1.smithi203.stdout:4/114: sync 2024-09-11T00:07:03.908 INFO:tasks.workunit.client.0.smithi111.stdout:1/67: dwrite d2/f10 [0,4194304] 0 2024-09-11T00:07:03.909 INFO:tasks.workunit.client.0.smithi111.stdout:5/97: mkdir d10/d1e/d23 0 2024-09-11T00:07:03.910 INFO:tasks.workunit.client.0.smithi111.stdout:1/68: stat d2/de/f11 0 2024-09-11T00:07:03.913 INFO:tasks.workunit.client.0.smithi111.stdout:1/69: truncate d2/de/f16 385838 0 2024-09-11T00:07:03.913 INFO:tasks.workunit.client.1.smithi203.stdout:9/140: dread d6/de/d19/d24/f2d [0,4194304] 0 2024-09-11T00:07:03.917 INFO:tasks.workunit.client.0.smithi111.stdout:5/98: symlink d10/d1e/l24 0 2024-09-11T00:07:03.919 INFO:tasks.workunit.client.0.smithi111.stdout:1/70: creat d2/de/f17 x:0 0 0 2024-09-11T00:07:03.919 INFO:tasks.workunit.client.0.smithi111.stdout:5/99: truncate d10/f19 1294330 0 2024-09-11T00:07:03.920 INFO:tasks.workunit.client.0.smithi111.stdout:5/100: dread - d10/f1f zero size 2024-09-11T00:07:03.921 INFO:tasks.workunit.client.1.smithi203.stdout:4/115: dread fa [0,4194304] 0 2024-09-11T00:07:03.921 INFO:tasks.workunit.client.0.smithi111.stdout:1/71: rename d2/de to d2/de/d12/d18 22 2024-09-11T00:07:03.922 INFO:tasks.workunit.client.0.smithi111.stdout:1/72: stat d2/de/f16 0 2024-09-11T00:07:03.924 INFO:tasks.workunit.client.0.smithi111.stdout:5/101: unlink fc 0 2024-09-11T00:07:03.928 INFO:tasks.workunit.client.0.smithi111.stdout:1/73: rename d2/fa to d2/f19 0 2024-09-11T00:07:03.930 INFO:tasks.workunit.client.0.smithi111.stdout:5/102: mkdir d10/d1e/d25 0 2024-09-11T00:07:03.930 INFO:tasks.workunit.client.0.smithi111.stdout:5/103: write d10/d1e/f21 [979526,59094] 0 2024-09-11T00:07:03.934 INFO:tasks.workunit.client.0.smithi111.stdout:5/104: mkdir d10/d1e/d23/d26 0 2024-09-11T00:07:03.944 INFO:tasks.workunit.client.0.smithi111.stdout:1/74: dwrite d2/f9 [0,4194304] 0 2024-09-11T00:07:03.944 INFO:tasks.workunit.client.0.smithi111.stdout:5/105: dread f7 [0,4194304] 0 2024-09-11T00:07:03.945 INFO:tasks.workunit.client.0.smithi111.stdout:5/106: write d10/f19 [1308274,42801] 0 2024-09-11T00:07:03.951 INFO:tasks.workunit.client.0.smithi111.stdout:1/75: creat d2/de/d12/d13/f1a x:0 0 0 2024-09-11T00:07:03.952 INFO:tasks.workunit.client.0.smithi111.stdout:5/107: rename d10/f17 to d10/f27 0 2024-09-11T00:07:03.954 INFO:tasks.workunit.client.0.smithi111.stdout:1/76: mknod d2/de/c1b 0 2024-09-11T00:07:03.956 INFO:tasks.workunit.client.0.smithi111.stdout:1/77: write d2/de/ff [1382491,41452] 0 2024-09-11T00:07:03.959 INFO:tasks.workunit.client.0.smithi111.stdout:3/119: dread f12 [0,4194304] 0 2024-09-11T00:07:03.960 INFO:tasks.workunit.client.0.smithi111.stdout:1/78: rmdir d2/de/d12 39 2024-09-11T00:07:03.961 INFO:tasks.workunit.client.0.smithi111.stdout:5/108: fsync f5 0 2024-09-11T00:07:03.962 INFO:tasks.workunit.client.0.smithi111.stdout:5/109: dread - d10/f27 zero size 2024-09-11T00:07:03.962 INFO:tasks.workunit.client.0.smithi111.stdout:5/110: read - d10/f1a zero size 2024-09-11T00:07:03.963 INFO:tasks.workunit.client.0.smithi111.stdout:3/120: mkdir d1c/d21/d26 0 2024-09-11T00:07:03.966 INFO:tasks.workunit.client.0.smithi111.stdout:5/111: chown d10/f27 3160787 1 2024-09-11T00:07:03.967 INFO:tasks.workunit.client.0.smithi111.stdout:5/112: dread - d10/f16 zero size 2024-09-11T00:07:03.967 INFO:tasks.workunit.client.1.smithi203.stdout:2/100: dwrite f8 [0,4194304] 0 2024-09-11T00:07:03.969 INFO:tasks.workunit.client.1.smithi203.stdout:4/116: dread db/dd/fe [0,4194304] 0 2024-09-11T00:07:03.970 INFO:tasks.workunit.client.1.smithi203.stdout:4/117: chown db/d12 1367046702 1 2024-09-11T00:07:03.971 INFO:tasks.workunit.client.1.smithi203.stdout:4/118: readlink db/d12/d15/l1d 0 2024-09-11T00:07:03.975 INFO:tasks.workunit.client.1.smithi203.stdout:4/119: write db/dd/f11 [1972916,89773] 0 2024-09-11T00:07:03.987 INFO:tasks.workunit.client.1.smithi203.stdout:0/154: write d0/f29 [2040416,121110] 0 2024-09-11T00:07:03.988 INFO:tasks.workunit.client.0.smithi111.stdout:8/99: rmdir d11 39 2024-09-11T00:07:03.990 INFO:tasks.workunit.client.1.smithi203.stdout:1/160: truncate d8/f1a 2416536 0 2024-09-11T00:07:03.992 INFO:tasks.workunit.client.1.smithi203.stdout:2/101: dwrite f8 [0,4194304] 0 2024-09-11T00:07:03.992 INFO:tasks.workunit.client.0.smithi111.stdout:0/80: write d3/f11 [844825,119156] 0 2024-09-11T00:07:03.994 INFO:tasks.workunit.client.0.smithi111.stdout:0/81: write f0 [523890,120920] 0 2024-09-11T00:07:03.998 INFO:tasks.workunit.client.1.smithi203.stdout:4/120: dwrite db/dd/f13 [0,4194304] 0 2024-09-11T00:07:04.009 INFO:tasks.workunit.client.1.smithi203.stdout:2/102: dread f4 [0,4194304] 0 2024-09-11T00:07:04.009 INFO:tasks.workunit.client.1.smithi203.stdout:1/161: rename d8/d9/d15/l32 to d8/d11/d29/l33 0 2024-09-11T00:07:04.014 INFO:tasks.workunit.client.1.smithi203.stdout:4/121: symlink db/l20 0 2024-09-11T00:07:04.014 INFO:tasks.workunit.client.1.smithi203.stdout:1/162: read d8/d9/fd [3589662,46104] 0 2024-09-11T00:07:04.018 INFO:tasks.workunit.client.1.smithi203.stdout:0/155: dwrite d0/d2/f12 [0,4194304] 0 2024-09-11T00:07:04.027 INFO:tasks.workunit.client.1.smithi203.stdout:1/163: creat d8/d9/d15/f34 x:0 0 0 2024-09-11T00:07:04.031 INFO:tasks.workunit.client.1.smithi203.stdout:2/103: dwrite f11 [0,4194304] 0 2024-09-11T00:07:04.032 INFO:tasks.workunit.client.1.smithi203.stdout:2/104: read f7 [117117,117500] 0 2024-09-11T00:07:04.041 INFO:tasks.workunit.client.1.smithi203.stdout:1/164: mkdir d8/d9/d15/d35 0 2024-09-11T00:07:04.044 INFO:tasks.workunit.client.1.smithi203.stdout:1/165: chown d8/c23 145918 1 2024-09-11T00:07:04.046 INFO:tasks.workunit.client.0.smithi111.stdout:2/100: truncate d0/d3/de/f11 1378502 0 2024-09-11T00:07:04.047 INFO:tasks.workunit.client.1.smithi203.stdout:8/115: dwrite d1/d13/f1d [0,4194304] 0 2024-09-11T00:07:04.048 INFO:tasks.workunit.client.0.smithi111.stdout:4/66: write f7 [1038114,65874] 0 2024-09-11T00:07:04.048 INFO:tasks.workunit.client.0.smithi111.stdout:7/87: rmdir dd 39 2024-09-11T00:07:04.050 INFO:tasks.workunit.client.1.smithi203.stdout:2/105: dread f8 [0,4194304] 0 2024-09-11T00:07:04.054 INFO:tasks.workunit.client.0.smithi111.stdout:8/100: dread - d11/f1a zero size 2024-09-11T00:07:04.057 INFO:tasks.workunit.client.0.smithi111.stdout:6/70: truncate d7/f9 3807849 0 2024-09-11T00:07:04.060 INFO:tasks.workunit.client.0.smithi111.stdout:0/82: rename d3/l8 to d3/dc/l1b 0 2024-09-11T00:07:04.063 INFO:tasks.workunit.client.1.smithi203.stdout:2/106: write f7 [468934,7862] 0 2024-09-11T00:07:04.063 INFO:tasks.workunit.client.0.smithi111.stdout:4/67: stat l0 0 2024-09-11T00:07:04.064 INFO:tasks.workunit.client.0.smithi111.stdout:9/105: truncate d6/db/f18 3831124 0 2024-09-11T00:07:04.064 INFO:tasks.workunit.client.0.smithi111.stdout:4/68: fsync f7 0 2024-09-11T00:07:04.064 INFO:tasks.workunit.client.0.smithi111.stdout:8/101: dread d11/f15 [0,4194304] 0 2024-09-11T00:07:04.065 INFO:tasks.workunit.client.1.smithi203.stdout:8/116: truncate d1/d13/f1b 308662 0 2024-09-11T00:07:04.065 INFO:tasks.workunit.client.0.smithi111.stdout:8/102: fdatasync f7 0 2024-09-11T00:07:04.066 INFO:tasks.workunit.client.0.smithi111.stdout:9/106: stat d6/dc/f17 0 2024-09-11T00:07:04.066 INFO:tasks.workunit.client.0.smithi111.stdout:2/101: creat d0/d3/f1c x:0 0 0 2024-09-11T00:07:04.067 INFO:tasks.workunit.client.1.smithi203.stdout:1/166: mkdir d8/d19/d31/d36 0 2024-09-11T00:07:04.070 INFO:tasks.workunit.client.1.smithi203.stdout:8/117: dread d1/f2 [0,4194304] 0 2024-09-11T00:07:04.070 INFO:tasks.workunit.client.1.smithi203.stdout:1/167: truncate d8/d11/f20 1562243 0 2024-09-11T00:07:04.071 INFO:tasks.workunit.client.0.smithi111.stdout:6/71: rmdir d7 39 2024-09-11T00:07:04.075 INFO:tasks.workunit.client.1.smithi203.stdout:8/118: mknod d1/d13/c2a 0 2024-09-11T00:07:04.076 INFO:tasks.workunit.client.0.smithi111.stdout:4/69: readlink la 0 2024-09-11T00:07:04.077 INFO:tasks.workunit.client.1.smithi203.stdout:2/107: dread f8 [0,4194304] 0 2024-09-11T00:07:04.079 INFO:tasks.workunit.client.1.smithi203.stdout:3/204: truncate d8/da/f19 2241109 0 2024-09-11T00:07:04.079 INFO:tasks.workunit.client.0.smithi111.stdout:7/88: dwrite dd/ff [0,4194304] 0 2024-09-11T00:07:04.080 INFO:tasks.workunit.client.1.smithi203.stdout:1/168: dread d8/d9/d15/f25 [0,4194304] 0 2024-09-11T00:07:04.081 INFO:tasks.workunit.client.0.smithi111.stdout:8/103: creat d11/f1b x:0 0 0 2024-09-11T00:07:04.081 INFO:tasks.workunit.client.0.smithi111.stdout:7/89: truncate dd/f15 1014920 0 2024-09-11T00:07:04.082 INFO:tasks.workunit.client.0.smithi111.stdout:9/107: rename d6/dc/l1a to d6/dc/l23 0 2024-09-11T00:07:04.084 INFO:tasks.workunit.client.1.smithi203.stdout:8/119: rename d1/d13/d22/l27 to d1/d13/d17/l2b 0 2024-09-11T00:07:04.087 INFO:tasks.workunit.client.0.smithi111.stdout:2/102: chown d0/d3/de/l19 16 1 2024-09-11T00:07:04.090 INFO:tasks.workunit.client.1.smithi203.stdout:3/205: creat d8/da/d34/f54 x:0 0 0 2024-09-11T00:07:04.092 INFO:tasks.workunit.client.1.smithi203.stdout:9/141: truncate d6/de/d19/f1b 1253979 0 2024-09-11T00:07:04.096 INFO:tasks.workunit.client.1.smithi203.stdout:7/160: dwrite dd/f12 [0,4194304] 0 2024-09-11T00:07:04.096 INFO:tasks.workunit.client.0.smithi111.stdout:9/108: dwrite d6/db/d1b/f1e [0,4194304] 0 2024-09-11T00:07:04.096 INFO:tasks.workunit.client.0.smithi111.stdout:6/72: fsync d7/fb 0 2024-09-11T00:07:04.097 INFO:tasks.workunit.client.1.smithi203.stdout:1/169: rename d8/d11/l21 to d8/l37 0 2024-09-11T00:07:04.097 INFO:tasks.workunit.client.1.smithi203.stdout:8/120: symlink d1/d13/l2c 0 2024-09-11T00:07:04.099 INFO:tasks.workunit.client.1.smithi203.stdout:1/170: chown d8/d9/f1c 28494459 1 2024-09-11T00:07:04.100 INFO:tasks.workunit.client.1.smithi203.stdout:8/121: rename d1/d13/d22 to d1/d13/d22/d2d 22 2024-09-11T00:07:04.100 INFO:tasks.workunit.client.1.smithi203.stdout:5/184: sync 2024-09-11T00:07:04.100 INFO:tasks.workunit.client.1.smithi203.stdout:6/138: sync 2024-09-11T00:07:04.104 INFO:tasks.workunit.client.1.smithi203.stdout:6/139: fdatasync d0/f16 0 2024-09-11T00:07:04.115 INFO:tasks.workunit.client.1.smithi203.stdout:3/206: dwrite d8/f2c [0,4194304] 0 2024-09-11T00:07:04.116 INFO:tasks.workunit.client.1.smithi203.stdout:9/142: creat d6/de/d19/f33 x:0 0 0 2024-09-11T00:07:04.118 INFO:tasks.workunit.client.0.smithi111.stdout:0/83: mkdir d3/d1c 0 2024-09-11T00:07:04.119 INFO:tasks.workunit.client.0.smithi111.stdout:2/103: creat d0/d3/f1d x:0 0 0 2024-09-11T00:07:04.119 INFO:tasks.workunit.client.0.smithi111.stdout:0/84: fdatasync d3/fd 0 2024-09-11T00:07:04.120 INFO:tasks.workunit.client.0.smithi111.stdout:9/109: symlink d6/l24 0 2024-09-11T00:07:04.120 INFO:tasks.workunit.client.0.smithi111.stdout:7/90: write dd/f18 [68030,7725] 0 2024-09-11T00:07:04.121 INFO:tasks.workunit.client.0.smithi111.stdout:0/85: readlink d3/dc/l16 0 2024-09-11T00:07:04.123 INFO:tasks.workunit.client.0.smithi111.stdout:0/86: write d3/f15 [534314,90927] 0 2024-09-11T00:07:04.124 INFO:tasks.workunit.client.1.smithi203.stdout:7/161: dwrite dd/f37 [0,4194304] 0 2024-09-11T00:07:04.127 INFO:tasks.workunit.client.1.smithi203.stdout:1/171: mknod d8/d11/d29/c38 0 2024-09-11T00:07:04.134 INFO:tasks.workunit.client.0.smithi111.stdout:6/73: creat d7/f12 x:0 0 0 2024-09-11T00:07:04.141 INFO:tasks.workunit.client.0.smithi111.stdout:2/104: creat d0/d3/de/f1e x:0 0 0 2024-09-11T00:07:04.142 INFO:tasks.workunit.client.1.smithi203.stdout:3/207: dread d8/fb [0,4194304] 0 2024-09-11T00:07:04.143 INFO:tasks.workunit.client.1.smithi203.stdout:1/172: creat d8/d9/d15/d27/f39 x:0 0 0 2024-09-11T00:07:04.144 INFO:tasks.workunit.client.1.smithi203.stdout:2/108: getdents d13/d15 0 2024-09-11T00:07:04.145 INFO:tasks.workunit.client.0.smithi111.stdout:7/91: creat dd/f1c x:0 0 0 2024-09-11T00:07:04.146 INFO:tasks.workunit.client.0.smithi111.stdout:0/87: creat d3/da/f1d x:0 0 0 2024-09-11T00:07:04.148 INFO:tasks.workunit.client.1.smithi203.stdout:9/143: dwrite d6/de/d19/d24/f27 [0,4194304] 0 2024-09-11T00:07:04.150 INFO:tasks.workunit.client.1.smithi203.stdout:6/140: dread d0/f14 [0,4194304] 0 2024-09-11T00:07:04.150 INFO:tasks.workunit.client.0.smithi111.stdout:0/88: dread d3/f11 [0,4194304] 0 2024-09-11T00:07:04.151 INFO:tasks.workunit.client.1.smithi203.stdout:3/208: truncate d8/f3d 824536 0 2024-09-11T00:07:04.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:03 smithi111 ceph-mon[27539]: pgmap v321: 65 pgs: 65 active+clean; 382 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 546 KiB/s rd, 25 MiB/s wr, 172 op/s 2024-09-11T00:07:04.153 INFO:tasks.workunit.client.1.smithi203.stdout:6/141: readlink d0/d6/la 0 2024-09-11T00:07:04.155 INFO:tasks.workunit.client.0.smithi111.stdout:4/70: creat f15 x:0 0 0 2024-09-11T00:07:04.156 INFO:tasks.workunit.client.1.smithi203.stdout:7/162: dwrite dd/d1c/f3a [0,4194304] 0 2024-09-11T00:07:04.158 INFO:tasks.workunit.client.1.smithi203.stdout:9/144: write d6/de/d19/d13/d29/f2b [1758874,16907] 0 2024-09-11T00:07:04.159 INFO:tasks.workunit.client.0.smithi111.stdout:2/105: creat d0/d3/de/f1f x:0 0 0 2024-09-11T00:07:04.162 INFO:tasks.workunit.client.1.smithi203.stdout:3/209: dread - d8/da/d37/f47 zero size 2024-09-11T00:07:04.163 INFO:tasks.workunit.client.1.smithi203.stdout:2/109: rmdir d13 39 2024-09-11T00:07:04.164 INFO:tasks.workunit.client.0.smithi111.stdout:7/92: mkdir dd/d1d 0 2024-09-11T00:07:04.165 INFO:tasks.workunit.client.0.smithi111.stdout:7/93: fsync dd/f19 0 2024-09-11T00:07:04.167 INFO:tasks.workunit.client.1.smithi203.stdout:1/173: readlink d8/d11/d29/l33 0 2024-09-11T00:07:04.170 INFO:tasks.workunit.client.1.smithi203.stdout:1/174: chown d8/d9/d15/f22 1 1 2024-09-11T00:07:04.172 INFO:tasks.workunit.client.1.smithi203.stdout:4/122: dwrite db/dd/f13 [4194304,4194304] 0 2024-09-11T00:07:04.176 INFO:tasks.workunit.client.0.smithi111.stdout:0/89: rename d3/d9 to d3/d13/d1e 0 2024-09-11T00:07:04.178 INFO:tasks.workunit.client.1.smithi203.stdout:6/142: fdatasync d0/f10 0 2024-09-11T00:07:04.179 INFO:tasks.workunit.client.0.smithi111.stdout:7/94: dwrite f6 [4194304,4194304] 0 2024-09-11T00:07:04.180 INFO:tasks.workunit.client.0.smithi111.stdout:7/95: stat f6 0 2024-09-11T00:07:04.181 INFO:tasks.workunit.client.1.smithi203.stdout:9/145: dread d6/de/d19/d13/f2a [0,4194304] 0 2024-09-11T00:07:04.189 INFO:tasks.workunit.client.0.smithi111.stdout:2/106: rename d0/d3/d12/l17 to d0/d3/d12/l20 0 2024-09-11T00:07:04.189 INFO:tasks.workunit.client.1.smithi203.stdout:1/175: mkdir d8/d11/d29/d3a 0 2024-09-11T00:07:04.192 INFO:tasks.workunit.client.1.smithi203.stdout:4/123: write fa [1292757,124548] 0 2024-09-11T00:07:04.193 INFO:tasks.workunit.client.1.smithi203.stdout:7/163: mkdir dd/d3b 0 2024-09-11T00:07:04.194 INFO:tasks.workunit.client.1.smithi203.stdout:4/124: fdatasync db/dd/f11 0 2024-09-11T00:07:04.196 INFO:tasks.workunit.client.0.smithi111.stdout:0/90: write f2 [285145,21443] 0 2024-09-11T00:07:04.197 INFO:tasks.workunit.client.1.smithi203.stdout:0/156: truncate d0/f29 1311641 0 2024-09-11T00:07:04.204 INFO:tasks.workunit.client.0.smithi111.stdout:7/96: rename dd/f12 to dd/f1e 0 2024-09-11T00:07:04.206 INFO:tasks.workunit.client.1.smithi203.stdout:1/176: creat d8/f3b x:0 0 0 2024-09-11T00:07:04.207 INFO:tasks.workunit.client.0.smithi111.stdout:7/97: dread dd/f18 [0,4194304] 0 2024-09-11T00:07:04.210 INFO:tasks.workunit.client.1.smithi203.stdout:4/125: dread f2 [0,4194304] 0 2024-09-11T00:07:04.212 INFO:tasks.workunit.client.0.smithi111.stdout:2/107: creat d0/d3/de/f21 x:0 0 0 2024-09-11T00:07:04.212 INFO:tasks.workunit.client.1.smithi203.stdout:4/126: read fa [262451,82731] 0 2024-09-11T00:07:04.214 INFO:tasks.workunit.client.0.smithi111.stdout:2/108: chown d0/d3/f13 59 1 2024-09-11T00:07:04.215 INFO:tasks.workunit.client.0.smithi111.stdout:0/91: creat d3/dc/f1f x:0 0 0 2024-09-11T00:07:04.215 INFO:tasks.workunit.client.0.smithi111.stdout:1/79: sync 2024-09-11T00:07:04.215 INFO:tasks.workunit.client.0.smithi111.stdout:5/113: sync 2024-09-11T00:07:04.215 INFO:tasks.workunit.client.0.smithi111.stdout:0/92: fsync f0 0 2024-09-11T00:07:04.216 INFO:tasks.workunit.client.0.smithi111.stdout:3/121: dwrite ff [4194304,4194304] 0 2024-09-11T00:07:04.217 INFO:tasks.workunit.client.0.smithi111.stdout:3/122: read - f1a zero size 2024-09-11T00:07:04.222 INFO:tasks.workunit.client.1.smithi203.stdout:0/157: creat d0/d2/f32 x:0 0 0 2024-09-11T00:07:04.233 INFO:tasks.workunit.client.1.smithi203.stdout:7/164: mknod dd/c3c 0 2024-09-11T00:07:04.238 INFO:tasks.workunit.client.1.smithi203.stdout:6/143: creat d0/f25 x:0 0 0 2024-09-11T00:07:04.245 INFO:tasks.workunit.client.1.smithi203.stdout:4/127: dwrite f2 [0,4194304] 0 2024-09-11T00:07:04.247 INFO:tasks.workunit.client.1.smithi203.stdout:4/128: write f1 [3623956,29867] 0 2024-09-11T00:07:04.251 INFO:tasks.workunit.client.1.smithi203.stdout:0/158: mknod d0/d1d/c33 0 2024-09-11T00:07:04.252 INFO:tasks.workunit.client.0.smithi111.stdout:0/93: symlink d3/d13/l20 0 2024-09-11T00:07:04.253 INFO:tasks.workunit.client.0.smithi111.stdout:4/71: link c13 c16 0 2024-09-11T00:07:04.256 INFO:tasks.workunit.client.0.smithi111.stdout:3/123: mknod d1c/d21/c27 0 2024-09-11T00:07:04.256 INFO:tasks.workunit.client.0.smithi111.stdout:8/104: sync 2024-09-11T00:07:04.256 INFO:tasks.workunit.client.0.smithi111.stdout:6/74: sync 2024-09-11T00:07:04.257 INFO:tasks.workunit.client.0.smithi111.stdout:5/114: dwrite f7 [0,4194304] 0 2024-09-11T00:07:04.258 INFO:tasks.workunit.client.0.smithi111.stdout:0/94: dread d3/f11 [0,4194304] 0 2024-09-11T00:07:04.259 INFO:tasks.workunit.client.0.smithi111.stdout:5/115: readlink d10/l11 0 2024-09-11T00:07:04.259 INFO:tasks.workunit.client.0.smithi111.stdout:8/105: chown fd 392902 1 2024-09-11T00:07:04.261 INFO:tasks.workunit.client.0.smithi111.stdout:0/95: fsync d3/fd 0 2024-09-11T00:07:04.262 INFO:tasks.workunit.client.0.smithi111.stdout:7/98: mkdir dd/d1d/d1f 0 2024-09-11T00:07:04.263 INFO:tasks.workunit.client.1.smithi203.stdout:8/122: write d1/f8 [1601489,121808] 0 2024-09-11T00:07:04.264 INFO:tasks.workunit.client.1.smithi203.stdout:4/129: truncate f9 4481965 0 2024-09-11T00:07:04.265 INFO:tasks.workunit.client.0.smithi111.stdout:7/99: chown f6 2158 1 2024-09-11T00:07:04.267 INFO:tasks.workunit.client.0.smithi111.stdout:1/80: dwrite d2/de/d12/d13/f1a [0,4194304] 0 2024-09-11T00:07:04.271 INFO:tasks.workunit.client.0.smithi111.stdout:6/75: creat d7/f13 x:0 0 0 2024-09-11T00:07:04.271 INFO:tasks.workunit.client.0.smithi111.stdout:3/124: creat d1c/d1d/d22/d23/f28 x:0 0 0 2024-09-11T00:07:04.271 INFO:tasks.workunit.client.1.smithi203.stdout:1/177: getdents d8/d9 0 2024-09-11T00:07:04.272 INFO:tasks.workunit.client.0.smithi111.stdout:8/106: write f10 [260889,121638] 0 2024-09-11T00:07:04.275 INFO:tasks.workunit.client.1.smithi203.stdout:8/123: symlink d1/d13/l2e 0 2024-09-11T00:07:04.279 INFO:tasks.workunit.client.0.smithi111.stdout:0/96: creat d3/da/f21 x:0 0 0 2024-09-11T00:07:04.282 INFO:tasks.workunit.client.0.smithi111.stdout:5/116: dwrite d10/d1e/f21 [0,4194304] 0 2024-09-11T00:07:04.282 INFO:tasks.workunit.client.0.smithi111.stdout:7/100: rmdir dd/d1d 39 2024-09-11T00:07:04.283 INFO:tasks.workunit.client.1.smithi203.stdout:7/165: creat dd/f3d x:0 0 0 2024-09-11T00:07:04.285 INFO:tasks.workunit.client.1.smithi203.stdout:7/166: stat dd/d1c/d26/d31/f39 0 2024-09-11T00:07:04.286 INFO:tasks.workunit.client.0.smithi111.stdout:4/72: mknod c17 0 2024-09-11T00:07:04.288 INFO:tasks.workunit.client.0.smithi111.stdout:2/109: chown d0/d3/de/f11 378610 1 2024-09-11T00:07:04.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:03 smithi203 ceph-mon[33225]: pgmap v321: 65 pgs: 65 active+clean; 382 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 546 KiB/s rd, 25 MiB/s wr, 172 op/s 2024-09-11T00:07:04.298 INFO:tasks.workunit.client.1.smithi203.stdout:0/159: creat d0/f34 x:0 0 0 2024-09-11T00:07:04.300 INFO:tasks.workunit.client.0.smithi111.stdout:1/81: rename d2/de/f14 to d2/de/d12/f1c 0 2024-09-11T00:07:04.303 INFO:tasks.workunit.client.1.smithi203.stdout:3/210: dwrite d8/d17/f1c [0,4194304] 0 2024-09-11T00:07:04.306 INFO:tasks.workunit.client.0.smithi111.stdout:8/107: dread d11/f15 [0,4194304] 0 2024-09-11T00:07:04.307 INFO:tasks.workunit.client.0.smithi111.stdout:8/108: chown d11/f19 656603 1 2024-09-11T00:07:04.308 INFO:tasks.workunit.client.0.smithi111.stdout:8/109: readlink d11/l17 0 2024-09-11T00:07:04.311 INFO:tasks.workunit.client.1.smithi203.stdout:0/160: creat d0/d2/f35 x:0 0 0 2024-09-11T00:07:04.312 INFO:tasks.workunit.client.1.smithi203.stdout:4/130: truncate db/dd/f11 845432 0 2024-09-11T00:07:04.315 INFO:tasks.workunit.client.1.smithi203.stdout:7/167: fdatasync dd/f14 0 2024-09-11T00:07:04.321 INFO:tasks.workunit.client.1.smithi203.stdout:3/211: dwrite d8/da/d34/f4d [0,4194304] 0 2024-09-11T00:07:04.328 INFO:tasks.workunit.client.0.smithi111.stdout:2/110: unlink d0/f4 0 2024-09-11T00:07:04.329 INFO:tasks.workunit.client.1.smithi203.stdout:3/212: chown d8/c14 227 1 2024-09-11T00:07:04.329 INFO:tasks.workunit.client.1.smithi203.stdout:1/178: dread d8/d19/f1b [0,4194304] 0 2024-09-11T00:07:04.332 INFO:tasks.workunit.client.1.smithi203.stdout:8/124: dread d1/f11 [0,4194304] 0 2024-09-11T00:07:04.333 INFO:tasks.workunit.client.1.smithi203.stdout:0/161: dwrite d0/d2/f3 [0,4194304] 0 2024-09-11T00:07:04.334 INFO:tasks.workunit.client.0.smithi111.stdout:1/82: creat d2/de/d12/d13/f1d x:0 0 0 2024-09-11T00:07:04.335 INFO:tasks.workunit.client.1.smithi203.stdout:8/125: write d1/d13/f21 [3428485,106618] 0 2024-09-11T00:07:04.336 INFO:tasks.workunit.client.0.smithi111.stdout:1/83: dread - d2/de/f17 zero size 2024-09-11T00:07:04.337 INFO:tasks.workunit.client.1.smithi203.stdout:8/126: stat d1/d13/d22/l25 0 2024-09-11T00:07:04.338 INFO:tasks.workunit.client.1.smithi203.stdout:4/131: creat db/f21 x:0 0 0 2024-09-11T00:07:04.340 INFO:tasks.workunit.client.0.smithi111.stdout:0/97: unlink d3/f11 0 2024-09-11T00:07:04.342 INFO:tasks.workunit.client.0.smithi111.stdout:0/98: readlink d3/dc/l10 0 2024-09-11T00:07:04.345 INFO:tasks.workunit.client.0.smithi111.stdout:8/110: symlink d11/l1c 0 2024-09-11T00:07:04.351 INFO:tasks.workunit.client.0.smithi111.stdout:1/84: dwrite d2/f9 [0,4194304] 0 2024-09-11T00:07:04.359 INFO:tasks.workunit.client.0.smithi111.stdout:7/101: getdents dd/d1d/d1f 0 2024-09-11T00:07:04.359 INFO:tasks.workunit.client.0.smithi111.stdout:3/125: sync 2024-09-11T00:07:04.359 INFO:tasks.workunit.client.0.smithi111.stdout:9/110: truncate d6/db/f18 3248349 0 2024-09-11T00:07:04.364 INFO:tasks.workunit.client.0.smithi111.stdout:0/99: symlink d3/d13/l22 0 2024-09-11T00:07:04.369 INFO:tasks.workunit.client.1.smithi203.stdout:7/168: creat dd/f3e x:0 0 0 2024-09-11T00:07:04.372 INFO:tasks.workunit.client.0.smithi111.stdout:8/111: rename fd to d11/f1d 0 2024-09-11T00:07:04.372 INFO:tasks.workunit.client.1.smithi203.stdout:0/162: dwrite d0/d2/fe [8388608,4194304] 0 2024-09-11T00:07:04.372 INFO:tasks.workunit.client.0.smithi111.stdout:8/112: chown f8 11 1 2024-09-11T00:07:04.373 INFO:tasks.workunit.client.0.smithi111.stdout:8/113: readlink d11/l18 0 2024-09-11T00:07:04.374 INFO:tasks.workunit.client.1.smithi203.stdout:1/179: link d8/d9/l1d d8/d9/d15/l3c 0 2024-09-11T00:07:04.375 INFO:tasks.workunit.client.0.smithi111.stdout:3/126: write f8 [481376,24126] 0 2024-09-11T00:07:04.386 INFO:tasks.workunit.client.0.smithi111.stdout:5/117: getdents d10/d1e/d23 0 2024-09-11T00:07:04.386 INFO:tasks.workunit.client.1.smithi203.stdout:0/163: symlink d0/l36 0 2024-09-11T00:07:04.389 INFO:tasks.workunit.client.1.smithi203.stdout:1/180: creat d8/d9/d15/d30/f3d x:0 0 0 2024-09-11T00:07:04.390 INFO:tasks.workunit.client.0.smithi111.stdout:3/127: dwrite f1a [0,4194304] 0 2024-09-11T00:07:04.390 INFO:tasks.workunit.client.0.smithi111.stdout:3/128: chown c18 588 1 2024-09-11T00:07:04.392 INFO:tasks.workunit.client.0.smithi111.stdout:3/129: write d1c/d1d/f1e [493959,28729] 0 2024-09-11T00:07:04.394 INFO:tasks.workunit.client.0.smithi111.stdout:7/102: mknod dd/c20 0 2024-09-11T00:07:04.396 INFO:tasks.workunit.client.1.smithi203.stdout:0/164: mkdir d0/d2/d37 0 2024-09-11T00:07:04.398 INFO:tasks.workunit.client.1.smithi203.stdout:1/181: mkdir d8/d9/d15/d30/d3e 0 2024-09-11T00:07:04.400 INFO:tasks.workunit.client.0.smithi111.stdout:0/100: creat d3/d1c/f23 x:0 0 0 2024-09-11T00:07:04.408 INFO:tasks.workunit.client.0.smithi111.stdout:5/118: creat d10/d1e/f28 x:0 0 0 2024-09-11T00:07:04.412 INFO:tasks.workunit.client.1.smithi203.stdout:0/165: creat d0/d2/d37/f38 x:0 0 0 2024-09-11T00:07:04.412 INFO:tasks.workunit.client.0.smithi111.stdout:5/119: dread - d10/d1e/f28 zero size 2024-09-11T00:07:04.413 INFO:tasks.workunit.client.0.smithi111.stdout:7/103: dwrite dd/f1c [0,4194304] 0 2024-09-11T00:07:04.415 INFO:tasks.workunit.client.0.smithi111.stdout:4/73: dwrite f8 [4194304,4194304] 0 2024-09-11T00:07:04.415 INFO:tasks.workunit.client.0.smithi111.stdout:1/85: sync 2024-09-11T00:07:04.416 INFO:tasks.workunit.client.1.smithi203.stdout:1/182: mknod d8/d9/d15/d30/d3e/c3f 0 2024-09-11T00:07:04.419 INFO:tasks.workunit.client.1.smithi203.stdout:1/183: chown d8/d9/l18 10 1 2024-09-11T00:07:04.420 INFO:tasks.workunit.client.1.smithi203.stdout:4/132: truncate db/f10 3727651 0 2024-09-11T00:07:04.422 INFO:tasks.workunit.client.1.smithi203.stdout:8/127: dwrite d1/f20 [0,4194304] 0 2024-09-11T00:07:04.423 INFO:tasks.workunit.client.0.smithi111.stdout:6/76: dwrite d7/f9 [0,4194304] 0 2024-09-11T00:07:04.428 INFO:tasks.workunit.client.1.smithi203.stdout:7/169: write dd/d1c/d26/d31/f39 [673253,56904] 0 2024-09-11T00:07:04.430 INFO:tasks.workunit.client.1.smithi203.stdout:0/166: dread d0/d2/fb [0,4194304] 0 2024-09-11T00:07:04.438 INFO:tasks.workunit.client.0.smithi111.stdout:5/120: dwrite d10/f1c [0,4194304] 0 2024-09-11T00:07:04.439 INFO:tasks.workunit.client.1.smithi203.stdout:8/128: mkdir d1/d13/d17/d2f 0 2024-09-11T00:07:04.440 INFO:tasks.workunit.client.0.smithi111.stdout:5/121: write fd [678717,26823] 0 2024-09-11T00:07:04.453 INFO:tasks.workunit.client.0.smithi111.stdout:6/77: dwrite d7/ff [0,4194304] 0 2024-09-11T00:07:04.455 INFO:tasks.workunit.client.0.smithi111.stdout:8/114: truncate f7 3788451 0 2024-09-11T00:07:04.456 INFO:tasks.workunit.client.0.smithi111.stdout:8/115: readlink d11/l1c 0 2024-09-11T00:07:04.456 INFO:tasks.workunit.client.1.smithi203.stdout:1/184: mknod d8/d9/d15/d35/c40 0 2024-09-11T00:07:04.459 INFO:tasks.workunit.client.0.smithi111.stdout:4/74: unlink l0 0 2024-09-11T00:07:04.460 INFO:tasks.workunit.client.1.smithi203.stdout:8/129: symlink d1/d13/l30 0 2024-09-11T00:07:04.461 INFO:tasks.workunit.client.0.smithi111.stdout:3/130: write d1c/d1d/f1f [2083315,16050] 0 2024-09-11T00:07:04.466 INFO:tasks.workunit.client.0.smithi111.stdout:0/101: mkdir d3/d24 0 2024-09-11T00:07:04.469 INFO:tasks.workunit.client.0.smithi111.stdout:9/111: dwrite d6/db/f18 [0,4194304] 0 2024-09-11T00:07:04.470 INFO:tasks.workunit.client.1.smithi203.stdout:1/185: truncate d8/d19/f26 1391399 0 2024-09-11T00:07:04.473 INFO:tasks.workunit.client.0.smithi111.stdout:8/116: dread d11/f1d [0,4194304] 0 2024-09-11T00:07:04.476 INFO:tasks.workunit.client.1.smithi203.stdout:0/167: write d0/d2/fb [71120,58848] 0 2024-09-11T00:07:04.477 INFO:tasks.workunit.client.1.smithi203.stdout:8/130: dread d1/d13/d17/f26 [0,4194304] 0 2024-09-11T00:07:04.481 INFO:tasks.workunit.client.0.smithi111.stdout:4/75: dwrite f8 [0,4194304] 0 2024-09-11T00:07:04.482 INFO:tasks.workunit.client.1.smithi203.stdout:1/186: fdatasync d8/d9/fd 0 2024-09-11T00:07:04.484 INFO:tasks.workunit.client.0.smithi111.stdout:9/112: dread d6/db/f18 [0,4194304] 0 2024-09-11T00:07:04.484 INFO:tasks.workunit.client.1.smithi203.stdout:1/187: dread - d8/d9/d15/d27/f2e zero size 2024-09-11T00:07:04.486 INFO:tasks.workunit.client.1.smithi203.stdout:1/188: read - d8/d9/d15/d27/f2e zero size 2024-09-11T00:07:04.487 INFO:tasks.workunit.client.1.smithi203.stdout:0/168: symlink d0/d1d/l39 0 2024-09-11T00:07:04.487 INFO:tasks.workunit.client.0.smithi111.stdout:8/117: dread d11/f1d [0,4194304] 0 2024-09-11T00:07:04.488 INFO:tasks.workunit.client.0.smithi111.stdout:8/118: dread - d11/f1b zero size 2024-09-11T00:07:04.488 INFO:tasks.workunit.client.1.smithi203.stdout:8/131: creat d1/d13/d17/f31 x:0 0 0 2024-09-11T00:07:04.489 INFO:tasks.workunit.client.0.smithi111.stdout:0/102: symlink d3/d13/l25 0 2024-09-11T00:07:04.490 INFO:tasks.workunit.client.1.smithi203.stdout:1/189: write d8/d9/d15/d30/f3d [870355,124838] 0 2024-09-11T00:07:04.494 INFO:tasks.workunit.client.1.smithi203.stdout:0/169: fsync d0/f18 0 2024-09-11T00:07:04.496 INFO:tasks.workunit.client.0.smithi111.stdout:5/122: creat d10/d1e/d25/f29 x:0 0 0 2024-09-11T00:07:04.497 INFO:tasks.workunit.client.0.smithi111.stdout:5/123: write d10/f16 [905393,5046] 0 2024-09-11T00:07:04.497 INFO:tasks.workunit.client.0.smithi111.stdout:5/124: fsync d10/f1f 0 2024-09-11T00:07:04.498 INFO:tasks.workunit.client.1.smithi203.stdout:7/170: truncate dd/f12 485839 0 2024-09-11T00:07:04.502 INFO:tasks.workunit.client.1.smithi203.stdout:1/190: write d8/d9/d15/f25 [2393949,27409] 0 2024-09-11T00:07:04.502 INFO:tasks.workunit.client.0.smithi111.stdout:1/86: link d2/l7 d2/l1e 0 2024-09-11T00:07:04.503 INFO:tasks.workunit.client.0.smithi111.stdout:1/87: fsync d2/f9 0 2024-09-11T00:07:04.503 INFO:tasks.workunit.client.1.smithi203.stdout:1/191: readlink d8/d9/d15/d27/l2f 0 2024-09-11T00:07:04.513 INFO:tasks.workunit.client.0.smithi111.stdout:9/113: rename d6/db/f21 to d6/dc/d13/f25 0 2024-09-11T00:07:04.513 INFO:tasks.workunit.client.1.smithi203.stdout:0/170: dwrite d0/d2/f13 [0,4194304] 0 2024-09-11T00:07:04.514 INFO:tasks.workunit.client.1.smithi203.stdout:4/133: truncate db/f10 2918656 0 2024-09-11T00:07:04.514 INFO:tasks.workunit.client.0.smithi111.stdout:9/114: truncate d6/dc/f17 397667 0 2024-09-11T00:07:04.515 INFO:tasks.workunit.client.0.smithi111.stdout:9/115: fsync d6/dc/d13/f1d 0 2024-09-11T00:07:04.516 INFO:tasks.workunit.client.0.smithi111.stdout:3/131: mknod d1c/c29 0 2024-09-11T00:07:04.516 INFO:tasks.workunit.client.0.smithi111.stdout:6/78: sync 2024-09-11T00:07:04.516 INFO:tasks.workunit.client.1.smithi203.stdout:8/132: creat d1/d13/d17/d2f/f32 x:0 0 0 2024-09-11T00:07:04.517 INFO:tasks.workunit.client.0.smithi111.stdout:9/116: read d6/dc/f17 [49402,12817] 0 2024-09-11T00:07:04.518 INFO:tasks.workunit.client.0.smithi111.stdout:8/119: creat d11/f1e x:0 0 0 2024-09-11T00:07:04.521 INFO:tasks.workunit.client.1.smithi203.stdout:7/171: dwrite dd/f3e [0,4194304] 0 2024-09-11T00:07:04.521 INFO:tasks.workunit.client.1.smithi203.stdout:1/192: mkdir d8/d11/d29/d41 0 2024-09-11T00:07:04.528 INFO:tasks.workunit.client.0.smithi111.stdout:8/120: dread d11/f19 [0,4194304] 0 2024-09-11T00:07:04.529 INFO:tasks.workunit.client.0.smithi111.stdout:5/125: creat d10/d1e/f2a x:0 0 0 2024-09-11T00:07:04.530 INFO:tasks.workunit.client.0.smithi111.stdout:5/126: chown d10/d1e/d23 0 1 2024-09-11T00:07:04.531 INFO:tasks.workunit.client.1.smithi203.stdout:1/193: unlink d8/f3b 0 2024-09-11T00:07:04.533 INFO:tasks.workunit.client.0.smithi111.stdout:7/104: link c3 dd/d1d/d1f/c21 0 2024-09-11T00:07:04.535 INFO:tasks.workunit.client.1.smithi203.stdout:7/172: creat dd/d1c/d26/f3f x:0 0 0 2024-09-11T00:07:04.535 INFO:tasks.workunit.client.0.smithi111.stdout:7/105: chown dd 3 1 2024-09-11T00:07:04.536 INFO:tasks.workunit.client.0.smithi111.stdout:4/76: mkdir d18 0 2024-09-11T00:07:04.540 INFO:tasks.workunit.client.1.smithi203.stdout:0/171: mknod d0/c3a 0 2024-09-11T00:07:04.540 INFO:tasks.workunit.client.1.smithi203.stdout:8/133: dwrite d1/d13/f19 [0,4194304] 0 2024-09-11T00:07:04.544 INFO:tasks.workunit.client.1.smithi203.stdout:8/134: chown d1/d13 890173844 1 2024-09-11T00:07:04.545 INFO:tasks.workunit.client.0.smithi111.stdout:8/121: dwrite d11/f1a [0,4194304] 0 2024-09-11T00:07:04.545 INFO:tasks.workunit.client.0.smithi111.stdout:1/88: creat d2/f1f x:0 0 0 2024-09-11T00:07:04.548 INFO:tasks.workunit.client.0.smithi111.stdout:1/89: truncate d2/fd 58451 0 2024-09-11T00:07:04.550 INFO:tasks.workunit.client.0.smithi111.stdout:1/90: fsync d2/de/f16 0 2024-09-11T00:07:04.551 INFO:tasks.workunit.client.1.smithi203.stdout:4/134: dwrite db/f21 [0,4194304] 0 2024-09-11T00:07:04.552 INFO:tasks.workunit.client.0.smithi111.stdout:1/91: fdatasync d2/de/d12/d13/f1a 0 2024-09-11T00:07:04.553 INFO:tasks.workunit.client.0.smithi111.stdout:4/77: dwrite f14 [0,4194304] 0 2024-09-11T00:07:04.554 INFO:tasks.workunit.client.0.smithi111.stdout:4/78: fdatasync f8 0 2024-09-11T00:07:04.556 INFO:tasks.workunit.client.0.smithi111.stdout:1/92: write d2/de/d12/d13/f1a [4142306,77393] 0 2024-09-11T00:07:04.560 INFO:tasks.workunit.client.1.smithi203.stdout:1/194: rename d8/d9/fd to d8/d19/d31/d36/f42 0 2024-09-11T00:07:04.569 INFO:tasks.workunit.client.0.smithi111.stdout:3/132: symlink d1c/d1d/l2a 0 2024-09-11T00:07:04.569 INFO:tasks.workunit.client.1.smithi203.stdout:7/173: dwrite dd/d1c/d26/f3f [0,4194304] 0 2024-09-11T00:07:04.569 INFO:tasks.workunit.client.1.smithi203.stdout:0/172: creat d0/d2/d37/f3b x:0 0 0 2024-09-11T00:07:04.570 INFO:tasks.workunit.client.1.smithi203.stdout:0/173: fdatasync d0/d2/fb 0 2024-09-11T00:07:04.577 INFO:tasks.workunit.client.0.smithi111.stdout:4/79: dwrite f7 [0,4194304] 0 2024-09-11T00:07:04.577 INFO:tasks.workunit.client.0.smithi111.stdout:0/103: mkdir d3/d26 0 2024-09-11T00:07:04.579 INFO:tasks.workunit.client.0.smithi111.stdout:5/127: mkdir d10/d1e/d23/d2b 0 2024-09-11T00:07:04.579 INFO:tasks.workunit.client.0.smithi111.stdout:4/80: dread - f15 zero size 2024-09-11T00:07:04.584 INFO:tasks.workunit.client.0.smithi111.stdout:8/122: mknod d11/c1f 0 2024-09-11T00:07:04.586 INFO:tasks.workunit.client.0.smithi111.stdout:8/123: truncate ff 699985 0 2024-09-11T00:07:04.587 INFO:tasks.workunit.client.0.smithi111.stdout:8/124: chown f10 118062 1 2024-09-11T00:07:04.589 INFO:tasks.workunit.client.0.smithi111.stdout:8/125: write d11/f12 [809132,70842] 0 2024-09-11T00:07:04.589 INFO:tasks.workunit.client.0.smithi111.stdout:8/126: chown ff 55690 1 2024-09-11T00:07:04.591 INFO:tasks.workunit.client.0.smithi111.stdout:8/127: fdatasync ff 0 2024-09-11T00:07:04.594 INFO:tasks.workunit.client.1.smithi203.stdout:0/174: link d0/d1d/f2e d0/d1d/f3c 0 2024-09-11T00:07:04.600 INFO:tasks.workunit.client.1.smithi203.stdout:7/174: rename dd/d1c/c25 to dd/d1c/d26/c40 0 2024-09-11T00:07:04.601 INFO:tasks.workunit.client.0.smithi111.stdout:1/93: fsync d2/de/d12/f1c 0 2024-09-11T00:07:04.602 INFO:tasks.workunit.client.0.smithi111.stdout:1/94: fdatasync d2/fd 0 2024-09-11T00:07:04.604 INFO:tasks.workunit.client.1.smithi203.stdout:1/195: dread d8/d9/d15/f25 [0,4194304] 0 2024-09-11T00:07:04.610 INFO:tasks.workunit.client.1.smithi203.stdout:7/175: mknod dd/c41 0 2024-09-11T00:07:04.612 INFO:tasks.workunit.client.0.smithi111.stdout:3/133: dread f3 [0,4194304] 0 2024-09-11T00:07:04.613 INFO:tasks.workunit.client.1.smithi203.stdout:4/135: dwrite db/f10 [0,4194304] 0 2024-09-11T00:07:04.614 INFO:tasks.workunit.client.0.smithi111.stdout:3/134: chown f1a 138055 1 2024-09-11T00:07:04.614 INFO:tasks.workunit.client.1.smithi203.stdout:0/175: dread d0/d2/f12 [0,4194304] 0 2024-09-11T00:07:04.616 INFO:tasks.workunit.client.1.smithi203.stdout:1/196: rename d8/d9/d15/f25 to d8/d9/d15/f43 0 2024-09-11T00:07:04.617 INFO:tasks.workunit.client.0.smithi111.stdout:0/104: mknod d3/d13/c27 0 2024-09-11T00:07:04.618 INFO:tasks.workunit.client.0.smithi111.stdout:0/105: write d3/dc/f12 [891924,36756] 0 2024-09-11T00:07:04.618 INFO:tasks.workunit.client.1.smithi203.stdout:7/176: symlink dd/d1c/l42 0 2024-09-11T00:07:04.619 INFO:tasks.workunit.client.1.smithi203.stdout:0/176: write d0/f19 [1000167,102256] 0 2024-09-11T00:07:04.619 INFO:tasks.workunit.client.0.smithi111.stdout:5/128: mknod d10/d1e/c2c 0 2024-09-11T00:07:04.619 INFO:tasks.workunit.client.0.smithi111.stdout:7/106: mknod dd/d1d/d1f/c22 0 2024-09-11T00:07:04.620 INFO:tasks.workunit.client.0.smithi111.stdout:5/129: write fd [756758,118968] 0 2024-09-11T00:07:04.620 INFO:tasks.workunit.client.0.smithi111.stdout:7/107: readlink dd/l16 0 2024-09-11T00:07:04.621 INFO:tasks.workunit.client.1.smithi203.stdout:1/197: read d8/d11/f20 [1251869,66413] 0 2024-09-11T00:07:04.622 INFO:tasks.workunit.client.0.smithi111.stdout:2/111: link d0/fc d0/f22 0 2024-09-11T00:07:04.622 INFO:tasks.workunit.client.0.smithi111.stdout:7/108: chown dd/f18 33061591 1 2024-09-11T00:07:04.624 INFO:tasks.workunit.client.0.smithi111.stdout:6/79: truncate d7/fd 3768315 0 2024-09-11T00:07:04.624 INFO:tasks.workunit.client.0.smithi111.stdout:6/80: readlink d7/la 0 2024-09-11T00:07:04.627 INFO:tasks.workunit.client.0.smithi111.stdout:8/128: rename d11/f19 to d11/f20 0 2024-09-11T00:07:04.631 INFO:tasks.workunit.client.1.smithi203.stdout:7/177: unlink c4 0 2024-09-11T00:07:04.631 INFO:tasks.workunit.client.0.smithi111.stdout:1/95: creat d2/de/d12/d13/f20 x:0 0 0 2024-09-11T00:07:04.632 INFO:tasks.workunit.client.1.smithi203.stdout:4/136: creat db/dd/d19/f22 x:0 0 0 2024-09-11T00:07:04.636 INFO:tasks.workunit.client.0.smithi111.stdout:3/135: creat d1c/d21/f2b x:0 0 0 2024-09-11T00:07:04.636 INFO:tasks.workunit.client.0.smithi111.stdout:4/81: creat d18/f19 x:0 0 0 2024-09-11T00:07:04.637 INFO:tasks.workunit.client.1.smithi203.stdout:4/137: write f2 [5219597,129553] 0 2024-09-11T00:07:04.637 INFO:tasks.workunit.client.1.smithi203.stdout:0/177: truncate d0/f29 1736689 0 2024-09-11T00:07:04.642 INFO:tasks.workunit.client.1.smithi203.stdout:0/178: write d0/f5 [12724714,128442] 0 2024-09-11T00:07:04.644 INFO:tasks.workunit.client.0.smithi111.stdout:0/106: symlink d3/dc/l28 0 2024-09-11T00:07:04.645 INFO:tasks.workunit.client.0.smithi111.stdout:0/107: write d3/dc/f1f [762081,9075] 0 2024-09-11T00:07:04.646 INFO:tasks.workunit.client.1.smithi203.stdout:0/179: write d0/d2/f1a [1591052,80760] 0 2024-09-11T00:07:04.649 INFO:tasks.workunit.client.0.smithi111.stdout:5/130: creat d10/d1e/d25/f2d x:0 0 0 2024-09-11T00:07:04.651 INFO:tasks.workunit.client.1.smithi203.stdout:1/198: dwrite d8/d9/f1e [0,4194304] 0 2024-09-11T00:07:04.652 INFO:tasks.workunit.client.0.smithi111.stdout:7/109: creat dd/d1d/d1f/f23 x:0 0 0 2024-09-11T00:07:04.656 INFO:tasks.workunit.client.0.smithi111.stdout:6/81: rename d7/l10 to d7/l14 0 2024-09-11T00:07:04.658 INFO:tasks.workunit.client.1.smithi203.stdout:0/180: mkdir d0/d2/d3d 0 2024-09-11T00:07:04.659 INFO:tasks.workunit.client.0.smithi111.stdout:8/129: mkdir d11/d21 0 2024-09-11T00:07:04.661 INFO:tasks.workunit.client.0.smithi111.stdout:1/96: mknod d2/de/d12/c21 0 2024-09-11T00:07:04.662 INFO:tasks.workunit.client.0.smithi111.stdout:2/112: dwrite d0/d3/f13 [4194304,4194304] 0 2024-09-11T00:07:04.663 INFO:tasks.workunit.client.0.smithi111.stdout:9/117: getdents d6/db 0 2024-09-11T00:07:04.663 INFO:tasks.workunit.client.0.smithi111.stdout:1/97: read - d2/de/f17 zero size 2024-09-11T00:07:04.665 INFO:tasks.workunit.client.1.smithi203.stdout:1/199: symlink d8/d9/d15/d27/l44 0 2024-09-11T00:07:04.667 INFO:tasks.workunit.client.1.smithi203.stdout:1/200: fdatasync d8/d9/d15/d30/f3d 0 2024-09-11T00:07:04.677 INFO:tasks.workunit.client.1.smithi203.stdout:7/178: dwrite dd/d1c/f20 [0,4194304] 0 2024-09-11T00:07:04.678 INFO:tasks.workunit.client.0.smithi111.stdout:5/131: symlink d10/d1e/l2e 0 2024-09-11T00:07:04.680 INFO:tasks.workunit.client.0.smithi111.stdout:7/110: mkdir dd/d1d/d1f/d24 0 2024-09-11T00:07:04.681 INFO:tasks.workunit.client.0.smithi111.stdout:5/132: write f2 [1179581,31687] 0 2024-09-11T00:07:04.684 INFO:tasks.workunit.client.0.smithi111.stdout:7/111: read f6 [7579400,85251] 0 2024-09-11T00:07:04.684 INFO:tasks.workunit.client.0.smithi111.stdout:6/82: creat d7/f15 x:0 0 0 2024-09-11T00:07:04.685 INFO:tasks.workunit.client.1.smithi203.stdout:4/138: truncate db/f21 3444538 0 2024-09-11T00:07:04.686 INFO:tasks.workunit.client.1.smithi203.stdout:4/139: stat c5 0 2024-09-11T00:07:04.687 INFO:tasks.workunit.client.0.smithi111.stdout:1/98: dwrite d2/fd [0,4194304] 0 2024-09-11T00:07:04.690 INFO:tasks.workunit.client.0.smithi111.stdout:2/113: dwrite d0/d3/de/f1e [0,4194304] 0 2024-09-11T00:07:04.691 INFO:tasks.workunit.client.0.smithi111.stdout:9/118: dwrite d6/db/fd [0,4194304] 0 2024-09-11T00:07:04.693 INFO:tasks.workunit.client.0.smithi111.stdout:7/112: read f6 [6184778,35944] 0 2024-09-11T00:07:04.694 INFO:tasks.workunit.client.1.smithi203.stdout:0/181: getdents d0/d1d 0 2024-09-11T00:07:04.695 INFO:tasks.workunit.client.0.smithi111.stdout:3/136: mknod d1c/c2c 0 2024-09-11T00:07:04.696 INFO:tasks.workunit.client.1.smithi203.stdout:4/140: creat db/f23 x:0 0 0 2024-09-11T00:07:04.698 INFO:tasks.workunit.client.1.smithi203.stdout:1/201: link d8/d9/d15/d35/c40 d8/d28/c45 0 2024-09-11T00:07:04.699 INFO:tasks.workunit.client.1.smithi203.stdout:4/141: chown c5 0 1 2024-09-11T00:07:04.699 INFO:tasks.workunit.client.1.smithi203.stdout:7/179: dwrite dd/d1c/f2d [0,4194304] 0 2024-09-11T00:07:04.699 INFO:tasks.workunit.client.0.smithi111.stdout:7/113: dread - dd/f19 zero size 2024-09-11T00:07:04.700 INFO:tasks.workunit.client.0.smithi111.stdout:1/99: write d2/de/d12/d13/f1a [3682644,70406] 0 2024-09-11T00:07:04.701 INFO:tasks.workunit.client.1.smithi203.stdout:0/182: creat d0/d2/d37/f3e x:0 0 0 2024-09-11T00:07:04.701 INFO:tasks.workunit.client.0.smithi111.stdout:9/119: write d6/dc/d13/f1d [981323,107836] 0 2024-09-11T00:07:04.703 INFO:tasks.workunit.client.0.smithi111.stdout:0/108: dread d3/f7 [0,4194304] 0 2024-09-11T00:07:04.711 INFO:tasks.workunit.client.1.smithi203.stdout:5/185: sync 2024-09-11T00:07:04.713 INFO:tasks.workunit.client.1.smithi203.stdout:4/142: rename fa to db/dd/d16/f24 0 2024-09-11T00:07:04.716 INFO:tasks.workunit.client.0.smithi111.stdout:6/83: unlink d7/fb 0 2024-09-11T00:07:04.718 INFO:tasks.workunit.client.1.smithi203.stdout:7/180: symlink dd/d1c/d26/d31/l43 0 2024-09-11T00:07:04.720 INFO:tasks.workunit.client.1.smithi203.stdout:0/183: truncate d0/f18 1803905 0 2024-09-11T00:07:04.721 INFO:tasks.workunit.client.0.smithi111.stdout:8/130: truncate d11/f20 3968237 0 2024-09-11T00:07:04.722 INFO:tasks.workunit.client.0.smithi111.stdout:8/131: fdatasync f8 0 2024-09-11T00:07:04.722 INFO:tasks.workunit.client.1.smithi203.stdout:0/184: write d0/d2/f32 [390558,125155] 0 2024-09-11T00:07:04.726 INFO:tasks.workunit.client.0.smithi111.stdout:3/137: symlink d1c/d21/l2d 0 2024-09-11T00:07:04.726 INFO:tasks.workunit.client.0.smithi111.stdout:3/138: fsync f17 0 2024-09-11T00:07:04.729 INFO:tasks.workunit.client.1.smithi203.stdout:4/143: mknod db/dd/d19/c25 0 2024-09-11T00:07:04.730 INFO:tasks.workunit.client.0.smithi111.stdout:2/114: mknod d0/d3/d12/c23 0 2024-09-11T00:07:04.732 INFO:tasks.workunit.client.0.smithi111.stdout:2/115: write d0/d3/de/f1f [19429,15011] 0 2024-09-11T00:07:04.733 INFO:tasks.workunit.client.1.smithi203.stdout:5/186: dwrite dc/dd/d13/f35 [0,4194304] 0 2024-09-11T00:07:04.736 INFO:tasks.workunit.client.1.smithi203.stdout:0/185: creat d0/d1d/f3f x:0 0 0 2024-09-11T00:07:04.740 INFO:tasks.workunit.client.1.smithi203.stdout:4/144: mkdir db/dd/d26 0 2024-09-11T00:07:04.742 INFO:tasks.workunit.client.1.smithi203.stdout:6/144: sync 2024-09-11T00:07:04.742 INFO:tasks.workunit.client.1.smithi203.stdout:9/146: sync 2024-09-11T00:07:04.742 INFO:tasks.workunit.client.1.smithi203.stdout:8/135: sync 2024-09-11T00:07:04.743 INFO:tasks.workunit.client.1.smithi203.stdout:2/110: sync 2024-09-11T00:07:04.743 INFO:tasks.workunit.client.1.smithi203.stdout:3/213: sync 2024-09-11T00:07:04.743 INFO:tasks.workunit.client.0.smithi111.stdout:9/120: rename d6/dc/c10 to d6/db/d1b/c26 0 2024-09-11T00:07:04.744 INFO:tasks.workunit.client.1.smithi203.stdout:4/145: chown db/dd/d19/c25 97113501 1 2024-09-11T00:07:04.745 INFO:tasks.workunit.client.0.smithi111.stdout:9/121: chown d6/db/fd 669834 1 2024-09-11T00:07:04.745 INFO:tasks.workunit.client.0.smithi111.stdout:9/122: chown d6/db 500440 1 2024-09-11T00:07:04.747 INFO:tasks.workunit.client.0.smithi111.stdout:1/100: dwrite d2/de/f11 [0,4194304] 0 2024-09-11T00:07:04.747 INFO:tasks.workunit.client.1.smithi203.stdout:7/181: symlink dd/l44 0 2024-09-11T00:07:04.747 INFO:tasks.workunit.client.0.smithi111.stdout:9/123: dread d6/dc/f17 [0,4194304] 0 2024-09-11T00:07:04.750 INFO:tasks.workunit.client.1.smithi203.stdout:1/202: dwrite d8/d19/d31/d36/f42 [0,4194304] 0 2024-09-11T00:07:04.751 INFO:tasks.workunit.client.1.smithi203.stdout:3/214: read d8/da/d34/f39 [2522334,2759] 0 2024-09-11T00:07:04.751 INFO:tasks.workunit.client.0.smithi111.stdout:6/84: symlink d7/l16 0 2024-09-11T00:07:04.754 INFO:tasks.workunit.client.1.smithi203.stdout:3/215: dread - d8/da/f44 zero size 2024-09-11T00:07:04.758 INFO:tasks.workunit.client.0.smithi111.stdout:5/133: mkdir d10/d1e/d23/d2b/d2f 0 2024-09-11T00:07:04.758 INFO:tasks.workunit.client.0.smithi111.stdout:7/114: sync 2024-09-11T00:07:04.765 INFO:tasks.workunit.client.0.smithi111.stdout:4/82: link c16 d18/c1a 0 2024-09-11T00:07:04.768 INFO:tasks.workunit.client.1.smithi203.stdout:4/146: symlink db/l27 0 2024-09-11T00:07:04.768 INFO:tasks.workunit.client.1.smithi203.stdout:8/136: dwrite d1/d13/f19 [0,4194304] 0 2024-09-11T00:07:04.769 INFO:tasks.workunit.client.0.smithi111.stdout:2/116: rmdir d0/d3/de 39 2024-09-11T00:07:04.774 INFO:tasks.workunit.client.0.smithi111.stdout:0/109: rename d3/d24 to d3/d13/d1e/d29 0 2024-09-11T00:07:04.779 INFO:tasks.workunit.client.0.smithi111.stdout:1/101: rmdir d2/de/d12 39 2024-09-11T00:07:04.779 INFO:tasks.workunit.client.1.smithi203.stdout:3/216: creat d8/da/d11/f55 x:0 0 0 2024-09-11T00:07:04.783 INFO:tasks.workunit.client.1.smithi203.stdout:0/186: truncate d0/f29 2320802 0 2024-09-11T00:07:04.784 INFO:tasks.workunit.client.0.smithi111.stdout:9/124: symlink d6/l27 0 2024-09-11T00:07:04.785 INFO:tasks.workunit.client.0.smithi111.stdout:8/132: dread f7 [0,4194304] 0 2024-09-11T00:07:04.789 INFO:tasks.workunit.client.0.smithi111.stdout:5/134: mkdir d10/d1e/d23/d30 0 2024-09-11T00:07:04.797 INFO:tasks.workunit.client.0.smithi111.stdout:4/83: creat d18/f1b x:0 0 0 2024-09-11T00:07:04.797 INFO:tasks.workunit.client.1.smithi203.stdout:5/187: write dc/dd/d15/f1d [2365736,26070] 0 2024-09-11T00:07:04.798 INFO:tasks.workunit.client.0.smithi111.stdout:8/133: dwrite d11/f12 [0,4194304] 0 2024-09-11T00:07:04.799 INFO:tasks.workunit.client.0.smithi111.stdout:8/134: fdatasync f8 0 2024-09-11T00:07:04.800 INFO:tasks.workunit.client.1.smithi203.stdout:3/217: dwrite d8/da/d11/f43 [0,4194304] 0 2024-09-11T00:07:04.802 INFO:tasks.workunit.client.1.smithi203.stdout:9/147: rename d6/de/d19/c1f to d6/de/d19/d21/c34 0 2024-09-11T00:07:04.803 INFO:tasks.workunit.client.1.smithi203.stdout:1/203: rename d8/d19 to d8/d19/d31/d46 22 2024-09-11T00:07:04.804 INFO:tasks.workunit.client.1.smithi203.stdout:9/148: readlink d6/de/d19/l12 0 2024-09-11T00:07:04.807 INFO:tasks.workunit.client.1.smithi203.stdout:0/187: creat d0/d2/f40 x:0 0 0 2024-09-11T00:07:04.808 INFO:tasks.workunit.client.0.smithi111.stdout:4/84: dread f7 [0,4194304] 0 2024-09-11T00:07:04.809 INFO:tasks.workunit.client.1.smithi203.stdout:0/188: fsync d0/d2/f13 0 2024-09-11T00:07:04.815 INFO:tasks.workunit.client.1.smithi203.stdout:2/111: creat d13/d15/d19/d1c/f1d x:0 0 0 2024-09-11T00:07:04.816 INFO:tasks.workunit.client.0.smithi111.stdout:0/110: stat f2 0 2024-09-11T00:07:04.816 INFO:tasks.workunit.client.1.smithi203.stdout:4/147: fsync db/f21 0 2024-09-11T00:07:04.820 INFO:tasks.workunit.client.1.smithi203.stdout:8/137: link d1/d13/f21 d1/d13/f33 0 2024-09-11T00:07:04.825 INFO:tasks.workunit.client.1.smithi203.stdout:3/218: symlink d8/d3c/l56 0 2024-09-11T00:07:04.825 INFO:tasks.workunit.client.0.smithi111.stdout:7/115: dwrite dd/f15 [0,4194304] 0 2024-09-11T00:07:04.827 INFO:tasks.workunit.client.1.smithi203.stdout:3/219: dread d8/fb [0,4194304] 0 2024-09-11T00:07:04.829 INFO:tasks.workunit.client.1.smithi203.stdout:1/204: write d8/d19/f1b [71645,28776] 0 2024-09-11T00:07:04.830 INFO:tasks.workunit.client.1.smithi203.stdout:3/220: dread - d8/d17/f3b zero size 2024-09-11T00:07:04.831 INFO:tasks.workunit.client.1.smithi203.stdout:3/221: readlink d8/l3e 0 2024-09-11T00:07:04.832 INFO:tasks.workunit.client.0.smithi111.stdout:7/116: dread dd/f10 [0,4194304] 0 2024-09-11T00:07:04.834 INFO:tasks.workunit.client.0.smithi111.stdout:7/117: dread - dd/f1b zero size 2024-09-11T00:07:04.834 INFO:tasks.workunit.client.0.smithi111.stdout:3/139: truncate f1a 3321294 0 2024-09-11T00:07:04.834 INFO:tasks.workunit.client.0.smithi111.stdout:8/135: truncate d11/f15 5106031 0 2024-09-11T00:07:04.835 INFO:tasks.workunit.client.1.smithi203.stdout:5/188: dread dc/dd/d15/f19 [0,4194304] 0 2024-09-11T00:07:04.836 INFO:tasks.workunit.client.0.smithi111.stdout:4/85: rename l4 to d18/l1c 0 2024-09-11T00:07:04.837 INFO:tasks.workunit.client.0.smithi111.stdout:1/102: dwrite d2/de/d12/d13/f1d [0,4194304] 0 2024-09-11T00:07:04.838 INFO:tasks.workunit.client.0.smithi111.stdout:9/125: write d6/dc/f1f [4667988,92875] 0 2024-09-11T00:07:04.839 INFO:tasks.workunit.client.0.smithi111.stdout:4/86: write d18/f1b [379052,68147] 0 2024-09-11T00:07:04.839 INFO:tasks.workunit.client.0.smithi111.stdout:6/85: truncate d7/ff 4047779 0 2024-09-11T00:07:04.840 INFO:tasks.workunit.client.0.smithi111.stdout:4/87: chown c11 199 1 2024-09-11T00:07:04.843 INFO:tasks.workunit.client.0.smithi111.stdout:5/135: dread f1 [0,4194304] 0 2024-09-11T00:07:04.843 INFO:tasks.workunit.client.0.smithi111.stdout:0/111: creat d3/d13/d1e/d29/f2a x:0 0 0 2024-09-11T00:07:04.845 INFO:tasks.workunit.client.0.smithi111.stdout:5/136: read - d10/d1e/f2a zero size 2024-09-11T00:07:04.846 INFO:tasks.workunit.client.0.smithi111.stdout:5/137: readlink d10/l1d 0 2024-09-11T00:07:04.847 INFO:tasks.workunit.client.1.smithi203.stdout:6/145: getdents d0 0 2024-09-11T00:07:04.849 INFO:tasks.workunit.client.1.smithi203.stdout:6/146: chown d0/f13 222 1 2024-09-11T00:07:04.852 INFO:tasks.workunit.client.1.smithi203.stdout:9/149: dread d6/de/f22 [0,4194304] 0 2024-09-11T00:07:04.862 INFO:tasks.workunit.client.0.smithi111.stdout:5/138: dwrite d10/d1e/d25/f29 [0,4194304] 0 2024-09-11T00:07:04.863 INFO:tasks.workunit.client.1.smithi203.stdout:8/138: write d1/fe [8281549,65513] 0 2024-09-11T00:07:04.863 INFO:tasks.workunit.client.0.smithi111.stdout:5/139: read f5 [732358,74789] 0 2024-09-11T00:07:04.863 INFO:tasks.workunit.client.1.smithi203.stdout:1/205: readlink d8/d9/l1d 0 2024-09-11T00:07:04.865 INFO:tasks.workunit.client.0.smithi111.stdout:1/103: symlink d2/de/d12/l22 0 2024-09-11T00:07:04.865 INFO:tasks.workunit.client.0.smithi111.stdout:5/140: read d10/f13 [2900247,129133] 0 2024-09-11T00:07:04.867 INFO:tasks.workunit.client.0.smithi111.stdout:9/126: creat d6/dc/d13/f28 x:0 0 0 2024-09-11T00:07:04.868 INFO:tasks.workunit.client.0.smithi111.stdout:9/127: dread - d6/dc/d13/f25 zero size 2024-09-11T00:07:04.868 INFO:tasks.workunit.client.1.smithi203.stdout:5/189: mknod dc/dd/d13/c39 0 2024-09-11T00:07:04.868 INFO:tasks.workunit.client.0.smithi111.stdout:4/88: chown cf 45081657 1 2024-09-11T00:07:04.869 INFO:tasks.workunit.client.0.smithi111.stdout:4/89: dread - f15 zero size 2024-09-11T00:07:04.869 INFO:tasks.workunit.client.0.smithi111.stdout:9/128: chown d6/c16 7 1 2024-09-11T00:07:04.870 INFO:tasks.workunit.client.1.smithi203.stdout:5/190: read - dc/dd/f32 zero size 2024-09-11T00:07:04.870 INFO:tasks.workunit.client.0.smithi111.stdout:9/129: dread - d6/dc/d13/f25 zero size 2024-09-11T00:07:04.871 INFO:tasks.workunit.client.0.smithi111.stdout:6/86: rename c4 to d7/c17 0 2024-09-11T00:07:04.872 INFO:tasks.workunit.client.1.smithi203.stdout:2/112: dwrite d13/d15/f1a [0,4194304] 0 2024-09-11T00:07:04.874 INFO:tasks.workunit.client.0.smithi111.stdout:6/87: write d7/f15 [798747,27420] 0 2024-09-11T00:07:04.875 INFO:tasks.workunit.client.0.smithi111.stdout:4/90: dread d18/f1b [0,4194304] 0 2024-09-11T00:07:04.877 INFO:tasks.workunit.client.1.smithi203.stdout:4/148: creat db/dd/d26/f28 x:0 0 0 2024-09-11T00:07:04.883 INFO:tasks.workunit.client.1.smithi203.stdout:1/206: creat d8/d9/d15/f47 x:0 0 0 2024-09-11T00:07:04.884 INFO:tasks.workunit.client.1.smithi203.stdout:8/139: rmdir d1/d13/d22 39 2024-09-11T00:07:04.884 INFO:tasks.workunit.client.1.smithi203.stdout:1/207: fdatasync d8/d9/d15/f47 0 2024-09-11T00:07:04.885 INFO:tasks.workunit.client.1.smithi203.stdout:3/222: rename d8/da/f19 to d8/d17/f57 0 2024-09-11T00:07:04.886 INFO:tasks.workunit.client.0.smithi111.stdout:8/136: creat d11/d21/f22 x:0 0 0 2024-09-11T00:07:04.886 INFO:tasks.workunit.client.1.smithi203.stdout:0/189: link d0/d1d/f2e d0/d2/f41 0 2024-09-11T00:07:04.889 INFO:tasks.workunit.client.0.smithi111.stdout:1/104: unlink d2/de/c1b 0 2024-09-11T00:07:04.891 INFO:tasks.workunit.client.0.smithi111.stdout:5/141: symlink d10/d1e/d23/d2b/l31 0 2024-09-11T00:07:04.891 INFO:tasks.workunit.client.0.smithi111.stdout:1/105: read d2/f19 [278171,131035] 0 2024-09-11T00:07:04.893 INFO:tasks.workunit.client.0.smithi111.stdout:5/142: write f2 [1994392,40705] 0 2024-09-11T00:07:04.894 INFO:tasks.workunit.client.1.smithi203.stdout:8/140: symlink d1/l34 0 2024-09-11T00:07:04.895 INFO:tasks.workunit.client.0.smithi111.stdout:9/130: creat d6/dc/d13/f29 x:0 0 0 2024-09-11T00:07:04.896 INFO:tasks.workunit.client.0.smithi111.stdout:8/137: dread d11/f1a [0,4194304] 0 2024-09-11T00:07:04.898 INFO:tasks.workunit.client.1.smithi203.stdout:6/147: rename d0/c1b to d0/d6/c26 0 2024-09-11T00:07:04.898 INFO:tasks.workunit.client.1.smithi203.stdout:8/141: truncate d1/d13/d17/f31 53671 0 2024-09-11T00:07:04.900 INFO:tasks.workunit.client.0.smithi111.stdout:0/112: rename d3/da/ce to d3/d13/d1e/c2b 0 2024-09-11T00:07:04.900 INFO:tasks.workunit.client.0.smithi111.stdout:7/118: sync 2024-09-11T00:07:04.901 INFO:tasks.workunit.client.0.smithi111.stdout:0/113: fdatasync d3/f15 0 2024-09-11T00:07:04.902 INFO:tasks.workunit.client.0.smithi111.stdout:7/119: truncate dd/f1a 46207 0 2024-09-11T00:07:04.903 INFO:tasks.workunit.client.1.smithi203.stdout:3/223: dread d8/da/d34/f4d [0,4194304] 0 2024-09-11T00:07:04.905 INFO:tasks.workunit.client.1.smithi203.stdout:5/191: dwrite dc/dd/d15/f2c [0,4194304] 0 2024-09-11T00:07:04.905 INFO:tasks.workunit.client.0.smithi111.stdout:4/91: fsync f7 0 2024-09-11T00:07:04.905 INFO:tasks.workunit.client.1.smithi203.stdout:3/224: dread d8/fb [0,4194304] 0 2024-09-11T00:07:04.906 INFO:tasks.workunit.client.0.smithi111.stdout:5/143: dwrite d10/f1c [0,4194304] 0 2024-09-11T00:07:04.907 INFO:tasks.workunit.client.0.smithi111.stdout:5/144: write d10/f1c [4549995,17411] 0 2024-09-11T00:07:04.907 INFO:tasks.workunit.client.1.smithi203.stdout:5/192: chown dc/dd/f32 1951185275 1 2024-09-11T00:07:04.907 INFO:tasks.workunit.client.1.smithi203.stdout:3/225: chown d8/d2a/l48 8407323 1 2024-09-11T00:07:04.908 INFO:tasks.workunit.client.1.smithi203.stdout:3/226: readlink d8/l3e 0 2024-09-11T00:07:04.911 INFO:tasks.workunit.client.0.smithi111.stdout:2/117: link d0/d3/d12/l20 d0/l24 0 2024-09-11T00:07:04.912 INFO:tasks.workunit.client.1.smithi203.stdout:0/190: unlink d0/d2/f35 0 2024-09-11T00:07:04.915 INFO:tasks.workunit.client.1.smithi203.stdout:0/191: write d0/f23 [375927,87416] 0 2024-09-11T00:07:04.923 INFO:tasks.workunit.client.1.smithi203.stdout:8/142: rmdir d1 39 2024-09-11T00:07:04.928 INFO:tasks.workunit.client.1.smithi203.stdout:1/208: unlink d8/d9/d15/d35/c40 0 2024-09-11T00:07:04.931 INFO:tasks.workunit.client.1.smithi203.stdout:2/113: write f0 [1528864,4604] 0 2024-09-11T00:07:04.934 INFO:tasks.workunit.client.1.smithi203.stdout:3/227: dwrite d8/d17/f3b [0,4194304] 0 2024-09-11T00:07:04.934 INFO:tasks.workunit.client.0.smithi111.stdout:9/131: symlink d6/db/l2a 0 2024-09-11T00:07:04.936 INFO:tasks.workunit.client.1.smithi203.stdout:3/228: stat d8/da/d34/f39 0 2024-09-11T00:07:04.938 INFO:tasks.workunit.client.1.smithi203.stdout:3/229: readlink d8/d17/l30 0 2024-09-11T00:07:04.942 INFO:tasks.workunit.client.0.smithi111.stdout:8/138: mkdir d11/d23 0 2024-09-11T00:07:04.942 INFO:tasks.workunit.client.1.smithi203.stdout:9/150: getdents d6/de/d19/d13/d29 0 2024-09-11T00:07:04.942 INFO:tasks.workunit.client.0.smithi111.stdout:8/139: readlink d11/l18 0 2024-09-11T00:07:04.946 INFO:tasks.workunit.client.0.smithi111.stdout:6/88: rename d7/le to d7/l18 0 2024-09-11T00:07:04.948 INFO:tasks.workunit.client.0.smithi111.stdout:7/120: dread f8 [0,4194304] 0 2024-09-11T00:07:04.948 INFO:tasks.workunit.client.0.smithi111.stdout:7/121: readlink dd/l11 0 2024-09-11T00:07:04.949 INFO:tasks.workunit.client.0.smithi111.stdout:7/122: readlink dd/l16 0 2024-09-11T00:07:04.952 INFO:tasks.workunit.client.0.smithi111.stdout:0/114: rename d3/d13/c14 to d3/d26/c2c 0 2024-09-11T00:07:04.952 INFO:tasks.workunit.client.0.smithi111.stdout:0/115: write d3/da/f1d [509734,57056] 0 2024-09-11T00:07:04.953 INFO:tasks.workunit.client.1.smithi203.stdout:1/209: dwrite d8/d19/f1b [0,4194304] 0 2024-09-11T00:07:04.953 INFO:tasks.workunit.client.0.smithi111.stdout:0/116: write d3/dc/f12 [1426045,56730] 0 2024-09-11T00:07:04.957 INFO:tasks.workunit.client.1.smithi203.stdout:5/193: symlink dc/dd/l3a 0 2024-09-11T00:07:04.961 INFO:tasks.workunit.client.0.smithi111.stdout:5/145: readlink l8 0 2024-09-11T00:07:04.966 INFO:tasks.workunit.client.0.smithi111.stdout:7/123: dwrite dd/f15 [0,4194304] 0 2024-09-11T00:07:04.968 INFO:tasks.workunit.client.1.smithi203.stdout:0/192: dread d0/f29 [0,4194304] 0 2024-09-11T00:07:04.968 INFO:tasks.workunit.client.0.smithi111.stdout:7/124: stat dd/f10 0 2024-09-11T00:07:04.970 INFO:tasks.workunit.client.1.smithi203.stdout:3/230: creat d8/f58 x:0 0 0 2024-09-11T00:07:04.970 INFO:tasks.workunit.client.1.smithi203.stdout:1/210: dread d8/d9/f1e [0,4194304] 0 2024-09-11T00:07:04.973 INFO:tasks.workunit.client.1.smithi203.stdout:9/151: rename d6/l1a to d6/de/d19/d13/l35 0 2024-09-11T00:07:04.974 INFO:tasks.workunit.client.0.smithi111.stdout:3/140: dread f1a [0,4194304] 0 2024-09-11T00:07:04.975 INFO:tasks.workunit.client.1.smithi203.stdout:8/143: write d1/d13/d22/f29 [664498,69651] 0 2024-09-11T00:07:04.976 INFO:tasks.workunit.client.0.smithi111.stdout:9/132: symlink d6/dc/l2b 0 2024-09-11T00:07:04.977 INFO:tasks.workunit.client.1.smithi203.stdout:5/194: chown dc/dd/d1e/l24 4 1 2024-09-11T00:07:04.978 INFO:tasks.workunit.client.0.smithi111.stdout:6/89: mknod d7/c19 0 2024-09-11T00:07:04.979 INFO:tasks.workunit.client.1.smithi203.stdout:8/144: chown d1/d13/l30 1221539 1 2024-09-11T00:07:04.982 INFO:tasks.workunit.client.1.smithi203.stdout:6/148: unlink d0/d6/f24 0 2024-09-11T00:07:04.984 INFO:tasks.workunit.client.1.smithi203.stdout:6/149: fsync d0/d6/f18 0 2024-09-11T00:07:04.986 INFO:tasks.workunit.client.0.smithi111.stdout:4/92: dread f5 [0,4194304] 0 2024-09-11T00:07:04.986 INFO:tasks.workunit.client.0.smithi111.stdout:7/125: dwrite dd/f19 [0,4194304] 0 2024-09-11T00:07:04.987 INFO:tasks.workunit.client.1.smithi203.stdout:3/231: rename d8/f29 to d8/f59 0 2024-09-11T00:07:04.992 INFO:tasks.workunit.client.0.smithi111.stdout:5/146: rename f7 to d10/d1e/d25/f32 0 2024-09-11T00:07:04.993 INFO:tasks.workunit.client.0.smithi111.stdout:5/147: truncate d10/d1e/f2a 597437 0 2024-09-11T00:07:04.994 INFO:tasks.workunit.client.1.smithi203.stdout:1/211: symlink d8/d9/d15/d30/d3e/l48 0 2024-09-11T00:07:04.997 INFO:tasks.workunit.client.0.smithi111.stdout:7/126: dread dd/f1c [0,4194304] 0 2024-09-11T00:07:04.997 INFO:tasks.workunit.client.0.smithi111.stdout:2/118: mknod d0/d3/c25 0 2024-09-11T00:07:04.999 INFO:tasks.workunit.client.1.smithi203.stdout:2/114: truncate d13/d15/f1b 254014 0 2024-09-11T00:07:05.004 INFO:tasks.workunit.client.1.smithi203.stdout:2/115: truncate d13/d15/d19/d1c/f1d 80855 0 2024-09-11T00:07:05.005 INFO:tasks.workunit.client.1.smithi203.stdout:2/116: fdatasync f11 0 2024-09-11T00:07:05.005 INFO:tasks.workunit.client.0.smithi111.stdout:3/141: mknod d1c/d1d/c2e 0 2024-09-11T00:07:05.011 INFO:tasks.workunit.client.1.smithi203.stdout:1/212: dwrite d8/d9/d15/f34 [0,4194304] 0 2024-09-11T00:07:05.012 INFO:tasks.workunit.client.0.smithi111.stdout:9/133: symlink d6/dc/l2c 0 2024-09-11T00:07:05.019 INFO:tasks.workunit.client.0.smithi111.stdout:0/117: link d3/da/f21 d3/d13/d1e/d29/f2d 0 2024-09-11T00:07:05.019 INFO:tasks.workunit.client.0.smithi111.stdout:4/93: creat d18/f1d x:0 0 0 2024-09-11T00:07:05.024 INFO:tasks.workunit.client.1.smithi203.stdout:5/195: mkdir dc/dd/d15/d3b 0 2024-09-11T00:07:05.026 INFO:tasks.workunit.client.0.smithi111.stdout:8/140: sync 2024-09-11T00:07:05.026 INFO:tasks.workunit.client.0.smithi111.stdout:8/141: dread - d11/f1e zero size 2024-09-11T00:07:05.030 INFO:tasks.workunit.client.0.smithi111.stdout:2/119: mknod d0/d3/d12/c26 0 2024-09-11T00:07:05.032 INFO:tasks.workunit.client.0.smithi111.stdout:1/106: getdents d2 0 2024-09-11T00:07:05.033 INFO:tasks.workunit.client.0.smithi111.stdout:1/107: dread - d2/de/f17 zero size 2024-09-11T00:07:05.034 INFO:tasks.workunit.client.0.smithi111.stdout:3/142: mkdir d1c/d1d/d22/d23/d2f 0 2024-09-11T00:07:05.035 INFO:tasks.workunit.client.1.smithi203.stdout:0/193: dwrite d0/d1d/f2e [0,4194304] 0 2024-09-11T00:07:05.036 INFO:tasks.workunit.client.1.smithi203.stdout:0/194: dread - d0/d2/f40 zero size 2024-09-11T00:07:05.038 INFO:tasks.workunit.client.0.smithi111.stdout:6/90: truncate d7/ff 4879180 0 2024-09-11T00:07:05.038 INFO:tasks.workunit.client.1.smithi203.stdout:6/150: truncate d0/f1 4387001 0 2024-09-11T00:07:05.039 INFO:tasks.workunit.client.1.smithi203.stdout:7/182: sync 2024-09-11T00:07:05.039 INFO:tasks.workunit.client.1.smithi203.stdout:9/152: truncate d6/de/f22 947637 0 2024-09-11T00:07:05.039 INFO:tasks.workunit.client.1.smithi203.stdout:0/195: write d0/f15 [205406,59267] 0 2024-09-11T00:07:05.042 INFO:tasks.workunit.client.1.smithi203.stdout:1/213: rename d8/d9/d15/f34 to d8/f49 0 2024-09-11T00:07:05.044 INFO:tasks.workunit.client.1.smithi203.stdout:1/214: chown d8/d9/d15/l3c 1858929717 1 2024-09-11T00:07:05.045 INFO:tasks.workunit.client.1.smithi203.stdout:3/232: link d8/d17/f3b d8/d3c/f5a 0 2024-09-11T00:07:05.046 INFO:tasks.workunit.client.1.smithi203.stdout:1/215: chown d8/d11/d29 15572 1 2024-09-11T00:07:05.046 INFO:tasks.workunit.client.0.smithi111.stdout:4/94: mknod d18/c1e 0 2024-09-11T00:07:05.048 INFO:tasks.workunit.client.1.smithi203.stdout:3/233: truncate d8/da/d37/f47 516150 0 2024-09-11T00:07:05.049 INFO:tasks.workunit.client.0.smithi111.stdout:0/118: creat d3/d13/d1e/f2e x:0 0 0 2024-09-11T00:07:05.049 INFO:tasks.workunit.client.1.smithi203.stdout:3/234: fdatasync d8/da/f44 0 2024-09-11T00:07:05.050 INFO:tasks.workunit.client.1.smithi203.stdout:5/196: mknod dc/c3c 0 2024-09-11T00:07:05.051 INFO:tasks.workunit.client.1.smithi203.stdout:8/145: creat d1/d13/f35 x:0 0 0 2024-09-11T00:07:05.052 INFO:tasks.workunit.client.0.smithi111.stdout:5/148: link d10/f19 d10/d1e/d23/d2b/f33 0 2024-09-11T00:07:05.053 INFO:tasks.workunit.client.0.smithi111.stdout:8/142: mknod d11/c24 0 2024-09-11T00:07:05.053 INFO:tasks.workunit.client.0.smithi111.stdout:5/149: write d10/f1f [602462,117325] 0 2024-09-11T00:07:05.055 INFO:tasks.workunit.client.0.smithi111.stdout:7/127: mknod dd/c25 0 2024-09-11T00:07:05.056 INFO:tasks.workunit.client.0.smithi111.stdout:7/128: write dd/f1a [716472,63637] 0 2024-09-11T00:07:05.057 INFO:tasks.workunit.client.1.smithi203.stdout:2/117: link d13/f17 d13/d15/d19/d1c/f1e 0 2024-09-11T00:07:05.061 INFO:tasks.workunit.client.0.smithi111.stdout:1/108: symlink d2/de/d12/l23 0 2024-09-11T00:07:05.066 INFO:tasks.workunit.client.0.smithi111.stdout:3/143: symlink d1c/d1d/l30 0 2024-09-11T00:07:05.068 INFO:tasks.workunit.client.1.smithi203.stdout:9/153: rmdir d6/de 39 2024-09-11T00:07:05.070 INFO:tasks.workunit.client.0.smithi111.stdout:6/91: chown d7/fd 536 1 2024-09-11T00:07:05.072 INFO:tasks.workunit.client.1.smithi203.stdout:7/183: rename dd/f3d to dd/d1c/d26/d31/f45 0 2024-09-11T00:07:05.072 INFO:tasks.workunit.client.0.smithi111.stdout:2/120: dwrite d0/d3/de/f1f [0,4194304] 0 2024-09-11T00:07:05.074 INFO:tasks.workunit.client.0.smithi111.stdout:1/109: dread d2/de/f11 [0,4194304] 0 2024-09-11T00:07:05.074 INFO:tasks.workunit.client.1.smithi203.stdout:1/216: symlink d8/d19/d31/d36/l4a 0 2024-09-11T00:07:05.075 INFO:tasks.workunit.client.0.smithi111.stdout:2/121: chown d0/d3/de/f1e 146880 1 2024-09-11T00:07:05.077 INFO:tasks.workunit.client.0.smithi111.stdout:4/95: unlink d18/f1d 0 2024-09-11T00:07:05.081 INFO:tasks.workunit.client.0.smithi111.stdout:8/143: dread f8 [0,4194304] 0 2024-09-11T00:07:05.083 INFO:tasks.workunit.client.1.smithi203.stdout:8/146: mknod d1/d13/d17/d2f/c36 0 2024-09-11T00:07:05.084 INFO:tasks.workunit.client.1.smithi203.stdout:4/149: sync 2024-09-11T00:07:05.084 INFO:tasks.workunit.client.1.smithi203.stdout:8/147: stat d1/d13/f35 0 2024-09-11T00:07:05.088 INFO:tasks.workunit.client.0.smithi111.stdout:1/110: dread d2/de/d12/d13/f1d [0,4194304] 0 2024-09-11T00:07:05.088 INFO:tasks.workunit.client.0.smithi111.stdout:9/134: dwrite d6/db/d1b/f22 [4194304,4194304] 0 2024-09-11T00:07:05.095 INFO:tasks.workunit.client.0.smithi111.stdout:3/144: mkdir d1c/d1d/d22/d31 0 2024-09-11T00:07:05.097 INFO:tasks.workunit.client.0.smithi111.stdout:3/145: dread - d1c/d1d/d22/d23/f25 zero size 2024-09-11T00:07:05.098 INFO:tasks.workunit.client.0.smithi111.stdout:3/146: chown f1a 10 1 2024-09-11T00:07:05.098 INFO:tasks.workunit.client.0.smithi111.stdout:3/147: stat d1c/c29 0 2024-09-11T00:07:05.099 INFO:tasks.workunit.client.0.smithi111.stdout:6/92: symlink d7/l1a 0 2024-09-11T00:07:05.100 INFO:tasks.workunit.client.0.smithi111.stdout:9/135: dread d6/db/d1b/f22 [4194304,4194304] 0 2024-09-11T00:07:05.100 INFO:tasks.workunit.client.1.smithi203.stdout:0/196: rename d0/d1d/c20 to d0/d2/d37/c42 0 2024-09-11T00:07:05.102 INFO:tasks.workunit.client.0.smithi111.stdout:9/136: truncate d6/dc/d13/f25 472094 0 2024-09-11T00:07:05.102 INFO:tasks.workunit.client.1.smithi203.stdout:1/217: readlink d8/d9/lf 0 2024-09-11T00:07:05.105 INFO:tasks.workunit.client.0.smithi111.stdout:9/137: truncate d6/dc/d13/f29 17134 0 2024-09-11T00:07:05.110 INFO:tasks.workunit.client.0.smithi111.stdout:0/119: mkdir d3/d2f 0 2024-09-11T00:07:05.115 INFO:tasks.workunit.client.1.smithi203.stdout:6/151: rename d0/d6 to d0/d27 0 2024-09-11T00:07:05.116 INFO:tasks.workunit.client.0.smithi111.stdout:4/96: mkdir d18/d1f 0 2024-09-11T00:07:05.118 INFO:tasks.workunit.client.0.smithi111.stdout:3/148: dread f9 [0,4194304] 0 2024-09-11T00:07:05.120 INFO:tasks.workunit.client.1.smithi203.stdout:7/184: dwrite dd/f10 [0,4194304] 0 2024-09-11T00:07:05.120 INFO:tasks.workunit.client.0.smithi111.stdout:5/150: rename d10/d1e/d25/f32 to d10/d1e/d23/d26/f34 0 2024-09-11T00:07:05.122 INFO:tasks.workunit.client.0.smithi111.stdout:1/111: rmdir d2 39 2024-09-11T00:07:05.124 INFO:tasks.workunit.client.1.smithi203.stdout:5/197: creat dc/dd/f3d x:0 0 0 2024-09-11T00:07:05.129 INFO:tasks.workunit.client.1.smithi203.stdout:1/218: rename d8/d11/d29 to d8/d9/d15/d30/d3e/d4b 0 2024-09-11T00:07:05.130 INFO:tasks.workunit.client.0.smithi111.stdout:6/93: mkdir d7/d1b 0 2024-09-11T00:07:05.133 INFO:tasks.workunit.client.0.smithi111.stdout:9/138: creat d6/dc/d13/f2d x:0 0 0 2024-09-11T00:07:05.134 INFO:tasks.workunit.client.1.smithi203.stdout:2/118: write f8 [995071,85451] 0 2024-09-11T00:07:05.136 INFO:tasks.workunit.client.1.smithi203.stdout:8/148: dread d1/fe [4194304,4194304] 0 2024-09-11T00:07:05.138 INFO:tasks.workunit.client.1.smithi203.stdout:7/185: creat dd/d1c/f46 x:0 0 0 2024-09-11T00:07:05.142 INFO:tasks.workunit.client.0.smithi111.stdout:8/144: getdents d11/d23 0 2024-09-11T00:07:05.142 INFO:tasks.workunit.client.1.smithi203.stdout:5/198: rename dc/dd/f2f to dc/dd/d13/f3e 0 2024-09-11T00:07:05.144 INFO:tasks.workunit.client.1.smithi203.stdout:3/235: dread d8/ff [0,4194304] 0 2024-09-11T00:07:05.146 INFO:tasks.workunit.client.0.smithi111.stdout:5/151: mknod d10/d1e/d23/c35 0 2024-09-11T00:07:05.146 INFO:tasks.workunit.client.1.smithi203.stdout:4/150: getdents db 0 2024-09-11T00:07:05.146 INFO:tasks.workunit.client.1.smithi203.stdout:8/149: creat d1/f37 x:0 0 0 2024-09-11T00:07:05.146 INFO:tasks.workunit.client.0.smithi111.stdout:7/129: link dd/f1e dd/f26 0 2024-09-11T00:07:05.147 INFO:tasks.workunit.client.1.smithi203.stdout:8/150: stat d1/d13/d17/f1e 0 2024-09-11T00:07:05.151 INFO:tasks.workunit.client.1.smithi203.stdout:7/186: readlink dd/l17 0 2024-09-11T00:07:05.153 INFO:tasks.workunit.client.1.smithi203.stdout:2/119: rename d13/d15/d19/d1c/f1d to d13/d15/f1f 0 2024-09-11T00:07:05.154 INFO:tasks.workunit.client.1.smithi203.stdout:2/120: chown f0 0 1 2024-09-11T00:07:05.156 INFO:tasks.workunit.client.0.smithi111.stdout:4/97: dread f9 [0,4194304] 0 2024-09-11T00:07:05.163 INFO:tasks.workunit.client.0.smithi111.stdout:2/122: creat d0/d3/f27 x:0 0 0 2024-09-11T00:07:05.164 INFO:tasks.workunit.client.0.smithi111.stdout:2/123: dread - d0/d3/f1c zero size 2024-09-11T00:07:05.166 INFO:tasks.workunit.client.0.smithi111.stdout:0/120: symlink d3/l30 0 2024-09-11T00:07:05.168 INFO:tasks.workunit.client.1.smithi203.stdout:8/151: creat d1/d13/d17/f38 x:0 0 0 2024-09-11T00:07:05.169 INFO:tasks.workunit.client.0.smithi111.stdout:8/145: creat d11/f25 x:0 0 0 2024-09-11T00:07:05.170 INFO:tasks.workunit.client.0.smithi111.stdout:3/149: mknod d1c/d1d/d22/d31/c32 0 2024-09-11T00:07:05.170 INFO:tasks.workunit.client.1.smithi203.stdout:9/154: dread d6/de/d19/d13/f15 [0,4194304] 0 2024-09-11T00:07:05.170 INFO:tasks.workunit.client.1.smithi203.stdout:7/187: symlink dd/d1c/l47 0 2024-09-11T00:07:05.171 INFO:tasks.workunit.client.1.smithi203.stdout:2/121: dread d13/d15/f1a [0,4194304] 0 2024-09-11T00:07:05.171 INFO:tasks.workunit.client.0.smithi111.stdout:3/150: write fb [2612516,17407] 0 2024-09-11T00:07:05.172 INFO:tasks.workunit.client.1.smithi203.stdout:4/151: dread db/dd/f11 [0,4194304] 0 2024-09-11T00:07:05.173 INFO:tasks.workunit.client.0.smithi111.stdout:1/112: mknod d2/c24 0 2024-09-11T00:07:05.174 INFO:tasks.workunit.client.0.smithi111.stdout:1/113: fdatasync d2/de/d12/f1c 0 2024-09-11T00:07:05.176 INFO:tasks.workunit.client.0.smithi111.stdout:4/98: mkdir d18/d20 0 2024-09-11T00:07:05.177 INFO:tasks.workunit.client.1.smithi203.stdout:6/152: unlink d0/f1e 0 2024-09-11T00:07:05.177 INFO:tasks.workunit.client.1.smithi203.stdout:9/155: write d6/de/d19/f33 [771011,21006] 0 2024-09-11T00:07:05.180 INFO:tasks.workunit.client.1.smithi203.stdout:8/152: creat d1/d13/d17/f39 x:0 0 0 2024-09-11T00:07:05.181 INFO:tasks.workunit.client.1.smithi203.stdout:8/153: fdatasync d1/f16 0 2024-09-11T00:07:05.182 INFO:tasks.workunit.client.1.smithi203.stdout:1/219: dread d8/d9/d15/f22 [0,4194304] 0 2024-09-11T00:07:05.183 INFO:tasks.workunit.client.0.smithi111.stdout:2/124: rename d0/d3 to d0/d3/d28 22 2024-09-11T00:07:05.185 INFO:tasks.workunit.client.0.smithi111.stdout:3/151: dwrite f2 [0,4194304] 0 2024-09-11T00:07:05.186 INFO:tasks.workunit.client.0.smithi111.stdout:3/152: stat d1c/d1d/d22/d31/c32 0 2024-09-11T00:07:05.187 INFO:tasks.workunit.client.0.smithi111.stdout:3/153: write d1c/f24 [724442,44563] 0 2024-09-11T00:07:05.188 INFO:tasks.workunit.client.1.smithi203.stdout:3/236: link d8/d17/c21 d8/d3c/c5b 0 2024-09-11T00:07:05.189 INFO:tasks.workunit.client.0.smithi111.stdout:4/99: dread f9 [0,4194304] 0 2024-09-11T00:07:05.198 INFO:tasks.workunit.client.0.smithi111.stdout:5/152: mknod d10/d1e/d23/d30/c36 0 2024-09-11T00:07:05.198 INFO:tasks.workunit.client.0.smithi111.stdout:6/94: dwrite f0 [0,4194304] 0 2024-09-11T00:07:05.199 INFO:tasks.workunit.client.1.smithi203.stdout:2/122: symlink d13/d15/d19/l20 0 2024-09-11T00:07:05.200 INFO:tasks.workunit.client.0.smithi111.stdout:0/121: dread d3/da/ff [0,4194304] 0 2024-09-11T00:07:05.200 INFO:tasks.workunit.client.0.smithi111.stdout:9/139: fsync d6/dc/d13/f25 0 2024-09-11T00:07:05.200 INFO:tasks.workunit.client.1.smithi203.stdout:5/199: dread dc/dd/d13/f1a [0,4194304] 0 2024-09-11T00:07:05.202 INFO:tasks.workunit.client.0.smithi111.stdout:9/140: write d6/dc/f20 [128229,117673] 0 2024-09-11T00:07:05.202 INFO:tasks.workunit.client.0.smithi111.stdout:0/122: dread - d3/d13/d1e/d29/f2d zero size 2024-09-11T00:07:05.205 INFO:tasks.workunit.client.0.smithi111.stdout:0/123: truncate d3/d13/f17 722624 0 2024-09-11T00:07:05.206 INFO:tasks.workunit.client.0.smithi111.stdout:2/125: symlink d0/d3/d12/l29 0 2024-09-11T00:07:05.206 INFO:tasks.workunit.client.0.smithi111.stdout:9/141: truncate d6/db/d1b/f1e 4963737 0 2024-09-11T00:07:05.207 INFO:tasks.workunit.client.1.smithi203.stdout:6/153: readlink d0/l12 0 2024-09-11T00:07:05.207 INFO:tasks.workunit.client.1.smithi203.stdout:9/156: creat d6/de/d19/d24/f36 x:0 0 0 2024-09-11T00:07:05.207 INFO:tasks.workunit.client.1.smithi203.stdout:4/152: write db/f21 [1188205,66515] 0 2024-09-11T00:07:05.212 INFO:tasks.workunit.client.1.smithi203.stdout:9/157: readlink d6/de/d19/l12 0 2024-09-11T00:07:05.213 INFO:tasks.workunit.client.0.smithi111.stdout:3/154: rmdir d1c/d21 39 2024-09-11T00:07:05.214 INFO:tasks.workunit.client.0.smithi111.stdout:3/155: chown d1c/d1d/l2a 4975 1 2024-09-11T00:07:05.216 INFO:tasks.workunit.client.0.smithi111.stdout:3/156: read - d1c/d1d/d22/d23/f25 zero size 2024-09-11T00:07:05.217 INFO:tasks.workunit.client.0.smithi111.stdout:2/126: dread d0/d3/de/f11 [0,4194304] 0 2024-09-11T00:07:05.221 INFO:tasks.workunit.client.1.smithi203.stdout:2/123: rename d13/d15/l16 to d13/l21 0 2024-09-11T00:07:05.223 INFO:tasks.workunit.client.0.smithi111.stdout:0/124: mknod d3/da/c31 0 2024-09-11T00:07:05.224 INFO:tasks.workunit.client.0.smithi111.stdout:0/125: chown d3/d13/l25 1 1 2024-09-11T00:07:05.224 INFO:tasks.workunit.client.1.smithi203.stdout:8/154: mkdir d1/d13/d3a 0 2024-09-11T00:07:05.227 INFO:tasks.workunit.client.1.smithi203.stdout:1/220: symlink d8/d9/l4c 0 2024-09-11T00:07:05.228 INFO:tasks.workunit.client.1.smithi203.stdout:8/155: write d1/d13/f19 [5131669,282] 0 2024-09-11T00:07:05.229 INFO:tasks.workunit.client.1.smithi203.stdout:7/188: write dd/f12 [88404,39960] 0 2024-09-11T00:07:05.229 INFO:tasks.workunit.client.0.smithi111.stdout:8/146: write d11/f13 [3694662,90068] 0 2024-09-11T00:07:05.231 INFO:tasks.workunit.client.1.smithi203.stdout:3/237: mkdir d8/da/d5c 0 2024-09-11T00:07:05.233 INFO:tasks.workunit.client.0.smithi111.stdout:6/95: getdents d7/d1b 0 2024-09-11T00:07:05.236 INFO:tasks.workunit.client.1.smithi203.stdout:9/158: creat d6/de/d32/f37 x:0 0 0 2024-09-11T00:07:05.237 INFO:tasks.workunit.client.1.smithi203.stdout:4/153: rename db/f21 to db/dd/d16/f29 0 2024-09-11T00:07:05.238 INFO:tasks.workunit.client.1.smithi203.stdout:9/159: fsync d6/de/d19/d13/d29/f2b 0 2024-09-11T00:07:05.239 INFO:tasks.workunit.client.0.smithi111.stdout:2/127: mknod d0/d3/d12/c2a 0 2024-09-11T00:07:05.240 INFO:tasks.workunit.client.1.smithi203.stdout:2/124: mkdir d13/d22 0 2024-09-11T00:07:05.243 INFO:tasks.workunit.client.0.smithi111.stdout:6/96: dread f1 [0,4194304] 0 2024-09-11T00:07:05.245 INFO:tasks.workunit.client.0.smithi111.stdout:6/97: chown d7/f9 58060 1 2024-09-11T00:07:05.245 INFO:tasks.workunit.client.0.smithi111.stdout:6/98: stat d7 0 2024-09-11T00:07:05.245 INFO:tasks.workunit.client.0.smithi111.stdout:6/99: stat f1 0 2024-09-11T00:07:05.245 INFO:tasks.workunit.client.0.smithi111.stdout:1/114: creat d2/de/f25 x:0 0 0 2024-09-11T00:07:05.246 INFO:tasks.workunit.client.1.smithi203.stdout:1/221: dread d8/d19/f1b [0,4194304] 0 2024-09-11T00:07:05.249 INFO:tasks.workunit.client.0.smithi111.stdout:3/157: dread f6 [0,4194304] 0 2024-09-11T00:07:05.249 INFO:tasks.workunit.client.1.smithi203.stdout:8/156: creat d1/f3b x:0 0 0 2024-09-11T00:07:05.250 INFO:tasks.workunit.client.1.smithi203.stdout:8/157: write d1/f3b [265076,34361] 0 2024-09-11T00:07:05.253 INFO:tasks.workunit.client.0.smithi111.stdout:8/147: creat d11/d21/f26 x:0 0 0 2024-09-11T00:07:05.255 INFO:tasks.workunit.client.0.smithi111.stdout:5/153: truncate d10/f1c 1850931 0 2024-09-11T00:07:05.256 INFO:tasks.workunit.client.1.smithi203.stdout:3/238: creat d8/da/d11/f5d x:0 0 0 2024-09-11T00:07:05.258 INFO:tasks.workunit.client.1.smithi203.stdout:3/239: fsync d8/f2c 0 2024-09-11T00:07:05.258 INFO:tasks.workunit.client.1.smithi203.stdout:8/158: write d1/d13/d17/d2f/f32 [647514,7791] 0 2024-09-11T00:07:05.262 INFO:tasks.workunit.client.1.smithi203.stdout:3/240: read - d8/da/d34/f54 zero size 2024-09-11T00:07:05.267 INFO:tasks.workunit.client.1.smithi203.stdout:4/154: rename db/dd/d19 to db/d12/d15/d2a 0 2024-09-11T00:07:05.267 INFO:tasks.workunit.client.1.smithi203.stdout:6/154: dread d0/f1 [0,4194304] 0 2024-09-11T00:07:05.269 INFO:tasks.workunit.client.1.smithi203.stdout:8/159: truncate d1/d13/d17/d2f/f32 656145 0 2024-09-11T00:07:05.269 INFO:tasks.workunit.client.1.smithi203.stdout:9/160: readlink d6/de/d19/d13/l35 0 2024-09-11T00:07:05.270 INFO:tasks.workunit.client.1.smithi203.stdout:2/125: dwrite d13/d15/f1b [0,4194304] 0 2024-09-11T00:07:05.272 INFO:tasks.workunit.client.1.smithi203.stdout:2/126: chown f4 24032 1 2024-09-11T00:07:05.273 INFO:tasks.workunit.client.0.smithi111.stdout:9/142: link d6/db/f18 d6/dc/d13/f2e 0 2024-09-11T00:07:05.276 INFO:tasks.workunit.client.1.smithi203.stdout:7/189: write dd/f22 [290388,53818] 0 2024-09-11T00:07:05.276 INFO:tasks.workunit.client.0.smithi111.stdout:7/130: sync 2024-09-11T00:07:05.276 INFO:tasks.workunit.client.0.smithi111.stdout:4/100: sync 2024-09-11T00:07:05.278 INFO:tasks.workunit.client.0.smithi111.stdout:8/148: symlink d11/l27 0 2024-09-11T00:07:05.279 INFO:tasks.workunit.client.1.smithi203.stdout:3/241: mkdir d8/da/d11/d5e 0 2024-09-11T00:07:05.279 INFO:tasks.workunit.client.0.smithi111.stdout:5/154: creat d10/d1e/d23/d30/f37 x:0 0 0 2024-09-11T00:07:05.279 INFO:tasks.workunit.client.0.smithi111.stdout:4/101: write f7 [4292236,83703] 0 2024-09-11T00:07:05.280 INFO:tasks.workunit.client.0.smithi111.stdout:2/128: symlink d0/l2b 0 2024-09-11T00:07:05.281 INFO:tasks.workunit.client.1.smithi203.stdout:9/161: chown d6/c9 316 1 2024-09-11T00:07:05.282 INFO:tasks.workunit.client.1.smithi203.stdout:3/242: write d8/da/d37/f47 [1527238,65735] 0 2024-09-11T00:07:05.283 INFO:tasks.workunit.client.0.smithi111.stdout:4/102: truncate d18/f19 7008 0 2024-09-11T00:07:05.284 INFO:tasks.workunit.client.1.smithi203.stdout:4/155: rename db/dd/fe to db/f2b 0 2024-09-11T00:07:05.285 INFO:tasks.workunit.client.0.smithi111.stdout:4/103: write f8 [8271997,65899] 0 2024-09-11T00:07:05.286 INFO:tasks.workunit.client.0.smithi111.stdout:1/115: dwrite d2/de/f11 [0,4194304] 0 2024-09-11T00:07:05.287 INFO:tasks.workunit.client.0.smithi111.stdout:6/100: symlink d7/d1b/l1c 0 2024-09-11T00:07:05.287 INFO:tasks.workunit.client.1.smithi203.stdout:8/160: mknod d1/d13/d22/c3c 0 2024-09-11T00:07:05.288 INFO:tasks.workunit.client.0.smithi111.stdout:9/143: fdatasync d6/db/fd 0 2024-09-11T00:07:05.288 INFO:tasks.workunit.client.0.smithi111.stdout:7/131: symlink dd/d1d/d1f/l27 0 2024-09-11T00:07:05.290 INFO:tasks.workunit.client.0.smithi111.stdout:6/101: truncate d7/f12 632794 0 2024-09-11T00:07:05.292 INFO:tasks.workunit.client.0.smithi111.stdout:6/102: fdatasync d7/f9 0 2024-09-11T00:07:05.293 INFO:tasks.workunit.client.0.smithi111.stdout:6/103: chown d7/f13 0 1 2024-09-11T00:07:05.294 INFO:tasks.workunit.client.1.smithi203.stdout:2/127: rename d13/d15/d19/d1c/f1e to d13/d15/f23 0 2024-09-11T00:07:05.295 INFO:tasks.workunit.client.0.smithi111.stdout:8/149: dwrite f10 [0,4194304] 0 2024-09-11T00:07:05.295 INFO:tasks.workunit.client.0.smithi111.stdout:0/126: getdents d3/d13/d1e 0 2024-09-11T00:07:05.297 INFO:tasks.workunit.client.0.smithi111.stdout:5/155: write d10/f27 [737381,68046] 0 2024-09-11T00:07:05.298 INFO:tasks.workunit.client.1.smithi203.stdout:1/222: creat d8/d9/d15/d30/d3e/d4b/d41/f4d x:0 0 0 2024-09-11T00:07:05.298 INFO:tasks.workunit.client.0.smithi111.stdout:4/104: unlink la 0 2024-09-11T00:07:05.298 INFO:tasks.workunit.client.1.smithi203.stdout:3/243: mknod d8/d17/c5f 0 2024-09-11T00:07:05.299 INFO:tasks.workunit.client.1.smithi203.stdout:2/128: chown fd 0 1 2024-09-11T00:07:05.300 INFO:tasks.workunit.client.0.smithi111.stdout:1/116: creat d2/de/d12/f26 x:0 0 0 2024-09-11T00:07:05.302 INFO:tasks.workunit.client.0.smithi111.stdout:9/144: mknod d6/db/d1b/c2f 0 2024-09-11T00:07:05.302 INFO:tasks.workunit.client.1.smithi203.stdout:9/162: dwrite d6/de/d19/f33 [0,4194304] 0 2024-09-11T00:07:05.304 INFO:tasks.workunit.client.0.smithi111.stdout:1/117: write d2/f10 [375608,108780] 0 2024-09-11T00:07:05.305 INFO:tasks.workunit.client.0.smithi111.stdout:6/104: mkdir d7/d1b/d1d 0 2024-09-11T00:07:05.307 INFO:tasks.workunit.client.1.smithi203.stdout:1/223: write d8/d9/f1c [9344681,130953] 0 2024-09-11T00:07:05.309 INFO:tasks.workunit.client.0.smithi111.stdout:4/105: mknod d18/c21 0 2024-09-11T00:07:05.309 INFO:tasks.workunit.client.1.smithi203.stdout:9/163: readlink d6/lc 0 2024-09-11T00:07:05.310 INFO:tasks.workunit.client.1.smithi203.stdout:8/161: truncate d1/f20 2713743 0 2024-09-11T00:07:05.311 INFO:tasks.workunit.client.1.smithi203.stdout:8/162: write d1/d13/f19 [5117977,130897] 0 2024-09-11T00:07:05.313 INFO:tasks.workunit.client.1.smithi203.stdout:9/164: write d6/de/d19/d13/d29/f2b [4192332,121979] 0 2024-09-11T00:07:05.313 INFO:tasks.workunit.client.0.smithi111.stdout:5/156: rename d10/d1e/d23/c35 to d10/d1e/d23/d30/c38 0 2024-09-11T00:07:05.314 INFO:tasks.workunit.client.0.smithi111.stdout:8/150: dread d11/f15 [0,4194304] 0 2024-09-11T00:07:05.315 INFO:tasks.workunit.client.1.smithi203.stdout:2/129: unlink d13/l21 0 2024-09-11T00:07:05.315 INFO:tasks.workunit.client.0.smithi111.stdout:8/151: stat d11/f1b 0 2024-09-11T00:07:05.316 INFO:tasks.workunit.client.1.smithi203.stdout:4/156: getdents db/dd/d16 0 2024-09-11T00:07:05.317 INFO:tasks.workunit.client.1.smithi203.stdout:2/130: write d13/f14 [792268,101181] 0 2024-09-11T00:07:05.318 INFO:tasks.workunit.client.1.smithi203.stdout:2/131: stat f4 0 2024-09-11T00:07:05.318 INFO:tasks.workunit.client.1.smithi203.stdout:4/157: read - db/dd/d26/f28 zero size 2024-09-11T00:07:05.320 INFO:tasks.workunit.client.0.smithi111.stdout:0/127: unlink d3/d13/d1e/c2b 0 2024-09-11T00:07:05.320 INFO:tasks.workunit.client.0.smithi111.stdout:8/152: read - d11/d21/f26 zero size 2024-09-11T00:07:05.321 INFO:tasks.workunit.client.1.smithi203.stdout:8/163: unlink d1/d13/f1d 0 2024-09-11T00:07:05.321 INFO:tasks.workunit.client.0.smithi111.stdout:8/153: readlink d11/l1c 0 2024-09-11T00:07:05.322 INFO:tasks.workunit.client.0.smithi111.stdout:4/106: mknod d18/c22 0 2024-09-11T00:07:05.322 INFO:tasks.workunit.client.1.smithi203.stdout:4/158: dread db/dd/f11 [0,4194304] 0 2024-09-11T00:07:05.323 INFO:tasks.workunit.client.0.smithi111.stdout:0/128: write d3/d13/d1e/d29/f2a [156804,115989] 0 2024-09-11T00:07:05.329 INFO:tasks.workunit.client.1.smithi203.stdout:9/165: rename d6/l16 to d6/de/d19/d24/l38 0 2024-09-11T00:07:05.329 INFO:tasks.workunit.client.0.smithi111.stdout:5/157: dread d10/d1e/d23/d2b/f33 [0,4194304] 0 2024-09-11T00:07:05.330 INFO:tasks.workunit.client.1.smithi203.stdout:4/159: creat db/dd/f2c x:0 0 0 2024-09-11T00:07:05.333 INFO:tasks.workunit.client.0.smithi111.stdout:1/118: rename d2/l7 to d2/de/d12/l27 0 2024-09-11T00:07:05.335 INFO:tasks.workunit.client.0.smithi111.stdout:9/145: creat d6/db/f30 x:0 0 0 2024-09-11T00:07:05.336 INFO:tasks.workunit.client.0.smithi111.stdout:8/154: mknod d11/d23/c28 0 2024-09-11T00:07:05.339 INFO:tasks.workunit.client.0.smithi111.stdout:4/107: creat d18/d20/f23 x:0 0 0 2024-09-11T00:07:05.345 INFO:tasks.workunit.client.1.smithi203.stdout:3/244: dread d8/d17/f57 [0,4194304] 0 2024-09-11T00:07:05.346 INFO:tasks.workunit.client.1.smithi203.stdout:4/160: truncate f6 974500 0 2024-09-11T00:07:05.346 INFO:tasks.workunit.client.0.smithi111.stdout:6/105: dread f6 [0,4194304] 0 2024-09-11T00:07:05.347 INFO:tasks.workunit.client.0.smithi111.stdout:1/119: creat d2/de/d12/f28 x:0 0 0 2024-09-11T00:07:05.348 INFO:tasks.workunit.client.0.smithi111.stdout:9/146: dwrite d6/dc/d13/f19 [0,4194304] 0 2024-09-11T00:07:05.348 INFO:tasks.workunit.client.0.smithi111.stdout:1/120: dread - d2/de/d12/f28 zero size 2024-09-11T00:07:05.353 INFO:tasks.workunit.client.0.smithi111.stdout:8/155: rename d11/d23/c28 to d11/d21/c29 0 2024-09-11T00:07:05.360 INFO:tasks.workunit.client.1.smithi203.stdout:4/161: creat db/d12/d15/f2d x:0 0 0 2024-09-11T00:07:05.362 INFO:tasks.workunit.client.1.smithi203.stdout:4/162: stat db/cf 0 2024-09-11T00:07:05.366 INFO:tasks.workunit.client.0.smithi111.stdout:8/156: dwrite d11/f12 [0,4194304] 0 2024-09-11T00:07:05.366 INFO:tasks.workunit.client.0.smithi111.stdout:8/157: fdatasync ff 0 2024-09-11T00:07:05.369 INFO:tasks.workunit.client.1.smithi203.stdout:4/163: rename db to db/d12/d15/d2e 22 2024-09-11T00:07:05.369 INFO:tasks.workunit.client.1.smithi203.stdout:2/132: dread d13/f14 [0,4194304] 0 2024-09-11T00:07:05.373 INFO:tasks.workunit.client.1.smithi203.stdout:3/245: dwrite d8/f58 [0,4194304] 0 2024-09-11T00:07:05.377 INFO:tasks.workunit.client.0.smithi111.stdout:1/121: dread d2/de/ff [0,4194304] 0 2024-09-11T00:07:05.388 INFO:tasks.workunit.client.1.smithi203.stdout:2/133: dread f8 [0,4194304] 0 2024-09-11T00:07:05.402 INFO:tasks.workunit.client.0.smithi111.stdout:9/147: symlink d6/l31 0 2024-09-11T00:07:05.403 INFO:tasks.workunit.client.0.smithi111.stdout:9/148: chown d6/l8 170 1 2024-09-11T00:07:05.405 INFO:tasks.workunit.client.1.smithi203.stdout:3/246: symlink d8/d17/l60 0 2024-09-11T00:07:05.406 INFO:tasks.workunit.client.0.smithi111.stdout:3/158: dwrite f1a [0,4194304] 0 2024-09-11T00:07:05.411 INFO:tasks.workunit.client.0.smithi111.stdout:5/158: link d10/d1e/l24 d10/d1e/d23/d2b/d2f/l39 0 2024-09-11T00:07:05.414 INFO:tasks.workunit.client.0.smithi111.stdout:0/129: getdents d3/d13/d1e/d29 0 2024-09-11T00:07:05.415 INFO:tasks.workunit.client.1.smithi203.stdout:3/247: chown d8/d3c/c5b 6337 1 2024-09-11T00:07:05.415 INFO:tasks.workunit.client.0.smithi111.stdout:0/130: read - d3/dc/f1a zero size 2024-09-11T00:07:05.417 INFO:tasks.workunit.client.0.smithi111.stdout:8/158: rename f10 to d11/d23/f2a 0 2024-09-11T00:07:05.418 INFO:tasks.workunit.client.0.smithi111.stdout:8/159: rename d11 to d11/d21/d2b 22 2024-09-11T00:07:05.422 INFO:tasks.workunit.client.0.smithi111.stdout:3/159: read d1c/d1d/f1f [1977085,25688] 0 2024-09-11T00:07:05.423 INFO:tasks.workunit.client.1.smithi203.stdout:4/164: dwrite db/dd/d16/f29 [0,4194304] 0 2024-09-11T00:07:05.426 INFO:tasks.workunit.client.0.smithi111.stdout:4/108: sync 2024-09-11T00:07:05.429 INFO:tasks.workunit.client.0.smithi111.stdout:9/149: rename d6/dc/d13/f2e to d6/dc/d13/f32 0 2024-09-11T00:07:05.429 INFO:tasks.workunit.client.1.smithi203.stdout:2/134: dwrite d13/d15/f1a [4194304,4194304] 0 2024-09-11T00:07:05.429 INFO:tasks.workunit.client.1.smithi203.stdout:3/248: creat d8/da/d5c/f61 x:0 0 0 2024-09-11T00:07:05.431 INFO:tasks.workunit.client.1.smithi203.stdout:3/249: readlink d8/d3c/l56 0 2024-09-11T00:07:05.432 INFO:tasks.workunit.client.0.smithi111.stdout:2/129: dwrite d0/f22 [0,4194304] 0 2024-09-11T00:07:05.433 INFO:tasks.workunit.client.0.smithi111.stdout:7/132: write dd/f10 [1672580,29926] 0 2024-09-11T00:07:05.435 INFO:tasks.workunit.client.0.smithi111.stdout:7/133: rename dd to dd/d1d/d1f/d24/d28 22 2024-09-11T00:07:05.437 INFO:tasks.workunit.client.1.smithi203.stdout:5/200: sync 2024-09-11T00:07:05.437 INFO:tasks.workunit.client.1.smithi203.stdout:0/197: sync 2024-09-11T00:07:05.438 INFO:tasks.workunit.client.1.smithi203.stdout:7/190: dwrite dd/d1c/f29 [0,4194304] 0 2024-09-11T00:07:05.441 INFO:tasks.workunit.client.1.smithi203.stdout:0/198: write d0/d2/f3 [4969076,75918] 0 2024-09-11T00:07:05.441 INFO:tasks.workunit.client.1.smithi203.stdout:7/191: write dd/d1c/f3a [3541422,87958] 0 2024-09-11T00:07:05.444 INFO:tasks.workunit.client.1.smithi203.stdout:0/199: stat d0/d1d/l25 0 2024-09-11T00:07:05.448 INFO:tasks.workunit.client.1.smithi203.stdout:3/250: rmdir d8/d2a 39 2024-09-11T00:07:05.451 INFO:tasks.workunit.client.1.smithi203.stdout:7/192: write dd/d1c/f23 [441554,100094] 0 2024-09-11T00:07:05.455 INFO:tasks.workunit.client.1.smithi203.stdout:7/193: truncate dd/d1c/f46 557936 0 2024-09-11T00:07:05.458 INFO:tasks.workunit.client.1.smithi203.stdout:7/194: write fc [5785753,61564] 0 2024-09-11T00:07:05.460 INFO:tasks.workunit.client.0.smithi111.stdout:6/106: link f0 d7/d1b/d1d/f1e 0 2024-09-11T00:07:05.463 INFO:tasks.workunit.client.1.smithi203.stdout:4/165: dwrite db/dd/f2c [0,4194304] 0 2024-09-11T00:07:05.465 INFO:tasks.workunit.client.0.smithi111.stdout:3/160: mkdir d1c/d1d/d22/d31/d33 0 2024-09-11T00:07:05.469 INFO:tasks.workunit.client.1.smithi203.stdout:3/251: creat d8/da/d37/d53/f62 x:0 0 0 2024-09-11T00:07:05.471 INFO:tasks.workunit.client.1.smithi203.stdout:2/135: dread f0 [0,4194304] 0 2024-09-11T00:07:05.471 INFO:tasks.workunit.client.0.smithi111.stdout:9/150: fsync d6/dc/f17 0 2024-09-11T00:07:05.474 INFO:tasks.workunit.client.1.smithi203.stdout:1/224: write d8/d9/f1e [2941427,55367] 0 2024-09-11T00:07:05.478 INFO:tasks.workunit.client.0.smithi111.stdout:7/134: unlink cb 0 2024-09-11T00:07:05.478 INFO:tasks.workunit.client.1.smithi203.stdout:7/195: dread dd/d1c/d26/d31/f39 [0,4194304] 0 2024-09-11T00:07:05.479 INFO:tasks.workunit.client.0.smithi111.stdout:8/160: dwrite d11/f1a [4194304,4194304] 0 2024-09-11T00:07:05.480 INFO:tasks.workunit.client.1.smithi203.stdout:4/166: creat db/dd/d26/f2f x:0 0 0 2024-09-11T00:07:05.484 INFO:tasks.workunit.client.0.smithi111.stdout:1/122: link d2/de/f11 d2/de/f29 0 2024-09-11T00:07:05.487 INFO:tasks.workunit.client.0.smithi111.stdout:1/123: truncate d2/de/d12/f1c 1032268 0 2024-09-11T00:07:05.493 INFO:tasks.workunit.client.1.smithi203.stdout:9/166: truncate d6/de/d19/d13/d29/f2b 2663588 0 2024-09-11T00:07:05.494 INFO:tasks.workunit.client.1.smithi203.stdout:3/252: chown d8/c2b 5312 1 2024-09-11T00:07:05.496 INFO:tasks.workunit.client.0.smithi111.stdout:8/161: dwrite d11/f1b [0,4194304] 0 2024-09-11T00:07:05.497 INFO:tasks.workunit.client.0.smithi111.stdout:4/109: creat d18/d1f/f24 x:0 0 0 2024-09-11T00:07:05.499 INFO:tasks.workunit.client.1.smithi203.stdout:1/225: mknod d8/d19/c4e 0 2024-09-11T00:07:05.499 INFO:tasks.workunit.client.1.smithi203.stdout:5/201: dread dc/dd/d13/f18 [0,4194304] 0 2024-09-11T00:07:05.500 INFO:tasks.workunit.client.0.smithi111.stdout:9/151: creat d6/db/d1b/f33 x:0 0 0 2024-09-11T00:07:05.502 INFO:tasks.workunit.client.0.smithi111.stdout:9/152: write d6/db/d1b/f33 [827959,127092] 0 2024-09-11T00:07:05.504 INFO:tasks.workunit.client.0.smithi111.stdout:9/153: chown d6/c12 0 1 2024-09-11T00:07:05.506 INFO:tasks.workunit.client.0.smithi111.stdout:2/130: mknod d0/d3/c2c 0 2024-09-11T00:07:05.508 INFO:tasks.workunit.client.1.smithi203.stdout:7/196: symlink dd/d1c/d26/l48 0 2024-09-11T00:07:05.511 INFO:tasks.workunit.client.1.smithi203.stdout:7/197: readlink dd/d1c/l42 0 2024-09-11T00:07:05.512 INFO:tasks.workunit.client.1.smithi203.stdout:3/253: mkdir d8/da/d37/d53/d63 0 2024-09-11T00:07:05.512 INFO:tasks.workunit.client.1.smithi203.stdout:2/136: dwrite f0 [0,4194304] 0 2024-09-11T00:07:05.515 INFO:tasks.workunit.client.1.smithi203.stdout:7/198: chown dd/d1c/d26/d31/f36 9 1 2024-09-11T00:07:05.517 INFO:tasks.workunit.client.1.smithi203.stdout:3/254: dread d8/da/f46 [0,4194304] 0 2024-09-11T00:07:05.520 INFO:tasks.workunit.client.1.smithi203.stdout:1/226: chown d8/d9/l1d 0 1 2024-09-11T00:07:05.520 INFO:tasks.workunit.client.1.smithi203.stdout:9/167: dread d6/de/d19/d13/f2a [0,4194304] 0 2024-09-11T00:07:05.521 INFO:tasks.workunit.client.0.smithi111.stdout:2/131: dread d0/d3/de/f1e [0,4194304] 0 2024-09-11T00:07:05.522 INFO:tasks.workunit.client.1.smithi203.stdout:5/202: mkdir dc/d2b/d3f 0 2024-09-11T00:07:05.525 INFO:tasks.workunit.client.0.smithi111.stdout:8/162: mkdir d11/d23/d2c 0 2024-09-11T00:07:05.529 INFO:tasks.workunit.client.1.smithi203.stdout:7/199: creat dd/d1c/d26/d31/f49 x:0 0 0 2024-09-11T00:07:05.530 INFO:tasks.workunit.client.0.smithi111.stdout:7/135: symlink dd/l29 0 2024-09-11T00:07:05.531 INFO:tasks.workunit.client.1.smithi203.stdout:7/200: read - dd/d1c/d26/d31/f36 zero size 2024-09-11T00:07:05.535 INFO:tasks.workunit.client.0.smithi111.stdout:3/161: creat d1c/f34 x:0 0 0 2024-09-11T00:07:05.536 INFO:tasks.workunit.client.0.smithi111.stdout:5/159: read d10/f1c [519342,87408] 0 2024-09-11T00:07:05.537 INFO:tasks.workunit.client.0.smithi111.stdout:1/124: dwrite d2/de/f29 [4194304,4194304] 0 2024-09-11T00:07:05.537 INFO:tasks.workunit.client.0.smithi111.stdout:3/162: chown l16 106992 1 2024-09-11T00:07:05.540 INFO:tasks.workunit.client.0.smithi111.stdout:5/160: dread d10/d1e/f2a [0,4194304] 0 2024-09-11T00:07:05.541 INFO:tasks.workunit.client.0.smithi111.stdout:8/163: symlink d11/l2d 0 2024-09-11T00:07:05.542 INFO:tasks.workunit.client.0.smithi111.stdout:5/161: read f5 [2884547,19833] 0 2024-09-11T00:07:05.543 INFO:tasks.workunit.client.0.smithi111.stdout:8/164: fsync d11/f12 0 2024-09-11T00:07:05.543 INFO:tasks.workunit.client.1.smithi203.stdout:2/137: symlink d13/d22/l24 0 2024-09-11T00:07:05.544 INFO:tasks.workunit.client.1.smithi203.stdout:7/201: dwrite dd/d1c/d26/f3f [0,4194304] 0 2024-09-11T00:07:05.548 INFO:tasks.workunit.client.0.smithi111.stdout:6/107: link d7/ff d7/f1f 0 2024-09-11T00:07:05.549 INFO:tasks.workunit.client.0.smithi111.stdout:7/136: dwrite dd/f15 [0,4194304] 0 2024-09-11T00:07:05.550 INFO:tasks.workunit.client.0.smithi111.stdout:7/137: chown dd/l11 421167 1 2024-09-11T00:07:05.551 INFO:tasks.workunit.client.1.smithi203.stdout:1/227: creat d8/d9/d15/d30/d3e/d4b/d3a/f4f x:0 0 0 2024-09-11T00:07:05.555 INFO:tasks.workunit.client.1.smithi203.stdout:5/203: rename dc/dd/d15/f25 to dc/dd/d15/d3b/f40 0 2024-09-11T00:07:05.558 INFO:tasks.workunit.client.0.smithi111.stdout:3/163: fdatasync d1c/d1d/f20 0 2024-09-11T00:07:05.558 INFO:tasks.workunit.client.1.smithi203.stdout:1/228: truncate d8/d9/d15/d30/d3e/d4b/d41/f4d 847745 0 2024-09-11T00:07:05.561 INFO:tasks.workunit.client.0.smithi111.stdout:3/164: fdatasync f19 0 2024-09-11T00:07:05.561 INFO:tasks.workunit.client.0.smithi111.stdout:1/125: unlink d2/f19 0 2024-09-11T00:07:05.564 INFO:tasks.workunit.client.0.smithi111.stdout:3/165: read - f19 zero size 2024-09-11T00:07:05.564 INFO:tasks.workunit.client.0.smithi111.stdout:8/165: dwrite d11/f12 [4194304,4194304] 0 2024-09-11T00:07:05.566 INFO:tasks.workunit.client.0.smithi111.stdout:1/126: chown d2/de/d12/l22 138973462 1 2024-09-11T00:07:05.566 INFO:tasks.workunit.client.0.smithi111.stdout:5/162: mkdir d10/d1e/d23/d26/d3a 0 2024-09-11T00:07:05.567 INFO:tasks.workunit.client.1.smithi203.stdout:1/229: dread d8/d9/d15/d30/f3d [0,4194304] 0 2024-09-11T00:07:05.571 INFO:tasks.workunit.client.0.smithi111.stdout:0/131: dwrite d3/da/f21 [0,4194304] 0 2024-09-11T00:07:05.571 INFO:tasks.workunit.client.1.smithi203.stdout:5/204: unlink dc/c3c 0 2024-09-11T00:07:05.575 INFO:tasks.workunit.client.0.smithi111.stdout:7/138: rmdir dd/d1d 39 2024-09-11T00:07:05.575 INFO:tasks.workunit.client.0.smithi111.stdout:1/127: write d2/de/d12/d13/f1a [780603,12629] 0 2024-09-11T00:07:05.581 INFO:tasks.workunit.client.1.smithi203.stdout:9/168: truncate d6/de/d19/d13/d29/f2b 2839805 0 2024-09-11T00:07:05.583 INFO:tasks.workunit.client.1.smithi203.stdout:8/164: unlink d1/d13/f21 0 2024-09-11T00:07:05.585 INFO:tasks.workunit.client.0.smithi111.stdout:9/154: sync 2024-09-11T00:07:05.585 INFO:tasks.workunit.client.0.smithi111.stdout:8/166: fsync f7 0 2024-09-11T00:07:05.592 INFO:tasks.workunit.client.0.smithi111.stdout:0/132: unlink d3/f15 0 2024-09-11T00:07:05.593 INFO:tasks.workunit.client.1.smithi203.stdout:5/205: mkdir dc/dd/d1e/d41 0 2024-09-11T00:07:05.594 INFO:tasks.workunit.client.1.smithi203.stdout:3/255: getdents d8/d2a 0 2024-09-11T00:07:05.596 INFO:tasks.workunit.client.0.smithi111.stdout:7/139: write dd/f1c [1656017,101238] 0 2024-09-11T00:07:05.598 INFO:tasks.workunit.client.1.smithi203.stdout:9/169: chown d6/f14 752858 1 2024-09-11T00:07:05.599 INFO:tasks.workunit.client.1.smithi203.stdout:8/165: creat d1/f3d x:0 0 0 2024-09-11T00:07:05.599 INFO:tasks.workunit.client.0.smithi111.stdout:1/128: dwrite d2/de/f16 [0,4194304] 0 2024-09-11T00:07:05.601 INFO:tasks.workunit.client.0.smithi111.stdout:1/129: readlink d2/lb 0 2024-09-11T00:07:05.605 INFO:tasks.workunit.client.1.smithi203.stdout:1/230: dwrite d8/d9/d15/f22 [4194304,4194304] 0 2024-09-11T00:07:05.609 INFO:tasks.workunit.client.1.smithi203.stdout:9/170: creat d6/de/d19/d13/f39 x:0 0 0 2024-09-11T00:07:05.611 INFO:tasks.workunit.client.0.smithi111.stdout:0/133: dwrite d3/d13/d1e/d29/f2a [0,4194304] 0 2024-09-11T00:07:05.614 INFO:tasks.workunit.client.1.smithi203.stdout:8/166: chown d1/d13/c1c 11760053 1 2024-09-11T00:07:05.615 INFO:tasks.workunit.client.0.smithi111.stdout:1/130: dread d2/fd [0,4194304] 0 2024-09-11T00:07:05.616 INFO:tasks.workunit.client.0.smithi111.stdout:1/131: fsync d2/fd 0 2024-09-11T00:07:05.619 INFO:tasks.workunit.client.0.smithi111.stdout:1/132: dread - d2/de/d12/f28 zero size 2024-09-11T00:07:05.622 INFO:tasks.workunit.client.0.smithi111.stdout:9/155: mkdir d6/db/d34 0 2024-09-11T00:07:05.622 INFO:tasks.workunit.client.0.smithi111.stdout:1/133: write d2/de/d12/d13/f20 [228256,125193] 0 2024-09-11T00:07:05.624 INFO:tasks.workunit.client.1.smithi203.stdout:5/206: creat dc/dd/d15/f42 x:0 0 0 2024-09-11T00:07:05.624 INFO:tasks.workunit.client.0.smithi111.stdout:9/156: dread - d6/db/f30 zero size 2024-09-11T00:07:05.627 INFO:tasks.workunit.client.0.smithi111.stdout:3/166: rmdir d1c/d21/d26 0 2024-09-11T00:07:05.628 INFO:tasks.workunit.client.1.smithi203.stdout:6/155: sync 2024-09-11T00:07:05.628 INFO:tasks.workunit.client.1.smithi203.stdout:9/171: symlink d6/de/d19/d30/l3a 0 2024-09-11T00:07:05.628 INFO:tasks.workunit.client.1.smithi203.stdout:3/256: dwrite d8/da/f46 [0,4194304] 0 2024-09-11T00:07:05.631 INFO:tasks.workunit.client.0.smithi111.stdout:0/134: mknod d3/d2f/c32 0 2024-09-11T00:07:05.634 INFO:tasks.workunit.client.1.smithi203.stdout:5/207: creat dc/dd/d13/f43 x:0 0 0 2024-09-11T00:07:05.634 INFO:tasks.workunit.client.1.smithi203.stdout:6/156: dread - d0/f25 zero size 2024-09-11T00:07:05.636 INFO:tasks.workunit.client.0.smithi111.stdout:0/135: symlink d3/da/l33 0 2024-09-11T00:07:05.637 INFO:tasks.workunit.client.0.smithi111.stdout:0/136: fsync d3/dc/f1f 0 2024-09-11T00:07:05.638 INFO:tasks.workunit.client.1.smithi203.stdout:9/172: symlink d6/de/d19/d30/l3b 0 2024-09-11T00:07:05.639 INFO:tasks.workunit.client.0.smithi111.stdout:9/157: link d6/dc/d13/f28 d6/dc/d13/f35 0 2024-09-11T00:07:05.643 INFO:tasks.workunit.client.1.smithi203.stdout:1/231: rename d8/d9/d15/c2c to d8/d28/c50 0 2024-09-11T00:07:05.644 INFO:tasks.workunit.client.1.smithi203.stdout:9/173: dread d6/de/d19/d24/f2c [0,4194304] 0 2024-09-11T00:07:05.646 INFO:tasks.workunit.client.1.smithi203.stdout:3/257: dread d8/da/d37/f47 [0,4194304] 0 2024-09-11T00:07:05.647 INFO:tasks.workunit.client.1.smithi203.stdout:6/157: mknod d0/c28 0 2024-09-11T00:07:05.649 INFO:tasks.workunit.client.1.smithi203.stdout:1/232: creat d8/d11/f51 x:0 0 0 2024-09-11T00:07:05.650 INFO:tasks.workunit.client.1.smithi203.stdout:9/174: creat d6/de/d19/f3c x:0 0 0 2024-09-11T00:07:05.654 INFO:tasks.workunit.client.1.smithi203.stdout:6/158: creat d0/d27/f29 x:0 0 0 2024-09-11T00:07:05.657 INFO:tasks.workunit.client.1.smithi203.stdout:3/258: link d8/f2c d8/da/d5c/f64 0 2024-09-11T00:07:05.660 INFO:tasks.workunit.client.1.smithi203.stdout:3/259: dread d8/f3d [0,4194304] 0 2024-09-11T00:07:05.660 INFO:tasks.workunit.client.1.smithi203.stdout:1/233: dread d8/d9/f1e [0,4194304] 0 2024-09-11T00:07:05.662 INFO:tasks.workunit.client.1.smithi203.stdout:3/260: truncate d8/fb 957660 0 2024-09-11T00:07:05.668 INFO:tasks.workunit.client.1.smithi203.stdout:1/234: link d8/d19/d31/d36/f42 d8/d9/d15/d30/f52 0 2024-09-11T00:07:05.669 INFO:tasks.workunit.client.1.smithi203.stdout:3/261: mkdir d8/da/d11/d5e/d65 0 2024-09-11T00:07:05.669 INFO:tasks.workunit.client.1.smithi203.stdout:1/235: creat d8/d9/d15/d30/f53 x:0 0 0 2024-09-11T00:07:05.671 INFO:tasks.workunit.client.1.smithi203.stdout:3/262: creat d8/da/d11/d5e/d65/f66 x:0 0 0 2024-09-11T00:07:05.673 INFO:tasks.workunit.client.1.smithi203.stdout:1/236: mknod d8/d9/d15/d30/d3e/d4b/d41/c54 0 2024-09-11T00:07:05.676 INFO:tasks.workunit.client.1.smithi203.stdout:1/237: symlink d8/l55 0 2024-09-11T00:07:05.678 INFO:tasks.workunit.client.1.smithi203.stdout:1/238: symlink d8/d19/d31/l56 0 2024-09-11T00:07:05.679 INFO:tasks.workunit.client.1.smithi203.stdout:6/159: dread d0/d27/f18 [4194304,4194304] 0 2024-09-11T00:07:05.680 INFO:tasks.workunit.client.1.smithi203.stdout:1/239: chown d8/d9/d15/d30/f53 4937068 1 2024-09-11T00:07:05.683 INFO:tasks.workunit.client.1.smithi203.stdout:1/240: dread - d8/d9/d15/d30/d3e/d4b/d3a/f4f zero size 2024-09-11T00:07:05.685 INFO:tasks.workunit.client.1.smithi203.stdout:6/160: rename d0/d27/f29 to d0/f2a 0 2024-09-11T00:07:05.686 INFO:tasks.workunit.client.1.smithi203.stdout:3/263: dwrite d8/da/f2f [0,4194304] 0 2024-09-11T00:07:05.686 INFO:tasks.workunit.client.1.smithi203.stdout:6/161: readlink d0/d27/la 0 2024-09-11T00:07:05.689 INFO:tasks.workunit.client.1.smithi203.stdout:6/162: chown d0/f21 109 1 2024-09-11T00:07:05.690 INFO:tasks.workunit.client.1.smithi203.stdout:3/264: symlink d8/da/d37/d53/d63/l67 0 2024-09-11T00:07:05.692 INFO:tasks.workunit.client.1.smithi203.stdout:6/163: unlink d0/d27/c1a 0 2024-09-11T00:07:05.693 INFO:tasks.workunit.client.1.smithi203.stdout:1/241: dread d8/d19/f26 [0,4194304] 0 2024-09-11T00:07:05.694 INFO:tasks.workunit.client.1.smithi203.stdout:3/265: mknod d8/da/d11/d5e/d65/c68 0 2024-09-11T00:07:05.695 INFO:tasks.workunit.client.1.smithi203.stdout:3/266: chown d8/d3c/f5a 1698 1 2024-09-11T00:07:05.698 INFO:tasks.workunit.client.1.smithi203.stdout:1/242: creat d8/d19/f57 x:0 0 0 2024-09-11T00:07:05.699 INFO:tasks.workunit.client.1.smithi203.stdout:3/267: write d8/f3d [1502379,101571] 0 2024-09-11T00:07:05.699 INFO:tasks.workunit.client.1.smithi203.stdout:6/164: mkdir d0/d2b 0 2024-09-11T00:07:05.701 INFO:tasks.workunit.client.0.smithi111.stdout:3/167: sync 2024-09-11T00:07:05.701 INFO:tasks.workunit.client.1.smithi203.stdout:3/268: read d8/d3c/f5a [2569450,40345] 0 2024-09-11T00:07:05.702 INFO:tasks.workunit.client.1.smithi203.stdout:1/243: write d8/d9/f1e [1779071,65747] 0 2024-09-11T00:07:05.705 INFO:tasks.workunit.client.1.smithi203.stdout:6/165: creat d0/f2c x:0 0 0 2024-09-11T00:07:05.706 INFO:tasks.workunit.client.1.smithi203.stdout:1/244: chown d8/d9/d15/d30/d3e/d4b/d41/f4d 0 1 2024-09-11T00:07:05.708 INFO:tasks.workunit.client.1.smithi203.stdout:1/245: mknod d8/d19/c58 0 2024-09-11T00:07:05.709 INFO:tasks.workunit.client.1.smithi203.stdout:6/166: creat d0/f2d x:0 0 0 2024-09-11T00:07:05.711 INFO:tasks.workunit.client.1.smithi203.stdout:6/167: chown d0/f4 7290 1 2024-09-11T00:07:05.721 INFO:tasks.workunit.client.1.smithi203.stdout:1/246: dwrite d8/d9/f1e [0,4194304] 0 2024-09-11T00:07:05.724 INFO:tasks.workunit.client.1.smithi203.stdout:1/247: dread d8/d9/d15/d30/f3d [0,4194304] 0 2024-09-11T00:07:05.726 INFO:tasks.workunit.client.1.smithi203.stdout:1/248: readlink d8/d9/l18 0 2024-09-11T00:07:05.746 INFO:tasks.workunit.client.1.smithi203.stdout:1/249: dread d8/f1a [0,4194304] 0 2024-09-11T00:07:05.749 INFO:tasks.workunit.client.1.smithi203.stdout:1/250: creat d8/d19/d31/f59 x:0 0 0 2024-09-11T00:07:05.758 INFO:tasks.workunit.client.0.smithi111.stdout:4/110: truncate f8 1844776 0 2024-09-11T00:07:05.761 INFO:tasks.workunit.client.0.smithi111.stdout:2/132: rename d0/c10 to d0/d3/de/c2d 0 2024-09-11T00:07:05.765 INFO:tasks.workunit.client.0.smithi111.stdout:5/163: rename d10/f15 to d10/d1e/d23/d2b/d2f/f3b 0 2024-09-11T00:07:05.765 INFO:tasks.workunit.client.0.smithi111.stdout:8/167: rename d11/d23 to d11/d23/d2c/d2e 22 2024-09-11T00:07:05.766 INFO:tasks.workunit.client.0.smithi111.stdout:5/164: chown d10/d1e/f2a 433737200 1 2024-09-11T00:07:05.767 INFO:tasks.workunit.client.0.smithi111.stdout:7/140: rename dd/f19 to dd/d1d/f2a 0 2024-09-11T00:07:05.768 INFO:tasks.workunit.client.0.smithi111.stdout:0/137: rename d3/d13/d1e to d3/d13/d1e/d34 22 2024-09-11T00:07:05.771 INFO:tasks.workunit.client.0.smithi111.stdout:8/168: creat d11/d23/f2f x:0 0 0 2024-09-11T00:07:05.772 INFO:tasks.workunit.client.0.smithi111.stdout:0/138: rename d3/dc to d3/dc/d35 22 2024-09-11T00:07:05.772 INFO:tasks.workunit.client.0.smithi111.stdout:5/165: mkdir d10/d1e/d23/d30/d3c 0 2024-09-11T00:07:05.774 INFO:tasks.workunit.client.0.smithi111.stdout:0/139: creat d3/d13/d1e/d29/f36 x:0 0 0 2024-09-11T00:07:05.777 INFO:tasks.workunit.client.0.smithi111.stdout:2/133: dwrite d0/d3/f27 [0,4194304] 0 2024-09-11T00:07:05.777 INFO:tasks.workunit.client.0.smithi111.stdout:5/166: rmdir d10/d1e/d23 39 2024-09-11T00:07:05.778 INFO:tasks.workunit.client.0.smithi111.stdout:7/141: creat dd/f2b x:0 0 0 2024-09-11T00:07:05.779 INFO:tasks.workunit.client.0.smithi111.stdout:0/140: symlink d3/da/l37 0 2024-09-11T00:07:05.781 INFO:tasks.workunit.client.0.smithi111.stdout:5/167: mknod d10/d1e/d25/c3d 0 2024-09-11T00:07:05.782 INFO:tasks.workunit.client.0.smithi111.stdout:7/142: rmdir dd/d1d 39 2024-09-11T00:07:05.782 INFO:tasks.workunit.client.0.smithi111.stdout:8/169: dread d11/d23/f2a [0,4194304] 0 2024-09-11T00:07:05.784 INFO:tasks.workunit.client.0.smithi111.stdout:2/134: mkdir d0/d3/d2e 0 2024-09-11T00:07:05.785 INFO:tasks.workunit.client.1.smithi203.stdout:2/138: truncate d13/d15/f1a 4812515 0 2024-09-11T00:07:05.788 INFO:tasks.workunit.client.1.smithi203.stdout:7/202: truncate dd/d1c/d26/f3f 534149 0 2024-09-11T00:07:05.789 INFO:tasks.workunit.client.1.smithi203.stdout:7/203: read dd/d1c/d26/d31/f39 [215614,43383] 0 2024-09-11T00:07:05.791 INFO:tasks.workunit.client.1.smithi203.stdout:2/139: rmdir d13/d15/d19 39 2024-09-11T00:07:05.795 INFO:tasks.workunit.client.1.smithi203.stdout:0/200: sync 2024-09-11T00:07:05.795 INFO:tasks.workunit.client.1.smithi203.stdout:4/167: sync 2024-09-11T00:07:05.795 INFO:tasks.workunit.client.1.smithi203.stdout:5/208: getdents dc/dd/d1e 0 2024-09-11T00:07:05.796 INFO:tasks.workunit.client.1.smithi203.stdout:5/209: readlink dc/l1b 0 2024-09-11T00:07:05.797 INFO:tasks.workunit.client.1.smithi203.stdout:0/201: chown d0/d2/f40 3472391 1 2024-09-11T00:07:05.797 INFO:tasks.workunit.client.1.smithi203.stdout:4/168: dread - db/d12/d15/f2d zero size 2024-09-11T00:07:05.798 INFO:tasks.workunit.client.1.smithi203.stdout:7/204: mkdir dd/d1c/d26/d31/d4a 0 2024-09-11T00:07:05.799 INFO:tasks.workunit.client.0.smithi111.stdout:6/108: dwrite f0 [0,4194304] 0 2024-09-11T00:07:05.806 INFO:tasks.workunit.client.1.smithi203.stdout:7/205: mkdir dd/d1c/d4b 0 2024-09-11T00:07:05.806 INFO:tasks.workunit.client.0.smithi111.stdout:2/135: dread d0/d3/de/f1e [0,4194304] 0 2024-09-11T00:07:05.808 INFO:tasks.workunit.client.1.smithi203.stdout:9/175: dread d6/de/d19/d13/d29/f2b [0,4194304] 0 2024-09-11T00:07:05.810 INFO:tasks.workunit.client.0.smithi111.stdout:6/109: mknod d7/d1b/c20 0 2024-09-11T00:07:05.814 INFO:tasks.workunit.client.1.smithi203.stdout:4/169: fdatasync db/f2b 0 2024-09-11T00:07:05.816 INFO:tasks.workunit.client.0.smithi111.stdout:7/143: creat dd/f2c x:0 0 0 2024-09-11T00:07:05.817 INFO:tasks.workunit.client.1.smithi203.stdout:4/170: fdatasync db/dd/f2c 0 2024-09-11T00:07:05.817 INFO:tasks.workunit.client.0.smithi111.stdout:7/144: fsync dd/f1c 0 2024-09-11T00:07:05.818 INFO:tasks.workunit.client.1.smithi203.stdout:0/202: dwrite d0/d2/d37/f38 [0,4194304] 0 2024-09-11T00:07:05.819 INFO:tasks.workunit.client.0.smithi111.stdout:0/141: getdents d3/d13/d1e 0 2024-09-11T00:07:05.820 INFO:tasks.workunit.client.0.smithi111.stdout:1/134: write d2/de/ff [572334,77857] 0 2024-09-11T00:07:05.822 INFO:tasks.workunit.client.1.smithi203.stdout:2/140: creat d13/d15/f25 x:0 0 0 2024-09-11T00:07:05.825 INFO:tasks.workunit.client.0.smithi111.stdout:6/110: rmdir d7/d1b/d1d 39 2024-09-11T00:07:05.826 INFO:tasks.workunit.client.0.smithi111.stdout:9/158: rmdir d6/dc 39 2024-09-11T00:07:05.827 INFO:tasks.workunit.client.0.smithi111.stdout:0/142: dread d3/da/f1d [0,4194304] 0 2024-09-11T00:07:05.836 INFO:tasks.workunit.client.0.smithi111.stdout:1/135: symlink d2/de/d12/d13/l2a 0 2024-09-11T00:07:05.838 INFO:tasks.workunit.client.0.smithi111.stdout:2/136: symlink d0/l2f 0 2024-09-11T00:07:05.843 INFO:tasks.workunit.client.0.smithi111.stdout:9/159: write d6/dc/f17 [6299,91314] 0 2024-09-11T00:07:05.844 INFO:tasks.workunit.client.0.smithi111.stdout:7/145: mkdir dd/d1d/d2d 0 2024-09-11T00:07:05.850 INFO:tasks.workunit.client.0.smithi111.stdout:6/111: creat d7/d1b/d1d/f21 x:0 0 0 2024-09-11T00:07:05.853 INFO:tasks.workunit.client.0.smithi111.stdout:2/137: dwrite d0/d3/f13 [4194304,4194304] 0 2024-09-11T00:07:05.854 INFO:tasks.workunit.client.0.smithi111.stdout:2/138: chown d0/d3/de/f11 558 1 2024-09-11T00:07:05.856 INFO:tasks.workunit.client.0.smithi111.stdout:7/146: mkdir dd/d1d/d2d/d2e 0 2024-09-11T00:07:05.858 INFO:tasks.workunit.client.0.smithi111.stdout:2/139: rmdir d0 39 2024-09-11T00:07:05.859 INFO:tasks.workunit.client.0.smithi111.stdout:9/160: getdents d6/db 0 2024-09-11T00:07:05.861 INFO:tasks.workunit.client.0.smithi111.stdout:3/168: truncate f6 1658981 0 2024-09-11T00:07:05.868 INFO:tasks.workunit.client.1.smithi203.stdout:5/210: link dc/dd/d13/c39 dc/d2b/d3f/c44 0 2024-09-11T00:07:05.869 INFO:tasks.workunit.client.0.smithi111.stdout:7/147: dread f6 [4194304,4194304] 0 2024-09-11T00:07:05.870 INFO:tasks.workunit.client.1.smithi203.stdout:8/167: dwrite d1/d13/f1f [4194304,4194304] 0 2024-09-11T00:07:05.870 INFO:tasks.workunit.client.1.smithi203.stdout:0/203: unlink d0/d1d/c1e 0 2024-09-11T00:07:05.871 INFO:tasks.workunit.client.1.smithi203.stdout:4/171: creat db/dd/d26/f30 x:0 0 0 2024-09-11T00:07:05.871 INFO:tasks.workunit.client.0.smithi111.stdout:4/111: truncate f7 2686766 0 2024-09-11T00:07:05.871 INFO:tasks.workunit.client.0.smithi111.stdout:7/148: read - dd/f2c zero size 2024-09-11T00:07:05.872 INFO:tasks.workunit.client.0.smithi111.stdout:9/161: dread d6/db/fd [0,4194304] 0 2024-09-11T00:07:05.872 INFO:tasks.workunit.client.0.smithi111.stdout:4/112: chown d18/c1e 162 1 2024-09-11T00:07:05.873 INFO:tasks.workunit.client.0.smithi111.stdout:4/113: chown d18 34888 1 2024-09-11T00:07:05.873 INFO:tasks.workunit.client.1.smithi203.stdout:0/204: chown d0/d2/f40 19 1 2024-09-11T00:07:05.875 INFO:tasks.workunit.client.1.smithi203.stdout:7/206: creat dd/d1c/d4b/f4c x:0 0 0 2024-09-11T00:07:05.876 INFO:tasks.workunit.client.0.smithi111.stdout:3/169: rename cc to d1c/c35 0 2024-09-11T00:07:05.877 INFO:tasks.workunit.client.0.smithi111.stdout:3/170: chown d1c/d1d/c2e 290 1 2024-09-11T00:07:05.877 INFO:tasks.workunit.client.0.smithi111.stdout:2/140: dwrite d0/d3/de/f1f [0,4194304] 0 2024-09-11T00:07:05.878 INFO:tasks.workunit.client.1.smithi203.stdout:6/168: write d0/f14 [2882251,47741] 0 2024-09-11T00:07:05.878 INFO:tasks.workunit.client.1.smithi203.stdout:0/205: readlink d0/d2/l2a 0 2024-09-11T00:07:05.878 INFO:tasks.workunit.client.1.smithi203.stdout:1/251: stat d8/d28/c50 0 2024-09-11T00:07:05.879 INFO:tasks.workunit.client.0.smithi111.stdout:2/141: dread - d0/d3/f1c zero size 2024-09-11T00:07:05.880 INFO:tasks.workunit.client.0.smithi111.stdout:4/114: creat d18/d1f/f25 x:0 0 0 2024-09-11T00:07:05.881 INFO:tasks.workunit.client.1.smithi203.stdout:5/211: dread dc/dd/d13/f3e [0,4194304] 0 2024-09-11T00:07:05.887 INFO:tasks.workunit.client.1.smithi203.stdout:4/172: mknod db/d12/d15/c31 0 2024-09-11T00:07:05.889 INFO:tasks.workunit.client.0.smithi111.stdout:3/171: read f12 [2393034,81933] 0 2024-09-11T00:07:05.891 INFO:tasks.workunit.client.1.smithi203.stdout:3/269: dwrite d8/ff [4194304,4194304] 0 2024-09-11T00:07:05.892 INFO:tasks.workunit.client.0.smithi111.stdout:2/142: chown d0/cb 0 1 2024-09-11T00:07:05.892 INFO:tasks.workunit.client.0.smithi111.stdout:9/162: dwrite d6/dc/f17 [0,4194304] 0 2024-09-11T00:07:05.894 INFO:tasks.workunit.client.1.smithi203.stdout:2/141: rename f7 to d13/d15/d19/f26 0 2024-09-11T00:07:05.895 INFO:tasks.workunit.client.1.smithi203.stdout:1/252: rename d8/d9/d15/d30 to d8/d9/d15/d30/d3e/d4b/d5a 22 2024-09-11T00:07:05.896 INFO:tasks.workunit.client.0.smithi111.stdout:9/163: truncate d6/dc/d13/f35 288538 0 2024-09-11T00:07:05.897 INFO:tasks.workunit.client.1.smithi203.stdout:2/142: dread d13/d15/f1f [0,4194304] 0 2024-09-11T00:07:05.898 INFO:tasks.workunit.client.0.smithi111.stdout:3/172: fsync f12 0 2024-09-11T00:07:05.900 INFO:tasks.workunit.client.1.smithi203.stdout:0/206: unlink d0/c17 0 2024-09-11T00:07:05.900 INFO:tasks.workunit.client.1.smithi203.stdout:2/143: dread d13/d15/f1f [0,4194304] 0 2024-09-11T00:07:05.902 INFO:tasks.workunit.client.0.smithi111.stdout:2/143: rmdir d0/d3/de 39 2024-09-11T00:07:05.905 INFO:tasks.workunit.client.0.smithi111.stdout:8/170: write d11/f20 [4255421,130579] 0 2024-09-11T00:07:05.914 INFO:tasks.workunit.client.0.smithi111.stdout:5/168: dwrite d10/d1e/d23/d26/f34 [0,4194304] 0 2024-09-11T00:07:05.915 INFO:tasks.workunit.client.0.smithi111.stdout:5/169: chown f5 270648655 1 2024-09-11T00:07:05.915 INFO:tasks.workunit.client.0.smithi111.stdout:8/171: unlink d11/c1f 0 2024-09-11T00:07:05.917 INFO:tasks.workunit.client.1.smithi203.stdout:3/270: unlink d8/d3c/l56 0 2024-09-11T00:07:05.918 INFO:tasks.workunit.client.0.smithi111.stdout:3/173: link f17 d1c/d1d/d22/d31/d33/f36 0 2024-09-11T00:07:05.920 INFO:tasks.workunit.client.1.smithi203.stdout:1/253: symlink d8/d9/d15/d30/d3e/d4b/l5b 0 2024-09-11T00:07:05.924 INFO:tasks.workunit.client.0.smithi111.stdout:1/136: rmdir d2 39 2024-09-11T00:07:05.925 INFO:tasks.workunit.client.1.smithi203.stdout:1/254: dread d8/d19/f26 [0,4194304] 0 2024-09-11T00:07:05.926 INFO:tasks.workunit.client.0.smithi111.stdout:8/172: dread d11/f1a [4194304,4194304] 0 2024-09-11T00:07:05.926 INFO:tasks.workunit.client.1.smithi203.stdout:6/169: creat d0/d2b/f2e x:0 0 0 2024-09-11T00:07:05.927 INFO:tasks.workunit.client.1.smithi203.stdout:1/255: chown d8/d11/f20 1441 1 2024-09-11T00:07:05.928 INFO:tasks.workunit.client.1.smithi203.stdout:1/256: dread - d8/d19/f57 zero size 2024-09-11T00:07:05.930 INFO:tasks.workunit.client.0.smithi111.stdout:2/144: rename d0/d3/d12/c23 to d0/d3/c30 0 2024-09-11T00:07:05.931 INFO:tasks.workunit.client.1.smithi203.stdout:2/144: rename f4 to d13/d15/d19/d1c/f27 0 2024-09-11T00:07:05.933 INFO:tasks.workunit.client.0.smithi111.stdout:0/143: dwrite d3/f6 [0,4194304] 0 2024-09-11T00:07:05.934 INFO:tasks.workunit.client.0.smithi111.stdout:0/144: fdatasync d3/d13/f17 0 2024-09-11T00:07:05.936 INFO:tasks.workunit.client.0.smithi111.stdout:6/112: rename d7/d1b to d7/d22 0 2024-09-11T00:07:05.942 INFO:tasks.workunit.client.1.smithi203.stdout:3/271: symlink d8/d17/l69 0 2024-09-11T00:07:05.942 INFO:tasks.workunit.client.0.smithi111.stdout:8/173: mknod d11/c30 0 2024-09-11T00:07:05.945 INFO:tasks.workunit.client.0.smithi111.stdout:3/174: mknod d1c/c37 0 2024-09-11T00:07:05.948 INFO:tasks.workunit.client.0.smithi111.stdout:4/115: rmdir d18 39 2024-09-11T00:07:05.950 INFO:tasks.workunit.client.0.smithi111.stdout:1/137: mkdir d2/d2b 0 2024-09-11T00:07:05.955 INFO:tasks.workunit.client.0.smithi111.stdout:0/145: mkdir d3/d13/d38 0 2024-09-11T00:07:05.960 INFO:tasks.workunit.client.0.smithi111.stdout:8/174: unlink d11/f1a 0 2024-09-11T00:07:05.966 INFO:tasks.workunit.client.0.smithi111.stdout:2/145: mknod d0/d3/c31 0 2024-09-11T00:07:05.968 INFO:tasks.workunit.client.1.smithi203.stdout:6/170: mknod d0/c2f 0 2024-09-11T00:07:05.969 INFO:tasks.workunit.client.0.smithi111.stdout:2/146: write d0/d3/f13 [8119386,60950] 0 2024-09-11T00:07:05.973 INFO:tasks.workunit.client.1.smithi203.stdout:5/212: truncate dc/dd/d15/f23 276071 0 2024-09-11T00:07:05.976 INFO:tasks.workunit.client.0.smithi111.stdout:6/113: fsync d7/f1f 0 2024-09-11T00:07:05.976 INFO:tasks.workunit.client.0.smithi111.stdout:5/170: truncate d10/d1e/d25/f29 2962327 0 2024-09-11T00:07:05.976 INFO:tasks.workunit.client.0.smithi111.stdout:6/114: fdatasync f0 0 2024-09-11T00:07:05.979 INFO:tasks.workunit.client.0.smithi111.stdout:3/175: mknod d1c/c38 0 2024-09-11T00:07:05.980 INFO:tasks.workunit.client.0.smithi111.stdout:3/176: dread - d1c/d1d/d22/d23/f28 zero size 2024-09-11T00:07:05.981 INFO:tasks.workunit.client.1.smithi203.stdout:4/173: dwrite f6 [0,4194304] 0 2024-09-11T00:07:05.981 INFO:tasks.workunit.client.1.smithi203.stdout:4/174: stat f2 0 2024-09-11T00:07:05.982 INFO:tasks.workunit.client.1.smithi203.stdout:3/272: dread d8/d2a/f40 [0,4194304] 0 2024-09-11T00:07:05.983 INFO:tasks.workunit.client.1.smithi203.stdout:4/175: chown db/l20 99102 1 2024-09-11T00:07:05.984 INFO:tasks.workunit.client.1.smithi203.stdout:3/273: stat d8/d17/f1c 0 2024-09-11T00:07:05.985 INFO:tasks.workunit.client.0.smithi111.stdout:7/149: sync 2024-09-11T00:07:05.985 INFO:tasks.workunit.client.0.smithi111.stdout:9/164: sync 2024-09-11T00:07:05.986 INFO:tasks.workunit.client.1.smithi203.stdout:6/171: dwrite d0/f14 [4194304,4194304] 0 2024-09-11T00:07:05.989 INFO:tasks.workunit.client.1.smithi203.stdout:0/207: getdents d0 0 2024-09-11T00:07:05.989 INFO:tasks.workunit.client.1.smithi203.stdout:1/257: creat d8/d9/f5c x:0 0 0 2024-09-11T00:07:05.991 INFO:tasks.workunit.client.1.smithi203.stdout:3/274: read d8/da/d34/f35 [382158,118452] 0 2024-09-11T00:07:05.992 INFO:tasks.workunit.client.0.smithi111.stdout:4/116: creat d18/d1f/f26 x:0 0 0 2024-09-11T00:07:05.995 INFO:tasks.workunit.client.1.smithi203.stdout:3/275: write d8/da/d11/f43 [4306515,114139] 0 2024-09-11T00:07:05.995 INFO:tasks.workunit.client.1.smithi203.stdout:5/213: mknod dc/c45 0 2024-09-11T00:07:06.009 INFO:tasks.workunit.client.0.smithi111.stdout:5/171: creat d10/d1e/d23/d26/f3e x:0 0 0 2024-09-11T00:07:06.011 INFO:tasks.workunit.client.0.smithi111.stdout:5/172: read - d10/d1e/d25/f2d zero size 2024-09-11T00:07:06.011 INFO:tasks.workunit.client.0.smithi111.stdout:7/150: fdatasync f6 0 2024-09-11T00:07:06.013 INFO:tasks.workunit.client.0.smithi111.stdout:4/117: mknod d18/c27 0 2024-09-11T00:07:06.014 INFO:tasks.workunit.client.0.smithi111.stdout:2/147: mknod d0/d3/c32 0 2024-09-11T00:07:06.015 INFO:tasks.workunit.client.0.smithi111.stdout:0/146: write f1 [308726,120667] 0 2024-09-11T00:07:06.017 INFO:tasks.workunit.client.0.smithi111.stdout:6/115: link d7/d22/d1d/f21 d7/f23 0 2024-09-11T00:07:06.018 INFO:tasks.workunit.client.0.smithi111.stdout:3/177: creat d1c/d1d/d22/d31/d33/f39 x:0 0 0 2024-09-11T00:07:06.019 INFO:tasks.workunit.client.0.smithi111.stdout:1/138: getdents d2 0 2024-09-11T00:07:06.020 INFO:tasks.workunit.client.0.smithi111.stdout:3/178: write d1c/d1d/d22/d23/f28 [308976,73088] 0 2024-09-11T00:07:06.022 INFO:tasks.workunit.client.0.smithi111.stdout:8/175: truncate d11/f1b 1448822 0 2024-09-11T00:07:06.022 INFO:tasks.workunit.client.0.smithi111.stdout:5/173: creat d10/d1e/d23/d2b/d2f/f3f x:0 0 0 2024-09-11T00:07:06.024 INFO:tasks.workunit.client.0.smithi111.stdout:6/116: creat d7/d22/d1d/f24 x:0 0 0 2024-09-11T00:07:06.024 INFO:tasks.workunit.client.0.smithi111.stdout:1/139: rmdir d2 39 2024-09-11T00:07:06.024 INFO:tasks.workunit.client.0.smithi111.stdout:9/165: link l1 d6/db/d1b/l36 0 2024-09-11T00:07:06.027 INFO:tasks.workunit.client.0.smithi111.stdout:2/148: mknod d0/c33 0 2024-09-11T00:07:06.030 INFO:tasks.workunit.client.0.smithi111.stdout:8/176: rename d11/f15 to d11/d21/f31 0 2024-09-11T00:07:06.034 INFO:tasks.workunit.client.0.smithi111.stdout:7/151: truncate f6 2597588 0 2024-09-11T00:07:06.040 INFO:tasks.workunit.client.0.smithi111.stdout:5/174: dread fd [0,4194304] 0 2024-09-11T00:07:06.040 INFO:tasks.workunit.client.0.smithi111.stdout:8/177: truncate d11/d23/f2f 478265 0 2024-09-11T00:07:06.042 INFO:tasks.workunit.client.0.smithi111.stdout:5/175: chown d10/f1b 7990 1 2024-09-11T00:07:06.042 INFO:tasks.workunit.client.0.smithi111.stdout:0/147: dwrite d3/dc/f1a [0,4194304] 0 2024-09-11T00:07:06.044 INFO:tasks.workunit.client.0.smithi111.stdout:9/166: rename d6/dc/d13 to d6/db/d34/d37 0 2024-09-11T00:07:06.048 INFO:tasks.workunit.client.0.smithi111.stdout:3/179: getdents d1c/d1d/d22/d23 0 2024-09-11T00:07:06.048 INFO:tasks.workunit.client.0.smithi111.stdout:2/149: mknod d0/d3/c34 0 2024-09-11T00:07:06.052 INFO:tasks.workunit.client.0.smithi111.stdout:8/178: write d11/f1d [5212237,24607] 0 2024-09-11T00:07:06.052 INFO:tasks.workunit.client.0.smithi111.stdout:6/117: rename d7/d22/l1c to d7/d22/l25 0 2024-09-11T00:07:06.053 INFO:tasks.workunit.client.0.smithi111.stdout:3/180: creat d1c/d21/f3a x:0 0 0 2024-09-11T00:07:06.054 INFO:tasks.workunit.client.1.smithi203.stdout:8/168: rename d1/d13/l2c to d1/d13/l3e 0 2024-09-11T00:07:06.055 INFO:tasks.workunit.client.0.smithi111.stdout:0/148: mknod d3/d13/d38/c39 0 2024-09-11T00:07:06.056 INFO:tasks.workunit.client.1.smithi203.stdout:1/258: symlink d8/d9/d15/d27/l5d 0 2024-09-11T00:07:06.056 INFO:tasks.workunit.client.1.smithi203.stdout:6/172: readlink d0/d27/l1d 0 2024-09-11T00:07:06.056 INFO:tasks.workunit.client.1.smithi203.stdout:0/208: dread d0/d2/f32 [0,4194304] 0 2024-09-11T00:07:06.056 INFO:tasks.workunit.client.0.smithi111.stdout:8/179: symlink d11/d23/l32 0 2024-09-11T00:07:06.057 INFO:tasks.workunit.client.1.smithi203.stdout:5/214: dread dc/dd/f28 [0,4194304] 0 2024-09-11T00:07:06.058 INFO:tasks.workunit.client.1.smithi203.stdout:1/259: stat d8/d9/d15/l3c 0 2024-09-11T00:07:06.059 INFO:tasks.workunit.client.1.smithi203.stdout:5/215: dread - dc/dd/d15/d3b/f40 zero size 2024-09-11T00:07:06.060 INFO:tasks.workunit.client.0.smithi111.stdout:3/181: write d1c/f24 [1067289,125126] 0 2024-09-11T00:07:06.061 INFO:tasks.workunit.client.1.smithi203.stdout:5/216: read - dc/dd/d13/f43 zero size 2024-09-11T00:07:06.062 INFO:tasks.workunit.client.0.smithi111.stdout:8/180: dread - d11/d21/f26 zero size 2024-09-11T00:07:06.063 INFO:tasks.workunit.client.1.smithi203.stdout:5/217: chown dc/dd/d15/f19 951752 1 2024-09-11T00:07:06.064 INFO:tasks.workunit.client.0.smithi111.stdout:5/176: creat d10/d1e/d23/d30/d3c/f40 x:0 0 0 2024-09-11T00:07:06.064 INFO:tasks.workunit.client.0.smithi111.stdout:4/118: dwrite f7 [0,4194304] 0 2024-09-11T00:07:06.066 INFO:tasks.workunit.client.1.smithi203.stdout:0/209: mknod d0/d2/d37/c43 0 2024-09-11T00:07:06.068 INFO:tasks.workunit.client.1.smithi203.stdout:1/260: rename d8/d9/d15/d30/f52 to d8/d9/d15/d30/f5e 0 2024-09-11T00:07:06.070 INFO:tasks.workunit.client.0.smithi111.stdout:2/150: link d0/d3/lf d0/d3/d2e/l35 0 2024-09-11T00:07:06.070 INFO:tasks.workunit.client.1.smithi203.stdout:6/173: mknod d0/c30 0 2024-09-11T00:07:06.079 INFO:tasks.workunit.client.1.smithi203.stdout:6/174: write d0/f21 [301798,63465] 0 2024-09-11T00:07:06.079 INFO:tasks.workunit.client.1.smithi203.stdout:2/145: dwrite d13/d15/f1a [0,4194304] 0 2024-09-11T00:07:06.080 INFO:tasks.workunit.client.0.smithi111.stdout:1/140: dwrite d2/de/d12/d13/f20 [0,4194304] 0 2024-09-11T00:07:06.081 INFO:tasks.workunit.client.0.smithi111.stdout:3/182: rename f19 to d1c/d21/f3b 0 2024-09-11T00:07:06.082 INFO:tasks.workunit.client.1.smithi203.stdout:1/261: mknod d8/d9/d15/d27/c5f 0 2024-09-11T00:07:06.082 INFO:tasks.workunit.client.1.smithi203.stdout:6/175: chown d0/d27/f18 1514001 1 2024-09-11T00:07:06.083 INFO:tasks.workunit.client.0.smithi111.stdout:4/119: fsync f8 0 2024-09-11T00:07:06.087 INFO:tasks.workunit.client.0.smithi111.stdout:0/149: dread f0 [0,4194304] 0 2024-09-11T00:07:06.087 INFO:tasks.workunit.client.0.smithi111.stdout:7/152: dwrite fa [0,4194304] 0 2024-09-11T00:07:06.089 INFO:tasks.workunit.client.1.smithi203.stdout:8/169: dread d1/d13/f1f [4194304,4194304] 0 2024-09-11T00:07:06.094 INFO:tasks.workunit.client.1.smithi203.stdout:3/276: dwrite d8/da/d37/f47 [0,4194304] 0 2024-09-11T00:07:06.094 INFO:tasks.workunit.client.0.smithi111.stdout:6/118: dwrite d7/d22/d1d/f24 [0,4194304] 0 2024-09-11T00:07:06.095 INFO:tasks.workunit.client.1.smithi203.stdout:2/146: rename f0 to d13/d15/d19/f28 0 2024-09-11T00:07:06.096 INFO:tasks.workunit.client.0.smithi111.stdout:9/167: dwrite d6/db/d34/d37/f29 [0,4194304] 0 2024-09-11T00:07:06.099 INFO:tasks.workunit.client.1.smithi203.stdout:1/262: mkdir d8/d19/d60 0 2024-09-11T00:07:06.102 INFO:tasks.workunit.client.0.smithi111.stdout:8/181: dread f8 [0,4194304] 0 2024-09-11T00:07:06.104 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:05 smithi203 ceph-mon[33225]: pgmap v322: 65 pgs: 65 active+clean; 515 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 727 KiB/s rd, 40 MiB/s wr, 158 op/s 2024-09-11T00:07:06.104 INFO:tasks.workunit.client.1.smithi203.stdout:1/263: chown d8/c23 47881 1 2024-09-11T00:07:06.109 INFO:tasks.workunit.client.0.smithi111.stdout:1/141: dread d2/de/f11 [4194304,4194304] 0 2024-09-11T00:07:06.109 INFO:tasks.workunit.client.1.smithi203.stdout:5/218: link dc/dd/d13/f3e dc/d2b/d3f/f46 0 2024-09-11T00:07:06.113 INFO:tasks.workunit.client.1.smithi203.stdout:5/219: write dc/dd/f3d [813931,48126] 0 2024-09-11T00:07:06.118 INFO:tasks.workunit.client.1.smithi203.stdout:8/170: creat d1/f3f x:0 0 0 2024-09-11T00:07:06.120 INFO:tasks.workunit.client.0.smithi111.stdout:4/120: truncate f5 3267430 0 2024-09-11T00:07:06.122 INFO:tasks.workunit.client.0.smithi111.stdout:4/121: chown d18/d20 423 1 2024-09-11T00:07:06.124 INFO:tasks.workunit.client.0.smithi111.stdout:4/122: chown d18/c22 1291 1 2024-09-11T00:07:06.125 INFO:tasks.workunit.client.1.smithi203.stdout:2/147: write d13/f14 [988177,39181] 0 2024-09-11T00:07:06.125 INFO:tasks.workunit.client.1.smithi203.stdout:3/277: mkdir d8/da/d11/d5e/d6a 0 2024-09-11T00:07:06.129 INFO:tasks.workunit.client.0.smithi111.stdout:0/150: creat d3/da/f3a x:0 0 0 2024-09-11T00:07:06.129 INFO:tasks.workunit.client.1.smithi203.stdout:0/210: dwrite d0/d2/f8 [0,4194304] 0 2024-09-11T00:07:06.132 INFO:tasks.workunit.client.0.smithi111.stdout:4/123: write f15 [294680,7672] 0 2024-09-11T00:07:06.133 INFO:tasks.workunit.client.0.smithi111.stdout:2/151: dread d0/d3/de/f1f [0,4194304] 0 2024-09-11T00:07:06.135 INFO:tasks.workunit.client.0.smithi111.stdout:9/168: dwrite d6/db/d34/d37/f2d [0,4194304] 0 2024-09-11T00:07:06.136 INFO:tasks.workunit.client.0.smithi111.stdout:2/152: chown d0/d3/de/f1f 240765485 1 2024-09-11T00:07:06.138 INFO:tasks.workunit.client.1.smithi203.stdout:6/176: link d0/d27/le d0/d2b/l31 0 2024-09-11T00:07:06.138 INFO:tasks.workunit.client.0.smithi111.stdout:8/182: dread d11/f12 [4194304,4194304] 0 2024-09-11T00:07:06.139 INFO:tasks.workunit.client.0.smithi111.stdout:7/153: creat dd/d1d/d1f/d24/f2f x:0 0 0 2024-09-11T00:07:06.139 INFO:tasks.workunit.client.1.smithi203.stdout:3/278: mkdir d8/da/d5c/d6b 0 2024-09-11T00:07:06.141 INFO:tasks.workunit.client.0.smithi111.stdout:7/154: read - dd/f2b zero size 2024-09-11T00:07:06.148 INFO:tasks.workunit.client.1.smithi203.stdout:5/220: link dc/dd/d15/f37 dc/dd/d15/d3b/f47 0 2024-09-11T00:07:06.148 INFO:tasks.workunit.client.1.smithi203.stdout:0/211: creat d0/d1d/f44 x:0 0 0 2024-09-11T00:07:06.149 INFO:tasks.workunit.client.1.smithi203.stdout:5/221: fsync dc/dd/d15/f2c 0 2024-09-11T00:07:06.150 INFO:tasks.workunit.client.1.smithi203.stdout:0/212: chown d0/l16 15 1 2024-09-11T00:07:06.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:05 smithi111 ceph-mon[27539]: pgmap v322: 65 pgs: 65 active+clean; 515 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 727 KiB/s rd, 40 MiB/s wr, 158 op/s 2024-09-11T00:07:06.154 INFO:tasks.workunit.client.0.smithi111.stdout:4/124: rmdir d18/d20 39 2024-09-11T00:07:06.155 INFO:tasks.workunit.client.1.smithi203.stdout:2/148: creat d13/d15/f29 x:0 0 0 2024-09-11T00:07:06.155 INFO:tasks.workunit.client.0.smithi111.stdout:5/177: dread d10/d1e/f21 [0,4194304] 0 2024-09-11T00:07:06.156 INFO:tasks.workunit.client.1.smithi203.stdout:1/264: dwrite d8/f49 [0,4194304] 0 2024-09-11T00:07:06.158 INFO:tasks.workunit.client.0.smithi111.stdout:5/178: chown d10/d1e/d25/c3d 874634 1 2024-09-11T00:07:06.159 INFO:tasks.workunit.client.0.smithi111.stdout:8/183: dwrite d11/f20 [0,4194304] 0 2024-09-11T00:07:06.161 INFO:tasks.workunit.client.1.smithi203.stdout:6/177: mkdir d0/d32 0 2024-09-11T00:07:06.169 INFO:tasks.workunit.client.0.smithi111.stdout:6/119: truncate d7/f15 424311 0 2024-09-11T00:07:06.171 INFO:tasks.workunit.client.1.smithi203.stdout:5/222: dwrite dc/dd/d13/f43 [0,4194304] 0 2024-09-11T00:07:06.176 INFO:tasks.workunit.client.1.smithi203.stdout:3/279: mkdir d8/da/d5c/d6b/d6c 0 2024-09-11T00:07:06.177 INFO:tasks.workunit.client.0.smithi111.stdout:5/179: dwrite d10/d1e/d23/d26/f34 [0,4194304] 0 2024-09-11T00:07:06.182 INFO:tasks.workunit.client.1.smithi203.stdout:0/213: symlink d0/d2/d3d/l45 0 2024-09-11T00:07:06.185 INFO:tasks.workunit.client.0.smithi111.stdout:8/184: rename d11/d23/f2f to d11/f33 0 2024-09-11T00:07:06.185 INFO:tasks.workunit.client.1.smithi203.stdout:2/149: link fd d13/d15/d19/d1c/f2a 0 2024-09-11T00:07:06.189 INFO:tasks.workunit.client.1.smithi203.stdout:5/223: read dc/dd/d15/f19 [824003,102974] 0 2024-09-11T00:07:06.189 INFO:tasks.workunit.client.0.smithi111.stdout:3/183: getdents d1c/d21 0 2024-09-11T00:07:06.191 INFO:tasks.workunit.client.1.smithi203.stdout:3/280: creat d8/da/d34/f6d x:0 0 0 2024-09-11T00:07:06.191 INFO:tasks.workunit.client.0.smithi111.stdout:0/151: dwrite d3/da/f1d [0,4194304] 0 2024-09-11T00:07:06.192 INFO:tasks.workunit.client.0.smithi111.stdout:3/184: read - d1c/d1d/d22/d31/d33/f39 zero size 2024-09-11T00:07:06.192 INFO:tasks.workunit.client.1.smithi203.stdout:6/178: symlink d0/d32/l33 0 2024-09-11T00:07:06.193 INFO:tasks.workunit.client.1.smithi203.stdout:3/281: stat d8/d17/f3b 0 2024-09-11T00:07:06.193 INFO:tasks.workunit.client.0.smithi111.stdout:3/185: read - d1c/d21/f2b zero size 2024-09-11T00:07:06.193 INFO:tasks.workunit.client.0.smithi111.stdout:4/125: symlink d18/l28 0 2024-09-11T00:07:06.195 INFO:tasks.workunit.client.1.smithi203.stdout:0/214: symlink d0/d1d/l46 0 2024-09-11T00:07:06.198 INFO:tasks.workunit.client.0.smithi111.stdout:9/169: creat d6/f38 x:0 0 0 2024-09-11T00:07:06.199 INFO:tasks.workunit.client.0.smithi111.stdout:9/170: read - d6/f38 zero size 2024-09-11T00:07:06.203 INFO:tasks.workunit.client.1.smithi203.stdout:5/224: fdatasync dc/dd/d15/f19 0 2024-09-11T00:07:06.204 INFO:tasks.workunit.client.0.smithi111.stdout:3/186: dread d1c/f24 [0,4194304] 0 2024-09-11T00:07:06.211 INFO:tasks.workunit.client.0.smithi111.stdout:2/153: creat d0/d3/f36 x:0 0 0 2024-09-11T00:07:06.211 INFO:tasks.workunit.client.0.smithi111.stdout:1/142: sync 2024-09-11T00:07:06.212 INFO:tasks.workunit.client.1.smithi203.stdout:1/265: getdents d8/d9/d15/d30/d3e/d4b/d3a 0 2024-09-11T00:07:06.212 INFO:tasks.workunit.client.0.smithi111.stdout:1/143: stat d2/de/d12/d13/f20 0 2024-09-11T00:07:06.213 INFO:tasks.workunit.client.0.smithi111.stdout:1/144: stat d2/de/d12/d13/f20 0 2024-09-11T00:07:06.214 INFO:tasks.workunit.client.1.smithi203.stdout:0/215: dwrite d0/d1d/f2e [0,4194304] 0 2024-09-11T00:07:06.215 INFO:tasks.workunit.client.0.smithi111.stdout:7/155: creat dd/f30 x:0 0 0 2024-09-11T00:07:06.216 INFO:tasks.workunit.client.1.smithi203.stdout:1/266: write d8/d9/d15/f22 [7887266,1988] 0 2024-09-11T00:07:06.222 INFO:tasks.workunit.client.1.smithi203.stdout:6/179: dwrite d0/d27/f19 [0,4194304] 0 2024-09-11T00:07:06.224 INFO:tasks.workunit.client.1.smithi203.stdout:5/225: rename dc/dd/d15/f1d to dc/dd/d13/f48 0 2024-09-11T00:07:06.227 INFO:tasks.workunit.client.1.smithi203.stdout:2/150: dwrite fd [0,4194304] 0 2024-09-11T00:07:06.227 INFO:tasks.workunit.client.1.smithi203.stdout:3/282: truncate d8/da/d5c/f64 469520 0 2024-09-11T00:07:06.229 INFO:tasks.workunit.client.1.smithi203.stdout:3/283: readlink d8/d17/l30 0 2024-09-11T00:07:06.230 INFO:tasks.workunit.client.1.smithi203.stdout:2/151: chown d13/d15/d19 793 1 2024-09-11T00:07:06.230 INFO:tasks.workunit.client.1.smithi203.stdout:0/216: rmdir d0 39 2024-09-11T00:07:06.233 INFO:tasks.workunit.client.0.smithi111.stdout:9/171: fdatasync d6/db/d1b/f22 0 2024-09-11T00:07:06.240 INFO:tasks.workunit.client.1.smithi203.stdout:6/180: creat d0/d32/f34 x:0 0 0 2024-09-11T00:07:06.240 INFO:tasks.workunit.client.1.smithi203.stdout:5/226: write dc/dd/d13/f48 [3008169,31169] 0 2024-09-11T00:07:06.243 INFO:tasks.workunit.client.1.smithi203.stdout:5/227: dread - dc/dd/d1e/f21 zero size 2024-09-11T00:07:06.244 INFO:tasks.workunit.client.0.smithi111.stdout:7/156: write f7 [2056800,39294] 0 2024-09-11T00:07:06.248 INFO:tasks.workunit.client.0.smithi111.stdout:4/126: dwrite f9 [0,4194304] 0 2024-09-11T00:07:06.248 INFO:tasks.workunit.client.0.smithi111.stdout:7/157: fsync fa 0 2024-09-11T00:07:06.250 INFO:tasks.workunit.client.0.smithi111.stdout:0/152: dwrite f0 [0,4194304] 0 2024-09-11T00:07:06.252 INFO:tasks.workunit.client.0.smithi111.stdout:8/185: link d11/l18 d11/d23/l34 0 2024-09-11T00:07:06.253 INFO:tasks.workunit.client.0.smithi111.stdout:8/186: fdatasync ff 0 2024-09-11T00:07:06.260 INFO:tasks.workunit.client.0.smithi111.stdout:5/180: dwrite d10/d1e/d25/f29 [0,4194304] 0 2024-09-11T00:07:06.261 INFO:tasks.workunit.client.1.smithi203.stdout:6/181: dwrite d0/f2d [0,4194304] 0 2024-09-11T00:07:06.262 INFO:tasks.workunit.client.0.smithi111.stdout:5/181: write f2 [5201454,86227] 0 2024-09-11T00:07:06.264 INFO:tasks.workunit.client.0.smithi111.stdout:5/182: readlink d10/d1e/l2e 0 2024-09-11T00:07:06.264 INFO:tasks.workunit.client.0.smithi111.stdout:1/145: write d2/de/f29 [5114164,2951] 0 2024-09-11T00:07:06.269 INFO:tasks.workunit.client.1.smithi203.stdout:5/228: mknod dc/d2b/d3f/c49 0 2024-09-11T00:07:06.272 INFO:tasks.workunit.client.1.smithi203.stdout:0/217: dwrite d0/f5 [4194304,4194304] 0 2024-09-11T00:07:06.273 INFO:tasks.workunit.client.0.smithi111.stdout:6/120: getdents d7/d22 0 2024-09-11T00:07:06.273 INFO:tasks.workunit.client.0.smithi111.stdout:2/154: dwrite d0/d3/de/f1e [0,4194304] 0 2024-09-11T00:07:06.275 INFO:tasks.workunit.client.0.smithi111.stdout:6/121: read f1 [1641204,85962] 0 2024-09-11T00:07:06.276 INFO:tasks.workunit.client.1.smithi203.stdout:3/284: link d8/d17/c28 d8/d2a/c6e 0 2024-09-11T00:07:06.279 INFO:tasks.workunit.client.1.smithi203.stdout:1/267: getdents d8 0 2024-09-11T00:07:06.281 INFO:tasks.workunit.client.0.smithi111.stdout:6/122: truncate d7/d22/d1d/f21 200917 0 2024-09-11T00:07:06.282 INFO:tasks.workunit.client.0.smithi111.stdout:6/123: fdatasync d7/f12 0 2024-09-11T00:07:06.287 INFO:tasks.workunit.client.0.smithi111.stdout:8/187: creat d11/f35 x:0 0 0 2024-09-11T00:07:06.287 INFO:tasks.workunit.client.1.smithi203.stdout:2/152: dwrite d13/f17 [0,4194304] 0 2024-09-11T00:07:06.292 INFO:tasks.workunit.client.0.smithi111.stdout:9/172: dwrite d6/db/f18 [0,4194304] 0 2024-09-11T00:07:06.295 INFO:tasks.workunit.client.0.smithi111.stdout:9/173: chown d6/db/f30 3612778 1 2024-09-11T00:07:06.298 INFO:tasks.workunit.client.0.smithi111.stdout:9/174: write d6/db/d34/d37/f19 [2999788,58751] 0 2024-09-11T00:07:06.300 INFO:tasks.workunit.client.0.smithi111.stdout:9/175: chown d6/db/d1b/f33 5410 1 2024-09-11T00:07:06.301 INFO:tasks.workunit.client.0.smithi111.stdout:9/176: dread - d6/f38 zero size 2024-09-11T00:07:06.303 INFO:tasks.workunit.client.1.smithi203.stdout:3/285: mknod d8/d3c/c6f 0 2024-09-11T00:07:06.305 INFO:tasks.workunit.client.0.smithi111.stdout:9/177: write d6/dc/f1f [3653401,6523] 0 2024-09-11T00:07:06.306 INFO:tasks.workunit.client.1.smithi203.stdout:1/268: creat d8/d9/d15/d30/f61 x:0 0 0 2024-09-11T00:07:06.306 INFO:tasks.workunit.client.1.smithi203.stdout:5/229: dread dc/dd/d15/f23 [0,4194304] 0 2024-09-11T00:07:06.308 INFO:tasks.workunit.client.0.smithi111.stdout:9/178: dread d6/db/d34/d37/f25 [0,4194304] 0 2024-09-11T00:07:06.309 INFO:tasks.workunit.client.0.smithi111.stdout:9/179: readlink d6/db/d1b/l1c 0 2024-09-11T00:07:06.313 INFO:tasks.workunit.client.1.smithi203.stdout:0/218: dwrite d0/d2/f13 [0,4194304] 0 2024-09-11T00:07:06.317 INFO:tasks.workunit.client.0.smithi111.stdout:6/124: mkdir d7/d22/d26 0 2024-09-11T00:07:06.318 INFO:tasks.workunit.client.1.smithi203.stdout:1/269: symlink d8/d9/d15/d30/d3e/d4b/d3a/l62 0 2024-09-11T00:07:06.318 INFO:tasks.workunit.client.1.smithi203.stdout:0/219: stat d0/c3a 0 2024-09-11T00:07:06.318 INFO:tasks.workunit.client.1.smithi203.stdout:6/182: getdents d0/d32 0 2024-09-11T00:07:06.319 INFO:tasks.workunit.client.0.smithi111.stdout:8/188: rename d11/l1c to d11/d23/l36 0 2024-09-11T00:07:06.320 INFO:tasks.workunit.client.0.smithi111.stdout:9/180: dread d6/dc/f17 [0,4194304] 0 2024-09-11T00:07:06.320 INFO:tasks.workunit.client.0.smithi111.stdout:3/187: getdents d1c/d1d/d22 0 2024-09-11T00:07:06.321 INFO:tasks.workunit.client.1.smithi203.stdout:6/183: dread - d0/d32/f34 zero size 2024-09-11T00:07:06.321 INFO:tasks.workunit.client.1.smithi203.stdout:0/220: stat d0/d2/fe 0 2024-09-11T00:07:06.323 INFO:tasks.workunit.client.1.smithi203.stdout:5/230: creat dc/dd/d1e/d41/f4a x:0 0 0 2024-09-11T00:07:06.323 INFO:tasks.workunit.client.0.smithi111.stdout:1/146: mkdir d2/d2b/d2c 0 2024-09-11T00:07:06.327 INFO:tasks.workunit.client.1.smithi203.stdout:1/270: dread d8/d9/d15/d30/d3e/d4b/d41/f4d [0,4194304] 0 2024-09-11T00:07:06.329 INFO:tasks.workunit.client.0.smithi111.stdout:4/127: creat d18/f29 x:0 0 0 2024-09-11T00:07:06.330 INFO:tasks.workunit.client.1.smithi203.stdout:3/286: getdents d8/d17 0 2024-09-11T00:07:06.330 INFO:tasks.workunit.client.0.smithi111.stdout:4/128: chown d18/c1e 307874 1 2024-09-11T00:07:06.332 INFO:tasks.workunit.client.0.smithi111.stdout:8/189: dread d11/f13 [0,4194304] 0 2024-09-11T00:07:06.333 INFO:tasks.workunit.client.0.smithi111.stdout:4/129: chown d18/d1f/f26 157328536 1 2024-09-11T00:07:06.334 INFO:tasks.workunit.client.0.smithi111.stdout:7/158: creat dd/f31 x:0 0 0 2024-09-11T00:07:06.339 INFO:tasks.workunit.client.1.smithi203.stdout:6/184: mkdir d0/d27/d35 0 2024-09-11T00:07:06.340 INFO:tasks.workunit.client.0.smithi111.stdout:9/181: dwrite d6/dc/f20 [0,4194304] 0 2024-09-11T00:07:06.340 INFO:tasks.workunit.client.1.smithi203.stdout:0/221: creat d0/d2/d37/f47 x:0 0 0 2024-09-11T00:07:06.340 INFO:tasks.workunit.client.0.smithi111.stdout:0/153: creat d3/f3b x:0 0 0 2024-09-11T00:07:06.341 INFO:tasks.workunit.client.0.smithi111.stdout:1/147: dwrite d2/f10 [0,4194304] 0 2024-09-11T00:07:06.344 INFO:tasks.workunit.client.0.smithi111.stdout:9/182: truncate d6/db/d34/d37/f19 4766692 0 2024-09-11T00:07:06.349 INFO:tasks.workunit.client.0.smithi111.stdout:3/188: symlink d1c/d1d/d22/d31/d33/l3c 0 2024-09-11T00:07:06.350 INFO:tasks.workunit.client.1.smithi203.stdout:6/185: mknod d0/d27/c36 0 2024-09-11T00:07:06.353 INFO:tasks.workunit.client.1.smithi203.stdout:1/271: dwrite d8/d9/d15/f47 [0,4194304] 0 2024-09-11T00:07:06.359 INFO:tasks.workunit.client.0.smithi111.stdout:2/155: truncate d0/d3/de/f1f 1749592 0 2024-09-11T00:07:06.362 INFO:tasks.workunit.client.0.smithi111.stdout:2/156: chown d0/cb 94377 1 2024-09-11T00:07:06.372 INFO:tasks.workunit.client.1.smithi203.stdout:3/287: dread d8/f2c [0,4194304] 0 2024-09-11T00:07:06.373 INFO:tasks.workunit.client.0.smithi111.stdout:3/189: dwrite d1c/d21/f3a [0,4194304] 0 2024-09-11T00:07:06.373 INFO:tasks.workunit.client.0.smithi111.stdout:7/159: rename dd/f15 to dd/d1d/d1f/d24/f32 0 2024-09-11T00:07:06.375 INFO:tasks.workunit.client.0.smithi111.stdout:0/154: creat d3/d13/f3c x:0 0 0 2024-09-11T00:07:06.375 INFO:tasks.workunit.client.0.smithi111.stdout:3/190: write f2 [734016,2591] 0 2024-09-11T00:07:06.375 INFO:tasks.workunit.client.0.smithi111.stdout:1/148: rmdir d2 39 2024-09-11T00:07:06.375 INFO:tasks.workunit.client.0.smithi111.stdout:7/160: dread - dd/f2b zero size 2024-09-11T00:07:06.377 INFO:tasks.workunit.client.0.smithi111.stdout:9/183: symlink d6/db/d34/l39 0 2024-09-11T00:07:06.379 INFO:tasks.workunit.client.0.smithi111.stdout:0/155: write d3/d1c/f23 [607711,119448] 0 2024-09-11T00:07:06.380 INFO:tasks.workunit.client.0.smithi111.stdout:5/183: link d10/d1e/d23/d2b/d2f/l39 d10/d1e/d23/d2b/d2f/l41 0 2024-09-11T00:07:06.380 INFO:tasks.workunit.client.1.smithi203.stdout:0/222: getdents d0/d2 0 2024-09-11T00:07:06.381 INFO:tasks.workunit.client.0.smithi111.stdout:7/161: chown dd/d1d/d1f/f23 452 1 2024-09-11T00:07:06.385 INFO:tasks.workunit.client.0.smithi111.stdout:0/156: dread - d3/da/f3a zero size 2024-09-11T00:07:06.385 INFO:tasks.workunit.client.0.smithi111.stdout:7/162: dread - dd/f31 zero size 2024-09-11T00:07:06.386 INFO:tasks.workunit.client.0.smithi111.stdout:7/163: chown dd/d1d/d1f 3958688 1 2024-09-11T00:07:06.387 INFO:tasks.workunit.client.1.smithi203.stdout:5/231: dwrite dc/dd/f28 [0,4194304] 0 2024-09-11T00:07:06.389 INFO:tasks.workunit.client.0.smithi111.stdout:7/164: write dd/ff [1419317,66931] 0 2024-09-11T00:07:06.389 INFO:tasks.workunit.client.0.smithi111.stdout:2/157: dwrite d0/d3/f13 [0,4194304] 0 2024-09-11T00:07:06.389 INFO:tasks.workunit.client.0.smithi111.stdout:8/190: mknod d11/d23/d2c/c37 0 2024-09-11T00:07:06.390 INFO:tasks.workunit.client.0.smithi111.stdout:4/130: write f8 [8470,120077] 0 2024-09-11T00:07:06.395 INFO:tasks.workunit.client.1.smithi203.stdout:1/272: dwrite d8/f1a [0,4194304] 0 2024-09-11T00:07:06.405 INFO:tasks.workunit.client.0.smithi111.stdout:8/191: dread d11/d23/f2a [0,4194304] 0 2024-09-11T00:07:06.407 INFO:tasks.workunit.client.1.smithi203.stdout:0/223: dread d0/f29 [0,4194304] 0 2024-09-11T00:07:06.409 INFO:tasks.workunit.client.0.smithi111.stdout:9/184: write d6/dc/f17 [1642412,104236] 0 2024-09-11T00:07:06.410 INFO:tasks.workunit.client.1.smithi203.stdout:0/224: chown d0/d2/d37 260081446 1 2024-09-11T00:07:06.410 INFO:tasks.workunit.client.0.smithi111.stdout:5/184: mknod d10/d1e/d23/c42 0 2024-09-11T00:07:06.411 INFO:tasks.workunit.client.0.smithi111.stdout:8/192: write f8 [4694472,130949] 0 2024-09-11T00:07:06.411 INFO:tasks.workunit.client.0.smithi111.stdout:6/125: creat d7/d22/d1d/f27 x:0 0 0 2024-09-11T00:07:06.413 INFO:tasks.workunit.client.0.smithi111.stdout:4/131: dwrite f7 [0,4194304] 0 2024-09-11T00:07:06.413 INFO:tasks.workunit.client.1.smithi203.stdout:3/288: dread d8/f3d [0,4194304] 0 2024-09-11T00:07:06.415 INFO:tasks.workunit.client.1.smithi203.stdout:5/232: creat dc/dd/d15/f4b x:0 0 0 2024-09-11T00:07:06.418 INFO:tasks.workunit.client.1.smithi203.stdout:3/289: chown d8/d17/l4e 639008066 1 2024-09-11T00:07:06.418 INFO:tasks.workunit.client.1.smithi203.stdout:0/225: mknod d0/d2/c48 0 2024-09-11T00:07:06.418 INFO:tasks.workunit.client.0.smithi111.stdout:9/185: chown d6/l27 12 1 2024-09-11T00:07:06.418 INFO:tasks.workunit.client.0.smithi111.stdout:2/158: dwrite d0/d3/de/f21 [0,4194304] 0 2024-09-11T00:07:06.418 INFO:tasks.workunit.client.0.smithi111.stdout:5/185: chown d10/d1e/f28 1084 1 2024-09-11T00:07:06.420 INFO:tasks.workunit.client.1.smithi203.stdout:1/273: creat d8/d9/f63 x:0 0 0 2024-09-11T00:07:06.423 INFO:tasks.workunit.client.0.smithi111.stdout:1/149: chown d2/de/d12/l27 3454 1 2024-09-11T00:07:06.424 INFO:tasks.workunit.client.0.smithi111.stdout:3/191: mknod d1c/d1d/d22/d23/d2f/c3d 0 2024-09-11T00:07:06.424 INFO:tasks.workunit.client.1.smithi203.stdout:5/233: creat dc/dd/d15/d3b/f4c x:0 0 0 2024-09-11T00:07:06.426 INFO:tasks.workunit.client.1.smithi203.stdout:0/226: chown d0/d2/d37/c42 0 1 2024-09-11T00:07:06.428 INFO:tasks.workunit.client.1.smithi203.stdout:1/274: unlink d8/d9/d15/d30/d3e/d4b/l5b 0 2024-09-11T00:07:06.429 INFO:tasks.workunit.client.0.smithi111.stdout:3/192: chown f5 3328144 1 2024-09-11T00:07:06.429 INFO:tasks.workunit.client.0.smithi111.stdout:5/186: dread d10/f1c [0,4194304] 0 2024-09-11T00:07:06.430 INFO:tasks.workunit.client.0.smithi111.stdout:4/132: rmdir d18/d1f 39 2024-09-11T00:07:06.430 INFO:tasks.workunit.client.1.smithi203.stdout:0/227: write d0/d2/d37/f47 [720448,113117] 0 2024-09-11T00:07:06.431 INFO:tasks.workunit.client.0.smithi111.stdout:5/187: readlink d10/l12 0 2024-09-11T00:07:06.433 INFO:tasks.workunit.client.1.smithi203.stdout:0/228: readlink d0/d2/la 0 2024-09-11T00:07:06.434 INFO:tasks.workunit.client.0.smithi111.stdout:9/186: symlink d6/db/d34/d37/l3a 0 2024-09-11T00:07:06.435 INFO:tasks.workunit.client.0.smithi111.stdout:7/165: creat dd/f33 x:0 0 0 2024-09-11T00:07:06.441 INFO:tasks.workunit.client.0.smithi111.stdout:5/188: mknod d10/d1e/d23/d30/d3c/c43 0 2024-09-11T00:07:06.442 INFO:tasks.workunit.client.1.smithi203.stdout:5/234: dwrite dc/dd/d15/d3b/f4c [0,4194304] 0 2024-09-11T00:07:06.444 INFO:tasks.workunit.client.0.smithi111.stdout:2/159: creat d0/d3/f37 x:0 0 0 2024-09-11T00:07:06.444 INFO:tasks.workunit.client.0.smithi111.stdout:4/133: mknod d18/c2a 0 2024-09-11T00:07:06.446 INFO:tasks.workunit.client.0.smithi111.stdout:7/166: rename dd/f30 to dd/d1d/d1f/d24/f34 0 2024-09-11T00:07:06.448 INFO:tasks.workunit.client.0.smithi111.stdout:1/150: dwrite d2/de/d12/d13/f20 [0,4194304] 0 2024-09-11T00:07:06.448 INFO:tasks.workunit.client.0.smithi111.stdout:2/160: dread - d0/d3/f37 zero size 2024-09-11T00:07:06.448 INFO:tasks.workunit.client.1.smithi203.stdout:1/275: dwrite d8/d9/d15/d27/f39 [0,4194304] 0 2024-09-11T00:07:06.451 INFO:tasks.workunit.client.0.smithi111.stdout:2/161: write d0/d3/f1c [22572,63447] 0 2024-09-11T00:07:06.452 INFO:tasks.workunit.client.1.smithi203.stdout:1/276: write d8/d19/f57 [598932,80150] 0 2024-09-11T00:07:06.453 INFO:tasks.workunit.client.0.smithi111.stdout:2/162: fdatasync d0/d3/f36 0 2024-09-11T00:07:06.453 INFO:tasks.workunit.client.0.smithi111.stdout:3/193: dread f1a [0,4194304] 0 2024-09-11T00:07:06.454 INFO:tasks.workunit.client.1.smithi203.stdout:9/176: sync 2024-09-11T00:07:06.454 INFO:tasks.workunit.client.1.smithi203.stdout:7/207: sync 2024-09-11T00:07:06.456 INFO:tasks.workunit.client.1.smithi203.stdout:1/277: chown d8/d9/d15/d30/d3e/d4b/d3a/l62 1594 1 2024-09-11T00:07:06.459 INFO:tasks.workunit.client.1.smithi203.stdout:0/229: dread d0/d2/f1a [0,4194304] 0 2024-09-11T00:07:06.460 INFO:tasks.workunit.client.1.smithi203.stdout:5/235: mkdir dc/dd/d4d 0 2024-09-11T00:07:06.462 INFO:tasks.workunit.client.1.smithi203.stdout:0/230: write d0/d2/f41 [1349778,21383] 0 2024-09-11T00:07:06.462 INFO:tasks.workunit.client.1.smithi203.stdout:5/236: dread - dc/dd/d15/d3b/f47 zero size 2024-09-11T00:07:06.463 INFO:tasks.workunit.client.0.smithi111.stdout:5/189: mkdir d10/d1e/d23/d30/d3c/d44 0 2024-09-11T00:07:06.466 INFO:tasks.workunit.client.0.smithi111.stdout:4/134: fsync d18/d1f/f25 0 2024-09-11T00:07:06.467 INFO:tasks.workunit.client.1.smithi203.stdout:9/177: mknod d6/de/d19/d30/c3d 0 2024-09-11T00:07:06.470 INFO:tasks.workunit.client.1.smithi203.stdout:3/290: write d8/da/d34/f39 [4681623,24285] 0 2024-09-11T00:07:06.472 INFO:tasks.workunit.client.0.smithi111.stdout:7/167: unlink c5 0 2024-09-11T00:07:06.472 INFO:tasks.workunit.client.0.smithi111.stdout:7/168: readlink dd/l11 0 2024-09-11T00:07:06.473 INFO:tasks.workunit.client.0.smithi111.stdout:0/157: truncate d3/da/ff 142426 0 2024-09-11T00:07:06.474 INFO:tasks.workunit.client.0.smithi111.stdout:0/158: chown d3/fd 475 1 2024-09-11T00:07:06.475 INFO:tasks.workunit.client.0.smithi111.stdout:6/126: link d7/d22/l25 d7/d22/l28 0 2024-09-11T00:07:06.478 INFO:tasks.workunit.client.0.smithi111.stdout:3/194: symlink d1c/d1d/d22/l3e 0 2024-09-11T00:07:06.479 INFO:tasks.workunit.client.0.smithi111.stdout:8/193: truncate d11/d21/f31 532140 0 2024-09-11T00:07:06.479 INFO:tasks.workunit.client.1.smithi203.stdout:0/231: rmdir d0/d2 39 2024-09-11T00:07:06.481 INFO:tasks.workunit.client.0.smithi111.stdout:9/187: creat d6/f3b x:0 0 0 2024-09-11T00:07:06.483 INFO:tasks.workunit.client.0.smithi111.stdout:2/163: mkdir d0/d3/d12/d38 0 2024-09-11T00:07:06.487 INFO:tasks.workunit.client.1.smithi203.stdout:9/178: unlink d6/de/d19/d13/f2a 0 2024-09-11T00:07:06.492 INFO:tasks.workunit.client.1.smithi203.stdout:3/291: unlink d8/c25 0 2024-09-11T00:07:06.494 INFO:tasks.workunit.client.1.smithi203.stdout:0/232: rmdir d0/d1d 39 2024-09-11T00:07:06.494 INFO:tasks.workunit.client.1.smithi203.stdout:1/278: dread d8/d9/d15/d30/f5e [0,4194304] 0 2024-09-11T00:07:06.496 INFO:tasks.workunit.client.0.smithi111.stdout:0/159: rename d3/da/l37 to d3/d1c/l3d 0 2024-09-11T00:07:06.498 INFO:tasks.workunit.client.0.smithi111.stdout:1/151: creat d2/d2b/d2c/f2d x:0 0 0 2024-09-11T00:07:06.507 INFO:tasks.workunit.client.0.smithi111.stdout:3/195: creat d1c/d1d/d22/d31/d33/f3f x:0 0 0 2024-09-11T00:07:06.508 INFO:tasks.workunit.client.0.smithi111.stdout:9/188: mknod d6/db/d34/d37/c3c 0 2024-09-11T00:07:06.510 INFO:tasks.workunit.client.0.smithi111.stdout:9/189: write d6/f3b [273511,58010] 0 2024-09-11T00:07:06.510 INFO:tasks.workunit.client.1.smithi203.stdout:3/292: truncate d8/da/d34/f4d 3133758 0 2024-09-11T00:07:06.510 INFO:tasks.workunit.client.1.smithi203.stdout:1/279: dwrite d8/d9/d15/f47 [0,4194304] 0 2024-09-11T00:07:06.511 INFO:tasks.workunit.client.1.smithi203.stdout:3/293: readlink d8/da/l20 0 2024-09-11T00:07:06.512 INFO:tasks.workunit.client.0.smithi111.stdout:2/164: unlink d0/d3/d12/c2a 0 2024-09-11T00:07:06.514 INFO:tasks.workunit.client.1.smithi203.stdout:3/294: read - d8/da/d11/d5e/d65/f66 zero size 2024-09-11T00:07:06.516 INFO:tasks.workunit.client.1.smithi203.stdout:7/208: dwrite dd/f1a [0,4194304] 0 2024-09-11T00:07:06.516 INFO:tasks.workunit.client.0.smithi111.stdout:5/190: creat d10/d1e/d23/d26/d3a/f45 x:0 0 0 2024-09-11T00:07:06.518 INFO:tasks.workunit.client.0.smithi111.stdout:4/135: mkdir d18/d2b 0 2024-09-11T00:07:06.520 INFO:tasks.workunit.client.1.smithi203.stdout:5/237: write dc/d2b/d3f/f46 [1898856,122805] 0 2024-09-11T00:07:06.521 INFO:tasks.workunit.client.0.smithi111.stdout:4/136: write d18/d1f/f24 [1008110,60097] 0 2024-09-11T00:07:06.521 INFO:tasks.workunit.client.1.smithi203.stdout:9/179: write d6/de/d19/d24/f2d [898503,102623] 0 2024-09-11T00:07:06.524 INFO:tasks.workunit.client.0.smithi111.stdout:0/160: creat d3/d13/d1e/d29/f3e x:0 0 0 2024-09-11T00:07:06.526 INFO:tasks.workunit.client.1.smithi203.stdout:5/238: dread dc/dd/d15/f23 [0,4194304] 0 2024-09-11T00:07:06.528 INFO:tasks.workunit.client.1.smithi203.stdout:5/239: read - dc/dd/d15/d3b/f47 zero size 2024-09-11T00:07:06.528 INFO:tasks.workunit.client.0.smithi111.stdout:1/152: write d2/de/d12/d13/f1d [1048298,122860] 0 2024-09-11T00:07:06.529 INFO:tasks.workunit.client.0.smithi111.stdout:6/127: getdents d7/d22/d26 0 2024-09-11T00:07:06.533 INFO:tasks.workunit.client.1.smithi203.stdout:3/295: mknod d8/da/d11/c70 0 2024-09-11T00:07:06.535 INFO:tasks.workunit.client.0.smithi111.stdout:3/196: rename f3 to d1c/d1d/d22/d23/f40 0 2024-09-11T00:07:06.535 INFO:tasks.workunit.client.0.smithi111.stdout:0/161: dread d3/dc/f1f [0,4194304] 0 2024-09-11T00:07:06.537 INFO:tasks.workunit.client.0.smithi111.stdout:3/197: chown ff 0 1 2024-09-11T00:07:06.537 INFO:tasks.workunit.client.0.smithi111.stdout:9/190: stat d6/dc/l23 0 2024-09-11T00:07:06.538 INFO:tasks.workunit.client.1.smithi203.stdout:9/180: creat d6/de/d19/f3e x:0 0 0 2024-09-11T00:07:06.539 INFO:tasks.workunit.client.0.smithi111.stdout:4/137: dwrite d18/d1f/f24 [0,4194304] 0 2024-09-11T00:07:06.541 INFO:tasks.workunit.client.1.smithi203.stdout:1/280: mkdir d8/d28/d64 0 2024-09-11T00:07:06.541 INFO:tasks.workunit.client.0.smithi111.stdout:9/191: write d6/db/d34/d37/f29 [1253544,118557] 0 2024-09-11T00:07:06.542 INFO:tasks.workunit.client.0.smithi111.stdout:5/191: mkdir d10/d1e/d23/d30/d46 0 2024-09-11T00:07:06.543 INFO:tasks.workunit.client.0.smithi111.stdout:5/192: fdatasync d10/f27 0 2024-09-11T00:07:06.544 INFO:tasks.workunit.client.0.smithi111.stdout:5/193: dread - d10/d1e/f28 zero size 2024-09-11T00:07:06.546 INFO:tasks.workunit.client.1.smithi203.stdout:7/209: mkdir dd/d4d 0 2024-09-11T00:07:06.546 INFO:tasks.workunit.client.0.smithi111.stdout:7/169: creat dd/f35 x:0 0 0 2024-09-11T00:07:06.548 INFO:tasks.workunit.client.0.smithi111.stdout:7/170: dread - dd/f1b zero size 2024-09-11T00:07:06.548 INFO:tasks.workunit.client.1.smithi203.stdout:5/240: symlink dc/dd/d15/l4e 0 2024-09-11T00:07:06.550 INFO:tasks.workunit.client.1.smithi203.stdout:7/210: fdatasync dd/d1c/f2d 0 2024-09-11T00:07:06.550 INFO:tasks.workunit.client.0.smithi111.stdout:1/153: creat d2/f2e x:0 0 0 2024-09-11T00:07:06.552 INFO:tasks.workunit.client.1.smithi203.stdout:5/241: dread - dc/dd/d15/f42 zero size 2024-09-11T00:07:06.552 INFO:tasks.workunit.client.1.smithi203.stdout:7/211: rename dd to dd/d1c/d26/d4e 22 2024-09-11T00:07:06.553 INFO:tasks.workunit.client.1.smithi203.stdout:0/233: write d0/d2/fd [1167860,46757] 0 2024-09-11T00:07:06.553 INFO:tasks.workunit.client.1.smithi203.stdout:3/296: dwrite d8/da/d11/f5d [0,4194304] 0 2024-09-11T00:07:06.554 INFO:tasks.workunit.client.0.smithi111.stdout:1/154: write d2/de/d12/d13/f20 [5119882,63279] 0 2024-09-11T00:07:06.555 INFO:tasks.workunit.client.1.smithi203.stdout:5/242: read - dc/dd/d1e/f21 zero size 2024-09-11T00:07:06.558 INFO:tasks.workunit.client.1.smithi203.stdout:1/281: truncate d8/d9/d15/d30/d3e/d4b/d41/f4d 1285274 0 2024-09-11T00:07:06.559 INFO:tasks.workunit.client.0.smithi111.stdout:2/165: write d0/d3/de/f11 [1188358,31879] 0 2024-09-11T00:07:06.560 INFO:tasks.workunit.client.0.smithi111.stdout:0/162: creat d3/dc/f3f x:0 0 0 2024-09-11T00:07:06.562 INFO:tasks.workunit.client.0.smithi111.stdout:4/138: dwrite d18/f29 [0,4194304] 0 2024-09-11T00:07:06.563 INFO:tasks.workunit.client.0.smithi111.stdout:8/194: dread d11/d21/f31 [0,4194304] 0 2024-09-11T00:07:06.563 INFO:tasks.workunit.client.0.smithi111.stdout:4/139: fdatasync f14 0 2024-09-11T00:07:06.564 INFO:tasks.workunit.client.1.smithi203.stdout:9/181: link d6/de/d19/d24/f36 d6/de/d19/d13/d29/f3f 0 2024-09-11T00:07:06.564 INFO:tasks.workunit.client.0.smithi111.stdout:4/140: fsync f7 0 2024-09-11T00:07:06.569 INFO:tasks.workunit.client.1.smithi203.stdout:3/297: rmdir d8/da/d11 39 2024-09-11T00:07:06.571 INFO:tasks.workunit.client.0.smithi111.stdout:9/192: creat d6/db/d34/f3d x:0 0 0 2024-09-11T00:07:06.571 INFO:tasks.workunit.client.1.smithi203.stdout:5/243: fsync dc/dd/d15/f37 0 2024-09-11T00:07:06.573 INFO:tasks.workunit.client.0.smithi111.stdout:3/198: dread d1c/d1d/d22/d31/d33/f36 [0,4194304] 0 2024-09-11T00:07:06.573 INFO:tasks.workunit.client.1.smithi203.stdout:5/244: write dc/dd/d13/f18 [1458517,122726] 0 2024-09-11T00:07:06.574 INFO:tasks.workunit.client.0.smithi111.stdout:7/171: unlink dd/d1d/f2a 0 2024-09-11T00:07:06.576 INFO:tasks.workunit.client.1.smithi203.stdout:7/212: rename dd/f11 to dd/d1c/d26/f4f 0 2024-09-11T00:07:06.577 INFO:tasks.workunit.client.1.smithi203.stdout:0/234: symlink d0/d1d/l49 0 2024-09-11T00:07:06.578 INFO:tasks.workunit.client.1.smithi203.stdout:3/298: symlink d8/d2a/l71 0 2024-09-11T00:07:06.580 INFO:tasks.workunit.client.0.smithi111.stdout:1/155: rename d2/de/d12/d13/f1d to d2/de/d12/f2f 0 2024-09-11T00:07:06.581 INFO:tasks.workunit.client.0.smithi111.stdout:3/199: dread d1c/d1d/f1e [0,4194304] 0 2024-09-11T00:07:06.581 INFO:tasks.workunit.client.0.smithi111.stdout:0/163: symlink d3/d13/l40 0 2024-09-11T00:07:06.582 INFO:tasks.workunit.client.1.smithi203.stdout:5/245: dread dc/dd/d1e/f27 [0,4194304] 0 2024-09-11T00:07:06.582 INFO:tasks.workunit.client.1.smithi203.stdout:1/282: creat d8/d28/d64/f65 x:0 0 0 2024-09-11T00:07:06.588 INFO:tasks.workunit.client.0.smithi111.stdout:3/200: dread d1c/d1d/d22/d23/f28 [0,4194304] 0 2024-09-11T00:07:06.589 INFO:tasks.workunit.client.1.smithi203.stdout:5/246: truncate dc/dd/f3d 1372739 0 2024-09-11T00:07:06.589 INFO:tasks.workunit.client.1.smithi203.stdout:7/213: creat dd/d1c/d26/d31/f50 x:0 0 0 2024-09-11T00:07:06.589 INFO:tasks.workunit.client.0.smithi111.stdout:8/195: mkdir d11/d21/d38 0 2024-09-11T00:07:06.589 INFO:tasks.workunit.client.1.smithi203.stdout:0/235: dread d0/d2/f41 [0,4194304] 0 2024-09-11T00:07:06.591 INFO:tasks.workunit.client.1.smithi203.stdout:3/299: truncate d8/d3c/f5a 394560 0 2024-09-11T00:07:06.592 INFO:tasks.workunit.client.1.smithi203.stdout:3/300: chown d8/d2a/l71 717536 1 2024-09-11T00:07:06.594 INFO:tasks.workunit.client.1.smithi203.stdout:1/283: mkdir d8/d9/d15/d30/d3e/d66 0 2024-09-11T00:07:06.598 INFO:tasks.workunit.client.0.smithi111.stdout:0/164: dwrite d3/dc/f12 [0,4194304] 0 2024-09-11T00:07:06.599 INFO:tasks.workunit.client.0.smithi111.stdout:7/172: mknod dd/d1d/d2d/c36 0 2024-09-11T00:07:06.601 INFO:tasks.workunit.client.0.smithi111.stdout:6/128: creat d7/d22/f29 x:0 0 0 2024-09-11T00:07:06.604 INFO:tasks.workunit.client.0.smithi111.stdout:3/201: dwrite d1c/f34 [0,4194304] 0 2024-09-11T00:07:06.607 INFO:tasks.workunit.client.1.smithi203.stdout:9/182: write d6/de/f22 [1331681,40852] 0 2024-09-11T00:07:06.608 INFO:tasks.workunit.client.1.smithi203.stdout:3/301: truncate d8/fb 1157269 0 2024-09-11T00:07:06.610 INFO:tasks.workunit.client.0.smithi111.stdout:4/141: dread f5 [0,4194304] 0 2024-09-11T00:07:06.612 INFO:tasks.workunit.client.0.smithi111.stdout:2/166: mkdir d0/d3/d39 0 2024-09-11T00:07:06.616 INFO:tasks.workunit.client.1.smithi203.stdout:0/236: link d0/d2/l1b d0/d2/d3d/l4a 0 2024-09-11T00:07:06.618 INFO:tasks.workunit.client.1.smithi203.stdout:0/237: truncate d0/f29 4432480 0 2024-09-11T00:07:06.622 INFO:tasks.workunit.client.0.smithi111.stdout:9/193: mknod d6/c3e 0 2024-09-11T00:07:06.623 INFO:tasks.workunit.client.1.smithi203.stdout:9/183: rmdir d6/de/d19/d13/d29 39 2024-09-11T00:07:06.624 INFO:tasks.workunit.client.0.smithi111.stdout:9/194: write d6/dc/f20 [3608181,126747] 0 2024-09-11T00:07:06.625 INFO:tasks.workunit.client.0.smithi111.stdout:5/194: rmdir d10/d1e/d23/d30/d3c/d44 0 2024-09-11T00:07:06.626 INFO:tasks.workunit.client.1.smithi203.stdout:0/238: creat d0/d2/d37/f4b x:0 0 0 2024-09-11T00:07:06.627 INFO:tasks.workunit.client.1.smithi203.stdout:0/239: chown d0 202197 1 2024-09-11T00:07:06.627 INFO:tasks.workunit.client.0.smithi111.stdout:9/195: dread d6/db/d34/d37/f25 [0,4194304] 0 2024-09-11T00:07:06.627 INFO:tasks.workunit.client.1.smithi203.stdout:1/284: write d8/d11/f20 [1543199,13059] 0 2024-09-11T00:07:06.634 INFO:tasks.workunit.client.1.smithi203.stdout:0/240: dread d0/d2/d37/f47 [0,4194304] 0 2024-09-11T00:07:06.640 INFO:tasks.workunit.client.1.smithi203.stdout:9/184: dwrite d6/de/d19/d24/f2d [0,4194304] 0 2024-09-11T00:07:06.647 INFO:tasks.workunit.client.1.smithi203.stdout:1/285: dwrite d8/d11/f20 [0,4194304] 0 2024-09-11T00:07:06.653 INFO:tasks.workunit.client.1.smithi203.stdout:0/241: mkdir d0/d1d/d4c 0 2024-09-11T00:07:06.655 INFO:tasks.workunit.client.1.smithi203.stdout:0/242: truncate d0/d2/f41 4210359 0 2024-09-11T00:07:06.659 INFO:tasks.workunit.client.1.smithi203.stdout:9/185: mkdir d6/de/d19/d24/d40 0 2024-09-11T00:07:06.662 INFO:tasks.workunit.client.1.smithi203.stdout:3/302: getdents d8/da/d11/d5e/d65 0 2024-09-11T00:07:06.663 INFO:tasks.workunit.client.1.smithi203.stdout:1/286: mknod d8/d9/d15/c67 0 2024-09-11T00:07:06.664 INFO:tasks.workunit.client.1.smithi203.stdout:0/243: symlink d0/d2/l4d 0 2024-09-11T00:07:06.665 INFO:tasks.workunit.client.1.smithi203.stdout:9/186: mkdir d6/de/d19/d24/d40/d41 0 2024-09-11T00:07:06.666 INFO:tasks.workunit.client.1.smithi203.stdout:1/287: creat d8/f68 x:0 0 0 2024-09-11T00:07:06.669 INFO:tasks.workunit.client.1.smithi203.stdout:9/187: creat d6/de/d19/d30/f42 x:0 0 0 2024-09-11T00:07:06.670 INFO:tasks.workunit.client.1.smithi203.stdout:3/303: link d8/da/d5c/f64 d8/da/d11/d5e/d6a/f72 0 2024-09-11T00:07:06.671 INFO:tasks.workunit.client.1.smithi203.stdout:1/288: symlink d8/d28/l69 0 2024-09-11T00:07:06.673 INFO:tasks.workunit.client.1.smithi203.stdout:4/176: sync 2024-09-11T00:07:06.673 INFO:tasks.workunit.client.1.smithi203.stdout:8/171: sync 2024-09-11T00:07:06.673 INFO:tasks.workunit.client.1.smithi203.stdout:2/153: sync 2024-09-11T00:07:06.673 INFO:tasks.workunit.client.1.smithi203.stdout:3/304: symlink d8/da/l73 0 2024-09-11T00:07:06.676 INFO:tasks.workunit.client.1.smithi203.stdout:9/188: rename d6/de/c17 to d6/de/d19/d21/c43 0 2024-09-11T00:07:06.678 INFO:tasks.workunit.client.1.smithi203.stdout:4/177: symlink db/l32 0 2024-09-11T00:07:06.681 INFO:tasks.workunit.client.1.smithi203.stdout:2/154: write d13/d15/d19/f28 [1896445,64609] 0 2024-09-11T00:07:06.682 INFO:tasks.workunit.client.1.smithi203.stdout:1/289: dread d8/d9/d15/d30/d3e/d4b/d41/f4d [0,4194304] 0 2024-09-11T00:07:06.685 INFO:tasks.workunit.client.1.smithi203.stdout:0/244: truncate d0/d2/f12 285981 0 2024-09-11T00:07:06.686 INFO:tasks.workunit.client.1.smithi203.stdout:8/172: mknod d1/d13/d22/c40 0 2024-09-11T00:07:06.689 INFO:tasks.workunit.client.1.smithi203.stdout:3/305: rename d8/da/d5c/f64 to d8/d17/f74 0 2024-09-11T00:07:06.689 INFO:tasks.workunit.client.1.smithi203.stdout:4/178: dread f2 [4194304,4194304] 0 2024-09-11T00:07:06.689 INFO:tasks.workunit.client.1.smithi203.stdout:1/290: mknod d8/c6a 0 2024-09-11T00:07:06.692 INFO:tasks.workunit.client.1.smithi203.stdout:8/173: mkdir d1/d13/d22/d41 0 2024-09-11T00:07:06.694 INFO:tasks.workunit.client.1.smithi203.stdout:9/189: dwrite d6/de/d19/d21/f25 [0,4194304] 0 2024-09-11T00:07:06.696 INFO:tasks.workunit.client.1.smithi203.stdout:2/155: rename d13/d22/l24 to d13/d15/d19/l2b 0 2024-09-11T00:07:06.697 INFO:tasks.workunit.client.1.smithi203.stdout:3/306: creat d8/da/d11/f75 x:0 0 0 2024-09-11T00:07:06.697 INFO:tasks.workunit.client.1.smithi203.stdout:2/156: chown f8 838826 1 2024-09-11T00:07:06.698 INFO:tasks.workunit.client.1.smithi203.stdout:1/291: mknod d8/d19/d31/c6b 0 2024-09-11T00:07:06.703 INFO:tasks.workunit.client.1.smithi203.stdout:0/245: link d0/d1d/c2f d0/d1d/c4e 0 2024-09-11T00:07:06.703 INFO:tasks.workunit.client.1.smithi203.stdout:4/179: truncate db/dd/f11 860971 0 2024-09-11T00:07:06.704 INFO:tasks.workunit.client.1.smithi203.stdout:0/246: chown d0/d2/d37/f3b 0 1 2024-09-11T00:07:06.707 INFO:tasks.workunit.client.1.smithi203.stdout:2/157: creat d13/d15/d19/f2c x:0 0 0 2024-09-11T00:07:06.710 INFO:tasks.workunit.client.1.smithi203.stdout:3/307: mknod d8/da/d11/d5e/c76 0 2024-09-11T00:07:06.710 INFO:tasks.workunit.client.1.smithi203.stdout:8/174: creat d1/d13/d17/f42 x:0 0 0 2024-09-11T00:07:06.711 INFO:tasks.workunit.client.0.smithi111.stdout:1/156: mknod d2/de/c30 0 2024-09-11T00:07:06.713 INFO:tasks.workunit.client.1.smithi203.stdout:0/247: symlink d0/d2/d3d/l4f 0 2024-09-11T00:07:06.714 INFO:tasks.workunit.client.0.smithi111.stdout:9/196: creat d6/db/d34/d37/f3f x:0 0 0 2024-09-11T00:07:06.714 INFO:tasks.workunit.client.0.smithi111.stdout:2/167: creat d0/d3/d12/f3a x:0 0 0 2024-09-11T00:07:06.715 INFO:tasks.workunit.client.0.smithi111.stdout:3/202: write d1c/d1d/f1f [490626,78207] 0 2024-09-11T00:07:06.715 INFO:tasks.workunit.client.1.smithi203.stdout:8/175: chown d1/d13/d22/d41 0 1 2024-09-11T00:07:06.716 INFO:tasks.workunit.client.0.smithi111.stdout:7/173: getdents dd/d1d/d2d/d2e 0 2024-09-11T00:07:06.718 INFO:tasks.workunit.client.0.smithi111.stdout:8/196: dwrite d11/f33 [0,4194304] 0 2024-09-11T00:07:06.721 INFO:tasks.workunit.client.0.smithi111.stdout:4/142: creat d18/d2b/f2c x:0 0 0 2024-09-11T00:07:06.722 INFO:tasks.workunit.client.0.smithi111.stdout:4/143: readlink d18/l28 0 2024-09-11T00:07:06.724 INFO:tasks.workunit.client.0.smithi111.stdout:4/144: truncate d18/d1f/f25 105042 0 2024-09-11T00:07:06.726 INFO:tasks.workunit.client.0.smithi111.stdout:5/195: mkdir d10/d1e/d23/d30/d46/d47 0 2024-09-11T00:07:06.726 INFO:tasks.workunit.client.0.smithi111.stdout:1/157: dread d2/de/f16 [0,4194304] 0 2024-09-11T00:07:06.727 INFO:tasks.workunit.client.1.smithi203.stdout:9/190: dwrite d6/de/d19/f1c [0,4194304] 0 2024-09-11T00:07:06.738 INFO:tasks.workunit.client.1.smithi203.stdout:0/248: rename d0/d1d/l46 to d0/d2/d3d/l50 0 2024-09-11T00:07:06.743 INFO:tasks.workunit.client.1.smithi203.stdout:0/249: write d0/d2/d37/f3b [178375,32937] 0 2024-09-11T00:07:06.743 INFO:tasks.workunit.client.1.smithi203.stdout:3/308: rename d8/da/d5c to d8/da/d5c/d6b/d6c/d77 22 2024-09-11T00:07:06.744 INFO:tasks.workunit.client.1.smithi203.stdout:4/180: fsync db/dd/f11 0 2024-09-11T00:07:06.747 INFO:tasks.workunit.client.0.smithi111.stdout:6/129: rename d7/l16 to d7/d22/l2a 0 2024-09-11T00:07:06.749 INFO:tasks.workunit.client.0.smithi111.stdout:7/174: unlink dd/f2b 0 2024-09-11T00:07:06.750 INFO:tasks.workunit.client.1.smithi203.stdout:8/176: dread d1/d13/d17/f26 [0,4194304] 0 2024-09-11T00:07:06.752 INFO:tasks.workunit.client.0.smithi111.stdout:3/203: fdatasync d1c/d1d/d22/d23/f28 0 2024-09-11T00:07:06.758 INFO:tasks.workunit.client.1.smithi203.stdout:0/250: creat d0/d2/f51 x:0 0 0 2024-09-11T00:07:06.760 INFO:tasks.workunit.client.0.smithi111.stdout:5/196: creat d10/d1e/d23/f48 x:0 0 0 2024-09-11T00:07:06.760 INFO:tasks.workunit.client.1.smithi203.stdout:1/292: dwrite d8/d9/d15/d30/d3e/d4b/d41/f4d [0,4194304] 0 2024-09-11T00:07:06.764 INFO:tasks.workunit.client.1.smithi203.stdout:1/293: truncate d8/d9/f1c 9540733 0 2024-09-11T00:07:06.765 INFO:tasks.workunit.client.1.smithi203.stdout:4/181: unlink db/f2b 0 2024-09-11T00:07:06.765 INFO:tasks.workunit.client.1.smithi203.stdout:1/294: dread - d8/d11/f51 zero size 2024-09-11T00:07:06.766 INFO:tasks.workunit.client.1.smithi203.stdout:8/177: dwrite d1/f8 [0,4194304] 0 2024-09-11T00:07:06.768 INFO:tasks.workunit.client.0.smithi111.stdout:6/130: mkdir d7/d2b 0 2024-09-11T00:07:06.770 INFO:tasks.workunit.client.1.smithi203.stdout:4/182: write db/dd/d26/f28 [264736,52517] 0 2024-09-11T00:07:06.770 INFO:tasks.workunit.client.1.smithi203.stdout:2/158: truncate d13/d15/d19/d1c/f27 608641 0 2024-09-11T00:07:06.770 INFO:tasks.workunit.client.1.smithi203.stdout:9/191: mkdir d6/de/d19/d24/d40/d41/d44 0 2024-09-11T00:07:06.772 INFO:tasks.workunit.client.0.smithi111.stdout:8/197: rename d11/c30 to d11/d23/d2c/c39 0 2024-09-11T00:07:06.775 INFO:tasks.workunit.client.1.smithi203.stdout:3/309: fdatasync d8/f2c 0 2024-09-11T00:07:06.777 INFO:tasks.workunit.client.1.smithi203.stdout:3/310: dread - d8/f59 zero size 2024-09-11T00:07:06.778 INFO:tasks.workunit.client.0.smithi111.stdout:3/204: creat d1c/d1d/f41 x:0 0 0 2024-09-11T00:07:06.779 INFO:tasks.workunit.client.1.smithi203.stdout:9/192: write d6/de/d19/d13/f39 [133658,110604] 0 2024-09-11T00:07:06.782 INFO:tasks.workunit.client.0.smithi111.stdout:4/145: dwrite d18/f1b [0,4194304] 0 2024-09-11T00:07:06.782 INFO:tasks.workunit.client.0.smithi111.stdout:5/197: symlink d10/d1e/d23/d30/l49 0 2024-09-11T00:07:06.785 INFO:tasks.workunit.client.1.smithi203.stdout:2/159: rename f2 to d13/d15/d19/d1c/f2d 0 2024-09-11T00:07:06.789 INFO:tasks.workunit.client.1.smithi203.stdout:2/160: fsync d13/d15/d19/d1c/f2a 0 2024-09-11T00:07:06.792 INFO:tasks.workunit.client.1.smithi203.stdout:4/183: truncate db/dd/d16/f24 3176304 0 2024-09-11T00:07:06.796 INFO:tasks.workunit.client.0.smithi111.stdout:8/198: write d11/f13 [1310181,77198] 0 2024-09-11T00:07:06.800 INFO:tasks.workunit.client.1.smithi203.stdout:9/193: unlink d6/de/d19/d30/c3d 0 2024-09-11T00:07:06.801 INFO:tasks.workunit.client.0.smithi111.stdout:0/165: sync 2024-09-11T00:07:06.803 INFO:tasks.workunit.client.1.smithi203.stdout:3/311: rename d8/ff to d8/d17/f78 0 2024-09-11T00:07:06.804 INFO:tasks.workunit.client.1.smithi203.stdout:9/194: truncate d6/de/d19/d30/f42 1027191 0 2024-09-11T00:07:06.806 INFO:tasks.workunit.client.1.smithi203.stdout:0/251: dwrite d0/d2/d37/f47 [0,4194304] 0 2024-09-11T00:07:06.806 INFO:tasks.workunit.client.1.smithi203.stdout:3/312: write d8/da/d34/f39 [1172327,15282] 0 2024-09-11T00:07:06.807 INFO:tasks.workunit.client.0.smithi111.stdout:9/197: truncate d6/db/d34/d37/f25 191904 0 2024-09-11T00:07:06.809 INFO:tasks.workunit.client.0.smithi111.stdout:3/205: creat d1c/d1d/f42 x:0 0 0 2024-09-11T00:07:06.811 INFO:tasks.workunit.client.1.smithi203.stdout:8/178: truncate d1/fe 7699706 0 2024-09-11T00:07:06.811 INFO:tasks.workunit.client.1.smithi203.stdout:3/313: write d8/da/d11/f75 [214416,15101] 0 2024-09-11T00:07:06.815 INFO:tasks.workunit.client.0.smithi111.stdout:7/175: truncate dd/f1a 667922 0 2024-09-11T00:07:06.815 INFO:tasks.workunit.client.0.smithi111.stdout:5/198: creat d10/d1e/d25/f4a x:0 0 0 2024-09-11T00:07:06.816 INFO:tasks.workunit.client.1.smithi203.stdout:2/161: symlink d13/d22/l2e 0 2024-09-11T00:07:06.818 INFO:tasks.workunit.client.0.smithi111.stdout:7/176: write dd/f1b [1033620,54151] 0 2024-09-11T00:07:06.820 INFO:tasks.workunit.client.1.smithi203.stdout:1/295: link d8/d9/d15/d27/l2f d8/d19/d31/l6c 0 2024-09-11T00:07:06.822 INFO:tasks.workunit.client.0.smithi111.stdout:6/131: mkdir d7/d22/d2c 0 2024-09-11T00:07:06.827 INFO:tasks.workunit.client.0.smithi111.stdout:0/166: mknod d3/da/c41 0 2024-09-11T00:07:06.829 INFO:tasks.workunit.client.0.smithi111.stdout:0/167: fdatasync d3/fd 0 2024-09-11T00:07:06.833 INFO:tasks.workunit.client.0.smithi111.stdout:4/146: link d18/d2b/f2c d18/d1f/f2d 0 2024-09-11T00:07:06.835 INFO:tasks.workunit.client.1.smithi203.stdout:6/186: sync 2024-09-11T00:07:06.836 INFO:tasks.workunit.client.0.smithi111.stdout:1/158: link d2/de/d12/c21 d2/de/c31 0 2024-09-11T00:07:06.836 INFO:tasks.workunit.client.0.smithi111.stdout:2/168: sync 2024-09-11T00:07:06.837 INFO:tasks.workunit.client.0.smithi111.stdout:5/199: dwrite d10/d1e/d23/f48 [0,4194304] 0 2024-09-11T00:07:06.840 INFO:tasks.workunit.client.0.smithi111.stdout:8/199: truncate d11/f1b 2250311 0 2024-09-11T00:07:06.840 INFO:tasks.workunit.client.0.smithi111.stdout:7/177: dwrite dd/f1b [0,4194304] 0 2024-09-11T00:07:06.847 INFO:tasks.workunit.client.0.smithi111.stdout:3/206: symlink d1c/l43 0 2024-09-11T00:07:06.850 INFO:tasks.workunit.client.1.smithi203.stdout:1/296: creat d8/f6d x:0 0 0 2024-09-11T00:07:06.851 INFO:tasks.workunit.client.0.smithi111.stdout:0/168: creat d3/d1c/f42 x:0 0 0 2024-09-11T00:07:06.851 INFO:tasks.workunit.client.0.smithi111.stdout:3/207: readlink l1b 0 2024-09-11T00:07:06.851 INFO:tasks.workunit.client.0.smithi111.stdout:4/147: creat d18/d1f/f2e x:0 0 0 2024-09-11T00:07:06.852 INFO:tasks.workunit.client.1.smithi203.stdout:8/179: mkdir d1/d13/d43 0 2024-09-11T00:07:06.852 INFO:tasks.workunit.client.1.smithi203.stdout:2/162: write d13/d15/d19/d1c/f2d [3025773,95433] 0 2024-09-11T00:07:06.853 INFO:tasks.workunit.client.1.smithi203.stdout:6/187: rmdir d0/d2b 39 2024-09-11T00:07:06.853 INFO:tasks.workunit.client.1.smithi203.stdout:1/297: dread - d8/f68 zero size 2024-09-11T00:07:06.854 INFO:tasks.workunit.client.0.smithi111.stdout:6/132: mkdir d7/d22/d2d 0 2024-09-11T00:07:06.856 INFO:tasks.workunit.client.0.smithi111.stdout:9/198: dwrite d6/db/d34/d37/f28 [0,4194304] 0 2024-09-11T00:07:06.856 INFO:tasks.workunit.client.1.smithi203.stdout:2/163: write d13/d15/d19/d1c/f2d [4649604,104859] 0 2024-09-11T00:07:06.859 INFO:tasks.workunit.client.1.smithi203.stdout:2/164: fsync d13/d15/f29 0 2024-09-11T00:07:06.861 INFO:tasks.workunit.client.0.smithi111.stdout:2/169: dwrite d0/d3/f13 [4194304,4194304] 0 2024-09-11T00:07:06.862 INFO:tasks.workunit.client.1.smithi203.stdout:2/165: fsync d13/d15/d19/d1c/f2a 0 2024-09-11T00:07:06.864 INFO:tasks.workunit.client.1.smithi203.stdout:2/166: write fd [4829113,100215] 0 2024-09-11T00:07:06.866 INFO:tasks.workunit.client.1.smithi203.stdout:0/252: creat d0/f52 x:0 0 0 2024-09-11T00:07:06.866 INFO:tasks.workunit.client.0.smithi111.stdout:8/200: readlink d11/l18 0 2024-09-11T00:07:06.876 INFO:tasks.workunit.client.0.smithi111.stdout:3/208: rmdir d1c 39 2024-09-11T00:07:06.878 INFO:tasks.workunit.client.0.smithi111.stdout:4/148: creat d18/d2b/f2f x:0 0 0 2024-09-11T00:07:06.878 INFO:tasks.workunit.client.0.smithi111.stdout:4/149: stat d18/c22 0 2024-09-11T00:07:06.879 INFO:tasks.workunit.client.1.smithi203.stdout:4/184: dwrite db/d12/d15/d2a/f22 [0,4194304] 0 2024-09-11T00:07:06.880 INFO:tasks.workunit.client.1.smithi203.stdout:1/298: dwrite d8/d9/d15/d30/f53 [0,4194304] 0 2024-09-11T00:07:06.881 INFO:tasks.workunit.client.0.smithi111.stdout:0/169: truncate d3/f7 2449800 0 2024-09-11T00:07:06.881 INFO:tasks.workunit.client.0.smithi111.stdout:9/199: mknod d6/db/c40 0 2024-09-11T00:07:06.883 INFO:tasks.workunit.client.1.smithi203.stdout:1/299: stat d8/d9/d15/c67 0 2024-09-11T00:07:06.886 INFO:tasks.workunit.client.1.smithi203.stdout:0/253: creat d0/d2/d37/f53 x:0 0 0 2024-09-11T00:07:06.887 INFO:tasks.workunit.client.1.smithi203.stdout:6/188: mknod d0/d2b/c37 0 2024-09-11T00:07:06.888 INFO:tasks.workunit.client.0.smithi111.stdout:2/170: rmdir d0/d3 39 2024-09-11T00:07:06.894 INFO:tasks.workunit.client.1.smithi203.stdout:4/185: mknod db/dd/d16/c33 0 2024-09-11T00:07:06.902 INFO:tasks.workunit.client.1.smithi203.stdout:3/314: link d8/d17/c28 d8/da/d5c/d6b/c79 0 2024-09-11T00:07:06.905 INFO:tasks.workunit.client.0.smithi111.stdout:6/133: mkdir d7/d22/d2e 0 2024-09-11T00:07:06.907 INFO:tasks.workunit.client.0.smithi111.stdout:5/200: truncate d10/d1e/d23/f48 4042794 0 2024-09-11T00:07:06.909 INFO:tasks.workunit.client.1.smithi203.stdout:8/180: getdents d1/d13/d22 0 2024-09-11T00:07:06.910 INFO:tasks.workunit.client.0.smithi111.stdout:7/178: write dd/f1a [1583203,92223] 0 2024-09-11T00:07:06.910 INFO:tasks.workunit.client.1.smithi203.stdout:8/181: write d1/f37 [59285,33309] 0 2024-09-11T00:07:06.913 INFO:tasks.workunit.client.0.smithi111.stdout:1/159: rename d2/de/d12/f2f to d2/de/f32 0 2024-09-11T00:07:06.917 INFO:tasks.workunit.client.1.smithi203.stdout:8/182: rmdir d1/d13/d17/d2f 39 2024-09-11T00:07:06.917 INFO:tasks.workunit.client.1.smithi203.stdout:4/186: dread db/d12/d15/d2a/f22 [0,4194304] 0 2024-09-11T00:07:06.919 INFO:tasks.workunit.client.1.smithi203.stdout:3/315: dwrite d8/da/d11/f43 [0,4194304] 0 2024-09-11T00:07:06.920 INFO:tasks.workunit.client.0.smithi111.stdout:3/209: mkdir d1c/d1d/d22/d44 0 2024-09-11T00:07:06.921 INFO:tasks.workunit.client.1.smithi203.stdout:3/316: chown d8/d2a/l33 125679987 1 2024-09-11T00:07:06.923 INFO:tasks.workunit.client.0.smithi111.stdout:4/150: creat d18/d20/f30 x:0 0 0 2024-09-11T00:07:06.923 INFO:tasks.workunit.client.1.smithi203.stdout:1/300: getdents d8/d9/d15/d30/d3e/d4b 0 2024-09-11T00:07:06.928 INFO:tasks.workunit.client.1.smithi203.stdout:3/317: symlink d8/da/d11/l7a 0 2024-09-11T00:07:06.930 INFO:tasks.workunit.client.0.smithi111.stdout:1/160: symlink d2/de/d12/l33 0 2024-09-11T00:07:06.931 INFO:tasks.workunit.client.0.smithi111.stdout:2/171: mkdir d0/d3/de/d3b 0 2024-09-11T00:07:06.931 INFO:tasks.workunit.client.0.smithi111.stdout:9/200: fdatasync d6/db/d34/d37/f19 0 2024-09-11T00:07:06.931 INFO:tasks.workunit.client.0.smithi111.stdout:3/210: mknod d1c/d21/c45 0 2024-09-11T00:07:06.937 INFO:tasks.workunit.client.1.smithi203.stdout:4/187: dwrite db/d12/d15/f2d [0,4194304] 0 2024-09-11T00:07:06.938 INFO:tasks.workunit.client.0.smithi111.stdout:3/211: mknod d1c/d1d/d22/c46 0 2024-09-11T00:07:06.940 INFO:tasks.workunit.client.0.smithi111.stdout:1/161: rename d2/de/d12/d13 to d2/de/d12/d34 0 2024-09-11T00:07:06.942 INFO:tasks.workunit.client.0.smithi111.stdout:4/151: rename d18/c27 to d18/c31 0 2024-09-11T00:07:06.946 INFO:tasks.workunit.client.0.smithi111.stdout:9/201: mkdir d6/db/d1b/d41 0 2024-09-11T00:07:06.949 INFO:tasks.workunit.client.0.smithi111.stdout:5/201: write d10/f1c [804176,32654] 0 2024-09-11T00:07:06.949 INFO:tasks.workunit.client.0.smithi111.stdout:2/172: dwrite d0/d3/f37 [0,4194304] 0 2024-09-11T00:07:06.950 INFO:tasks.workunit.client.0.smithi111.stdout:3/212: mknod d1c/d21/c47 0 2024-09-11T00:07:06.950 INFO:tasks.workunit.client.1.smithi203.stdout:3/318: dwrite d8/da/d5c/f61 [0,4194304] 0 2024-09-11T00:07:06.955 INFO:tasks.workunit.client.1.smithi203.stdout:8/183: dwrite d1/f11 [0,4194304] 0 2024-09-11T00:07:06.958 INFO:tasks.workunit.client.1.smithi203.stdout:8/184: truncate d1/f3b 656005 0 2024-09-11T00:07:06.969 INFO:tasks.workunit.client.0.smithi111.stdout:4/152: dwrite d18/d1f/f26 [0,4194304] 0 2024-09-11T00:07:06.973 INFO:tasks.workunit.client.0.smithi111.stdout:2/173: rename d0/d3/d12/c26 to d0/d3/d39/c3c 0 2024-09-11T00:07:06.973 INFO:tasks.workunit.client.1.smithi203.stdout:4/188: getdents db 0 2024-09-11T00:07:06.975 INFO:tasks.workunit.client.0.smithi111.stdout:9/202: creat d6/db/d1b/d41/f42 x:0 0 0 2024-09-11T00:07:06.979 INFO:tasks.workunit.client.0.smithi111.stdout:6/134: dwrite d7/f15 [0,4194304] 0 2024-09-11T00:07:06.980 INFO:tasks.workunit.client.0.smithi111.stdout:3/213: rename d1c/d1d/d22/d31/c32 to d1c/d1d/d22/d31/d33/c48 0 2024-09-11T00:07:06.981 INFO:tasks.workunit.client.0.smithi111.stdout:8/201: sync 2024-09-11T00:07:06.981 INFO:tasks.workunit.client.1.smithi203.stdout:8/185: rename d1/f20 to d1/d13/d3a/f44 0 2024-09-11T00:07:06.982 INFO:tasks.workunit.client.0.smithi111.stdout:9/203: chown d6/db/l2a 31305 1 2024-09-11T00:07:06.984 INFO:tasks.workunit.client.1.smithi203.stdout:3/319: truncate d8/da/f2f 2761532 0 2024-09-11T00:07:06.986 INFO:tasks.workunit.client.1.smithi203.stdout:8/186: symlink d1/d13/d3a/l45 0 2024-09-11T00:07:06.987 INFO:tasks.workunit.client.0.smithi111.stdout:3/214: truncate f10 59449 0 2024-09-11T00:07:06.993 INFO:tasks.workunit.client.1.smithi203.stdout:8/187: mkdir d1/d13/d43/d46 0 2024-09-11T00:07:06.996 INFO:tasks.workunit.client.1.smithi203.stdout:8/188: readlink d1/d13/l30 0 2024-09-11T00:07:06.997 INFO:tasks.workunit.client.0.smithi111.stdout:1/162: truncate d2/de/f32 3091164 0 2024-09-11T00:07:06.999 INFO:tasks.workunit.client.1.smithi203.stdout:4/189: dwrite db/d12/d15/d2a/f22 [0,4194304] 0 2024-09-11T00:07:07.000 INFO:tasks.workunit.client.0.smithi111.stdout:8/202: dread d11/f33 [0,4194304] 0 2024-09-11T00:07:07.001 INFO:tasks.workunit.client.1.smithi203.stdout:4/190: fdatasync db/dd/d26/f30 0 2024-09-11T00:07:07.001 INFO:tasks.workunit.client.0.smithi111.stdout:8/203: readlink d11/d23/l34 0 2024-09-11T00:07:07.004 INFO:tasks.workunit.client.0.smithi111.stdout:4/153: rename d18/d1f/f24 to d18/f32 0 2024-09-11T00:07:07.004 INFO:tasks.workunit.client.0.smithi111.stdout:0/170: dwrite d3/f7 [0,4194304] 0 2024-09-11T00:07:07.007 INFO:tasks.workunit.client.0.smithi111.stdout:3/215: dread f17 [0,4194304] 0 2024-09-11T00:07:07.007 INFO:tasks.workunit.client.0.smithi111.stdout:0/171: write d3/dc/f12 [2094037,53987] 0 2024-09-11T00:07:07.008 INFO:tasks.workunit.client.1.smithi203.stdout:8/189: symlink d1/d13/d3a/l47 0 2024-09-11T00:07:07.010 INFO:tasks.workunit.client.0.smithi111.stdout:9/204: creat d6/db/f43 x:0 0 0 2024-09-11T00:07:07.014 INFO:tasks.workunit.client.0.smithi111.stdout:1/163: symlink d2/l35 0 2024-09-11T00:07:07.022 INFO:tasks.workunit.client.0.smithi111.stdout:8/204: mknod d11/d21/c3a 0 2024-09-11T00:07:07.023 INFO:tasks.workunit.client.0.smithi111.stdout:2/174: truncate d0/d3/de/f11 905508 0 2024-09-11T00:07:07.023 INFO:tasks.workunit.client.0.smithi111.stdout:8/205: dread - d11/f35 zero size 2024-09-11T00:07:07.025 INFO:tasks.workunit.client.0.smithi111.stdout:8/206: write d11/f20 [5201088,41146] 0 2024-09-11T00:07:07.026 INFO:tasks.workunit.client.1.smithi203.stdout:4/191: creat db/d12/d15/d2a/f34 x:0 0 0 2024-09-11T00:07:07.027 INFO:tasks.workunit.client.0.smithi111.stdout:4/154: mkdir d18/d1f/d33 0 2024-09-11T00:07:07.029 INFO:tasks.workunit.client.0.smithi111.stdout:8/207: fsync d11/f20 0 2024-09-11T00:07:07.030 INFO:tasks.workunit.client.1.smithi203.stdout:3/320: dwrite d8/d17/f74 [0,4194304] 0 2024-09-11T00:07:07.032 INFO:tasks.workunit.client.0.smithi111.stdout:0/172: creat d3/dc/f43 x:0 0 0 2024-09-11T00:07:07.034 INFO:tasks.workunit.client.0.smithi111.stdout:3/216: symlink d1c/d1d/d22/d23/d2f/l49 0 2024-09-11T00:07:07.036 INFO:tasks.workunit.client.0.smithi111.stdout:7/179: sync 2024-09-11T00:07:07.037 INFO:tasks.workunit.client.0.smithi111.stdout:3/217: read d1c/d1d/d22/d31/d33/f36 [1940616,103111] 0 2024-09-11T00:07:07.037 INFO:tasks.workunit.client.0.smithi111.stdout:1/164: rmdir d2/d2b 39 2024-09-11T00:07:07.038 INFO:tasks.workunit.client.0.smithi111.stdout:6/135: link d7/l14 d7/d22/l2f 0 2024-09-11T00:07:07.040 INFO:tasks.workunit.client.0.smithi111.stdout:3/218: fdatasync d1c/d1d/d22/d31/d33/f39 0 2024-09-11T00:07:07.040 INFO:tasks.workunit.client.1.smithi203.stdout:3/321: creat d8/da/d5c/d6b/d6c/f7b x:0 0 0 2024-09-11T00:07:07.041 INFO:tasks.workunit.client.0.smithi111.stdout:2/175: fsync d0/f1a 0 2024-09-11T00:07:07.043 INFO:tasks.workunit.client.1.smithi203.stdout:8/190: dread d1/d13/d3a/f44 [0,4194304] 0 2024-09-11T00:07:07.046 INFO:tasks.workunit.client.1.smithi203.stdout:8/191: write d1/d13/d17/f1e [302268,65333] 0 2024-09-11T00:07:07.047 INFO:tasks.workunit.client.1.smithi203.stdout:3/322: creat d8/da/d11/d5e/d65/f7c x:0 0 0 2024-09-11T00:07:07.049 INFO:tasks.workunit.client.0.smithi111.stdout:8/208: creat d11/d23/d2c/f3b x:0 0 0 2024-09-11T00:07:07.049 INFO:tasks.workunit.client.1.smithi203.stdout:8/192: stat d1/d13/d3a/l47 0 2024-09-11T00:07:07.051 INFO:tasks.workunit.client.0.smithi111.stdout:9/205: mknod d6/c44 0 2024-09-11T00:07:07.052 INFO:tasks.workunit.client.0.smithi111.stdout:0/173: creat d3/d13/d1e/f44 x:0 0 0 2024-09-11T00:07:07.053 INFO:tasks.workunit.client.1.smithi203.stdout:3/323: rmdir d8/da/d37/d53/d63 39 2024-09-11T00:07:07.054 INFO:tasks.workunit.client.0.smithi111.stdout:9/206: dread - d6/db/d1b/d41/f42 zero size 2024-09-11T00:07:07.054 INFO:tasks.workunit.client.0.smithi111.stdout:0/174: chown d3/d1c/f42 158971 1 2024-09-11T00:07:07.055 INFO:tasks.workunit.client.1.smithi203.stdout:3/324: readlink d8/d2a/l71 0 2024-09-11T00:07:07.055 INFO:tasks.workunit.client.0.smithi111.stdout:0/175: chown d3/d13/f17 1480374899 1 2024-09-11T00:07:07.055 INFO:tasks.workunit.client.0.smithi111.stdout:9/207: chown d6/c12 74 1 2024-09-11T00:07:07.057 INFO:tasks.workunit.client.1.smithi203.stdout:3/325: write d8/da/d11/d5e/d65/f66 [621071,4986] 0 2024-09-11T00:07:07.058 INFO:tasks.workunit.client.1.smithi203.stdout:4/192: rename db/d12/d15/d2a/c25 to db/c35 0 2024-09-11T00:07:07.060 INFO:tasks.workunit.client.1.smithi203.stdout:3/326: write d8/f16 [639512,55682] 0 2024-09-11T00:07:07.060 INFO:tasks.workunit.client.1.smithi203.stdout:4/193: chown f1 0 1 2024-09-11T00:07:07.060 INFO:tasks.workunit.client.0.smithi111.stdout:1/165: mkdir d2/de/d12/d36 0 2024-09-11T00:07:07.060 INFO:tasks.workunit.client.0.smithi111.stdout:3/219: dread f12 [0,4194304] 0 2024-09-11T00:07:07.066 INFO:tasks.workunit.client.0.smithi111.stdout:2/176: creat d0/d3/d12/f3d x:0 0 0 2024-09-11T00:07:07.067 INFO:tasks.workunit.client.1.smithi203.stdout:4/194: unlink db/dd/d16/l18 0 2024-09-11T00:07:07.068 INFO:tasks.workunit.client.0.smithi111.stdout:2/177: chown d0/d3/de/f1e 129925159 1 2024-09-11T00:07:07.069 INFO:tasks.workunit.client.1.smithi203.stdout:8/193: write d1/f9 [2620913,97685] 0 2024-09-11T00:07:07.069 INFO:tasks.workunit.client.0.smithi111.stdout:4/155: dwrite d18/d1f/f2d [0,4194304] 0 2024-09-11T00:07:07.070 INFO:tasks.workunit.client.1.smithi203.stdout:3/327: dread d8/da/d5c/f61 [0,4194304] 0 2024-09-11T00:07:07.071 INFO:tasks.workunit.client.0.smithi111.stdout:8/209: creat d11/f3c x:0 0 0 2024-09-11T00:07:07.071 INFO:tasks.workunit.client.0.smithi111.stdout:5/202: sync 2024-09-11T00:07:07.071 INFO:tasks.workunit.client.0.smithi111.stdout:7/180: write dd/f18 [680711,71479] 0 2024-09-11T00:07:07.075 INFO:tasks.workunit.client.0.smithi111.stdout:0/176: rename d3/dc/f1a to d3/d13/d38/f45 0 2024-09-11T00:07:07.077 INFO:tasks.workunit.client.1.smithi203.stdout:8/194: unlink d1/d13/d17/f1e 0 2024-09-11T00:07:07.078 INFO:tasks.workunit.client.0.smithi111.stdout:6/136: getdents d7/d22/d2c 0 2024-09-11T00:07:07.079 INFO:tasks.workunit.client.1.smithi203.stdout:5/247: sync 2024-09-11T00:07:07.079 INFO:tasks.workunit.client.1.smithi203.stdout:7/214: sync 2024-09-11T00:07:07.080 INFO:tasks.workunit.client.0.smithi111.stdout:6/137: truncate d7/f23 352146 0 2024-09-11T00:07:07.081 INFO:tasks.workunit.client.1.smithi203.stdout:3/328: creat d8/da/d11/d5e/d6a/f7d x:0 0 0 2024-09-11T00:07:07.084 INFO:tasks.workunit.client.0.smithi111.stdout:4/156: creat d18/d20/f34 x:0 0 0 2024-09-11T00:07:07.085 INFO:tasks.workunit.client.1.smithi203.stdout:8/195: truncate d1/d13/d17/d2f/f32 1014897 0 2024-09-11T00:07:07.085 INFO:tasks.workunit.client.1.smithi203.stdout:8/196: read - d1/f3d zero size 2024-09-11T00:07:07.086 INFO:tasks.workunit.client.0.smithi111.stdout:8/210: write d11/f33 [719717,79458] 0 2024-09-11T00:07:07.086 INFO:tasks.workunit.client.0.smithi111.stdout:2/178: write d0/fc [1213952,117402] 0 2024-09-11T00:07:07.086 INFO:tasks.workunit.client.0.smithi111.stdout:4/157: chown d18/d1f 102615 1 2024-09-11T00:07:07.090 INFO:tasks.workunit.client.0.smithi111.stdout:3/220: dread f8 [0,4194304] 0 2024-09-11T00:07:07.093 INFO:tasks.workunit.client.1.smithi203.stdout:3/329: dread d8/d2a/f40 [0,4194304] 0 2024-09-11T00:07:07.095 INFO:tasks.workunit.client.1.smithi203.stdout:7/215: mkdir dd/d3b/d51 0 2024-09-11T00:07:07.096 INFO:tasks.workunit.client.0.smithi111.stdout:7/181: mknod dd/d1d/c37 0 2024-09-11T00:07:07.098 INFO:tasks.workunit.client.0.smithi111.stdout:7/182: chown dd/ff 84585 1 2024-09-11T00:07:07.098 INFO:tasks.workunit.client.1.smithi203.stdout:5/248: dwrite dc/dd/d1e/f21 [0,4194304] 0 2024-09-11T00:07:07.099 INFO:tasks.workunit.client.0.smithi111.stdout:9/208: dread d6/db/fd [0,4194304] 0 2024-09-11T00:07:07.101 INFO:tasks.workunit.client.0.smithi111.stdout:5/203: rmdir d10/d1e/d23/d2b/d2f 39 2024-09-11T00:07:07.103 INFO:tasks.workunit.client.0.smithi111.stdout:8/211: dwrite d11/f33 [0,4194304] 0 2024-09-11T00:07:07.104 INFO:tasks.workunit.client.1.smithi203.stdout:8/197: dwrite d1/d13/d17/d2f/f32 [0,4194304] 0 2024-09-11T00:07:07.105 INFO:tasks.workunit.client.1.smithi203.stdout:3/330: creat d8/d17/f7e x:0 0 0 2024-09-11T00:07:07.108 INFO:tasks.workunit.client.0.smithi111.stdout:1/166: rename d2/l5 to d2/de/d12/d34/l37 0 2024-09-11T00:07:07.109 INFO:tasks.workunit.client.0.smithi111.stdout:1/167: read - d2/f1f zero size 2024-09-11T00:07:07.109 INFO:tasks.workunit.client.1.smithi203.stdout:3/331: chown d8/da/d11/c42 832 1 2024-09-11T00:07:07.112 INFO:tasks.workunit.client.0.smithi111.stdout:0/177: symlink d3/d13/d38/l46 0 2024-09-11T00:07:07.113 INFO:tasks.workunit.client.0.smithi111.stdout:0/178: stat d3/dc/f1f 0 2024-09-11T00:07:07.116 INFO:tasks.workunit.client.0.smithi111.stdout:0/179: write d3/d1c/f23 [1629296,30479] 0 2024-09-11T00:07:07.119 INFO:tasks.workunit.client.1.smithi203.stdout:5/249: mkdir dc/d4f 0 2024-09-11T00:07:07.128 INFO:tasks.workunit.client.1.smithi203.stdout:3/332: mknod d8/da/d11/d5e/d65/c7f 0 2024-09-11T00:07:07.130 INFO:tasks.workunit.client.1.smithi203.stdout:8/198: dwrite d1/f3f [0,4194304] 0 2024-09-11T00:07:07.133 INFO:tasks.workunit.client.1.smithi203.stdout:7/216: rmdir dd/d3b/d51 0 2024-09-11T00:07:07.140 INFO:tasks.workunit.client.0.smithi111.stdout:3/221: dread d1c/f24 [0,4194304] 0 2024-09-11T00:07:07.141 INFO:tasks.workunit.client.1.smithi203.stdout:5/250: creat dc/d4f/f50 x:0 0 0 2024-09-11T00:07:07.141 INFO:tasks.workunit.client.0.smithi111.stdout:9/209: creat d6/db/d34/f45 x:0 0 0 2024-09-11T00:07:07.142 INFO:tasks.workunit.client.0.smithi111.stdout:3/222: readlink d1c/d1d/d22/d31/d33/l3c 0 2024-09-11T00:07:07.142 INFO:tasks.workunit.client.0.smithi111.stdout:9/210: readlink d6/l31 0 2024-09-11T00:07:07.144 INFO:tasks.workunit.client.0.smithi111.stdout:9/211: write d6/db/f43 [663957,29421] 0 2024-09-11T00:07:07.144 INFO:tasks.workunit.client.0.smithi111.stdout:5/204: creat d10/d1e/d23/d26/d3a/f4b x:0 0 0 2024-09-11T00:07:07.145 INFO:tasks.workunit.client.0.smithi111.stdout:5/205: readlink d10/d1e/d23/d2b/l31 0 2024-09-11T00:07:07.148 INFO:tasks.workunit.client.0.smithi111.stdout:8/212: mkdir d11/d23/d3d 0 2024-09-11T00:07:07.149 INFO:tasks.workunit.client.0.smithi111.stdout:1/168: fdatasync d2/de/f16 0 2024-09-11T00:07:07.151 INFO:tasks.workunit.client.1.smithi203.stdout:3/333: dwrite d8/da/f46 [0,4194304] 0 2024-09-11T00:07:07.153 INFO:tasks.workunit.client.0.smithi111.stdout:0/180: rmdir d3/dc 39 2024-09-11T00:07:07.153 INFO:tasks.workunit.client.0.smithi111.stdout:0/181: chown d3/d13 1 1 2024-09-11T00:07:07.153 INFO:tasks.workunit.client.1.smithi203.stdout:8/199: dwrite d1/f3b [0,4194304] 0 2024-09-11T00:07:07.157 INFO:tasks.workunit.client.0.smithi111.stdout:8/213: dread f8 [0,4194304] 0 2024-09-11T00:07:07.158 INFO:tasks.workunit.client.0.smithi111.stdout:4/158: symlink d18/d1f/d33/l35 0 2024-09-11T00:07:07.159 INFO:tasks.workunit.client.1.smithi203.stdout:5/251: write dc/dd/d15/f23 [180951,25131] 0 2024-09-11T00:07:07.160 INFO:tasks.workunit.client.0.smithi111.stdout:7/183: symlink dd/l38 0 2024-09-11T00:07:07.162 INFO:tasks.workunit.client.0.smithi111.stdout:6/138: truncate d7/d22/d1d/f24 581231 0 2024-09-11T00:07:07.163 INFO:tasks.workunit.client.1.smithi203.stdout:3/334: mkdir d8/da/d5c/d80 0 2024-09-11T00:07:07.167 INFO:tasks.workunit.client.1.smithi203.stdout:3/335: dread - d8/da/f44 zero size 2024-09-11T00:07:07.172 INFO:tasks.workunit.client.1.smithi203.stdout:7/217: dwrite dd/d1c/d26/d31/f45 [0,4194304] 0 2024-09-11T00:07:07.174 INFO:tasks.workunit.client.0.smithi111.stdout:0/182: mknod d3/d13/c47 0 2024-09-11T00:07:07.175 INFO:tasks.workunit.client.1.smithi203.stdout:3/336: chown d8/d17/f57 0 1 2024-09-11T00:07:07.178 INFO:tasks.workunit.client.0.smithi111.stdout:9/212: dread d6/db/f18 [0,4194304] 0 2024-09-11T00:07:07.178 INFO:tasks.workunit.client.1.smithi203.stdout:7/218: dread - dd/d1c/d26/d31/f36 zero size 2024-09-11T00:07:07.179 INFO:tasks.workunit.client.0.smithi111.stdout:2/179: creat d0/d3/f3e x:0 0 0 2024-09-11T00:07:07.179 INFO:tasks.workunit.client.0.smithi111.stdout:8/214: mknod d11/c3e 0 2024-09-11T00:07:07.183 INFO:tasks.workunit.client.1.smithi203.stdout:3/337: chown d8/da/c1b 265493151 1 2024-09-11T00:07:07.183 INFO:tasks.workunit.client.0.smithi111.stdout:4/159: mkdir d18/d1f/d36 0 2024-09-11T00:07:07.184 INFO:tasks.workunit.client.1.smithi203.stdout:8/200: dwrite d1/d13/d22/f29 [0,4194304] 0 2024-09-11T00:07:07.186 INFO:tasks.workunit.client.0.smithi111.stdout:9/213: read d6/db/d34/d37/f19 [488568,62902] 0 2024-09-11T00:07:07.186 INFO:tasks.workunit.client.0.smithi111.stdout:7/184: rmdir dd 39 2024-09-11T00:07:07.191 INFO:tasks.workunit.client.1.smithi203.stdout:7/219: mkdir dd/d1c/d52 0 2024-09-11T00:07:07.192 INFO:tasks.workunit.client.0.smithi111.stdout:6/139: rename d7/f1f to d7/f30 0 2024-09-11T00:07:07.194 INFO:tasks.workunit.client.1.smithi203.stdout:3/338: chown d8/d3c/l4c 7292 1 2024-09-11T00:07:07.196 INFO:tasks.workunit.client.0.smithi111.stdout:5/206: chown d10/d1e/d23/d2b/d2f/l41 31 1 2024-09-11T00:07:07.200 INFO:tasks.workunit.client.0.smithi111.stdout:5/207: dread - d10/f1b zero size 2024-09-11T00:07:07.200 INFO:tasks.workunit.client.1.smithi203.stdout:7/220: chown cb 938442 1 2024-09-11T00:07:07.200 INFO:tasks.workunit.client.0.smithi111.stdout:1/169: symlink d2/d2b/d2c/l38 0 2024-09-11T00:07:07.200 INFO:tasks.workunit.client.0.smithi111.stdout:5/208: chown d10/d1e/d23/d26/d3a/f45 450 1 2024-09-11T00:07:07.202 INFO:tasks.workunit.client.1.smithi203.stdout:8/201: mkdir d1/d13/d17/d48 0 2024-09-11T00:07:07.203 INFO:tasks.workunit.client.0.smithi111.stdout:8/215: mknod d11/c3f 0 2024-09-11T00:07:07.204 INFO:tasks.workunit.client.1.smithi203.stdout:8/202: read d1/f3b [69233,55291] 0 2024-09-11T00:07:07.204 INFO:tasks.workunit.client.1.smithi203.stdout:5/252: dread dc/dd/d13/f35 [0,4194304] 0 2024-09-11T00:07:07.204 INFO:tasks.workunit.client.1.smithi203.stdout:7/221: creat dd/d1c/d4b/f53 x:0 0 0 2024-09-11T00:07:07.206 INFO:tasks.workunit.client.1.smithi203.stdout:8/203: readlink d1/d13/l30 0 2024-09-11T00:07:07.206 INFO:tasks.workunit.client.0.smithi111.stdout:4/160: symlink d18/d1f/l37 0 2024-09-11T00:07:07.207 INFO:tasks.workunit.client.1.smithi203.stdout:7/222: write dd/d1c/f3a [4599548,4982] 0 2024-09-11T00:07:07.207 INFO:tasks.workunit.client.1.smithi203.stdout:5/253: chown dc/dd/d13/f35 34 1 2024-09-11T00:07:07.209 INFO:tasks.workunit.client.0.smithi111.stdout:9/214: mkdir d6/db/d1b/d41/d46 0 2024-09-11T00:07:07.211 INFO:tasks.workunit.client.1.smithi203.stdout:7/223: write dd/d1c/f46 [1519514,109094] 0 2024-09-11T00:07:07.211 INFO:tasks.workunit.client.1.smithi203.stdout:5/254: write dc/dd/d13/f3e [2492902,56991] 0 2024-09-11T00:07:07.212 INFO:tasks.workunit.client.0.smithi111.stdout:0/183: dread d3/dc/f12 [0,4194304] 0 2024-09-11T00:07:07.214 INFO:tasks.workunit.client.1.smithi203.stdout:3/339: dwrite d8/da/d11/d5e/d65/f66 [0,4194304] 0 2024-09-11T00:07:07.215 INFO:tasks.workunit.client.0.smithi111.stdout:6/140: fsync f3 0 2024-09-11T00:07:07.215 INFO:tasks.workunit.client.0.smithi111.stdout:0/184: read - d3/d13/d1e/d29/f36 zero size 2024-09-11T00:07:07.217 INFO:tasks.workunit.client.1.smithi203.stdout:3/340: stat d8/da/d11/d5e/d6a/f7d 0 2024-09-11T00:07:07.219 INFO:tasks.workunit.client.1.smithi203.stdout:8/204: mkdir d1/d13/d22/d41/d49 0 2024-09-11T00:07:07.220 INFO:tasks.workunit.client.0.smithi111.stdout:0/185: readlink d3/dc/l16 0 2024-09-11T00:07:07.220 INFO:tasks.workunit.client.1.smithi203.stdout:3/341: write d8/da/d11/d5e/d6a/f72 [4881127,105514] 0 2024-09-11T00:07:07.221 INFO:tasks.workunit.client.1.smithi203.stdout:7/224: mknod dd/d3b/c54 0 2024-09-11T00:07:07.222 INFO:tasks.workunit.client.0.smithi111.stdout:8/216: dwrite d11/d21/f31 [0,4194304] 0 2024-09-11T00:07:07.222 INFO:tasks.workunit.client.0.smithi111.stdout:0/186: chown d3/fd 23301 1 2024-09-11T00:07:07.225 INFO:tasks.workunit.client.1.smithi203.stdout:5/255: unlink dc/dd/d13/f1a 0 2024-09-11T00:07:07.228 INFO:tasks.workunit.client.0.smithi111.stdout:8/217: chown d11/d23/d2c/f3b 5755 1 2024-09-11T00:07:07.231 INFO:tasks.workunit.client.0.smithi111.stdout:2/180: rename d0/c6 to d0/d3/d39/c3f 0 2024-09-11T00:07:07.232 INFO:tasks.workunit.client.1.smithi203.stdout:8/205: stat d1/d13/d17/l2b 0 2024-09-11T00:07:07.234 INFO:tasks.workunit.client.0.smithi111.stdout:9/215: creat d6/db/d34/f47 x:0 0 0 2024-09-11T00:07:07.234 INFO:tasks.workunit.client.0.smithi111.stdout:7/185: dwrite dd/f33 [0,4194304] 0 2024-09-11T00:07:07.234 INFO:tasks.workunit.client.0.smithi111.stdout:4/161: dwrite d18/d20/f30 [0,4194304] 0 2024-09-11T00:07:07.235 INFO:tasks.workunit.client.0.smithi111.stdout:9/216: fdatasync d6/db/fd 0 2024-09-11T00:07:07.235 INFO:tasks.workunit.client.0.smithi111.stdout:3/223: getdents d1c/d1d/d22/d31 0 2024-09-11T00:07:07.239 INFO:tasks.workunit.client.0.smithi111.stdout:9/217: truncate d6/db/d1b/d41/f42 267778 0 2024-09-11T00:07:07.241 INFO:tasks.workunit.client.1.smithi203.stdout:7/225: dwrite dd/d1c/f29 [0,4194304] 0 2024-09-11T00:07:07.331 INFO:tasks.workunit.client.1.smithi203.stdout:3/342: symlink d8/da/d5c/d6b/l81 0 2024-09-11T00:07:07.335 INFO:tasks.workunit.client.1.smithi203.stdout:8/206: mknod d1/d13/d43/c4a 0 2024-09-11T00:07:07.336 INFO:tasks.workunit.client.1.smithi203.stdout:8/207: dread - d1/d13/d17/f38 zero size 2024-09-11T00:07:07.337 INFO:tasks.workunit.client.1.smithi203.stdout:8/208: readlink d1/l18 0 2024-09-11T00:07:07.338 INFO:tasks.workunit.client.1.smithi203.stdout:7/226: write dd/d1c/d26/f2c [256645,105207] 0 2024-09-11T00:07:07.340 INFO:tasks.workunit.client.1.smithi203.stdout:8/209: read d1/f9 [834138,12895] 0 2024-09-11T00:07:07.341 INFO:tasks.workunit.client.0.smithi111.stdout:5/209: link d10/d1e/d23/d26/f3e d10/d1e/d23/d26/f4c 0 2024-09-11T00:07:07.354 INFO:tasks.workunit.client.0.smithi111.stdout:2/181: chown d0/l24 2417148 1 2024-09-11T00:07:07.355 INFO:tasks.workunit.client.0.smithi111.stdout:4/162: chown cd 14845055 1 2024-09-11T00:07:07.359 INFO:tasks.workunit.client.0.smithi111.stdout:5/210: dwrite d10/d1e/d25/f2d [0,4194304] 0 2024-09-11T00:07:07.359 INFO:tasks.workunit.client.0.smithi111.stdout:6/141: dwrite d7/d22/d1d/f21 [0,4194304] 0 2024-09-11T00:07:07.360 INFO:tasks.workunit.client.0.smithi111.stdout:3/224: creat d1c/d1d/d22/d23/f4a x:0 0 0 2024-09-11T00:07:07.361 INFO:tasks.workunit.client.0.smithi111.stdout:3/225: chown f12 21429437 1 2024-09-11T00:07:07.361 INFO:tasks.workunit.client.1.smithi203.stdout:3/343: dwrite d8/da/d34/f35 [0,4194304] 0 2024-09-11T00:07:07.361 INFO:tasks.workunit.client.1.smithi203.stdout:7/227: getdents dd/d1c/d52 0 2024-09-11T00:07:07.362 INFO:tasks.workunit.client.0.smithi111.stdout:3/226: chown f8 11690593 1 2024-09-11T00:07:07.362 INFO:tasks.workunit.client.0.smithi111.stdout:9/218: creat d6/db/d34/d37/f48 x:0 0 0 2024-09-11T00:07:07.365 INFO:tasks.workunit.client.1.smithi203.stdout:3/344: dread d8/da/d11/f75 [0,4194304] 0 2024-09-11T00:07:07.368 INFO:tasks.workunit.client.0.smithi111.stdout:1/170: truncate d2/f9 4135991 0 2024-09-11T00:07:07.370 INFO:tasks.workunit.client.0.smithi111.stdout:1/171: stat d2/de/d12/d34/f1a 0 2024-09-11T00:07:07.371 INFO:tasks.workunit.client.1.smithi203.stdout:5/256: getdents dc/dd/d1e/d41 0 2024-09-11T00:07:07.382 INFO:tasks.workunit.client.1.smithi203.stdout:7/228: mknod dd/d1c/d26/c55 0 2024-09-11T00:07:07.382 INFO:tasks.workunit.client.1.smithi203.stdout:7/229: readlink dd/d1c/l42 0 2024-09-11T00:07:07.384 INFO:tasks.workunit.client.1.smithi203.stdout:8/210: dread d1/d13/f19 [0,4194304] 0 2024-09-11T00:07:07.384 INFO:tasks.workunit.client.0.smithi111.stdout:7/186: link dd/f10 dd/d1d/f39 0 2024-09-11T00:07:07.386 INFO:tasks.workunit.client.0.smithi111.stdout:7/187: fdatasync dd/f33 0 2024-09-11T00:07:07.389 INFO:tasks.workunit.client.0.smithi111.stdout:7/188: write dd/f18 [1608941,88206] 0 2024-09-11T00:07:07.396 INFO:tasks.workunit.client.0.smithi111.stdout:9/219: stat d6/db/d1b/c26 0 2024-09-11T00:07:07.398 INFO:tasks.workunit.client.0.smithi111.stdout:3/227: mknod d1c/d1d/d22/d23/c4b 0 2024-09-11T00:07:07.398 INFO:tasks.workunit.client.0.smithi111.stdout:3/228: readlink ld 0 2024-09-11T00:07:07.399 INFO:tasks.workunit.client.0.smithi111.stdout:3/229: chown fb 32124 1 2024-09-11T00:07:07.399 INFO:tasks.workunit.client.0.smithi111.stdout:1/172: mkdir d2/de/d12/d39 0 2024-09-11T00:07:07.399 INFO:tasks.workunit.client.1.smithi203.stdout:8/211: mknod d1/d13/d22/d41/d49/c4b 0 2024-09-11T00:07:07.400 INFO:tasks.workunit.client.0.smithi111.stdout:3/230: write d1c/d1d/f42 [562620,8151] 0 2024-09-11T00:07:07.401 INFO:tasks.workunit.client.0.smithi111.stdout:0/187: link d3/dc/l28 d3/d1c/l48 0 2024-09-11T00:07:07.402 INFO:tasks.workunit.client.1.smithi203.stdout:8/212: mkdir d1/d13/d3a/d4c 0 2024-09-11T00:07:07.404 INFO:tasks.workunit.client.0.smithi111.stdout:1/173: truncate d2/d2b/d2c/f2d 102060 0 2024-09-11T00:07:07.404 INFO:tasks.workunit.client.0.smithi111.stdout:8/218: link d11/c16 d11/c40 0 2024-09-11T00:07:07.408 INFO:tasks.workunit.client.1.smithi203.stdout:9/195: sync 2024-09-11T00:07:07.408 INFO:tasks.workunit.client.1.smithi203.stdout:8/213: unlink d1/f9 0 2024-09-11T00:07:07.409 INFO:tasks.workunit.client.0.smithi111.stdout:7/189: read f8 [1080170,4172] 0 2024-09-11T00:07:07.409 INFO:tasks.workunit.client.1.smithi203.stdout:9/196: fdatasync f5 0 2024-09-11T00:07:07.411 INFO:tasks.workunit.client.1.smithi203.stdout:5/257: dwrite dc/dd/d15/f19 [0,4194304] 0 2024-09-11T00:07:07.412 INFO:tasks.workunit.client.1.smithi203.stdout:3/345: dwrite d8/d3c/f5a [0,4194304] 0 2024-09-11T00:07:07.414 INFO:tasks.workunit.client.0.smithi111.stdout:7/190: read dd/f18 [1442465,27529] 0 2024-09-11T00:07:07.416 INFO:tasks.workunit.client.0.smithi111.stdout:2/182: write d0/d3/de/f1f [764286,101991] 0 2024-09-11T00:07:07.416 INFO:tasks.workunit.client.1.smithi203.stdout:9/197: rmdir d6/de 39 2024-09-11T00:07:07.417 INFO:tasks.workunit.client.0.smithi111.stdout:9/220: dwrite d6/dc/f17 [0,4194304] 0 2024-09-11T00:07:07.421 INFO:tasks.workunit.client.0.smithi111.stdout:0/188: dread d3/d1c/f23 [0,4194304] 0 2024-09-11T00:07:07.421 INFO:tasks.workunit.client.1.smithi203.stdout:5/258: mknod dc/dd/d1e/d41/c51 0 2024-09-11T00:07:07.424 INFO:tasks.workunit.client.0.smithi111.stdout:0/189: write d3/d1c/f23 [553103,79374] 0 2024-09-11T00:07:07.426 INFO:tasks.workunit.client.1.smithi203.stdout:8/214: symlink d1/d13/d3a/d4c/l4d 0 2024-09-11T00:07:07.431 INFO:tasks.workunit.client.1.smithi203.stdout:5/259: rmdir dc/dd/d15/d3b 39 2024-09-11T00:07:07.435 INFO:tasks.workunit.client.0.smithi111.stdout:6/142: rmdir d7/d22/d2e 0 2024-09-11T00:07:07.438 INFO:tasks.workunit.client.0.smithi111.stdout:6/143: fdatasync d7/d22/f29 0 2024-09-11T00:07:07.438 INFO:tasks.workunit.client.0.smithi111.stdout:4/163: getdents d18/d20 0 2024-09-11T00:07:07.440 INFO:tasks.workunit.client.1.smithi203.stdout:9/198: dread d6/de/d19/d24/f2d [0,4194304] 0 2024-09-11T00:07:07.440 INFO:tasks.workunit.client.0.smithi111.stdout:7/191: dwrite f7 [0,4194304] 0 2024-09-11T00:07:07.441 INFO:tasks.workunit.client.1.smithi203.stdout:5/260: symlink dc/dd/l52 0 2024-09-11T00:07:07.442 INFO:tasks.workunit.client.0.smithi111.stdout:7/192: write dd/f35 [195587,87593] 0 2024-09-11T00:07:07.444 INFO:tasks.workunit.client.0.smithi111.stdout:8/219: creat d11/d21/d38/f41 x:0 0 0 2024-09-11T00:07:07.445 INFO:tasks.workunit.client.0.smithi111.stdout:1/174: mkdir d2/de/d12/d39/d3a 0 2024-09-11T00:07:07.448 INFO:tasks.workunit.client.0.smithi111.stdout:0/190: rename d3/d2f to d3/d13/d1e/d29/d49 0 2024-09-11T00:07:07.450 INFO:tasks.workunit.client.0.smithi111.stdout:5/211: getdents d10 0 2024-09-11T00:07:07.450 INFO:tasks.workunit.client.1.smithi203.stdout:3/346: write d8/d17/f57 [920681,130531] 0 2024-09-11T00:07:07.454 INFO:tasks.workunit.client.0.smithi111.stdout:5/212: truncate d10/d1e/f28 280498 0 2024-09-11T00:07:07.458 INFO:tasks.workunit.client.0.smithi111.stdout:2/183: mknod d0/d3/d12/d38/c40 0 2024-09-11T00:07:07.459 INFO:tasks.workunit.client.1.smithi203.stdout:9/199: getdents d6/de/d19/d30 0 2024-09-11T00:07:07.460 INFO:tasks.workunit.client.0.smithi111.stdout:2/184: write d0/d3/d12/f3d [460850,121901] 0 2024-09-11T00:07:07.462 INFO:tasks.workunit.client.0.smithi111.stdout:6/144: creat d7/d22/d1d/f31 x:0 0 0 2024-09-11T00:07:07.462 INFO:tasks.workunit.client.0.smithi111.stdout:0/191: dread f2 [0,4194304] 0 2024-09-11T00:07:07.464 INFO:tasks.workunit.client.0.smithi111.stdout:7/193: unlink fc 0 2024-09-11T00:07:07.465 INFO:tasks.workunit.client.1.smithi203.stdout:8/215: fdatasync d1/f3d 0 2024-09-11T00:07:07.467 INFO:tasks.workunit.client.1.smithi203.stdout:5/261: truncate dc/dd/f28 38817 0 2024-09-11T00:07:07.469 INFO:tasks.workunit.client.1.smithi203.stdout:9/200: dread - d6/de/d19/d13/d29/f3f zero size 2024-09-11T00:07:07.471 INFO:tasks.workunit.client.0.smithi111.stdout:8/220: rename d11/f1e to d11/f42 0 2024-09-11T00:07:07.474 INFO:tasks.workunit.client.0.smithi111.stdout:5/213: fdatasync d10/d1e/d23/d26/f3e 0 2024-09-11T00:07:07.476 INFO:tasks.workunit.client.0.smithi111.stdout:4/164: creat d18/d1f/d36/f38 x:0 0 0 2024-09-11T00:07:07.480 INFO:tasks.workunit.client.1.smithi203.stdout:3/347: dread d8/f58 [0,4194304] 0 2024-09-11T00:07:07.480 INFO:tasks.workunit.client.1.smithi203.stdout:5/262: rmdir dc/dd 39 2024-09-11T00:07:07.483 INFO:tasks.workunit.client.0.smithi111.stdout:0/192: creat d3/d1c/f4a x:0 0 0 2024-09-11T00:07:07.488 INFO:tasks.workunit.client.0.smithi111.stdout:5/214: dwrite d10/f16 [0,4194304] 0 2024-09-11T00:07:07.489 INFO:tasks.workunit.client.1.smithi203.stdout:9/201: write d6/de/d19/d24/f2c [873408,122908] 0 2024-09-11T00:07:07.489 INFO:tasks.workunit.client.0.smithi111.stdout:5/215: chown d10/d1e/d23/d30 620 1 2024-09-11T00:07:07.494 INFO:tasks.workunit.client.1.smithi203.stdout:9/202: rmdir d6/de/d19/d30 39 2024-09-11T00:07:07.498 INFO:tasks.workunit.client.0.smithi111.stdout:2/185: unlink d0/d3/de/c2d 0 2024-09-11T00:07:07.499 INFO:tasks.workunit.client.0.smithi111.stdout:2/186: chown d0/d3/d2e 12615 1 2024-09-11T00:07:07.500 INFO:tasks.workunit.client.0.smithi111.stdout:6/145: unlink d7/d22/d1d/f24 0 2024-09-11T00:07:07.501 INFO:tasks.workunit.client.1.smithi203.stdout:5/263: getdents dc/d2b/d3f 0 2024-09-11T00:07:07.502 INFO:tasks.workunit.client.1.smithi203.stdout:3/348: dwrite d8/da/d11/f43 [4194304,4194304] 0 2024-09-11T00:07:07.502 INFO:tasks.workunit.client.1.smithi203.stdout:9/203: fsync d6/de/d19/d24/f36 0 2024-09-11T00:07:07.504 INFO:tasks.workunit.client.1.smithi203.stdout:3/349: readlink d8/d17/l4e 0 2024-09-11T00:07:07.505 INFO:tasks.workunit.client.1.smithi203.stdout:8/216: dwrite d1/d13/f33 [4194304,4194304] 0 2024-09-11T00:07:07.505 INFO:tasks.workunit.client.0.smithi111.stdout:0/193: rename d3/da/l33 to d3/d13/l4b 0 2024-09-11T00:07:07.505 INFO:tasks.workunit.client.0.smithi111.stdout:9/221: getdents d6/db 0 2024-09-11T00:07:07.507 INFO:tasks.workunit.client.0.smithi111.stdout:5/216: dwrite d10/f1a [0,4194304] 0 2024-09-11T00:07:07.507 INFO:tasks.workunit.client.0.smithi111.stdout:0/194: stat d3/d13/d1e/d29/f2a 0 2024-09-11T00:07:07.509 INFO:tasks.workunit.client.0.smithi111.stdout:8/221: creat d11/d23/d3d/f43 x:0 0 0 2024-09-11T00:07:07.511 INFO:tasks.workunit.client.0.smithi111.stdout:5/217: dread - d10/d1e/d23/d26/d3a/f4b zero size 2024-09-11T00:07:07.511 INFO:tasks.workunit.client.1.smithi203.stdout:9/204: fsync d6/f14 0 2024-09-11T00:07:07.512 INFO:tasks.workunit.client.0.smithi111.stdout:4/165: mkdir d18/d39 0 2024-09-11T00:07:07.514 INFO:tasks.workunit.client.1.smithi203.stdout:3/350: creat d8/da/d37/f82 x:0 0 0 2024-09-11T00:07:07.515 INFO:tasks.workunit.client.1.smithi203.stdout:9/205: write d6/de/d19/d21/f25 [3802569,57888] 0 2024-09-11T00:07:07.515 INFO:tasks.workunit.client.1.smithi203.stdout:4/195: sync 2024-09-11T00:07:07.516 INFO:tasks.workunit.client.1.smithi203.stdout:0/254: sync 2024-09-11T00:07:07.516 INFO:tasks.workunit.client.1.smithi203.stdout:2/167: sync 2024-09-11T00:07:07.516 INFO:tasks.workunit.client.1.smithi203.stdout:6/189: sync 2024-09-11T00:07:07.517 INFO:tasks.workunit.client.0.smithi111.stdout:6/146: unlink d7/f13 0 2024-09-11T00:07:07.517 INFO:tasks.workunit.client.1.smithi203.stdout:1/301: sync 2024-09-11T00:07:07.519 INFO:tasks.workunit.client.1.smithi203.stdout:6/190: chown d0/f2a 38877615 1 2024-09-11T00:07:07.524 INFO:tasks.workunit.client.0.smithi111.stdout:2/187: creat d0/d3/d12/f41 x:0 0 0 2024-09-11T00:07:07.526 INFO:tasks.workunit.client.0.smithi111.stdout:7/194: creat dd/f3a x:0 0 0 2024-09-11T00:07:07.528 INFO:tasks.workunit.client.0.smithi111.stdout:1/175: getdents d2/d2b/d2c 0 2024-09-11T00:07:07.529 INFO:tasks.workunit.client.0.smithi111.stdout:2/188: read d0/d3/de/f1f [217520,113126] 0 2024-09-11T00:07:07.529 INFO:tasks.workunit.client.0.smithi111.stdout:3/231: sync 2024-09-11T00:07:07.530 INFO:tasks.workunit.client.1.smithi203.stdout:5/264: fsync dc/dd/d13/f48 0 2024-09-11T00:07:07.531 INFO:tasks.workunit.client.1.smithi203.stdout:4/196: mknod db/d12/d15/c36 0 2024-09-11T00:07:07.533 INFO:tasks.workunit.client.1.smithi203.stdout:0/255: mknod d0/d2/c54 0 2024-09-11T00:07:07.533 INFO:tasks.workunit.client.0.smithi111.stdout:8/222: creat d11/d23/d3d/f44 x:0 0 0 2024-09-11T00:07:07.534 INFO:tasks.workunit.client.0.smithi111.stdout:8/223: fdatasync d11/f13 0 2024-09-11T00:07:07.534 INFO:tasks.workunit.client.1.smithi203.stdout:8/217: creat d1/d13/d43/d46/f4e x:0 0 0 2024-09-11T00:07:07.534 INFO:tasks.workunit.client.0.smithi111.stdout:4/166: rmdir d18/d1f/d36 39 2024-09-11T00:07:07.538 INFO:tasks.workunit.client.1.smithi203.stdout:8/218: readlink d1/d13/d22/l25 0 2024-09-11T00:07:07.538 INFO:tasks.workunit.client.1.smithi203.stdout:2/168: dwrite d13/d15/d19/f28 [0,4194304] 0 2024-09-11T00:07:07.541 INFO:tasks.workunit.client.1.smithi203.stdout:3/351: rename d8/da/d11/d5e to d8/da/d37/d83 0 2024-09-11T00:07:07.543 INFO:tasks.workunit.client.0.smithi111.stdout:6/147: mkdir d7/d32 0 2024-09-11T00:07:07.543 INFO:tasks.workunit.client.1.smithi203.stdout:6/191: unlink d0/c2f 0 2024-09-11T00:07:07.545 INFO:tasks.workunit.client.0.smithi111.stdout:7/195: unlink dd/l16 0 2024-09-11T00:07:07.547 INFO:tasks.workunit.client.1.smithi203.stdout:5/265: creat dc/dd/d1e/f53 x:0 0 0 2024-09-11T00:07:07.549 INFO:tasks.workunit.client.0.smithi111.stdout:3/232: creat d1c/d1d/d22/f4c x:0 0 0 2024-09-11T00:07:07.550 INFO:tasks.workunit.client.0.smithi111.stdout:0/195: dread d3/f6 [0,4194304] 0 2024-09-11T00:07:07.553 INFO:tasks.workunit.client.0.smithi111.stdout:0/196: chown d3/da/f1d 997 1 2024-09-11T00:07:07.553 INFO:tasks.workunit.client.1.smithi203.stdout:2/169: rmdir d13 39 2024-09-11T00:07:07.557 INFO:tasks.workunit.client.1.smithi203.stdout:9/206: rename d6/de/d19/d13 to d6/de/d19/d24/d40/d45 0 2024-09-11T00:07:07.559 INFO:tasks.workunit.client.0.smithi111.stdout:2/189: symlink d0/d3/d39/l42 0 2024-09-11T00:07:07.561 INFO:tasks.workunit.client.1.smithi203.stdout:6/192: rmdir d0/d32 39 2024-09-11T00:07:07.564 INFO:tasks.workunit.client.0.smithi111.stdout:8/224: rmdir d11/d23 39 2024-09-11T00:07:07.566 INFO:tasks.workunit.client.1.smithi203.stdout:7/230: sync 2024-09-11T00:07:07.568 INFO:tasks.workunit.client.0.smithi111.stdout:4/167: mknod d18/d1f/d33/c3a 0 2024-09-11T00:07:07.569 INFO:tasks.workunit.client.1.smithi203.stdout:4/197: dread db/dd/f2c [0,4194304] 0 2024-09-11T00:07:07.575 INFO:tasks.workunit.client.1.smithi203.stdout:3/352: dwrite d8/f58 [0,4194304] 0 2024-09-11T00:07:07.581 INFO:tasks.workunit.client.1.smithi203.stdout:6/193: rename d0/d2b to d0/d27/d35/d38 0 2024-09-11T00:07:07.585 INFO:tasks.workunit.client.0.smithi111.stdout:3/233: creat d1c/d1d/d22/f4d x:0 0 0 2024-09-11T00:07:07.587 INFO:tasks.workunit.client.1.smithi203.stdout:7/231: rmdir dd/d3b 39 2024-09-11T00:07:07.587 INFO:tasks.workunit.client.1.smithi203.stdout:1/302: truncate d8/d9/d15/d30/d3e/d4b/d41/f4d 2492925 0 2024-09-11T00:07:07.587 INFO:tasks.workunit.client.1.smithi203.stdout:4/198: rmdir db 39 2024-09-11T00:07:07.588 INFO:tasks.workunit.client.0.smithi111.stdout:0/197: symlink d3/d26/l4c 0 2024-09-11T00:07:07.588 INFO:tasks.workunit.client.1.smithi203.stdout:0/256: truncate d0/f15 39714 0 2024-09-11T00:07:07.588 INFO:tasks.workunit.client.0.smithi111.stdout:1/176: creat d2/de/d12/d39/d3a/f3b x:0 0 0 2024-09-11T00:07:07.590 INFO:tasks.workunit.client.0.smithi111.stdout:2/190: rename d0/d3/f1d to d0/d3/de/f43 0 2024-09-11T00:07:07.592 INFO:tasks.workunit.client.0.smithi111.stdout:8/225: rmdir d11/d21/d38 39 2024-09-11T00:07:07.592 INFO:tasks.workunit.client.1.smithi203.stdout:3/353: write d8/d2a/f40 [5191479,20125] 0 2024-09-11T00:07:07.593 INFO:tasks.workunit.client.0.smithi111.stdout:2/191: read d0/fc [167588,57473] 0 2024-09-11T00:07:07.596 INFO:tasks.workunit.client.1.smithi203.stdout:6/194: mkdir d0/d27/d35/d39 0 2024-09-11T00:07:07.596 INFO:tasks.workunit.client.0.smithi111.stdout:2/192: truncate d0/d3/d12/f41 171830 0 2024-09-11T00:07:07.598 INFO:tasks.workunit.client.1.smithi203.stdout:8/219: dread d1/fc [4194304,4194304] 0 2024-09-11T00:07:07.599 INFO:tasks.workunit.client.0.smithi111.stdout:9/222: getdents d6 0 2024-09-11T00:07:07.600 INFO:tasks.workunit.client.0.smithi111.stdout:9/223: fsync d6/db/d34/f3d 0 2024-09-11T00:07:07.605 INFO:tasks.workunit.client.1.smithi203.stdout:2/170: mknod d13/d15/c2f 0 2024-09-11T00:07:07.608 INFO:tasks.workunit.client.1.smithi203.stdout:2/171: stat d13/d15/f1b 0 2024-09-11T00:07:07.608 INFO:tasks.workunit.client.1.smithi203.stdout:7/232: dwrite dd/f12 [0,4194304] 0 2024-09-11T00:07:07.614 INFO:tasks.workunit.client.0.smithi111.stdout:2/193: dwrite d0/d3/d12/f41 [0,4194304] 0 2024-09-11T00:07:07.614 INFO:tasks.workunit.client.0.smithi111.stdout:2/194: readlink d0/d3/d12/l20 0 2024-09-11T00:07:07.616 INFO:tasks.workunit.client.1.smithi203.stdout:1/303: fdatasync d8/d19/d31/d36/f42 0 2024-09-11T00:07:07.616 INFO:tasks.workunit.client.1.smithi203.stdout:0/257: rename d0/l16 to d0/d2/l55 0 2024-09-11T00:07:07.616 INFO:tasks.workunit.client.1.smithi203.stdout:9/207: creat d6/f46 x:0 0 0 2024-09-11T00:07:07.616 INFO:tasks.workunit.client.1.smithi203.stdout:3/354: dwrite d8/d17/f57 [0,4194304] 0 2024-09-11T00:07:07.618 INFO:tasks.workunit.client.0.smithi111.stdout:7/196: truncate dd/ff 959865 0 2024-09-11T00:07:07.623 INFO:tasks.workunit.client.0.smithi111.stdout:5/218: getdents d10/d1e/d23/d26/d3a 0 2024-09-11T00:07:07.623 INFO:tasks.workunit.client.0.smithi111.stdout:6/148: truncate d7/f9 3661465 0 2024-09-11T00:07:07.626 INFO:tasks.workunit.client.0.smithi111.stdout:5/219: write d10/d1e/d23/d26/d3a/f4b [179901,67297] 0 2024-09-11T00:07:07.628 INFO:tasks.workunit.client.0.smithi111.stdout:3/234: creat d1c/d1d/d22/d44/f4e x:0 0 0 2024-09-11T00:07:07.631 INFO:tasks.workunit.client.0.smithi111.stdout:0/198: link d3/dc/f1f d3/d13/d1e/f4d 0 2024-09-11T00:07:07.632 INFO:tasks.workunit.client.0.smithi111.stdout:3/235: fsync d1c/d1d/d22/d31/d33/f39 0 2024-09-11T00:07:07.633 INFO:tasks.workunit.client.1.smithi203.stdout:0/258: symlink d0/d2/d3d/l56 0 2024-09-11T00:07:07.639 INFO:tasks.workunit.client.0.smithi111.stdout:4/168: truncate d18/d2b/f2c 108545 0 2024-09-11T00:07:07.640 INFO:tasks.workunit.client.0.smithi111.stdout:8/226: creat d11/d23/d2c/f45 x:0 0 0 2024-09-11T00:07:07.645 INFO:tasks.workunit.client.1.smithi203.stdout:3/355: rmdir d8/da/d5c/d6b 39 2024-09-11T00:07:07.646 INFO:tasks.workunit.client.1.smithi203.stdout:6/195: fdatasync d0/f13 0 2024-09-11T00:07:07.646 INFO:tasks.workunit.client.0.smithi111.stdout:9/224: link d6/db/d34/d37/f29 d6/db/f49 0 2024-09-11T00:07:07.649 INFO:tasks.workunit.client.1.smithi203.stdout:5/266: getdents dc/dd/d15/d3b 0 2024-09-11T00:07:07.649 INFO:tasks.workunit.client.0.smithi111.stdout:1/177: dread d2/f9 [0,4194304] 0 2024-09-11T00:07:07.649 INFO:tasks.workunit.client.0.smithi111.stdout:9/225: rename d6/db/d1b/d41/d46 to d6/db/d1b/d41/d46/d4a 22 2024-09-11T00:07:07.649 INFO:tasks.workunit.client.0.smithi111.stdout:0/199: unlink d3/dc/l18 0 2024-09-11T00:07:07.650 INFO:tasks.workunit.client.0.smithi111.stdout:0/200: stat d3/d1c 0 2024-09-11T00:07:07.652 INFO:tasks.workunit.client.1.smithi203.stdout:8/220: mknod d1/d13/d17/c4f 0 2024-09-11T00:07:07.653 INFO:tasks.workunit.client.0.smithi111.stdout:3/236: creat d1c/d21/f4f x:0 0 0 2024-09-11T00:07:07.654 INFO:tasks.workunit.client.1.smithi203.stdout:5/267: truncate dc/dd/d1e/f53 746966 0 2024-09-11T00:07:07.655 INFO:tasks.workunit.client.0.smithi111.stdout:2/195: link d0/d3/f37 d0/d3/de/f44 0 2024-09-11T00:07:07.655 INFO:tasks.workunit.client.1.smithi203.stdout:5/268: dread - dc/dd/d15/d3b/f47 zero size 2024-09-11T00:07:07.657 INFO:tasks.workunit.client.1.smithi203.stdout:1/304: creat d8/d9/d15/d30/d3e/d66/f6e x:0 0 0 2024-09-11T00:07:07.660 INFO:tasks.workunit.client.0.smithi111.stdout:5/220: dwrite fd [0,4194304] 0 2024-09-11T00:07:07.661 INFO:tasks.workunit.client.0.smithi111.stdout:5/221: chown fd 153628 1 2024-09-11T00:07:07.663 INFO:tasks.workunit.client.1.smithi203.stdout:9/208: mkdir d6/de/d47 0 2024-09-11T00:07:07.668 INFO:tasks.workunit.client.1.smithi203.stdout:6/196: dwrite d0/d27/f19 [0,4194304] 0 2024-09-11T00:07:07.670 INFO:tasks.workunit.client.0.smithi111.stdout:1/178: rmdir d2/d2b 39 2024-09-11T00:07:07.671 INFO:tasks.workunit.client.1.smithi203.stdout:4/199: write db/dd/d16/f24 [120684,23222] 0 2024-09-11T00:07:07.672 INFO:tasks.workunit.client.0.smithi111.stdout:9/226: creat d6/db/d1b/f4b x:0 0 0 2024-09-11T00:07:07.673 INFO:tasks.workunit.client.0.smithi111.stdout:1/179: write d2/de/d12/d34/f20 [2802340,103200] 0 2024-09-11T00:07:07.674 INFO:tasks.workunit.client.0.smithi111.stdout:1/180: fsync d2/f2e 0 2024-09-11T00:07:07.675 INFO:tasks.workunit.client.0.smithi111.stdout:7/197: dread dd/f1c [0,4194304] 0 2024-09-11T00:07:07.676 INFO:tasks.workunit.client.1.smithi203.stdout:3/356: write d8/da/d5c/f61 [1063786,7506] 0 2024-09-11T00:07:07.679 INFO:tasks.workunit.client.0.smithi111.stdout:0/201: unlink d3/d13/d1e/d29/f36 0 2024-09-11T00:07:07.682 INFO:tasks.workunit.client.0.smithi111.stdout:3/237: mknod d1c/d1d/c50 0 2024-09-11T00:07:07.684 INFO:tasks.workunit.client.0.smithi111.stdout:3/238: write d1c/d1d/d22/f4d [376778,112061] 0 2024-09-11T00:07:07.685 INFO:tasks.workunit.client.1.smithi203.stdout:5/269: dwrite dc/d4f/f50 [0,4194304] 0 2024-09-11T00:07:07.685 INFO:tasks.workunit.client.1.smithi203.stdout:2/172: dread d13/d15/f1b [0,4194304] 0 2024-09-11T00:07:07.691 INFO:tasks.workunit.client.1.smithi203.stdout:7/233: getdents dd/d1c/d26 0 2024-09-11T00:07:07.691 INFO:tasks.workunit.client.1.smithi203.stdout:1/305: dwrite d8/f1a [0,4194304] 0 2024-09-11T00:07:07.694 INFO:tasks.workunit.client.1.smithi203.stdout:7/234: chown dd/d1c/f46 16507634 1 2024-09-11T00:07:07.694 INFO:tasks.workunit.client.1.smithi203.stdout:1/306: chown d8/f68 4742776 1 2024-09-11T00:07:07.700 INFO:tasks.workunit.client.1.smithi203.stdout:3/357: creat d8/d17/f84 x:0 0 0 2024-09-11T00:07:07.701 INFO:tasks.workunit.client.0.smithi111.stdout:6/149: dwrite d7/ff [0,4194304] 0 2024-09-11T00:07:07.703 INFO:tasks.workunit.client.0.smithi111.stdout:5/222: rename d10/d1e/d23/c42 to d10/c4d 0 2024-09-11T00:07:07.704 INFO:tasks.workunit.client.1.smithi203.stdout:9/209: mknod d6/de/d47/c48 0 2024-09-11T00:07:07.706 INFO:tasks.workunit.client.0.smithi111.stdout:8/227: write d11/f1b [1097752,76535] 0 2024-09-11T00:07:07.708 INFO:tasks.workunit.client.1.smithi203.stdout:4/200: dwrite db/dd/d26/f30 [0,4194304] 0 2024-09-11T00:07:07.709 INFO:tasks.workunit.client.0.smithi111.stdout:6/150: write f0 [1878889,22849] 0 2024-09-11T00:07:07.713 INFO:tasks.workunit.client.1.smithi203.stdout:4/201: chown db/dd/l14 1 1 2024-09-11T00:07:07.716 INFO:tasks.workunit.client.0.smithi111.stdout:2/196: dwrite d0/f22 [4194304,4194304] 0 2024-09-11T00:07:07.716 INFO:tasks.workunit.client.1.smithi203.stdout:5/270: creat dc/dd/d1e/f54 x:0 0 0 2024-09-11T00:07:07.717 INFO:tasks.workunit.client.0.smithi111.stdout:9/227: dread d6/db/d1b/f1e [0,4194304] 0 2024-09-11T00:07:07.718 INFO:tasks.workunit.client.1.smithi203.stdout:4/202: chown db/dd/d16/f29 7184348 1 2024-09-11T00:07:07.719 INFO:tasks.workunit.client.1.smithi203.stdout:6/197: creat d0/d32/f3a x:0 0 0 2024-09-11T00:07:07.720 INFO:tasks.workunit.client.0.smithi111.stdout:0/202: creat d3/d13/d1e/d29/f4e x:0 0 0 2024-09-11T00:07:07.720 INFO:tasks.workunit.client.1.smithi203.stdout:8/221: creat d1/d13/d17/f50 x:0 0 0 2024-09-11T00:07:07.720 INFO:tasks.workunit.client.1.smithi203.stdout:7/235: mknod dd/d1c/d26/c56 0 2024-09-11T00:07:07.721 INFO:tasks.workunit.client.1.smithi203.stdout:4/203: readlink db/d12/d15/l1d 0 2024-09-11T00:07:07.723 INFO:tasks.workunit.client.1.smithi203.stdout:9/210: mknod d6/de/d19/d24/c49 0 2024-09-11T00:07:07.724 INFO:tasks.workunit.client.0.smithi111.stdout:5/223: rmdir d10 39 2024-09-11T00:07:07.726 INFO:tasks.workunit.client.1.smithi203.stdout:2/173: mkdir d13/d15/d30 0 2024-09-11T00:07:07.726 INFO:tasks.workunit.client.0.smithi111.stdout:8/228: mkdir d11/d23/d2c/d46 0 2024-09-11T00:07:07.733 INFO:tasks.workunit.client.1.smithi203.stdout:6/198: creat d0/d27/f3b x:0 0 0 2024-09-11T00:07:07.733 INFO:tasks.workunit.client.1.smithi203.stdout:7/236: creat dd/d1c/f57 x:0 0 0 2024-09-11T00:07:07.735 INFO:tasks.workunit.client.1.smithi203.stdout:4/204: creat db/d12/f37 x:0 0 0 2024-09-11T00:07:07.735 INFO:tasks.workunit.client.1.smithi203.stdout:3/358: dwrite d8/d17/f1c [0,4194304] 0 2024-09-11T00:07:07.736 INFO:tasks.workunit.client.1.smithi203.stdout:2/174: write d13/d15/f25 [168408,49284] 0 2024-09-11T00:07:07.737 INFO:tasks.workunit.client.0.smithi111.stdout:9/228: mkdir d6/db/d34/d37/d4c 0 2024-09-11T00:07:07.738 INFO:tasks.workunit.client.0.smithi111.stdout:4/169: truncate d18/d1f/f26 1402803 0 2024-09-11T00:07:07.740 INFO:tasks.workunit.client.1.smithi203.stdout:7/237: write dd/d1c/d26/d31/f49 [176790,111277] 0 2024-09-11T00:07:07.741 INFO:tasks.workunit.client.0.smithi111.stdout:9/229: write d6/db/f30 [939707,91910] 0 2024-09-11T00:07:07.744 INFO:tasks.workunit.client.0.smithi111.stdout:8/229: dwrite d11/f20 [0,4194304] 0 2024-09-11T00:07:07.749 INFO:tasks.workunit.client.0.smithi111.stdout:1/181: dwrite d2/f9 [0,4194304] 0 2024-09-11T00:07:07.749 INFO:tasks.workunit.client.1.smithi203.stdout:5/271: write dc/dd/d13/f35 [2482302,64794] 0 2024-09-11T00:07:07.752 INFO:tasks.workunit.client.1.smithi203.stdout:4/205: rmdir db/dd 39 2024-09-11T00:07:07.753 INFO:tasks.workunit.client.0.smithi111.stdout:3/239: unlink f10 0 2024-09-11T00:07:07.754 INFO:tasks.workunit.client.0.smithi111.stdout:0/203: creat d3/d1c/f4f x:0 0 0 2024-09-11T00:07:07.755 INFO:tasks.workunit.client.1.smithi203.stdout:8/222: dread d1/d13/d3a/f44 [0,4194304] 0 2024-09-11T00:07:07.756 INFO:tasks.workunit.client.0.smithi111.stdout:1/182: truncate d2/de/d12/d39/d3a/f3b 594832 0 2024-09-11T00:07:07.759 INFO:tasks.workunit.client.0.smithi111.stdout:3/240: fsync d1c/d1d/f42 0 2024-09-11T00:07:07.760 INFO:tasks.workunit.client.0.smithi111.stdout:3/241: chown d1c/d1d/d22/d23/c4b 6462826 1 2024-09-11T00:07:07.761 INFO:tasks.workunit.client.1.smithi203.stdout:3/359: write d8/d17/f78 [4805759,86492] 0 2024-09-11T00:07:07.765 INFO:tasks.workunit.client.0.smithi111.stdout:7/198: truncate dd/d1d/d1f/d24/f32 2573549 0 2024-09-11T00:07:07.769 INFO:tasks.workunit.client.0.smithi111.stdout:7/199: read fa [2626697,110639] 0 2024-09-11T00:07:07.771 INFO:tasks.workunit.client.1.smithi203.stdout:3/360: write d8/da/d11/f55 [639722,17785] 0 2024-09-11T00:07:07.771 INFO:tasks.workunit.client.1.smithi203.stdout:8/223: mknod d1/d13/d3a/d4c/c51 0 2024-09-11T00:07:07.772 INFO:tasks.workunit.client.0.smithi111.stdout:9/230: dread d6/db/d34/d37/f25 [0,4194304] 0 2024-09-11T00:07:07.772 INFO:tasks.workunit.client.1.smithi203.stdout:4/206: write db/dd/d26/f30 [448510,40845] 0 2024-09-11T00:07:07.774 INFO:tasks.workunit.client.1.smithi203.stdout:9/211: link d6/de/d19/d24/d40/d45/f39 d6/f4a 0 2024-09-11T00:07:07.775 INFO:tasks.workunit.client.1.smithi203.stdout:7/238: dwrite dd/d1c/d4b/f4c [0,4194304] 0 2024-09-11T00:07:07.784 INFO:tasks.workunit.client.0.smithi111.stdout:0/204: mkdir d3/d1c/d50 0 2024-09-11T00:07:07.785 INFO:tasks.workunit.client.0.smithi111.stdout:6/151: truncate d7/f30 117178 0 2024-09-11T00:07:07.787 INFO:tasks.workunit.client.0.smithi111.stdout:9/231: dwrite d6/db/d34/d37/f19 [0,4194304] 0 2024-09-11T00:07:07.788 INFO:tasks.workunit.client.1.smithi203.stdout:5/272: mknod dc/dd/d15/c55 0 2024-09-11T00:07:07.790 INFO:tasks.workunit.client.1.smithi203.stdout:3/361: dread d8/d3c/f5a [0,4194304] 0 2024-09-11T00:07:07.792 INFO:tasks.workunit.client.0.smithi111.stdout:1/183: mkdir d2/de/d12/d3c 0 2024-09-11T00:07:07.793 INFO:tasks.workunit.client.0.smithi111.stdout:1/184: dread - d2/de/f17 zero size 2024-09-11T00:07:07.795 INFO:tasks.workunit.client.0.smithi111.stdout:3/242: write f17 [2972811,55645] 0 2024-09-11T00:07:07.796 INFO:tasks.workunit.client.1.smithi203.stdout:3/362: write d8/d17/f84 [631659,17154] 0 2024-09-11T00:07:07.797 INFO:tasks.workunit.client.1.smithi203.stdout:3/363: chown d8/d17/f84 7372395 1 2024-09-11T00:07:07.803 INFO:tasks.workunit.client.0.smithi111.stdout:4/170: mkdir d18/d3b 0 2024-09-11T00:07:07.805 INFO:tasks.workunit.client.1.smithi203.stdout:4/207: mkdir db/dd/d16/d38 0 2024-09-11T00:07:07.808 INFO:tasks.workunit.client.0.smithi111.stdout:8/230: rename d11/d23/f2a to d11/d21/d38/f47 0 2024-09-11T00:07:07.811 INFO:tasks.workunit.client.1.smithi203.stdout:6/199: truncate d0/f5 1488853 0 2024-09-11T00:07:07.812 INFO:tasks.workunit.client.0.smithi111.stdout:2/197: link d0/d3/d12/l29 d0/d3/d39/l45 0 2024-09-11T00:07:07.813 INFO:tasks.workunit.client.1.smithi203.stdout:5/273: truncate dc/dd/d15/f37 630258 0 2024-09-11T00:07:07.816 INFO:tasks.workunit.client.0.smithi111.stdout:0/205: mkdir d3/d13/d1e/d29/d49/d51 0 2024-09-11T00:07:07.822 INFO:tasks.workunit.client.0.smithi111.stdout:1/185: creat d2/de/d12/d39/f3d x:0 0 0 2024-09-11T00:07:07.823 INFO:tasks.workunit.client.0.smithi111.stdout:8/231: dwrite d11/f20 [0,4194304] 0 2024-09-11T00:07:07.830 INFO:tasks.workunit.client.0.smithi111.stdout:4/171: mkdir d18/d20/d3c 0 2024-09-11T00:07:07.831 INFO:tasks.workunit.client.0.smithi111.stdout:3/243: symlink d1c/d1d/d22/d23/l51 0 2024-09-11T00:07:07.831 INFO:tasks.workunit.client.0.smithi111.stdout:4/172: chown d18/l28 5 1 2024-09-11T00:07:07.832 INFO:tasks.workunit.client.1.smithi203.stdout:7/239: dwrite dd/d1c/f2b [0,4194304] 0 2024-09-11T00:07:07.832 INFO:tasks.workunit.client.0.smithi111.stdout:3/244: read d1c/d21/f3a [2366050,6804] 0 2024-09-11T00:07:07.834 INFO:tasks.workunit.client.0.smithi111.stdout:2/198: chown d0/d3/d39/c3f 252753 1 2024-09-11T00:07:07.834 INFO:tasks.workunit.client.0.smithi111.stdout:3/245: write d1c/d21/f3a [2844265,76637] 0 2024-09-11T00:07:07.835 INFO:tasks.workunit.client.0.smithi111.stdout:6/152: mknod d7/d32/c33 0 2024-09-11T00:07:07.841 INFO:tasks.workunit.client.1.smithi203.stdout:5/274: mkdir dc/dd/d56 0 2024-09-11T00:07:07.843 INFO:tasks.workunit.client.1.smithi203.stdout:3/364: link d8/d17/c5f d8/d17/c85 0 2024-09-11T00:07:07.845 INFO:tasks.workunit.client.1.smithi203.stdout:7/240: truncate dd/d1c/d4b/f53 138049 0 2024-09-11T00:07:07.846 INFO:tasks.workunit.client.0.smithi111.stdout:5/224: truncate d10/d1e/d25/f29 1369551 0 2024-09-11T00:07:07.846 INFO:tasks.workunit.client.1.smithi203.stdout:4/208: link db/dd/d16/l17 db/d12/l39 0 2024-09-11T00:07:07.848 INFO:tasks.workunit.client.1.smithi203.stdout:8/224: dwrite d1/d13/f1b [0,4194304] 0 2024-09-11T00:07:07.849 INFO:tasks.workunit.client.1.smithi203.stdout:9/212: dwrite d6/de/d19/f1b [0,4194304] 0 2024-09-11T00:07:07.850 INFO:tasks.workunit.client.0.smithi111.stdout:2/199: symlink d0/d3/d12/l46 0 2024-09-11T00:07:07.851 INFO:tasks.workunit.client.0.smithi111.stdout:0/206: dread d3/d13/d1e/d29/f2d [0,4194304] 0 2024-09-11T00:07:07.852 INFO:tasks.workunit.client.1.smithi203.stdout:9/213: fsync d6/de/d19/d24/f27 0 2024-09-11T00:07:07.853 INFO:tasks.workunit.client.0.smithi111.stdout:8/232: fsync d11/f20 0 2024-09-11T00:07:07.854 INFO:tasks.workunit.client.0.smithi111.stdout:6/153: dwrite f0 [0,4194304] 0 2024-09-11T00:07:07.858 INFO:tasks.workunit.client.0.smithi111.stdout:3/246: creat d1c/d1d/d22/d23/f52 x:0 0 0 2024-09-11T00:07:07.858 INFO:tasks.workunit.client.1.smithi203.stdout:9/214: truncate d6/de/d19/d21/f25 4585235 0 2024-09-11T00:07:07.861 INFO:tasks.workunit.client.0.smithi111.stdout:9/232: truncate d6/db/fd 2498220 0 2024-09-11T00:07:07.863 INFO:tasks.workunit.client.0.smithi111.stdout:9/233: chown d6/db/d1b/f1e 3 1 2024-09-11T00:07:07.864 INFO:tasks.workunit.client.0.smithi111.stdout:9/234: stat d6/dc/l2b 0 2024-09-11T00:07:07.868 INFO:tasks.workunit.client.0.smithi111.stdout:5/225: fsync f1 0 2024-09-11T00:07:07.871 INFO:tasks.workunit.client.0.smithi111.stdout:4/173: rename d18/d1f/f2d to d18/d1f/d33/f3d 0 2024-09-11T00:07:07.873 INFO:tasks.workunit.client.1.smithi203.stdout:8/225: rename d1/d13/d22/d41 to d1/d13/d17/d2f/d52 0 2024-09-11T00:07:07.876 INFO:tasks.workunit.client.1.smithi203.stdout:5/275: unlink dc/dd/d13/f18 0 2024-09-11T00:07:07.876 INFO:tasks.workunit.client.0.smithi111.stdout:0/207: mknod d3/dc/c52 0 2024-09-11T00:07:07.878 INFO:tasks.workunit.client.0.smithi111.stdout:0/208: truncate d3/da/f3a 793001 0 2024-09-11T00:07:07.880 INFO:tasks.workunit.client.1.smithi203.stdout:5/276: dread dc/dd/d1e/f53 [0,4194304] 0 2024-09-11T00:07:07.880 INFO:tasks.workunit.client.0.smithi111.stdout:7/200: sync 2024-09-11T00:07:07.888 INFO:tasks.workunit.client.1.smithi203.stdout:3/365: link d8/d2a/c6e d8/da/d37/d83/c86 0 2024-09-11T00:07:07.890 INFO:tasks.workunit.client.0.smithi111.stdout:2/200: creat d0/d3/d2e/f47 x:0 0 0 2024-09-11T00:07:07.892 INFO:tasks.workunit.client.1.smithi203.stdout:8/226: dread d1/f8 [0,4194304] 0 2024-09-11T00:07:07.893 INFO:tasks.workunit.client.0.smithi111.stdout:6/154: symlink d7/d22/l34 0 2024-09-11T00:07:07.896 INFO:tasks.workunit.client.0.smithi111.stdout:0/209: creat d3/d13/d1e/d29/f53 x:0 0 0 2024-09-11T00:07:07.897 INFO:tasks.workunit.client.0.smithi111.stdout:8/233: mknod d11/d23/d2c/d46/c48 0 2024-09-11T00:07:07.898 INFO:tasks.workunit.client.0.smithi111.stdout:7/201: stat c3 0 2024-09-11T00:07:07.899 INFO:tasks.workunit.client.1.smithi203.stdout:3/366: creat d8/da/d37/d83/d6a/f87 x:0 0 0 2024-09-11T00:07:07.900 INFO:tasks.workunit.client.0.smithi111.stdout:7/202: write dd/f3a [297630,90170] 0 2024-09-11T00:07:07.900 INFO:tasks.workunit.client.1.smithi203.stdout:3/367: readlink l3 0 2024-09-11T00:07:07.901 INFO:tasks.workunit.client.0.smithi111.stdout:7/203: stat f8 0 2024-09-11T00:07:07.901 INFO:tasks.workunit.client.0.smithi111.stdout:3/247: link d1c/d1d/d22/f4d d1c/d1d/d22/d31/d33/f53 0 2024-09-11T00:07:07.901 INFO:tasks.workunit.client.1.smithi203.stdout:4/209: getdents db/d12/d15 0 2024-09-11T00:07:07.902 INFO:tasks.workunit.client.0.smithi111.stdout:7/204: dread - dd/f2c zero size 2024-09-11T00:07:07.902 INFO:tasks.workunit.client.1.smithi203.stdout:9/215: truncate d6/de/d19/d24/f27 1493278 0 2024-09-11T00:07:07.904 INFO:tasks.workunit.client.0.smithi111.stdout:1/186: rename d2/de/f32 to d2/d2b/f3e 0 2024-09-11T00:07:07.905 INFO:tasks.workunit.client.1.smithi203.stdout:5/277: truncate dc/dd/d15/f37 289556 0 2024-09-11T00:07:07.908 INFO:tasks.workunit.client.1.smithi203.stdout:4/210: mknod db/dd/c3a 0 2024-09-11T00:07:07.909 INFO:tasks.workunit.client.1.smithi203.stdout:4/211: dread - db/d12/f37 zero size 2024-09-11T00:07:07.909 INFO:tasks.workunit.client.1.smithi203.stdout:8/227: creat d1/d13/d17/d48/f53 x:0 0 0 2024-09-11T00:07:07.910 INFO:tasks.workunit.client.1.smithi203.stdout:4/212: chown c8 307 1 2024-09-11T00:07:07.911 INFO:tasks.workunit.client.0.smithi111.stdout:0/210: dwrite d3/da/f1d [4194304,4194304] 0 2024-09-11T00:07:07.911 INFO:tasks.workunit.client.1.smithi203.stdout:9/216: creat d6/de/d19/d24/d40/d41/f4b x:0 0 0 2024-09-11T00:07:07.911 INFO:tasks.workunit.client.0.smithi111.stdout:7/205: dread dd/f10 [0,4194304] 0 2024-09-11T00:07:07.912 INFO:tasks.workunit.client.1.smithi203.stdout:4/213: dread - db/d12/f1e zero size 2024-09-11T00:07:07.912 INFO:tasks.workunit.client.1.smithi203.stdout:9/217: fdatasync d6/f46 0 2024-09-11T00:07:07.917 INFO:tasks.workunit.client.0.smithi111.stdout:6/155: mkdir d7/d2b/d35 0 2024-09-11T00:07:07.921 INFO:tasks.workunit.client.0.smithi111.stdout:9/235: rename d6/db/d34/l39 to d6/db/d1b/l4d 0 2024-09-11T00:07:07.923 INFO:tasks.workunit.client.0.smithi111.stdout:3/248: dwrite d1c/d21/f3b [0,4194304] 0 2024-09-11T00:07:07.924 INFO:tasks.workunit.client.0.smithi111.stdout:3/249: readlink d1c/l43 0 2024-09-11T00:07:07.925 INFO:tasks.workunit.client.1.smithi203.stdout:8/228: chown d1/fe 429 1 2024-09-11T00:07:07.925 INFO:tasks.workunit.client.0.smithi111.stdout:1/187: symlink d2/de/d12/d39/d3a/l3f 0 2024-09-11T00:07:07.929 INFO:tasks.workunit.client.0.smithi111.stdout:3/250: chown d1c/d1d/d22/d31/d33/f36 1 1 2024-09-11T00:07:07.930 INFO:tasks.workunit.client.1.smithi203.stdout:4/214: dwrite db/d12/f37 [0,4194304] 0 2024-09-11T00:07:07.931 INFO:tasks.workunit.client.1.smithi203.stdout:5/278: creat dc/dd/d4d/f57 x:0 0 0 2024-09-11T00:07:07.931 INFO:tasks.workunit.client.0.smithi111.stdout:1/188: write d2/de/d12/d39/d3a/f3b [1421250,99764] 0 2024-09-11T00:07:07.937 INFO:tasks.workunit.client.0.smithi111.stdout:7/206: unlink dd/f2c 0 2024-09-11T00:07:07.938 INFO:tasks.workunit.client.1.smithi203.stdout:9/218: rmdir d6/de/d19/d30 39 2024-09-11T00:07:07.939 INFO:tasks.workunit.client.0.smithi111.stdout:7/207: write dd/d1d/d1f/f23 [615511,97697] 0 2024-09-11T00:07:07.940 INFO:tasks.workunit.client.0.smithi111.stdout:6/156: dwrite d7/f15 [0,4194304] 0 2024-09-11T00:07:07.943 INFO:tasks.workunit.client.1.smithi203.stdout:5/279: rmdir dc/dd/d1e/d41 39 2024-09-11T00:07:07.943 INFO:tasks.workunit.client.0.smithi111.stdout:5/226: rename d10/d1e/d23/d26/d3a/f45 to d10/d1e/d23/d30/d3c/f4e 0 2024-09-11T00:07:07.943 INFO:tasks.workunit.client.0.smithi111.stdout:6/157: chown d7/d22/l34 192663 1 2024-09-11T00:07:07.944 INFO:tasks.workunit.client.0.smithi111.stdout:4/174: rename d18 to d18/d1f/d33/d3e 22 2024-09-11T00:07:07.944 INFO:tasks.workunit.client.0.smithi111.stdout:9/236: rmdir d6/db/d1b/d41 39 2024-09-11T00:07:07.945 INFO:tasks.workunit.client.1.smithi203.stdout:4/215: read db/d12/d15/d2a/f1b [977118,71323] 0 2024-09-11T00:07:07.947 INFO:tasks.workunit.client.0.smithi111.stdout:7/208: dread dd/d1d/f39 [0,4194304] 0 2024-09-11T00:07:07.948 INFO:tasks.workunit.client.0.smithi111.stdout:4/175: write d18/f19 [322784,49883] 0 2024-09-11T00:07:07.951 INFO:tasks.workunit.client.0.smithi111.stdout:4/176: chown d18/c1a 8773604 1 2024-09-11T00:07:07.959 INFO:tasks.workunit.client.0.smithi111.stdout:7/209: dread f6 [0,4194304] 0 2024-09-11T00:07:07.967 INFO:tasks.workunit.client.0.smithi111.stdout:7/210: dread dd/f33 [0,4194304] 0 2024-09-11T00:07:08.028 INFO:tasks.workunit.client.1.smithi203.stdout:3/368: getdents d8/da/d5c/d6b/d6c 0 2024-09-11T00:07:08.030 INFO:tasks.workunit.client.0.smithi111.stdout:1/189: creat d2/de/d12/d39/d3a/f40 x:0 0 0 2024-09-11T00:07:08.031 INFO:tasks.workunit.client.1.smithi203.stdout:5/280: symlink dc/dd/d4d/l58 0 2024-09-11T00:07:08.032 INFO:tasks.workunit.client.0.smithi111.stdout:3/251: creat d1c/d1d/d22/d31/f54 x:0 0 0 2024-09-11T00:07:08.033 INFO:tasks.workunit.client.0.smithi111.stdout:8/234: truncate d11/f1b 634888 0 2024-09-11T00:07:08.033 INFO:tasks.workunit.client.0.smithi111.stdout:8/235: readlink d11/l18 0 2024-09-11T00:07:08.038 INFO:tasks.workunit.client.0.smithi111.stdout:9/237: unlink d6/dc/l2b 0 2024-09-11T00:07:08.039 INFO:tasks.workunit.client.1.smithi203.stdout:3/369: symlink d8/da/d37/l88 0 2024-09-11T00:07:08.039 INFO:tasks.workunit.client.0.smithi111.stdout:9/238: write d6/db/f43 [371361,1437] 0 2024-09-11T00:07:08.041 INFO:tasks.workunit.client.0.smithi111.stdout:9/239: write d6/db/f43 [1350411,50261] 0 2024-09-11T00:07:08.041 INFO:tasks.workunit.client.1.smithi203.stdout:9/219: write d6/de/f20 [2960219,3237] 0 2024-09-11T00:07:08.045 INFO:tasks.workunit.client.1.smithi203.stdout:9/220: stat d6/de/d19/d24/d40/d45/f15 0 2024-09-11T00:07:08.045 INFO:tasks.workunit.client.1.smithi203.stdout:8/229: getdents d1/d13/d43 0 2024-09-11T00:07:08.045 INFO:tasks.workunit.client.0.smithi111.stdout:4/177: chown d18/d1f/d36 357 1 2024-09-11T00:07:08.048 INFO:tasks.workunit.client.0.smithi111.stdout:7/211: symlink dd/d1d/d1f/l3b 0 2024-09-11T00:07:08.049 INFO:tasks.workunit.client.1.smithi203.stdout:5/281: getdents dc/d2b/d3f 0 2024-09-11T00:07:08.053 INFO:tasks.workunit.client.1.smithi203.stdout:4/216: dwrite db/f10 [4194304,4194304] 0 2024-09-11T00:07:08.055 INFO:tasks.workunit.client.0.smithi111.stdout:2/201: link d0/d3/c30 d0/d3/de/c48 0 2024-09-11T00:07:08.057 INFO:tasks.workunit.client.0.smithi111.stdout:7/212: dread dd/f1a [0,4194304] 0 2024-09-11T00:07:08.057 INFO:tasks.workunit.client.1.smithi203.stdout:9/221: fsync d6/de/d19/d24/d40/d45/d29/f3f 0 2024-09-11T00:07:08.058 INFO:tasks.workunit.client.1.smithi203.stdout:8/230: symlink d1/l54 0 2024-09-11T00:07:08.059 INFO:tasks.workunit.client.1.smithi203.stdout:3/370: dwrite d8/d17/f74 [0,4194304] 0 2024-09-11T00:07:08.061 INFO:tasks.workunit.client.1.smithi203.stdout:3/371: chown d8 1216503 1 2024-09-11T00:07:08.062 INFO:tasks.workunit.client.0.smithi111.stdout:7/213: dread dd/f3a [0,4194304] 0 2024-09-11T00:07:08.064 INFO:tasks.workunit.client.0.smithi111.stdout:0/211: rename d3/f6 to d3/f54 0 2024-09-11T00:07:08.068 INFO:tasks.workunit.client.1.smithi203.stdout:4/217: truncate db/d12/d15/d2a/f1b 3440484 0 2024-09-11T00:07:08.069 INFO:tasks.workunit.client.0.smithi111.stdout:3/252: mknod d1c/d1d/d22/d23/c55 0 2024-09-11T00:07:08.069 INFO:tasks.workunit.client.0.smithi111.stdout:5/227: dwrite d10/d1e/d23/d2b/f33 [0,4194304] 0 2024-09-11T00:07:08.073 INFO:tasks.workunit.client.1.smithi203.stdout:4/218: dread - db/dd/d26/f2f zero size 2024-09-11T00:07:08.073 INFO:tasks.workunit.client.0.smithi111.stdout:8/236: mknod d11/d21/d38/c49 0 2024-09-11T00:07:08.075 INFO:tasks.workunit.client.1.smithi203.stdout:4/219: fsync db/dd/d26/f28 0 2024-09-11T00:07:08.078 INFO:tasks.workunit.client.1.smithi203.stdout:8/231: symlink d1/d13/d43/l55 0 2024-09-11T00:07:08.082 INFO:tasks.workunit.client.0.smithi111.stdout:9/240: fdatasync d6/db/d34/d37/f25 0 2024-09-11T00:07:08.088 INFO:tasks.workunit.client.1.smithi203.stdout:3/372: dwrite d8/da/d11/f55 [0,4194304] 0 2024-09-11T00:07:08.088 INFO:tasks.workunit.client.1.smithi203.stdout:9/222: rename d6/de/f22 to d6/de/d19/f4c 0 2024-09-11T00:07:08.092 INFO:tasks.workunit.client.1.smithi203.stdout:9/223: write d6/de/d19/f33 [1110795,89072] 0 2024-09-11T00:07:08.092 INFO:tasks.workunit.client.1.smithi203.stdout:5/282: dread dc/dd/d15/f2c [0,4194304] 0 2024-09-11T00:07:08.093 INFO:tasks.workunit.client.1.smithi203.stdout:4/220: creat db/dd/d16/d38/f3b x:0 0 0 2024-09-11T00:07:08.096 INFO:tasks.workunit.client.1.smithi203.stdout:9/224: dread - d6/de/d19/f3c zero size 2024-09-11T00:07:08.104 INFO:tasks.workunit.client.0.smithi111.stdout:7/214: stat dd/ff 0 2024-09-11T00:07:08.105 INFO:tasks.workunit.client.1.smithi203.stdout:8/232: dwrite d1/d13/d43/d46/f4e [0,4194304] 0 2024-09-11T00:07:08.107 INFO:tasks.workunit.client.0.smithi111.stdout:6/158: truncate d7/f15 2622888 0 2024-09-11T00:07:08.109 INFO:tasks.workunit.client.1.smithi203.stdout:4/221: mkdir db/dd/d16/d38/d3c 0 2024-09-11T00:07:08.118 INFO:tasks.workunit.client.0.smithi111.stdout:3/253: creat d1c/d1d/d22/d44/f56 x:0 0 0 2024-09-11T00:07:08.120 INFO:tasks.workunit.client.0.smithi111.stdout:3/254: chown ld 28593 1 2024-09-11T00:07:08.121 INFO:tasks.workunit.client.0.smithi111.stdout:1/190: truncate d2/de/ff 840209 0 2024-09-11T00:07:08.123 INFO:tasks.workunit.client.0.smithi111.stdout:7/215: dwrite dd/f1b [0,4194304] 0 2024-09-11T00:07:08.128 INFO:tasks.workunit.client.0.smithi111.stdout:3/255: dread d1c/d1d/d22/d31/d33/f53 [0,4194304] 0 2024-09-11T00:07:08.129 INFO:tasks.workunit.client.0.smithi111.stdout:2/202: creat d0/d3/de/d3b/f49 x:0 0 0 2024-09-11T00:07:08.131 INFO:tasks.workunit.client.1.smithi203.stdout:3/373: write d8/fb [1477462,75255] 0 2024-09-11T00:07:08.133 INFO:tasks.workunit.client.1.smithi203.stdout:3/374: chown d8/da/f46 183192442 1 2024-09-11T00:07:08.134 INFO:tasks.workunit.client.1.smithi203.stdout:1/307: sync 2024-09-11T00:07:08.136 INFO:tasks.workunit.client.1.smithi203.stdout:5/283: dread dc/dd/d15/d3b/f4c [0,4194304] 0 2024-09-11T00:07:08.137 INFO:tasks.workunit.client.0.smithi111.stdout:5/228: dwrite f1 [0,4194304] 0 2024-09-11T00:07:08.140 INFO:tasks.workunit.client.1.smithi203.stdout:5/284: stat dc/c1c 0 2024-09-11T00:07:08.140 INFO:tasks.workunit.client.1.smithi203.stdout:0/259: sync 2024-09-11T00:07:08.141 INFO:tasks.workunit.client.0.smithi111.stdout:0/212: mknod d3/c55 0 2024-09-11T00:07:08.141 INFO:tasks.workunit.client.1.smithi203.stdout:4/222: truncate db/dd/f2c 149012 0 2024-09-11T00:07:08.143 INFO:tasks.workunit.client.0.smithi111.stdout:4/178: truncate d18/f29 3637566 0 2024-09-11T00:07:08.145 INFO:tasks.workunit.client.1.smithi203.stdout:3/375: creat d8/da/d11/f89 x:0 0 0 2024-09-11T00:07:08.145 INFO:tasks.workunit.client.1.smithi203.stdout:9/225: dwrite d6/de/d19/d24/d40/d45/d29/f3f [0,4194304] 0 2024-09-11T00:07:08.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:07 smithi111 ceph-mon[27539]: pgmap v323: 65 pgs: 65 active+clean; 775 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s rd, 77 MiB/s wr, 190 op/s 2024-09-11T00:07:08.160 INFO:tasks.workunit.client.0.smithi111.stdout:7/216: mknod dd/d1d/c3c 0 2024-09-11T00:07:08.167 INFO:tasks.workunit.client.0.smithi111.stdout:5/229: mknod d10/c4f 0 2024-09-11T00:07:08.168 INFO:tasks.workunit.client.0.smithi111.stdout:0/213: symlink d3/d26/l56 0 2024-09-11T00:07:08.170 INFO:tasks.workunit.client.0.smithi111.stdout:6/159: dwrite f3 [0,4194304] 0 2024-09-11T00:07:08.173 INFO:tasks.workunit.client.0.smithi111.stdout:9/241: creat d6/db/d1b/f4e x:0 0 0 2024-09-11T00:07:08.175 INFO:tasks.workunit.client.0.smithi111.stdout:8/237: getdents d11/d23/d2c/d46 0 2024-09-11T00:07:08.177 INFO:tasks.workunit.client.0.smithi111.stdout:0/214: rmdir d3/d13/d38 39 2024-09-11T00:07:08.177 INFO:tasks.workunit.client.0.smithi111.stdout:7/217: creat dd/d1d/d2d/d2e/f3d x:0 0 0 2024-09-11T00:07:08.184 INFO:tasks.workunit.client.0.smithi111.stdout:3/256: dwrite d1c/d1d/d22/d31/d33/f53 [0,4194304] 0 2024-09-11T00:07:08.184 INFO:tasks.workunit.client.0.smithi111.stdout:1/191: write d2/d2b/f3e [1541174,46692] 0 2024-09-11T00:07:08.186 INFO:tasks.workunit.client.0.smithi111.stdout:6/160: symlink d7/d22/d2c/l36 0 2024-09-11T00:07:08.235 INFO:tasks.workunit.client.0.smithi111.stdout:4/179: getdents d18/d2b 0 2024-09-11T00:07:08.235 INFO:tasks.workunit.client.0.smithi111.stdout:1/192: dread - d2/de/d12/f26 zero size 2024-09-11T00:07:08.235 INFO:tasks.workunit.client.0.smithi111.stdout:8/238: rename d11/d23/l36 to d11/d23/d2c/d46/l4a 0 2024-09-11T00:07:08.236 INFO:tasks.workunit.client.1.smithi203.stdout:8/233: getdents d1/d13/d17/d2f/d52 0 2024-09-11T00:07:08.236 INFO:tasks.workunit.client.1.smithi203.stdout:0/260: symlink d0/d2/d37/l57 0 2024-09-11T00:07:08.237 INFO:tasks.workunit.client.1.smithi203.stdout:9/226: symlink d6/de/d19/d24/d40/d41/l4d 0 2024-09-11T00:07:08.237 INFO:tasks.workunit.client.0.smithi111.stdout:5/230: getdents d10/d1e/d23/d30/d3c 0 2024-09-11T00:07:08.238 INFO:tasks.workunit.client.1.smithi203.stdout:3/376: write d8/f3d [692679,14083] 0 2024-09-11T00:07:08.238 INFO:tasks.workunit.client.1.smithi203.stdout:8/234: stat d1/d13/d22/c40 0 2024-09-11T00:07:08.240 INFO:tasks.workunit.client.0.smithi111.stdout:1/193: fsync d2/de/d12/f28 0 2024-09-11T00:07:08.240 INFO:tasks.workunit.client.0.smithi111.stdout:6/161: chown d7/d22/l2a 14817598 1 2024-09-11T00:07:08.242 INFO:tasks.workunit.client.0.smithi111.stdout:4/180: creat d18/d2b/f3f x:0 0 0 2024-09-11T00:07:08.243 INFO:tasks.workunit.client.1.smithi203.stdout:4/223: creat db/f3d x:0 0 0 2024-09-11T00:07:08.243 INFO:tasks.workunit.client.0.smithi111.stdout:9/242: dwrite d6/dc/f1f [0,4194304] 0 2024-09-11T00:07:08.245 INFO:tasks.workunit.client.0.smithi111.stdout:8/239: rename d11/f42 to d11/d23/d2c/f4b 0 2024-09-11T00:07:08.246 INFO:tasks.workunit.client.1.smithi203.stdout:9/227: truncate d6/f14 278530 0 2024-09-11T00:07:08.247 INFO:tasks.workunit.client.0.smithi111.stdout:9/243: readlink d6/l24 0 2024-09-11T00:07:08.247 INFO:tasks.workunit.client.1.smithi203.stdout:5/285: dwrite f8 [0,4194304] 0 2024-09-11T00:07:08.249 INFO:tasks.workunit.client.0.smithi111.stdout:7/218: dwrite dd/f33 [0,4194304] 0 2024-09-11T00:07:08.249 INFO:tasks.workunit.client.0.smithi111.stdout:5/231: creat d10/d1e/d23/d26/f50 x:0 0 0 2024-09-11T00:07:08.249 INFO:tasks.workunit.client.1.smithi203.stdout:3/377: creat d8/da/d37/d83/d6a/f8a x:0 0 0 2024-09-11T00:07:08.252 INFO:tasks.workunit.client.0.smithi111.stdout:4/181: mkdir d18/d20/d40 0 2024-09-11T00:07:08.254 INFO:tasks.workunit.client.0.smithi111.stdout:7/219: dread - dd/f31 zero size 2024-09-11T00:07:08.256 INFO:tasks.workunit.client.1.smithi203.stdout:3/378: write d8/da/d37/f47 [2316102,14316] 0 2024-09-11T00:07:08.258 INFO:tasks.workunit.client.0.smithi111.stdout:8/240: symlink d11/d23/d2c/l4c 0 2024-09-11T00:07:08.258 INFO:tasks.workunit.client.0.smithi111.stdout:7/220: chown c2 23 1 2024-09-11T00:07:08.261 INFO:tasks.workunit.client.0.smithi111.stdout:7/221: chown f8 35983 1 2024-09-11T00:07:08.262 INFO:tasks.workunit.client.0.smithi111.stdout:3/257: dwrite d1c/d1d/f41 [0,4194304] 0 2024-09-11T00:07:08.262 INFO:tasks.workunit.client.1.smithi203.stdout:4/224: mknod db/dd/d16/d38/d3c/c3e 0 2024-09-11T00:07:08.265 INFO:tasks.workunit.client.0.smithi111.stdout:6/162: dread f0 [0,4194304] 0 2024-09-11T00:07:08.265 INFO:tasks.workunit.client.0.smithi111.stdout:3/258: write d1c/d1d/d22/d23/f4a [101354,71340] 0 2024-09-11T00:07:08.266 INFO:tasks.workunit.client.0.smithi111.stdout:2/203: sync 2024-09-11T00:07:08.267 INFO:tasks.workunit.client.1.smithi203.stdout:3/379: read d8/d17/f78 [5227098,6818] 0 2024-09-11T00:07:08.268 INFO:tasks.workunit.client.0.smithi111.stdout:3/259: write f17 [611279,33786] 0 2024-09-11T00:07:08.271 INFO:tasks.workunit.client.1.smithi203.stdout:8/235: dwrite d1/d13/d43/d46/f4e [0,4194304] 0 2024-09-11T00:07:08.271 INFO:tasks.workunit.client.0.smithi111.stdout:6/163: chown d7/d22/f29 149683304 1 2024-09-11T00:07:08.272 INFO:tasks.workunit.client.0.smithi111.stdout:8/241: creat d11/d23/d2c/d46/f4d x:0 0 0 2024-09-11T00:07:08.274 INFO:tasks.workunit.client.0.smithi111.stdout:8/242: fsync d11/f35 0 2024-09-11T00:07:08.275 INFO:tasks.workunit.client.0.smithi111.stdout:4/182: mknod d18/d1f/c41 0 2024-09-11T00:07:08.275 INFO:tasks.workunit.client.0.smithi111.stdout:4/183: fsync d18/f1b 0 2024-09-11T00:07:08.286 INFO:tasks.workunit.client.1.smithi203.stdout:0/261: dread d0/d2/f8 [0,4194304] 0 2024-09-11T00:07:08.286 INFO:tasks.workunit.client.0.smithi111.stdout:3/260: symlink d1c/d1d/d22/d44/l57 0 2024-09-11T00:07:08.287 INFO:tasks.workunit.client.0.smithi111.stdout:3/261: chown d1c/f24 260 1 2024-09-11T00:07:08.289 INFO:tasks.workunit.client.1.smithi203.stdout:3/380: mkdir d8/da/d37/d83/d65/d8b 0 2024-09-11T00:07:08.292 INFO:tasks.workunit.client.0.smithi111.stdout:6/164: creat d7/d22/d2c/f37 x:0 0 0 2024-09-11T00:07:08.293 INFO:tasks.workunit.client.1.smithi203.stdout:4/225: dwrite db/dd/d26/f30 [0,4194304] 0 2024-09-11T00:07:08.295 INFO:tasks.workunit.client.1.smithi203.stdout:4/226: stat db/l20 0 2024-09-11T00:07:08.300 INFO:tasks.workunit.client.1.smithi203.stdout:2/175: sync 2024-09-11T00:07:08.301 INFO:tasks.workunit.client.1.smithi203.stdout:2/176: readlink lf 0 2024-09-11T00:07:08.302 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:07 smithi203 ceph-mon[33225]: pgmap v323: 65 pgs: 65 active+clean; 775 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s rd, 77 MiB/s wr, 190 op/s 2024-09-11T00:07:08.306 INFO:tasks.workunit.client.0.smithi111.stdout:8/243: rename d11/f25 to d11/d23/f4e 0 2024-09-11T00:07:08.310 INFO:tasks.workunit.client.0.smithi111.stdout:5/232: rmdir d10/d1e/d23 39 2024-09-11T00:07:08.311 INFO:tasks.workunit.client.0.smithi111.stdout:5/233: chown d10/c18 43 1 2024-09-11T00:07:08.313 INFO:tasks.workunit.client.1.smithi203.stdout:3/381: creat d8/da/d37/d83/d6a/f8c x:0 0 0 2024-09-11T00:07:08.315 INFO:tasks.workunit.client.1.smithi203.stdout:4/227: creat db/dd/d26/f3f x:0 0 0 2024-09-11T00:07:08.316 INFO:tasks.workunit.client.0.smithi111.stdout:3/262: mkdir d1c/d1d/d22/d23/d58 0 2024-09-11T00:07:08.318 INFO:tasks.workunit.client.0.smithi111.stdout:6/165: mkdir d7/d22/d2c/d38 0 2024-09-11T00:07:08.321 INFO:tasks.workunit.client.0.smithi111.stdout:8/244: readlink d11/d23/d2c/d46/l4a 0 2024-09-11T00:07:08.324 INFO:tasks.workunit.client.1.smithi203.stdout:5/286: dread dc/dd/d13/f48 [0,4194304] 0 2024-09-11T00:07:08.324 INFO:tasks.workunit.client.1.smithi203.stdout:0/262: mknod d0/c58 0 2024-09-11T00:07:08.325 INFO:tasks.workunit.client.1.smithi203.stdout:0/263: stat d0/d1d/f3c 0 2024-09-11T00:07:08.326 INFO:tasks.workunit.client.1.smithi203.stdout:2/177: fdatasync d13/d15/f1f 0 2024-09-11T00:07:08.327 INFO:tasks.workunit.client.0.smithi111.stdout:5/234: write d10/d1e/d23/d30/d3c/f40 [917479,127038] 0 2024-09-11T00:07:08.328 INFO:tasks.workunit.client.0.smithi111.stdout:6/166: unlink d7/d22/f29 0 2024-09-11T00:07:08.328 INFO:tasks.workunit.client.1.smithi203.stdout:6/200: sync 2024-09-11T00:07:08.328 INFO:tasks.workunit.client.1.smithi203.stdout:7/241: sync 2024-09-11T00:07:08.329 INFO:tasks.workunit.client.0.smithi111.stdout:3/263: dwrite d1c/d1d/f20 [0,4194304] 0 2024-09-11T00:07:08.331 INFO:tasks.workunit.client.1.smithi203.stdout:9/228: truncate d6/de/d19/d24/f2c 818094 0 2024-09-11T00:07:08.331 INFO:tasks.workunit.client.1.smithi203.stdout:6/201: write d0/f14 [8811439,25066] 0 2024-09-11T00:07:08.333 INFO:tasks.workunit.client.0.smithi111.stdout:6/167: truncate d7/f30 476523 0 2024-09-11T00:07:08.336 INFO:tasks.workunit.client.1.smithi203.stdout:4/228: rename db/dd/d16/f29 to db/dd/f40 0 2024-09-11T00:07:08.338 INFO:tasks.workunit.client.0.smithi111.stdout:9/244: truncate d6/dc/f17 353494 0 2024-09-11T00:07:08.339 INFO:tasks.workunit.client.1.smithi203.stdout:2/178: mknod d13/d15/d19/d1c/c31 0 2024-09-11T00:07:08.340 INFO:tasks.workunit.client.0.smithi111.stdout:9/245: fdatasync d6/db/f30 0 2024-09-11T00:07:08.341 INFO:tasks.workunit.client.0.smithi111.stdout:5/235: mkdir d10/d51 0 2024-09-11T00:07:08.341 INFO:tasks.workunit.client.0.smithi111.stdout:5/236: fsync f5 0 2024-09-11T00:07:08.343 INFO:tasks.workunit.client.0.smithi111.stdout:9/246: write d6/db/d34/d37/f2d [270603,110739] 0 2024-09-11T00:07:08.346 INFO:tasks.workunit.client.0.smithi111.stdout:8/245: dwrite d11/f12 [0,4194304] 0 2024-09-11T00:07:08.348 INFO:tasks.workunit.client.0.smithi111.stdout:4/184: link d18/f29 d18/d20/d40/f42 0 2024-09-11T00:07:08.356 INFO:tasks.workunit.client.1.smithi203.stdout:9/229: creat d6/de/d19/d24/d40/f4e x:0 0 0 2024-09-11T00:07:08.356 INFO:tasks.workunit.client.1.smithi203.stdout:2/179: dread d13/d15/f1b [0,4194304] 0 2024-09-11T00:07:08.358 INFO:tasks.workunit.client.1.smithi203.stdout:0/264: dwrite d0/d2/f1a [0,4194304] 0 2024-09-11T00:07:08.359 INFO:tasks.workunit.client.1.smithi203.stdout:8/236: dwrite d1/f2 [0,4194304] 0 2024-09-11T00:07:08.362 INFO:tasks.workunit.client.1.smithi203.stdout:0/265: chown d0/d2/d3d/l4f 17 1 2024-09-11T00:07:08.364 INFO:tasks.workunit.client.1.smithi203.stdout:0/266: write d0/d2/f1a [3514003,11349] 0 2024-09-11T00:07:08.365 INFO:tasks.workunit.client.1.smithi203.stdout:8/237: dread d1/d13/f19 [4194304,4194304] 0 2024-09-11T00:07:08.365 INFO:tasks.workunit.client.1.smithi203.stdout:5/287: rename dc/d2b/d3f to dc/dd/d4d/d59 0 2024-09-11T00:07:08.365 INFO:tasks.workunit.client.1.smithi203.stdout:4/229: mkdir db/dd/d16/d38/d3c/d41 0 2024-09-11T00:07:08.367 INFO:tasks.workunit.client.0.smithi111.stdout:9/247: fdatasync d6/db/f18 0 2024-09-11T00:07:08.367 INFO:tasks.workunit.client.0.smithi111.stdout:6/168: mkdir d7/d22/d2c/d38/d39 0 2024-09-11T00:07:08.368 INFO:tasks.workunit.client.0.smithi111.stdout:4/185: dwrite d18/d2b/f3f [0,4194304] 0 2024-09-11T00:07:08.371 INFO:tasks.workunit.client.1.smithi203.stdout:3/382: creat d8/da/d5c/f8d x:0 0 0 2024-09-11T00:07:08.374 INFO:tasks.workunit.client.0.smithi111.stdout:4/186: write d18/f1b [276016,27039] 0 2024-09-11T00:07:08.375 INFO:tasks.workunit.client.0.smithi111.stdout:0/215: sync 2024-09-11T00:07:08.375 INFO:tasks.workunit.client.0.smithi111.stdout:2/204: sync 2024-09-11T00:07:08.375 INFO:tasks.workunit.client.0.smithi111.stdout:1/194: sync 2024-09-11T00:07:08.375 INFO:tasks.workunit.client.0.smithi111.stdout:7/222: sync 2024-09-11T00:07:08.376 INFO:tasks.workunit.client.0.smithi111.stdout:8/246: mknod d11/d23/d2c/c4f 0 2024-09-11T00:07:08.382 INFO:tasks.workunit.client.0.smithi111.stdout:1/195: write d2/de/d12/d39/d3a/f3b [1164022,15060] 0 2024-09-11T00:07:08.384 INFO:tasks.workunit.client.0.smithi111.stdout:8/247: dread ff [0,4194304] 0 2024-09-11T00:07:08.387 INFO:tasks.workunit.client.0.smithi111.stdout:8/248: chown d11/c16 90 1 2024-09-11T00:07:08.387 INFO:tasks.workunit.client.0.smithi111.stdout:9/248: mknod d6/db/c4f 0 2024-09-11T00:07:08.387 INFO:tasks.workunit.client.1.smithi203.stdout:6/202: unlink d0/d27/d35/d38/l31 0 2024-09-11T00:07:08.388 INFO:tasks.workunit.client.1.smithi203.stdout:6/203: read - d0/d32/f3a zero size 2024-09-11T00:07:08.390 INFO:tasks.workunit.client.1.smithi203.stdout:6/204: chown d0/d27/f18 689190 1 2024-09-11T00:07:08.390 INFO:tasks.workunit.client.0.smithi111.stdout:1/196: chown d2/de/d12/d34/l2a 1 1 2024-09-11T00:07:08.391 INFO:tasks.workunit.client.1.smithi203.stdout:9/230: creat d6/de/d19/d24/d40/d41/f4f x:0 0 0 2024-09-11T00:07:08.394 INFO:tasks.workunit.client.1.smithi203.stdout:0/267: symlink d0/d1d/l59 0 2024-09-11T00:07:08.394 INFO:tasks.workunit.client.0.smithi111.stdout:3/264: getdents d1c/d1d/d22/d31/d33 0 2024-09-11T00:07:08.395 INFO:tasks.workunit.client.0.smithi111.stdout:7/223: write dd/d1d/d1f/d24/f34 [597370,25745] 0 2024-09-11T00:07:08.397 INFO:tasks.workunit.client.0.smithi111.stdout:3/265: stat d1c/d1d/d22/d44/f4e 0 2024-09-11T00:07:08.397 INFO:tasks.workunit.client.0.smithi111.stdout:2/205: rmdir d0/d3/de 39 2024-09-11T00:07:08.400 INFO:tasks.workunit.client.1.smithi203.stdout:4/230: mkdir db/dd/d26/d42 0 2024-09-11T00:07:08.400 INFO:tasks.workunit.client.1.smithi203.stdout:1/308: sync 2024-09-11T00:07:08.402 INFO:tasks.workunit.client.0.smithi111.stdout:9/249: creat d6/db/f50 x:0 0 0 2024-09-11T00:07:08.403 INFO:tasks.workunit.client.1.smithi203.stdout:0/268: dread d0/d2/f8 [0,4194304] 0 2024-09-11T00:07:08.403 INFO:tasks.workunit.client.0.smithi111.stdout:4/187: mknod d18/d1f/c43 0 2024-09-11T00:07:08.403 INFO:tasks.workunit.client.0.smithi111.stdout:0/216: dread d3/dc/f12 [0,4194304] 0 2024-09-11T00:07:08.404 INFO:tasks.workunit.client.0.smithi111.stdout:9/250: fsync d6/db/d34/f47 0 2024-09-11T00:07:08.404 INFO:tasks.workunit.client.1.smithi203.stdout:3/383: mkdir d8/da/d5c/d6b/d8e 0 2024-09-11T00:07:08.405 INFO:tasks.workunit.client.0.smithi111.stdout:8/249: dwrite d11/d23/d2c/f3b [0,4194304] 0 2024-09-11T00:07:08.406 INFO:tasks.workunit.client.0.smithi111.stdout:1/197: symlink d2/d2b/l41 0 2024-09-11T00:07:08.407 INFO:tasks.workunit.client.0.smithi111.stdout:1/198: fsync d2/de/f29 0 2024-09-11T00:07:08.408 INFO:tasks.workunit.client.0.smithi111.stdout:7/224: mknod dd/d1d/d1f/c3e 0 2024-09-11T00:07:08.409 INFO:tasks.workunit.client.0.smithi111.stdout:4/188: read d18/f32 [3624131,78072] 0 2024-09-11T00:07:08.412 INFO:tasks.workunit.client.0.smithi111.stdout:4/189: rename d18 to d18/d1f/d36/d44 22 2024-09-11T00:07:08.415 INFO:tasks.workunit.client.1.smithi203.stdout:5/288: fdatasync dc/dd/d4d/d59/f46 0 2024-09-11T00:07:08.416 INFO:tasks.workunit.client.0.smithi111.stdout:3/266: dread d1c/d1d/f1e [0,4194304] 0 2024-09-11T00:07:08.418 INFO:tasks.workunit.client.1.smithi203.stdout:4/231: rmdir db/d12 39 2024-09-11T00:07:08.419 INFO:tasks.workunit.client.0.smithi111.stdout:5/237: truncate d10/d1e/d23/d30/d3c/f40 961464 0 2024-09-11T00:07:08.420 INFO:tasks.workunit.client.0.smithi111.stdout:8/250: symlink d11/d23/d2c/d46/l50 0 2024-09-11T00:07:08.422 INFO:tasks.workunit.client.1.smithi203.stdout:1/309: mknod d8/d19/c6f 0 2024-09-11T00:07:08.422 INFO:tasks.workunit.client.0.smithi111.stdout:5/238: write f5 [3425522,56041] 0 2024-09-11T00:07:08.423 INFO:tasks.workunit.client.1.smithi203.stdout:1/310: fdatasync d8/d19/d31/d36/f42 0 2024-09-11T00:07:08.424 INFO:tasks.workunit.client.1.smithi203.stdout:0/269: rmdir d0/d2/d3d 39 2024-09-11T00:07:08.429 INFO:tasks.workunit.client.1.smithi203.stdout:3/384: readlink d8/d3c/l52 0 2024-09-11T00:07:08.429 INFO:tasks.workunit.client.0.smithi111.stdout:2/206: creat d0/d3/de/f4a x:0 0 0 2024-09-11T00:07:08.430 INFO:tasks.workunit.client.0.smithi111.stdout:5/239: chown d10/d1e/d23/d26/f50 703532 1 2024-09-11T00:07:08.430 INFO:tasks.workunit.client.0.smithi111.stdout:9/251: dwrite d6/dc/f1f [0,4194304] 0 2024-09-11T00:07:08.430 INFO:tasks.workunit.client.0.smithi111.stdout:1/199: dwrite d2/de/f16 [0,4194304] 0 2024-09-11T00:07:08.431 INFO:tasks.workunit.client.1.smithi203.stdout:6/205: mkdir d0/d27/d35/d39/d3c 0 2024-09-11T00:07:08.433 INFO:tasks.workunit.client.1.smithi203.stdout:8/238: dwrite d1/fe [4194304,4194304] 0 2024-09-11T00:07:08.433 INFO:tasks.workunit.client.1.smithi203.stdout:6/206: chown d0/d27/d35/d39/d3c 86119080 1 2024-09-11T00:07:08.434 INFO:tasks.workunit.client.0.smithi111.stdout:3/267: creat d1c/d1d/d22/d31/d33/f59 x:0 0 0 2024-09-11T00:07:08.437 INFO:tasks.workunit.client.0.smithi111.stdout:8/251: creat d11/d21/d38/f51 x:0 0 0 2024-09-11T00:07:08.442 INFO:tasks.workunit.client.1.smithi203.stdout:5/289: write dc/dd/d15/d3b/f4c [4041461,105198] 0 2024-09-11T00:07:08.451 INFO:tasks.workunit.client.0.smithi111.stdout:7/225: write dd/f10 [1804559,82332] 0 2024-09-11T00:07:08.452 INFO:tasks.workunit.client.1.smithi203.stdout:5/290: write dc/dd/d1e/f54 [260202,69882] 0 2024-09-11T00:07:08.453 INFO:tasks.workunit.client.1.smithi203.stdout:1/311: dwrite d8/d28/d64/f65 [0,4194304] 0 2024-09-11T00:07:08.456 INFO:tasks.workunit.client.0.smithi111.stdout:1/200: readlink d2/de/d12/d34/l37 0 2024-09-11T00:07:08.459 INFO:tasks.workunit.client.0.smithi111.stdout:8/252: dwrite d11/f12 [4194304,4194304] 0 2024-09-11T00:07:08.459 INFO:tasks.workunit.client.1.smithi203.stdout:7/242: getdents dd/d3b 0 2024-09-11T00:07:08.462 INFO:tasks.workunit.client.0.smithi111.stdout:3/268: mkdir d1c/d1d/d22/d44/d5a 0 2024-09-11T00:07:08.462 INFO:tasks.workunit.client.0.smithi111.stdout:2/207: dwrite d0/d3/de/f43 [0,4194304] 0 2024-09-11T00:07:08.464 INFO:tasks.workunit.client.0.smithi111.stdout:2/208: chown d0/d3/d12/f3a 0 1 2024-09-11T00:07:08.465 INFO:tasks.workunit.client.0.smithi111.stdout:5/240: mkdir d10/d51/d52 0 2024-09-11T00:07:08.466 INFO:tasks.workunit.client.1.smithi203.stdout:9/231: dwrite d6/de/d19/d24/d40/d45/f39 [0,4194304] 0 2024-09-11T00:07:08.466 INFO:tasks.workunit.client.1.smithi203.stdout:4/232: dread db/dd/f2c [0,4194304] 0 2024-09-11T00:07:08.466 INFO:tasks.workunit.client.1.smithi203.stdout:3/385: chown d8/d17/c28 535814966 1 2024-09-11T00:07:08.467 INFO:tasks.workunit.client.1.smithi203.stdout:6/207: mkdir d0/d27/d35/d39/d3d 0 2024-09-11T00:07:08.468 INFO:tasks.workunit.client.1.smithi203.stdout:2/180: dwrite d13/d15/d19/d1c/f27 [0,4194304] 0 2024-09-11T00:07:08.470 INFO:tasks.workunit.client.1.smithi203.stdout:0/270: mkdir d0/d2/d3d/d5a 0 2024-09-11T00:07:08.473 INFO:tasks.workunit.client.1.smithi203.stdout:9/232: chown d6/de/f20 4286 1 2024-09-11T00:07:08.474 INFO:tasks.workunit.client.1.smithi203.stdout:6/208: truncate d0/f25 287321 0 2024-09-11T00:07:08.475 INFO:tasks.workunit.client.1.smithi203.stdout:9/233: fsync d6/f46 0 2024-09-11T00:07:08.476 INFO:tasks.workunit.client.1.smithi203.stdout:5/291: symlink dc/dd/d4d/d59/l5a 0 2024-09-11T00:07:08.479 INFO:tasks.workunit.client.1.smithi203.stdout:2/181: write f11 [2893658,14034] 0 2024-09-11T00:07:08.480 INFO:tasks.workunit.client.1.smithi203.stdout:6/209: chown d0/f4 25 1 2024-09-11T00:07:08.480 INFO:tasks.workunit.client.1.smithi203.stdout:7/243: mkdir dd/d1c/d26/d31/d58 0 2024-09-11T00:07:08.480 INFO:tasks.workunit.client.0.smithi111.stdout:7/226: creat dd/d1d/d1f/f3f x:0 0 0 2024-09-11T00:07:08.484 INFO:tasks.workunit.client.1.smithi203.stdout:7/244: write dd/f22 [706665,101501] 0 2024-09-11T00:07:08.491 INFO:tasks.workunit.client.1.smithi203.stdout:1/312: creat d8/d9/d15/d30/d3e/d4b/d41/f70 x:0 0 0 2024-09-11T00:07:08.492 INFO:tasks.workunit.client.0.smithi111.stdout:1/201: creat d2/d2b/d2c/f42 x:0 0 0 2024-09-11T00:07:08.492 INFO:tasks.workunit.client.0.smithi111.stdout:8/253: creat d11/d21/d38/f52 x:0 0 0 2024-09-11T00:07:08.494 INFO:tasks.workunit.client.1.smithi203.stdout:0/271: fdatasync d0/d2/f32 0 2024-09-11T00:07:08.496 INFO:tasks.workunit.client.0.smithi111.stdout:3/269: rename d1c/d1d/f41 to d1c/d1d/d22/f5b 0 2024-09-11T00:07:08.498 INFO:tasks.workunit.client.0.smithi111.stdout:3/270: read d1c/f24 [805586,49274] 0 2024-09-11T00:07:08.500 INFO:tasks.workunit.client.0.smithi111.stdout:3/271: write d1c/d1d/f20 [4882073,127406] 0 2024-09-11T00:07:08.503 INFO:tasks.workunit.client.0.smithi111.stdout:6/169: sync 2024-09-11T00:07:08.505 INFO:tasks.workunit.client.0.smithi111.stdout:2/209: mkdir d0/d3/de/d4b 0 2024-09-11T00:07:08.506 INFO:tasks.workunit.client.1.smithi203.stdout:7/245: dwrite dd/f12 [0,4194304] 0 2024-09-11T00:07:08.506 INFO:tasks.workunit.client.0.smithi111.stdout:4/190: link d18/d1f/l37 d18/d1f/l45 0 2024-09-11T00:07:08.507 INFO:tasks.workunit.client.0.smithi111.stdout:4/191: write d18/f1b [820708,60949] 0 2024-09-11T00:07:08.509 INFO:tasks.workunit.client.1.smithi203.stdout:9/234: read d6/de/d19/d24/d40/d45/f15 [1562329,26892] 0 2024-09-11T00:07:08.510 INFO:tasks.workunit.client.0.smithi111.stdout:9/252: link l1 d6/db/d34/l51 0 2024-09-11T00:07:08.517 INFO:tasks.workunit.client.1.smithi203.stdout:6/210: creat d0/d27/d35/f3e x:0 0 0 2024-09-11T00:07:08.517 INFO:tasks.workunit.client.0.smithi111.stdout:8/254: mkdir d11/d23/d2c/d53 0 2024-09-11T00:07:08.518 INFO:tasks.workunit.client.0.smithi111.stdout:3/272: dwrite d1c/d1d/d22/d31/d33/f36 [0,4194304] 0 2024-09-11T00:07:08.520 INFO:tasks.workunit.client.1.smithi203.stdout:6/211: truncate d0/d32/f34 1037913 0 2024-09-11T00:07:08.523 INFO:tasks.workunit.client.0.smithi111.stdout:0/217: sync 2024-09-11T00:07:08.523 INFO:tasks.workunit.client.0.smithi111.stdout:7/227: rename dd/d1d/d1f/d24/f34 to dd/d1d/d2d/d2e/f40 0 2024-09-11T00:07:08.524 INFO:tasks.workunit.client.1.smithi203.stdout:1/313: rename d8/d19/d31/l6c to d8/d9/d15/d35/l71 0 2024-09-11T00:07:08.527 INFO:tasks.workunit.client.1.smithi203.stdout:1/314: chown d8/l37 2300 1 2024-09-11T00:07:08.530 INFO:tasks.workunit.client.0.smithi111.stdout:9/253: dwrite d6/db/d1b/f4b [0,4194304] 0 2024-09-11T00:07:08.535 INFO:tasks.workunit.client.1.smithi203.stdout:4/233: creat db/dd/d16/d38/d3c/d41/f43 x:0 0 0 2024-09-11T00:07:08.538 INFO:tasks.workunit.client.1.smithi203.stdout:4/234: fsync db/f23 0 2024-09-11T00:07:08.542 INFO:tasks.workunit.client.1.smithi203.stdout:0/272: dread d0/d2/f12 [0,4194304] 0 2024-09-11T00:07:08.543 INFO:tasks.workunit.client.0.smithi111.stdout:4/192: fdatasync d18/f32 0 2024-09-11T00:07:08.545 INFO:tasks.workunit.client.1.smithi203.stdout:0/273: write d0/d2/fd [2190760,81956] 0 2024-09-11T00:07:08.549 INFO:tasks.workunit.client.0.smithi111.stdout:8/255: mkdir d11/d21/d38/d54 0 2024-09-11T00:07:08.549 INFO:tasks.workunit.client.1.smithi203.stdout:1/315: dwrite d8/d9/d15/d30/d3e/d66/f6e [0,4194304] 0 2024-09-11T00:07:08.551 INFO:tasks.workunit.client.0.smithi111.stdout:5/241: write d10/d1e/d25/f29 [1092300,81301] 0 2024-09-11T00:07:08.552 INFO:tasks.workunit.client.0.smithi111.stdout:5/242: readlink d10/l12 0 2024-09-11T00:07:08.554 INFO:tasks.workunit.client.1.smithi203.stdout:3/386: link d8/d17/c4f d8/da/d37/d83/c8f 0 2024-09-11T00:07:08.556 INFO:tasks.workunit.client.0.smithi111.stdout:7/228: mknod dd/d1d/d1f/d24/c41 0 2024-09-11T00:07:08.557 INFO:tasks.workunit.client.1.smithi203.stdout:9/235: symlink d6/de/l50 0 2024-09-11T00:07:08.557 INFO:tasks.workunit.client.1.smithi203.stdout:3/387: dread - d8/da/d37/d83/d6a/f8c zero size 2024-09-11T00:07:08.558 INFO:tasks.workunit.client.0.smithi111.stdout:2/210: write d0/d3/de/f44 [1463452,48793] 0 2024-09-11T00:07:08.560 INFO:tasks.workunit.client.1.smithi203.stdout:7/246: link dd/d1c/d26/d31/f50 dd/d1c/d4b/f59 0 2024-09-11T00:07:08.560 INFO:tasks.workunit.client.1.smithi203.stdout:9/236: read d6/de/d19/d24/f2d [2846590,111548] 0 2024-09-11T00:07:08.563 INFO:tasks.workunit.client.1.smithi203.stdout:2/182: creat d13/d15/f32 x:0 0 0 2024-09-11T00:07:08.566 INFO:tasks.workunit.client.0.smithi111.stdout:9/254: dread d6/db/d34/d37/f28 [0,4194304] 0 2024-09-11T00:07:08.567 INFO:tasks.workunit.client.1.smithi203.stdout:8/239: link d1/d13/l3e d1/d13/l56 0 2024-09-11T00:07:08.567 INFO:tasks.workunit.client.0.smithi111.stdout:6/170: creat d7/d2b/d35/f3a x:0 0 0 2024-09-11T00:07:08.568 INFO:tasks.workunit.client.0.smithi111.stdout:1/202: creat d2/de/f43 x:0 0 0 2024-09-11T00:07:08.569 INFO:tasks.workunit.client.1.smithi203.stdout:0/274: mkdir d0/d2/d37/d5b 0 2024-09-11T00:07:08.569 INFO:tasks.workunit.client.1.smithi203.stdout:8/240: chown d1/d13/d17/l1a 47341 1 2024-09-11T00:07:08.570 INFO:tasks.workunit.client.1.smithi203.stdout:1/316: dwrite d8/d9/f1c [0,4194304] 0 2024-09-11T00:07:08.570 INFO:tasks.workunit.client.0.smithi111.stdout:6/171: dread d7/f12 [0,4194304] 0 2024-09-11T00:07:08.570 INFO:tasks.workunit.client.0.smithi111.stdout:4/193: creat d18/d20/f46 x:0 0 0 2024-09-11T00:07:08.572 INFO:tasks.workunit.client.1.smithi203.stdout:1/317: write d8/d9/f5c [121138,126171] 0 2024-09-11T00:07:08.574 INFO:tasks.workunit.client.1.smithi203.stdout:1/318: fdatasync d8/d28/d64/f65 0 2024-09-11T00:07:08.583 INFO:tasks.workunit.client.0.smithi111.stdout:4/194: dwrite f14 [0,4194304] 0 2024-09-11T00:07:08.587 INFO:tasks.workunit.client.0.smithi111.stdout:1/203: dread d2/fd [0,4194304] 0 2024-09-11T00:07:08.588 INFO:tasks.workunit.client.0.smithi111.stdout:1/204: chown d2/l1e 594 1 2024-09-11T00:07:08.594 INFO:tasks.workunit.client.0.smithi111.stdout:3/273: mkdir d1c/d1d/d22/d23/d58/d5c 0 2024-09-11T00:07:08.595 INFO:tasks.workunit.client.1.smithi203.stdout:4/235: dwrite db/d12/d15/f2d [0,4194304] 0 2024-09-11T00:07:08.599 INFO:tasks.workunit.client.1.smithi203.stdout:5/292: getdents dc/dd 0 2024-09-11T00:07:08.599 INFO:tasks.workunit.client.1.smithi203.stdout:4/236: chown db/d12/d15/c36 121514 1 2024-09-11T00:07:08.602 INFO:tasks.workunit.client.1.smithi203.stdout:3/388: creat d8/da/d34/f90 x:0 0 0 2024-09-11T00:07:08.606 INFO:tasks.workunit.client.1.smithi203.stdout:7/247: fsync dd/f30 0 2024-09-11T00:07:08.611 INFO:tasks.workunit.client.0.smithi111.stdout:9/255: mkdir d6/d52 0 2024-09-11T00:07:08.612 INFO:tasks.workunit.client.0.smithi111.stdout:5/243: write d10/d1e/d23/d26/f3e [546708,42518] 0 2024-09-11T00:07:08.613 INFO:tasks.workunit.client.0.smithi111.stdout:8/256: creat d11/d23/d2c/d53/f55 x:0 0 0 2024-09-11T00:07:08.615 INFO:tasks.workunit.client.0.smithi111.stdout:6/172: mknod d7/d22/d1d/c3b 0 2024-09-11T00:07:08.617 INFO:tasks.workunit.client.1.smithi203.stdout:1/319: unlink d8/d19/f1b 0 2024-09-11T00:07:08.617 INFO:tasks.workunit.client.0.smithi111.stdout:4/195: rmdir d18/d20/d40 39 2024-09-11T00:07:08.620 INFO:tasks.workunit.client.1.smithi203.stdout:4/237: mknod db/dd/c44 0 2024-09-11T00:07:08.621 INFO:tasks.workunit.client.1.smithi203.stdout:6/212: dwrite d0/f8 [0,4194304] 0 2024-09-11T00:07:08.623 INFO:tasks.workunit.client.0.smithi111.stdout:0/218: truncate d3/d13/f17 250072 0 2024-09-11T00:07:08.624 INFO:tasks.workunit.client.1.smithi203.stdout:3/389: dwrite d8/da/d11/f89 [0,4194304] 0 2024-09-11T00:07:08.626 INFO:tasks.workunit.client.1.smithi203.stdout:9/237: creat d6/de/d19/d30/f51 x:0 0 0 2024-09-11T00:07:08.629 INFO:tasks.workunit.client.0.smithi111.stdout:5/244: dwrite d10/d1e/d23/d30/f37 [0,4194304] 0 2024-09-11T00:07:08.630 INFO:tasks.workunit.client.0.smithi111.stdout:5/245: chown d10/d1e/d25/f29 189662484 1 2024-09-11T00:07:08.632 INFO:tasks.workunit.client.0.smithi111.stdout:8/257: symlink d11/d21/d38/l56 0 2024-09-11T00:07:08.633 INFO:tasks.workunit.client.1.smithi203.stdout:1/320: symlink d8/d9/d15/d30/d3e/d66/l72 0 2024-09-11T00:07:08.636 INFO:tasks.workunit.client.1.smithi203.stdout:5/293: symlink dc/dd/d15/l5b 0 2024-09-11T00:07:08.636 INFO:tasks.workunit.client.1.smithi203.stdout:1/321: write d8/d9/d15/d30/d3e/d4b/d41/f70 [543789,99457] 0 2024-09-11T00:07:08.637 INFO:tasks.workunit.client.1.smithi203.stdout:6/213: creat d0/d27/d35/f3f x:0 0 0 2024-09-11T00:07:08.638 INFO:tasks.workunit.client.0.smithi111.stdout:7/229: link c3 dd/d1d/d2d/d2e/c42 0 2024-09-11T00:07:08.639 INFO:tasks.workunit.client.1.smithi203.stdout:6/214: fsync d0/f14 0 2024-09-11T00:07:08.639 INFO:tasks.workunit.client.1.smithi203.stdout:9/238: rmdir d6/de/d47 39 2024-09-11T00:07:08.640 INFO:tasks.workunit.client.1.smithi203.stdout:1/322: fdatasync d8/d9/f5c 0 2024-09-11T00:07:08.642 INFO:tasks.workunit.client.1.smithi203.stdout:1/323: fsync d8/d9/f1c 0 2024-09-11T00:07:08.643 INFO:tasks.workunit.client.0.smithi111.stdout:4/196: mknod d18/d20/c47 0 2024-09-11T00:07:08.643 INFO:tasks.workunit.client.1.smithi203.stdout:9/239: fsync d6/de/d19/d24/d40/d41/f4b 0 2024-09-11T00:07:08.644 INFO:tasks.workunit.client.1.smithi203.stdout:1/324: chown d8/d19/d60 28 1 2024-09-11T00:07:08.646 INFO:tasks.workunit.client.0.smithi111.stdout:8/258: write d11/d21/d38/f47 [4740503,31070] 0 2024-09-11T00:07:08.647 INFO:tasks.workunit.client.0.smithi111.stdout:4/197: write d18/d20/f30 [1087803,88195] 0 2024-09-11T00:07:08.649 INFO:tasks.workunit.client.1.smithi203.stdout:4/238: creat db/dd/d26/d42/f45 x:0 0 0 2024-09-11T00:07:08.650 INFO:tasks.workunit.client.1.smithi203.stdout:9/240: write d6/de/f20 [3507322,129785] 0 2024-09-11T00:07:08.651 INFO:tasks.workunit.client.0.smithi111.stdout:8/259: write d11/d21/f31 [1691098,31168] 0 2024-09-11T00:07:08.654 INFO:tasks.workunit.client.0.smithi111.stdout:1/205: rmdir d2/de/d12/d36 0 2024-09-11T00:07:08.654 INFO:tasks.workunit.client.1.smithi203.stdout:0/275: getdents d0/d2 0 2024-09-11T00:07:08.654 INFO:tasks.workunit.client.1.smithi203.stdout:9/241: chown f5 3035 1 2024-09-11T00:07:08.655 INFO:tasks.workunit.client.1.smithi203.stdout:9/242: dread - d6/f46 zero size 2024-09-11T00:07:08.656 INFO:tasks.workunit.client.1.smithi203.stdout:0/276: readlink d0/d1d/l31 0 2024-09-11T00:07:08.657 INFO:tasks.workunit.client.0.smithi111.stdout:1/206: read d2/d2b/f3e [2856472,4045] 0 2024-09-11T00:07:08.657 INFO:tasks.workunit.client.1.smithi203.stdout:5/294: unlink dc/dd/d4d/d59/l5a 0 2024-09-11T00:07:08.658 INFO:tasks.workunit.client.0.smithi111.stdout:7/230: dwrite dd/d1d/d1f/f23 [0,4194304] 0 2024-09-11T00:07:08.658 INFO:tasks.workunit.client.0.smithi111.stdout:1/207: dread - d2/de/d12/f28 zero size 2024-09-11T00:07:08.660 INFO:tasks.workunit.client.1.smithi203.stdout:5/295: chown dc/dd/d1e/l31 5969 1 2024-09-11T00:07:08.660 INFO:tasks.workunit.client.0.smithi111.stdout:1/208: fsync d2/de/d12/f1c 0 2024-09-11T00:07:08.662 INFO:tasks.workunit.client.1.smithi203.stdout:5/296: chown dc/l1b 16 1 2024-09-11T00:07:08.663 INFO:tasks.workunit.client.0.smithi111.stdout:2/211: rename d0/d3/d39/c3c to d0/c4c 0 2024-09-11T00:07:08.664 INFO:tasks.workunit.client.1.smithi203.stdout:8/241: getdents d1/d13/d17/d2f 0 2024-09-11T00:07:08.666 INFO:tasks.workunit.client.0.smithi111.stdout:2/212: write d0/d3/d12/f41 [369918,48439] 0 2024-09-11T00:07:08.666 INFO:tasks.workunit.client.0.smithi111.stdout:2/213: fsync d0/f22 0 2024-09-11T00:07:08.667 INFO:tasks.workunit.client.1.smithi203.stdout:5/297: truncate dc/dd/d1e/f54 958579 0 2024-09-11T00:07:08.667 INFO:tasks.workunit.client.0.smithi111.stdout:2/214: stat d0/cb 0 2024-09-11T00:07:08.668 INFO:tasks.workunit.client.0.smithi111.stdout:0/219: dread d3/da/f1d [0,4194304] 0 2024-09-11T00:07:08.669 INFO:tasks.workunit.client.0.smithi111.stdout:0/220: chown f2 661 1 2024-09-11T00:07:08.673 INFO:tasks.workunit.client.1.smithi203.stdout:3/390: creat d8/da/d37/d53/d63/f91 x:0 0 0 2024-09-11T00:07:08.674 INFO:tasks.workunit.client.0.smithi111.stdout:4/198: readlink d18/d1f/l37 0 2024-09-11T00:07:08.676 INFO:tasks.workunit.client.1.smithi203.stdout:7/248: getdents dd/d1c 0 2024-09-11T00:07:08.677 INFO:tasks.workunit.client.0.smithi111.stdout:8/260: creat d11/d21/d38/f57 x:0 0 0 2024-09-11T00:07:08.682 INFO:tasks.workunit.client.0.smithi111.stdout:7/231: symlink dd/d1d/l43 0 2024-09-11T00:07:08.682 INFO:tasks.workunit.client.1.smithi203.stdout:1/325: mknod d8/d19/d31/c73 0 2024-09-11T00:07:08.683 INFO:tasks.workunit.client.0.smithi111.stdout:5/246: truncate d10/d1e/d25/f2d 864853 0 2024-09-11T00:07:08.684 INFO:tasks.workunit.client.0.smithi111.stdout:5/247: stat d10/d1e/l24 0 2024-09-11T00:07:08.684 INFO:tasks.workunit.client.0.smithi111.stdout:1/209: rmdir d2/de/d12/d39/d3a 39 2024-09-11T00:07:08.684 INFO:tasks.workunit.client.1.smithi203.stdout:1/326: write d8/d19/d31/f59 [260400,126965] 0 2024-09-11T00:07:08.686 INFO:tasks.workunit.client.0.smithi111.stdout:1/210: write d2/de/d12/f1c [546649,67878] 0 2024-09-11T00:07:08.686 INFO:tasks.workunit.client.0.smithi111.stdout:3/274: rename d1c/d21/c27 to d1c/d1d/d22/d31/c5d 0 2024-09-11T00:07:08.689 INFO:tasks.workunit.client.1.smithi203.stdout:9/243: rename d6/de/d19/d24/d40/d41 to d6/de/d32/d52 0 2024-09-11T00:07:08.690 INFO:tasks.workunit.client.1.smithi203.stdout:9/244: write d6/f46 [319180,30783] 0 2024-09-11T00:07:08.690 INFO:tasks.workunit.client.1.smithi203.stdout:8/242: creat d1/d13/d43/f57 x:0 0 0 2024-09-11T00:07:08.693 INFO:tasks.workunit.client.0.smithi111.stdout:2/215: mknod d0/d3/d2e/c4d 0 2024-09-11T00:07:08.695 INFO:tasks.workunit.client.1.smithi203.stdout:6/215: getdents d0/d27/d35/d39/d3d 0 2024-09-11T00:07:08.695 INFO:tasks.workunit.client.0.smithi111.stdout:2/216: truncate d0/d3/d12/f41 4929621 0 2024-09-11T00:07:08.697 INFO:tasks.workunit.client.0.smithi111.stdout:2/217: write d0/d3/d12/f3d [482346,107440] 0 2024-09-11T00:07:08.700 INFO:tasks.workunit.client.0.smithi111.stdout:8/261: mknod d11/d23/d2c/d53/c58 0 2024-09-11T00:07:08.701 INFO:tasks.workunit.client.0.smithi111.stdout:8/262: dread - d11/d23/d3d/f44 zero size 2024-09-11T00:07:08.706 INFO:tasks.workunit.client.1.smithi203.stdout:8/243: creat d1/d13/d22/f58 x:0 0 0 2024-09-11T00:07:08.706 INFO:tasks.workunit.client.1.smithi203.stdout:4/239: write f9 [1248451,36559] 0 2024-09-11T00:07:08.708 INFO:tasks.workunit.client.1.smithi203.stdout:9/245: unlink d6/de/d19/d24/d40/f4e 0 2024-09-11T00:07:08.710 INFO:tasks.workunit.client.0.smithi111.stdout:6/173: rename d7/d22/l2f to d7/d2b/l3c 0 2024-09-11T00:07:08.710 INFO:tasks.workunit.client.0.smithi111.stdout:9/256: rename d6/dc to d6/dc/d53 22 2024-09-11T00:07:08.711 INFO:tasks.workunit.client.1.smithi203.stdout:7/249: creat dd/d4d/f5a x:0 0 0 2024-09-11T00:07:08.711 INFO:tasks.workunit.client.1.smithi203.stdout:1/327: write d8/d19/f26 [1329742,13227] 0 2024-09-11T00:07:08.711 INFO:tasks.workunit.client.0.smithi111.stdout:6/174: chown d7/d22/d1d/f21 1 1 2024-09-11T00:07:08.719 INFO:tasks.workunit.client.1.smithi203.stdout:8/244: unlink d1/d13/d43/l55 0 2024-09-11T00:07:08.720 INFO:tasks.workunit.client.0.smithi111.stdout:5/248: fsync d10/d1e/d23/d30/d3c/f40 0 2024-09-11T00:07:08.724 INFO:tasks.workunit.client.0.smithi111.stdout:9/257: chown d6/db/d1b/c2f 27 1 2024-09-11T00:07:08.724 INFO:tasks.workunit.client.0.smithi111.stdout:1/211: mknod d2/de/d12/d3c/c44 0 2024-09-11T00:07:08.725 INFO:tasks.workunit.client.1.smithi203.stdout:0/277: getdents d0/d2/d3d 0 2024-09-11T00:07:08.728 INFO:tasks.workunit.client.0.smithi111.stdout:4/199: dwrite d18/d1f/d33/f3d [0,4194304] 0 2024-09-11T00:07:08.729 INFO:tasks.workunit.client.1.smithi203.stdout:1/328: mknod d8/d9/d15/d30/d3e/d4b/c74 0 2024-09-11T00:07:08.730 INFO:tasks.workunit.client.0.smithi111.stdout:4/200: dread - d18/d2b/f2f zero size 2024-09-11T00:07:08.734 INFO:tasks.workunit.client.1.smithi203.stdout:5/298: getdents dc/dd/d15 0 2024-09-11T00:07:08.735 INFO:tasks.workunit.client.0.smithi111.stdout:7/232: truncate fa 1660814 0 2024-09-11T00:07:08.738 INFO:tasks.workunit.client.0.smithi111.stdout:3/275: creat d1c/f5e x:0 0 0 2024-09-11T00:07:08.742 INFO:tasks.workunit.client.1.smithi203.stdout:5/299: write dc/d4f/f50 [3550431,13020] 0 2024-09-11T00:07:08.742 INFO:tasks.workunit.client.1.smithi203.stdout:4/240: getdents db/d12/d15/d2a 0 2024-09-11T00:07:08.748 INFO:tasks.workunit.client.1.smithi203.stdout:9/246: creat d6/de/d19/f53 x:0 0 0 2024-09-11T00:07:08.750 INFO:tasks.workunit.client.0.smithi111.stdout:6/175: mkdir d7/d22/d2c/d38/d39/d3d 0 2024-09-11T00:07:08.750 INFO:tasks.workunit.client.0.smithi111.stdout:6/176: stat d7/la 0 2024-09-11T00:07:08.751 INFO:tasks.workunit.client.1.smithi203.stdout:4/241: dread - db/dd/d16/d38/d3c/d41/f43 zero size 2024-09-11T00:07:08.751 INFO:tasks.workunit.client.1.smithi203.stdout:7/250: dread dd/f18 [0,4194304] 0 2024-09-11T00:07:08.752 INFO:tasks.workunit.client.0.smithi111.stdout:2/218: creat d0/d3/f4e x:0 0 0 2024-09-11T00:07:08.753 INFO:tasks.workunit.client.1.smithi203.stdout:6/216: getdents d0 0 2024-09-11T00:07:08.753 INFO:tasks.workunit.client.0.smithi111.stdout:2/219: write d0/fc [938570,105813] 0 2024-09-11T00:07:08.754 INFO:tasks.workunit.client.0.smithi111.stdout:8/263: link ca d11/d23/d3d/c59 0 2024-09-11T00:07:08.755 INFO:tasks.workunit.client.0.smithi111.stdout:2/220: read - d0/d3/d12/f3a zero size 2024-09-11T00:07:08.757 INFO:tasks.workunit.client.0.smithi111.stdout:0/221: sync 2024-09-11T00:07:08.760 INFO:tasks.workunit.client.0.smithi111.stdout:9/258: write d6/db/d1b/f1e [3486322,99938] 0 2024-09-11T00:07:08.761 INFO:tasks.workunit.client.1.smithi203.stdout:0/278: dwrite d0/d2/f40 [0,4194304] 0 2024-09-11T00:07:08.761 INFO:tasks.workunit.client.0.smithi111.stdout:7/233: mkdir dd/d1d/d44 0 2024-09-11T00:07:08.767 INFO:tasks.workunit.client.1.smithi203.stdout:1/329: dread d8/d11/f20 [0,4194304] 0 2024-09-11T00:07:08.769 INFO:tasks.workunit.client.1.smithi203.stdout:6/217: rename d0/f2c to d0/d27/f40 0 2024-09-11T00:07:08.769 INFO:tasks.workunit.client.1.smithi203.stdout:8/245: getdents d1/d13/d17/d2f/d52/d49 0 2024-09-11T00:07:08.771 INFO:tasks.workunit.client.1.smithi203.stdout:4/242: truncate db/dd/d16/d38/d3c/d41/f43 460007 0 2024-09-11T00:07:08.772 INFO:tasks.workunit.client.1.smithi203.stdout:8/246: fsync d1/d13/d17/f42 0 2024-09-11T00:07:08.774 INFO:tasks.workunit.client.0.smithi111.stdout:6/177: fsync f0 0 2024-09-11T00:07:08.777 INFO:tasks.workunit.client.1.smithi203.stdout:8/247: write d1/d13/d17/f42 [577992,77505] 0 2024-09-11T00:07:08.778 INFO:tasks.workunit.client.0.smithi111.stdout:3/276: dwrite d1c/d1d/d22/f5b [0,4194304] 0 2024-09-11T00:07:08.778 INFO:tasks.workunit.client.0.smithi111.stdout:0/222: write f2 [4938422,123569] 0 2024-09-11T00:07:08.779 INFO:tasks.workunit.client.1.smithi203.stdout:4/243: truncate db/dd/f11 1391171 0 2024-09-11T00:07:08.779 INFO:tasks.workunit.client.0.smithi111.stdout:9/259: dwrite d6/db/d34/f3d [0,4194304] 0 2024-09-11T00:07:08.781 INFO:tasks.workunit.client.1.smithi203.stdout:0/279: creat d0/f5c x:0 0 0 2024-09-11T00:07:08.783 INFO:tasks.workunit.client.0.smithi111.stdout:1/212: creat d2/f45 x:0 0 0 2024-09-11T00:07:08.784 INFO:tasks.workunit.client.0.smithi111.stdout:6/178: symlink d7/d2b/l3e 0 2024-09-11T00:07:08.785 INFO:tasks.workunit.client.1.smithi203.stdout:9/247: dwrite f5 [0,4194304] 0 2024-09-11T00:07:08.785 INFO:tasks.workunit.client.1.smithi203.stdout:0/280: readlink d0/d1d/l25 0 2024-09-11T00:07:08.785 INFO:tasks.workunit.client.0.smithi111.stdout:2/221: link d0/d3/f1c d0/d3/d2e/f4f 0 2024-09-11T00:07:08.788 INFO:tasks.workunit.client.0.smithi111.stdout:2/222: stat d0/d3/d12/f3d 0 2024-09-11T00:07:08.790 INFO:tasks.workunit.client.0.smithi111.stdout:2/223: chown d0/d3/d39/l42 18 1 2024-09-11T00:07:08.793 INFO:tasks.workunit.client.1.smithi203.stdout:8/248: unlink d1/l34 0 2024-09-11T00:07:08.794 INFO:tasks.workunit.client.1.smithi203.stdout:1/330: dwrite d8/d9/f5c [0,4194304] 0 2024-09-11T00:07:08.794 INFO:tasks.workunit.client.0.smithi111.stdout:0/223: symlink d3/d26/l57 0 2024-09-11T00:07:08.801 INFO:tasks.workunit.client.0.smithi111.stdout:5/249: dwrite d10/d1e/d25/f2d [0,4194304] 0 2024-09-11T00:07:08.806 INFO:tasks.workunit.client.1.smithi203.stdout:5/300: truncate dc/dd/d15/f19 2162299 0 2024-09-11T00:07:08.811 INFO:tasks.workunit.client.0.smithi111.stdout:9/260: write d6/db/d1b/d41/f42 [1223019,34957] 0 2024-09-11T00:07:08.813 INFO:tasks.workunit.client.0.smithi111.stdout:4/201: dwrite d18/f29 [0,4194304] 0 2024-09-11T00:07:08.814 INFO:tasks.workunit.client.1.smithi203.stdout:9/248: dread d6/de/d19/d24/f36 [0,4194304] 0 2024-09-11T00:07:08.815 INFO:tasks.workunit.client.0.smithi111.stdout:3/277: mkdir d1c/d1d/d22/d31/d33/d5f 0 2024-09-11T00:07:08.818 INFO:tasks.workunit.client.1.smithi203.stdout:4/244: dwrite db/dd/d16/d38/d3c/d41/f43 [0,4194304] 0 2024-09-11T00:07:08.819 INFO:tasks.workunit.client.1.smithi203.stdout:8/249: mkdir d1/d13/d17/d2f/d52/d59 0 2024-09-11T00:07:08.823 INFO:tasks.workunit.client.1.smithi203.stdout:7/251: dwrite dd/d1c/d26/f4f [0,4194304] 0 2024-09-11T00:07:08.824 INFO:tasks.workunit.client.0.smithi111.stdout:3/278: read fb [4118298,9823] 0 2024-09-11T00:07:08.827 INFO:tasks.workunit.client.1.smithi203.stdout:7/252: stat dd/d1c 0 2024-09-11T00:07:08.831 INFO:tasks.workunit.client.0.smithi111.stdout:3/279: truncate d1c/d1d/d22/d31/d33/f39 347238 0 2024-09-11T00:07:08.832 INFO:tasks.workunit.client.0.smithi111.stdout:3/280: stat d1c/c37 0 2024-09-11T00:07:08.832 INFO:tasks.workunit.client.0.smithi111.stdout:2/224: mkdir d0/d3/de/d50 0 2024-09-11T00:07:08.835 INFO:tasks.workunit.client.0.smithi111.stdout:3/281: write ff [4223854,49814] 0 2024-09-11T00:07:08.840 INFO:tasks.workunit.client.0.smithi111.stdout:0/224: rename d3/d1c/l48 to d3/d13/d1e/l58 0 2024-09-11T00:07:08.840 INFO:tasks.workunit.client.0.smithi111.stdout:6/179: write f6 [724581,91447] 0 2024-09-11T00:07:08.841 INFO:tasks.workunit.client.0.smithi111.stdout:0/225: fsync d3/d13/d1e/d29/f53 0 2024-09-11T00:07:08.842 INFO:tasks.workunit.client.1.smithi203.stdout:5/301: mkdir dc/d4f/d5c 0 2024-09-11T00:07:08.843 INFO:tasks.workunit.client.0.smithi111.stdout:5/250: mkdir d10/d51/d53 0 2024-09-11T00:07:08.845 INFO:tasks.workunit.client.0.smithi111.stdout:5/251: write f1 [1284445,33639] 0 2024-09-11T00:07:08.846 INFO:tasks.workunit.client.0.smithi111.stdout:7/234: fdatasync fa 0 2024-09-11T00:07:08.849 INFO:tasks.workunit.client.1.smithi203.stdout:9/249: unlink d6/de/d19/d24/f2d 0 2024-09-11T00:07:08.850 INFO:tasks.workunit.client.1.smithi203.stdout:8/250: symlink d1/d13/d17/d48/l5a 0 2024-09-11T00:07:08.851 INFO:tasks.workunit.client.0.smithi111.stdout:8/264: sync 2024-09-11T00:07:08.852 INFO:tasks.workunit.client.0.smithi111.stdout:8/265: read - d11/d23/d2c/f45 zero size 2024-09-11T00:07:08.853 INFO:tasks.workunit.client.1.smithi203.stdout:9/250: chown d6/de/f20 996747 1 2024-09-11T00:07:08.853 INFO:tasks.workunit.client.1.smithi203.stdout:7/253: mkdir dd/d3b/d5b 0 2024-09-11T00:07:08.854 INFO:tasks.workunit.client.1.smithi203.stdout:8/251: dread - d1/d13/d17/d48/f53 zero size 2024-09-11T00:07:08.857 INFO:tasks.workunit.client.1.smithi203.stdout:1/331: dread d8/d9/d15/f47 [0,4194304] 0 2024-09-11T00:07:08.857 INFO:tasks.workunit.client.1.smithi203.stdout:9/251: write d6/de/f20 [3442089,67062] 0 2024-09-11T00:07:08.858 INFO:tasks.workunit.client.1.smithi203.stdout:6/218: truncate d0/f1 588663 0 2024-09-11T00:07:08.858 INFO:tasks.workunit.client.0.smithi111.stdout:4/202: rename d18/d1f/l37 to d18/d2b/l48 0 2024-09-11T00:07:08.860 INFO:tasks.workunit.client.1.smithi203.stdout:9/252: dread - d6/de/d19/f53 zero size 2024-09-11T00:07:08.861 INFO:tasks.workunit.client.0.smithi111.stdout:4/203: write d18/d1f/f25 [404448,75669] 0 2024-09-11T00:07:08.862 INFO:tasks.workunit.client.0.smithi111.stdout:4/204: write d18/f1b [812678,34147] 0 2024-09-11T00:07:08.865 INFO:tasks.workunit.client.0.smithi111.stdout:8/266: dread d11/f20 [0,4194304] 0 2024-09-11T00:07:08.865 INFO:tasks.workunit.client.0.smithi111.stdout:8/267: readlink d11/l2d 0 2024-09-11T00:07:08.866 INFO:tasks.workunit.client.0.smithi111.stdout:8/268: chown d11/f3c 202363 1 2024-09-11T00:07:08.867 INFO:tasks.workunit.client.0.smithi111.stdout:9/261: symlink d6/d52/l54 0 2024-09-11T00:07:08.868 INFO:tasks.workunit.client.0.smithi111.stdout:5/252: symlink d10/d1e/d23/d26/d3a/l54 0 2024-09-11T00:07:08.869 INFO:tasks.workunit.client.1.smithi203.stdout:6/219: fsync d0/f21 0 2024-09-11T00:07:08.870 INFO:tasks.workunit.client.0.smithi111.stdout:5/253: chown d10/d1e/d23/d26/d3a 47 1 2024-09-11T00:07:08.871 INFO:tasks.workunit.client.0.smithi111.stdout:5/254: write d10/f1b [944728,18101] 0 2024-09-11T00:07:08.874 INFO:tasks.workunit.client.1.smithi203.stdout:0/281: truncate d0/d2/fe 4534202 0 2024-09-11T00:07:08.874 INFO:tasks.workunit.client.1.smithi203.stdout:1/332: write d8/d9/d15/f47 [2181228,94590] 0 2024-09-11T00:07:08.875 INFO:tasks.workunit.client.0.smithi111.stdout:1/213: creat d2/de/d12/d39/f46 x:0 0 0 2024-09-11T00:07:08.878 INFO:tasks.workunit.client.1.smithi203.stdout:9/253: mkdir d6/de/d19/d24/d54 0 2024-09-11T00:07:08.882 INFO:tasks.workunit.client.0.smithi111.stdout:0/226: creat d3/d13/d1e/d29/d49/d51/f59 x:0 0 0 2024-09-11T00:07:08.887 INFO:tasks.workunit.client.1.smithi203.stdout:6/220: dread - d0/d27/d35/f3f zero size 2024-09-11T00:07:08.888 INFO:tasks.workunit.client.0.smithi111.stdout:7/235: rename dd/ff to dd/d1d/d1f/f45 0 2024-09-11T00:07:08.888 INFO:tasks.workunit.client.1.smithi203.stdout:6/221: write d0/d27/f18 [6238722,24300] 0 2024-09-11T00:07:08.889 INFO:tasks.workunit.client.0.smithi111.stdout:7/236: read dd/f1c [1620327,72091] 0 2024-09-11T00:07:08.890 INFO:tasks.workunit.client.1.smithi203.stdout:1/333: rmdir d8/d9/d15 39 2024-09-11T00:07:08.892 INFO:tasks.workunit.client.1.smithi203.stdout:0/282: mkdir d0/d1d/d5d 0 2024-09-11T00:07:08.893 INFO:tasks.workunit.client.0.smithi111.stdout:8/269: creat d11/d23/d2c/d53/f5a x:0 0 0 2024-09-11T00:07:08.897 INFO:tasks.workunit.client.1.smithi203.stdout:8/252: creat d1/f5b x:0 0 0 2024-09-11T00:07:08.901 INFO:tasks.workunit.client.1.smithi203.stdout:9/254: chown d6/de/d19/d21/c26 29564 1 2024-09-11T00:07:08.904 INFO:tasks.workunit.client.1.smithi203.stdout:7/254: getdents dd/d1c/d26/d31 0 2024-09-11T00:07:08.904 INFO:tasks.workunit.client.1.smithi203.stdout:9/255: dread - d6/de/d19/f3e zero size 2024-09-11T00:07:08.905 INFO:tasks.workunit.client.1.smithi203.stdout:7/255: readlink dd/l44 0 2024-09-11T00:07:08.906 INFO:tasks.workunit.client.0.smithi111.stdout:3/282: link f12 d1c/d1d/d22/f60 0 2024-09-11T00:07:08.906 INFO:tasks.workunit.client.1.smithi203.stdout:6/222: dread - d0/f4 zero size 2024-09-11T00:07:08.907 INFO:tasks.workunit.client.1.smithi203.stdout:5/302: dwrite dc/dd/d15/f37 [0,4194304] 0 2024-09-11T00:07:08.908 INFO:tasks.workunit.client.1.smithi203.stdout:9/256: fsync d6/de/d32/d52/f4f 0 2024-09-11T00:07:08.910 INFO:tasks.workunit.client.1.smithi203.stdout:9/257: chown d6/de/d19/d21/c26 452220567 1 2024-09-11T00:07:08.912 INFO:tasks.workunit.client.0.smithi111.stdout:4/205: rename d18/c22 to d18/d3b/c49 0 2024-09-11T00:07:08.915 INFO:tasks.workunit.client.0.smithi111.stdout:9/262: write d6/db/f18 [5032362,70719] 0 2024-09-11T00:07:08.916 INFO:tasks.workunit.client.1.smithi203.stdout:8/253: creat d1/d13/d3a/d4c/f5c x:0 0 0 2024-09-11T00:07:08.921 INFO:tasks.workunit.client.0.smithi111.stdout:5/255: mkdir d10/d1e/d23/d2b/d55 0 2024-09-11T00:07:08.922 INFO:tasks.workunit.client.0.smithi111.stdout:1/214: unlink d2/de/d12/d39/d3a/l3f 0 2024-09-11T00:07:08.922 INFO:tasks.workunit.client.0.smithi111.stdout:9/263: fdatasync d6/db/d34/d37/f32 0 2024-09-11T00:07:08.924 INFO:tasks.workunit.client.0.smithi111.stdout:2/225: getdents d0/d3/de 0 2024-09-11T00:07:08.926 INFO:tasks.workunit.client.0.smithi111.stdout:2/226: fdatasync d0/d3/f27 0 2024-09-11T00:07:08.927 INFO:tasks.workunit.client.1.smithi203.stdout:6/223: chown d0/c2 4334 1 2024-09-11T00:07:08.927 INFO:tasks.workunit.client.0.smithi111.stdout:3/283: creat d1c/d1d/d22/f61 x:0 0 0 2024-09-11T00:07:08.929 INFO:tasks.workunit.client.1.smithi203.stdout:9/258: dwrite d6/de/d19/d24/d40/d45/f39 [4194304,4194304] 0 2024-09-11T00:07:08.930 INFO:tasks.workunit.client.0.smithi111.stdout:1/215: dread d2/de/d12/f1c [0,4194304] 0 2024-09-11T00:07:08.930 INFO:tasks.workunit.client.1.smithi203.stdout:1/334: creat d8/d9/d15/d30/d3e/d4b/f75 x:0 0 0 2024-09-11T00:07:08.933 INFO:tasks.workunit.client.1.smithi203.stdout:7/256: write dd/d1c/f32 [1948336,63654] 0 2024-09-11T00:07:08.934 INFO:tasks.workunit.client.0.smithi111.stdout:7/237: symlink dd/d1d/d44/l46 0 2024-09-11T00:07:08.934 INFO:tasks.workunit.client.1.smithi203.stdout:8/254: fdatasync d1/fc 0 2024-09-11T00:07:08.937 INFO:tasks.workunit.client.0.smithi111.stdout:5/256: mknod d10/d1e/d23/c56 0 2024-09-11T00:07:08.940 INFO:tasks.workunit.client.1.smithi203.stdout:1/335: mknod d8/c76 0 2024-09-11T00:07:08.940 INFO:tasks.workunit.client.0.smithi111.stdout:8/270: dwrite f7 [0,4194304] 0 2024-09-11T00:07:08.941 INFO:tasks.workunit.client.0.smithi111.stdout:6/180: sync 2024-09-11T00:07:08.943 INFO:tasks.workunit.client.1.smithi203.stdout:9/259: rename d6/de/d19/d24/d40/d45/d29 to d6/de/d32/d52/d55 0 2024-09-11T00:07:08.945 INFO:tasks.workunit.client.0.smithi111.stdout:9/264: symlink d6/dc/l55 0 2024-09-11T00:07:08.947 INFO:tasks.workunit.client.1.smithi203.stdout:8/255: write d1/f37 [103095,129872] 0 2024-09-11T00:07:08.947 INFO:tasks.workunit.client.1.smithi203.stdout:6/224: fdatasync d0/f5 0 2024-09-11T00:07:08.951 INFO:tasks.workunit.client.1.smithi203.stdout:5/303: creat dc/dd/d13/f5d x:0 0 0 2024-09-11T00:07:08.951 INFO:tasks.workunit.client.0.smithi111.stdout:2/227: creat d0/d3/de/f51 x:0 0 0 2024-09-11T00:07:08.951 INFO:tasks.workunit.client.0.smithi111.stdout:2/228: stat d0/d3/de/f1f 0 2024-09-11T00:07:08.952 INFO:tasks.workunit.client.0.smithi111.stdout:3/284: mkdir d1c/d1d/d22/d31/d62 0 2024-09-11T00:07:08.953 INFO:tasks.workunit.client.1.smithi203.stdout:1/336: mknod d8/d9/d15/d30/c77 0 2024-09-11T00:07:08.954 INFO:tasks.workunit.client.0.smithi111.stdout:1/216: dwrite d2/de/d12/f26 [0,4194304] 0 2024-09-11T00:07:08.954 INFO:tasks.workunit.client.0.smithi111.stdout:0/227: creat d3/d13/f5a x:0 0 0 2024-09-11T00:07:08.957 INFO:tasks.workunit.client.1.smithi203.stdout:7/257: rename dd/d1c/l47 to dd/d3b/d5b/l5c 0 2024-09-11T00:07:08.959 INFO:tasks.workunit.client.0.smithi111.stdout:0/228: read - d3/dc/f3f zero size 2024-09-11T00:07:08.959 INFO:tasks.workunit.client.1.smithi203.stdout:9/260: unlink d6/de/d19/d21/f25 0 2024-09-11T00:07:08.960 INFO:tasks.workunit.client.0.smithi111.stdout:0/229: fdatasync d3/dc/f3f 0 2024-09-11T00:07:08.960 INFO:tasks.workunit.client.0.smithi111.stdout:6/181: dread d7/f11 [0,4194304] 0 2024-09-11T00:07:08.962 INFO:tasks.workunit.client.0.smithi111.stdout:7/238: creat dd/d1d/d1f/f47 x:0 0 0 2024-09-11T00:07:08.968 INFO:tasks.workunit.client.0.smithi111.stdout:8/271: dwrite d11/f3c [0,4194304] 0 2024-09-11T00:07:08.970 INFO:tasks.workunit.client.0.smithi111.stdout:5/257: rmdir d10/d1e/d23/d30/d46 39 2024-09-11T00:07:08.971 INFO:tasks.workunit.client.1.smithi203.stdout:8/256: mkdir d1/d13/d22/d5d 0 2024-09-11T00:07:08.972 INFO:tasks.workunit.client.1.smithi203.stdout:5/304: dwrite dc/dd/d4d/f57 [0,4194304] 0 2024-09-11T00:07:08.975 INFO:tasks.workunit.client.0.smithi111.stdout:9/265: readlink d6/l27 0 2024-09-11T00:07:08.977 INFO:tasks.workunit.client.1.smithi203.stdout:1/337: dwrite d8/d9/f63 [0,4194304] 0 2024-09-11T00:07:08.979 INFO:tasks.workunit.client.0.smithi111.stdout:4/206: rename d18/d2b to d18/d20/d4a 0 2024-09-11T00:07:08.980 INFO:tasks.workunit.client.1.smithi203.stdout:1/338: read d8/d9/d15/f47 [3268148,64281] 0 2024-09-11T00:07:08.980 INFO:tasks.workunit.client.0.smithi111.stdout:9/266: chown d6/db/d34/d37 10 1 2024-09-11T00:07:08.982 INFO:tasks.workunit.client.1.smithi203.stdout:9/261: chown d6/de/d19/d21/c34 18429906 1 2024-09-11T00:07:08.984 INFO:tasks.workunit.client.0.smithi111.stdout:1/217: rmdir d2/de/d12/d39 39 2024-09-11T00:07:08.984 INFO:tasks.workunit.client.1.smithi203.stdout:7/258: symlink dd/d1c/d4b/l5d 0 2024-09-11T00:07:08.986 INFO:tasks.workunit.client.0.smithi111.stdout:4/207: chown d18/d1f/d36/f38 16472903 1 2024-09-11T00:07:08.987 INFO:tasks.workunit.client.0.smithi111.stdout:9/267: fsync d6/db/d34/d37/f32 0 2024-09-11T00:07:08.988 INFO:tasks.workunit.client.0.smithi111.stdout:0/230: dwrite d3/d13/d1e/d29/f3e [0,4194304] 0 2024-09-11T00:07:08.989 INFO:tasks.workunit.client.1.smithi203.stdout:7/259: read dd/d1c/d4b/f53 [36369,45210] 0 2024-09-11T00:07:08.989 INFO:tasks.workunit.client.1.smithi203.stdout:6/225: mknod d0/d27/d35/d39/d3c/c41 0 2024-09-11T00:07:08.990 INFO:tasks.workunit.client.1.smithi203.stdout:7/260: readlink dd/l44 0 2024-09-11T00:07:08.992 INFO:tasks.workunit.client.1.smithi203.stdout:8/257: creat d1/d13/d3a/d4c/f5e x:0 0 0 2024-09-11T00:07:08.993 INFO:tasks.workunit.client.0.smithi111.stdout:7/239: read dd/f1a [1262449,109945] 0 2024-09-11T00:07:08.995 INFO:tasks.workunit.client.0.smithi111.stdout:5/258: mknod d10/d1e/d23/c57 0 2024-09-11T00:07:08.996 INFO:tasks.workunit.client.1.smithi203.stdout:5/305: mknod dc/dd/d15/c5e 0 2024-09-11T00:07:09.001 INFO:tasks.workunit.client.1.smithi203.stdout:5/306: read dc/dd/d1e/f54 [389021,63174] 0 2024-09-11T00:07:09.001 INFO:tasks.workunit.client.0.smithi111.stdout:9/268: write d6/db/d1b/f4b [4314675,70249] 0 2024-09-11T00:07:09.002 INFO:tasks.workunit.client.1.smithi203.stdout:1/339: symlink d8/d9/d15/d30/d3e/d4b/d41/l78 0 2024-09-11T00:07:09.003 INFO:tasks.workunit.client.1.smithi203.stdout:5/307: fdatasync f8 0 2024-09-11T00:07:09.003 INFO:tasks.workunit.client.1.smithi203.stdout:1/340: chown d8/d9 54811 1 2024-09-11T00:07:09.008 INFO:tasks.workunit.client.1.smithi203.stdout:9/262: creat d6/de/d19/d21/f56 x:0 0 0 2024-09-11T00:07:09.008 INFO:tasks.workunit.client.0.smithi111.stdout:3/285: dread d1c/f34 [0,4194304] 0 2024-09-11T00:07:09.009 INFO:tasks.workunit.client.0.smithi111.stdout:2/229: rename d0/d3/d39 to d0/d3/d12/d52 0 2024-09-11T00:07:09.012 INFO:tasks.workunit.client.0.smithi111.stdout:3/286: dread - d1c/d1d/d22/d44/f4e zero size 2024-09-11T00:07:09.013 INFO:tasks.workunit.client.0.smithi111.stdout:8/272: mkdir d11/d21/d38/d54/d5b 0 2024-09-11T00:07:09.014 INFO:tasks.workunit.client.1.smithi203.stdout:8/258: mkdir d1/d13/d17/d2f/d52/d5f 0 2024-09-11T00:07:09.019 INFO:tasks.workunit.client.1.smithi203.stdout:1/341: fsync d8/d9/d15/f43 0 2024-09-11T00:07:09.023 INFO:tasks.workunit.client.1.smithi203.stdout:6/226: fsync d0/f2a 0 2024-09-11T00:07:09.026 INFO:tasks.workunit.client.1.smithi203.stdout:7/261: creat dd/d1c/d26/d31/d58/f5e x:0 0 0 2024-09-11T00:07:09.027 INFO:tasks.workunit.client.0.smithi111.stdout:6/182: truncate d7/f11 1620570 0 2024-09-11T00:07:09.027 INFO:tasks.workunit.client.1.smithi203.stdout:7/262: chown dd/c3c 141 1 2024-09-11T00:07:09.029 INFO:tasks.workunit.client.0.smithi111.stdout:3/287: dwrite d1c/d1d/d22/d44/f4e [0,4194304] 0 2024-09-11T00:07:09.031 INFO:tasks.workunit.client.0.smithi111.stdout:1/218: link d2/f1f d2/d2b/d2c/f47 0 2024-09-11T00:07:09.034 INFO:tasks.workunit.client.0.smithi111.stdout:4/208: creat d18/d20/d3c/f4b x:0 0 0 2024-09-11T00:07:09.034 INFO:tasks.workunit.client.0.smithi111.stdout:1/219: readlink d2/de/d12/d34/l37 0 2024-09-11T00:07:09.036 INFO:tasks.workunit.client.0.smithi111.stdout:0/231: dwrite d3/da/f1d [0,4194304] 0 2024-09-11T00:07:09.037 INFO:tasks.workunit.client.1.smithi203.stdout:1/342: symlink d8/d9/d15/d30/d3e/d4b/l79 0 2024-09-11T00:07:09.037 INFO:tasks.workunit.client.0.smithi111.stdout:4/209: read f15 [37223,56035] 0 2024-09-11T00:07:09.037 INFO:tasks.workunit.client.1.smithi203.stdout:9/263: rmdir d6/de/d19/d21 39 2024-09-11T00:07:09.037 INFO:tasks.workunit.client.0.smithi111.stdout:7/240: mkdir dd/d48 0 2024-09-11T00:07:09.038 INFO:tasks.workunit.client.0.smithi111.stdout:0/232: fsync d3/d13/d1e/f44 0 2024-09-11T00:07:09.038 INFO:tasks.workunit.client.0.smithi111.stdout:4/210: chown d18/d20/d4a/f2f 0 1 2024-09-11T00:07:09.045 INFO:tasks.workunit.client.0.smithi111.stdout:9/269: mkdir d6/db/d1b/d56 0 2024-09-11T00:07:09.045 INFO:tasks.workunit.client.1.smithi203.stdout:8/259: creat d1/d13/d17/d2f/d52/d5f/f60 x:0 0 0 2024-09-11T00:07:09.045 INFO:tasks.workunit.client.1.smithi203.stdout:6/227: readlink d0/l20 0 2024-09-11T00:07:09.046 INFO:tasks.workunit.client.1.smithi203.stdout:6/228: chown d0/d27/d35/d39/d3d 12374151 1 2024-09-11T00:07:09.047 INFO:tasks.workunit.client.1.smithi203.stdout:1/343: symlink d8/d9/d15/d35/l7a 0 2024-09-11T00:07:09.050 INFO:tasks.workunit.client.1.smithi203.stdout:9/264: rmdir d6/de/d19/d24 39 2024-09-11T00:07:09.051 INFO:tasks.workunit.client.1.smithi203.stdout:5/308: dread dc/dd/d1e/f21 [0,4194304] 0 2024-09-11T00:07:09.052 INFO:tasks.workunit.client.1.smithi203.stdout:6/229: truncate d0/f2a 255463 0 2024-09-11T00:07:09.055 INFO:tasks.workunit.client.1.smithi203.stdout:8/260: fsync d1/f11 0 2024-09-11T00:07:09.056 INFO:tasks.workunit.client.0.smithi111.stdout:2/230: symlink d0/d3/l53 0 2024-09-11T00:07:09.058 INFO:tasks.workunit.client.0.smithi111.stdout:8/273: mknod d11/c5c 0 2024-09-11T00:07:09.058 INFO:tasks.workunit.client.0.smithi111.stdout:2/231: truncate d0/d3/de/f4a 788648 0 2024-09-11T00:07:09.061 INFO:tasks.workunit.client.1.smithi203.stdout:8/261: stat d1/d13/d22/l28 0 2024-09-11T00:07:09.062 INFO:tasks.workunit.client.0.smithi111.stdout:3/288: mkdir d1c/d1d/d22/d23/d2f/d63 0 2024-09-11T00:07:09.069 INFO:tasks.workunit.client.1.smithi203.stdout:1/344: mknod d8/d28/c7b 0 2024-09-11T00:07:09.071 INFO:tasks.workunit.client.0.smithi111.stdout:0/233: readlink d3/dc/l28 0 2024-09-11T00:07:09.072 INFO:tasks.workunit.client.0.smithi111.stdout:3/289: dread d1c/d21/f3b [0,4194304] 0 2024-09-11T00:07:09.072 INFO:tasks.workunit.client.0.smithi111.stdout:8/274: dwrite d11/d23/d2c/f45 [0,4194304] 0 2024-09-11T00:07:09.074 INFO:tasks.workunit.client.1.smithi203.stdout:5/309: unlink dc/dd/d13/c2a 0 2024-09-11T00:07:09.074 INFO:tasks.workunit.client.0.smithi111.stdout:5/259: creat d10/d1e/d23/d30/d46/d47/f58 x:0 0 0 2024-09-11T00:07:09.076 INFO:tasks.workunit.client.0.smithi111.stdout:4/211: mkdir d18/d20/d4a/d4c 0 2024-09-11T00:07:09.079 INFO:tasks.workunit.client.1.smithi203.stdout:9/265: rename d6/de/d19/f53 to d6/de/d19/d24/f57 0 2024-09-11T00:07:09.079 INFO:tasks.workunit.client.1.smithi203.stdout:8/262: dwrite d1/d13/f33 [0,4194304] 0 2024-09-11T00:07:09.082 INFO:tasks.workunit.client.1.smithi203.stdout:8/263: write d1/d13/f33 [8660172,90008] 0 2024-09-11T00:07:09.084 INFO:tasks.workunit.client.0.smithi111.stdout:9/270: creat d6/db/d1b/d41/f57 x:0 0 0 2024-09-11T00:07:09.085 INFO:tasks.workunit.client.0.smithi111.stdout:9/271: chown d6/dc/f20 3083 1 2024-09-11T00:07:09.087 INFO:tasks.workunit.client.1.smithi203.stdout:6/230: unlink d0/f13 0 2024-09-11T00:07:09.089 INFO:tasks.workunit.client.0.smithi111.stdout:6/183: mkdir d7/d22/d3f 0 2024-09-11T00:07:09.091 INFO:tasks.workunit.client.0.smithi111.stdout:6/184: chown d7/d22/d2c/d38/d39/d3d 309895 1 2024-09-11T00:07:09.091 INFO:tasks.workunit.client.0.smithi111.stdout:9/272: dread d6/db/d34/d37/f19 [4194304,4194304] 0 2024-09-11T00:07:09.091 INFO:tasks.workunit.client.1.smithi203.stdout:5/310: creat dc/dd/d15/f5f x:0 0 0 2024-09-11T00:07:09.092 INFO:tasks.workunit.client.0.smithi111.stdout:2/232: rename d0/d3/d12/l20 to d0/d3/d12/d52/l54 0 2024-09-11T00:07:09.094 INFO:tasks.workunit.client.0.smithi111.stdout:9/273: chown d6/db/d34/d37/d4c 210 1 2024-09-11T00:07:09.095 INFO:tasks.workunit.client.1.smithi203.stdout:8/264: mkdir d1/d13/d17/d48/d61 0 2024-09-11T00:07:09.096 INFO:tasks.workunit.client.0.smithi111.stdout:9/274: write d6/db/d1b/f4e [203928,68458] 0 2024-09-11T00:07:09.099 INFO:tasks.workunit.client.1.smithi203.stdout:9/266: unlink d6/de/d19/d24/d40/d45/l35 0 2024-09-11T00:07:09.103 INFO:tasks.workunit.client.0.smithi111.stdout:7/241: mkdir dd/d49 0 2024-09-11T00:07:09.106 INFO:tasks.workunit.client.0.smithi111.stdout:3/290: mknod d1c/d1d/d22/d31/d33/c64 0 2024-09-11T00:07:09.106 INFO:tasks.workunit.client.0.smithi111.stdout:7/242: fsync dd/d1d/d1f/f47 0 2024-09-11T00:07:09.106 INFO:tasks.workunit.client.0.smithi111.stdout:9/275: dread d6/db/d1b/f33 [0,4194304] 0 2024-09-11T00:07:09.108 INFO:tasks.workunit.client.0.smithi111.stdout:2/233: dread d0/d3/d12/f41 [0,4194304] 0 2024-09-11T00:07:09.113 INFO:tasks.workunit.client.1.smithi203.stdout:2/183: sync 2024-09-11T00:07:09.121 INFO:tasks.workunit.client.0.smithi111.stdout:0/234: rename d3/d13/l20 to d3/d13/d1e/l5b 0 2024-09-11T00:07:09.122 INFO:tasks.workunit.client.1.smithi203.stdout:6/231: rename d0/d27/c36 to d0/d27/d35/d38/c42 0 2024-09-11T00:07:09.124 INFO:tasks.workunit.client.1.smithi203.stdout:1/345: truncate d8/d19/f57 277063 0 2024-09-11T00:07:09.125 INFO:tasks.workunit.client.0.smithi111.stdout:0/235: chown d3/dc/f43 1124798829 1 2024-09-11T00:07:09.125 INFO:tasks.workunit.client.0.smithi111.stdout:2/234: dread d0/d3/de/f1f [0,4194304] 0 2024-09-11T00:07:09.126 INFO:tasks.workunit.client.1.smithi203.stdout:5/311: creat dc/dd/d1e/d41/f60 x:0 0 0 2024-09-11T00:07:09.128 INFO:tasks.workunit.client.0.smithi111.stdout:1/220: truncate d2/de/f29 3169860 0 2024-09-11T00:07:09.128 INFO:tasks.workunit.client.1.smithi203.stdout:1/346: truncate d8/d9/d15/d30/f61 668147 0 2024-09-11T00:07:09.129 INFO:tasks.workunit.client.1.smithi203.stdout:2/184: dwrite d13/d15/d19/f28 [4194304,4194304] 0 2024-09-11T00:07:09.132 INFO:tasks.workunit.client.1.smithi203.stdout:1/347: write d8/d9/d15/d30/f3d [1456375,110905] 0 2024-09-11T00:07:09.134 INFO:tasks.workunit.client.1.smithi203.stdout:9/267: unlink d6/de/d19/d24/f2c 0 2024-09-11T00:07:09.140 INFO:tasks.workunit.client.0.smithi111.stdout:7/243: mknod dd/d1d/d44/c4a 0 2024-09-11T00:07:09.142 INFO:tasks.workunit.client.1.smithi203.stdout:8/265: creat d1/d13/d17/f62 x:0 0 0 2024-09-11T00:07:09.142 INFO:tasks.workunit.client.0.smithi111.stdout:9/276: readlink d6/db/d34/l51 0 2024-09-11T00:07:09.143 INFO:tasks.workunit.client.0.smithi111.stdout:3/291: symlink d1c/d1d/d22/d31/d33/l65 0 2024-09-11T00:07:09.143 INFO:tasks.workunit.client.1.smithi203.stdout:5/312: chown dc/dd/d13/f43 211905 1 2024-09-11T00:07:09.144 INFO:tasks.workunit.client.1.smithi203.stdout:2/185: symlink d13/l33 0 2024-09-11T00:07:09.148 INFO:tasks.workunit.client.1.smithi203.stdout:1/348: symlink d8/d19/d31/l7c 0 2024-09-11T00:07:09.149 INFO:tasks.workunit.client.0.smithi111.stdout:6/185: getdents d7/d22/d26 0 2024-09-11T00:07:09.149 INFO:tasks.workunit.client.1.smithi203.stdout:2/186: truncate d13/d15/d19/d1c/f2a 5680614 0 2024-09-11T00:07:09.150 INFO:tasks.workunit.client.0.smithi111.stdout:6/186: write d7/f12 [1634535,48003] 0 2024-09-11T00:07:09.151 INFO:tasks.workunit.client.0.smithi111.stdout:8/275: rename d11/c3e to d11/d23/d2c/d53/c5d 0 2024-09-11T00:07:09.153 INFO:tasks.workunit.client.0.smithi111.stdout:8/276: chown d11/d23/d2c/d46/l50 137926 1 2024-09-11T00:07:09.153 INFO:tasks.workunit.client.0.smithi111.stdout:0/236: mkdir d3/d13/d1e/d29/d5c 0 2024-09-11T00:07:09.155 INFO:tasks.workunit.client.1.smithi203.stdout:8/266: symlink d1/d13/d17/d48/l63 0 2024-09-11T00:07:09.156 INFO:tasks.workunit.client.0.smithi111.stdout:0/237: read d3/d13/d1e/d29/f2a [618840,12892] 0 2024-09-11T00:07:09.157 INFO:tasks.workunit.client.0.smithi111.stdout:1/221: truncate d2/de/d12/d39/f3d 308298 0 2024-09-11T00:07:09.157 INFO:tasks.workunit.client.1.smithi203.stdout:2/187: symlink d13/l34 0 2024-09-11T00:07:09.160 INFO:tasks.workunit.client.1.smithi203.stdout:6/232: rmdir d0/d27/d35/d39/d3d 0 2024-09-11T00:07:09.162 INFO:tasks.workunit.client.1.smithi203.stdout:5/313: symlink dc/dd/d13/l61 0 2024-09-11T00:07:09.163 INFO:tasks.workunit.client.1.smithi203.stdout:8/267: mkdir d1/d13/d43/d46/d64 0 2024-09-11T00:07:09.168 INFO:tasks.workunit.client.1.smithi203.stdout:9/268: rename d6/de/l50 to d6/de/d19/d24/d40/d45/l58 0 2024-09-11T00:07:09.171 INFO:tasks.workunit.client.1.smithi203.stdout:1/349: link d8/d19/c4e d8/d9/d15/d30/d3e/c7d 0 2024-09-11T00:07:09.171 INFO:tasks.workunit.client.1.smithi203.stdout:6/233: write d0/d32/f34 [940648,90128] 0 2024-09-11T00:07:09.176 INFO:tasks.workunit.client.1.smithi203.stdout:8/268: rename d1/d13/d3a/l47 to d1/d13/d17/d48/d61/l65 0 2024-09-11T00:07:09.181 INFO:tasks.workunit.client.1.smithi203.stdout:8/269: creat d1/d13/d22/d5d/f66 x:0 0 0 2024-09-11T00:07:09.183 INFO:tasks.workunit.client.1.smithi203.stdout:1/350: getdents d8/d9/d15/d30/d3e/d4b 0 2024-09-11T00:07:09.188 INFO:tasks.workunit.client.1.smithi203.stdout:1/351: truncate d8/d9/d15/d27/f2e 993405 0 2024-09-11T00:07:09.195 INFO:tasks.workunit.client.1.smithi203.stdout:9/269: rmdir d6 39 2024-09-11T00:07:09.196 INFO:tasks.workunit.client.1.smithi203.stdout:6/234: dwrite d0/f2d [4194304,4194304] 0 2024-09-11T00:07:09.198 INFO:tasks.workunit.client.1.smithi203.stdout:1/352: rmdir d8/d9/d15/d30/d3e/d4b/d41 39 2024-09-11T00:07:09.201 INFO:tasks.workunit.client.0.smithi111.stdout:7/244: mkdir dd/d1d/d4b 0 2024-09-11T00:07:09.201 INFO:tasks.workunit.client.1.smithi203.stdout:6/235: stat d0/d27/d35/f3e 0 2024-09-11T00:07:09.202 INFO:tasks.workunit.client.0.smithi111.stdout:2/235: mknod d0/d3/de/d50/c55 0 2024-09-11T00:07:09.203 INFO:tasks.workunit.client.1.smithi203.stdout:1/353: read d8/d19/d31/f59 [289491,50029] 0 2024-09-11T00:07:09.204 INFO:tasks.workunit.client.0.smithi111.stdout:1/222: write d2/de/d12/d39/f3d [852281,84881] 0 2024-09-11T00:07:09.204 INFO:tasks.workunit.client.0.smithi111.stdout:4/212: getdents d18/d1f/d36 0 2024-09-11T00:07:09.206 INFO:tasks.workunit.client.0.smithi111.stdout:2/236: dread - d0/d3/de/d3b/f49 zero size 2024-09-11T00:07:09.206 INFO:tasks.workunit.client.1.smithi203.stdout:9/270: unlink d6/f46 0 2024-09-11T00:07:09.207 INFO:tasks.workunit.client.0.smithi111.stdout:3/292: dread d1c/d1d/d22/d23/f28 [0,4194304] 0 2024-09-11T00:07:09.210 INFO:tasks.workunit.client.1.smithi203.stdout:2/188: dread d13/d15/f1a [0,4194304] 0 2024-09-11T00:07:09.211 INFO:tasks.workunit.client.1.smithi203.stdout:8/270: dwrite d1/d13/d43/d46/f4e [0,4194304] 0 2024-09-11T00:07:09.213 INFO:tasks.workunit.client.0.smithi111.stdout:6/187: link d7/d22/d2c/l36 d7/d2b/d35/l40 0 2024-09-11T00:07:09.213 INFO:tasks.workunit.client.0.smithi111.stdout:0/238: truncate d3/d13/d1e/f4d 336110 0 2024-09-11T00:07:09.214 INFO:tasks.workunit.client.0.smithi111.stdout:7/245: write dd/d1d/d2d/d2e/f40 [918755,27655] 0 2024-09-11T00:07:09.214 INFO:tasks.workunit.client.1.smithi203.stdout:2/189: fsync d13/d15/f32 0 2024-09-11T00:07:09.214 INFO:tasks.workunit.client.0.smithi111.stdout:0/239: stat d3/d13/l40 0 2024-09-11T00:07:09.215 INFO:tasks.workunit.client.0.smithi111.stdout:5/260: rename d10/d51 to d10/d1e/d23/d30/d59 0 2024-09-11T00:07:09.215 INFO:tasks.workunit.client.1.smithi203.stdout:8/271: chown d1/f37 1012 1 2024-09-11T00:07:09.217 INFO:tasks.workunit.client.0.smithi111.stdout:1/223: symlink d2/de/d12/d3c/l48 0 2024-09-11T00:07:09.220 INFO:tasks.workunit.client.1.smithi203.stdout:5/314: dwrite dc/dd/d1e/f29 [0,4194304] 0 2024-09-11T00:07:09.223 INFO:tasks.workunit.client.1.smithi203.stdout:8/272: write d1/d13/d3a/d4c/f5c [11809,75822] 0 2024-09-11T00:07:09.226 INFO:tasks.workunit.client.0.smithi111.stdout:8/277: truncate d11/f3c 2711693 0 2024-09-11T00:07:09.227 INFO:tasks.workunit.client.1.smithi203.stdout:6/236: getdents d0 0 2024-09-11T00:07:09.230 INFO:tasks.workunit.client.1.smithi203.stdout:6/237: readlink d0/d27/la 0 2024-09-11T00:07:09.234 INFO:tasks.workunit.client.1.smithi203.stdout:8/273: write d1/d13/f19 [3823159,54052] 0 2024-09-11T00:07:09.237 INFO:tasks.workunit.client.1.smithi203.stdout:5/315: write dc/dd/d15/f2c [1091181,104978] 0 2024-09-11T00:07:09.241 INFO:tasks.workunit.client.0.smithi111.stdout:7/246: creat dd/d49/f4c x:0 0 0 2024-09-11T00:07:09.241 INFO:tasks.workunit.client.0.smithi111.stdout:1/224: dwrite d2/d2b/d2c/f42 [0,4194304] 0 2024-09-11T00:07:09.242 INFO:tasks.workunit.client.0.smithi111.stdout:8/278: creat d11/d21/d38/f5e x:0 0 0 2024-09-11T00:07:09.242 INFO:tasks.workunit.client.1.smithi203.stdout:6/238: creat d0/d32/f43 x:0 0 0 2024-09-11T00:07:09.243 INFO:tasks.workunit.client.0.smithi111.stdout:2/237: link d0/d3/f36 d0/d3/f56 0 2024-09-11T00:07:09.244 INFO:tasks.workunit.client.1.smithi203.stdout:6/239: chown d0/f21 33780996 1 2024-09-11T00:07:09.244 INFO:tasks.workunit.client.1.smithi203.stdout:1/354: dwrite d8/d9/d15/d30/f3d [0,4194304] 0 2024-09-11T00:07:09.245 INFO:tasks.workunit.client.0.smithi111.stdout:1/225: stat d2/de/d12/d3c 0 2024-09-11T00:07:09.248 INFO:tasks.workunit.client.0.smithi111.stdout:0/240: mknod d3/d13/d38/c5d 0 2024-09-11T00:07:09.249 INFO:tasks.workunit.client.0.smithi111.stdout:4/213: getdents d18/d3b 0 2024-09-11T00:07:09.252 INFO:tasks.workunit.client.1.smithi203.stdout:2/190: truncate d13/f14 555250 0 2024-09-11T00:07:09.253 INFO:tasks.workunit.client.0.smithi111.stdout:0/241: write d3/da/f3a [1561988,88741] 0 2024-09-11T00:07:09.253 INFO:tasks.workunit.client.0.smithi111.stdout:0/242: stat d3/d13/d38/c39 0 2024-09-11T00:07:09.254 INFO:tasks.workunit.client.0.smithi111.stdout:5/261: rename d10/l12 to d10/d1e/d23/d30/l5a 0 2024-09-11T00:07:09.254 INFO:tasks.workunit.client.1.smithi203.stdout:2/191: fsync d13/d15/f25 0 2024-09-11T00:07:09.257 INFO:tasks.workunit.client.1.smithi203.stdout:8/274: dwrite d1/d13/d43/d46/f4e [0,4194304] 0 2024-09-11T00:07:09.257 INFO:tasks.workunit.client.1.smithi203.stdout:2/192: chown fd 108081217 1 2024-09-11T00:07:09.260 INFO:tasks.workunit.client.0.smithi111.stdout:7/247: mkdir dd/d1d/d4d 0 2024-09-11T00:07:09.262 INFO:tasks.workunit.client.0.smithi111.stdout:8/279: mkdir d11/d23/d3d/d5f 0 2024-09-11T00:07:09.263 INFO:tasks.workunit.client.0.smithi111.stdout:7/248: write dd/f31 [642432,110452] 0 2024-09-11T00:07:09.265 INFO:tasks.workunit.client.0.smithi111.stdout:3/293: dwrite d1c/d1d/f1f [0,4194304] 0 2024-09-11T00:07:09.268 INFO:tasks.workunit.client.1.smithi203.stdout:5/316: creat dc/d4f/d5c/f62 x:0 0 0 2024-09-11T00:07:09.271 INFO:tasks.workunit.client.0.smithi111.stdout:7/249: truncate dd/f1e 809669 0 2024-09-11T00:07:09.272 INFO:tasks.workunit.client.0.smithi111.stdout:3/294: fdatasync d1c/d1d/d22/f5b 0 2024-09-11T00:07:09.272 INFO:tasks.workunit.client.0.smithi111.stdout:6/188: dwrite d7/f9 [0,4194304] 0 2024-09-11T00:07:09.273 INFO:tasks.workunit.client.1.smithi203.stdout:8/275: symlink d1/d13/d17/d48/l67 0 2024-09-11T00:07:09.279 INFO:tasks.workunit.client.1.smithi203.stdout:1/355: mkdir d8/d9/d15/d30/d3e/d4b/d41/d7e 0 2024-09-11T00:07:09.283 INFO:tasks.workunit.client.0.smithi111.stdout:0/243: truncate d3/fd 2198218 0 2024-09-11T00:07:09.286 INFO:tasks.workunit.client.0.smithi111.stdout:0/244: fsync d3/f7 0 2024-09-11T00:07:09.288 INFO:tasks.workunit.client.1.smithi203.stdout:2/193: dwrite d13/d15/d19/d1c/f27 [0,4194304] 0 2024-09-11T00:07:09.290 INFO:tasks.workunit.client.0.smithi111.stdout:3/295: unlink d1c/d1d/d22/f4c 0 2024-09-11T00:07:09.292 INFO:tasks.workunit.client.0.smithi111.stdout:9/277: sync 2024-09-11T00:07:09.304 INFO:tasks.workunit.client.0.smithi111.stdout:5/262: dwrite d10/d1e/d25/f4a [0,4194304] 0 2024-09-11T00:07:09.304 INFO:tasks.workunit.client.0.smithi111.stdout:6/189: read d7/f12 [230552,114069] 0 2024-09-11T00:07:09.305 INFO:tasks.workunit.client.0.smithi111.stdout:8/280: dwrite d11/f33 [0,4194304] 0 2024-09-11T00:07:09.306 INFO:tasks.workunit.client.1.smithi203.stdout:8/276: dwrite d1/d13/d17/f50 [0,4194304] 0 2024-09-11T00:07:09.306 INFO:tasks.workunit.client.1.smithi203.stdout:5/317: rename dc/dd/d15/f5f to dc/dd/d15/d3b/f63 0 2024-09-11T00:07:09.310 INFO:tasks.workunit.client.0.smithi111.stdout:8/281: write d11/d21/f31 [3875665,66981] 0 2024-09-11T00:07:09.311 INFO:tasks.workunit.client.0.smithi111.stdout:6/190: chown d7/d22/d2c/f37 1748 1 2024-09-11T00:07:09.312 INFO:tasks.workunit.client.0.smithi111.stdout:2/238: write d0/d3/f1c [562180,92949] 0 2024-09-11T00:07:09.318 INFO:tasks.workunit.client.0.smithi111.stdout:3/296: dread d1c/d21/f3b [0,4194304] 0 2024-09-11T00:07:09.319 INFO:tasks.workunit.client.0.smithi111.stdout:0/245: symlink d3/dc/l5e 0 2024-09-11T00:07:09.321 INFO:tasks.workunit.client.1.smithi203.stdout:5/318: write dc/dd/d1e/d41/f4a [819007,92164] 0 2024-09-11T00:07:09.323 INFO:tasks.workunit.client.0.smithi111.stdout:3/297: dread d1c/d1d/d22/d31/d33/f39 [0,4194304] 0 2024-09-11T00:07:09.324 INFO:tasks.workunit.client.0.smithi111.stdout:9/278: creat d6/db/d34/f58 x:0 0 0 2024-09-11T00:07:09.325 INFO:tasks.workunit.client.1.smithi203.stdout:6/240: dread d0/d27/f19 [0,4194304] 0 2024-09-11T00:07:09.326 INFO:tasks.workunit.client.0.smithi111.stdout:9/279: stat d6 0 2024-09-11T00:07:09.326 INFO:tasks.workunit.client.0.smithi111.stdout:7/250: dread dd/f18 [0,4194304] 0 2024-09-11T00:07:09.327 INFO:tasks.workunit.client.1.smithi203.stdout:1/356: dwrite d8/d9/d15/f43 [0,4194304] 0 2024-09-11T00:07:09.328 INFO:tasks.workunit.client.1.smithi203.stdout:2/194: dread f8 [0,4194304] 0 2024-09-11T00:07:09.330 INFO:tasks.workunit.client.1.smithi203.stdout:6/241: chown d0/f16 1733482580 1 2024-09-11T00:07:09.331 INFO:tasks.workunit.client.1.smithi203.stdout:2/195: write d13/d15/f1f [927516,37823] 0 2024-09-11T00:07:09.331 INFO:tasks.workunit.client.0.smithi111.stdout:5/263: dread d10/d1e/d25/f2d [0,4194304] 0 2024-09-11T00:07:09.334 INFO:tasks.workunit.client.1.smithi203.stdout:2/196: chown d13/d15/d19/d1c/f2a 17 1 2024-09-11T00:07:09.334 INFO:tasks.workunit.client.1.smithi203.stdout:2/197: stat f11 0 2024-09-11T00:07:09.334 INFO:tasks.workunit.client.0.smithi111.stdout:4/214: write f15 [73300,116811] 0 2024-09-11T00:07:09.335 INFO:tasks.workunit.client.0.smithi111.stdout:1/226: dwrite d2/fd [0,4194304] 0 2024-09-11T00:07:09.352 INFO:tasks.workunit.client.0.smithi111.stdout:6/191: mkdir d7/d2b/d35/d41 0 2024-09-11T00:07:09.354 INFO:tasks.workunit.client.1.smithi203.stdout:8/277: mkdir d1/d13/d17/d2f/d52/d49/d68 0 2024-09-11T00:07:09.356 INFO:tasks.workunit.client.0.smithi111.stdout:8/282: unlink d11/d23/d2c/c37 0 2024-09-11T00:07:09.356 INFO:tasks.workunit.client.0.smithi111.stdout:5/264: dread d10/d1e/d23/d30/f37 [0,4194304] 0 2024-09-11T00:07:09.358 INFO:tasks.workunit.client.0.smithi111.stdout:6/192: truncate d7/f9 4654361 0 2024-09-11T00:07:09.358 INFO:tasks.workunit.client.1.smithi203.stdout:8/278: write d1/fe [1411162,122609] 0 2024-09-11T00:07:09.366 INFO:tasks.workunit.client.1.smithi203.stdout:5/319: fsync dc/dd/d1e/f27 0 2024-09-11T00:07:09.373 INFO:tasks.workunit.client.0.smithi111.stdout:0/246: write d3/d13/d1e/d29/f2a [4644826,80668] 0 2024-09-11T00:07:09.373 INFO:tasks.workunit.client.0.smithi111.stdout:9/280: write d6/f3b [73294,80082] 0 2024-09-11T00:07:09.376 INFO:tasks.workunit.client.1.smithi203.stdout:8/279: dread d1/d13/d17/f50 [0,4194304] 0 2024-09-11T00:07:09.377 INFO:tasks.workunit.client.0.smithi111.stdout:0/247: truncate d3/d13/d1e/d29/f3e 5013732 0 2024-09-11T00:07:09.379 INFO:tasks.workunit.client.0.smithi111.stdout:0/248: truncate d3/d13/d1e/f44 26970 0 2024-09-11T00:07:09.382 INFO:tasks.workunit.client.0.smithi111.stdout:7/251: rename dd/d1d/d44 to dd/d1d/d2d/d2e/d4e 0 2024-09-11T00:07:09.385 INFO:tasks.workunit.client.1.smithi203.stdout:1/357: dread d8/d9/d15/f47 [0,4194304] 0 2024-09-11T00:07:09.387 INFO:tasks.workunit.client.0.smithi111.stdout:4/215: unlink d18/f19 0 2024-09-11T00:07:09.389 INFO:tasks.workunit.client.1.smithi203.stdout:5/320: dread - dc/dd/d15/f42 zero size 2024-09-11T00:07:09.393 INFO:tasks.workunit.client.1.smithi203.stdout:2/198: mknod d13/d15/c35 0 2024-09-11T00:07:09.394 INFO:tasks.workunit.client.0.smithi111.stdout:4/216: write d18/d20/d4a/f2f [511593,22346] 0 2024-09-11T00:07:09.395 INFO:tasks.workunit.client.0.smithi111.stdout:2/239: symlink d0/l57 0 2024-09-11T00:07:09.395 INFO:tasks.workunit.client.1.smithi203.stdout:8/280: fsync d1/d13/d3a/f44 0 2024-09-11T00:07:09.399 INFO:tasks.workunit.client.1.smithi203.stdout:8/281: truncate d1/d13/d17/d48/f53 165981 0 2024-09-11T00:07:09.402 INFO:tasks.workunit.client.0.smithi111.stdout:0/249: dwrite d3/d13/d1e/d29/f2a [0,4194304] 0 2024-09-11T00:07:09.403 INFO:tasks.workunit.client.1.smithi203.stdout:5/321: creat dc/dd/d1e/d41/f64 x:0 0 0 2024-09-11T00:07:09.404 INFO:tasks.workunit.client.1.smithi203.stdout:2/199: creat d13/d15/d19/f36 x:0 0 0 2024-09-11T00:07:09.405 INFO:tasks.workunit.client.1.smithi203.stdout:2/200: fdatasync d13/d15/f32 0 2024-09-11T00:07:09.406 INFO:tasks.workunit.client.1.smithi203.stdout:6/242: truncate d0/f2d 2824920 0 2024-09-11T00:07:09.408 INFO:tasks.workunit.client.1.smithi203.stdout:6/243: chown d0/f14 9760 1 2024-09-11T00:07:09.410 INFO:tasks.workunit.client.1.smithi203.stdout:1/358: mknod d8/d9/c7f 0 2024-09-11T00:07:09.412 INFO:tasks.workunit.client.0.smithi111.stdout:3/298: creat d1c/d1d/d22/d23/d58/d5c/f66 x:0 0 0 2024-09-11T00:07:09.416 INFO:tasks.workunit.client.0.smithi111.stdout:9/281: dread d6/db/d34/d37/f19 [4194304,4194304] 0 2024-09-11T00:07:09.416 INFO:tasks.workunit.client.0.smithi111.stdout:3/299: chown d1c/d1d/d22/d31/d33/c64 5 1 2024-09-11T00:07:09.417 INFO:tasks.workunit.client.1.smithi203.stdout:6/244: symlink d0/d32/l44 0 2024-09-11T00:07:09.417 INFO:tasks.workunit.client.1.smithi203.stdout:2/201: write d13/d15/f1a [2014033,116283] 0 2024-09-11T00:07:09.419 INFO:tasks.workunit.client.0.smithi111.stdout:4/217: symlink d18/d20/d40/l4d 0 2024-09-11T00:07:09.421 INFO:tasks.workunit.client.0.smithi111.stdout:2/240: creat d0/d3/de/d3b/f58 x:0 0 0 2024-09-11T00:07:09.422 INFO:tasks.workunit.client.0.smithi111.stdout:5/265: dread d10/d1e/d23/f48 [0,4194304] 0 2024-09-11T00:07:09.422 INFO:tasks.workunit.client.0.smithi111.stdout:4/218: stat d18/d1f/f25 0 2024-09-11T00:07:09.422 INFO:tasks.workunit.client.1.smithi203.stdout:6/245: symlink d0/d27/d35/d39/l45 0 2024-09-11T00:07:09.424 INFO:tasks.workunit.client.1.smithi203.stdout:2/202: mknod d13/d22/c37 0 2024-09-11T00:07:09.425 INFO:tasks.workunit.client.1.smithi203.stdout:5/322: rename dc/dd/d1e/d41 to dc/d65 0 2024-09-11T00:07:09.426 INFO:tasks.workunit.client.1.smithi203.stdout:2/203: write d13/f17 [1240298,24980] 0 2024-09-11T00:07:09.427 INFO:tasks.workunit.client.1.smithi203.stdout:5/323: fdatasync dc/d4f/f50 0 2024-09-11T00:07:09.428 INFO:tasks.workunit.client.1.smithi203.stdout:1/359: dwrite d8/d11/f51 [0,4194304] 0 2024-09-11T00:07:09.430 INFO:tasks.workunit.client.1.smithi203.stdout:2/204: stat d13/d15/d19/f36 0 2024-09-11T00:07:09.431 INFO:tasks.workunit.client.0.smithi111.stdout:5/266: read d10/d1e/d25/f29 [1232453,66461] 0 2024-09-11T00:07:09.432 INFO:tasks.workunit.client.1.smithi203.stdout:6/246: creat d0/d32/f46 x:0 0 0 2024-09-11T00:07:09.432 INFO:tasks.workunit.client.0.smithi111.stdout:0/250: write d3/da/f21 [1137346,75962] 0 2024-09-11T00:07:09.434 INFO:tasks.workunit.client.0.smithi111.stdout:7/252: symlink dd/d1d/d4b/l4f 0 2024-09-11T00:07:09.435 INFO:tasks.workunit.client.0.smithi111.stdout:4/219: dread d18/d20/d4a/f3f [0,4194304] 0 2024-09-11T00:07:09.436 INFO:tasks.workunit.client.0.smithi111.stdout:4/220: chown d18/d20 1424962 1 2024-09-11T00:07:09.437 INFO:tasks.workunit.client.1.smithi203.stdout:5/324: fdatasync dc/dd/d1e/f54 0 2024-09-11T00:07:09.439 INFO:tasks.workunit.client.0.smithi111.stdout:5/267: truncate d10/d1e/d23/d26/d3a/f4b 505638 0 2024-09-11T00:07:09.442 INFO:tasks.workunit.client.0.smithi111.stdout:8/283: link d11/d23/d2c/d53/c58 d11/d23/d3d/d5f/c60 0 2024-09-11T00:07:09.443 INFO:tasks.workunit.client.0.smithi111.stdout:2/241: creat d0/d3/de/d50/f59 x:0 0 0 2024-09-11T00:07:09.445 INFO:tasks.workunit.client.1.smithi203.stdout:2/205: creat d13/d22/f38 x:0 0 0 2024-09-11T00:07:09.448 INFO:tasks.workunit.client.0.smithi111.stdout:2/242: chown d0/d3/de/c48 13685217 1 2024-09-11T00:07:09.450 INFO:tasks.workunit.client.1.smithi203.stdout:6/247: dread d0/f21 [0,4194304] 0 2024-09-11T00:07:09.450 INFO:tasks.workunit.client.0.smithi111.stdout:2/243: fsync d0/d3/d12/f3d 0 2024-09-11T00:07:09.451 INFO:tasks.workunit.client.1.smithi203.stdout:6/248: chown d0 265 1 2024-09-11T00:07:09.451 INFO:tasks.workunit.client.0.smithi111.stdout:1/227: dwrite d2/de/f11 [0,4194304] 0 2024-09-11T00:07:09.452 INFO:tasks.workunit.client.0.smithi111.stdout:2/244: dread - d0/d3/f56 zero size 2024-09-11T00:07:09.453 INFO:tasks.workunit.client.1.smithi203.stdout:1/360: dwrite d8/d9/d15/d27/f39 [0,4194304] 0 2024-09-11T00:07:09.455 INFO:tasks.workunit.client.1.smithi203.stdout:6/249: write d0/d27/f3b [477183,13743] 0 2024-09-11T00:07:09.458 INFO:tasks.workunit.client.1.smithi203.stdout:5/325: dread dc/dd/d4d/f57 [0,4194304] 0 2024-09-11T00:07:09.460 INFO:tasks.workunit.client.0.smithi111.stdout:6/193: rmdir d7/d22/d2c/d38/d39/d3d 0 2024-09-11T00:07:09.461 INFO:tasks.workunit.client.1.smithi203.stdout:2/206: creat d13/d15/d30/f39 x:0 0 0 2024-09-11T00:07:09.463 INFO:tasks.workunit.client.1.smithi203.stdout:6/250: rmdir d0 39 2024-09-11T00:07:09.464 INFO:tasks.workunit.client.1.smithi203.stdout:2/207: write d13/d15/f23 [4723590,53727] 0 2024-09-11T00:07:09.465 INFO:tasks.workunit.client.0.smithi111.stdout:9/282: getdents d6/db/d34/d37/d4c 0 2024-09-11T00:07:09.470 INFO:tasks.workunit.client.0.smithi111.stdout:5/268: creat d10/d1e/d23/d30/d46/f5b x:0 0 0 2024-09-11T00:07:09.472 INFO:tasks.workunit.client.0.smithi111.stdout:7/253: dread fa [0,4194304] 0 2024-09-11T00:07:09.476 INFO:tasks.workunit.client.1.smithi203.stdout:1/361: mkdir d8/d9/d15/d30/d3e/d4b/d80 0 2024-09-11T00:07:09.478 INFO:tasks.workunit.client.1.smithi203.stdout:2/208: rmdir d13/d15/d19 39 2024-09-11T00:07:09.479 INFO:tasks.workunit.client.1.smithi203.stdout:2/209: dread - d13/d22/f38 zero size 2024-09-11T00:07:09.479 INFO:tasks.workunit.client.1.smithi203.stdout:3/391: sync 2024-09-11T00:07:09.480 INFO:tasks.workunit.client.0.smithi111.stdout:2/245: dwrite d0/d3/de/d50/f59 [0,4194304] 0 2024-09-11T00:07:09.481 INFO:tasks.workunit.client.0.smithi111.stdout:1/228: symlink d2/de/d12/d3c/l49 0 2024-09-11T00:07:09.481 INFO:tasks.workunit.client.1.smithi203.stdout:6/251: creat d0/d27/d35/d38/f47 x:0 0 0 2024-09-11T00:07:09.483 INFO:tasks.workunit.client.0.smithi111.stdout:1/229: dread - d2/de/d12/f28 zero size 2024-09-11T00:07:09.484 INFO:tasks.workunit.client.1.smithi203.stdout:1/362: unlink d8/d9/d15/f22 0 2024-09-11T00:07:09.487 INFO:tasks.workunit.client.0.smithi111.stdout:6/194: readlink d7/d2b/l3c 0 2024-09-11T00:07:09.487 INFO:tasks.workunit.client.0.smithi111.stdout:0/251: creat d3/d1c/d50/f5f x:0 0 0 2024-09-11T00:07:09.488 INFO:tasks.workunit.client.1.smithi203.stdout:1/363: chown d8/d9/d15/d30/d3e/d4b/d41 180 1 2024-09-11T00:07:09.488 INFO:tasks.workunit.client.1.smithi203.stdout:2/210: chown d13/d15/d19/f2c 75059 1 2024-09-11T00:07:09.490 INFO:tasks.workunit.client.0.smithi111.stdout:9/283: rename d6/db/d34/d37/f25 to d6/d52/f59 0 2024-09-11T00:07:09.492 INFO:tasks.workunit.client.0.smithi111.stdout:9/284: readlink d6/db/d34/d37/l3a 0 2024-09-11T00:07:09.492 INFO:tasks.workunit.client.1.smithi203.stdout:1/364: write d8/d9/d15/d30/f5e [5034260,110431] 0 2024-09-11T00:07:09.493 INFO:tasks.workunit.client.1.smithi203.stdout:3/392: symlink d8/d17/l92 0 2024-09-11T00:07:09.496 INFO:tasks.workunit.client.1.smithi203.stdout:1/365: chown d8/d9/d15/d35/l7a 740489538 1 2024-09-11T00:07:09.501 INFO:tasks.workunit.client.0.smithi111.stdout:9/285: dread d6/db/d34/d37/f35 [0,4194304] 0 2024-09-11T00:07:09.501 INFO:tasks.workunit.client.0.smithi111.stdout:7/254: creat dd/d1d/d1f/f50 x:0 0 0 2024-09-11T00:07:09.503 INFO:tasks.workunit.client.1.smithi203.stdout:2/211: symlink d13/d15/d30/l3a 0 2024-09-11T00:07:09.503 INFO:tasks.workunit.client.1.smithi203.stdout:5/326: write dc/dd/d13/f14 [342931,69378] 0 2024-09-11T00:07:09.504 INFO:tasks.workunit.client.0.smithi111.stdout:3/300: getdents d1c 0 2024-09-11T00:07:09.512 INFO:tasks.workunit.client.1.smithi203.stdout:2/212: mknod d13/d22/c3b 0 2024-09-11T00:07:09.513 INFO:tasks.workunit.client.0.smithi111.stdout:0/252: symlink d3/d13/d38/l60 0 2024-09-11T00:07:09.515 INFO:tasks.workunit.client.1.smithi203.stdout:3/393: mknod d8/da/d5c/c93 0 2024-09-11T00:07:09.515 INFO:tasks.workunit.client.1.smithi203.stdout:6/252: dread d0/d27/f18 [0,4194304] 0 2024-09-11T00:07:09.516 INFO:tasks.workunit.client.0.smithi111.stdout:5/269: mkdir d10/d1e/d23/d2b/d5c 0 2024-09-11T00:07:09.517 INFO:tasks.workunit.client.1.smithi203.stdout:6/253: fsync d0/f2a 0 2024-09-11T00:07:09.520 INFO:tasks.workunit.client.0.smithi111.stdout:7/255: rename dd/d1d/l43 to dd/d1d/d4d/l51 0 2024-09-11T00:07:09.522 INFO:tasks.workunit.client.1.smithi203.stdout:2/213: creat d13/d15/d19/d1c/f3c x:0 0 0 2024-09-11T00:07:09.522 INFO:tasks.workunit.client.1.smithi203.stdout:5/327: dwrite dc/d65/f60 [0,4194304] 0 2024-09-11T00:07:09.523 INFO:tasks.workunit.client.0.smithi111.stdout:3/301: rmdir d1c/d21 39 2024-09-11T00:07:09.524 INFO:tasks.workunit.client.0.smithi111.stdout:1/230: dwrite d2/d2b/f3e [0,4194304] 0 2024-09-11T00:07:09.526 INFO:tasks.workunit.client.0.smithi111.stdout:1/231: dread - d2/de/f25 zero size 2024-09-11T00:07:09.529 INFO:tasks.workunit.client.1.smithi203.stdout:1/366: truncate d8/d19/f26 608319 0 2024-09-11T00:07:09.535 INFO:tasks.workunit.client.0.smithi111.stdout:9/286: creat d6/db/d1b/d56/f5a x:0 0 0 2024-09-11T00:07:09.535 INFO:tasks.workunit.client.0.smithi111.stdout:0/253: mkdir d3/d13/d1e/d29/d49/d51/d61 0 2024-09-11T00:07:09.539 INFO:tasks.workunit.client.0.smithi111.stdout:5/270: creat d10/d1e/d23/d26/d3a/f5d x:0 0 0 2024-09-11T00:07:09.539 INFO:tasks.workunit.client.1.smithi203.stdout:1/367: mkdir d8/d9/d15/d35/d81 0 2024-09-11T00:07:09.541 INFO:tasks.workunit.client.1.smithi203.stdout:3/394: link d8/da/d37/f3f d8/da/d34/f94 0 2024-09-11T00:07:09.541 INFO:tasks.workunit.client.0.smithi111.stdout:5/271: write d10/d1e/d23/d2b/d2f/f3f [1019905,125978] 0 2024-09-11T00:07:09.542 INFO:tasks.workunit.client.0.smithi111.stdout:2/246: link d0/d3/de/f11 d0/d3/d2e/f5a 0 2024-09-11T00:07:09.544 INFO:tasks.workunit.client.0.smithi111.stdout:9/287: creat d6/db/f5b x:0 0 0 2024-09-11T00:07:09.551 INFO:tasks.workunit.client.0.smithi111.stdout:4/221: sync 2024-09-11T00:07:09.551 INFO:tasks.workunit.client.0.smithi111.stdout:8/284: sync 2024-09-11T00:07:09.552 INFO:tasks.workunit.client.1.smithi203.stdout:1/368: symlink d8/d9/d15/d30/d3e/d66/l82 0 2024-09-11T00:07:09.555 INFO:tasks.workunit.client.0.smithi111.stdout:0/254: dwrite d3/d13/d1e/d29/d49/d51/f59 [0,4194304] 0 2024-09-11T00:07:09.556 INFO:tasks.workunit.client.1.smithi203.stdout:6/254: write d0/f10 [4112883,128987] 0 2024-09-11T00:07:09.557 INFO:tasks.workunit.client.1.smithi203.stdout:3/395: symlink d8/da/d37/d53/l95 0 2024-09-11T00:07:09.558 INFO:tasks.workunit.client.0.smithi111.stdout:5/272: rename d10/f1f to d10/d1e/d23/d30/d59/d53/f5e 0 2024-09-11T00:07:09.560 INFO:tasks.workunit.client.0.smithi111.stdout:5/273: fsync f1 0 2024-09-11T00:07:09.561 INFO:tasks.workunit.client.1.smithi203.stdout:1/369: creat d8/d9/d15/d35/d81/f83 x:0 0 0 2024-09-11T00:07:09.562 INFO:tasks.workunit.client.1.smithi203.stdout:6/255: mknod d0/c48 0 2024-09-11T00:07:09.564 INFO:tasks.workunit.client.1.smithi203.stdout:3/396: mkdir d8/da/d5c/d6b/d96 0 2024-09-11T00:07:09.569 INFO:tasks.workunit.client.1.smithi203.stdout:1/370: creat d8/d9/d15/d30/d3e/d4b/d3a/f84 x:0 0 0 2024-09-11T00:07:09.569 INFO:tasks.workunit.client.1.smithi203.stdout:2/214: write f8 [2272751,41706] 0 2024-09-11T00:07:09.572 INFO:tasks.workunit.client.1.smithi203.stdout:1/371: write d8/d9/d15/d35/d81/f83 [266795,45327] 0 2024-09-11T00:07:09.575 INFO:tasks.workunit.client.1.smithi203.stdout:1/372: readlink d8/d9/d15/d35/l7a 0 2024-09-11T00:07:09.576 INFO:tasks.workunit.client.0.smithi111.stdout:6/195: dwrite d7/f11 [0,4194304] 0 2024-09-11T00:07:09.577 INFO:tasks.workunit.client.1.smithi203.stdout:1/373: chown d8/d9/d15/d30/d3e/d4b/d80 443045 1 2024-09-11T00:07:09.577 INFO:tasks.workunit.client.0.smithi111.stdout:4/222: dwrite d18/d1f/d33/f3d [4194304,4194304] 0 2024-09-11T00:07:09.578 INFO:tasks.workunit.client.0.smithi111.stdout:6/196: fdatasync d7/f9 0 2024-09-11T00:07:09.578 INFO:tasks.workunit.client.1.smithi203.stdout:1/374: fsync d8/f1a 0 2024-09-11T00:07:09.578 INFO:tasks.workunit.client.1.smithi203.stdout:2/215: creat d13/d15/d19/d1c/f3d x:0 0 0 2024-09-11T00:07:09.579 INFO:tasks.workunit.client.0.smithi111.stdout:6/197: chown d7 732185 1 2024-09-11T00:07:09.579 INFO:tasks.workunit.client.0.smithi111.stdout:7/256: truncate f7 2258580 0 2024-09-11T00:07:09.580 INFO:tasks.workunit.client.0.smithi111.stdout:1/232: truncate d2/de/d12/d34/f1a 885201 0 2024-09-11T00:07:09.581 INFO:tasks.workunit.client.0.smithi111.stdout:6/198: read - d7/d22/d1d/f31 zero size 2024-09-11T00:07:09.581 INFO:tasks.workunit.client.0.smithi111.stdout:7/257: chown dd/l11 4556014 1 2024-09-11T00:07:09.582 INFO:tasks.workunit.client.1.smithi203.stdout:2/216: write d13/d15/d19/f36 [149300,14425] 0 2024-09-11T00:07:09.582 INFO:tasks.workunit.client.1.smithi203.stdout:1/375: write d8/d28/d64/f65 [4063603,45868] 0 2024-09-11T00:07:09.585 INFO:tasks.workunit.client.1.smithi203.stdout:1/376: chown d8/d9/d15/d35/d81/f83 0 1 2024-09-11T00:07:09.585 INFO:tasks.workunit.client.0.smithi111.stdout:8/285: creat d11/d21/d38/d54/d5b/f61 x:0 0 0 2024-09-11T00:07:09.586 INFO:tasks.workunit.client.0.smithi111.stdout:2/247: write d0/d3/f36 [629728,36892] 0 2024-09-11T00:07:09.586 INFO:tasks.workunit.client.1.smithi203.stdout:1/377: readlink d8/l55 0 2024-09-11T00:07:09.588 INFO:tasks.workunit.client.0.smithi111.stdout:5/274: fdatasync d10/d1e/f21 0 2024-09-11T00:07:09.589 INFO:tasks.workunit.client.1.smithi203.stdout:3/397: creat d8/da/f97 x:0 0 0 2024-09-11T00:07:09.591 INFO:tasks.workunit.client.0.smithi111.stdout:2/248: write d0/d3/d12/f3a [986340,51990] 0 2024-09-11T00:07:09.592 INFO:tasks.workunit.client.1.smithi203.stdout:2/217: mknod d13/d22/c3e 0 2024-09-11T00:07:09.592 INFO:tasks.workunit.client.1.smithi203.stdout:1/378: write d8/d9/d15/d30/d3e/d66/f6e [4939258,87188] 0 2024-09-11T00:07:09.596 INFO:tasks.workunit.client.0.smithi111.stdout:2/249: readlink d0/d3/d12/l29 0 2024-09-11T00:07:09.596 INFO:tasks.workunit.client.0.smithi111.stdout:4/223: rmdir d18/d20/d40 39 2024-09-11T00:07:09.596 INFO:tasks.workunit.client.0.smithi111.stdout:9/288: link d6/db/f50 d6/db/d1b/f5c 0 2024-09-11T00:07:09.597 INFO:tasks.workunit.client.0.smithi111.stdout:3/302: dread d1c/d1d/d22/d23/f40 [0,4194304] 0 2024-09-11T00:07:09.598 INFO:tasks.workunit.client.1.smithi203.stdout:2/218: creat d13/d22/f3f x:0 0 0 2024-09-11T00:07:09.599 INFO:tasks.workunit.client.0.smithi111.stdout:6/199: chown d7/d22/c20 1257 1 2024-09-11T00:07:09.600 INFO:tasks.workunit.client.0.smithi111.stdout:0/255: link d3/c19 d3/d1c/d50/c62 0 2024-09-11T00:07:09.601 INFO:tasks.workunit.client.0.smithi111.stdout:5/275: creat d10/d1e/d23/d2b/d2f/f5f x:0 0 0 2024-09-11T00:07:09.601 INFO:tasks.workunit.client.0.smithi111.stdout:0/256: chown d3 11 1 2024-09-11T00:07:09.603 INFO:tasks.workunit.client.0.smithi111.stdout:8/286: creat d11/d23/d3d/d5f/f62 x:0 0 0 2024-09-11T00:07:09.604 INFO:tasks.workunit.client.1.smithi203.stdout:3/398: link d8/da/d11/l7a d8/da/d5c/d6b/d6c/l98 0 2024-09-11T00:07:09.606 INFO:tasks.workunit.client.1.smithi203.stdout:3/399: fsync d8/da/d34/f39 0 2024-09-11T00:07:09.607 INFO:tasks.workunit.client.0.smithi111.stdout:4/224: write d18/d20/f30 [752911,123451] 0 2024-09-11T00:07:09.612 INFO:tasks.workunit.client.0.smithi111.stdout:7/258: getdents dd/d1d/d4d 0 2024-09-11T00:07:09.615 INFO:tasks.workunit.client.0.smithi111.stdout:1/233: dwrite d2/de/f25 [0,4194304] 0 2024-09-11T00:07:09.615 INFO:tasks.workunit.client.0.smithi111.stdout:0/257: rename d3/d1c/d50 to d3/d1c/d50/d63 22 2024-09-11T00:07:09.616 INFO:tasks.workunit.client.0.smithi111.stdout:3/303: chown d1c/d1d/d22/d31/c5d 3604297 1 2024-09-11T00:07:09.618 INFO:tasks.workunit.client.0.smithi111.stdout:7/259: readlink dd/d1d/d4b/l4f 0 2024-09-11T00:07:09.618 INFO:tasks.workunit.client.0.smithi111.stdout:5/276: chown d10/d1e/d23/d30/d46/f5b 2110671728 1 2024-09-11T00:07:09.624 INFO:tasks.workunit.client.1.smithi203.stdout:3/400: dwrite d8/da/d5c/d6b/d6c/f7b [0,4194304] 0 2024-09-11T00:07:09.634 INFO:tasks.workunit.client.0.smithi111.stdout:2/250: dread d0/d3/f56 [0,4194304] 0 2024-09-11T00:07:09.637 INFO:tasks.workunit.client.0.smithi111.stdout:8/287: dread f7 [0,4194304] 0 2024-09-11T00:07:09.638 INFO:tasks.workunit.client.0.smithi111.stdout:5/277: mkdir d10/d1e/d23/d30/d3c/d60 0 2024-09-11T00:07:09.641 INFO:tasks.workunit.client.1.smithi203.stdout:3/401: dwrite d8/d17/f1c [0,4194304] 0 2024-09-11T00:07:09.642 INFO:tasks.workunit.client.0.smithi111.stdout:2/251: read d0/d3/d12/f41 [1036699,13428] 0 2024-09-11T00:07:09.643 INFO:tasks.workunit.client.0.smithi111.stdout:0/258: dread d3/d13/d1e/f4d [0,4194304] 0 2024-09-11T00:07:09.649 INFO:tasks.workunit.client.0.smithi111.stdout:6/200: dwrite f6 [0,4194304] 0 2024-09-11T00:07:09.649 INFO:tasks.workunit.client.0.smithi111.stdout:3/304: link d1c/d1d/d22/d31/f54 d1c/d1d/d22/d23/d2f/f67 0 2024-09-11T00:07:09.650 INFO:tasks.workunit.client.0.smithi111.stdout:2/252: write d0/d3/de/f44 [3838301,129398] 0 2024-09-11T00:07:09.650 INFO:tasks.workunit.client.0.smithi111.stdout:4/225: dwrite f15 [0,4194304] 0 2024-09-11T00:07:09.651 INFO:tasks.workunit.client.0.smithi111.stdout:5/278: chown d10/d1e/d23/d2b/d2f/f5f 1169 1 2024-09-11T00:07:09.652 INFO:tasks.workunit.client.0.smithi111.stdout:0/259: readlink d3/d26/l57 0 2024-09-11T00:07:09.652 INFO:tasks.workunit.client.0.smithi111.stdout:8/288: rmdir d11/d23 39 2024-09-11T00:07:09.655 INFO:tasks.workunit.client.0.smithi111.stdout:6/201: fsync d7/f23 0 2024-09-11T00:07:09.660 INFO:tasks.workunit.client.0.smithi111.stdout:8/289: chown d11/d21/d38 14038884 1 2024-09-11T00:07:09.662 INFO:tasks.workunit.client.0.smithi111.stdout:8/290: truncate d11/f33 4423521 0 2024-09-11T00:07:09.662 INFO:tasks.workunit.client.0.smithi111.stdout:0/260: mknod d3/d1c/d50/c64 0 2024-09-11T00:07:09.663 INFO:tasks.workunit.client.1.smithi203.stdout:3/402: dwrite d8/d2a/f40 [0,4194304] 0 2024-09-11T00:07:09.667 INFO:tasks.workunit.client.0.smithi111.stdout:0/261: readlink d3/d13/d38/l46 0 2024-09-11T00:07:09.668 INFO:tasks.workunit.client.0.smithi111.stdout:7/260: dwrite f6 [0,4194304] 0 2024-09-11T00:07:09.671 INFO:tasks.workunit.client.0.smithi111.stdout:2/253: rmdir d0/d3/d12 39 2024-09-11T00:07:09.671 INFO:tasks.workunit.client.1.smithi203.stdout:3/403: mkdir d8/da/d5c/d99 0 2024-09-11T00:07:09.675 INFO:tasks.workunit.client.0.smithi111.stdout:9/289: dread d6/db/d34/d37/f29 [0,4194304] 0 2024-09-11T00:07:09.679 INFO:tasks.workunit.client.0.smithi111.stdout:8/291: stat d11/d23/d2c/d46 0 2024-09-11T00:07:09.679 INFO:tasks.workunit.client.0.smithi111.stdout:2/254: fsync d0/d3/f36 0 2024-09-11T00:07:09.681 INFO:tasks.workunit.client.0.smithi111.stdout:8/292: chown d11/d21/d38/c49 697310268 1 2024-09-11T00:07:09.682 INFO:tasks.workunit.client.0.smithi111.stdout:5/279: dread d10/d1e/d25/f4a [0,4194304] 0 2024-09-11T00:07:09.683 INFO:tasks.workunit.client.0.smithi111.stdout:6/202: getdents d7/d2b/d35 0 2024-09-11T00:07:09.688 INFO:tasks.workunit.client.0.smithi111.stdout:8/293: write d11/d21/d38/d54/d5b/f61 [85470,49549] 0 2024-09-11T00:07:09.688 INFO:tasks.workunit.client.0.smithi111.stdout:0/262: creat d3/f65 x:0 0 0 2024-09-11T00:07:09.692 INFO:tasks.workunit.client.0.smithi111.stdout:1/234: dread d2/de/d12/d34/f1a [0,4194304] 0 2024-09-11T00:07:09.693 INFO:tasks.workunit.client.1.smithi203.stdout:3/404: dwrite d8/da/f44 [0,4194304] 0 2024-09-11T00:07:09.697 INFO:tasks.workunit.client.0.smithi111.stdout:0/263: read - d3/d13/d1e/d29/f53 zero size 2024-09-11T00:07:09.697 INFO:tasks.workunit.client.1.smithi203.stdout:3/405: truncate d8/da/d37/d53/d63/f91 1004752 0 2024-09-11T00:07:09.699 INFO:tasks.workunit.client.0.smithi111.stdout:4/226: write d18/d20/d4a/f3f [1334058,122660] 0 2024-09-11T00:07:09.702 INFO:tasks.workunit.client.0.smithi111.stdout:3/305: truncate d1c/d1d/d22/f60 3783955 0 2024-09-11T00:07:09.703 INFO:tasks.workunit.client.0.smithi111.stdout:1/235: mknod d2/d2b/c4a 0 2024-09-11T00:07:09.709 INFO:tasks.workunit.client.0.smithi111.stdout:5/280: truncate d10/d1e/f2a 1439811 0 2024-09-11T00:07:09.712 INFO:tasks.workunit.client.0.smithi111.stdout:7/261: dwrite dd/d1d/d2d/d2e/f3d [0,4194304] 0 2024-09-11T00:07:09.712 INFO:tasks.workunit.client.0.smithi111.stdout:6/203: dwrite f6 [0,4194304] 0 2024-09-11T00:07:09.716 INFO:tasks.workunit.client.1.smithi203.stdout:3/406: dwrite d8/f16 [4194304,4194304] 0 2024-09-11T00:07:09.717 INFO:tasks.workunit.client.0.smithi111.stdout:3/306: creat d1c/d1d/d22/d23/f68 x:0 0 0 2024-09-11T00:07:09.718 INFO:tasks.workunit.client.1.smithi203.stdout:3/407: fsync d8/f3d 0 2024-09-11T00:07:09.722 INFO:tasks.workunit.client.0.smithi111.stdout:0/264: dread d3/da/ff [0,4194304] 0 2024-09-11T00:07:09.723 INFO:tasks.workunit.client.0.smithi111.stdout:5/281: mkdir d10/d1e/d23/d2b/d5c/d61 0 2024-09-11T00:07:09.724 INFO:tasks.workunit.client.0.smithi111.stdout:0/265: fdatasync d3/d1c/f4f 0 2024-09-11T00:07:09.727 INFO:tasks.workunit.client.0.smithi111.stdout:8/294: getdents d11/d21/d38/d54 0 2024-09-11T00:07:09.728 INFO:tasks.workunit.client.0.smithi111.stdout:6/204: unlink d7/d22/d1d/f1e 0 2024-09-11T00:07:09.732 INFO:tasks.workunit.client.0.smithi111.stdout:0/266: write d3/d13/d1e/f2e [33394,42367] 0 2024-09-11T00:07:09.732 INFO:tasks.workunit.client.0.smithi111.stdout:8/295: fdatasync d11/d23/d2c/d46/f4d 0 2024-09-11T00:07:09.733 INFO:tasks.workunit.client.0.smithi111.stdout:4/227: dwrite d18/d20/d4a/f2f [0,4194304] 0 2024-09-11T00:07:09.736 INFO:tasks.workunit.client.0.smithi111.stdout:4/228: fsync d18/f1b 0 2024-09-11T00:07:09.737 INFO:tasks.workunit.client.0.smithi111.stdout:8/296: fdatasync d11/d21/d38/f57 0 2024-09-11T00:07:09.738 INFO:tasks.workunit.client.0.smithi111.stdout:5/282: symlink d10/d1e/d23/d2b/d5c/l62 0 2024-09-11T00:07:09.739 INFO:tasks.workunit.client.1.smithi203.stdout:3/408: dwrite d8/da/d34/f35 [0,4194304] 0 2024-09-11T00:07:09.742 INFO:tasks.workunit.client.0.smithi111.stdout:4/229: write d18/d20/f46 [105478,47415] 0 2024-09-11T00:07:09.743 INFO:tasks.workunit.client.1.smithi203.stdout:3/409: dread - d8/da/d37/d83/d65/f7c zero size 2024-09-11T00:07:09.746 INFO:tasks.workunit.client.0.smithi111.stdout:1/236: write d2/de/ff [335059,117575] 0 2024-09-11T00:07:09.746 INFO:tasks.workunit.client.0.smithi111.stdout:7/262: dwrite dd/f31 [0,4194304] 0 2024-09-11T00:07:09.753 INFO:tasks.workunit.client.0.smithi111.stdout:0/267: rmdir d3/d13/d1e/d29/d49/d51 39 2024-09-11T00:07:09.753 INFO:tasks.workunit.client.1.smithi203.stdout:3/410: mknod d8/da/d11/c9a 0 2024-09-11T00:07:09.759 INFO:tasks.workunit.client.0.smithi111.stdout:3/307: truncate f8 5510919 0 2024-09-11T00:07:09.759 INFO:tasks.workunit.client.0.smithi111.stdout:8/297: unlink d11/c3f 0 2024-09-11T00:07:09.760 INFO:tasks.workunit.client.0.smithi111.stdout:2/255: dread d0/d3/de/f21 [0,4194304] 0 2024-09-11T00:07:09.763 INFO:tasks.workunit.client.0.smithi111.stdout:1/237: mkdir d2/de/d12/d3c/d4b 0 2024-09-11T00:07:09.766 INFO:tasks.workunit.client.0.smithi111.stdout:1/238: chown d2/de/ff 208243 1 2024-09-11T00:07:09.768 INFO:tasks.workunit.client.0.smithi111.stdout:4/230: dwrite d18/d1f/d33/f3d [0,4194304] 0 2024-09-11T00:07:09.769 INFO:tasks.workunit.client.0.smithi111.stdout:1/239: stat d2/de/f43 0 2024-09-11T00:07:09.771 INFO:tasks.workunit.client.0.smithi111.stdout:4/231: chown d18/f1b 552 1 2024-09-11T00:07:09.779 INFO:tasks.workunit.client.0.smithi111.stdout:0/268: dwrite d3/d13/d1e/d29/f53 [0,4194304] 0 2024-09-11T00:07:09.781 INFO:tasks.workunit.client.0.smithi111.stdout:0/269: stat d3/d26/l56 0 2024-09-11T00:07:09.781 INFO:tasks.workunit.client.0.smithi111.stdout:2/256: dwrite d0/d3/de/d50/f59 [0,4194304] 0 2024-09-11T00:07:09.793 INFO:tasks.workunit.client.0.smithi111.stdout:7/263: symlink dd/d1d/d2d/d2e/d4e/l52 0 2024-09-11T00:07:09.793 INFO:tasks.workunit.client.1.smithi203.stdout:9/271: sync 2024-09-11T00:07:09.793 INFO:tasks.workunit.client.1.smithi203.stdout:7/263: sync 2024-09-11T00:07:09.794 INFO:tasks.workunit.client.1.smithi203.stdout:4/245: sync 2024-09-11T00:07:09.794 INFO:tasks.workunit.client.1.smithi203.stdout:0/283: sync 2024-09-11T00:07:09.799 INFO:tasks.workunit.client.1.smithi203.stdout:3/411: creat d8/da/d37/d53/f9b x:0 0 0 2024-09-11T00:07:09.799 INFO:tasks.workunit.client.0.smithi111.stdout:5/283: mkdir d10/d1e/d23/d30/d3c/d60/d63 0 2024-09-11T00:07:09.799 INFO:tasks.workunit.client.0.smithi111.stdout:0/270: dwrite d3/d13/f3c [0,4194304] 0 2024-09-11T00:07:09.802 INFO:tasks.workunit.client.1.smithi203.stdout:4/246: chown db/d12/d15/d2a/f22 184162338 1 2024-09-11T00:07:09.804 INFO:tasks.workunit.client.1.smithi203.stdout:3/412: write d8/d17/f74 [2832624,47586] 0 2024-09-11T00:07:09.804 INFO:tasks.workunit.client.0.smithi111.stdout:0/271: write d3/da/f1d [4800585,12777] 0 2024-09-11T00:07:09.805 INFO:tasks.workunit.client.1.smithi203.stdout:7/264: rmdir dd 39 2024-09-11T00:07:09.808 INFO:tasks.workunit.client.0.smithi111.stdout:8/298: creat d11/d23/d2c/d46/f63 x:0 0 0 2024-09-11T00:07:09.816 INFO:tasks.workunit.client.1.smithi203.stdout:9/272: rename d6/de/d19/f33 to d6/de/d32/f59 0 2024-09-11T00:07:09.820 INFO:tasks.workunit.client.1.smithi203.stdout:4/247: rmdir db/d12/d15 39 2024-09-11T00:07:09.825 INFO:tasks.workunit.client.1.smithi203.stdout:4/248: truncate db/dd/d26/f3f 257859 0 2024-09-11T00:07:09.829 INFO:tasks.workunit.client.1.smithi203.stdout:4/249: truncate db/dd/d26/f3f 823632 0 2024-09-11T00:07:09.833 INFO:tasks.workunit.client.1.smithi203.stdout:4/250: read - db/dd/d26/d42/f45 zero size 2024-09-11T00:07:09.835 INFO:tasks.workunit.client.1.smithi203.stdout:0/284: creat d0/d2/d37/d5b/f5e x:0 0 0 2024-09-11T00:07:09.838 INFO:tasks.workunit.client.1.smithi203.stdout:0/285: readlink d0/d2/d3d/l50 0 2024-09-11T00:07:09.840 INFO:tasks.workunit.client.1.smithi203.stdout:3/413: symlink d8/da/d5c/d6b/d6c/l9c 0 2024-09-11T00:07:09.842 INFO:tasks.workunit.client.0.smithi111.stdout:7/264: mknod dd/d1d/c53 0 2024-09-11T00:07:09.843 INFO:tasks.workunit.client.1.smithi203.stdout:3/414: write d8/da/d11/f89 [1738793,75376] 0 2024-09-11T00:07:09.845 INFO:tasks.workunit.client.1.smithi203.stdout:9/273: mknod d6/de/d19/d24/d40/c5a 0 2024-09-11T00:07:09.848 INFO:tasks.workunit.client.0.smithi111.stdout:9/290: sync 2024-09-11T00:07:09.850 INFO:tasks.workunit.client.0.smithi111.stdout:9/291: stat d6/db/d34/f47 0 2024-09-11T00:07:09.851 INFO:tasks.workunit.client.1.smithi203.stdout:0/286: symlink d0/d1d/l5f 0 2024-09-11T00:07:09.852 INFO:tasks.workunit.client.0.smithi111.stdout:2/257: dwrite d0/d3/d12/f3d [0,4194304] 0 2024-09-11T00:07:09.852 INFO:tasks.workunit.client.0.smithi111.stdout:8/299: mkdir d11/d23/d2c/d46/d64 0 2024-09-11T00:07:09.853 INFO:tasks.workunit.client.0.smithi111.stdout:8/300: fdatasync d11/d21/f26 0 2024-09-11T00:07:09.855 INFO:tasks.workunit.client.1.smithi203.stdout:4/251: dwrite db/f10 [0,4194304] 0 2024-09-11T00:07:09.855 INFO:tasks.workunit.client.0.smithi111.stdout:4/232: mkdir d18/d20/d4e 0 2024-09-11T00:07:09.864 INFO:tasks.workunit.client.1.smithi203.stdout:0/287: fsync d0/d2/f8 0 2024-09-11T00:07:09.867 INFO:tasks.workunit.client.1.smithi203.stdout:3/415: mknod d8/da/d5c/c9d 0 2024-09-11T00:07:09.869 INFO:tasks.workunit.client.0.smithi111.stdout:2/258: mknod d0/d3/d12/d38/c5b 0 2024-09-11T00:07:09.869 INFO:tasks.workunit.client.1.smithi203.stdout:0/288: fdatasync d0/d2/fb 0 2024-09-11T00:07:09.873 INFO:tasks.workunit.client.0.smithi111.stdout:0/272: dwrite d3/f54 [0,4194304] 0 2024-09-11T00:07:09.874 INFO:tasks.workunit.client.0.smithi111.stdout:2/259: write d0/d3/de/f43 [3939558,31252] 0 2024-09-11T00:07:09.877 INFO:tasks.workunit.client.0.smithi111.stdout:2/260: write d0/fc [707505,11142] 0 2024-09-11T00:07:09.877 INFO:tasks.workunit.client.0.smithi111.stdout:8/301: dwrite d11/d21/f26 [0,4194304] 0 2024-09-11T00:07:09.879 INFO:tasks.workunit.client.0.smithi111.stdout:5/284: rename d10/d1e/d23/d2b/d2f/f3b to d10/d1e/d23/d30/f64 0 2024-09-11T00:07:09.880 INFO:tasks.workunit.client.0.smithi111.stdout:0/273: dread d3/d13/d1e/f2e [0,4194304] 0 2024-09-11T00:07:09.880 INFO:tasks.workunit.client.0.smithi111.stdout:9/292: getdents d6/db/d1b/d41/d46 0 2024-09-11T00:07:09.881 INFO:tasks.workunit.client.1.smithi203.stdout:7/265: write dd/d1c/d26/d31/f50 [640433,3076] 0 2024-09-11T00:07:09.882 INFO:tasks.workunit.client.0.smithi111.stdout:8/302: write d11/d21/f22 [744963,44272] 0 2024-09-11T00:07:09.884 INFO:tasks.workunit.client.0.smithi111.stdout:4/233: dread f5 [0,4194304] 0 2024-09-11T00:07:09.884 INFO:tasks.workunit.client.0.smithi111.stdout:1/240: link d2/de/d12/d34/f1a d2/de/d12/f4c 0 2024-09-11T00:07:09.885 INFO:tasks.workunit.client.0.smithi111.stdout:7/265: link dd/l29 dd/d48/l54 0 2024-09-11T00:07:09.886 INFO:tasks.workunit.client.0.smithi111.stdout:1/241: readlink d2/de/d12/l23 0 2024-09-11T00:07:09.887 INFO:tasks.workunit.client.0.smithi111.stdout:4/234: stat d18/f32 0 2024-09-11T00:07:09.888 INFO:tasks.workunit.client.0.smithi111.stdout:4/235: write d18/d1f/d33/f3d [5407526,68228] 0 2024-09-11T00:07:09.889 INFO:tasks.workunit.client.1.smithi203.stdout:0/289: dread d0/f29 [0,4194304] 0 2024-09-11T00:07:09.893 INFO:tasks.workunit.client.0.smithi111.stdout:2/261: rmdir d0/d3/d2e 39 2024-09-11T00:07:09.894 INFO:tasks.workunit.client.1.smithi203.stdout:4/252: fdatasync f2 0 2024-09-11T00:07:09.900 INFO:tasks.workunit.client.1.smithi203.stdout:4/253: truncate db/d12/f37 4483018 0 2024-09-11T00:07:09.905 INFO:tasks.workunit.client.0.smithi111.stdout:9/293: symlink d6/db/d34/l5d 0 2024-09-11T00:07:09.909 INFO:tasks.workunit.client.0.smithi111.stdout:8/303: write f7 [1004257,91119] 0 2024-09-11T00:07:09.912 INFO:tasks.workunit.client.0.smithi111.stdout:8/304: truncate d11/d23/d2c/d46/f4d 614742 0 2024-09-11T00:07:09.913 INFO:tasks.workunit.client.1.smithi203.stdout:7/266: unlink dd/f1e 0 2024-09-11T00:07:09.913 INFO:tasks.workunit.client.0.smithi111.stdout:5/285: mknod d10/d1e/d23/d30/d59/d53/c65 0 2024-09-11T00:07:09.920 INFO:tasks.workunit.client.1.smithi203.stdout:4/254: truncate db/dd/f2c 700374 0 2024-09-11T00:07:09.924 INFO:tasks.workunit.client.1.smithi203.stdout:7/267: creat dd/d1c/f5f x:0 0 0 2024-09-11T00:07:09.926 INFO:tasks.workunit.client.0.smithi111.stdout:2/262: symlink d0/d3/d12/l5c 0 2024-09-11T00:07:09.927 INFO:tasks.workunit.client.1.smithi203.stdout:7/268: stat dd/d1c/d26 0 2024-09-11T00:07:09.929 INFO:tasks.workunit.client.1.smithi203.stdout:9/274: dwrite d6/de/d19/d24/f27 [0,4194304] 0 2024-09-11T00:07:09.930 INFO:tasks.workunit.client.0.smithi111.stdout:9/294: creat d6/db/d1b/d41/f5e x:0 0 0 2024-09-11T00:07:09.931 INFO:tasks.workunit.client.1.smithi203.stdout:7/269: write dd/d1c/f20 [1945772,49026] 0 2024-09-11T00:07:09.931 INFO:tasks.workunit.client.0.smithi111.stdout:9/295: dread - d6/db/d1b/f5c zero size 2024-09-11T00:07:09.934 INFO:tasks.workunit.client.1.smithi203.stdout:9/275: read - d6/de/d32/d52/f4b zero size 2024-09-11T00:07:09.935 INFO:tasks.workunit.client.0.smithi111.stdout:9/296: write d6/f3b [167395,94819] 0 2024-09-11T00:07:09.937 INFO:tasks.workunit.client.0.smithi111.stdout:5/286: fsync d10/d1e/d25/f29 0 2024-09-11T00:07:09.940 INFO:tasks.workunit.client.0.smithi111.stdout:1/242: symlink d2/l4d 0 2024-09-11T00:07:09.941 INFO:tasks.workunit.client.0.smithi111.stdout:5/287: dread - d10/d1e/d23/d30/d46/d47/f58 zero size 2024-09-11T00:07:09.944 INFO:tasks.workunit.client.0.smithi111.stdout:2/263: dwrite d0/d3/de/f51 [0,4194304] 0 2024-09-11T00:07:09.953 INFO:tasks.workunit.client.1.smithi203.stdout:7/270: rename dd/l17 to dd/d1c/l60 0 2024-09-11T00:07:09.957 INFO:tasks.workunit.client.1.smithi203.stdout:7/271: dread - dd/d1c/d26/d31/f36 zero size 2024-09-11T00:07:09.964 INFO:tasks.workunit.client.1.smithi203.stdout:0/290: write d0/f15 [768050,130955] 0 2024-09-11T00:07:09.965 INFO:tasks.workunit.client.1.smithi203.stdout:9/276: dwrite d6/de/d19/f1b [0,4194304] 0 2024-09-11T00:07:09.967 INFO:tasks.workunit.client.0.smithi111.stdout:0/274: dread f2 [0,4194304] 0 2024-09-11T00:07:09.968 INFO:tasks.workunit.client.1.smithi203.stdout:0/291: dread - d0/f5c zero size 2024-09-11T00:07:09.969 INFO:tasks.workunit.client.0.smithi111.stdout:0/275: chown d3/d26/l56 470 1 2024-09-11T00:07:09.971 INFO:tasks.workunit.client.1.smithi203.stdout:9/277: chown d6/de/l1d 217318056 1 2024-09-11T00:07:09.973 INFO:tasks.workunit.client.1.smithi203.stdout:8/282: sync 2024-09-11T00:07:09.974 INFO:tasks.workunit.client.1.smithi203.stdout:5/328: sync 2024-09-11T00:07:09.975 INFO:tasks.workunit.client.0.smithi111.stdout:6/205: sync 2024-09-11T00:07:09.978 INFO:tasks.workunit.client.1.smithi203.stdout:5/329: stat dc/d4f/d5c 0 2024-09-11T00:07:09.987 INFO:tasks.workunit.client.1.smithi203.stdout:3/416: dread d8/da/d11/f5d [0,4194304] 0 2024-09-11T00:07:09.987 INFO:tasks.workunit.client.0.smithi111.stdout:9/297: rename d6/dc/l2c to d6/db/d1b/d56/l5f 0 2024-09-11T00:07:09.988 INFO:tasks.workunit.client.0.smithi111.stdout:5/288: fdatasync d10/d1e/d23/d30/d3c/f40 0 2024-09-11T00:07:09.989 INFO:tasks.workunit.client.0.smithi111.stdout:7/266: link dd/l11 dd/d1d/d1f/l55 0 2024-09-11T00:07:09.989 INFO:tasks.workunit.client.0.smithi111.stdout:5/289: readlink d10/l1d 0 2024-09-11T00:07:09.991 INFO:tasks.workunit.client.0.smithi111.stdout:7/267: write dd/d1d/d2d/d2e/f3d [3948679,115633] 0 2024-09-11T00:07:09.993 INFO:tasks.workunit.client.0.smithi111.stdout:2/264: creat d0/d3/de/f5d x:0 0 0 2024-09-11T00:07:09.996 INFO:tasks.workunit.client.1.smithi203.stdout:0/292: dwrite d0/f5c [0,4194304] 0 2024-09-11T00:07:09.998 INFO:tasks.workunit.client.1.smithi203.stdout:0/293: dread - d0/d1d/f3f zero size 2024-09-11T00:07:10.000 INFO:tasks.workunit.client.1.smithi203.stdout:5/330: fsync dc/dd/d15/f19 0 2024-09-11T00:07:10.004 INFO:tasks.workunit.client.1.smithi203.stdout:4/255: write db/dd/f11 [409916,79379] 0 2024-09-11T00:07:10.005 INFO:tasks.workunit.client.0.smithi111.stdout:5/290: dwrite f5 [0,4194304] 0 2024-09-11T00:07:10.006 INFO:tasks.workunit.client.1.smithi203.stdout:4/256: stat db/dd/d26/f2f 0 2024-09-11T00:07:10.010 INFO:tasks.workunit.client.0.smithi111.stdout:3/308: sync 2024-09-11T00:07:10.012 INFO:tasks.workunit.client.1.smithi203.stdout:7/272: symlink dd/l61 0 2024-09-11T00:07:10.017 INFO:tasks.workunit.client.0.smithi111.stdout:8/305: truncate d11/d23/d2c/f3b 1353352 0 2024-09-11T00:07:10.018 INFO:tasks.workunit.client.1.smithi203.stdout:8/283: dread d1/d13/f1f [4194304,4194304] 0 2024-09-11T00:07:10.020 INFO:tasks.workunit.client.1.smithi203.stdout:0/294: mkdir d0/d2/d60 0 2024-09-11T00:07:10.022 INFO:tasks.workunit.client.1.smithi203.stdout:0/295: readlink d0/l36 0 2024-09-11T00:07:10.029 INFO:tasks.workunit.client.1.smithi203.stdout:4/257: creat db/dd/d16/d38/d3c/d41/f46 x:0 0 0 2024-09-11T00:07:10.031 INFO:tasks.workunit.client.1.smithi203.stdout:8/284: mknod d1/d13/d3a/d4c/c69 0 2024-09-11T00:07:10.032 INFO:tasks.workunit.client.1.smithi203.stdout:4/258: write f6 [1876290,48344] 0 2024-09-11T00:07:10.033 INFO:tasks.workunit.client.0.smithi111.stdout:8/306: dwrite d11/f12 [4194304,4194304] 0 2024-09-11T00:07:10.033 INFO:tasks.workunit.client.1.smithi203.stdout:0/296: mkdir d0/d2/d61 0 2024-09-11T00:07:10.035 INFO:tasks.workunit.client.0.smithi111.stdout:8/307: fdatasync d11/f35 0 2024-09-11T00:07:10.039 INFO:tasks.workunit.client.1.smithi203.stdout:8/285: write d1/d13/f1f [2421458,66341] 0 2024-09-11T00:07:10.039 INFO:tasks.workunit.client.0.smithi111.stdout:0/276: mkdir d3/d13/d66 0 2024-09-11T00:07:10.040 INFO:tasks.workunit.client.1.smithi203.stdout:8/286: fdatasync d1/d13/f19 0 2024-09-11T00:07:10.040 INFO:tasks.workunit.client.1.smithi203.stdout:8/287: fsync d1/f5b 0 2024-09-11T00:07:10.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:09 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:07:10.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:09 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:07:10.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:09 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:07:10.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:09 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:07:10.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:09 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:07:10.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:09 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:07:10.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:09 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mgr fail", "who": "smithi111.ypucji"}]: dispatch 2024-09-11T00:07:10.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:09 smithi203 ceph-mon[33225]: osdmap e48: 6 total, 6 up, 6 in 2024-09-11T00:07:10.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:09 smithi203 ceph-mon[33225]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "mgr fail", "who": "smithi111.ypucji"}]': finished 2024-09-11T00:07:10.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:09 smithi203 ceph-mon[33225]: mgrmap e21: smithi203.smuspl(active, starting, since 0.0158533s) 2024-09-11T00:07:10.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:09 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-11T00:07:10.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:09 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-09-11T00:07:10.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:09 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.rucaba"}]: dispatch 2024-09-11T00:07:10.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:09 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.gmgsay"}]: dispatch 2024-09-11T00:07:10.048 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:09 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.tcrqop"}]: dispatch 2024-09-11T00:07:10.048 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:09 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.uqkbkn"}]: dispatch 2024-09-11T00:07:10.048 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:09 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "mgr metadata", "who": "smithi203.smuspl", "id": "smithi203.smuspl"}]: dispatch 2024-09-11T00:07:10.048 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:09 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T00:07:10.048 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:09 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T00:07:10.048 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:09 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T00:07:10.048 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:09 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T00:07:10.048 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:09 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T00:07:10.048 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:09 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T00:07:10.048 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:09 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T00:07:10.048 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:09 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T00:07:10.048 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:09 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T00:07:10.049 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:09 smithi203 ceph-mon[33225]: Manager daemon smithi203.smuspl is now available 2024-09-11T00:07:10.049 INFO:tasks.workunit.client.0.smithi111.stdout:5/291: mkdir d10/d1e/d23/d30/d46/d47/d66 0 2024-09-11T00:07:10.053 INFO:tasks.workunit.client.1.smithi203.stdout:3/417: dwrite d8/d3c/f5a [4194304,4194304] 0 2024-09-11T00:07:10.054 INFO:tasks.workunit.client.1.smithi203.stdout:5/331: dwrite dc/dd/d15/d3b/f63 [0,4194304] 0 2024-09-11T00:07:10.055 INFO:tasks.workunit.client.1.smithi203.stdout:9/278: dread d6/de/d19/f1c [0,4194304] 0 2024-09-11T00:07:10.062 INFO:tasks.workunit.client.1.smithi203.stdout:4/259: mknod db/d12/d15/d2a/c47 0 2024-09-11T00:07:10.063 INFO:tasks.workunit.client.0.smithi111.stdout:3/309: truncate f9 1838235 0 2024-09-11T00:07:10.065 INFO:tasks.workunit.client.0.smithi111.stdout:5/292: dwrite fd [0,4194304] 0 2024-09-11T00:07:10.066 INFO:tasks.workunit.client.1.smithi203.stdout:1/379: sync 2024-09-11T00:07:10.066 INFO:tasks.workunit.client.1.smithi203.stdout:6/256: sync 2024-09-11T00:07:10.066 INFO:tasks.workunit.client.1.smithi203.stdout:2/219: sync 2024-09-11T00:07:10.069 INFO:tasks.workunit.client.0.smithi111.stdout:5/293: write d10/d1e/d23/d2b/d2f/f5f [855513,124651] 0 2024-09-11T00:07:10.072 INFO:tasks.workunit.client.0.smithi111.stdout:5/294: write d10/d1e/d23/d26/f3e [1283644,102906] 0 2024-09-11T00:07:10.074 INFO:tasks.workunit.client.1.smithi203.stdout:4/260: read db/dd/d16/f24 [107671,73539] 0 2024-09-11T00:07:10.076 INFO:tasks.workunit.client.1.smithi203.stdout:3/418: rmdir d8/da 39 2024-09-11T00:07:10.078 INFO:tasks.workunit.client.1.smithi203.stdout:3/419: write d8/d17/f7e [924583,45914] 0 2024-09-11T00:07:10.080 INFO:tasks.workunit.client.1.smithi203.stdout:3/420: stat d8/d17/c1d 0 2024-09-11T00:07:10.080 INFO:tasks.workunit.client.0.smithi111.stdout:7/268: unlink dd/d1d/d1f/c21 0 2024-09-11T00:07:10.082 INFO:tasks.workunit.client.0.smithi111.stdout:4/236: sync 2024-09-11T00:07:10.084 INFO:tasks.workunit.client.0.smithi111.stdout:4/237: write d18/d20/d4a/f2c [4597199,125769] 0 2024-09-11T00:07:10.085 INFO:tasks.workunit.client.1.smithi203.stdout:7/273: fdatasync dd/f30 0 2024-09-11T00:07:10.086 INFO:tasks.workunit.client.0.smithi111.stdout:2/265: mknod d0/d3/c5e 0 2024-09-11T00:07:10.090 INFO:tasks.workunit.client.0.smithi111.stdout:0/277: chown d3/d13/d1e/d29/d49/d51 370 1 2024-09-11T00:07:10.093 INFO:tasks.workunit.client.1.smithi203.stdout:0/297: write d0/d2/f12 [861119,122574] 0 2024-09-11T00:07:10.093 INFO:tasks.workunit.client.1.smithi203.stdout:1/380: dwrite d8/f68 [0,4194304] 0 2024-09-11T00:07:10.099 INFO:tasks.workunit.client.0.smithi111.stdout:6/206: write d7/f15 [146576,44550] 0 2024-09-11T00:07:10.100 INFO:tasks.workunit.client.1.smithi203.stdout:5/332: truncate dc/dd/d1e/f27 874951 0 2024-09-11T00:07:10.101 INFO:tasks.workunit.client.1.smithi203.stdout:4/261: dwrite db/d12/f37 [0,4194304] 0 2024-09-11T00:07:10.113 INFO:tasks.workunit.client.0.smithi111.stdout:0/278: dwrite d3/d13/d1e/d29/f3e [0,4194304] 0 2024-09-11T00:07:10.113 INFO:tasks.workunit.client.1.smithi203.stdout:2/220: creat d13/d15/d19/d1c/f40 x:0 0 0 2024-09-11T00:07:10.115 INFO:tasks.workunit.client.0.smithi111.stdout:1/243: rename d2/de/d12/l27 to d2/de/d12/d39/l4e 0 2024-09-11T00:07:10.118 INFO:tasks.workunit.client.1.smithi203.stdout:1/381: dwrite d8/d9/d15/d27/f2e [0,4194304] 0 2024-09-11T00:07:10.119 INFO:tasks.workunit.client.1.smithi203.stdout:5/333: dread dc/d65/f4a [0,4194304] 0 2024-09-11T00:07:10.120 INFO:tasks.workunit.client.0.smithi111.stdout:9/298: link d6/d52/l54 d6/db/d34/d37/d4c/l60 0 2024-09-11T00:07:10.124 INFO:tasks.workunit.client.1.smithi203.stdout:8/288: dread d1/f11 [0,4194304] 0 2024-09-11T00:07:10.125 INFO:tasks.workunit.client.1.smithi203.stdout:0/298: mknod d0/d1d/c62 0 2024-09-11T00:07:10.126 INFO:tasks.workunit.client.0.smithi111.stdout:7/269: readlink dd/l11 0 2024-09-11T00:07:10.127 INFO:tasks.workunit.client.1.smithi203.stdout:0/299: readlink d0/d1d/l25 0 2024-09-11T00:07:10.129 INFO:tasks.workunit.client.0.smithi111.stdout:7/270: readlink dd/d1d/d1f/l55 0 2024-09-11T00:07:10.130 INFO:tasks.workunit.client.0.smithi111.stdout:7/271: readlink dd/l38 0 2024-09-11T00:07:10.135 INFO:tasks.workunit.client.0.smithi111.stdout:0/279: dwrite d3/d1c/f42 [0,4194304] 0 2024-09-11T00:07:10.135 INFO:tasks.workunit.client.0.smithi111.stdout:2/266: creat d0/d3/d12/f5f x:0 0 0 2024-09-11T00:07:10.135 INFO:tasks.workunit.client.1.smithi203.stdout:9/279: mkdir d6/de/d19/d5b 0 2024-09-11T00:07:10.141 INFO:tasks.workunit.client.1.smithi203.stdout:3/421: dwrite d8/da/d5c/d6b/d6c/f7b [0,4194304] 0 2024-09-11T00:07:10.142 INFO:tasks.workunit.client.0.smithi111.stdout:0/280: fsync d3/d13/d1e/d29/f53 0 2024-09-11T00:07:10.144 INFO:tasks.workunit.client.0.smithi111.stdout:6/207: fdatasync d7/f30 0 2024-09-11T00:07:10.145 INFO:tasks.workunit.client.0.smithi111.stdout:3/310: creat d1c/d1d/d22/d44/d5a/f69 x:0 0 0 2024-09-11T00:07:10.148 INFO:tasks.workunit.client.0.smithi111.stdout:8/308: rename d11/d21/d38/f51 to d11/d23/f65 0 2024-09-11T00:07:10.148 INFO:tasks.workunit.client.1.smithi203.stdout:4/262: write db/dd/f40 [2824342,1709] 0 2024-09-11T00:07:10.149 INFO:tasks.workunit.client.0.smithi111.stdout:3/311: dread - d1c/d1d/d22/d23/d58/d5c/f66 zero size 2024-09-11T00:07:10.150 INFO:tasks.workunit.client.0.smithi111.stdout:5/295: creat d10/d1e/d23/d30/d46/d47/d66/f67 x:0 0 0 2024-09-11T00:07:10.151 INFO:tasks.workunit.client.0.smithi111.stdout:5/296: chown d10/c4f 40365 1 2024-09-11T00:07:10.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:09 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:07:10.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:09 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:07:10.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:09 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:07:10.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:09 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:07:10.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:09 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' 2024-09-11T00:07:10.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:09 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:07:10.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:09 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mgr fail", "who": "smithi111.ypucji"}]: dispatch 2024-09-11T00:07:10.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:09 smithi111 ceph-mon[27539]: osdmap e48: 6 total, 6 up, 6 in 2024-09-11T00:07:10.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:09 smithi111 ceph-mon[27539]: from='mgr.14211 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "mgr fail", "who": "smithi111.ypucji"}]': finished 2024-09-11T00:07:10.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:09 smithi111 ceph-mon[27539]: mgrmap e21: smithi203.smuspl(active, starting, since 0.0158533s) 2024-09-11T00:07:10.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:09 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-11T00:07:10.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:09 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-09-11T00:07:10.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:09 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.rucaba"}]: dispatch 2024-09-11T00:07:10.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:09 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.gmgsay"}]: dispatch 2024-09-11T00:07:10.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:09 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.tcrqop"}]: dispatch 2024-09-11T00:07:10.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:09 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.uqkbkn"}]: dispatch 2024-09-11T00:07:10.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:09 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "mgr metadata", "who": "smithi203.smuspl", "id": "smithi203.smuspl"}]: dispatch 2024-09-11T00:07:10.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:09 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T00:07:10.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:09 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T00:07:10.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:09 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T00:07:10.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:09 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T00:07:10.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:09 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T00:07:10.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:09 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T00:07:10.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:09 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T00:07:10.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:09 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T00:07:10.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:09 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T00:07:10.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:09 smithi111 ceph-mon[27539]: Manager daemon smithi203.smuspl is now available 2024-09-11T00:07:10.156 INFO:tasks.workunit.client.1.smithi203.stdout:2/221: rename d13/d15/d19/f2c to d13/f41 0 2024-09-11T00:07:10.156 INFO:tasks.workunit.client.1.smithi203.stdout:2/222: readlink lf 0 2024-09-11T00:07:10.156 INFO:tasks.workunit.client.1.smithi203.stdout:6/257: write d0/d27/d35/d38/f2e [660286,12314] 0 2024-09-11T00:07:10.159 INFO:tasks.workunit.client.1.smithi203.stdout:2/223: write d13/d15/d30/f39 [900204,60923] 0 2024-09-11T00:07:10.163 INFO:tasks.workunit.client.1.smithi203.stdout:1/382: unlink d8/d9/d15/c67 0 2024-09-11T00:07:10.165 INFO:tasks.workunit.client.0.smithi111.stdout:7/272: symlink dd/d1d/d2d/d2e/l56 0 2024-09-11T00:07:10.169 INFO:tasks.workunit.client.0.smithi111.stdout:4/238: symlink d18/d20/d40/l4f 0 2024-09-11T00:07:10.169 INFO:tasks.workunit.client.1.smithi203.stdout:8/289: symlink d1/d13/d17/d2f/d52/l6a 0 2024-09-11T00:07:10.170 INFO:tasks.workunit.client.0.smithi111.stdout:5/297: dwrite d10/d1e/d23/d30/d46/f5b [0,4194304] 0 2024-09-11T00:07:10.171 INFO:tasks.workunit.client.0.smithi111.stdout:2/267: write d0/d3/de/f21 [12859,121069] 0 2024-09-11T00:07:10.172 INFO:tasks.workunit.client.1.smithi203.stdout:0/300: read - d0/f34 zero size 2024-09-11T00:07:10.175 INFO:tasks.workunit.client.1.smithi203.stdout:8/290: write d1/d13/d17/f39 [62792,23663] 0 2024-09-11T00:07:10.177 INFO:tasks.workunit.client.0.smithi111.stdout:0/281: mknod d3/d13/d38/c67 0 2024-09-11T00:07:10.181 INFO:tasks.workunit.client.0.smithi111.stdout:4/239: dread f5 [0,4194304] 0 2024-09-11T00:07:10.181 INFO:tasks.workunit.client.1.smithi203.stdout:9/280: symlink d6/de/d19/d24/l5c 0 2024-09-11T00:07:10.182 INFO:tasks.workunit.client.1.smithi203.stdout:7/274: dread dd/f22 [0,4194304] 0 2024-09-11T00:07:10.182 INFO:tasks.workunit.client.1.smithi203.stdout:8/291: fsync d1/d13/d22/f29 0 2024-09-11T00:07:10.187 INFO:tasks.workunit.client.1.smithi203.stdout:2/224: dwrite d13/f17 [0,4194304] 0 2024-09-11T00:07:10.191 INFO:tasks.workunit.client.0.smithi111.stdout:3/312: fsync d1c/d1d/d22/d31/d33/f39 0 2024-09-11T00:07:10.191 INFO:tasks.workunit.client.1.smithi203.stdout:5/334: rename dc/dd/d13/f43 to dc/d4f/d5c/f66 0 2024-09-11T00:07:10.194 INFO:tasks.workunit.client.0.smithi111.stdout:9/299: fdatasync d6/dc/f17 0 2024-09-11T00:07:10.200 INFO:tasks.workunit.client.1.smithi203.stdout:0/301: dwrite d0/f29 [0,4194304] 0 2024-09-11T00:07:10.205 INFO:tasks.workunit.client.0.smithi111.stdout:6/208: creat d7/d22/d3f/f42 x:0 0 0 2024-09-11T00:07:10.211 INFO:tasks.workunit.client.1.smithi203.stdout:2/225: creat d13/d15/d19/f42 x:0 0 0 2024-09-11T00:07:10.213 INFO:tasks.workunit.client.1.smithi203.stdout:4/263: dwrite db/d12/d15/d2a/f22 [0,4194304] 0 2024-09-11T00:07:10.213 INFO:tasks.workunit.client.1.smithi203.stdout:2/226: write d13/d15/f25 [1040621,77159] 0 2024-09-11T00:07:10.214 INFO:tasks.workunit.client.0.smithi111.stdout:9/300: dwrite d6/db/f43 [0,4194304] 0 2024-09-11T00:07:10.216 INFO:tasks.workunit.client.1.smithi203.stdout:6/258: rename d0/d27/f40 to d0/d27/d35/d38/f49 0 2024-09-11T00:07:10.221 INFO:tasks.workunit.client.0.smithi111.stdout:4/240: mknod d18/d1f/c50 0 2024-09-11T00:07:10.222 INFO:tasks.workunit.client.0.smithi111.stdout:4/241: fdatasync f8 0 2024-09-11T00:07:10.222 INFO:tasks.workunit.client.1.smithi203.stdout:5/335: dwrite dc/dd/d13/f48 [0,4194304] 0 2024-09-11T00:07:10.223 INFO:tasks.workunit.client.0.smithi111.stdout:5/298: dwrite d10/d1e/d23/d30/f64 [0,4194304] 0 2024-09-11T00:07:10.223 INFO:tasks.workunit.client.1.smithi203.stdout:4/264: chown db/d12/d15/d2a/f34 28 1 2024-09-11T00:07:10.225 INFO:tasks.workunit.client.0.smithi111.stdout:5/299: chown d10/d1e/d23/d26/d3a/l54 11 1 2024-09-11T00:07:10.226 INFO:tasks.workunit.client.0.smithi111.stdout:1/244: rename d2/de/d12/d34/l37 to d2/l4f 0 2024-09-11T00:07:10.229 INFO:tasks.workunit.client.0.smithi111.stdout:3/313: mknod d1c/d1d/d22/d31/d33/d5f/c6a 0 2024-09-11T00:07:10.230 INFO:tasks.workunit.client.1.smithi203.stdout:9/281: getdents d6/de/d32/d52/d44 0 2024-09-11T00:07:10.234 INFO:tasks.workunit.client.0.smithi111.stdout:9/301: creat d6/d52/f61 x:0 0 0 2024-09-11T00:07:10.235 INFO:tasks.workunit.client.1.smithi203.stdout:6/259: write d0/f10 [4036620,113980] 0 2024-09-11T00:07:10.237 INFO:tasks.workunit.client.1.smithi203.stdout:0/302: rename d0/lf to d0/d1d/d5d/l63 0 2024-09-11T00:07:10.243 INFO:tasks.workunit.client.1.smithi203.stdout:0/303: write d0/d2/d37/f38 [505749,26634] 0 2024-09-11T00:07:10.243 INFO:tasks.workunit.client.1.smithi203.stdout:5/336: creat dc/d4f/d5c/f67 x:0 0 0 2024-09-11T00:07:10.244 INFO:tasks.workunit.client.1.smithi203.stdout:0/304: chown d0/c3a 23626 1 2024-09-11T00:07:10.258 INFO:tasks.workunit.client.0.smithi111.stdout:8/309: rename d11/d23/d3d/c59 to d11/d21/d38/d54/c66 0 2024-09-11T00:07:10.258 INFO:tasks.workunit.client.0.smithi111.stdout:7/273: rename dd to dd/d1d/d4d/d57 22 2024-09-11T00:07:10.263 INFO:tasks.workunit.client.1.smithi203.stdout:6/260: dwrite d0/d27/d35/f3f [0,4194304] 0 2024-09-11T00:07:10.267 INFO:tasks.workunit.client.1.smithi203.stdout:2/227: truncate d13/f14 1174179 0 2024-09-11T00:07:10.267 INFO:tasks.workunit.client.0.smithi111.stdout:2/268: sync 2024-09-11T00:07:10.269 INFO:tasks.workunit.client.0.smithi111.stdout:5/300: mknod d10/d1e/d23/d30/d59/c68 0 2024-09-11T00:07:10.269 INFO:tasks.workunit.client.0.smithi111.stdout:2/269: readlink d0/l57 0 2024-09-11T00:07:10.274 INFO:tasks.workunit.client.0.smithi111.stdout:1/245: creat d2/d2b/d2c/f50 x:0 0 0 2024-09-11T00:07:10.276 INFO:tasks.workunit.client.1.smithi203.stdout:9/282: dread d6/de/d19/f4c [0,4194304] 0 2024-09-11T00:07:10.278 INFO:tasks.workunit.client.1.smithi203.stdout:7/275: link dd/f1a dd/d1c/d26/d31/f62 0 2024-09-11T00:07:10.279 INFO:tasks.workunit.client.0.smithi111.stdout:7/274: dwrite f8 [0,4194304] 0 2024-09-11T00:07:10.279 INFO:tasks.workunit.client.0.smithi111.stdout:8/310: dwrite d11/d23/d3d/f43 [0,4194304] 0 2024-09-11T00:07:10.287 INFO:tasks.workunit.client.1.smithi203.stdout:1/383: truncate d8/d9/d15/d30/f5e 4249225 0 2024-09-11T00:07:10.290 INFO:tasks.workunit.client.1.smithi203.stdout:1/384: chown d8/d9/d15/d30 42646 1 2024-09-11T00:07:10.292 INFO:tasks.workunit.client.1.smithi203.stdout:5/337: dread dc/dd/d4d/d59/f46 [0,4194304] 0 2024-09-11T00:07:10.292 INFO:tasks.workunit.client.0.smithi111.stdout:7/275: dread dd/d1d/d2d/d2e/f3d [0,4194304] 0 2024-09-11T00:07:10.294 INFO:tasks.workunit.client.0.smithi111.stdout:1/246: dwrite d2/de/d12/d39/f3d [0,4194304] 0 2024-09-11T00:07:10.302 INFO:tasks.workunit.client.1.smithi203.stdout:2/228: dwrite d13/d15/d19/d1c/f3d [0,4194304] 0 2024-09-11T00:07:10.308 INFO:tasks.workunit.client.0.smithi111.stdout:9/302: creat d6/dc/f62 x:0 0 0 2024-09-11T00:07:10.308 INFO:tasks.workunit.client.1.smithi203.stdout:6/261: write d0/d27/f19 [4871195,74549] 0 2024-09-11T00:07:10.309 INFO:tasks.workunit.client.0.smithi111.stdout:9/303: write d6/db/d1b/f1e [4086904,110369] 0 2024-09-11T00:07:10.309 INFO:tasks.workunit.client.0.smithi111.stdout:0/282: getdents d3/d26 0 2024-09-11T00:07:10.321 INFO:tasks.workunit.client.1.smithi203.stdout:7/276: creat dd/d1c/d26/d31/f63 x:0 0 0 2024-09-11T00:07:10.326 INFO:tasks.workunit.client.0.smithi111.stdout:3/314: dread f5 [4194304,4194304] 0 2024-09-11T00:07:10.330 INFO:tasks.workunit.client.1.smithi203.stdout:2/229: dread f8 [0,4194304] 0 2024-09-11T00:07:10.330 INFO:tasks.workunit.client.0.smithi111.stdout:0/283: dwrite d3/dc/f3f [0,4194304] 0 2024-09-11T00:07:10.331 INFO:tasks.workunit.client.1.smithi203.stdout:1/385: mknod d8/d9/d15/d30/d3e/c85 0 2024-09-11T00:07:10.332 INFO:tasks.workunit.client.0.smithi111.stdout:0/284: chown d3/d13/f3c 1826 1 2024-09-11T00:07:10.334 INFO:tasks.workunit.client.0.smithi111.stdout:0/285: chown d3/d26/l56 119 1 2024-09-11T00:07:10.335 INFO:tasks.workunit.client.0.smithi111.stdout:6/209: truncate f6 2641476 0 2024-09-11T00:07:10.341 INFO:tasks.workunit.client.1.smithi203.stdout:5/338: rename dc/dd/d1e/l24 to dc/d2b/l68 0 2024-09-11T00:07:10.343 INFO:tasks.workunit.client.0.smithi111.stdout:4/242: write d18/d1f/f26 [917917,89342] 0 2024-09-11T00:07:10.346 INFO:tasks.workunit.client.0.smithi111.stdout:8/311: mknod d11/d21/d38/d54/c67 0 2024-09-11T00:07:10.348 INFO:tasks.workunit.client.1.smithi203.stdout:9/283: mkdir d6/de/d47/d5d 0 2024-09-11T00:07:10.350 INFO:tasks.workunit.client.0.smithi111.stdout:7/276: rename dd/c25 to dd/d1d/d2d/d2e/d4e/c58 0 2024-09-11T00:07:10.352 INFO:tasks.workunit.client.0.smithi111.stdout:7/277: dread dd/f26 [0,4194304] 0 2024-09-11T00:07:10.355 INFO:tasks.workunit.client.0.smithi111.stdout:9/304: fdatasync d6/db/d34/d37/f19 0 2024-09-11T00:07:10.359 INFO:tasks.workunit.client.0.smithi111.stdout:2/270: unlink d0/d3/lf 0 2024-09-11T00:07:10.360 INFO:tasks.workunit.client.0.smithi111.stdout:5/301: dwrite d10/f22 [0,4194304] 0 2024-09-11T00:07:10.376 INFO:tasks.workunit.client.1.smithi203.stdout:2/230: dread d13/d15/d19/d1c/f2d [0,4194304] 0 2024-09-11T00:07:10.399 INFO:tasks.workunit.client.0.smithi111.stdout:5/302: dread d10/f1c [0,4194304] 0 2024-09-11T00:07:10.401 INFO:tasks.workunit.client.0.smithi111.stdout:5/303: read d10/f1b [541456,123921] 0 2024-09-11T00:07:10.403 INFO:tasks.workunit.client.0.smithi111.stdout:5/304: readlink d10/d1e/d23/d2b/d2f/l39 0 2024-09-11T00:07:10.434 INFO:tasks.workunit.client.1.smithi203.stdout:7/277: write dd/d1c/f35 [1421455,89501] 0 2024-09-11T00:07:10.434 INFO:tasks.workunit.client.0.smithi111.stdout:4/243: mkdir d18/d3b/d51 0 2024-09-11T00:07:10.439 INFO:tasks.workunit.client.0.smithi111.stdout:1/247: creat d2/de/d12/d3c/d4b/f51 x:0 0 0 2024-09-11T00:07:10.442 INFO:tasks.workunit.client.0.smithi111.stdout:1/248: write d2/d2b/d2c/f50 [894577,52142] 0 2024-09-11T00:07:10.444 INFO:tasks.workunit.client.0.smithi111.stdout:1/249: chown d2/de/c30 3207 1 2024-09-11T00:07:10.447 INFO:tasks.workunit.client.0.smithi111.stdout:1/250: chown d2/f2e 153191555 1 2024-09-11T00:07:10.447 INFO:tasks.workunit.client.1.smithi203.stdout:5/339: dread - dc/dd/f32 zero size 2024-09-11T00:07:10.457 INFO:tasks.workunit.client.0.smithi111.stdout:9/305: write d6/db/f49 [55045,42953] 0 2024-09-11T00:07:10.458 INFO:tasks.workunit.client.1.smithi203.stdout:0/305: getdents d0/d2/d37/d5b 0 2024-09-11T00:07:10.465 INFO:tasks.workunit.client.1.smithi203.stdout:5/340: creat dc/d4f/d5c/f69 x:0 0 0 2024-09-11T00:07:10.468 INFO:tasks.workunit.client.1.smithi203.stdout:3/422: sync 2024-09-11T00:07:10.468 INFO:tasks.workunit.client.0.smithi111.stdout:5/305: symlink d10/d1e/d23/d30/d46/d47/d66/l69 0 2024-09-11T00:07:10.469 INFO:tasks.workunit.client.1.smithi203.stdout:3/423: chown d8/da/d5c/f8d 425756 1 2024-09-11T00:07:10.470 INFO:tasks.workunit.client.0.smithi111.stdout:3/315: creat d1c/d1d/d22/d23/d2f/d63/f6b x:0 0 0 2024-09-11T00:07:10.471 INFO:tasks.workunit.client.1.smithi203.stdout:3/424: chown d8/d3c 3499 1 2024-09-11T00:07:10.473 INFO:tasks.workunit.client.1.smithi203.stdout:0/306: symlink d0/d1d/l64 0 2024-09-11T00:07:10.473 INFO:tasks.workunit.client.0.smithi111.stdout:6/210: mknod d7/d22/c43 0 2024-09-11T00:07:10.473 INFO:tasks.workunit.client.1.smithi203.stdout:3/425: write d8/da/d37/d83/d65/f7c [372049,84020] 0 2024-09-11T00:07:10.481 INFO:tasks.workunit.client.0.smithi111.stdout:8/312: creat d11/d23/d2c/d46/d64/f68 x:0 0 0 2024-09-11T00:07:10.481 INFO:tasks.workunit.client.1.smithi203.stdout:5/341: write dc/dd/d15/f37 [24036,31850] 0 2024-09-11T00:07:10.481 INFO:tasks.workunit.client.1.smithi203.stdout:5/342: chown dc/d65 33889282 1 2024-09-11T00:07:10.484 INFO:tasks.workunit.client.0.smithi111.stdout:4/244: creat d18/d20/d4a/f52 x:0 0 0 2024-09-11T00:07:10.486 INFO:tasks.workunit.client.1.smithi203.stdout:7/278: link dd/d4d/f5a dd/d1c/d26/d31/d58/f64 0 2024-09-11T00:07:10.491 INFO:tasks.workunit.client.0.smithi111.stdout:1/251: symlink d2/de/d12/d3c/l52 0 2024-09-11T00:07:10.492 INFO:tasks.workunit.client.1.smithi203.stdout:0/307: dwrite d0/f15 [0,4194304] 0 2024-09-11T00:07:10.500 INFO:tasks.workunit.client.0.smithi111.stdout:4/245: dwrite d18/d20/f23 [0,4194304] 0 2024-09-11T00:07:10.504 INFO:tasks.workunit.client.1.smithi203.stdout:7/279: dwrite dd/d1c/f46 [0,4194304] 0 2024-09-11T00:07:10.506 INFO:tasks.workunit.client.0.smithi111.stdout:9/306: creat d6/db/d1b/d56/f63 x:0 0 0 2024-09-11T00:07:10.517 INFO:tasks.workunit.client.1.smithi203.stdout:0/308: dwrite d0/d2/f3 [4194304,4194304] 0 2024-09-11T00:07:10.520 INFO:tasks.workunit.client.1.smithi203.stdout:7/280: creat dd/d1c/d4b/f65 x:0 0 0 2024-09-11T00:07:10.523 INFO:tasks.workunit.client.0.smithi111.stdout:3/316: dread - d1c/f5e zero size 2024-09-11T00:07:10.524 INFO:tasks.workunit.client.1.smithi203.stdout:7/281: chown dd/d1c/f21 367850 1 2024-09-11T00:07:10.524 INFO:tasks.workunit.client.1.smithi203.stdout:7/282: stat dd/d1c/d26/f4f 0 2024-09-11T00:07:10.525 INFO:tasks.workunit.client.1.smithi203.stdout:5/343: dwrite dc/dd/d1e/f21 [0,4194304] 0 2024-09-11T00:07:10.529 INFO:tasks.workunit.client.1.smithi203.stdout:7/283: chown dd/d1c/f32 20015 1 2024-09-11T00:07:10.531 INFO:tasks.workunit.client.0.smithi111.stdout:8/313: creat d11/d23/d2c/d46/f69 x:0 0 0 2024-09-11T00:07:10.542 INFO:tasks.workunit.client.1.smithi203.stdout:4/265: sync 2024-09-11T00:07:10.542 INFO:tasks.workunit.client.1.smithi203.stdout:1/386: sync 2024-09-11T00:07:10.542 INFO:tasks.workunit.client.1.smithi203.stdout:8/292: sync 2024-09-11T00:07:10.548 INFO:tasks.workunit.client.0.smithi111.stdout:8/314: dwrite d11/f33 [4194304,4194304] 0 2024-09-11T00:07:10.549 INFO:tasks.workunit.client.1.smithi203.stdout:7/284: dread dd/d1c/f46 [0,4194304] 0 2024-09-11T00:07:10.554 INFO:tasks.workunit.client.0.smithi111.stdout:9/307: link d6/db/d34/f47 d6/d52/f64 0 2024-09-11T00:07:10.556 INFO:tasks.workunit.client.0.smithi111.stdout:9/308: write d6/dc/f1f [320993,92346] 0 2024-09-11T00:07:10.561 INFO:tasks.workunit.client.0.smithi111.stdout:3/317: rename d1c/d1d/d22/d23/d58/d5c/f66 to d1c/d21/f6c 0 2024-09-11T00:07:10.567 INFO:tasks.workunit.client.0.smithi111.stdout:4/246: rmdir d18/d20/d4a/d4c 0 2024-09-11T00:07:10.570 INFO:tasks.workunit.client.1.smithi203.stdout:4/266: mknod db/d12/d15/c48 0 2024-09-11T00:07:10.570 INFO:tasks.workunit.client.1.smithi203.stdout:4/267: write db/dd/d16/d38/f3b [309240,83954] 0 2024-09-11T00:07:10.572 INFO:tasks.workunit.client.0.smithi111.stdout:9/309: dwrite d6/db/d34/d37/f29 [4194304,4194304] 0 2024-09-11T00:07:10.575 INFO:tasks.workunit.client.0.smithi111.stdout:8/315: creat d11/d23/d3d/d5f/f6a x:0 0 0 2024-09-11T00:07:10.579 INFO:tasks.workunit.client.1.smithi203.stdout:8/293: link d1/d13/d17/f38 d1/d13/d43/d46/d64/f6b 0 2024-09-11T00:07:10.583 INFO:tasks.workunit.client.1.smithi203.stdout:8/294: chown d1/d13/d22/d5d/f66 1 1 2024-09-11T00:07:10.596 INFO:tasks.workunit.client.0.smithi111.stdout:8/316: creat d11/d23/d2c/f6b x:0 0 0 2024-09-11T00:07:10.596 INFO:tasks.workunit.client.1.smithi203.stdout:1/387: getdents d8/d9/d15/d30/d3e/d4b 0 2024-09-11T00:07:10.598 INFO:tasks.workunit.client.0.smithi111.stdout:4/247: creat d18/d39/f53 x:0 0 0 2024-09-11T00:07:10.599 INFO:tasks.workunit.client.0.smithi111.stdout:4/248: fsync f15 0 2024-09-11T00:07:10.603 INFO:tasks.workunit.client.0.smithi111.stdout:8/317: unlink d11/f35 0 2024-09-11T00:07:10.606 INFO:tasks.workunit.client.0.smithi111.stdout:4/249: creat d18/d20/d3c/f54 x:0 0 0 2024-09-11T00:07:10.606 INFO:tasks.workunit.client.0.smithi111.stdout:8/318: chown d11/d23/d2c/d53/f55 3055806 1 2024-09-11T00:07:10.607 INFO:tasks.workunit.client.1.smithi203.stdout:6/262: write d0/f1 [754836,78532] 0 2024-09-11T00:07:10.608 INFO:tasks.workunit.client.0.smithi111.stdout:9/310: dread d6/db/d34/d37/f32 [0,4194304] 0 2024-09-11T00:07:10.609 INFO:tasks.workunit.client.0.smithi111.stdout:8/319: rename d11/d21 to d11/d21/d38/d54/d5b/d6c 22 2024-09-11T00:07:10.610 INFO:tasks.workunit.client.0.smithi111.stdout:9/311: readlink d6/db/d34/d37/d4c/l60 0 2024-09-11T00:07:10.611 INFO:tasks.workunit.client.0.smithi111.stdout:8/320: dread - d11/d23/d2c/d46/f69 zero size 2024-09-11T00:07:10.611 INFO:tasks.workunit.client.1.smithi203.stdout:1/388: dread d8/f68 [0,4194304] 0 2024-09-11T00:07:10.612 INFO:tasks.workunit.client.0.smithi111.stdout:8/321: stat d11/d21/d38/d54/c67 0 2024-09-11T00:07:10.613 INFO:tasks.workunit.client.1.smithi203.stdout:7/285: creat dd/d1c/f66 x:0 0 0 2024-09-11T00:07:10.615 INFO:tasks.workunit.client.1.smithi203.stdout:7/286: dread - dd/d1c/f5f zero size 2024-09-11T00:07:10.615 INFO:tasks.workunit.client.0.smithi111.stdout:9/312: rename d6/db/d1b/d56/f5a to d6/db/d34/f65 0 2024-09-11T00:07:10.616 INFO:tasks.workunit.client.0.smithi111.stdout:8/322: dread d11/d21/d38/d54/d5b/f61 [0,4194304] 0 2024-09-11T00:07:10.618 INFO:tasks.workunit.client.1.smithi203.stdout:1/389: unlink d8/d9/d15/d30/d3e/d4b/c74 0 2024-09-11T00:07:10.620 INFO:tasks.workunit.client.1.smithi203.stdout:9/284: dwrite d6/f14 [0,4194304] 0 2024-09-11T00:07:10.622 INFO:tasks.workunit.client.1.smithi203.stdout:9/285: dread - d6/de/d19/f3e zero size 2024-09-11T00:07:10.624 INFO:tasks.workunit.client.0.smithi111.stdout:9/313: dread d6/db/f49 [4194304,4194304] 0 2024-09-11T00:07:10.625 INFO:tasks.workunit.client.1.smithi203.stdout:9/286: write d6/de/d32/d52/f4f [13633,89973] 0 2024-09-11T00:07:10.625 INFO:tasks.workunit.client.1.smithi203.stdout:7/287: unlink dd/d1c/d26/c55 0 2024-09-11T00:07:10.626 INFO:tasks.workunit.client.0.smithi111.stdout:9/314: chown d6/db/d34/l5d 27718206 1 2024-09-11T00:07:10.628 INFO:tasks.workunit.client.1.smithi203.stdout:9/287: chown d6/de/c11 9042182 1 2024-09-11T00:07:10.632 INFO:tasks.workunit.client.1.smithi203.stdout:4/268: creat db/f49 x:0 0 0 2024-09-11T00:07:10.633 INFO:tasks.workunit.client.1.smithi203.stdout:1/390: symlink d8/d19/d60/l86 0 2024-09-11T00:07:10.635 INFO:tasks.workunit.client.0.smithi111.stdout:9/315: fsync d6/f38 0 2024-09-11T00:07:10.636 INFO:tasks.workunit.client.1.smithi203.stdout:7/288: mkdir dd/d1c/d26/d31/d67 0 2024-09-11T00:07:10.640 INFO:tasks.workunit.client.0.smithi111.stdout:2/271: truncate d0/d3/d2e/f5a 1619447 0 2024-09-11T00:07:10.641 INFO:tasks.workunit.client.1.smithi203.stdout:4/269: unlink db/dd/c3a 0 2024-09-11T00:07:10.643 INFO:tasks.workunit.client.1.smithi203.stdout:1/391: creat d8/d19/d60/f87 x:0 0 0 2024-09-11T00:07:10.644 INFO:tasks.workunit.client.0.smithi111.stdout:1/252: creat d2/de/f53 x:0 0 0 2024-09-11T00:07:10.645 INFO:tasks.workunit.client.0.smithi111.stdout:9/316: creat d6/db/d34/f66 x:0 0 0 2024-09-11T00:07:10.646 INFO:tasks.workunit.client.0.smithi111.stdout:1/253: truncate d2/f1f 906402 0 2024-09-11T00:07:10.646 INFO:tasks.workunit.client.1.smithi203.stdout:9/288: creat d6/de/d32/d52/d44/f5e x:0 0 0 2024-09-11T00:07:10.647 INFO:tasks.workunit.client.0.smithi111.stdout:5/306: symlink d10/d1e/l6a 0 2024-09-11T00:07:10.649 INFO:tasks.workunit.client.0.smithi111.stdout:5/307: write f2 [2490461,92987] 0 2024-09-11T00:07:10.649 INFO:tasks.workunit.client.0.smithi111.stdout:5/308: readlink d10/l11 0 2024-09-11T00:07:10.650 INFO:tasks.workunit.client.1.smithi203.stdout:4/270: symlink db/dd/l4a 0 2024-09-11T00:07:10.651 INFO:tasks.workunit.client.1.smithi203.stdout:8/295: mknod d1/d13/d17/c6c 0 2024-09-11T00:07:10.653 INFO:tasks.workunit.client.1.smithi203.stdout:8/296: fdatasync d1/f11 0 2024-09-11T00:07:10.653 INFO:tasks.workunit.client.1.smithi203.stdout:4/271: fdatasync db/d12/d15/d2a/f22 0 2024-09-11T00:07:10.654 INFO:tasks.workunit.client.1.smithi203.stdout:1/392: chown d8/d9/c17 1306 1 2024-09-11T00:07:10.655 INFO:tasks.workunit.client.1.smithi203.stdout:8/297: dread - d1/d13/d17/f38 zero size 2024-09-11T00:07:10.656 INFO:tasks.workunit.client.1.smithi203.stdout:8/298: dread - d1/d13/d22/d5d/f66 zero size 2024-09-11T00:07:10.657 INFO:tasks.workunit.client.1.smithi203.stdout:9/289: dread - d6/de/d19/f31 zero size 2024-09-11T00:07:10.657 INFO:tasks.workunit.client.0.smithi111.stdout:2/272: mknod d0/c60 0 2024-09-11T00:07:10.657 INFO:tasks.workunit.client.0.smithi111.stdout:0/286: creat d3/d13/f68 x:0 0 0 2024-09-11T00:07:10.659 INFO:tasks.workunit.client.1.smithi203.stdout:2/231: mknod d13/d15/d19/c43 0 2024-09-11T00:07:10.660 INFO:tasks.workunit.client.1.smithi203.stdout:7/289: creat dd/d1c/d26/d31/d4a/f68 x:0 0 0 2024-09-11T00:07:10.662 INFO:tasks.workunit.client.0.smithi111.stdout:1/254: rename d2/de/c30 to d2/de/d12/d34/c54 0 2024-09-11T00:07:10.663 INFO:tasks.workunit.client.0.smithi111.stdout:6/211: write d7/fd [4037444,82623] 0 2024-09-11T00:07:10.666 INFO:tasks.workunit.client.0.smithi111.stdout:0/287: mknod d3/d13/d1e/d29/d49/d51/c69 0 2024-09-11T00:07:10.669 INFO:tasks.workunit.client.0.smithi111.stdout:2/273: rename d0/d3/d12/d52/c3f to d0/d3/d12/c61 0 2024-09-11T00:07:10.670 INFO:tasks.workunit.client.0.smithi111.stdout:8/323: getdents d11/d23/d2c/d46 0 2024-09-11T00:07:10.671 INFO:tasks.workunit.client.0.smithi111.stdout:2/274: write d0/d3/de/f1e [393017,86206] 0 2024-09-11T00:07:10.673 INFO:tasks.workunit.client.0.smithi111.stdout:1/255: creat d2/d2b/f55 x:0 0 0 2024-09-11T00:07:10.675 INFO:tasks.workunit.client.1.smithi203.stdout:1/393: creat d8/d19/d31/f88 x:0 0 0 2024-09-11T00:07:10.675 INFO:tasks.workunit.client.1.smithi203.stdout:0/309: dwrite d0/f18 [0,4194304] 0 2024-09-11T00:07:10.676 INFO:tasks.workunit.client.0.smithi111.stdout:6/212: unlink d7/d32/c33 0 2024-09-11T00:07:10.678 INFO:tasks.workunit.client.1.smithi203.stdout:0/310: truncate d0/d2/f1a 4692797 0 2024-09-11T00:07:10.681 INFO:tasks.workunit.client.1.smithi203.stdout:8/299: rmdir d1/d13/d17/d2f/d52 39 2024-09-11T00:07:10.685 INFO:tasks.workunit.client.0.smithi111.stdout:0/288: creat d3/d1c/f6a x:0 0 0 2024-09-11T00:07:10.685 INFO:tasks.workunit.client.1.smithi203.stdout:8/300: dread - d1/d13/d3a/d4c/f5e zero size 2024-09-11T00:07:10.686 INFO:tasks.workunit.client.1.smithi203.stdout:2/232: creat d13/d15/d19/d1c/f44 x:0 0 0 2024-09-11T00:07:10.688 INFO:tasks.workunit.client.1.smithi203.stdout:2/233: fsync d13/d15/d19/d1c/f3d 0 2024-09-11T00:07:10.690 INFO:tasks.workunit.client.1.smithi203.stdout:7/290: dread dd/d1c/d4b/f4c [0,4194304] 0 2024-09-11T00:07:10.691 INFO:tasks.workunit.client.0.smithi111.stdout:7/278: mknod dd/c59 0 2024-09-11T00:07:10.691 INFO:tasks.workunit.client.0.smithi111.stdout:2/275: mkdir d0/d3/de/d3b/d62 0 2024-09-11T00:07:10.693 INFO:tasks.workunit.client.0.smithi111.stdout:2/276: dread - d0/d3/de/d3b/f49 zero size 2024-09-11T00:07:10.695 INFO:tasks.workunit.client.0.smithi111.stdout:1/256: mkdir d2/d2b/d2c/d56 0 2024-09-11T00:07:10.699 INFO:tasks.workunit.client.1.smithi203.stdout:8/301: dwrite d1/f2 [0,4194304] 0 2024-09-11T00:07:10.705 INFO:tasks.workunit.client.0.smithi111.stdout:7/279: mknod dd/d49/c5a 0 2024-09-11T00:07:10.709 INFO:tasks.workunit.client.0.smithi111.stdout:2/277: mkdir d0/d3/de/d3b/d63 0 2024-09-11T00:07:10.713 INFO:tasks.workunit.client.0.smithi111.stdout:1/257: dwrite d2/de/d12/f28 [0,4194304] 0 2024-09-11T00:07:10.714 INFO:tasks.workunit.client.0.smithi111.stdout:8/324: creat d11/f6d x:0 0 0 2024-09-11T00:07:10.715 INFO:tasks.workunit.client.1.smithi203.stdout:3/426: rename d8/f2c to d8/da/d37/d83/d65/d8b/f9e 0 2024-09-11T00:07:10.720 INFO:tasks.workunit.client.0.smithi111.stdout:1/258: write d2/de/d12/f28 [607868,65595] 0 2024-09-11T00:07:10.720 INFO:tasks.workunit.client.0.smithi111.stdout:7/280: readlink dd/d48/l54 0 2024-09-11T00:07:10.720 INFO:tasks.workunit.client.0.smithi111.stdout:1/259: readlink d2/de/d12/d3c/l49 0 2024-09-11T00:07:10.721 INFO:tasks.workunit.client.1.smithi203.stdout:8/302: creat d1/d13/d43/d46/f6d x:0 0 0 2024-09-11T00:07:10.722 INFO:tasks.workunit.client.0.smithi111.stdout:6/213: link d7/d22/c20 d7/d22/d2c/c44 0 2024-09-11T00:07:10.722 INFO:tasks.workunit.client.0.smithi111.stdout:3/318: dwrite d1c/d21/f3a [0,4194304] 0 2024-09-11T00:07:10.724 INFO:tasks.workunit.client.0.smithi111.stdout:3/319: write d1c/d1d/d22/d31/d33/f39 [287663,24577] 0 2024-09-11T00:07:10.728 INFO:tasks.workunit.client.1.smithi203.stdout:7/291: mknod dd/d3b/d5b/c69 0 2024-09-11T00:07:10.737 INFO:tasks.workunit.client.1.smithi203.stdout:5/344: rename dc/dd/d13/f35 to dc/dd/d4d/f6a 0 2024-09-11T00:07:10.741 INFO:tasks.workunit.client.0.smithi111.stdout:8/325: rename d11/l27 to d11/d21/d38/d54/l6e 0 2024-09-11T00:07:10.742 INFO:tasks.workunit.client.1.smithi203.stdout:3/427: rmdir d8/d2a 39 2024-09-11T00:07:10.743 INFO:tasks.workunit.client.1.smithi203.stdout:6/263: truncate d0/d27/d35/f3f 2484366 0 2024-09-11T00:07:10.745 INFO:tasks.workunit.client.1.smithi203.stdout:4/272: getdents db/dd/d26/d42 0 2024-09-11T00:07:10.747 INFO:tasks.workunit.client.1.smithi203.stdout:8/303: chown d1/d13/l56 79 1 2024-09-11T00:07:10.749 INFO:tasks.workunit.client.0.smithi111.stdout:6/214: creat d7/d22/d2c/d38/f45 x:0 0 0 2024-09-11T00:07:10.750 INFO:tasks.workunit.client.1.smithi203.stdout:9/290: getdents d6/de/d32/d52/d55 0 2024-09-11T00:07:10.752 INFO:tasks.workunit.client.1.smithi203.stdout:9/291: chown d6/de/d19/f1b 39111 1 2024-09-11T00:07:10.754 INFO:tasks.workunit.client.1.smithi203.stdout:9/292: write d6/de/d19/d30/f51 [647869,112167] 0 2024-09-11T00:07:10.755 INFO:tasks.workunit.client.0.smithi111.stdout:0/289: link d3/d13/f17 d3/d13/d1e/d29/d49/d51/d61/f6b 0 2024-09-11T00:07:10.755 INFO:tasks.workunit.client.1.smithi203.stdout:9/293: fdatasync d6/de/d19/f3e 0 2024-09-11T00:07:10.759 INFO:tasks.workunit.client.1.smithi203.stdout:9/294: write d6/de/d32/d52/f4b [568260,118341] 0 2024-09-11T00:07:10.761 INFO:tasks.workunit.client.0.smithi111.stdout:1/260: symlink d2/de/d12/d39/l57 0 2024-09-11T00:07:10.762 INFO:tasks.workunit.client.1.smithi203.stdout:6/264: mknod d0/d27/c4a 0 2024-09-11T00:07:10.764 INFO:tasks.workunit.client.1.smithi203.stdout:4/273: rmdir db/dd 39 2024-09-11T00:07:10.764 INFO:tasks.workunit.client.0.smithi111.stdout:6/215: dwrite d7/d22/d1d/f31 [0,4194304] 0 2024-09-11T00:07:10.766 INFO:tasks.workunit.client.1.smithi203.stdout:4/274: write db/f49 [565329,106888] 0 2024-09-11T00:07:10.767 INFO:tasks.workunit.client.1.smithi203.stdout:4/275: fdatasync f1 0 2024-09-11T00:07:10.771 INFO:tasks.workunit.client.1.smithi203.stdout:5/345: symlink dc/l6b 0 2024-09-11T00:07:10.772 INFO:tasks.workunit.client.1.smithi203.stdout:5/346: fsync dc/d65/f60 0 2024-09-11T00:07:10.773 INFO:tasks.workunit.client.0.smithi111.stdout:0/290: mknod d3/d13/d1e/c6c 0 2024-09-11T00:07:10.773 INFO:tasks.workunit.client.1.smithi203.stdout:7/292: rename dd/d1c/d26 to dd/d3b/d5b/d6a 0 2024-09-11T00:07:10.776 INFO:tasks.workunit.client.0.smithi111.stdout:4/250: sync 2024-09-11T00:07:10.776 INFO:tasks.workunit.client.0.smithi111.stdout:1/261: dread d2/de/f29 [0,4194304] 0 2024-09-11T00:07:10.776 INFO:tasks.workunit.client.0.smithi111.stdout:0/291: write d3/d1c/f6a [149392,89080] 0 2024-09-11T00:07:10.776 INFO:tasks.workunit.client.0.smithi111.stdout:8/326: mkdir d11/d21/d6f 0 2024-09-11T00:07:10.777 INFO:tasks.workunit.client.0.smithi111.stdout:9/317: dwrite d6/db/d34/d37/f19 [0,4194304] 0 2024-09-11T00:07:10.777 INFO:tasks.workunit.client.1.smithi203.stdout:6/265: stat d0/f5 0 2024-09-11T00:07:10.779 INFO:tasks.workunit.client.0.smithi111.stdout:1/262: chown d2/d2b 98 1 2024-09-11T00:07:10.782 INFO:tasks.workunit.client.0.smithi111.stdout:8/327: truncate d11/d21/d38/f57 648331 0 2024-09-11T00:07:10.783 INFO:tasks.workunit.client.0.smithi111.stdout:4/251: read f8 [1175341,3966] 0 2024-09-11T00:07:10.786 INFO:tasks.workunit.client.0.smithi111.stdout:6/216: readlink l5 0 2024-09-11T00:07:10.786 INFO:tasks.workunit.client.0.smithi111.stdout:4/252: fdatasync d18/d20/f23 0 2024-09-11T00:07:10.790 INFO:tasks.workunit.client.0.smithi111.stdout:2/278: getdents d0 0 2024-09-11T00:07:10.794 INFO:tasks.workunit.client.1.smithi203.stdout:2/234: getdents d13/d15/d19/d1c 0 2024-09-11T00:07:10.794 INFO:tasks.workunit.client.1.smithi203.stdout:6/266: dread d0/d27/f19 [0,4194304] 0 2024-09-11T00:07:10.797 INFO:tasks.workunit.client.0.smithi111.stdout:0/292: rename d3/d13/f3c to d3/d1c/f6d 0 2024-09-11T00:07:10.799 INFO:tasks.workunit.client.1.smithi203.stdout:3/428: rename d8/d17/f3b to d8/da/d37/f9f 0 2024-09-11T00:07:10.800 INFO:tasks.workunit.client.0.smithi111.stdout:9/318: creat d6/db/d34/f67 x:0 0 0 2024-09-11T00:07:10.801 INFO:tasks.workunit.client.1.smithi203.stdout:9/295: mknod d6/de/d19/d24/d40/d45/c5f 0 2024-09-11T00:07:10.802 INFO:tasks.workunit.client.1.smithi203.stdout:0/311: write d0/f23 [747087,76975] 0 2024-09-11T00:07:10.808 INFO:tasks.workunit.client.1.smithi203.stdout:8/304: creat d1/d13/d17/d2f/d52/d59/f6e x:0 0 0 2024-09-11T00:07:10.809 INFO:tasks.workunit.client.1.smithi203.stdout:8/305: fsync d1/d13/d22/f29 0 2024-09-11T00:07:10.811 INFO:tasks.workunit.client.1.smithi203.stdout:4/276: creat db/dd/d16/d38/d3c/d41/f4b x:0 0 0 2024-09-11T00:07:10.816 INFO:tasks.workunit.client.0.smithi111.stdout:6/217: fdatasync d7/f12 0 2024-09-11T00:07:10.817 INFO:tasks.workunit.client.0.smithi111.stdout:6/218: dread - d7/d22/d3f/f42 zero size 2024-09-11T00:07:10.817 INFO:tasks.workunit.client.0.smithi111.stdout:5/309: sync 2024-09-11T00:07:10.819 INFO:tasks.workunit.client.0.smithi111.stdout:6/219: dread - d7/d22/d2c/d38/f45 zero size 2024-09-11T00:07:10.819 INFO:tasks.workunit.client.0.smithi111.stdout:5/310: chown d10/d1e/d23/d30/d3c/f40 79632559 1 2024-09-11T00:07:10.826 INFO:tasks.workunit.client.0.smithi111.stdout:0/293: creat d3/da/f6e x:0 0 0 2024-09-11T00:07:10.830 INFO:tasks.workunit.client.0.smithi111.stdout:0/294: truncate d3/d13/d1e/d29/f4e 65564 0 2024-09-11T00:07:10.832 INFO:tasks.workunit.client.1.smithi203.stdout:9/296: dread d6/de/d19/d24/d40/d45/f39 [0,4194304] 0 2024-09-11T00:07:10.833 INFO:tasks.workunit.client.0.smithi111.stdout:7/281: dwrite dd/f3a [0,4194304] 0 2024-09-11T00:07:10.835 INFO:tasks.workunit.client.1.smithi203.stdout:0/312: creat d0/d2/f65 x:0 0 0 2024-09-11T00:07:10.838 INFO:tasks.workunit.client.0.smithi111.stdout:6/220: stat f6 0 2024-09-11T00:07:10.840 INFO:tasks.workunit.client.0.smithi111.stdout:3/320: dwrite d1c/d1d/d22/f60 [4194304,4194304] 0 2024-09-11T00:07:10.841 INFO:tasks.workunit.client.1.smithi203.stdout:4/277: unlink db/cc 0 2024-09-11T00:07:10.847 INFO:tasks.workunit.client.1.smithi203.stdout:4/278: write db/dd/d16/d38/f3b [996652,121772] 0 2024-09-11T00:07:10.847 INFO:tasks.workunit.client.0.smithi111.stdout:5/311: unlink d10/d1e/d25/f2d 0 2024-09-11T00:07:10.855 INFO:tasks.workunit.client.0.smithi111.stdout:9/319: fdatasync d6/d52/f59 0 2024-09-11T00:07:10.856 INFO:tasks.workunit.client.0.smithi111.stdout:1/263: write d2/d2b/d2c/f47 [268116,75986] 0 2024-09-11T00:07:10.857 INFO:tasks.workunit.client.1.smithi203.stdout:6/267: fsync d0/f16 0 2024-09-11T00:07:10.858 INFO:tasks.workunit.client.0.smithi111.stdout:3/321: dwrite d1c/d1d/d22/f60 [4194304,4194304] 0 2024-09-11T00:07:10.860 INFO:tasks.workunit.client.0.smithi111.stdout:1/264: dread - d2/de/f53 zero size 2024-09-11T00:07:10.860 INFO:tasks.workunit.client.0.smithi111.stdout:0/295: fsync f0 0 2024-09-11T00:07:10.860 INFO:tasks.workunit.client.0.smithi111.stdout:7/282: symlink dd/d1d/d1f/l5b 0 2024-09-11T00:07:10.864 INFO:tasks.workunit.client.0.smithi111.stdout:6/221: creat d7/d22/d2c/f46 x:0 0 0 2024-09-11T00:07:10.865 INFO:tasks.workunit.client.1.smithi203.stdout:9/297: mknod d6/de/d47/c60 0 2024-09-11T00:07:10.866 INFO:tasks.workunit.client.0.smithi111.stdout:3/322: fdatasync d1c/d1d/d22/d23/f68 0 2024-09-11T00:07:10.867 INFO:tasks.workunit.client.0.smithi111.stdout:6/222: write f3 [3407131,54569] 0 2024-09-11T00:07:10.873 INFO:tasks.workunit.client.0.smithi111.stdout:8/328: dwrite f8 [4194304,4194304] 0 2024-09-11T00:07:10.873 INFO:tasks.workunit.client.0.smithi111.stdout:2/279: mknod d0/d3/d2e/c64 0 2024-09-11T00:07:10.875 INFO:tasks.workunit.client.1.smithi203.stdout:7/293: dwrite dd/f3e [4194304,4194304] 0 2024-09-11T00:07:10.881 INFO:tasks.workunit.client.1.smithi203.stdout:2/235: creat d13/d15/f45 x:0 0 0 2024-09-11T00:07:10.883 INFO:tasks.workunit.client.0.smithi111.stdout:5/312: creat d10/f6b x:0 0 0 2024-09-11T00:07:10.884 INFO:tasks.workunit.client.1.smithi203.stdout:2/236: chown lf 184 1 2024-09-11T00:07:10.884 INFO:tasks.workunit.client.1.smithi203.stdout:3/429: dwrite d8/d17/f74 [0,4194304] 0 2024-09-11T00:07:10.892 INFO:tasks.workunit.client.1.smithi203.stdout:5/347: getdents dc/d4f 0 2024-09-11T00:07:10.893 INFO:tasks.workunit.client.1.smithi203.stdout:1/394: sync 2024-09-11T00:07:10.895 INFO:tasks.workunit.client.0.smithi111.stdout:9/320: dread d6/db/d34/d37/f28 [0,4194304] 0 2024-09-11T00:07:10.899 INFO:tasks.workunit.client.0.smithi111.stdout:4/253: link d18/d1f/l45 d18/d20/d40/l55 0 2024-09-11T00:07:10.899 INFO:tasks.workunit.client.1.smithi203.stdout:5/348: write dc/dd/d15/f2c [506223,21483] 0 2024-09-11T00:07:10.900 INFO:tasks.workunit.client.1.smithi203.stdout:9/298: chown d6/de/d19/d21 195244 1 2024-09-11T00:07:10.901 INFO:tasks.workunit.client.0.smithi111.stdout:3/323: creat d1c/d1d/d22/d23/d58/d5c/f6d x:0 0 0 2024-09-11T00:07:10.902 INFO:tasks.workunit.client.0.smithi111.stdout:9/321: write d6/db/d34/d37/f19 [3989164,91509] 0 2024-09-11T00:07:10.902 INFO:tasks.workunit.client.0.smithi111.stdout:3/324: chown f12 3 1 2024-09-11T00:07:10.902 INFO:tasks.workunit.client.0.smithi111.stdout:4/254: chown d18/d20/d40/l55 1386 1 2024-09-11T00:07:10.903 INFO:tasks.workunit.client.0.smithi111.stdout:3/325: stat d1c/d1d/l2a 0 2024-09-11T00:07:10.903 INFO:tasks.workunit.client.0.smithi111.stdout:4/255: chown d18/d20/d4a 726033 1 2024-09-11T00:07:10.907 INFO:tasks.workunit.client.0.smithi111.stdout:2/280: mkdir d0/d3/d12/d52/d65 0 2024-09-11T00:07:10.909 INFO:tasks.workunit.client.1.smithi203.stdout:7/294: symlink dd/d3b/d5b/d6a/d31/d4a/l6b 0 2024-09-11T00:07:10.909 INFO:tasks.workunit.client.0.smithi111.stdout:2/281: chown d0/d3/d12/l46 4855984 1 2024-09-11T00:07:10.911 INFO:tasks.workunit.client.1.smithi203.stdout:8/306: dwrite d1/f16 [0,4194304] 0 2024-09-11T00:07:10.915 INFO:tasks.workunit.client.1.smithi203.stdout:3/430: unlink d8/da/f46 0 2024-09-11T00:07:10.923 INFO:tasks.workunit.client.1.smithi203.stdout:1/395: dwrite d8/d9/d15/d35/d81/f83 [0,4194304] 0 2024-09-11T00:07:10.925 INFO:tasks.workunit.client.0.smithi111.stdout:1/265: symlink d2/de/d12/l58 0 2024-09-11T00:07:10.930 INFO:tasks.workunit.client.0.smithi111.stdout:3/326: mknod d1c/d1d/c6e 0 2024-09-11T00:07:10.930 INFO:tasks.workunit.client.0.smithi111.stdout:6/223: dread d7/f23 [0,4194304] 0 2024-09-11T00:07:10.933 INFO:tasks.workunit.client.0.smithi111.stdout:8/329: dread d11/f13 [0,4194304] 0 2024-09-11T00:07:10.937 INFO:tasks.workunit.client.0.smithi111.stdout:6/224: dread d7/ff [0,4194304] 0 2024-09-11T00:07:10.937 INFO:tasks.workunit.client.0.smithi111.stdout:5/313: mknod d10/d1e/d23/d2b/d5c/d61/c6c 0 2024-09-11T00:07:10.938 INFO:tasks.workunit.client.1.smithi203.stdout:9/299: creat d6/de/d47/f61 x:0 0 0 2024-09-11T00:07:10.938 INFO:tasks.workunit.client.0.smithi111.stdout:5/314: chown f1 20013 1 2024-09-11T00:07:10.940 INFO:tasks.workunit.client.1.smithi203.stdout:9/300: readlink d6/de/l1d 0 2024-09-11T00:07:10.940 INFO:tasks.workunit.client.1.smithi203.stdout:4/279: link db/dd/d26/f2f db/f4c 0 2024-09-11T00:07:10.942 INFO:tasks.workunit.client.0.smithi111.stdout:0/296: creat d3/d13/f6f x:0 0 0 2024-09-11T00:07:10.945 INFO:tasks.workunit.client.0.smithi111.stdout:7/283: dread dd/d1d/d1f/d24/f32 [0,4194304] 0 2024-09-11T00:07:10.945 INFO:tasks.workunit.client.1.smithi203.stdout:6/268: write d0/f2d [1018307,51611] 0 2024-09-11T00:07:10.946 INFO:tasks.workunit.client.0.smithi111.stdout:9/322: write d6/db/d1b/f33 [737273,108740] 0 2024-09-11T00:07:10.947 INFO:tasks.workunit.client.0.smithi111.stdout:0/297: truncate d3/d1c/f23 2690751 0 2024-09-11T00:07:10.949 INFO:tasks.workunit.client.0.smithi111.stdout:3/327: creat d1c/d1d/d22/d44/f6f x:0 0 0 2024-09-11T00:07:10.951 INFO:tasks.workunit.client.0.smithi111.stdout:4/256: mknod d18/d20/d4e/c56 0 2024-09-11T00:07:10.951 INFO:tasks.workunit.client.0.smithi111.stdout:9/323: write d6/db/d34/f3d [642444,51783] 0 2024-09-11T00:07:10.954 INFO:tasks.workunit.client.0.smithi111.stdout:3/328: write d1c/d1d/d22/d44/f4e [85125,66245] 0 2024-09-11T00:07:10.956 INFO:tasks.workunit.client.0.smithi111.stdout:9/324: write d6/db/d34/f58 [136161,59029] 0 2024-09-11T00:07:10.956 INFO:tasks.workunit.client.1.smithi203.stdout:0/313: link d0/d2/l28 d0/l66 0 2024-09-11T00:07:10.958 INFO:tasks.workunit.client.0.smithi111.stdout:6/225: dwrite d7/f30 [0,4194304] 0 2024-09-11T00:07:10.959 INFO:tasks.workunit.client.0.smithi111.stdout:3/329: fsync d1c/d1d/d22/f61 0 2024-09-11T00:07:10.960 INFO:tasks.workunit.client.0.smithi111.stdout:9/325: chown d6/db/d1b/f5c 328 1 2024-09-11T00:07:10.961 INFO:tasks.workunit.client.0.smithi111.stdout:3/330: write f12 [2599842,84776] 0 2024-09-11T00:07:10.962 INFO:tasks.workunit.client.0.smithi111.stdout:9/326: dread - d6/db/f5b zero size 2024-09-11T00:07:10.963 INFO:tasks.workunit.client.0.smithi111.stdout:3/331: dread - d1c/d1d/d22/f61 zero size 2024-09-11T00:07:10.963 INFO:tasks.workunit.client.0.smithi111.stdout:9/327: dread - d6/d52/f61 zero size 2024-09-11T00:07:10.965 INFO:tasks.workunit.client.1.smithi203.stdout:6/269: dread d0/d27/f18 [0,4194304] 0 2024-09-11T00:07:10.966 INFO:tasks.workunit.client.1.smithi203.stdout:9/301: mknod d6/de/d19/d24/c62 0 2024-09-11T00:07:10.973 INFO:tasks.workunit.client.0.smithi111.stdout:6/226: dread d7/f12 [0,4194304] 0 2024-09-11T00:07:10.974 INFO:tasks.workunit.client.1.smithi203.stdout:4/280: rename db/dd/d16/d38/d3c/d41/f43 to db/dd/d26/f4d 0 2024-09-11T00:07:10.974 INFO:tasks.workunit.client.1.smithi203.stdout:2/237: truncate d13/d15/f1a 1686563 0 2024-09-11T00:07:10.975 INFO:tasks.workunit.client.0.smithi111.stdout:7/284: creat dd/d1d/d4b/f5c x:0 0 0 2024-09-11T00:07:10.976 INFO:tasks.workunit.client.1.smithi203.stdout:5/349: dread dc/dd/d15/f37 [0,4194304] 0 2024-09-11T00:07:10.977 INFO:tasks.workunit.client.0.smithi111.stdout:4/257: dread d18/d1f/f26 [0,4194304] 0 2024-09-11T00:07:10.977 INFO:tasks.workunit.client.0.smithi111.stdout:7/285: readlink dd/d1d/d1f/l55 0 2024-09-11T00:07:10.981 INFO:tasks.workunit.client.1.smithi203.stdout:0/314: mkdir d0/d2/d67 0 2024-09-11T00:07:10.988 INFO:tasks.workunit.client.1.smithi203.stdout:9/302: rmdir d6/de/d32/d52/d44 39 2024-09-11T00:07:10.990 INFO:tasks.workunit.client.1.smithi203.stdout:9/303: fdatasync d6/de/d19/f3c 0 2024-09-11T00:07:10.994 INFO:tasks.workunit.client.1.smithi203.stdout:2/238: rmdir d13/d15/d30 39 2024-09-11T00:07:10.994 INFO:tasks.workunit.client.0.smithi111.stdout:0/298: write d3/d13/d1e/f4d [1115438,73497] 0 2024-09-11T00:07:10.995 INFO:tasks.workunit.client.1.smithi203.stdout:9/304: write d6/de/d32/d52/f4b [258698,55096] 0 2024-09-11T00:07:10.996 INFO:tasks.workunit.client.1.smithi203.stdout:9/305: read - d6/de/d47/f61 zero size 2024-09-11T00:07:10.998 INFO:tasks.workunit.client.1.smithi203.stdout:3/431: truncate d8/da/d34/f39 3510425 0 2024-09-11T00:07:10.999 INFO:tasks.workunit.client.0.smithi111.stdout:3/332: creat d1c/d1d/d22/f70 x:0 0 0 2024-09-11T00:07:11.000 INFO:tasks.workunit.client.0.smithi111.stdout:3/333: chown d1c/d1d/l30 1446 1 2024-09-11T00:07:11.001 INFO:tasks.workunit.client.1.smithi203.stdout:5/350: unlink dc/d4f/d5c/f67 0 2024-09-11T00:07:11.004 INFO:tasks.workunit.client.1.smithi203.stdout:0/315: unlink d0/d2/f12 0 2024-09-11T00:07:11.005 INFO:tasks.workunit.client.0.smithi111.stdout:4/258: truncate f5 2419712 0 2024-09-11T00:07:11.006 INFO:tasks.workunit.client.0.smithi111.stdout:7/286: symlink dd/d1d/d1f/d24/l5d 0 2024-09-11T00:07:11.008 INFO:tasks.workunit.client.1.smithi203.stdout:2/239: unlink d13/d15/d19/f36 0 2024-09-11T00:07:11.009 INFO:tasks.workunit.client.1.smithi203.stdout:7/295: getdents dd 0 2024-09-11T00:07:11.016 INFO:tasks.workunit.client.0.smithi111.stdout:8/330: rename d11/d23/d3d/f43 to d11/d21/f70 0 2024-09-11T00:07:11.018 INFO:tasks.workunit.client.1.smithi203.stdout:1/396: getdents d8/d19/d60 0 2024-09-11T00:07:11.020 INFO:tasks.workunit.client.0.smithi111.stdout:2/282: creat d0/d3/d2e/f66 x:0 0 0 2024-09-11T00:07:11.020 INFO:tasks.workunit.client.1.smithi203.stdout:1/397: dread - d8/d19/d60/f87 zero size 2024-09-11T00:07:11.020 INFO:tasks.workunit.client.0.smithi111.stdout:0/299: mkdir d3/d13/d1e/d29/d70 0 2024-09-11T00:07:11.021 INFO:tasks.workunit.client.1.smithi203.stdout:1/398: chown d8/d9/d15/d30/f61 11433 1 2024-09-11T00:07:11.022 INFO:tasks.workunit.client.0.smithi111.stdout:0/300: write d3/f54 [3355021,69844] 0 2024-09-11T00:07:11.023 INFO:tasks.workunit.client.1.smithi203.stdout:1/399: write d8/d28/d64/f65 [842534,38079] 0 2024-09-11T00:07:11.023 INFO:tasks.workunit.client.0.smithi111.stdout:0/301: dread - d3/d1c/f4a zero size 2024-09-11T00:07:11.025 INFO:tasks.workunit.client.1.smithi203.stdout:5/351: rename dc/dd/d1e/l31 to dc/d4f/l6c 0 2024-09-11T00:07:11.033 INFO:tasks.workunit.client.1.smithi203.stdout:0/316: symlink d0/d1d/l68 0 2024-09-11T00:07:11.035 INFO:tasks.workunit.client.0.smithi111.stdout:1/266: getdents d2/d2b/d2c 0 2024-09-11T00:07:11.036 INFO:tasks.workunit.client.0.smithi111.stdout:1/267: chown d2/de/d12/d34 8 1 2024-09-11T00:07:11.037 INFO:tasks.workunit.client.1.smithi203.stdout:4/281: creat db/f4e x:0 0 0 2024-09-11T00:07:11.037 INFO:tasks.workunit.client.0.smithi111.stdout:1/268: chown d2/f45 2 1 2024-09-11T00:07:11.038 INFO:tasks.workunit.client.0.smithi111.stdout:9/328: symlink d6/db/d1b/l68 0 2024-09-11T00:07:11.039 INFO:tasks.workunit.client.0.smithi111.stdout:0/302: dwrite d3/da/f21 [0,4194304] 0 2024-09-11T00:07:11.044 INFO:tasks.workunit.client.0.smithi111.stdout:3/334: rmdir d1c/d1d/d22/d23/d58/d5c 39 2024-09-11T00:07:11.045 INFO:tasks.workunit.client.0.smithi111.stdout:3/335: dread - d1c/d1d/d22/d23/f68 zero size 2024-09-11T00:07:11.046 INFO:tasks.workunit.client.0.smithi111.stdout:6/227: truncate d7/f11 1080602 0 2024-09-11T00:07:11.052 INFO:tasks.workunit.client.0.smithi111.stdout:7/287: rename f6 to dd/d1d/d1f/f5e 0 2024-09-11T00:07:11.056 INFO:tasks.workunit.client.1.smithi203.stdout:1/400: rmdir d8/d9/d15/d30/d3e 39 2024-09-11T00:07:11.061 INFO:tasks.workunit.client.0.smithi111.stdout:5/315: getdents d10/d1e/d23/d2b 0 2024-09-11T00:07:11.063 INFO:tasks.workunit.client.1.smithi203.stdout:7/296: rename dd/c1b to dd/d3b/c6c 0 2024-09-11T00:07:11.067 INFO:tasks.workunit.client.1.smithi203.stdout:0/317: creat d0/d1d/f69 x:0 0 0 2024-09-11T00:07:11.070 INFO:tasks.workunit.client.1.smithi203.stdout:0/318: write d0/d2/d37/f3b [689825,6246] 0 2024-09-11T00:07:11.071 INFO:tasks.workunit.client.1.smithi203.stdout:4/282: creat db/dd/d16/f4f x:0 0 0 2024-09-11T00:07:11.077 INFO:tasks.workunit.client.1.smithi203.stdout:2/240: mknod d13/d15/c46 0 2024-09-11T00:07:11.077 INFO:tasks.workunit.client.1.smithi203.stdout:4/283: dread db/dd/d26/f3f [0,4194304] 0 2024-09-11T00:07:11.078 INFO:tasks.workunit.client.1.smithi203.stdout:9/306: rmdir d6/de/d47/d5d 0 2024-09-11T00:07:11.082 INFO:tasks.workunit.client.1.smithi203.stdout:3/432: creat d8/da/d5c/fa0 x:0 0 0 2024-09-11T00:07:11.088 INFO:tasks.workunit.client.0.smithi111.stdout:8/331: rename d11/d23/l32 to d11/d21/d6f/l71 0 2024-09-11T00:07:11.089 INFO:tasks.workunit.client.1.smithi203.stdout:5/352: mknod dc/dd/d56/c6d 0 2024-09-11T00:07:11.093 INFO:tasks.workunit.client.0.smithi111.stdout:2/283: symlink d0/d3/de/d3b/d63/l67 0 2024-09-11T00:07:11.093 INFO:tasks.workunit.client.0.smithi111.stdout:8/332: dread ff [0,4194304] 0 2024-09-11T00:07:11.093 INFO:tasks.workunit.client.0.smithi111.stdout:2/284: chown d0/f1a 21087376 1 2024-09-11T00:07:11.093 INFO:tasks.workunit.client.0.smithi111.stdout:8/333: write d11/d23/d2c/d53/f55 [765188,110627] 0 2024-09-11T00:07:11.093 INFO:tasks.workunit.client.0.smithi111.stdout:7/288: chown dd/d1d/d2d/d2e/c42 136295759 1 2024-09-11T00:07:11.099 INFO:tasks.workunit.client.0.smithi111.stdout:0/303: unlink d3/d13/l4b 0 2024-09-11T00:07:11.100 INFO:tasks.workunit.client.0.smithi111.stdout:0/304: write d3/d13/f6f [379820,65281] 0 2024-09-11T00:07:11.100 INFO:tasks.workunit.client.1.smithi203.stdout:2/241: mkdir d13/d47 0 2024-09-11T00:07:11.101 INFO:tasks.workunit.client.0.smithi111.stdout:0/305: stat d3/d1c/f6d 0 2024-09-11T00:07:11.102 INFO:tasks.workunit.client.0.smithi111.stdout:4/259: sync 2024-09-11T00:07:11.103 INFO:tasks.workunit.client.0.smithi111.stdout:0/306: dread - d3/da/f6e zero size 2024-09-11T00:07:11.103 INFO:tasks.workunit.client.0.smithi111.stdout:4/260: fdatasync d18/d20/f30 0 2024-09-11T00:07:11.104 INFO:tasks.workunit.client.0.smithi111.stdout:0/307: dread - d3/d13/f68 zero size 2024-09-11T00:07:11.104 INFO:tasks.workunit.client.1.smithi203.stdout:4/284: rename db/f4c to db/dd/d16/d38/f50 0 2024-09-11T00:07:11.107 INFO:tasks.workunit.client.0.smithi111.stdout:3/336: mknod d1c/d1d/d22/d23/d58/d5c/c71 0 2024-09-11T00:07:11.108 INFO:tasks.workunit.client.0.smithi111.stdout:6/228: symlink d7/d22/d26/l47 0 2024-09-11T00:07:11.109 INFO:tasks.workunit.client.1.smithi203.stdout:4/285: truncate db/dd/d16/d38/f3b 1432365 0 2024-09-11T00:07:11.110 INFO:tasks.workunit.client.0.smithi111.stdout:3/337: write d1c/d1d/d22/d31/d33/f59 [1000183,28698] 0 2024-09-11T00:07:11.111 INFO:tasks.workunit.client.1.smithi203.stdout:4/286: fdatasync db/f4e 0 2024-09-11T00:07:11.111 INFO:tasks.workunit.client.0.smithi111.stdout:2/285: mkdir d0/d3/de/d68 0 2024-09-11T00:07:11.112 INFO:tasks.workunit.client.0.smithi111.stdout:8/334: mknod d11/d23/d3d/c72 0 2024-09-11T00:07:11.117 INFO:tasks.workunit.client.1.smithi203.stdout:9/307: rename d6/l28 to d6/de/d19/d21/l63 0 2024-09-11T00:07:11.118 INFO:tasks.workunit.client.0.smithi111.stdout:4/261: dwrite d18/d20/f46 [0,4194304] 0 2024-09-11T00:07:11.121 INFO:tasks.workunit.client.1.smithi203.stdout:8/307: sync 2024-09-11T00:07:11.121 INFO:tasks.workunit.client.0.smithi111.stdout:1/269: creat d2/de/d12/d39/f59 x:0 0 0 2024-09-11T00:07:11.124 INFO:tasks.workunit.client.1.smithi203.stdout:7/297: write dd/d1c/d4b/f4c [4007870,24274] 0 2024-09-11T00:07:11.128 INFO:tasks.workunit.client.0.smithi111.stdout:9/329: rmdir d6/db/d1b/d41/d46 0 2024-09-11T00:07:11.128 INFO:tasks.workunit.client.0.smithi111.stdout:0/308: creat d3/d13/d1e/d29/d49/d51/f71 x:0 0 0 2024-09-11T00:07:11.129 INFO:tasks.workunit.client.1.smithi203.stdout:4/287: mknod db/dd/d26/d42/c51 0 2024-09-11T00:07:11.129 INFO:tasks.workunit.client.0.smithi111.stdout:2/286: dwrite d0/d3/f27 [0,4194304] 0 2024-09-11T00:07:11.130 INFO:tasks.workunit.client.0.smithi111.stdout:6/229: rmdir d7/d2b/d35 39 2024-09-11T00:07:11.132 INFO:tasks.workunit.client.0.smithi111.stdout:8/335: dwrite d11/f33 [0,4194304] 0 2024-09-11T00:07:11.134 INFO:tasks.workunit.client.1.smithi203.stdout:9/308: chown d6/de/d32/d52/d44 59 1 2024-09-11T00:07:11.134 INFO:tasks.workunit.client.0.smithi111.stdout:0/309: dread d3/d13/d1e/d29/f4e [0,4194304] 0 2024-09-11T00:07:11.135 INFO:tasks.workunit.client.0.smithi111.stdout:6/230: write f3 [4189095,43021] 0 2024-09-11T00:07:11.135 INFO:tasks.workunit.client.0.smithi111.stdout:8/336: chown d11/d21/c3a 112302233 1 2024-09-11T00:07:11.137 INFO:tasks.workunit.client.0.smithi111.stdout:8/337: stat d11/d21/d38/f57 0 2024-09-11T00:07:11.138 INFO:tasks.workunit.client.0.smithi111.stdout:6/231: chown d7/f30 1907 1 2024-09-11T00:07:11.138 INFO:tasks.workunit.client.0.smithi111.stdout:6/232: stat f3 0 2024-09-11T00:07:11.139 INFO:tasks.workunit.client.0.smithi111.stdout:8/338: dread - d11/d23/d2c/d46/f69 zero size 2024-09-11T00:07:11.147 INFO:tasks.workunit.client.1.smithi203.stdout:1/401: getdents d8/d9/d15/d30 0 2024-09-11T00:07:11.152 INFO:tasks.workunit.client.0.smithi111.stdout:0/310: dwrite d3/d13/f5a [0,4194304] 0 2024-09-11T00:07:11.153 INFO:tasks.workunit.client.1.smithi203.stdout:9/309: dread d6/de/d19/f1b [0,4194304] 0 2024-09-11T00:07:11.155 INFO:tasks.workunit.client.1.smithi203.stdout:9/310: readlink d6/de/d19/d24/l5c 0 2024-09-11T00:07:11.159 INFO:tasks.workunit.client.0.smithi111.stdout:1/270: rmdir d2 39 2024-09-11T00:07:11.160 INFO:tasks.workunit.client.1.smithi203.stdout:3/433: write d8/da/d34/f4d [1780976,81007] 0 2024-09-11T00:07:11.163 INFO:tasks.workunit.client.1.smithi203.stdout:3/434: fsync d8/da/d37/d83/d6a/f8a 0 2024-09-11T00:07:11.165 INFO:tasks.workunit.client.1.smithi203.stdout:3/435: write d8/da/d37/d83/d6a/f87 [211312,56464] 0 2024-09-11T00:07:11.168 INFO:tasks.workunit.client.1.smithi203.stdout:0/319: getdents d0 0 2024-09-11T00:07:11.168 INFO:tasks.workunit.client.0.smithi111.stdout:4/262: unlink d18/d20/d4a/f52 0 2024-09-11T00:07:11.175 INFO:tasks.workunit.client.1.smithi203.stdout:7/298: chown dd/d3b/d5b/d6a/d31/d4a/f68 13014106 1 2024-09-11T00:07:11.177 INFO:tasks.workunit.client.1.smithi203.stdout:8/308: rename d1/d13/d17/d2f/d52/d5f to d1/d13/d22/d6f 0 2024-09-11T00:07:11.182 INFO:tasks.workunit.client.1.smithi203.stdout:2/242: creat d13/d15/f48 x:0 0 0 2024-09-11T00:07:11.186 INFO:tasks.workunit.client.1.smithi203.stdout:4/288: mknod db/dd/d16/c52 0 2024-09-11T00:07:11.188 INFO:tasks.workunit.client.0.smithi111.stdout:5/316: getdents d10/d1e/d23/d30/d46/d47 0 2024-09-11T00:07:11.189 INFO:tasks.workunit.client.0.smithi111.stdout:5/317: read - d10/f6b zero size 2024-09-11T00:07:11.191 INFO:tasks.workunit.client.0.smithi111.stdout:5/318: stat d10/d1e/d23/d30/f37 0 2024-09-11T00:07:11.192 INFO:tasks.workunit.client.1.smithi203.stdout:6/270: sync 2024-09-11T00:07:11.194 INFO:tasks.workunit.client.0.smithi111.stdout:7/289: link dd/f26 dd/d48/f5f 0 2024-09-11T00:07:11.195 INFO:tasks.workunit.client.0.smithi111.stdout:7/290: fdatasync dd/f3a 0 2024-09-11T00:07:11.199 INFO:tasks.workunit.client.1.smithi203.stdout:5/353: getdents dc/d65 0 2024-09-11T00:07:11.201 INFO:tasks.workunit.client.1.smithi203.stdout:3/436: mkdir d8/da/d37/d83/da1 0 2024-09-11T00:07:11.206 INFO:tasks.workunit.client.1.smithi203.stdout:3/437: chown d8/da/d37/d53/d63/l67 34 1 2024-09-11T00:07:11.207 INFO:tasks.workunit.client.1.smithi203.stdout:0/320: mkdir d0/d2/d3d/d6a 0 2024-09-11T00:07:11.209 INFO:tasks.workunit.client.0.smithi111.stdout:0/311: rmdir d3 39 2024-09-11T00:07:11.210 INFO:tasks.workunit.client.1.smithi203.stdout:7/299: rename dd/d1c/f2d to dd/d3b/d5b/d6a/d31/f6d 0 2024-09-11T00:07:11.211 INFO:tasks.workunit.client.0.smithi111.stdout:1/271: read d2/d2b/d2c/f2d [87743,66498] 0 2024-09-11T00:07:11.215 INFO:tasks.workunit.client.1.smithi203.stdout:8/309: readlink d1/d13/d17/d48/d61/l65 0 2024-09-11T00:07:11.215 INFO:tasks.workunit.client.1.smithi203.stdout:7/300: write dd/d3b/d5b/d6a/f2c [283807,65152] 0 2024-09-11T00:07:11.218 INFO:tasks.workunit.client.1.smithi203.stdout:4/289: dread f9 [0,4194304] 0 2024-09-11T00:07:11.222 INFO:tasks.workunit.client.0.smithi111.stdout:0/312: dwrite f0 [0,4194304] 0 2024-09-11T00:07:11.225 INFO:tasks.workunit.client.1.smithi203.stdout:7/301: dread dd/d3b/d5b/d6a/d31/f50 [0,4194304] 0 2024-09-11T00:07:11.225 INFO:tasks.workunit.client.0.smithi111.stdout:2/287: creat d0/d3/de/d4b/f69 x:0 0 0 2024-09-11T00:07:11.227 INFO:tasks.workunit.client.0.smithi111.stdout:2/288: fdatasync d0/d3/d12/f3a 0 2024-09-11T00:07:11.228 INFO:tasks.workunit.client.0.smithi111.stdout:2/289: fsync d0/d3/d12/f5f 0 2024-09-11T00:07:11.229 INFO:tasks.workunit.client.0.smithi111.stdout:5/319: write d10/d1e/d25/f4a [3208593,54494] 0 2024-09-11T00:07:11.233 INFO:tasks.workunit.client.1.smithi203.stdout:1/402: write d8/d9/d15/d30/d3e/d4b/d3a/f84 [209981,50285] 0 2024-09-11T00:07:11.234 INFO:tasks.workunit.client.1.smithi203.stdout:6/271: write d0/f14 [5037091,27877] 0 2024-09-11T00:07:11.235 INFO:tasks.workunit.client.1.smithi203.stdout:8/310: dread d1/d13/d3a/f44 [0,4194304] 0 2024-09-11T00:07:11.236 INFO:tasks.workunit.client.1.smithi203.stdout:1/403: chown d8/d9/d15/d30/f53 76616 1 2024-09-11T00:07:11.237 INFO:tasks.workunit.client.0.smithi111.stdout:7/291: creat dd/d1d/d4d/f60 x:0 0 0 2024-09-11T00:07:11.238 INFO:tasks.workunit.client.0.smithi111.stdout:7/292: stat dd/d1d/d1f/l27 0 2024-09-11T00:07:11.241 INFO:tasks.workunit.client.0.smithi111.stdout:7/293: write dd/d1d/d1f/f3f [519999,87155] 0 2024-09-11T00:07:11.241 INFO:tasks.workunit.client.1.smithi203.stdout:5/354: creat dc/d2b/f6e x:0 0 0 2024-09-11T00:07:11.244 INFO:tasks.workunit.client.0.smithi111.stdout:3/338: link d1c/d1d/d22/d31/d33/d5f/c6a d1c/d1d/d22/d31/d33/d5f/c72 0 2024-09-11T00:07:11.250 INFO:tasks.workunit.client.0.smithi111.stdout:1/272: symlink d2/d2b/d2c/l5a 0 2024-09-11T00:07:11.251 INFO:tasks.workunit.client.0.smithi111.stdout:1/273: chown d2/d2b/c4a 21374 1 2024-09-11T00:07:11.253 INFO:tasks.workunit.client.0.smithi111.stdout:9/330: rename d6/db/f30 to d6/f69 0 2024-09-11T00:07:11.255 INFO:tasks.workunit.client.0.smithi111.stdout:9/331: read - d6/db/d34/d37/f3f zero size 2024-09-11T00:07:11.257 INFO:tasks.workunit.client.0.smithi111.stdout:9/332: fsync d6/db/d34/f67 0 2024-09-11T00:07:11.258 INFO:tasks.workunit.client.1.smithi203.stdout:7/302: dwrite dd/f30 [0,4194304] 0 2024-09-11T00:07:11.266 INFO:tasks.workunit.client.1.smithi203.stdout:2/243: mknod d13/d15/c49 0 2024-09-11T00:07:11.266 INFO:tasks.workunit.client.1.smithi203.stdout:5/355: dwrite dc/dd/d1e/f29 [4194304,4194304] 0 2024-09-11T00:07:11.267 INFO:tasks.workunit.client.1.smithi203.stdout:2/244: stat d13/d15/c2f 0 2024-09-11T00:07:11.268 INFO:tasks.workunit.client.1.smithi203.stdout:5/356: dread - dc/d65/f64 zero size 2024-09-11T00:07:11.271 INFO:tasks.workunit.client.0.smithi111.stdout:5/320: dread d10/f19 [0,4194304] 0 2024-09-11T00:07:11.274 INFO:tasks.workunit.client.0.smithi111.stdout:5/321: write d10/d1e/d23/d26/f50 [867485,114235] 0 2024-09-11T00:07:11.274 INFO:tasks.workunit.client.0.smithi111.stdout:5/322: chown d10/f27 67465145 1 2024-09-11T00:07:11.284 INFO:tasks.workunit.client.0.smithi111.stdout:2/290: mkdir d0/d3/de/d3b/d63/d6a 0 2024-09-11T00:07:11.291 INFO:tasks.workunit.client.0.smithi111.stdout:7/294: write dd/f31 [3751042,82243] 0 2024-09-11T00:07:11.292 INFO:tasks.workunit.client.0.smithi111.stdout:7/295: chown f8 117954419 1 2024-09-11T00:07:11.296 INFO:tasks.workunit.client.1.smithi203.stdout:9/311: creat d6/f64 x:0 0 0 2024-09-11T00:07:11.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:11 smithi203 ceph-mon[33225]: mgrmap e22: smithi203.smuspl(active, since 1.02616s) 2024-09-11T00:07:11.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:11 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:11.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:11 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:11.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:11 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:11.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:11 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:11.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:11 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:11.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:11 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:11.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:11 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:07:11.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:11 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:07:11.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:11 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-11T00:07:11.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:11 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi203.smuspl/mirror_snapshot_schedule"}]: dispatch 2024-09-11T00:07:11.298 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:11 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi203.smuspl/mirror_snapshot_schedule"}]: dispatch 2024-09-11T00:07:11.298 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:11 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi203.smuspl/trash_purge_schedule"}]: dispatch 2024-09-11T00:07:11.298 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:11 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi203.smuspl/trash_purge_schedule"}]: dispatch 2024-09-11T00:07:11.298 INFO:tasks.workunit.client.1.smithi203.stdout:2/245: dwrite d13/d15/d19/f28 [4194304,4194304] 0 2024-09-11T00:07:11.298 INFO:tasks.workunit.client.0.smithi111.stdout:2/291: dread d0/d3/f27 [0,4194304] 0 2024-09-11T00:07:11.301 INFO:tasks.workunit.client.0.smithi111.stdout:3/339: symlink d1c/d1d/d22/d23/d2f/d63/l73 0 2024-09-11T00:07:11.305 INFO:tasks.workunit.client.1.smithi203.stdout:1/404: mknod d8/d19/d31/c89 0 2024-09-11T00:07:11.305 INFO:tasks.workunit.client.0.smithi111.stdout:4/263: creat d18/f57 x:0 0 0 2024-09-11T00:07:11.312 INFO:tasks.workunit.client.0.smithi111.stdout:7/296: dwrite dd/f35 [0,4194304] 0 2024-09-11T00:07:11.316 INFO:tasks.workunit.client.0.smithi111.stdout:9/333: mknod d6/d52/c6a 0 2024-09-11T00:07:11.323 INFO:tasks.workunit.client.1.smithi203.stdout:6/272: dread d0/f10 [0,4194304] 0 2024-09-11T00:07:11.328 INFO:tasks.workunit.client.0.smithi111.stdout:0/313: creat d3/d13/d1e/f72 x:0 0 0 2024-09-11T00:07:11.329 INFO:tasks.workunit.client.0.smithi111.stdout:0/314: chown d3/d26 75742034 1 2024-09-11T00:07:11.330 INFO:tasks.workunit.client.0.smithi111.stdout:0/315: fsync d3/d13/d1e/f4d 0 2024-09-11T00:07:11.331 INFO:tasks.workunit.client.1.smithi203.stdout:7/303: mkdir dd/d3b/d5b/d6a/d31/d4a/d6e 0 2024-09-11T00:07:11.345 INFO:tasks.workunit.client.1.smithi203.stdout:5/357: rename dc/dd/c2e to dc/dd/d15/d3b/c6f 0 2024-09-11T00:07:11.352 INFO:tasks.workunit.client.1.smithi203.stdout:4/290: unlink db/d12/l39 0 2024-09-11T00:07:11.354 INFO:tasks.workunit.client.0.smithi111.stdout:3/340: mkdir d1c/d1d/d22/d44/d5a/d74 0 2024-09-11T00:07:11.356 INFO:tasks.workunit.client.0.smithi111.stdout:4/264: creat d18/d20/d3c/f58 x:0 0 0 2024-09-11T00:07:11.357 INFO:tasks.workunit.client.0.smithi111.stdout:4/265: readlink d18/d1f/l45 0 2024-09-11T00:07:11.362 INFO:tasks.workunit.client.0.smithi111.stdout:1/274: creat d2/d2b/d2c/d56/f5b x:0 0 0 2024-09-11T00:07:11.362 INFO:tasks.workunit.client.1.smithi203.stdout:9/312: unlink d6/de/d19/f3c 0 2024-09-11T00:07:11.362 INFO:tasks.workunit.client.1.smithi203.stdout:0/321: truncate d0/f15 1803886 0 2024-09-11T00:07:11.364 INFO:tasks.workunit.client.1.smithi203.stdout:0/322: chown d0/f29 5579 1 2024-09-11T00:07:11.367 INFO:tasks.workunit.client.1.smithi203.stdout:9/313: chown d6/de/d19/d24/d40/d45/f15 1912174116 1 2024-09-11T00:07:11.368 INFO:tasks.workunit.client.1.smithi203.stdout:3/438: dwrite d8/da/d34/f94 [0,4194304] 0 2024-09-11T00:07:11.369 INFO:tasks.workunit.client.1.smithi203.stdout:2/246: creat d13/d22/f4a x:0 0 0 2024-09-11T00:07:11.371 INFO:tasks.workunit.client.1.smithi203.stdout:3/439: chown d8/d17/f74 1406486644 1 2024-09-11T00:07:11.372 INFO:tasks.workunit.client.0.smithi111.stdout:7/297: fdatasync dd/d1d/d1f/f5e 0 2024-09-11T00:07:11.372 INFO:tasks.workunit.client.0.smithi111.stdout:9/334: creat d6/db/d1b/d56/f6b x:0 0 0 2024-09-11T00:07:11.374 INFO:tasks.workunit.client.0.smithi111.stdout:5/323: mkdir d10/d1e/d23/d2b/d55/d6d 0 2024-09-11T00:07:11.375 INFO:tasks.workunit.client.0.smithi111.stdout:9/335: fsync d6/db/d1b/d41/f42 0 2024-09-11T00:07:11.377 INFO:tasks.workunit.client.1.smithi203.stdout:1/405: dread d8/d9/d15/f43 [0,4194304] 0 2024-09-11T00:07:11.377 INFO:tasks.workunit.client.0.smithi111.stdout:5/324: write d10/d1e/d23/d30/d46/d47/f58 [99649,35337] 0 2024-09-11T00:07:11.379 INFO:tasks.workunit.client.0.smithi111.stdout:3/341: fsync d1c/d21/f6c 0 2024-09-11T00:07:11.386 INFO:tasks.workunit.client.0.smithi111.stdout:1/275: rmdir d2/de/d12/d39/d3a 39 2024-09-11T00:07:11.386 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:11 smithi111 ceph-mon[27539]: mgrmap e22: smithi203.smuspl(active, since 1.02616s) 2024-09-11T00:07:11.386 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:11 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:11.386 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:11 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:11.386 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:11 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:11.386 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:11 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:11.386 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:11 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:11.387 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:11 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:11.387 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:11 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:07:11.387 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:11 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:07:11.387 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:11 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-11T00:07:11.387 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:11 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi203.smuspl/mirror_snapshot_schedule"}]: dispatch 2024-09-11T00:07:11.387 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:11 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi203.smuspl/mirror_snapshot_schedule"}]: dispatch 2024-09-11T00:07:11.387 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:11 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi203.smuspl/trash_purge_schedule"}]: dispatch 2024-09-11T00:07:11.387 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:11 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi203.smuspl/trash_purge_schedule"}]: dispatch 2024-09-11T00:07:11.389 INFO:tasks.workunit.client.0.smithi111.stdout:6/233: rename d7/l14 to d7/d22/l48 0 2024-09-11T00:07:11.392 INFO:tasks.workunit.client.0.smithi111.stdout:7/298: dwrite dd/d1d/d4d/f60 [0,4194304] 0 2024-09-11T00:07:11.393 INFO:tasks.workunit.client.0.smithi111.stdout:7/299: fdatasync dd/f35 0 2024-09-11T00:07:11.395 INFO:tasks.workunit.client.0.smithi111.stdout:9/336: rmdir d6/db/d34/d37 39 2024-09-11T00:07:11.396 INFO:tasks.workunit.client.1.smithi203.stdout:6/273: creat d0/d27/d35/d39/f4b x:0 0 0 2024-09-11T00:07:11.397 INFO:tasks.workunit.client.0.smithi111.stdout:9/337: chown d6/db/d34/f66 17 1 2024-09-11T00:07:11.403 INFO:tasks.workunit.client.0.smithi111.stdout:5/325: mkdir d10/d1e/d25/d6e 0 2024-09-11T00:07:11.409 INFO:tasks.workunit.client.1.smithi203.stdout:5/358: mknod dc/dd/c70 0 2024-09-11T00:07:11.413 INFO:tasks.workunit.client.1.smithi203.stdout:5/359: read - dc/dd/d13/f5d zero size 2024-09-11T00:07:11.418 INFO:tasks.workunit.client.0.smithi111.stdout:0/316: truncate d3/d13/d1e/d29/f3e 2273549 0 2024-09-11T00:07:11.418 INFO:tasks.workunit.client.0.smithi111.stdout:0/317: dread - d3/f65 zero size 2024-09-11T00:07:11.419 INFO:tasks.workunit.client.1.smithi203.stdout:1/406: dread d8/d9/d15/d27/f39 [0,4194304] 0 2024-09-11T00:07:11.420 INFO:tasks.workunit.client.1.smithi203.stdout:1/407: chown d8/d9 3751244 1 2024-09-11T00:07:11.421 INFO:tasks.workunit.client.0.smithi111.stdout:0/318: write d3/d1c/f6a [341748,43057] 0 2024-09-11T00:07:11.422 INFO:tasks.workunit.client.0.smithi111.stdout:0/319: write d3/d1c/f6a [1354991,32522] 0 2024-09-11T00:07:11.426 INFO:tasks.workunit.client.0.smithi111.stdout:8/339: rename d11/d21/d38/d54/c67 to d11/d23/d2c/c73 0 2024-09-11T00:07:11.429 INFO:tasks.workunit.client.1.smithi203.stdout:2/247: stat d13/d15/f1a 0 2024-09-11T00:07:11.431 INFO:tasks.workunit.client.0.smithi111.stdout:2/292: getdents d0/d3/d2e 0 2024-09-11T00:07:11.433 INFO:tasks.workunit.client.1.smithi203.stdout:9/314: write d6/de/d32/f37 [260332,44938] 0 2024-09-11T00:07:11.439 INFO:tasks.workunit.client.1.smithi203.stdout:6/274: creat d0/d27/d35/d39/d3c/f4c x:0 0 0 2024-09-11T00:07:11.440 INFO:tasks.workunit.client.0.smithi111.stdout:8/340: dwrite d11/f12 [4194304,4194304] 0 2024-09-11T00:07:11.441 INFO:tasks.workunit.client.1.smithi203.stdout:7/304: creat dd/d1c/d52/f6f x:0 0 0 2024-09-11T00:07:11.442 INFO:tasks.workunit.client.0.smithi111.stdout:8/341: dread - d11/d21/d38/f5e zero size 2024-09-11T00:07:11.443 INFO:tasks.workunit.client.1.smithi203.stdout:4/291: mknod db/d12/d15/d2a/c53 0 2024-09-11T00:07:11.445 INFO:tasks.workunit.client.1.smithi203.stdout:4/292: dread - db/d12/f1e zero size 2024-09-11T00:07:11.446 INFO:tasks.workunit.client.1.smithi203.stdout:1/408: rmdir d8/d19/d31/d36 39 2024-09-11T00:07:11.448 INFO:tasks.workunit.client.0.smithi111.stdout:7/300: fsync dd/d48/f5f 0 2024-09-11T00:07:11.448 INFO:tasks.workunit.client.1.smithi203.stdout:8/311: getdents d1/d13/d3a 0 2024-09-11T00:07:11.450 INFO:tasks.workunit.client.1.smithi203.stdout:8/312: chown d1/d13/d17/f38 486 1 2024-09-11T00:07:11.451 INFO:tasks.workunit.client.1.smithi203.stdout:2/248: mknod d13/c4b 0 2024-09-11T00:07:11.452 INFO:tasks.workunit.client.0.smithi111.stdout:9/338: fsync d6/db/d34/d37/f35 0 2024-09-11T00:07:11.452 INFO:tasks.workunit.client.1.smithi203.stdout:3/440: mkdir d8/da/d37/d53/da2 0 2024-09-11T00:07:11.453 INFO:tasks.workunit.client.0.smithi111.stdout:2/293: symlink d0/d3/d12/l6b 0 2024-09-11T00:07:11.457 INFO:tasks.workunit.client.0.smithi111.stdout:4/266: getdents d18/d20/d40 0 2024-09-11T00:07:11.458 INFO:tasks.workunit.client.0.smithi111.stdout:4/267: write f9 [6073902,96630] 0 2024-09-11T00:07:11.459 INFO:tasks.workunit.client.0.smithi111.stdout:4/268: read d18/d20/f23 [3864021,11966] 0 2024-09-11T00:07:11.461 INFO:tasks.workunit.client.1.smithi203.stdout:0/323: write d0/f5 [4560601,33424] 0 2024-09-11T00:07:11.462 INFO:tasks.workunit.client.1.smithi203.stdout:9/315: write d6/de/d19/d24/d40/d45/f15 [3117891,44087] 0 2024-09-11T00:07:11.463 INFO:tasks.workunit.client.0.smithi111.stdout:3/342: creat d1c/d1d/d22/d23/d58/f75 x:0 0 0 2024-09-11T00:07:11.463 INFO:tasks.workunit.client.1.smithi203.stdout:0/324: stat d0/d2/d37/f38 0 2024-09-11T00:07:11.464 INFO:tasks.workunit.client.0.smithi111.stdout:3/343: fdatasync d1c/d1d/d22/d44/f4e 0 2024-09-11T00:07:11.470 INFO:tasks.workunit.client.1.smithi203.stdout:7/305: symlink dd/d1c/l70 0 2024-09-11T00:07:11.471 INFO:tasks.workunit.client.0.smithi111.stdout:8/342: rename d11/c40 to d11/d23/d3d/c74 0 2024-09-11T00:07:11.473 INFO:tasks.workunit.client.0.smithi111.stdout:6/234: symlink d7/d2b/d35/d41/l49 0 2024-09-11T00:07:11.473 INFO:tasks.workunit.client.0.smithi111.stdout:8/343: chown d11/d23/d3d/d5f/f62 371231 1 2024-09-11T00:07:11.474 INFO:tasks.workunit.client.1.smithi203.stdout:4/293: rmdir db/d12/d15 39 2024-09-11T00:07:11.477 INFO:tasks.workunit.client.1.smithi203.stdout:4/294: write db/dd/f11 [1180673,28683] 0 2024-09-11T00:07:11.478 INFO:tasks.workunit.client.1.smithi203.stdout:8/313: write d1/d13/d3a/f44 [2219129,103381] 0 2024-09-11T00:07:11.479 INFO:tasks.workunit.client.1.smithi203.stdout:3/441: mkdir d8/da/d37/d83/da3 0 2024-09-11T00:07:11.483 INFO:tasks.workunit.client.1.smithi203.stdout:5/360: creat dc/dd/d1e/f71 x:0 0 0 2024-09-11T00:07:11.485 INFO:tasks.workunit.client.0.smithi111.stdout:1/276: getdents d2/d2b 0 2024-09-11T00:07:11.485 INFO:tasks.workunit.client.1.smithi203.stdout:8/314: chown d1/d13/d3a/d4c/c51 180622 1 2024-09-11T00:07:11.487 INFO:tasks.workunit.client.1.smithi203.stdout:1/409: creat d8/d9/d15/d30/d3e/d4b/d41/f8a x:0 0 0 2024-09-11T00:07:11.488 INFO:tasks.workunit.client.0.smithi111.stdout:3/344: creat d1c/d1d/d22/d44/d5a/f76 x:0 0 0 2024-09-11T00:07:11.488 INFO:tasks.workunit.client.1.smithi203.stdout:1/410: chown d8/d9/d15/d30/f3d 21274 1 2024-09-11T00:07:11.490 INFO:tasks.workunit.client.0.smithi111.stdout:0/320: creat d3/d13/f73 x:0 0 0 2024-09-11T00:07:11.493 INFO:tasks.workunit.client.0.smithi111.stdout:0/321: chown d3/f7 325 1 2024-09-11T00:07:11.494 INFO:tasks.workunit.client.1.smithi203.stdout:1/411: read - d8/d9/d15/d30/d3e/d4b/d41/f8a zero size 2024-09-11T00:07:11.494 INFO:tasks.workunit.client.1.smithi203.stdout:2/249: mknod d13/d15/c4c 0 2024-09-11T00:07:11.494 INFO:tasks.workunit.client.1.smithi203.stdout:0/325: creat d0/d2/d3d/d5a/f6b x:0 0 0 2024-09-11T00:07:11.494 INFO:tasks.workunit.client.1.smithi203.stdout:2/250: chown d13/d15/d19/d1c/f3c 320314 1 2024-09-11T00:07:11.494 INFO:tasks.workunit.client.1.smithi203.stdout:1/412: fsync d8/d9/d15/d30/f3d 0 2024-09-11T00:07:11.500 INFO:tasks.workunit.client.1.smithi203.stdout:4/295: mknod db/dd/d16/d38/d3c/d41/c54 0 2024-09-11T00:07:11.500 INFO:tasks.workunit.client.1.smithi203.stdout:4/296: fsync f2 0 2024-09-11T00:07:11.501 INFO:tasks.workunit.client.1.smithi203.stdout:4/297: write f2 [1797575,44082] 0 2024-09-11T00:07:11.503 INFO:tasks.workunit.client.1.smithi203.stdout:4/298: write db/dd/d26/f28 [579327,128822] 0 2024-09-11T00:07:11.504 INFO:tasks.workunit.client.1.smithi203.stdout:3/442: rename d8/d17/l32 to d8/da/d5c/d80/la4 0 2024-09-11T00:07:11.508 INFO:tasks.workunit.client.0.smithi111.stdout:7/301: truncate dd/d1d/d1f/f45 444613 0 2024-09-11T00:07:11.509 INFO:tasks.workunit.client.0.smithi111.stdout:8/344: dread d11/d23/d2c/f3b [0,4194304] 0 2024-09-11T00:07:11.512 INFO:tasks.workunit.client.1.smithi203.stdout:0/326: dwrite d0/d2/f1a [0,4194304] 0 2024-09-11T00:07:11.515 INFO:tasks.workunit.client.1.smithi203.stdout:5/361: creat dc/dd/d15/d3b/f72 x:0 0 0 2024-09-11T00:07:11.516 INFO:tasks.workunit.client.0.smithi111.stdout:2/294: getdents d0/d3/de/d3b/d62 0 2024-09-11T00:07:11.518 INFO:tasks.workunit.client.0.smithi111.stdout:9/339: truncate d6/db/f49 4548659 0 2024-09-11T00:07:11.521 INFO:tasks.workunit.client.0.smithi111.stdout:4/269: link d18/d20/f46 d18/d1f/d33/f59 0 2024-09-11T00:07:11.525 INFO:tasks.workunit.client.0.smithi111.stdout:3/345: rename d1c/d21/f2b to d1c/d1d/f77 0 2024-09-11T00:07:11.526 INFO:tasks.workunit.client.1.smithi203.stdout:3/443: dwrite d8/da/d5c/fa0 [0,4194304] 0 2024-09-11T00:07:11.528 INFO:tasks.workunit.client.0.smithi111.stdout:0/322: write d3/d1c/f6d [2519267,37529] 0 2024-09-11T00:07:11.531 INFO:tasks.workunit.client.0.smithi111.stdout:7/302: rmdir dd/d49 39 2024-09-11T00:07:11.533 INFO:tasks.workunit.client.1.smithi203.stdout:0/327: dread d0/f5c [0,4194304] 0 2024-09-11T00:07:11.534 INFO:tasks.workunit.client.1.smithi203.stdout:6/275: link d0/l20 d0/d27/d35/d38/l4d 0 2024-09-11T00:07:11.535 INFO:tasks.workunit.client.1.smithi203.stdout:0/328: chown d0/d1d/c26 99 1 2024-09-11T00:07:11.537 INFO:tasks.workunit.client.0.smithi111.stdout:9/340: mknod d6/db/d1b/d56/c6c 0 2024-09-11T00:07:11.538 INFO:tasks.workunit.client.0.smithi111.stdout:2/295: dwrite d0/d3/de/d3b/f58 [0,4194304] 0 2024-09-11T00:07:11.544 INFO:tasks.workunit.client.0.smithi111.stdout:2/296: chown d0/d3/d2e/f66 556 1 2024-09-11T00:07:11.545 INFO:tasks.workunit.client.1.smithi203.stdout:3/444: dwrite d8/d17/f1c [0,4194304] 0 2024-09-11T00:07:11.547 INFO:tasks.workunit.client.0.smithi111.stdout:4/270: symlink d18/d3b/l5a 0 2024-09-11T00:07:11.548 INFO:tasks.workunit.client.0.smithi111.stdout:4/271: chown d18/d3b 11 1 2024-09-11T00:07:11.549 INFO:tasks.workunit.client.0.smithi111.stdout:4/272: stat d18/d1f 0 2024-09-11T00:07:11.550 INFO:tasks.workunit.client.1.smithi203.stdout:5/362: mkdir dc/dd/d15/d3b/d73 0 2024-09-11T00:07:11.552 INFO:tasks.workunit.client.0.smithi111.stdout:6/235: rmdir d7/d32 0 2024-09-11T00:07:11.563 INFO:tasks.workunit.client.0.smithi111.stdout:8/345: link d11/f13 d11/d21/d38/d54/f75 0 2024-09-11T00:07:11.567 INFO:tasks.workunit.client.0.smithi111.stdout:4/273: dwrite d18/d20/d3c/f54 [0,4194304] 0 2024-09-11T00:07:11.569 INFO:tasks.workunit.client.0.smithi111.stdout:4/274: write f8 [2520311,67329] 0 2024-09-11T00:07:11.570 INFO:tasks.workunit.client.1.smithi203.stdout:6/276: unlink d0/d27/l1d 0 2024-09-11T00:07:11.570 INFO:tasks.workunit.client.1.smithi203.stdout:2/251: dwrite d13/d15/f1a [0,4194304] 0 2024-09-11T00:07:11.571 INFO:tasks.workunit.client.0.smithi111.stdout:7/303: rename dd/d1d/d2d/d2e/f3d to dd/d48/f61 0 2024-09-11T00:07:11.572 INFO:tasks.workunit.client.0.smithi111.stdout:5/326: sync 2024-09-11T00:07:11.573 INFO:tasks.workunit.client.0.smithi111.stdout:7/304: dread - dd/d1d/d1f/f50 zero size 2024-09-11T00:07:11.573 INFO:tasks.workunit.client.0.smithi111.stdout:9/341: chown d6/l24 532425154 1 2024-09-11T00:07:11.574 INFO:tasks.workunit.client.1.smithi203.stdout:0/329: mknod d0/d2/c6c 0 2024-09-11T00:07:11.581 INFO:tasks.workunit.client.0.smithi111.stdout:0/323: mkdir d3/d74 0 2024-09-11T00:07:11.584 INFO:tasks.workunit.client.1.smithi203.stdout:3/445: rename d8/d3c/c5b to d8/da/d37/ca5 0 2024-09-11T00:07:11.590 INFO:tasks.workunit.client.0.smithi111.stdout:0/324: dread d3/d13/d1e/d29/f2d [0,4194304] 0 2024-09-11T00:07:11.591 INFO:tasks.workunit.client.1.smithi203.stdout:1/413: symlink d8/d9/d15/d30/d3e/d4b/d80/l8b 0 2024-09-11T00:07:11.592 INFO:tasks.workunit.client.1.smithi203.stdout:1/414: chown d8/d9/d15/d35 1 1 2024-09-11T00:07:11.593 INFO:tasks.workunit.client.1.smithi203.stdout:1/415: chown d8/d19/d31/c73 2 1 2024-09-11T00:07:11.595 INFO:tasks.workunit.client.0.smithi111.stdout:8/346: unlink d11/d23/d3d/c72 0 2024-09-11T00:07:11.597 INFO:tasks.workunit.client.0.smithi111.stdout:8/347: write ff [1375173,57798] 0 2024-09-11T00:07:11.598 INFO:tasks.workunit.client.0.smithi111.stdout:8/348: read - d11/d21/d38/f5e zero size 2024-09-11T00:07:11.599 INFO:tasks.workunit.client.1.smithi203.stdout:5/363: rmdir dc/dd/d15/d3b 39 2024-09-11T00:07:11.601 INFO:tasks.workunit.client.0.smithi111.stdout:8/349: truncate d11/d23/d2c/d46/f69 650164 0 2024-09-11T00:07:11.602 INFO:tasks.workunit.client.0.smithi111.stdout:8/350: write d11/d21/d38/f47 [1601030,60501] 0 2024-09-11T00:07:11.603 INFO:tasks.workunit.client.1.smithi203.stdout:2/252: dread d13/d15/f1a [0,4194304] 0 2024-09-11T00:07:11.604 INFO:tasks.workunit.client.0.smithi111.stdout:8/351: chown d11/d21/d38/d54/d5b/f61 1874933 1 2024-09-11T00:07:11.605 INFO:tasks.workunit.client.1.smithi203.stdout:0/330: dwrite d0/f5 [0,4194304] 0 2024-09-11T00:07:11.606 INFO:tasks.workunit.client.0.smithi111.stdout:8/352: fsync d11/d23/d3d/f44 0 2024-09-11T00:07:11.608 INFO:tasks.workunit.client.1.smithi203.stdout:2/253: truncate d13/d15/d19/f26 565853 0 2024-09-11T00:07:11.613 INFO:tasks.workunit.client.0.smithi111.stdout:1/277: getdents d2/de/d12/d34 0 2024-09-11T00:07:11.614 INFO:tasks.workunit.client.1.smithi203.stdout:3/446: dread d8/da/d37/d83/d65/d8b/f9e [4194304,4194304] 0 2024-09-11T00:07:11.614 INFO:tasks.workunit.client.0.smithi111.stdout:1/278: fdatasync d2/fd 0 2024-09-11T00:07:11.617 INFO:tasks.workunit.client.0.smithi111.stdout:9/342: unlink d6/db/f50 0 2024-09-11T00:07:11.619 INFO:tasks.workunit.client.1.smithi203.stdout:8/315: getdents d1/d13/d17/d48/d61 0 2024-09-11T00:07:11.621 INFO:tasks.workunit.client.0.smithi111.stdout:7/305: mkdir dd/d1d/d1f/d24/d62 0 2024-09-11T00:07:11.624 INFO:tasks.workunit.client.0.smithi111.stdout:2/297: truncate d0/d3/de/f11 785456 0 2024-09-11T00:07:11.625 INFO:tasks.workunit.client.0.smithi111.stdout:2/298: chown d0/l2b 6330 1 2024-09-11T00:07:11.628 INFO:tasks.workunit.client.1.smithi203.stdout:1/416: creat d8/d9/d15/d30/d3e/f8c x:0 0 0 2024-09-11T00:07:11.631 INFO:tasks.workunit.client.0.smithi111.stdout:5/327: rename d10/d1e/d23/d2b/d2f/f5f to d10/d1e/d23/d30/d3c/d60/d63/f6f 0 2024-09-11T00:07:11.633 INFO:tasks.workunit.client.1.smithi203.stdout:5/364: unlink dc/l6b 0 2024-09-11T00:07:11.636 INFO:tasks.workunit.client.0.smithi111.stdout:6/236: mkdir d7/d22/d2d/d4a 0 2024-09-11T00:07:11.639 INFO:tasks.workunit.client.0.smithi111.stdout:0/325: mkdir d3/da/d75 0 2024-09-11T00:07:11.639 INFO:tasks.workunit.client.1.smithi203.stdout:2/254: mknod d13/d15/d19/d1c/c4d 0 2024-09-11T00:07:11.643 INFO:tasks.workunit.client.0.smithi111.stdout:8/353: unlink d11/d21/f26 0 2024-09-11T00:07:11.645 INFO:tasks.workunit.client.0.smithi111.stdout:8/354: dread - d11/d21/d38/f52 zero size 2024-09-11T00:07:11.645 INFO:tasks.workunit.client.0.smithi111.stdout:4/275: creat d18/d3b/d51/f5b x:0 0 0 2024-09-11T00:07:11.646 INFO:tasks.workunit.client.0.smithi111.stdout:4/276: fdatasync f14 0 2024-09-11T00:07:11.647 INFO:tasks.workunit.client.1.smithi203.stdout:8/316: write d1/f3f [985470,113758] 0 2024-09-11T00:07:11.648 INFO:tasks.workunit.client.0.smithi111.stdout:8/355: write d11/f1d [1840813,75013] 0 2024-09-11T00:07:11.650 INFO:tasks.workunit.client.0.smithi111.stdout:1/279: rmdir d2/de/d12/d3c 39 2024-09-11T00:07:11.652 INFO:tasks.workunit.client.0.smithi111.stdout:8/356: write ff [1501688,107730] 0 2024-09-11T00:07:11.653 INFO:tasks.workunit.client.0.smithi111.stdout:2/299: dread d0/d3/de/f1e [0,4194304] 0 2024-09-11T00:07:11.654 INFO:tasks.workunit.client.1.smithi203.stdout:1/417: mkdir d8/d9/d15/d30/d3e/d4b/d80/d8d 0 2024-09-11T00:07:11.655 INFO:tasks.workunit.client.0.smithi111.stdout:2/300: stat d0/d3/de/c48 0 2024-09-11T00:07:11.656 INFO:tasks.workunit.client.0.smithi111.stdout:6/237: dwrite d7/d2b/d35/f3a [0,4194304] 0 2024-09-11T00:07:11.656 INFO:tasks.workunit.client.0.smithi111.stdout:9/343: creat d6/db/f6d x:0 0 0 2024-09-11T00:07:11.658 INFO:tasks.workunit.client.1.smithi203.stdout:5/365: write dc/d4f/d5c/f66 [1017998,53001] 0 2024-09-11T00:07:11.659 INFO:tasks.workunit.client.1.smithi203.stdout:4/299: write db/d12/d15/d2a/f1b [2187932,5237] 0 2024-09-11T00:07:11.661 INFO:tasks.workunit.client.0.smithi111.stdout:9/344: dread d6/db/d34/f58 [0,4194304] 0 2024-09-11T00:07:11.662 INFO:tasks.workunit.client.0.smithi111.stdout:6/238: dread - d7/d22/d2c/d38/f45 zero size 2024-09-11T00:07:11.662 INFO:tasks.workunit.client.0.smithi111.stdout:3/346: sync 2024-09-11T00:07:11.662 INFO:tasks.workunit.client.0.smithi111.stdout:6/239: stat d7/d22/d1d 0 2024-09-11T00:07:11.664 INFO:tasks.workunit.client.0.smithi111.stdout:3/347: chown d1c/d21/f3a 0 1 2024-09-11T00:07:11.665 INFO:tasks.workunit.client.1.smithi203.stdout:2/255: creat d13/d22/f4e x:0 0 0 2024-09-11T00:07:11.666 INFO:tasks.workunit.client.0.smithi111.stdout:6/240: write d7/d2b/d35/f3a [590833,37075] 0 2024-09-11T00:07:11.668 INFO:tasks.workunit.client.1.smithi203.stdout:6/277: write d0/f4 [158885,110848] 0 2024-09-11T00:07:11.669 INFO:tasks.workunit.client.1.smithi203.stdout:3/447: creat d8/da/d37/d83/da3/fa6 x:0 0 0 2024-09-11T00:07:11.671 INFO:tasks.workunit.client.0.smithi111.stdout:5/328: dread d10/f1c [0,4194304] 0 2024-09-11T00:07:11.677 INFO:tasks.workunit.client.1.smithi203.stdout:8/317: creat d1/d13/d22/d5d/f70 x:0 0 0 2024-09-11T00:07:11.681 INFO:tasks.workunit.client.1.smithi203.stdout:1/418: dread d8/f68 [0,4194304] 0 2024-09-11T00:07:11.683 INFO:tasks.workunit.client.1.smithi203.stdout:1/419: stat d8/d9/d15/d27/c5f 0 2024-09-11T00:07:11.684 INFO:tasks.workunit.client.1.smithi203.stdout:5/366: dwrite dc/dd/d15/f2c [0,4194304] 0 2024-09-11T00:07:11.686 INFO:tasks.workunit.client.1.smithi203.stdout:4/300: rename db/dd/d16/d38/d3c/d41/f4b to db/dd/d16/f55 0 2024-09-11T00:07:11.690 INFO:tasks.workunit.client.1.smithi203.stdout:6/278: rmdir d0/d27/d35/d39 39 2024-09-11T00:07:11.698 INFO:tasks.workunit.client.1.smithi203.stdout:0/331: getdents d0 0 2024-09-11T00:07:11.701 INFO:tasks.workunit.client.0.smithi111.stdout:8/357: creat d11/d23/d2c/d46/d64/f76 x:0 0 0 2024-09-11T00:07:11.701 INFO:tasks.workunit.client.1.smithi203.stdout:0/332: truncate d0/d1d/f69 706562 0 2024-09-11T00:07:11.704 INFO:tasks.workunit.client.1.smithi203.stdout:8/318: fsync d1/d13/d43/d46/d64/f6b 0 2024-09-11T00:07:11.705 INFO:tasks.workunit.client.1.smithi203.stdout:8/319: fdatasync d1/d13/d22/f58 0 2024-09-11T00:07:11.706 INFO:tasks.workunit.client.1.smithi203.stdout:8/320: write d1/d13/f1f [14939,82945] 0 2024-09-11T00:07:11.707 INFO:tasks.workunit.client.1.smithi203.stdout:1/420: symlink d8/d9/d15/d30/d3e/d66/l8e 0 2024-09-11T00:07:11.709 INFO:tasks.workunit.client.1.smithi203.stdout:3/448: write d8/da/d37/d53/f62 [132073,27789] 0 2024-09-11T00:07:11.712 INFO:tasks.workunit.client.1.smithi203.stdout:5/367: write dc/dd/d15/f4b [294504,36089] 0 2024-09-11T00:07:11.713 INFO:tasks.workunit.client.0.smithi111.stdout:2/301: rename d0/d3/de/d3b/d63/d6a to d0/d3/d12/d52/d6c 0 2024-09-11T00:07:11.713 INFO:tasks.workunit.client.1.smithi203.stdout:5/368: chown dc/dd/d4d 34 1 2024-09-11T00:07:11.714 INFO:tasks.workunit.client.0.smithi111.stdout:2/302: readlink d0/d3/d12/d52/l45 0 2024-09-11T00:07:11.716 INFO:tasks.workunit.client.0.smithi111.stdout:9/345: mknod d6/db/d34/d37/c6e 0 2024-09-11T00:07:11.717 INFO:tasks.workunit.client.1.smithi203.stdout:2/256: creat d13/d15/d30/f4f x:0 0 0 2024-09-11T00:07:11.720 INFO:tasks.workunit.client.0.smithi111.stdout:6/241: symlink d7/d22/d2d/l4b 0 2024-09-11T00:07:11.721 INFO:tasks.workunit.client.1.smithi203.stdout:0/333: truncate d0/d2/d37/f3e 666862 0 2024-09-11T00:07:11.727 INFO:tasks.workunit.client.1.smithi203.stdout:1/421: creat d8/d9/d15/d35/f8f x:0 0 0 2024-09-11T00:07:11.728 INFO:tasks.workunit.client.0.smithi111.stdout:4/277: symlink d18/d20/l5c 0 2024-09-11T00:07:11.729 INFO:tasks.workunit.client.0.smithi111.stdout:4/278: readlink d18/d20/l5c 0 2024-09-11T00:07:11.730 INFO:tasks.workunit.client.0.smithi111.stdout:8/358: mknod d11/d23/d2c/d46/d64/c77 0 2024-09-11T00:07:11.731 INFO:tasks.workunit.client.1.smithi203.stdout:4/301: mknod db/c56 0 2024-09-11T00:07:11.732 INFO:tasks.workunit.client.0.smithi111.stdout:7/306: creat dd/f63 x:0 0 0 2024-09-11T00:07:11.733 INFO:tasks.workunit.client.1.smithi203.stdout:5/369: chown dc/dd/d15/d3b/f63 1410151 1 2024-09-11T00:07:11.733 INFO:tasks.workunit.client.1.smithi203.stdout:2/257: readlink d13/d15/d19/l2b 0 2024-09-11T00:07:11.734 INFO:tasks.workunit.client.0.smithi111.stdout:7/307: truncate dd/d1d/d4d/f60 4591982 0 2024-09-11T00:07:11.735 INFO:tasks.workunit.client.1.smithi203.stdout:2/258: chown d13/d15/d30/l3a 1 1 2024-09-11T00:07:11.736 INFO:tasks.workunit.client.0.smithi111.stdout:9/346: chown d6/c44 23 1 2024-09-11T00:07:11.736 INFO:tasks.workunit.client.1.smithi203.stdout:2/259: fdatasync f11 0 2024-09-11T00:07:11.737 INFO:tasks.workunit.client.1.smithi203.stdout:8/321: link d1/d13/d17/d2f/f32 d1/d13/d17/d48/d61/f71 0 2024-09-11T00:07:11.738 INFO:tasks.workunit.client.0.smithi111.stdout:0/326: link d3/d13/d1e/f44 d3/d13/d1e/d29/d49/f76 0 2024-09-11T00:07:11.738 INFO:tasks.workunit.client.1.smithi203.stdout:2/260: chown d13/d22/c3b 3 1 2024-09-11T00:07:11.739 INFO:tasks.workunit.client.1.smithi203.stdout:1/422: rmdir d8/d9/d15 39 2024-09-11T00:07:11.739 INFO:tasks.workunit.client.0.smithi111.stdout:0/327: fdatasync d3/da/f1d 0 2024-09-11T00:07:11.741 INFO:tasks.workunit.client.1.smithi203.stdout:0/334: rmdir d0/d2/d37 39 2024-09-11T00:07:11.742 INFO:tasks.workunit.client.1.smithi203.stdout:8/322: truncate d1/d13/d17/d48/d61/f71 5030891 0 2024-09-11T00:07:11.742 INFO:tasks.workunit.client.1.smithi203.stdout:0/335: dread - d0/d1d/f3f zero size 2024-09-11T00:07:11.742 INFO:tasks.workunit.client.0.smithi111.stdout:8/359: dread d11/d21/f31 [0,4194304] 0 2024-09-11T00:07:11.749 INFO:tasks.workunit.client.1.smithi203.stdout:6/279: rename d0/c7 to d0/d32/c4e 0 2024-09-11T00:07:11.755 INFO:tasks.workunit.client.1.smithi203.stdout:7/306: sync 2024-09-11T00:07:11.755 INFO:tasks.workunit.client.0.smithi111.stdout:2/303: mkdir d0/d3/de/d3b/d62/d6d 0 2024-09-11T00:07:11.757 INFO:tasks.workunit.client.1.smithi203.stdout:8/323: dwrite d1/d13/f1f [0,4194304] 0 2024-09-11T00:07:11.759 INFO:tasks.workunit.client.1.smithi203.stdout:8/324: chown d1/d13/d22/c3c 25 1 2024-09-11T00:07:11.769 INFO:tasks.workunit.client.1.smithi203.stdout:8/325: read - d1/d13/d22/d5d/f70 zero size 2024-09-11T00:07:11.769 INFO:tasks.workunit.client.1.smithi203.stdout:5/370: dread dc/dd/d13/f3e [0,4194304] 0 2024-09-11T00:07:11.772 INFO:tasks.workunit.client.0.smithi111.stdout:5/329: truncate d10/d1e/d23/d2b/f33 1621575 0 2024-09-11T00:07:11.773 INFO:tasks.workunit.client.1.smithi203.stdout:2/261: symlink d13/d15/d19/d1c/l50 0 2024-09-11T00:07:11.775 INFO:tasks.workunit.client.0.smithi111.stdout:9/347: rename d6/db/d34/f58 to d6/dc/f6f 0 2024-09-11T00:07:11.775 INFO:tasks.workunit.client.0.smithi111.stdout:5/330: dread - d10/d1e/d23/d26/d3a/f5d zero size 2024-09-11T00:07:11.776 INFO:tasks.workunit.client.1.smithi203.stdout:2/262: write d13/d15/f1f [353898,24181] 0 2024-09-11T00:07:11.778 INFO:tasks.workunit.client.1.smithi203.stdout:2/263: chown d13/d15/c35 467265 1 2024-09-11T00:07:11.780 INFO:tasks.workunit.client.1.smithi203.stdout:3/449: rmdir d8/da/d5c/d6b/d96 0 2024-09-11T00:07:11.780 INFO:tasks.workunit.client.1.smithi203.stdout:2/264: dread - d13/d22/f3f zero size 2024-09-11T00:07:11.781 INFO:tasks.workunit.client.0.smithi111.stdout:8/360: mknod d11/d23/d2c/d53/c78 0 2024-09-11T00:07:11.784 INFO:tasks.workunit.client.1.smithi203.stdout:7/307: creat dd/d1c/f71 x:0 0 0 2024-09-11T00:07:11.785 INFO:tasks.workunit.client.0.smithi111.stdout:2/304: symlink d0/d3/d12/d38/l6e 0 2024-09-11T00:07:11.785 INFO:tasks.workunit.client.0.smithi111.stdout:8/361: stat d11/d21/d38/f52 0 2024-09-11T00:07:11.785 INFO:tasks.workunit.client.1.smithi203.stdout:5/371: fdatasync dc/dd/d4d/f6a 0 2024-09-11T00:07:11.788 INFO:tasks.workunit.client.1.smithi203.stdout:8/326: dread d1/d13/d17/f31 [0,4194304] 0 2024-09-11T00:07:11.789 INFO:tasks.workunit.client.0.smithi111.stdout:3/348: getdents d1c/d1d/d22/d31/d33/d5f 0 2024-09-11T00:07:11.790 INFO:tasks.workunit.client.0.smithi111.stdout:5/331: dwrite d10/f27 [0,4194304] 0 2024-09-11T00:07:11.797 INFO:tasks.workunit.client.0.smithi111.stdout:0/328: rename d3/d13/d38 to d3/d26/d77 0 2024-09-11T00:07:11.798 INFO:tasks.workunit.client.1.smithi203.stdout:4/302: creat db/f57 x:0 0 0 2024-09-11T00:07:11.798 INFO:tasks.workunit.client.0.smithi111.stdout:0/329: chown d3/d13/d1e/d29/d5c 2823 1 2024-09-11T00:07:11.800 INFO:tasks.workunit.client.0.smithi111.stdout:1/280: getdents d2/de/d12/d39/d3a 0 2024-09-11T00:07:11.801 INFO:tasks.workunit.client.0.smithi111.stdout:4/279: write f5 [149422,12627] 0 2024-09-11T00:07:11.802 INFO:tasks.workunit.client.1.smithi203.stdout:3/450: dwrite d8/da/d37/d83/d65/f7c [0,4194304] 0 2024-09-11T00:07:11.807 INFO:tasks.workunit.client.1.smithi203.stdout:5/372: creat dc/dd/d56/f74 x:0 0 0 2024-09-11T00:07:11.807 INFO:tasks.workunit.client.0.smithi111.stdout:2/305: mknod d0/d3/de/d4b/c6f 0 2024-09-11T00:07:11.808 INFO:tasks.workunit.client.0.smithi111.stdout:5/332: dread d10/d1e/d23/d30/d46/f5b [0,4194304] 0 2024-09-11T00:07:11.809 INFO:tasks.workunit.client.0.smithi111.stdout:1/281: read d2/de/d12/d39/f3d [1406856,58513] 0 2024-09-11T00:07:11.809 INFO:tasks.workunit.client.1.smithi203.stdout:5/373: stat dc/c1c 0 2024-09-11T00:07:11.809 INFO:tasks.workunit.client.1.smithi203.stdout:7/308: creat dd/d3b/f72 x:0 0 0 2024-09-11T00:07:11.810 INFO:tasks.workunit.client.1.smithi203.stdout:8/327: mknod d1/d13/d43/d46/c72 0 2024-09-11T00:07:11.814 INFO:tasks.workunit.client.1.smithi203.stdout:0/336: rmdir d0/d2/d60 0 2024-09-11T00:07:11.815 INFO:tasks.workunit.client.0.smithi111.stdout:8/362: dwrite d11/d23/d3d/d5f/f62 [0,4194304] 0 2024-09-11T00:07:11.816 INFO:tasks.workunit.client.1.smithi203.stdout:5/374: truncate dc/dd/d13/f5d 671999 0 2024-09-11T00:07:11.816 INFO:tasks.workunit.client.0.smithi111.stdout:6/242: sync 2024-09-11T00:07:11.819 INFO:tasks.workunit.client.0.smithi111.stdout:0/330: symlink d3/dc/l78 0 2024-09-11T00:07:11.821 INFO:tasks.workunit.client.1.smithi203.stdout:6/280: creat d0/f4f x:0 0 0 2024-09-11T00:07:11.824 INFO:tasks.workunit.client.1.smithi203.stdout:3/451: creat d8/da/d34/fa7 x:0 0 0 2024-09-11T00:07:11.825 INFO:tasks.workunit.client.1.smithi203.stdout:2/265: dwrite d13/d15/f1a [0,4194304] 0 2024-09-11T00:07:11.825 INFO:tasks.workunit.client.1.smithi203.stdout:3/452: chown d8/da/f97 248095746 1 2024-09-11T00:07:11.826 INFO:tasks.workunit.client.1.smithi203.stdout:2/266: chown d13/l34 82408 1 2024-09-11T00:07:11.831 INFO:tasks.workunit.client.0.smithi111.stdout:3/349: creat d1c/d1d/d22/d31/d62/f78 x:0 0 0 2024-09-11T00:07:11.833 INFO:tasks.workunit.client.1.smithi203.stdout:4/303: unlink db/dd/d16/l17 0 2024-09-11T00:07:11.837 INFO:tasks.workunit.client.0.smithi111.stdout:5/333: mknod d10/d1e/d23/d2b/d2f/c70 0 2024-09-11T00:07:11.837 INFO:tasks.workunit.client.0.smithi111.stdout:1/282: mknod d2/de/d12/d34/c5c 0 2024-09-11T00:07:11.837 INFO:tasks.workunit.client.1.smithi203.stdout:6/281: write d0/d27/d35/d38/f49 [779503,120360] 0 2024-09-11T00:07:11.839 INFO:tasks.workunit.client.1.smithi203.stdout:6/282: chown d0/d27/f18 1 1 2024-09-11T00:07:11.840 INFO:tasks.workunit.client.1.smithi203.stdout:2/267: symlink d13/l51 0 2024-09-11T00:07:11.840 INFO:tasks.workunit.client.0.smithi111.stdout:6/243: fsync f6 0 2024-09-11T00:07:11.840 INFO:tasks.workunit.client.0.smithi111.stdout:2/306: dwrite d0/d3/d2e/f47 [0,4194304] 0 2024-09-11T00:07:11.841 INFO:tasks.workunit.client.1.smithi203.stdout:0/337: link d0/f5 d0/d1d/d4c/f6d 0 2024-09-11T00:07:11.842 INFO:tasks.workunit.client.1.smithi203.stdout:2/268: read - d13/d15/f48 zero size 2024-09-11T00:07:11.844 INFO:tasks.workunit.client.0.smithi111.stdout:7/308: getdents dd/d49 0 2024-09-11T00:07:11.845 INFO:tasks.workunit.client.1.smithi203.stdout:2/269: write d13/d15/f1a [950330,102031] 0 2024-09-11T00:07:11.847 INFO:tasks.workunit.client.1.smithi203.stdout:4/304: rename db/dd/d16/d38/f50 to db/dd/d26/d42/f58 0 2024-09-11T00:07:11.848 INFO:tasks.workunit.client.1.smithi203.stdout:2/270: stat d13/d15/d19/d1c/c4d 0 2024-09-11T00:07:11.849 INFO:tasks.workunit.client.1.smithi203.stdout:2/271: fdatasync d13/d22/f3f 0 2024-09-11T00:07:11.850 INFO:tasks.workunit.client.1.smithi203.stdout:4/305: dread - db/d12/f1e zero size 2024-09-11T00:07:11.850 INFO:tasks.workunit.client.1.smithi203.stdout:0/338: creat d0/d2/d3d/d5a/f6e x:0 0 0 2024-09-11T00:07:11.853 INFO:tasks.workunit.client.1.smithi203.stdout:3/453: link d8/da/d34/f4d d8/d3c/fa8 0 2024-09-11T00:07:11.856 INFO:tasks.workunit.client.0.smithi111.stdout:2/307: dread d0/d3/de/f51 [0,4194304] 0 2024-09-11T00:07:11.857 INFO:tasks.workunit.client.0.smithi111.stdout:5/334: rmdir d10/d1e/d23/d30 39 2024-09-11T00:07:11.857 INFO:tasks.workunit.client.0.smithi111.stdout:4/280: dread d18/f32 [0,4194304] 0 2024-09-11T00:07:11.858 INFO:tasks.workunit.client.1.smithi203.stdout:7/309: rmdir dd/d3b 39 2024-09-11T00:07:11.858 INFO:tasks.workunit.client.0.smithi111.stdout:4/281: write f7 [4834246,79237] 0 2024-09-11T00:07:11.860 INFO:tasks.workunit.client.1.smithi203.stdout:3/454: truncate d8/d3c/fa8 3821966 0 2024-09-11T00:07:11.861 INFO:tasks.workunit.client.0.smithi111.stdout:8/363: dread d11/f1b [0,4194304] 0 2024-09-11T00:07:11.865 INFO:tasks.workunit.client.0.smithi111.stdout:8/364: truncate d11/d23/d3d/d5f/f6a 1031713 0 2024-09-11T00:07:11.866 INFO:tasks.workunit.client.1.smithi203.stdout:6/283: mknod d0/c50 0 2024-09-11T00:07:11.868 INFO:tasks.workunit.client.1.smithi203.stdout:0/339: unlink d0/f23 0 2024-09-11T00:07:11.874 INFO:tasks.workunit.client.0.smithi111.stdout:6/244: creat d7/d22/d2c/d38/f4c x:0 0 0 2024-09-11T00:07:11.875 INFO:tasks.workunit.client.1.smithi203.stdout:8/328: truncate d1/d13/f33 267690 0 2024-09-11T00:07:11.875 INFO:tasks.workunit.client.0.smithi111.stdout:7/309: creat dd/d1d/d2d/d2e/d4e/f64 x:0 0 0 2024-09-11T00:07:11.876 INFO:tasks.workunit.client.1.smithi203.stdout:2/272: truncate d13/d15/d19/d1c/f2d 4945323 0 2024-09-11T00:07:11.878 INFO:tasks.workunit.client.0.smithi111.stdout:4/282: dwrite d18/d20/f34 [0,4194304] 0 2024-09-11T00:07:11.883 INFO:tasks.workunit.client.1.smithi203.stdout:7/310: chown dd/l44 25172 1 2024-09-11T00:07:11.885 INFO:tasks.workunit.client.1.smithi203.stdout:4/306: dwrite db/dd/d16/d38/f3b [0,4194304] 0 2024-09-11T00:07:11.886 INFO:tasks.workunit.client.0.smithi111.stdout:2/308: symlink d0/d3/d12/d38/l70 0 2024-09-11T00:07:11.887 INFO:tasks.workunit.client.0.smithi111.stdout:0/331: dwrite d3/d13/d1e/d29/f2d [0,4194304] 0 2024-09-11T00:07:11.889 INFO:tasks.workunit.client.1.smithi203.stdout:5/375: dwrite dc/dd/f32 [0,4194304] 0 2024-09-11T00:07:11.891 INFO:tasks.workunit.client.0.smithi111.stdout:2/309: dread - d0/d3/de/f5d zero size 2024-09-11T00:07:11.892 INFO:tasks.workunit.client.1.smithi203.stdout:4/307: write db/f57 [994145,11710] 0 2024-09-11T00:07:11.899 INFO:tasks.workunit.client.0.smithi111.stdout:8/365: creat d11/d21/d6f/f79 x:0 0 0 2024-09-11T00:07:11.901 INFO:tasks.workunit.client.1.smithi203.stdout:8/329: mknod d1/d13/d43/d46/c73 0 2024-09-11T00:07:11.908 INFO:tasks.workunit.client.1.smithi203.stdout:5/376: symlink dc/dd/d4d/d59/l75 0 2024-09-11T00:07:11.909 INFO:tasks.workunit.client.0.smithi111.stdout:7/310: creat dd/d1d/d1f/f65 x:0 0 0 2024-09-11T00:07:11.910 INFO:tasks.workunit.client.0.smithi111.stdout:6/245: fsync d7/d22/d2c/d38/f4c 0 2024-09-11T00:07:11.911 INFO:tasks.workunit.client.1.smithi203.stdout:4/308: symlink db/dd/d16/d38/d3c/d41/l59 0 2024-09-11T00:07:11.911 INFO:tasks.workunit.client.0.smithi111.stdout:9/348: getdents d6/db/d1b/d41 0 2024-09-11T00:07:11.911 INFO:tasks.workunit.client.0.smithi111.stdout:0/332: symlink d3/d1c/l79 0 2024-09-11T00:07:11.912 INFO:tasks.workunit.client.1.smithi203.stdout:6/284: creat d0/d27/d35/d39/f51 x:0 0 0 2024-09-11T00:07:11.912 INFO:tasks.workunit.client.1.smithi203.stdout:4/309: stat db/dd 0 2024-09-11T00:07:11.914 INFO:tasks.workunit.client.0.smithi111.stdout:2/310: unlink d0/d3/de/l19 0 2024-09-11T00:07:11.915 INFO:tasks.workunit.client.0.smithi111.stdout:0/333: write d3/d13/f6f [1234876,43177] 0 2024-09-11T00:07:11.917 INFO:tasks.workunit.client.0.smithi111.stdout:1/283: truncate d2/d2b/d2c/f47 518296 0 2024-09-11T00:07:11.919 INFO:tasks.workunit.client.1.smithi203.stdout:0/340: creat d0/d1d/d4c/f6f x:0 0 0 2024-09-11T00:07:11.920 INFO:tasks.workunit.client.1.smithi203.stdout:2/273: mknod d13/d47/c52 0 2024-09-11T00:07:11.925 INFO:tasks.workunit.client.0.smithi111.stdout:6/246: mkdir d7/d4d 0 2024-09-11T00:07:11.925 INFO:tasks.workunit.client.0.smithi111.stdout:8/366: dwrite d11/d23/d2c/f45 [4194304,4194304] 0 2024-09-11T00:07:11.926 INFO:tasks.workunit.client.0.smithi111.stdout:6/247: read d7/d2b/d35/f3a [1640527,87314] 0 2024-09-11T00:07:11.929 INFO:tasks.workunit.client.0.smithi111.stdout:7/311: dread f8 [0,4194304] 0 2024-09-11T00:07:11.929 INFO:tasks.workunit.client.0.smithi111.stdout:1/284: creat d2/d2b/d2c/d56/f5d x:0 0 0 2024-09-11T00:07:11.931 INFO:tasks.workunit.client.0.smithi111.stdout:7/312: write dd/d1d/d2d/d2e/f40 [1668641,33959] 0 2024-09-11T00:07:11.933 INFO:tasks.workunit.client.0.smithi111.stdout:7/313: stat dd/d1d/d4b/f5c 0 2024-09-11T00:07:11.934 INFO:tasks.workunit.client.0.smithi111.stdout:7/314: fdatasync dd/d1d/d1f/f5e 0 2024-09-11T00:07:11.937 INFO:tasks.workunit.client.1.smithi203.stdout:5/377: mkdir dc/d4f/d5c/d76 0 2024-09-11T00:07:11.938 INFO:tasks.workunit.client.1.smithi203.stdout:6/285: stat d0/l20 0 2024-09-11T00:07:11.939 INFO:tasks.workunit.client.0.smithi111.stdout:9/349: symlink d6/db/d1b/d56/l70 0 2024-09-11T00:07:11.941 INFO:tasks.workunit.client.1.smithi203.stdout:6/286: write d0/d32/f46 [165272,81729] 0 2024-09-11T00:07:11.942 INFO:tasks.workunit.client.0.smithi111.stdout:4/283: truncate f5 1269394 0 2024-09-11T00:07:11.942 INFO:tasks.workunit.client.0.smithi111.stdout:9/350: readlink d6/db/d34/d37/l15 0 2024-09-11T00:07:11.942 INFO:tasks.workunit.client.1.smithi203.stdout:4/310: creat db/dd/d16/d38/d3c/d41/f5a x:0 0 0 2024-09-11T00:07:11.945 INFO:tasks.workunit.client.1.smithi203.stdout:2/274: mkdir d13/d22/d53 0 2024-09-11T00:07:11.946 INFO:tasks.workunit.client.0.smithi111.stdout:8/367: symlink d11/d21/d38/d54/l7a 0 2024-09-11T00:07:11.946 INFO:tasks.workunit.client.0.smithi111.stdout:6/248: dwrite d7/d2b/d35/f3a [0,4194304] 0 2024-09-11T00:07:11.947 INFO:tasks.workunit.client.0.smithi111.stdout:8/368: stat d11/f1d 0 2024-09-11T00:07:11.948 INFO:tasks.workunit.client.1.smithi203.stdout:2/275: dread - d13/d15/d19/d1c/f44 zero size 2024-09-11T00:07:11.948 INFO:tasks.workunit.client.1.smithi203.stdout:0/341: write d0/d1d/f2e [4505641,129072] 0 2024-09-11T00:07:11.949 INFO:tasks.workunit.client.0.smithi111.stdout:2/311: creat d0/d3/de/d3b/d62/d6d/f71 x:0 0 0 2024-09-11T00:07:11.950 INFO:tasks.workunit.client.1.smithi203.stdout:2/276: readlink d13/l51 0 2024-09-11T00:07:11.952 INFO:tasks.workunit.client.1.smithi203.stdout:7/311: rename dd/d3b/d5b/d6a/d31/f6d to dd/d4d/f73 0 2024-09-11T00:07:11.954 INFO:tasks.workunit.client.1.smithi203.stdout:7/312: chown dd/l44 7528 1 2024-09-11T00:07:11.954 INFO:tasks.workunit.client.1.smithi203.stdout:5/378: creat dc/d4f/d5c/f77 x:0 0 0 2024-09-11T00:07:11.957 INFO:tasks.workunit.client.1.smithi203.stdout:6/287: mknod d0/d27/c52 0 2024-09-11T00:07:11.961 INFO:tasks.workunit.client.0.smithi111.stdout:4/284: unlink f9 0 2024-09-11T00:07:11.962 INFO:tasks.workunit.client.0.smithi111.stdout:4/285: stat d18/d1f/d33/l35 0 2024-09-11T00:07:11.963 INFO:tasks.workunit.client.1.smithi203.stdout:3/455: getdents d8/d2a 0 2024-09-11T00:07:11.966 INFO:tasks.workunit.client.1.smithi203.stdout:3/456: write d8/d17/f7e [1736618,117743] 0 2024-09-11T00:07:11.969 INFO:tasks.workunit.client.1.smithi203.stdout:3/457: write d8/f16 [7433183,15389] 0 2024-09-11T00:07:11.970 INFO:tasks.workunit.client.1.smithi203.stdout:0/342: chown d0/d2/d37/f38 18 1 2024-09-11T00:07:11.975 INFO:tasks.workunit.client.1.smithi203.stdout:0/343: write d0/d1d/f3f [997270,56699] 0 2024-09-11T00:07:11.975 INFO:tasks.workunit.client.1.smithi203.stdout:2/277: fsync f8 0 2024-09-11T00:07:11.978 INFO:tasks.workunit.client.0.smithi111.stdout:8/369: creat d11/d21/d6f/f7b x:0 0 0 2024-09-11T00:07:11.980 INFO:tasks.workunit.client.0.smithi111.stdout:8/370: write d11/d23/d2c/d46/f69 [1141582,30729] 0 2024-09-11T00:07:11.982 INFO:tasks.workunit.client.0.smithi111.stdout:3/350: sync 2024-09-11T00:07:11.984 INFO:tasks.workunit.client.1.smithi203.stdout:4/311: mknod db/c5b 0 2024-09-11T00:07:11.987 INFO:tasks.workunit.client.0.smithi111.stdout:7/315: unlink dd/d1d/d1f/f45 0 2024-09-11T00:07:11.987 INFO:tasks.workunit.client.0.smithi111.stdout:8/371: truncate d11/d21/d38/f41 296100 0 2024-09-11T00:07:11.988 INFO:tasks.workunit.client.0.smithi111.stdout:8/372: dread - d11/f6d zero size 2024-09-11T00:07:11.989 INFO:tasks.workunit.client.0.smithi111.stdout:0/334: truncate d3/d26/d77/f45 3076994 0 2024-09-11T00:07:11.990 INFO:tasks.workunit.client.0.smithi111.stdout:8/373: chown d11/d23/d2c/d46/f4d 3534705 1 2024-09-11T00:07:11.993 INFO:tasks.workunit.client.0.smithi111.stdout:6/249: rename f0 to d7/d22/d2c/f4e 0 2024-09-11T00:07:11.995 INFO:tasks.workunit.client.1.smithi203.stdout:8/330: getdents d1/d13/d17/d2f/d52/d59 0 2024-09-11T00:07:11.998 INFO:tasks.workunit.client.0.smithi111.stdout:1/285: creat d2/de/f5e x:0 0 0 2024-09-11T00:07:12.003 INFO:tasks.workunit.client.1.smithi203.stdout:6/288: symlink d0/d27/d35/l53 0 2024-09-11T00:07:12.003 INFO:tasks.workunit.client.1.smithi203.stdout:0/344: dread d0/d1d/f3c [0,4194304] 0 2024-09-11T00:07:12.005 INFO:tasks.workunit.client.1.smithi203.stdout:2/278: creat d13/d47/f54 x:0 0 0 2024-09-11T00:07:12.007 INFO:tasks.workunit.client.1.smithi203.stdout:2/279: readlink d13/d15/d30/l3a 0 2024-09-11T00:07:12.008 INFO:tasks.workunit.client.1.smithi203.stdout:4/312: chown db/c35 222264 1 2024-09-11T00:07:12.012 INFO:tasks.workunit.client.1.smithi203.stdout:5/379: creat dc/d4f/d5c/d76/f78 x:0 0 0 2024-09-11T00:07:12.012 INFO:tasks.workunit.client.1.smithi203.stdout:2/280: fdatasync d13/d15/d19/d1c/f27 0 2024-09-11T00:07:12.012 INFO:tasks.workunit.client.1.smithi203.stdout:8/331: mknod d1/d13/d17/d48/c74 0 2024-09-11T00:07:12.013 INFO:tasks.workunit.client.1.smithi203.stdout:3/458: symlink d8/da/d37/d53/da2/la9 0 2024-09-11T00:07:12.016 INFO:tasks.workunit.client.1.smithi203.stdout:6/289: unlink d0/d27/f19 0 2024-09-11T00:07:12.019 INFO:tasks.workunit.client.1.smithi203.stdout:6/290: write d0/d27/d35/d39/d3c/f4c [1032311,75558] 0 2024-09-11T00:07:12.021 INFO:tasks.workunit.client.1.smithi203.stdout:0/345: rename d0/d2/d3d/d6a to d0/d1d/d5d/d70 0 2024-09-11T00:07:12.023 INFO:tasks.workunit.client.0.smithi111.stdout:9/351: creat d6/db/d34/f71 x:0 0 0 2024-09-11T00:07:12.026 INFO:tasks.workunit.client.1.smithi203.stdout:5/380: mknod dc/d4f/c79 0 2024-09-11T00:07:12.026 INFO:tasks.workunit.client.0.smithi111.stdout:9/352: truncate d6/db/d34/f66 588278 0 2024-09-11T00:07:12.029 INFO:tasks.workunit.client.1.smithi203.stdout:3/459: mknod d8/d3c/caa 0 2024-09-11T00:07:12.030 INFO:tasks.workunit.client.0.smithi111.stdout:4/286: truncate d18/d1f/d33/f59 579078 0 2024-09-11T00:07:12.030 INFO:tasks.workunit.client.1.smithi203.stdout:7/313: link dd/d3b/d5b/d6a/d31/l38 dd/l74 0 2024-09-11T00:07:12.032 INFO:tasks.workunit.client.0.smithi111.stdout:4/287: write d18/d20/f34 [2068349,85021] 0 2024-09-11T00:07:12.035 INFO:tasks.workunit.client.0.smithi111.stdout:6/250: mknod d7/d22/d2c/d38/c4f 0 2024-09-11T00:07:12.038 INFO:tasks.workunit.client.0.smithi111.stdout:1/286: creat d2/d2b/d2c/f5f x:0 0 0 2024-09-11T00:07:12.038 INFO:tasks.workunit.client.1.smithi203.stdout:6/291: truncate d0/f8 5109496 0 2024-09-11T00:07:12.041 INFO:tasks.workunit.client.1.smithi203.stdout:4/313: rename db/d12/d15/c48 to db/dd/d16/c5c 0 2024-09-11T00:07:12.041 INFO:tasks.workunit.client.0.smithi111.stdout:1/287: write d2/de/f25 [2584023,79553] 0 2024-09-11T00:07:12.042 INFO:tasks.workunit.client.0.smithi111.stdout:9/353: dread d6/db/f43 [0,4194304] 0 2024-09-11T00:07:12.043 INFO:tasks.workunit.client.1.smithi203.stdout:4/314: chown db/dd/d26/f2f 1 1 2024-09-11T00:07:12.045 INFO:tasks.workunit.client.0.smithi111.stdout:3/351: dwrite d1c/d1d/d22/d31/d33/f3f [0,4194304] 0 2024-09-11T00:07:12.048 INFO:tasks.workunit.client.1.smithi203.stdout:0/346: creat d0/d1d/d5d/f71 x:0 0 0 2024-09-11T00:07:12.051 INFO:tasks.workunit.client.1.smithi203.stdout:9/316: sync 2024-09-11T00:07:12.054 INFO:tasks.workunit.client.1.smithi203.stdout:5/381: mkdir dc/dd/d15/d3b/d7a 0 2024-09-11T00:07:12.054 INFO:tasks.workunit.client.1.smithi203.stdout:8/332: dread d1/f3b [0,4194304] 0 2024-09-11T00:07:12.056 INFO:tasks.workunit.client.1.smithi203.stdout:3/460: rmdir d8/da/d11 39 2024-09-11T00:07:12.057 INFO:tasks.workunit.client.1.smithi203.stdout:5/382: chown dc/d4f/c79 4 1 2024-09-11T00:07:12.065 INFO:tasks.workunit.client.0.smithi111.stdout:4/288: symlink d18/d20/d4e/l5d 0 2024-09-11T00:07:12.065 INFO:tasks.workunit.client.1.smithi203.stdout:5/383: dread dc/dd/d13/f14 [0,4194304] 0 2024-09-11T00:07:12.066 INFO:tasks.workunit.client.0.smithi111.stdout:6/251: chown d7/d22/d2c/l36 974456 1 2024-09-11T00:07:12.066 INFO:tasks.workunit.client.0.smithi111.stdout:4/289: fdatasync d18/d1f/f25 0 2024-09-11T00:07:12.067 INFO:tasks.workunit.client.0.smithi111.stdout:4/290: fdatasync f15 0 2024-09-11T00:07:12.069 INFO:tasks.workunit.client.1.smithi203.stdout:4/315: mknod db/dd/d26/d42/c5d 0 2024-09-11T00:07:12.069 INFO:tasks.workunit.client.1.smithi203.stdout:5/384: chown dc/dd/d13/f14 69175690 1 2024-09-11T00:07:12.074 INFO:tasks.workunit.client.1.smithi203.stdout:2/281: link d13/d15/f29 d13/d15/f55 0 2024-09-11T00:07:12.076 INFO:tasks.workunit.client.0.smithi111.stdout:3/352: write d1c/d21/f3b [3291766,42628] 0 2024-09-11T00:07:12.077 INFO:tasks.workunit.client.1.smithi203.stdout:8/333: dwrite d1/f37 [0,4194304] 0 2024-09-11T00:07:12.078 INFO:tasks.workunit.client.0.smithi111.stdout:3/353: dread - d1c/d1d/d22/d23/d2f/f67 zero size 2024-09-11T00:07:12.080 INFO:tasks.workunit.client.1.smithi203.stdout:9/317: fsync d6/de/d19/f4c 0 2024-09-11T00:07:12.080 INFO:tasks.workunit.client.0.smithi111.stdout:0/335: creat d3/f7a x:0 0 0 2024-09-11T00:07:12.090 INFO:tasks.workunit.client.1.smithi203.stdout:4/316: dwrite db/f57 [0,4194304] 0 2024-09-11T00:07:12.092 INFO:tasks.workunit.client.1.smithi203.stdout:4/317: readlink db/l1f 0 2024-09-11T00:07:12.093 INFO:tasks.workunit.client.0.smithi111.stdout:8/374: rename d11/d23/d2c/d46/c48 to d11/d21/c7c 0 2024-09-11T00:07:12.093 INFO:tasks.workunit.client.0.smithi111.stdout:7/316: write dd/d48/f61 [761073,69814] 0 2024-09-11T00:07:12.095 INFO:tasks.workunit.client.0.smithi111.stdout:8/375: stat d11/d23/f4e 0 2024-09-11T00:07:12.096 INFO:tasks.workunit.client.0.smithi111.stdout:7/317: fsync dd/d1d/d1f/f65 0 2024-09-11T00:07:12.097 INFO:tasks.workunit.client.0.smithi111.stdout:6/252: unlink d7/d22/c43 0 2024-09-11T00:07:12.097 INFO:tasks.workunit.client.0.smithi111.stdout:7/318: stat dd/f3a 0 2024-09-11T00:07:12.098 INFO:tasks.workunit.client.1.smithi203.stdout:6/292: mkdir d0/d54 0 2024-09-11T00:07:12.100 INFO:tasks.workunit.client.0.smithi111.stdout:4/291: mkdir d18/d20/d3c/d5e 0 2024-09-11T00:07:12.105 INFO:tasks.workunit.client.1.smithi203.stdout:7/314: write fc [856844,41527] 0 2024-09-11T00:07:12.114 INFO:tasks.workunit.client.1.smithi203.stdout:0/347: truncate d0/d2/d37/f3e 377710 0 2024-09-11T00:07:12.114 INFO:tasks.workunit.client.0.smithi111.stdout:3/354: unlink c18 0 2024-09-11T00:07:12.115 INFO:tasks.workunit.client.0.smithi111.stdout:3/355: dread - d1c/d1d/d22/d23/f52 zero size 2024-09-11T00:07:12.115 INFO:tasks.workunit.client.0.smithi111.stdout:0/336: fdatasync d3/d13/d1e/d29/f4e 0 2024-09-11T00:07:12.116 INFO:tasks.workunit.client.1.smithi203.stdout:4/318: mkdir db/dd/d26/d42/d5e 0 2024-09-11T00:07:12.119 INFO:tasks.workunit.client.1.smithi203.stdout:6/293: mknod d0/d32/c55 0 2024-09-11T00:07:12.122 INFO:tasks.workunit.client.0.smithi111.stdout:8/376: write d11/d23/f4e [903877,76734] 0 2024-09-11T00:07:12.124 INFO:tasks.workunit.client.1.smithi203.stdout:0/348: dread d0/d1d/d4c/f6d [0,4194304] 0 2024-09-11T00:07:12.125 INFO:tasks.workunit.client.0.smithi111.stdout:6/253: mknod d7/d22/d1d/c50 0 2024-09-11T00:07:12.125 INFO:tasks.workunit.client.1.smithi203.stdout:0/349: stat d0/f34 0 2024-09-11T00:07:12.127 INFO:tasks.workunit.client.0.smithi111.stdout:7/319: creat dd/d1d/f66 x:0 0 0 2024-09-11T00:07:12.127 INFO:tasks.workunit.client.0.smithi111.stdout:6/254: dread - d7/d22/d2c/f37 zero size 2024-09-11T00:07:12.129 INFO:tasks.workunit.client.0.smithi111.stdout:5/335: sync 2024-09-11T00:07:12.129 INFO:tasks.workunit.client.1.smithi203.stdout:0/350: truncate d0/d2/d37/f38 4837423 0 2024-09-11T00:07:12.131 INFO:tasks.workunit.client.0.smithi111.stdout:5/336: write d10/f16 [482289,64583] 0 2024-09-11T00:07:12.131 INFO:tasks.workunit.client.1.smithi203.stdout:0/351: fsync d0/d2/d37/d5b/f5e 0 2024-09-11T00:07:12.132 INFO:tasks.workunit.client.0.smithi111.stdout:3/356: creat d1c/d1d/d22/d31/f79 x:0 0 0 2024-09-11T00:07:12.134 INFO:tasks.workunit.client.1.smithi203.stdout:0/352: write d0/d2/f3 [3043400,14337] 0 2024-09-11T00:07:12.135 INFO:tasks.workunit.client.1.smithi203.stdout:4/319: creat db/dd/d16/d38/f5f x:0 0 0 2024-09-11T00:07:12.141 INFO:tasks.workunit.client.0.smithi111.stdout:9/354: rename d6/db/d1b/f5c to d6/db/d1b/d56/f72 0 2024-09-11T00:07:12.149 INFO:tasks.workunit.client.1.smithi203.stdout:5/385: dwrite dc/dd/d4d/d59/f46 [0,4194304] 0 2024-09-11T00:07:12.150 INFO:tasks.workunit.client.0.smithi111.stdout:8/377: dread d11/f1d [0,4194304] 0 2024-09-11T00:07:12.157 INFO:tasks.workunit.client.1.smithi203.stdout:0/353: rename d0/c11 to d0/d2/d3d/c72 0 2024-09-11T00:07:12.159 INFO:tasks.workunit.client.1.smithi203.stdout:4/320: rename db/dd/d26/f4d to db/dd/d26/f60 0 2024-09-11T00:07:12.162 INFO:tasks.workunit.client.1.smithi203.stdout:9/318: truncate d6/de/d19/d24/d40/d45/f39 5004720 0 2024-09-11T00:07:12.165 INFO:tasks.workunit.client.0.smithi111.stdout:3/357: fdatasync d1c/d1d/d22/d23/f28 0 2024-09-11T00:07:12.170 INFO:tasks.workunit.client.0.smithi111.stdout:5/337: dread d10/f1b [0,4194304] 0 2024-09-11T00:07:12.172 INFO:tasks.workunit.client.0.smithi111.stdout:4/292: dwrite d18/d1f/f26 [0,4194304] 0 2024-09-11T00:07:12.172 INFO:tasks.workunit.client.0.smithi111.stdout:7/320: rename dd/l29 to dd/d48/l67 0 2024-09-11T00:07:12.173 INFO:tasks.workunit.client.0.smithi111.stdout:5/338: write d10/d1e/f28 [14748,14076] 0 2024-09-11T00:07:12.174 INFO:tasks.workunit.client.1.smithi203.stdout:4/321: symlink db/dd/d26/d42/l61 0 2024-09-11T00:07:12.175 INFO:tasks.workunit.client.0.smithi111.stdout:7/321: readlink dd/d1d/d1f/d24/l5d 0 2024-09-11T00:07:12.178 INFO:tasks.workunit.client.1.smithi203.stdout:7/315: dwrite dd/f14 [0,4194304] 0 2024-09-11T00:07:12.182 INFO:tasks.workunit.client.0.smithi111.stdout:2/312: sync 2024-09-11T00:07:12.183 INFO:tasks.workunit.client.0.smithi111.stdout:8/378: symlink d11/d21/d38/d54/l7d 0 2024-09-11T00:07:12.185 INFO:tasks.workunit.client.0.smithi111.stdout:2/313: write d0/d3/de/d50/f59 [2890711,54166] 0 2024-09-11T00:07:12.189 INFO:tasks.workunit.client.1.smithi203.stdout:5/386: mkdir dc/dd/d1e/d7b 0 2024-09-11T00:07:12.192 INFO:tasks.workunit.client.1.smithi203.stdout:6/294: link d0/d27/d35/f3f d0/d27/d35/d39/f56 0 2024-09-11T00:07:12.200 INFO:tasks.workunit.client.1.smithi203.stdout:5/387: mknod dc/dd/d56/c7c 0 2024-09-11T00:07:12.202 INFO:tasks.workunit.client.1.smithi203.stdout:6/295: rename d0/d27/d35/d38/c37 to d0/d27/c57 0 2024-09-11T00:07:12.206 INFO:tasks.workunit.client.1.smithi203.stdout:7/316: dread dd/d1c/f46 [0,4194304] 0 2024-09-11T00:07:12.207 INFO:tasks.workunit.client.0.smithi111.stdout:7/322: rename dd/d1d/d1f/d24/d62 to dd/d1d/d2d/d68 0 2024-09-11T00:07:12.209 INFO:tasks.workunit.client.0.smithi111.stdout:0/337: dwrite d3/d13/d1e/d29/d49/d51/d61/f6b [0,4194304] 0 2024-09-11T00:07:12.210 INFO:tasks.workunit.client.0.smithi111.stdout:6/255: link d7/c19 d7/d22/d2c/d38/c51 0 2024-09-11T00:07:12.211 INFO:tasks.workunit.client.0.smithi111.stdout:7/323: readlink dd/d1d/d2d/d2e/l56 0 2024-09-11T00:07:12.212 INFO:tasks.workunit.client.0.smithi111.stdout:6/256: fdatasync d7/fd 0 2024-09-11T00:07:12.212 INFO:tasks.workunit.client.0.smithi111.stdout:2/314: dwrite d0/d3/f56 [0,4194304] 0 2024-09-11T00:07:12.213 INFO:tasks.workunit.client.1.smithi203.stdout:9/319: dread d6/de/f20 [0,4194304] 0 2024-09-11T00:07:12.214 INFO:tasks.workunit.client.1.smithi203.stdout:7/317: creat dd/d1c/d4b/f75 x:0 0 0 2024-09-11T00:07:12.215 INFO:tasks.workunit.client.1.smithi203.stdout:0/354: truncate d0/d2/d37/f47 1272674 0 2024-09-11T00:07:12.219 INFO:tasks.workunit.client.0.smithi111.stdout:9/355: dwrite d6/dc/f17 [0,4194304] 0 2024-09-11T00:07:12.220 INFO:tasks.workunit.client.1.smithi203.stdout:6/296: rename d0/f25 to d0/d32/f58 0 2024-09-11T00:07:12.223 INFO:tasks.workunit.client.0.smithi111.stdout:8/379: truncate d11/d23/d2c/f3b 1413817 0 2024-09-11T00:07:12.224 INFO:tasks.workunit.client.0.smithi111.stdout:3/358: unlink f8 0 2024-09-11T00:07:12.226 INFO:tasks.workunit.client.0.smithi111.stdout:5/339: write d10/d1e/d23/d30/d59/d53/f5e [696038,94714] 0 2024-09-11T00:07:12.227 INFO:tasks.workunit.client.1.smithi203.stdout:5/388: link dc/dd/l52 dc/d2b/l7d 0 2024-09-11T00:07:12.228 INFO:tasks.workunit.client.1.smithi203.stdout:9/320: creat d6/de/d47/f65 x:0 0 0 2024-09-11T00:07:12.233 INFO:tasks.workunit.client.0.smithi111.stdout:0/338: dread d3/d13/d1e/d29/f2d [0,4194304] 0 2024-09-11T00:07:12.235 INFO:tasks.workunit.client.1.smithi203.stdout:0/355: rename d0/d2/d61 to d0/d2/d37/d5b/d73 0 2024-09-11T00:07:12.235 INFO:tasks.workunit.client.1.smithi203.stdout:6/297: symlink d0/d27/d35/d39/d3c/l59 0 2024-09-11T00:07:12.237 INFO:tasks.workunit.client.0.smithi111.stdout:1/288: sync 2024-09-11T00:07:12.238 INFO:tasks.workunit.client.1.smithi203.stdout:0/356: readlink d0/d1d/l2d 0 2024-09-11T00:07:12.238 INFO:tasks.workunit.client.1.smithi203.stdout:4/322: dwrite db/dd/d16/f55 [0,4194304] 0 2024-09-11T00:07:12.240 INFO:tasks.workunit.client.1.smithi203.stdout:9/321: chown c2 1664899 1 2024-09-11T00:07:12.241 INFO:tasks.workunit.client.0.smithi111.stdout:6/257: rmdir d7 39 2024-09-11T00:07:12.241 INFO:tasks.workunit.client.0.smithi111.stdout:7/324: rmdir dd/d1d/d2d 39 2024-09-11T00:07:12.244 INFO:tasks.workunit.client.1.smithi203.stdout:4/323: dread - db/dd/d26/f2f zero size 2024-09-11T00:07:12.247 INFO:tasks.workunit.client.1.smithi203.stdout:5/389: readlink dc/dd/d13/l30 0 2024-09-11T00:07:12.249 INFO:tasks.workunit.client.0.smithi111.stdout:2/315: fdatasync d0/d3/de/f1e 0 2024-09-11T00:07:12.258 INFO:tasks.workunit.client.0.smithi111.stdout:8/380: dwrite d11/d21/d38/f5e [0,4194304] 0 2024-09-11T00:07:12.258 INFO:tasks.workunit.client.0.smithi111.stdout:4/293: creat d18/d1f/f5f x:0 0 0 2024-09-11T00:07:12.258 INFO:tasks.workunit.client.0.smithi111.stdout:0/339: dread d3/d1c/f6a [0,4194304] 0 2024-09-11T00:07:12.258 INFO:tasks.workunit.client.0.smithi111.stdout:2/316: write d0/d3/d2e/f66 [988242,12998] 0 2024-09-11T00:07:12.258 INFO:tasks.workunit.client.0.smithi111.stdout:4/294: fdatasync d18/f1b 0 2024-09-11T00:07:12.260 INFO:tasks.workunit.client.1.smithi203.stdout:6/298: dwrite d0/d27/d35/d38/f49 [0,4194304] 0 2024-09-11T00:07:12.262 INFO:tasks.workunit.client.0.smithi111.stdout:0/340: chown d3/d26/l57 27355 1 2024-09-11T00:07:12.264 INFO:tasks.workunit.client.0.smithi111.stdout:0/341: stat d3/d1c/f4a 0 2024-09-11T00:07:12.264 INFO:tasks.workunit.client.0.smithi111.stdout:5/340: truncate d10/d1e/d23/d30/d46/f5b 919989 0 2024-09-11T00:07:12.267 INFO:tasks.workunit.client.0.smithi111.stdout:1/289: mknod d2/de/d12/d34/c60 0 2024-09-11T00:07:12.267 INFO:tasks.workunit.client.1.smithi203.stdout:9/322: mkdir d6/de/d32/d52/d55/d66 0 2024-09-11T00:07:12.268 INFO:tasks.workunit.client.1.smithi203.stdout:6/299: write d0/f4f [402402,84803] 0 2024-09-11T00:07:12.270 INFO:tasks.workunit.client.1.smithi203.stdout:9/323: chown d6/de/d19/d5b 588 1 2024-09-11T00:07:12.274 INFO:tasks.workunit.client.1.smithi203.stdout:9/324: stat d6/de/d19/f1b 0 2024-09-11T00:07:12.275 INFO:tasks.workunit.client.0.smithi111.stdout:6/258: chown d7/d22/d2c/f37 1213588225 1 2024-09-11T00:07:12.276 INFO:tasks.workunit.client.1.smithi203.stdout:5/390: mknod dc/d2b/c7e 0 2024-09-11T00:07:12.278 INFO:tasks.workunit.client.1.smithi203.stdout:1/423: sync 2024-09-11T00:07:12.280 INFO:tasks.workunit.client.0.smithi111.stdout:2/317: dwrite d0/d3/de/d3b/f58 [0,4194304] 0 2024-09-11T00:07:12.284 INFO:tasks.workunit.client.0.smithi111.stdout:2/318: chown d0/d3/de/d68 97697867 1 2024-09-11T00:07:12.285 INFO:tasks.workunit.client.1.smithi203.stdout:5/391: write dc/dd/d15/f4b [1278942,107619] 0 2024-09-11T00:07:12.288 INFO:tasks.workunit.client.0.smithi111.stdout:4/295: dwrite d18/d20/f34 [0,4194304] 0 2024-09-11T00:07:12.290 INFO:tasks.workunit.client.0.smithi111.stdout:7/325: mkdir dd/d48/d69 0 2024-09-11T00:07:12.293 INFO:tasks.workunit.client.1.smithi203.stdout:4/324: symlink db/dd/d26/d42/d5e/l62 0 2024-09-11T00:07:12.297 INFO:tasks.workunit.client.1.smithi203.stdout:7/318: write dd/f22 [772063,95537] 0 2024-09-11T00:07:12.298 INFO:tasks.workunit.client.1.smithi203.stdout:6/300: mkdir d0/d32/d5a 0 2024-09-11T00:07:12.298 INFO:tasks.workunit.client.1.smithi203.stdout:4/325: fdatasync db/d12/f1e 0 2024-09-11T00:07:12.306 INFO:tasks.workunit.client.1.smithi203.stdout:4/326: write db/dd/d16/f55 [1831087,22769] 0 2024-09-11T00:07:12.312 INFO:tasks.workunit.client.0.smithi111.stdout:9/356: dwrite d6/db/d34/f47 [0,4194304] 0 2024-09-11T00:07:12.313 INFO:tasks.workunit.client.1.smithi203.stdout:0/357: link d0/c4 d0/d2/d67/c74 0 2024-09-11T00:07:12.318 INFO:tasks.workunit.client.0.smithi111.stdout:0/342: mkdir d3/da/d7b 0 2024-09-11T00:07:12.319 INFO:tasks.workunit.client.0.smithi111.stdout:0/343: stat d3/da/f21 0 2024-09-11T00:07:12.324 INFO:tasks.workunit.client.1.smithi203.stdout:6/301: dwrite d0/d32/f3a [0,4194304] 0 2024-09-11T00:07:12.327 INFO:tasks.workunit.client.0.smithi111.stdout:1/290: unlink d2/f2e 0 2024-09-11T00:07:12.330 INFO:tasks.workunit.client.0.smithi111.stdout:5/341: mknod d10/d1e/d23/d30/d59/c71 0 2024-09-11T00:07:12.330 INFO:tasks.workunit.client.0.smithi111.stdout:1/291: chown d2/de/f17 10 1 2024-09-11T00:07:12.333 INFO:tasks.workunit.client.0.smithi111.stdout:1/292: read - d2/de/d12/d39/f46 zero size 2024-09-11T00:07:12.333 INFO:tasks.workunit.client.0.smithi111.stdout:2/319: creat d0/f72 x:0 0 0 2024-09-11T00:07:12.335 INFO:tasks.workunit.client.1.smithi203.stdout:4/327: mknod db/dd/d16/d38/c63 0 2024-09-11T00:07:12.335 INFO:tasks.workunit.client.1.smithi203.stdout:6/302: readlink d0/d27/d35/l53 0 2024-09-11T00:07:12.337 INFO:tasks.workunit.client.0.smithi111.stdout:7/326: fdatasync dd/d1d/d1f/d24/f32 0 2024-09-11T00:07:12.338 INFO:tasks.workunit.client.1.smithi203.stdout:7/319: rename dd/l74 to dd/d3b/d5b/d6a/l76 0 2024-09-11T00:07:12.338 INFO:tasks.workunit.client.1.smithi203.stdout:6/303: fdatasync d0/d27/d35/f3e 0 2024-09-11T00:07:12.339 INFO:tasks.workunit.client.0.smithi111.stdout:8/381: dread d11/f12 [0,4194304] 0 2024-09-11T00:07:12.340 INFO:tasks.workunit.client.1.smithi203.stdout:5/392: creat dc/dd/d13/f7f x:0 0 0 2024-09-11T00:07:12.342 INFO:tasks.workunit.client.1.smithi203.stdout:6/304: chown d0/d27/f3b 5854123 1 2024-09-11T00:07:12.345 INFO:tasks.workunit.client.1.smithi203.stdout:5/393: write dc/dd/d13/f3e [5171960,78014] 0 2024-09-11T00:07:12.345 INFO:tasks.workunit.client.0.smithi111.stdout:0/344: mknod d3/d1c/c7c 0 2024-09-11T00:07:12.346 INFO:tasks.workunit.client.0.smithi111.stdout:0/345: fdatasync d3/f65 0 2024-09-11T00:07:12.351 INFO:tasks.workunit.client.0.smithi111.stdout:5/342: unlink f1 0 2024-09-11T00:07:12.358 INFO:tasks.workunit.client.0.smithi111.stdout:3/359: getdents d1c/d1d/d22/d23 0 2024-09-11T00:07:12.363 INFO:tasks.workunit.client.0.smithi111.stdout:9/357: dread d6/dc/f1f [0,4194304] 0 2024-09-11T00:07:12.371 INFO:tasks.workunit.client.1.smithi203.stdout:9/325: getdents d6/de/d32/d52/d44 0 2024-09-11T00:07:12.373 INFO:tasks.workunit.client.1.smithi203.stdout:0/358: symlink d0/d2/l75 0 2024-09-11T00:07:12.373 INFO:tasks.workunit.client.1.smithi203.stdout:9/326: dread - d6/de/d19/d24/f57 zero size 2024-09-11T00:07:12.375 INFO:tasks.workunit.client.1.smithi203.stdout:4/328: creat db/d12/d15/f64 x:0 0 0 2024-09-11T00:07:12.376 INFO:tasks.workunit.client.0.smithi111.stdout:1/293: write d2/de/f11 [2611208,72751] 0 2024-09-11T00:07:12.379 INFO:tasks.workunit.client.0.smithi111.stdout:4/296: truncate d18/d20/d4a/f2c 3800576 0 2024-09-11T00:07:12.380 INFO:tasks.workunit.client.0.smithi111.stdout:3/360: creat d1c/d1d/d22/d23/d2f/f7a x:0 0 0 2024-09-11T00:07:12.380 INFO:tasks.workunit.client.0.smithi111.stdout:8/382: dwrite d11/d23/f65 [0,4194304] 0 2024-09-11T00:07:12.381 INFO:tasks.workunit.client.1.smithi203.stdout:6/305: rmdir d0/d27/d35/d39 39 2024-09-11T00:07:12.383 INFO:tasks.workunit.client.0.smithi111.stdout:6/259: dwrite f1 [0,4194304] 0 2024-09-11T00:07:12.383 INFO:tasks.workunit.client.1.smithi203.stdout:5/394: unlink dc/dd/d56/f74 0 2024-09-11T00:07:12.384 INFO:tasks.workunit.client.0.smithi111.stdout:0/346: creat d3/d74/f7d x:0 0 0 2024-09-11T00:07:12.386 INFO:tasks.workunit.client.0.smithi111.stdout:2/320: truncate d0/d3/de/d3b/f49 516569 0 2024-09-11T00:07:12.387 INFO:tasks.workunit.client.0.smithi111.stdout:4/297: write f8 [2890035,34594] 0 2024-09-11T00:07:12.388 INFO:tasks.workunit.client.1.smithi203.stdout:4/329: creat db/dd/d26/d42/d5e/f65 x:0 0 0 2024-09-11T00:07:12.389 INFO:tasks.workunit.client.1.smithi203.stdout:7/320: truncate dd/f37 1094644 0 2024-09-11T00:07:12.391 INFO:tasks.workunit.client.0.smithi111.stdout:8/383: mkdir d11/d23/d7e 0 2024-09-11T00:07:12.391 INFO:tasks.workunit.client.0.smithi111.stdout:0/347: dread - d3/da/f6e zero size 2024-09-11T00:07:12.392 INFO:tasks.workunit.client.0.smithi111.stdout:6/260: creat d7/f52 x:0 0 0 2024-09-11T00:07:12.395 INFO:tasks.workunit.client.0.smithi111.stdout:1/294: truncate d2/de/d12/d39/d3a/f3b 1722031 0 2024-09-11T00:07:12.395 INFO:tasks.workunit.client.0.smithi111.stdout:4/298: dread - d18/d1f/f2e zero size 2024-09-11T00:07:12.398 INFO:tasks.workunit.client.0.smithi111.stdout:3/361: truncate d1c/d1d/d22/d23/f52 645588 0 2024-09-11T00:07:12.398 INFO:tasks.workunit.client.0.smithi111.stdout:8/384: truncate d11/d23/f4e 1671591 0 2024-09-11T00:07:12.398 INFO:tasks.workunit.client.0.smithi111.stdout:2/321: symlink d0/d3/d12/d38/l73 0 2024-09-11T00:07:12.398 INFO:tasks.workunit.client.0.smithi111.stdout:3/362: stat d1c/d1d 0 2024-09-11T00:07:12.401 INFO:tasks.workunit.client.0.smithi111.stdout:5/343: getdents d10/d1e/d23/d30/d3c 0 2024-09-11T00:07:12.402 INFO:tasks.workunit.client.1.smithi203.stdout:5/395: readlink dc/dd/d15/l1f 0 2024-09-11T00:07:12.403 INFO:tasks.workunit.client.1.smithi203.stdout:7/321: symlink dd/d1c/d52/l77 0 2024-09-11T00:07:12.408 INFO:tasks.workunit.client.1.smithi203.stdout:6/306: mkdir d0/d5b 0 2024-09-11T00:07:12.413 INFO:tasks.workunit.client.0.smithi111.stdout:6/261: mknod d7/d22/d26/c53 0 2024-09-11T00:07:12.414 INFO:tasks.workunit.client.1.smithi203.stdout:0/359: link d0/d2/l28 d0/d1d/d4c/l76 0 2024-09-11T00:07:12.416 INFO:tasks.workunit.client.1.smithi203.stdout:4/330: dwrite db/dd/d16/f4f [0,4194304] 0 2024-09-11T00:07:12.417 INFO:tasks.workunit.client.0.smithi111.stdout:4/299: creat d18/d3b/f60 x:0 0 0 2024-09-11T00:07:12.417 INFO:tasks.workunit.client.0.smithi111.stdout:0/348: dwrite d3/da/f3a [0,4194304] 0 2024-09-11T00:07:12.418 INFO:tasks.workunit.client.1.smithi203.stdout:5/396: symlink dc/d4f/d5c/d76/l80 0 2024-09-11T00:07:12.419 INFO:tasks.workunit.client.0.smithi111.stdout:6/262: write f3 [4726208,125337] 0 2024-09-11T00:07:12.421 INFO:tasks.workunit.client.0.smithi111.stdout:4/300: chown d18/d39/f53 53537815 1 2024-09-11T00:07:12.423 INFO:tasks.workunit.client.0.smithi111.stdout:1/295: creat d2/d2b/d2c/d56/f61 x:0 0 0 2024-09-11T00:07:12.424 INFO:tasks.workunit.client.0.smithi111.stdout:6/263: chown d7/ff 419 1 2024-09-11T00:07:12.424 INFO:tasks.workunit.client.1.smithi203.stdout:7/322: creat dd/d1c/f78 x:0 0 0 2024-09-11T00:07:12.426 INFO:tasks.workunit.client.0.smithi111.stdout:2/322: unlink d0/d3/d12/d38/l73 0 2024-09-11T00:07:12.427 INFO:tasks.workunit.client.1.smithi203.stdout:7/323: readlink dd/d1c/l70 0 2024-09-11T00:07:12.430 INFO:tasks.workunit.client.0.smithi111.stdout:5/344: mkdir d10/d1e/d23/d30/d46/d47/d72 0 2024-09-11T00:07:12.431 INFO:tasks.workunit.client.1.smithi203.stdout:9/327: getdents d6/de/d32/d52/d55 0 2024-09-11T00:07:12.432 INFO:tasks.workunit.client.1.smithi203.stdout:0/360: write d0/d1d/f2e [175889,77256] 0 2024-09-11T00:07:12.433 INFO:tasks.workunit.client.0.smithi111.stdout:9/358: dwrite d6/d52/f59 [0,4194304] 0 2024-09-11T00:07:12.433 INFO:tasks.workunit.client.0.smithi111.stdout:2/323: dread - d0/d3/f3e zero size 2024-09-11T00:07:12.435 INFO:tasks.workunit.client.1.smithi203.stdout:5/397: creat dc/dd/d4d/f81 x:0 0 0 2024-09-11T00:07:12.436 INFO:tasks.workunit.client.0.smithi111.stdout:8/385: dwrite d11/d23/d2c/d46/d64/f76 [0,4194304] 0 2024-09-11T00:07:12.441 INFO:tasks.workunit.client.1.smithi203.stdout:6/307: mkdir d0/d5b/d5c 0 2024-09-11T00:07:12.441 INFO:tasks.workunit.client.0.smithi111.stdout:4/301: mkdir d18/d3b/d61 0 2024-09-11T00:07:12.443 INFO:tasks.workunit.client.0.smithi111.stdout:8/386: write d11/d21/d38/f52 [89078,29954] 0 2024-09-11T00:07:12.444 INFO:tasks.workunit.client.0.smithi111.stdout:7/327: sync 2024-09-11T00:07:12.448 INFO:tasks.workunit.client.0.smithi111.stdout:6/264: creat d7/d22/d3f/f54 x:0 0 0 2024-09-11T00:07:12.450 INFO:tasks.workunit.client.1.smithi203.stdout:9/328: dread d6/de/d32/f37 [0,4194304] 0 2024-09-11T00:07:12.451 INFO:tasks.workunit.client.0.smithi111.stdout:3/363: mkdir d1c/d1d/d22/d44/d5a/d74/d7b 0 2024-09-11T00:07:12.451 INFO:tasks.workunit.client.0.smithi111.stdout:9/359: mkdir d6/dc/d73 0 2024-09-11T00:07:12.454 INFO:tasks.workunit.client.0.smithi111.stdout:8/387: readlink d11/d21/d38/d54/l7d 0 2024-09-11T00:07:12.455 INFO:tasks.workunit.client.0.smithi111.stdout:1/296: mkdir d2/de/d62 0 2024-09-11T00:07:12.457 INFO:tasks.workunit.client.1.smithi203.stdout:4/331: rename f2 to db/d12/f66 0 2024-09-11T00:07:12.461 INFO:tasks.workunit.client.1.smithi203.stdout:4/332: chown db/dd/f11 1916 1 2024-09-11T00:07:12.461 INFO:tasks.workunit.client.1.smithi203.stdout:0/361: truncate d0/d2/d37/f3e 774218 0 2024-09-11T00:07:12.465 INFO:tasks.workunit.client.0.smithi111.stdout:7/328: dread - dd/d1d/d2d/d2e/d4e/f64 zero size 2024-09-11T00:07:12.466 INFO:tasks.workunit.client.0.smithi111.stdout:0/349: dwrite d3/dc/f43 [0,4194304] 0 2024-09-11T00:07:12.468 INFO:tasks.workunit.client.0.smithi111.stdout:4/302: dwrite d18/f1b [4194304,4194304] 0 2024-09-11T00:07:12.477 INFO:tasks.workunit.client.1.smithi203.stdout:4/333: dread db/dd/d16/d38/f3b [0,4194304] 0 2024-09-11T00:07:12.478 INFO:tasks.workunit.client.0.smithi111.stdout:3/364: creat d1c/d1d/d22/d44/f7c x:0 0 0 2024-09-11T00:07:12.482 INFO:tasks.workunit.client.1.smithi203.stdout:5/398: rename dc/dd/d4d/d59/l75 to dc/dd/d1e/d7b/l82 0 2024-09-11T00:07:12.486 INFO:tasks.workunit.client.0.smithi111.stdout:8/388: mkdir d11/d23/d2c/d7f 0 2024-09-11T00:07:12.486 INFO:tasks.workunit.client.0.smithi111.stdout:2/324: dwrite d0/f1a [0,4194304] 0 2024-09-11T00:07:12.488 INFO:tasks.workunit.client.0.smithi111.stdout:2/325: read - d0/d3/f4e zero size 2024-09-11T00:07:12.491 INFO:tasks.workunit.client.0.smithi111.stdout:2/326: dread - d0/d3/de/d4b/f69 zero size 2024-09-11T00:07:12.496 INFO:tasks.workunit.client.1.smithi203.stdout:9/329: mknod d6/de/d32/d52/d55/d66/c67 0 2024-09-11T00:07:12.503 INFO:tasks.workunit.client.0.smithi111.stdout:6/265: unlink d7/d22/d2c/d38/c51 0 2024-09-11T00:07:12.504 INFO:tasks.workunit.client.0.smithi111.stdout:6/266: dread - d7/d22/d2c/f37 zero size 2024-09-11T00:07:12.507 INFO:tasks.workunit.client.0.smithi111.stdout:0/350: rename d3/da/f1d to d3/d13/d1e/d29/d49/d51/d61/f7e 0 2024-09-11T00:07:12.508 INFO:tasks.workunit.client.1.smithi203.stdout:4/334: symlink db/dd/d16/d38/d3c/l67 0 2024-09-11T00:07:12.510 INFO:tasks.workunit.client.0.smithi111.stdout:9/360: mkdir d6/db/d1b/d74 0 2024-09-11T00:07:12.512 INFO:tasks.workunit.client.0.smithi111.stdout:9/361: write d6/db/f6d [625144,75017] 0 2024-09-11T00:07:12.514 INFO:tasks.workunit.client.0.smithi111.stdout:5/345: truncate fd 2204503 0 2024-09-11T00:07:12.515 INFO:tasks.workunit.client.1.smithi203.stdout:3/461: sync 2024-09-11T00:07:12.516 INFO:tasks.workunit.client.0.smithi111.stdout:3/365: creat d1c/d21/f7d x:0 0 0 2024-09-11T00:07:12.518 INFO:tasks.workunit.client.0.smithi111.stdout:8/389: rmdir d11/d21/d38 39 2024-09-11T00:07:12.520 INFO:tasks.workunit.client.1.smithi203.stdout:6/308: getdents d0/d32 0 2024-09-11T00:07:12.521 INFO:tasks.workunit.client.0.smithi111.stdout:1/297: mkdir d2/de/d12/d39/d63 0 2024-09-11T00:07:12.524 INFO:tasks.workunit.client.1.smithi203.stdout:9/330: rename d6/de/d19/d21/c26 to d6/de/d19/d24/d40/c68 0 2024-09-11T00:07:12.526 INFO:tasks.workunit.client.0.smithi111.stdout:2/327: creat d0/d3/d12/d52/f74 x:0 0 0 2024-09-11T00:07:12.527 INFO:tasks.workunit.client.1.smithi203.stdout:0/362: write d0/d2/d37/f4b [268795,73354] 0 2024-09-11T00:07:12.528 INFO:tasks.workunit.client.1.smithi203.stdout:7/324: link dd/f37 dd/d3b/d5b/d6a/d31/d67/f79 0 2024-09-11T00:07:12.528 INFO:tasks.workunit.client.0.smithi111.stdout:2/328: write d0/f72 [717014,59190] 0 2024-09-11T00:07:12.529 INFO:tasks.workunit.client.1.smithi203.stdout:7/325: fdatasync dd/d3b/f72 0 2024-09-11T00:07:12.530 INFO:tasks.workunit.client.0.smithi111.stdout:4/303: truncate f5 188009 0 2024-09-11T00:07:12.531 INFO:tasks.workunit.client.1.smithi203.stdout:5/399: creat dc/dd/d15/d3b/d73/f83 x:0 0 0 2024-09-11T00:07:12.538 INFO:tasks.workunit.client.0.smithi111.stdout:6/267: symlink d7/d22/d26/l55 0 2024-09-11T00:07:12.538 INFO:tasks.workunit.client.0.smithi111.stdout:1/298: dwrite d2/d2b/d2c/f42 [4194304,4194304] 0 2024-09-11T00:07:12.540 INFO:tasks.workunit.client.0.smithi111.stdout:1/299: dread - d2/d2b/d2c/f5f zero size 2024-09-11T00:07:12.543 INFO:tasks.workunit.client.0.smithi111.stdout:1/300: write d2/de/d12/d39/f59 [1007136,46683] 0 2024-09-11T00:07:12.544 INFO:tasks.workunit.client.1.smithi203.stdout:9/331: truncate d6/de/d19/f1b 1211068 0 2024-09-11T00:07:12.545 INFO:tasks.workunit.client.0.smithi111.stdout:9/362: rmdir d6/db/d1b/d56 39 2024-09-11T00:07:12.547 INFO:tasks.workunit.client.1.smithi203.stdout:0/363: dread d0/f5c [0,4194304] 0 2024-09-11T00:07:12.548 INFO:tasks.workunit.client.1.smithi203.stdout:7/326: write dd/d4d/f73 [2234940,12948] 0 2024-09-11T00:07:12.548 INFO:tasks.workunit.client.1.smithi203.stdout:5/400: mknod dc/dd/d1e/d7b/c84 0 2024-09-11T00:07:12.550 INFO:tasks.workunit.client.0.smithi111.stdout:8/390: write d11/d21/d38/f5e [1795264,5405] 0 2024-09-11T00:07:12.552 INFO:tasks.workunit.client.1.smithi203.stdout:3/462: dread d8/f58 [0,4194304] 0 2024-09-11T00:07:12.553 INFO:tasks.workunit.client.0.smithi111.stdout:8/391: write d11/d23/d2c/f6b [170079,81454] 0 2024-09-11T00:07:12.554 INFO:tasks.workunit.client.1.smithi203.stdout:1/424: sync 2024-09-11T00:07:12.555 INFO:tasks.workunit.client.1.smithi203.stdout:2/282: sync 2024-09-11T00:07:12.556 INFO:tasks.workunit.client.1.smithi203.stdout:8/334: sync 2024-09-11T00:07:12.557 INFO:tasks.workunit.client.1.smithi203.stdout:0/364: rmdir d0/d1d/d5d 39 2024-09-11T00:07:12.558 INFO:tasks.workunit.client.1.smithi203.stdout:2/283: chown d13/d22/d53 29085900 1 2024-09-11T00:07:12.561 INFO:tasks.workunit.client.1.smithi203.stdout:0/365: write d0/d2/f3 [2818187,48065] 0 2024-09-11T00:07:12.564 INFO:tasks.workunit.client.1.smithi203.stdout:0/366: write d0/d2/f65 [782274,121000] 0 2024-09-11T00:07:12.567 INFO:tasks.workunit.client.1.smithi203.stdout:7/327: creat dd/d4d/f7a x:0 0 0 2024-09-11T00:07:12.567 INFO:tasks.workunit.client.1.smithi203.stdout:2/284: truncate d13/d22/f4a 718664 0 2024-09-11T00:07:12.568 INFO:tasks.workunit.client.0.smithi111.stdout:6/268: mkdir d7/d22/d2c/d38/d56 0 2024-09-11T00:07:12.572 INFO:tasks.workunit.client.1.smithi203.stdout:7/328: write dd/d3b/d5b/d6a/d31/f36 [608915,50370] 0 2024-09-11T00:07:12.574 INFO:tasks.workunit.client.1.smithi203.stdout:6/309: fdatasync d0/d27/d35/d39/f56 0 2024-09-11T00:07:12.578 INFO:tasks.workunit.client.1.smithi203.stdout:4/335: getdents db/dd/d26/d42 0 2024-09-11T00:07:12.578 INFO:tasks.workunit.client.1.smithi203.stdout:5/401: dwrite dc/dd/d13/f5d [0,4194304] 0 2024-09-11T00:07:12.579 INFO:tasks.workunit.client.0.smithi111.stdout:6/269: dread d7/ff [0,4194304] 0 2024-09-11T00:07:12.581 INFO:tasks.workunit.client.0.smithi111.stdout:5/346: creat d10/d1e/d23/d30/d46/d47/d72/f73 x:0 0 0 2024-09-11T00:07:12.583 INFO:tasks.workunit.client.0.smithi111.stdout:5/347: fsync d10/d1e/d23/d30/d46/d47/d66/f67 0 2024-09-11T00:07:12.584 INFO:tasks.workunit.client.1.smithi203.stdout:4/336: read db/d12/d15/f2d [2448854,67344] 0 2024-09-11T00:07:12.584 INFO:tasks.workunit.client.1.smithi203.stdout:9/332: chown d6/de/c11 274 1 2024-09-11T00:07:12.585 INFO:tasks.workunit.client.0.smithi111.stdout:5/348: fsync d10/d1e/d23/d2b/d2f/f3f 0 2024-09-11T00:07:12.588 INFO:tasks.workunit.client.0.smithi111.stdout:5/349: read d10/d1e/d23/f48 [1844481,124838] 0 2024-09-11T00:07:12.589 INFO:tasks.workunit.client.0.smithi111.stdout:7/329: getdents dd/d1d/d1f/d24 0 2024-09-11T00:07:12.593 INFO:tasks.workunit.client.1.smithi203.stdout:0/367: mkdir d0/d2/d3d/d5a/d77 0 2024-09-11T00:07:12.593 INFO:tasks.workunit.client.0.smithi111.stdout:4/304: fsync d18/d1f/d33/f3d 0 2024-09-11T00:07:12.597 INFO:tasks.workunit.client.1.smithi203.stdout:2/285: mkdir d13/d56 0 2024-09-11T00:07:12.599 INFO:tasks.workunit.client.0.smithi111.stdout:8/392: readlink d11/d21/d38/d54/l6e 0 2024-09-11T00:07:12.603 INFO:tasks.workunit.client.1.smithi203.stdout:7/329: rename dd/d1c/f23 to dd/d3b/d5b/f7b 0 2024-09-11T00:07:12.604 INFO:tasks.workunit.client.0.smithi111.stdout:0/351: rmdir d3/d13/d1e/d29/d5c 0 2024-09-11T00:07:12.610 INFO:tasks.workunit.client.1.smithi203.stdout:4/337: dwrite db/dd/d26/d42/d5e/f65 [0,4194304] 0 2024-09-11T00:07:12.612 INFO:tasks.workunit.client.1.smithi203.stdout:6/310: readlink d0/d27/le 0 2024-09-11T00:07:12.614 INFO:tasks.workunit.client.1.smithi203.stdout:6/311: truncate d0/d32/f3a 4459116 0 2024-09-11T00:07:12.617 INFO:tasks.workunit.client.0.smithi111.stdout:6/270: unlink d7/d2b/d35/d41/l49 0 2024-09-11T00:07:12.617 INFO:tasks.workunit.client.1.smithi203.stdout:6/312: chown d0/f1 3490 1 2024-09-11T00:07:12.618 INFO:tasks.workunit.client.0.smithi111.stdout:6/271: chown d7/d22/d1d/f31 5415419 1 2024-09-11T00:07:12.619 INFO:tasks.workunit.client.0.smithi111.stdout:2/329: truncate d0/d3/d12/f3d 266100 0 2024-09-11T00:07:12.620 INFO:tasks.workunit.client.1.smithi203.stdout:3/463: dread d8/da/d5c/d6b/d6c/f7b [0,4194304] 0 2024-09-11T00:07:12.621 INFO:tasks.workunit.client.0.smithi111.stdout:2/330: dread - d0/d3/d12/d52/f74 zero size 2024-09-11T00:07:12.622 INFO:tasks.workunit.client.1.smithi203.stdout:8/335: write d1/d13/f33 [1098482,73130] 0 2024-09-11T00:07:12.625 INFO:tasks.workunit.client.1.smithi203.stdout:8/336: dread - d1/d13/d43/f57 zero size 2024-09-11T00:07:12.635 INFO:tasks.workunit.client.1.smithi203.stdout:1/425: dread d8/d9/d15/d27/f2e [0,4194304] 0 2024-09-11T00:07:12.636 INFO:tasks.workunit.client.1.smithi203.stdout:4/338: dwrite db/dd/f11 [0,4194304] 0 2024-09-11T00:07:12.637 INFO:tasks.workunit.client.0.smithi111.stdout:7/330: rename dd/le to dd/d1d/d4b/l6a 0 2024-09-11T00:07:12.638 INFO:tasks.workunit.client.0.smithi111.stdout:9/363: dwrite d6/dc/f6f [0,4194304] 0 2024-09-11T00:07:12.643 INFO:tasks.workunit.client.1.smithi203.stdout:2/286: fdatasync f8 0 2024-09-11T00:07:12.648 INFO:tasks.workunit.client.0.smithi111.stdout:0/352: creat d3/d13/d1e/f7f x:0 0 0 2024-09-11T00:07:12.649 INFO:tasks.workunit.client.1.smithi203.stdout:7/330: mkdir dd/d1c/d7c 0 2024-09-11T00:07:12.654 INFO:tasks.workunit.client.0.smithi111.stdout:6/272: creat d7/d2b/d35/f57 x:0 0 0 2024-09-11T00:07:12.656 INFO:tasks.workunit.client.0.smithi111.stdout:2/331: creat d0/d3/de/d3b/d63/f75 x:0 0 0 2024-09-11T00:07:12.657 INFO:tasks.workunit.client.0.smithi111.stdout:3/366: getdents d1c/d1d/d22/d23/d2f/d63 0 2024-09-11T00:07:12.666 INFO:tasks.workunit.client.1.smithi203.stdout:8/337: mkdir d1/d13/d3a/d75 0 2024-09-11T00:07:12.666 INFO:tasks.workunit.client.0.smithi111.stdout:0/353: dwrite d3/dc/f3f [0,4194304] 0 2024-09-11T00:07:12.673 INFO:tasks.workunit.client.1.smithi203.stdout:9/333: mknod d6/c69 0 2024-09-11T00:07:12.673 INFO:tasks.workunit.client.1.smithi203.stdout:1/426: write d8/f68 [1970022,6294] 0 2024-09-11T00:07:12.674 INFO:tasks.workunit.client.1.smithi203.stdout:0/368: mknod d0/d2/d3d/d5a/d77/c78 0 2024-09-11T00:07:12.677 INFO:tasks.workunit.client.1.smithi203.stdout:2/287: creat d13/d15/d30/f57 x:0 0 0 2024-09-11T00:07:12.678 INFO:tasks.workunit.client.1.smithi203.stdout:6/313: mknod d0/d27/d35/c5d 0 2024-09-11T00:07:12.679 INFO:tasks.workunit.client.0.smithi111.stdout:1/301: getdents d2/d2b/d2c/d56 0 2024-09-11T00:07:12.680 INFO:tasks.workunit.client.0.smithi111.stdout:3/367: rmdir d1c/d1d/d22/d44/d5a/d74 39 2024-09-11T00:07:12.680 INFO:tasks.workunit.client.0.smithi111.stdout:9/364: fsync d6/dc/f6f 0 2024-09-11T00:07:12.681 INFO:tasks.workunit.client.1.smithi203.stdout:2/288: fdatasync d13/d15/d19/d1c/f44 0 2024-09-11T00:07:12.684 INFO:tasks.workunit.client.0.smithi111.stdout:2/332: rename d0/d3/d12/d38/c5b to d0/d3/de/d3b/d63/c76 0 2024-09-11T00:07:12.685 INFO:tasks.workunit.client.0.smithi111.stdout:0/354: dread d3/d13/d1e/d29/d49/d51/d61/f6b [0,4194304] 0 2024-09-11T00:07:12.685 INFO:tasks.workunit.client.1.smithi203.stdout:8/338: mkdir d1/d13/d43/d46/d76 0 2024-09-11T00:07:12.685 INFO:tasks.workunit.client.1.smithi203.stdout:2/289: write d13/d22/f38 [308021,100279] 0 2024-09-11T00:07:12.688 INFO:tasks.workunit.client.1.smithi203.stdout:3/464: dwrite d8/d3c/f5a [0,4194304] 0 2024-09-11T00:07:12.688 INFO:tasks.workunit.client.1.smithi203.stdout:9/334: mknod d6/de/d47/c6a 0 2024-09-11T00:07:12.689 INFO:tasks.workunit.client.0.smithi111.stdout:7/331: creat dd/d48/d69/f6b x:0 0 0 2024-09-11T00:07:12.693 INFO:tasks.workunit.client.0.smithi111.stdout:8/393: link d11/l2d d11/d23/d7e/l80 0 2024-09-11T00:07:12.696 INFO:tasks.workunit.client.0.smithi111.stdout:5/350: sync 2024-09-11T00:07:12.700 INFO:tasks.workunit.client.0.smithi111.stdout:6/273: mknod d7/d2b/c58 0 2024-09-11T00:07:12.701 INFO:tasks.workunit.client.0.smithi111.stdout:9/365: dwrite d6/db/f5b [0,4194304] 0 2024-09-11T00:07:12.701 INFO:tasks.workunit.client.1.smithi203.stdout:0/369: unlink d0/d1d/c62 0 2024-09-11T00:07:12.705 INFO:tasks.workunit.client.0.smithi111.stdout:6/274: write d7/d22/d1d/f31 [1617307,101730] 0 2024-09-11T00:07:12.705 INFO:tasks.workunit.client.0.smithi111.stdout:9/366: write d6/db/d34/f47 [1211746,25728] 0 2024-09-11T00:07:12.705 INFO:tasks.workunit.client.1.smithi203.stdout:0/370: write d0/d2/f1a [3376039,125655] 0 2024-09-11T00:07:12.705 INFO:tasks.workunit.client.1.smithi203.stdout:6/314: chown d0/f23 0 1 2024-09-11T00:07:12.706 INFO:tasks.workunit.client.1.smithi203.stdout:3/465: dwrite d8/fb [0,4194304] 0 2024-09-11T00:07:12.706 INFO:tasks.workunit.client.0.smithi111.stdout:3/368: mkdir d1c/d1d/d22/d23/d2f/d63/d7e 0 2024-09-11T00:07:12.711 INFO:tasks.workunit.client.0.smithi111.stdout:2/333: mknod d0/d3/d12/d38/c77 0 2024-09-11T00:07:12.712 INFO:tasks.workunit.client.1.smithi203.stdout:5/402: link dc/dd/d15/c5e dc/d2b/c85 0 2024-09-11T00:07:12.713 INFO:tasks.workunit.client.0.smithi111.stdout:4/305: dwrite d18/d20/f46 [0,4194304] 0 2024-09-11T00:07:12.713 INFO:tasks.workunit.client.0.smithi111.stdout:6/275: write d7/d22/d2c/f37 [699725,126195] 0 2024-09-11T00:07:12.714 INFO:tasks.workunit.client.1.smithi203.stdout:1/427: write d8/d9/d15/f47 [1264415,127546] 0 2024-09-11T00:07:12.715 INFO:tasks.workunit.client.1.smithi203.stdout:5/403: read dc/dd/d1e/f29 [7931507,123729] 0 2024-09-11T00:07:12.720 INFO:tasks.workunit.client.0.smithi111.stdout:8/394: mkdir d11/d23/d2c/d46/d81 0 2024-09-11T00:07:12.721 INFO:tasks.workunit.client.1.smithi203.stdout:5/404: fdatasync dc/dd/d4d/f81 0 2024-09-11T00:07:12.722 INFO:tasks.workunit.client.1.smithi203.stdout:9/335: symlink d6/de/d32/d52/d55/l6b 0 2024-09-11T00:07:12.724 INFO:tasks.workunit.client.1.smithi203.stdout:9/336: write d6/f64 [405101,125284] 0 2024-09-11T00:07:12.731 INFO:tasks.workunit.client.1.smithi203.stdout:6/315: creat d0/d32/f5e x:0 0 0 2024-09-11T00:07:12.738 INFO:tasks.workunit.client.0.smithi111.stdout:8/395: dwrite d11/d23/d2c/f45 [4194304,4194304] 0 2024-09-11T00:07:12.740 INFO:tasks.workunit.client.0.smithi111.stdout:8/396: dread - d11/d21/d6f/f79 zero size 2024-09-11T00:07:12.741 INFO:tasks.workunit.client.1.smithi203.stdout:1/428: dwrite d8/f1a [0,4194304] 0 2024-09-11T00:07:12.741 INFO:tasks.workunit.client.0.smithi111.stdout:2/334: creat d0/d3/de/d3b/d62/f78 x:0 0 0 2024-09-11T00:07:12.742 INFO:tasks.workunit.client.0.smithi111.stdout:8/397: fsync d11/d23/d2c/d46/f63 0 2024-09-11T00:07:12.745 INFO:tasks.workunit.client.1.smithi203.stdout:4/339: getdents db/dd/d16/d38/d3c/d41 0 2024-09-11T00:07:12.747 INFO:tasks.workunit.client.0.smithi111.stdout:6/276: mknod d7/d22/d26/c59 0 2024-09-11T00:07:12.749 INFO:tasks.workunit.client.0.smithi111.stdout:1/302: creat d2/de/d12/d39/f64 x:0 0 0 2024-09-11T00:07:12.751 INFO:tasks.workunit.client.0.smithi111.stdout:7/332: dwrite dd/f26 [0,4194304] 0 2024-09-11T00:07:12.753 INFO:tasks.workunit.client.0.smithi111.stdout:1/303: write d2/de/d12/d39/f46 [208255,130235] 0 2024-09-11T00:07:12.754 INFO:tasks.workunit.client.1.smithi203.stdout:9/337: fdatasync d6/de/d32/f37 0 2024-09-11T00:07:12.767 INFO:tasks.workunit.client.1.smithi203.stdout:8/339: truncate d1/d13/f33 562557 0 2024-09-11T00:07:12.768 INFO:tasks.workunit.client.0.smithi111.stdout:9/367: symlink d6/dc/d73/l75 0 2024-09-11T00:07:12.770 INFO:tasks.workunit.client.0.smithi111.stdout:9/368: write d6/db/d34/d37/f2d [3169381,14118] 0 2024-09-11T00:07:12.771 INFO:tasks.workunit.client.1.smithi203.stdout:8/340: write d1/d13/d3a/d4c/f5c [632271,38686] 0 2024-09-11T00:07:12.772 INFO:tasks.workunit.client.1.smithi203.stdout:2/290: creat d13/d15/f58 x:0 0 0 2024-09-11T00:07:12.775 INFO:tasks.workunit.client.0.smithi111.stdout:8/398: rmdir d11/d21/d38/d54 39 2024-09-11T00:07:12.777 INFO:tasks.workunit.client.1.smithi203.stdout:1/429: rmdir d8/d11 39 2024-09-11T00:07:12.777 INFO:tasks.workunit.client.1.smithi203.stdout:4/340: creat db/dd/d16/d38/d3c/f68 x:0 0 0 2024-09-11T00:07:12.779 INFO:tasks.workunit.client.0.smithi111.stdout:8/399: dread d11/d23/d2c/f6b [0,4194304] 0 2024-09-11T00:07:12.780 INFO:tasks.workunit.client.1.smithi203.stdout:0/371: link d0/d2/fe d0/d2/d37/d5b/f79 0 2024-09-11T00:07:12.783 INFO:tasks.workunit.client.1.smithi203.stdout:9/338: read d6/de/d19/d24/d40/d45/f39 [48446,97921] 0 2024-09-11T00:07:12.788 INFO:tasks.workunit.client.1.smithi203.stdout:5/405: dwrite dc/dd/d15/d3b/f40 [0,4194304] 0 2024-09-11T00:07:12.788 INFO:tasks.workunit.client.0.smithi111.stdout:5/351: link d10/d1e/d23/c57 d10/d1e/d23/d30/d3c/d60/c74 0 2024-09-11T00:07:12.789 INFO:tasks.workunit.client.1.smithi203.stdout:3/466: creat d8/da/d37/d53/fab x:0 0 0 2024-09-11T00:07:12.790 INFO:tasks.workunit.client.0.smithi111.stdout:6/277: dread f3 [0,4194304] 0 2024-09-11T00:07:12.793 INFO:tasks.workunit.client.0.smithi111.stdout:0/355: sync 2024-09-11T00:07:12.793 INFO:tasks.workunit.client.1.smithi203.stdout:8/341: unlink d1/d13/d22/l28 0 2024-09-11T00:07:12.795 INFO:tasks.workunit.client.0.smithi111.stdout:0/356: truncate d3/d1c/f4f 902099 0 2024-09-11T00:07:12.797 INFO:tasks.workunit.client.0.smithi111.stdout:0/357: dread d3/d13/d1e/f44 [0,4194304] 0 2024-09-11T00:07:12.801 INFO:tasks.workunit.client.0.smithi111.stdout:3/369: truncate d1c/d1d/d22/f4d 3402409 0 2024-09-11T00:07:12.801 INFO:tasks.workunit.client.0.smithi111.stdout:2/335: write d0/d3/f27 [349517,28999] 0 2024-09-11T00:07:12.803 INFO:tasks.workunit.client.1.smithi203.stdout:6/316: creat d0/f5f x:0 0 0 2024-09-11T00:07:12.805 INFO:tasks.workunit.client.0.smithi111.stdout:4/306: truncate d18/d20/d40/f42 1131068 0 2024-09-11T00:07:12.806 INFO:tasks.workunit.client.1.smithi203.stdout:1/430: dwrite d8/d9/d15/d30/f61 [0,4194304] 0 2024-09-11T00:07:12.808 INFO:tasks.workunit.client.0.smithi111.stdout:7/333: symlink dd/d1d/l6c 0 2024-09-11T00:07:12.814 INFO:tasks.workunit.client.1.smithi203.stdout:9/339: rmdir d6/de/d32/d52/d55/d66 39 2024-09-11T00:07:12.817 INFO:tasks.workunit.client.1.smithi203.stdout:2/291: dread f11 [0,4194304] 0 2024-09-11T00:07:12.818 INFO:tasks.workunit.client.0.smithi111.stdout:9/369: dread d6/db/fd [0,4194304] 0 2024-09-11T00:07:12.819 INFO:tasks.workunit.client.0.smithi111.stdout:7/334: dread dd/f26 [0,4194304] 0 2024-09-11T00:07:12.819 INFO:tasks.workunit.client.0.smithi111.stdout:6/278: rename d7/f9 to d7/f5a 0 2024-09-11T00:07:12.820 INFO:tasks.workunit.client.1.smithi203.stdout:2/292: chown d13/d15/d19/d1c/f2a 611740 1 2024-09-11T00:07:12.822 INFO:tasks.workunit.client.0.smithi111.stdout:2/336: symlink d0/d3/de/d3b/l79 0 2024-09-11T00:07:12.822 INFO:tasks.workunit.client.1.smithi203.stdout:5/406: fsync dc/d65/f4a 0 2024-09-11T00:07:12.823 INFO:tasks.workunit.client.1.smithi203.stdout:2/293: stat d13/d15/d19/d1c/f3c 0 2024-09-11T00:07:12.823 INFO:tasks.workunit.client.0.smithi111.stdout:7/335: write dd/d1d/d2d/d2e/d4e/f64 [884977,62961] 0 2024-09-11T00:07:12.823 INFO:tasks.workunit.client.0.smithi111.stdout:2/337: dread - d0/d3/de/d4b/f69 zero size 2024-09-11T00:07:12.826 INFO:tasks.workunit.client.1.smithi203.stdout:5/407: read dc/d4f/d5c/f66 [3854410,16774] 0 2024-09-11T00:07:12.827 INFO:tasks.workunit.client.0.smithi111.stdout:4/307: creat d18/d20/d4a/f62 x:0 0 0 2024-09-11T00:07:12.829 INFO:tasks.workunit.client.1.smithi203.stdout:4/341: getdents db/dd/d16/d38/d3c/d41 0 2024-09-11T00:07:12.829 INFO:tasks.workunit.client.1.smithi203.stdout:5/408: chown dc/d4f/f50 487379 1 2024-09-11T00:07:12.830 INFO:tasks.workunit.client.0.smithi111.stdout:1/304: creat d2/de/d12/d39/f65 x:0 0 0 2024-09-11T00:07:12.832 INFO:tasks.workunit.client.0.smithi111.stdout:1/305: fsync d2/de/d12/d39/f59 0 2024-09-11T00:07:12.833 INFO:tasks.workunit.client.0.smithi111.stdout:9/370: dread d6/dc/f1f [0,4194304] 0 2024-09-11T00:07:12.833 INFO:tasks.workunit.client.1.smithi203.stdout:4/342: write db/dd/d16/d38/d3c/f68 [362093,73651] 0 2024-09-11T00:07:12.833 INFO:tasks.workunit.client.1.smithi203.stdout:1/431: rename d8/d9/d15/d30 to d8/d19/d60/d90 0 2024-09-11T00:07:12.846 INFO:tasks.workunit.client.1.smithi203.stdout:8/342: mkdir d1/d13/d17/d77 0 2024-09-11T00:07:12.849 INFO:tasks.workunit.client.1.smithi203.stdout:9/340: dread d6/f14 [0,4194304] 0 2024-09-11T00:07:12.850 INFO:tasks.workunit.client.1.smithi203.stdout:2/294: mkdir d13/d15/d30/d59 0 2024-09-11T00:07:12.853 INFO:tasks.workunit.client.1.smithi203.stdout:6/317: write d0/d27/d35/d39/f56 [963419,101725] 0 2024-09-11T00:07:12.854 INFO:tasks.workunit.client.1.smithi203.stdout:6/318: chown d0/d27/le 478674983 1 2024-09-11T00:07:12.854 INFO:tasks.workunit.client.1.smithi203.stdout:2/295: dread d13/d22/f4a [0,4194304] 0 2024-09-11T00:07:12.855 INFO:tasks.workunit.client.1.smithi203.stdout:7/331: sync 2024-09-11T00:07:12.857 INFO:tasks.workunit.client.1.smithi203.stdout:5/409: mknod dc/dd/c86 0 2024-09-11T00:07:12.858 INFO:tasks.workunit.client.1.smithi203.stdout:5/410: chown dc 12165862 1 2024-09-11T00:07:12.860 INFO:tasks.workunit.client.1.smithi203.stdout:4/343: mknod db/dd/d16/d38/d3c/d41/c69 0 2024-09-11T00:07:12.861 INFO:tasks.workunit.client.1.smithi203.stdout:8/343: chown d1/d13/f35 4 1 2024-09-11T00:07:12.863 INFO:tasks.workunit.client.1.smithi203.stdout:8/344: fsync d1/f3d 0 2024-09-11T00:07:12.865 INFO:tasks.workunit.client.1.smithi203.stdout:9/341: mkdir d6/de/d19/d24/d6c 0 2024-09-11T00:07:12.870 INFO:tasks.workunit.client.1.smithi203.stdout:0/372: getdents d0 0 2024-09-11T00:07:12.870 INFO:tasks.workunit.client.1.smithi203.stdout:2/296: mkdir d13/d15/d30/d5a 0 2024-09-11T00:07:12.871 INFO:tasks.workunit.client.1.smithi203.stdout:8/345: chown d1/d13/d43/d46/c73 795 1 2024-09-11T00:07:12.871 INFO:tasks.workunit.client.1.smithi203.stdout:3/467: dwrite d8/da/d34/f39 [0,4194304] 0 2024-09-11T00:07:12.871 INFO:tasks.workunit.client.1.smithi203.stdout:6/319: mknod d0/d27/c60 0 2024-09-11T00:07:12.875 INFO:tasks.workunit.client.1.smithi203.stdout:7/332: creat dd/d1c/d7c/f7d x:0 0 0 2024-09-11T00:07:12.878 INFO:tasks.workunit.client.1.smithi203.stdout:1/432: dread d8/d9/d15/d27/f39 [0,4194304] 0 2024-09-11T00:07:12.880 INFO:tasks.workunit.client.1.smithi203.stdout:9/342: read d6/de/d19/f1b [45589,42502] 0 2024-09-11T00:07:12.881 INFO:tasks.workunit.client.1.smithi203.stdout:6/320: readlink d0/l1f 0 2024-09-11T00:07:12.883 INFO:tasks.workunit.client.1.smithi203.stdout:7/333: fsync dd/d1c/d4b/f65 0 2024-09-11T00:07:12.884 INFO:tasks.workunit.client.1.smithi203.stdout:9/343: readlink d6/lc 0 2024-09-11T00:07:12.885 INFO:tasks.workunit.client.1.smithi203.stdout:5/411: creat dc/f87 x:0 0 0 2024-09-11T00:07:12.886 INFO:tasks.workunit.client.1.smithi203.stdout:8/346: mkdir d1/d78 0 2024-09-11T00:07:12.888 INFO:tasks.workunit.client.1.smithi203.stdout:1/433: write d8/d19/d31/f88 [940516,88119] 0 2024-09-11T00:07:12.888 INFO:tasks.workunit.client.1.smithi203.stdout:4/344: dwrite db/f49 [0,4194304] 0 2024-09-11T00:07:12.893 INFO:tasks.workunit.client.1.smithi203.stdout:3/468: write d8/da/d5c/d6b/d6c/f7b [5000032,74358] 0 2024-09-11T00:07:12.894 INFO:tasks.workunit.client.1.smithi203.stdout:9/344: chown d6/de/d32/d52/f4b 12221914 1 2024-09-11T00:07:12.895 INFO:tasks.workunit.client.0.smithi111.stdout:4/308: creat d18/d3b/d51/f63 x:0 0 0 2024-09-11T00:07:12.896 INFO:tasks.workunit.client.1.smithi203.stdout:9/345: write d6/de/d19/f4c [1353905,41811] 0 2024-09-11T00:07:12.896 INFO:tasks.workunit.client.0.smithi111.stdout:5/352: write fd [877590,27840] 0 2024-09-11T00:07:12.901 INFO:tasks.workunit.client.0.smithi111.stdout:2/338: dwrite d0/d3/de/d3b/f58 [0,4194304] 0 2024-09-11T00:07:12.901 INFO:tasks.workunit.client.1.smithi203.stdout:7/334: mkdir dd/d1c/d7c/d7e 0 2024-09-11T00:07:12.905 INFO:tasks.workunit.client.1.smithi203.stdout:5/412: symlink dc/dd/d1e/d7b/l88 0 2024-09-11T00:07:12.909 INFO:tasks.workunit.client.1.smithi203.stdout:5/413: fsync dc/dd/d15/d3b/f63 0 2024-09-11T00:07:12.910 INFO:tasks.workunit.client.1.smithi203.stdout:4/345: mknod db/dd/d16/d38/d3c/d41/c6a 0 2024-09-11T00:07:12.911 INFO:tasks.workunit.client.1.smithi203.stdout:3/469: creat d8/da/d5c/d6b/d6c/fac x:0 0 0 2024-09-11T00:07:12.912 INFO:tasks.workunit.client.1.smithi203.stdout:4/346: readlink db/l20 0 2024-09-11T00:07:12.915 INFO:tasks.workunit.client.1.smithi203.stdout:5/414: chown dc/dd/d15/d3b 16381250 1 2024-09-11T00:07:12.917 INFO:tasks.workunit.client.1.smithi203.stdout:9/346: creat d6/de/d19/d24/f6d x:0 0 0 2024-09-11T00:07:12.921 INFO:tasks.workunit.client.1.smithi203.stdout:5/415: write dc/d4f/d5c/f77 [717000,97273] 0 2024-09-11T00:07:12.922 INFO:tasks.workunit.client.1.smithi203.stdout:0/373: dread d0/f15 [0,4194304] 0 2024-09-11T00:07:12.925 INFO:tasks.workunit.client.1.smithi203.stdout:6/321: creat d0/d54/f61 x:0 0 0 2024-09-11T00:07:12.926 INFO:tasks.workunit.client.1.smithi203.stdout:9/347: readlink d6/de/d19/d24/l5c 0 2024-09-11T00:07:12.928 INFO:tasks.workunit.client.1.smithi203.stdout:8/347: dwrite d1/d13/d43/d46/f6d [0,4194304] 0 2024-09-11T00:07:12.929 INFO:tasks.workunit.client.1.smithi203.stdout:7/335: fsync dd/f37 0 2024-09-11T00:07:12.932 INFO:tasks.workunit.client.1.smithi203.stdout:0/374: fdatasync d0/d2/f32 0 2024-09-11T00:07:12.934 INFO:tasks.workunit.client.0.smithi111.stdout:8/400: sync 2024-09-11T00:07:12.935 INFO:tasks.workunit.client.1.smithi203.stdout:2/297: dwrite d13/d15/f1b [4194304,4194304] 0 2024-09-11T00:07:12.938 INFO:tasks.workunit.client.1.smithi203.stdout:0/375: chown d0/d2/f3 31 1 2024-09-11T00:07:12.938 INFO:tasks.workunit.client.1.smithi203.stdout:5/416: creat dc/dd/f89 x:0 0 0 2024-09-11T00:07:12.940 INFO:tasks.workunit.client.0.smithi111.stdout:3/370: truncate d1c/d1d/f42 542501 0 2024-09-11T00:07:12.940 INFO:tasks.workunit.client.0.smithi111.stdout:0/358: creat d3/f80 x:0 0 0 2024-09-11T00:07:12.940 INFO:tasks.workunit.client.0.smithi111.stdout:7/336: fsync f7 0 2024-09-11T00:07:12.943 INFO:tasks.workunit.client.0.smithi111.stdout:4/309: readlink d18/l1c 0 2024-09-11T00:07:12.943 INFO:tasks.workunit.client.0.smithi111.stdout:5/353: fdatasync d10/d1e/d23/d30/d3c/f4e 0 2024-09-11T00:07:12.944 INFO:tasks.workunit.client.1.smithi203.stdout:1/434: dwrite d8/d19/d31/f59 [0,4194304] 0 2024-09-11T00:07:12.949 INFO:tasks.workunit.client.1.smithi203.stdout:6/322: fdatasync d0/d27/f18 0 2024-09-11T00:07:12.950 INFO:tasks.workunit.client.0.smithi111.stdout:0/359: read f2 [3393513,95107] 0 2024-09-11T00:07:12.950 INFO:tasks.workunit.client.1.smithi203.stdout:3/470: dread d8/fb [0,4194304] 0 2024-09-11T00:07:12.952 INFO:tasks.workunit.client.1.smithi203.stdout:6/323: dread - d0/d27/d35/f3e zero size 2024-09-11T00:07:12.953 INFO:tasks.workunit.client.0.smithi111.stdout:9/371: getdents d6/db/d1b/d74 0 2024-09-11T00:07:12.954 INFO:tasks.workunit.client.0.smithi111.stdout:7/337: mknod dd/d49/c6d 0 2024-09-11T00:07:12.959 INFO:tasks.workunit.client.0.smithi111.stdout:6/279: sync 2024-09-11T00:07:12.960 INFO:tasks.workunit.client.0.smithi111.stdout:1/306: dwrite d2/de/d12/d39/d3a/f40 [0,4194304] 0 2024-09-11T00:07:12.961 INFO:tasks.workunit.client.0.smithi111.stdout:5/354: fdatasync d10/d1e/d23/d30/f37 0 2024-09-11T00:07:12.965 INFO:tasks.workunit.client.1.smithi203.stdout:2/298: dwrite d13/d15/f32 [0,4194304] 0 2024-09-11T00:07:12.968 INFO:tasks.workunit.client.0.smithi111.stdout:8/401: dwrite d11/d23/d3d/d5f/f62 [0,4194304] 0 2024-09-11T00:07:12.969 INFO:tasks.workunit.client.0.smithi111.stdout:9/372: rmdir d6/dc/d73 39 2024-09-11T00:07:12.970 INFO:tasks.workunit.client.1.smithi203.stdout:4/347: rename db/c35 to db/d12/c6b 0 2024-09-11T00:07:12.971 INFO:tasks.workunit.client.0.smithi111.stdout:6/280: write d7/d22/d2c/f4e [2492574,22093] 0 2024-09-11T00:07:12.972 INFO:tasks.workunit.client.1.smithi203.stdout:3/471: mkdir d8/da/d37/d83/d6a/dad 0 2024-09-11T00:07:12.974 INFO:tasks.workunit.client.1.smithi203.stdout:5/417: symlink dc/l8a 0 2024-09-11T00:07:12.975 INFO:tasks.workunit.client.0.smithi111.stdout:8/402: chown d11/d23/d2c/f6b 3502 1 2024-09-11T00:07:12.976 INFO:tasks.workunit.client.0.smithi111.stdout:6/281: readlink d7/d22/d26/l55 0 2024-09-11T00:07:12.977 INFO:tasks.workunit.client.1.smithi203.stdout:8/348: link d1/d13/d22/d6f/f60 d1/d13/d17/d77/f79 0 2024-09-11T00:07:12.982 INFO:tasks.workunit.client.0.smithi111.stdout:7/338: symlink dd/l6e 0 2024-09-11T00:07:12.985 INFO:tasks.workunit.client.0.smithi111.stdout:7/339: truncate dd/d49/f4c 685139 0 2024-09-11T00:07:12.986 INFO:tasks.workunit.client.0.smithi111.stdout:4/310: dwrite d18/d20/d3c/f58 [0,4194304] 0 2024-09-11T00:07:12.986 INFO:tasks.workunit.client.0.smithi111.stdout:5/355: rename d10/d1e/f2a to d10/d1e/d25/f75 0 2024-09-11T00:07:12.991 INFO:tasks.workunit.client.0.smithi111.stdout:8/403: truncate d11/d21/d38/f52 1139598 0 2024-09-11T00:07:12.992 INFO:tasks.workunit.client.1.smithi203.stdout:3/472: mknod d8/d17/cae 0 2024-09-11T00:07:12.994 INFO:tasks.workunit.client.1.smithi203.stdout:8/349: rmdir d1/d13 39 2024-09-11T00:07:12.995 INFO:tasks.workunit.client.1.smithi203.stdout:0/376: creat d0/d2/f7a x:0 0 0 2024-09-11T00:07:12.996 INFO:tasks.workunit.client.1.smithi203.stdout:9/348: link d6/de/l1e d6/de/l6e 0 2024-09-11T00:07:12.997 INFO:tasks.workunit.client.0.smithi111.stdout:7/340: truncate dd/d1d/d1f/f5e 4256637 0 2024-09-11T00:07:12.997 INFO:tasks.workunit.client.1.smithi203.stdout:2/299: symlink d13/d22/d53/l5b 0 2024-09-11T00:07:12.999 INFO:tasks.workunit.client.0.smithi111.stdout:3/371: dread d1c/d1d/d22/d23/f40 [4194304,4194304] 0 2024-09-11T00:07:13.001 INFO:tasks.workunit.client.1.smithi203.stdout:6/324: getdents d0/d5b 0 2024-09-11T00:07:13.003 INFO:tasks.workunit.client.1.smithi203.stdout:9/349: dread - d6/de/d19/d21/f56 zero size 2024-09-11T00:07:13.009 INFO:tasks.workunit.client.1.smithi203.stdout:0/377: rmdir d0 39 2024-09-11T00:07:13.012 INFO:tasks.workunit.client.1.smithi203.stdout:4/348: creat db/f6c x:0 0 0 2024-09-11T00:07:13.014 INFO:tasks.workunit.client.0.smithi111.stdout:4/311: creat d18/d20/d4a/f64 x:0 0 0 2024-09-11T00:07:13.014 INFO:tasks.workunit.client.0.smithi111.stdout:0/360: write d3/dc/f12 [3572293,130201] 0 2024-09-11T00:07:13.019 INFO:tasks.workunit.client.0.smithi111.stdout:2/339: truncate d0/f22 6559700 0 2024-09-11T00:07:13.020 INFO:tasks.workunit.client.0.smithi111.stdout:1/307: dread d2/d2b/f3e [0,4194304] 0 2024-09-11T00:07:13.021 INFO:tasks.workunit.client.1.smithi203.stdout:6/325: truncate d0/f5 406268 0 2024-09-11T00:07:13.021 INFO:tasks.workunit.client.1.smithi203.stdout:7/336: dwrite dd/f1a [4194304,4194304] 0 2024-09-11T00:07:13.022 INFO:tasks.workunit.client.0.smithi111.stdout:8/404: rename d11/c24 to d11/d23/d7e/c82 0 2024-09-11T00:07:13.025 INFO:tasks.workunit.client.0.smithi111.stdout:5/356: mkdir d10/d1e/d23/d30/d46/d47/d66/d76 0 2024-09-11T00:07:13.025 INFO:tasks.workunit.client.1.smithi203.stdout:8/350: mkdir d1/d13/d17/d2f/d52/d49/d7a 0 2024-09-11T00:07:13.028 INFO:tasks.workunit.client.1.smithi203.stdout:6/326: dread d0/f4f [0,4194304] 0 2024-09-11T00:07:13.028 INFO:tasks.workunit.client.1.smithi203.stdout:9/350: stat d6/de/d19/d24/d40/d45/l58 0 2024-09-11T00:07:13.029 INFO:tasks.workunit.client.0.smithi111.stdout:7/341: creat dd/d48/d69/f6f x:0 0 0 2024-09-11T00:07:13.031 INFO:tasks.workunit.client.1.smithi203.stdout:9/351: dread - d6/de/d19/f3e zero size 2024-09-11T00:07:13.031 INFO:tasks.workunit.client.0.smithi111.stdout:7/342: read f8 [1434562,28094] 0 2024-09-11T00:07:13.031 INFO:tasks.workunit.client.0.smithi111.stdout:3/372: symlink d1c/d1d/d22/d23/d58/d5c/l7f 0 2024-09-11T00:07:13.036 INFO:tasks.workunit.client.1.smithi203.stdout:2/300: getdents d13/d15/d30/d59 0 2024-09-11T00:07:13.037 INFO:tasks.workunit.client.0.smithi111.stdout:3/373: fdatasync d1c/d1d/d22/d23/d58/d5c/f6d 0 2024-09-11T00:07:13.037 INFO:tasks.workunit.client.0.smithi111.stdout:0/361: readlink d3/d1c/l3d 0 2024-09-11T00:07:13.038 INFO:tasks.workunit.client.0.smithi111.stdout:7/343: fsync dd/d1d/d1f/f50 0 2024-09-11T00:07:13.039 INFO:tasks.workunit.client.1.smithi203.stdout:4/349: unlink db/dd/d16/d38/d3c/d41/c54 0 2024-09-11T00:07:13.042 INFO:tasks.workunit.client.1.smithi203.stdout:1/435: truncate d8/d9/d15/f47 135 0 2024-09-11T00:07:13.043 INFO:tasks.workunit.client.0.smithi111.stdout:6/282: write d7/f30 [1289391,49928] 0 2024-09-11T00:07:13.044 INFO:tasks.workunit.client.0.smithi111.stdout:4/312: rename cd to d18/d3b/d61/c65 0 2024-09-11T00:07:13.047 INFO:tasks.workunit.client.0.smithi111.stdout:8/405: unlink d11/d23/d3d/d5f/f6a 0 2024-09-11T00:07:13.048 INFO:tasks.workunit.client.0.smithi111.stdout:1/308: dwrite d2/de/f29 [0,4194304] 0 2024-09-11T00:07:13.048 INFO:tasks.workunit.client.0.smithi111.stdout:0/362: write d3/d13/d1e/d29/d49/d51/f71 [1033361,107465] 0 2024-09-11T00:07:13.049 INFO:tasks.workunit.client.1.smithi203.stdout:7/337: mkdir dd/d4d/d7f 0 2024-09-11T00:07:13.050 INFO:tasks.workunit.client.1.smithi203.stdout:8/351: dread d1/d13/d17/d48/d61/f71 [0,4194304] 0 2024-09-11T00:07:13.051 INFO:tasks.workunit.client.0.smithi111.stdout:2/340: dwrite d0/d3/de/d3b/d62/f78 [0,4194304] 0 2024-09-11T00:07:13.052 INFO:tasks.workunit.client.0.smithi111.stdout:0/363: stat d3/d13/d1e 0 2024-09-11T00:07:13.053 INFO:tasks.workunit.client.1.smithi203.stdout:6/327: unlink d0/d27/d35/d39/d3c/f4c 0 2024-09-11T00:07:13.055 INFO:tasks.workunit.client.1.smithi203.stdout:0/378: readlink d0/d2/l28 0 2024-09-11T00:07:13.056 INFO:tasks.workunit.client.0.smithi111.stdout:0/364: write d3/d13/d1e/d29/f53 [2219459,10801] 0 2024-09-11T00:07:13.056 INFO:tasks.workunit.client.0.smithi111.stdout:9/373: link d6/ca d6/dc/c76 0 2024-09-11T00:07:13.057 INFO:tasks.workunit.client.1.smithi203.stdout:9/352: creat d6/de/d19/d24/f6f x:0 0 0 2024-09-11T00:07:13.057 INFO:tasks.workunit.client.1.smithi203.stdout:6/328: write d0/d27/d35/d39/f51 [703429,115199] 0 2024-09-11T00:07:13.059 INFO:tasks.workunit.client.0.smithi111.stdout:7/344: creat dd/d1d/d2d/d2e/f70 x:0 0 0 2024-09-11T00:07:13.059 INFO:tasks.workunit.client.0.smithi111.stdout:9/374: chown d6/db/d34/l5d 34 1 2024-09-11T00:07:13.060 INFO:tasks.workunit.client.0.smithi111.stdout:9/375: write d6/f38 [935977,64997] 0 2024-09-11T00:07:13.060 INFO:tasks.workunit.client.1.smithi203.stdout:9/353: read - d6/de/d19/f31 zero size 2024-09-11T00:07:13.063 INFO:tasks.workunit.client.0.smithi111.stdout:7/345: chown dd/d49/f4c 0 1 2024-09-11T00:07:13.065 INFO:tasks.workunit.client.1.smithi203.stdout:9/354: read d6/f64 [275202,96656] 0 2024-09-11T00:07:13.065 INFO:tasks.workunit.client.1.smithi203.stdout:1/436: mkdir d8/d19/d60/d90/d3e/d4b/d80/d91 0 2024-09-11T00:07:13.067 INFO:tasks.workunit.client.1.smithi203.stdout:4/350: dread db/dd/d26/f3f [0,4194304] 0 2024-09-11T00:07:13.071 INFO:tasks.workunit.client.0.smithi111.stdout:1/309: dread d2/de/f29 [0,4194304] 0 2024-09-11T00:07:13.072 INFO:tasks.workunit.client.0.smithi111.stdout:3/374: rename d1c/d1d/l2a to d1c/d1d/d22/d31/d33/d5f/l80 0 2024-09-11T00:07:13.073 INFO:tasks.workunit.client.0.smithi111.stdout:1/310: stat d2/d2b/d2c/f50 0 2024-09-11T00:07:13.075 INFO:tasks.workunit.client.0.smithi111.stdout:3/375: truncate d1c/f5e 614544 0 2024-09-11T00:07:13.078 INFO:tasks.workunit.client.1.smithi203.stdout:8/352: rmdir d1/d13/d17/d77 39 2024-09-11T00:07:13.082 INFO:tasks.workunit.client.0.smithi111.stdout:5/357: truncate d10/d1e/d25/f75 2429500 0 2024-09-11T00:07:13.083 INFO:tasks.workunit.client.1.smithi203.stdout:3/473: link d8/da/d11/c42 d8/da/caf 0 2024-09-11T00:07:13.086 INFO:tasks.workunit.client.1.smithi203.stdout:2/301: symlink d13/d15/d30/d59/l5c 0 2024-09-11T00:07:13.091 INFO:tasks.workunit.client.1.smithi203.stdout:6/329: creat d0/d27/d35/d39/f62 x:0 0 0 2024-09-11T00:07:13.094 INFO:tasks.workunit.client.0.smithi111.stdout:7/346: creat dd/d48/d69/f71 x:0 0 0 2024-09-11T00:07:13.096 INFO:tasks.workunit.client.1.smithi203.stdout:9/355: mknod d6/de/d32/c70 0 2024-09-11T00:07:13.097 INFO:tasks.workunit.client.0.smithi111.stdout:8/406: fdatasync d11/d21/d38/d54/f75 0 2024-09-11T00:07:13.100 INFO:tasks.workunit.client.0.smithi111.stdout:4/313: dread d18/d20/d4a/f2c [0,4194304] 0 2024-09-11T00:07:13.101 INFO:tasks.workunit.client.1.smithi203.stdout:7/338: dread fc [0,4194304] 0 2024-09-11T00:07:13.101 INFO:tasks.workunit.client.1.smithi203.stdout:9/356: dread d6/de/d19/f1b [0,4194304] 0 2024-09-11T00:07:13.102 INFO:tasks.workunit.client.0.smithi111.stdout:1/311: symlink d2/d2b/d2c/l66 0 2024-09-11T00:07:13.103 INFO:tasks.workunit.client.1.smithi203.stdout:9/357: chown d6/de/d32/d52 10 1 2024-09-11T00:07:13.104 INFO:tasks.workunit.client.1.smithi203.stdout:7/339: write dd/d1c/d4b/f75 [973071,48764] 0 2024-09-11T00:07:13.106 INFO:tasks.workunit.client.0.smithi111.stdout:2/341: dread d0/d3/de/f43 [0,4194304] 0 2024-09-11T00:07:13.106 INFO:tasks.workunit.client.0.smithi111.stdout:1/312: truncate d2/d2b/d2c/d56/f5b 952284 0 2024-09-11T00:07:13.108 INFO:tasks.workunit.client.0.smithi111.stdout:3/376: creat d1c/d1d/d22/d23/d2f/d63/f81 x:0 0 0 2024-09-11T00:07:13.110 INFO:tasks.workunit.client.1.smithi203.stdout:9/358: write d6/de/d19/f3e [205827,82075] 0 2024-09-11T00:07:13.113 INFO:tasks.workunit.client.0.smithi111.stdout:5/358: creat d10/d1e/d23/d2b/d55/f77 x:0 0 0 2024-09-11T00:07:13.114 INFO:tasks.workunit.client.1.smithi203.stdout:0/379: mknod d0/d1d/d5d/d70/c7b 0 2024-09-11T00:07:13.114 INFO:tasks.workunit.client.0.smithi111.stdout:8/407: dwrite f8 [4194304,4194304] 0 2024-09-11T00:07:13.115 INFO:tasks.workunit.client.0.smithi111.stdout:5/359: chown d10/d1e/d23/d26/f3e 5 1 2024-09-11T00:07:13.117 INFO:tasks.workunit.client.1.smithi203.stdout:3/474: symlink d8/da/d37/lb0 0 2024-09-11T00:07:13.119 INFO:tasks.workunit.client.0.smithi111.stdout:9/376: creat d6/dc/d73/f77 x:0 0 0 2024-09-11T00:07:13.121 INFO:tasks.workunit.client.0.smithi111.stdout:6/283: creat d7/d2b/f5b x:0 0 0 2024-09-11T00:07:13.122 INFO:tasks.workunit.client.1.smithi203.stdout:0/380: truncate d0/d2/f32 1438995 0 2024-09-11T00:07:13.124 INFO:tasks.workunit.client.1.smithi203.stdout:3/475: truncate d8/d3c/f5a 9068790 0 2024-09-11T00:07:13.128 INFO:tasks.workunit.client.1.smithi203.stdout:3/476: write d8/da/d5c/f61 [3290084,57502] 0 2024-09-11T00:07:13.131 INFO:tasks.workunit.client.1.smithi203.stdout:3/477: dread - d8/da/d5c/f8d zero size 2024-09-11T00:07:13.132 INFO:tasks.workunit.client.0.smithi111.stdout:4/314: creat d18/d39/f66 x:0 0 0 2024-09-11T00:07:13.133 INFO:tasks.workunit.client.1.smithi203.stdout:3/478: chown d8/da/l73 2526 1 2024-09-11T00:07:13.136 INFO:tasks.workunit.client.1.smithi203.stdout:7/340: dwrite dd/d4d/f7a [0,4194304] 0 2024-09-11T00:07:13.136 INFO:tasks.workunit.client.1.smithi203.stdout:3/479: stat d8/da/f97 0 2024-09-11T00:07:13.137 INFO:tasks.workunit.client.0.smithi111.stdout:1/313: mknod d2/d2b/d2c/c67 0 2024-09-11T00:07:13.138 INFO:tasks.workunit.client.0.smithi111.stdout:2/342: creat d0/d3/de/d4b/f7a x:0 0 0 2024-09-11T00:07:13.139 INFO:tasks.workunit.client.0.smithi111.stdout:6/284: dread f3 [0,4194304] 0 2024-09-11T00:07:13.142 INFO:tasks.workunit.client.0.smithi111.stdout:8/408: dwrite d11/d23/d2c/d46/f63 [0,4194304] 0 2024-09-11T00:07:13.145 INFO:tasks.workunit.client.1.smithi203.stdout:9/359: mknod d6/de/d19/d24/d40/c71 0 2024-09-11T00:07:13.145 INFO:tasks.workunit.client.0.smithi111.stdout:5/360: mkdir d10/d1e/d23/d26/d78 0 2024-09-11T00:07:13.149 INFO:tasks.workunit.client.1.smithi203.stdout:0/381: creat d0/d2/d3d/d5a/f7c x:0 0 0 2024-09-11T00:07:13.149 INFO:tasks.workunit.client.0.smithi111.stdout:3/377: dread d1c/d1d/f20 [0,4194304] 0 2024-09-11T00:07:13.153 INFO:tasks.workunit.client.0.smithi111.stdout:3/378: write d1c/d21/f7d [367568,33973] 0 2024-09-11T00:07:13.157 INFO:tasks.workunit.client.0.smithi111.stdout:1/314: creat d2/de/d12/d39/d3a/f68 x:0 0 0 2024-09-11T00:07:13.159 INFO:tasks.workunit.client.0.smithi111.stdout:4/315: dwrite d18/d20/f46 [0,4194304] 0 2024-09-11T00:07:13.159 INFO:tasks.workunit.client.1.smithi203.stdout:7/341: creat dd/d3b/d5b/f80 x:0 0 0 2024-09-11T00:07:13.164 INFO:tasks.workunit.client.1.smithi203.stdout:8/353: write d1/d13/d17/f38 [564853,129355] 0 2024-09-11T00:07:13.170 INFO:tasks.workunit.client.0.smithi111.stdout:0/365: getdents d3/d13/d1e 0 2024-09-11T00:07:13.171 INFO:tasks.workunit.client.1.smithi203.stdout:0/382: symlink d0/d2/d37/d5b/d73/l7d 0 2024-09-11T00:07:13.177 INFO:tasks.workunit.client.1.smithi203.stdout:1/437: getdents d8/d19/d60/d90/d3e/d4b/d3a 0 2024-09-11T00:07:13.180 INFO:tasks.workunit.client.1.smithi203.stdout:6/330: write d0/d27/d35/d38/f49 [4405612,131001] 0 2024-09-11T00:07:13.183 INFO:tasks.workunit.client.0.smithi111.stdout:9/377: mknod d6/db/d34/d37/d4c/c78 0 2024-09-11T00:07:13.185 INFO:tasks.workunit.client.0.smithi111.stdout:7/347: dwrite dd/d1d/d1f/d24/f2f [0,4194304] 0 2024-09-11T00:07:13.186 INFO:tasks.workunit.client.1.smithi203.stdout:4/351: dwrite db/dd/d26/f2f [0,4194304] 0 2024-09-11T00:07:13.189 INFO:tasks.workunit.client.1.smithi203.stdout:6/331: dread - d0/d27/d35/f3e zero size 2024-09-11T00:07:13.190 INFO:tasks.workunit.client.0.smithi111.stdout:2/343: dread d0/d3/de/f21 [0,4194304] 0 2024-09-11T00:07:13.191 INFO:tasks.workunit.client.0.smithi111.stdout:3/379: unlink d1c/d1d/d22/d31/d33/f39 0 2024-09-11T00:07:13.194 INFO:tasks.workunit.client.0.smithi111.stdout:3/380: stat d1c/d1d/d22/d23/d2f/d63 0 2024-09-11T00:07:13.195 INFO:tasks.workunit.client.1.smithi203.stdout:2/302: getdents d13/d15/d19 0 2024-09-11T00:07:13.198 INFO:tasks.workunit.client.1.smithi203.stdout:4/352: chown db/f57 2024 1 2024-09-11T00:07:13.198 INFO:tasks.workunit.client.1.smithi203.stdout:0/383: dread - d0/d1d/f44 zero size 2024-09-11T00:07:13.199 INFO:tasks.workunit.client.0.smithi111.stdout:4/316: truncate d18/d1f/d36/f38 434149 0 2024-09-11T00:07:13.200 INFO:tasks.workunit.client.1.smithi203.stdout:3/480: dread d8/da/d37/f3f [0,4194304] 0 2024-09-11T00:07:13.200 INFO:tasks.workunit.client.0.smithi111.stdout:4/317: stat d18/d1f 0 2024-09-11T00:07:13.201 INFO:tasks.workunit.client.1.smithi203.stdout:7/342: mknod dd/d3b/d5b/d6a/d31/d67/c81 0 2024-09-11T00:07:13.201 INFO:tasks.workunit.client.0.smithi111.stdout:0/366: creat d3/d26/f81 x:0 0 0 2024-09-11T00:07:13.202 INFO:tasks.workunit.client.0.smithi111.stdout:6/285: getdents d7/d22/d2d/d4a 0 2024-09-11T00:07:13.203 INFO:tasks.workunit.client.0.smithi111.stdout:0/367: fsync d3/d1c/f42 0 2024-09-11T00:07:13.205 INFO:tasks.workunit.client.1.smithi203.stdout:2/303: fdatasync d13/d15/d19/d1c/f2a 0 2024-09-11T00:07:13.205 INFO:tasks.workunit.client.1.smithi203.stdout:8/354: dwrite d1/d13/d22/f58 [0,4194304] 0 2024-09-11T00:07:13.205 INFO:tasks.workunit.client.0.smithi111.stdout:8/409: dread d11/f20 [0,4194304] 0 2024-09-11T00:07:13.208 INFO:tasks.workunit.client.1.smithi203.stdout:7/343: dread - dd/d3b/d5b/f80 zero size 2024-09-11T00:07:13.208 INFO:tasks.workunit.client.1.smithi203.stdout:0/384: chown d0/d2/d37/d5b/f5e 22449 1 2024-09-11T00:07:13.210 INFO:tasks.workunit.client.0.smithi111.stdout:0/368: write d3/f54 [1371013,130677] 0 2024-09-11T00:07:13.210 INFO:tasks.workunit.client.0.smithi111.stdout:7/348: unlink dd/f1e 0 2024-09-11T00:07:13.211 INFO:tasks.workunit.client.0.smithi111.stdout:0/369: chown d3/d13/d1e/f4d 1414295462 1 2024-09-11T00:07:13.213 INFO:tasks.workunit.client.1.smithi203.stdout:8/355: dread - d1/f3d zero size 2024-09-11T00:07:13.214 INFO:tasks.workunit.client.1.smithi203.stdout:7/344: chown dd/d3b/d5b/d6a/d31/d67/f79 42940 1 2024-09-11T00:07:13.215 INFO:tasks.workunit.client.1.smithi203.stdout:9/360: dwrite d6/de/d32/d52/d55/f3f [0,4194304] 0 2024-09-11T00:07:13.218 INFO:tasks.workunit.client.1.smithi203.stdout:8/356: chown d1/d13/d43/d46/f6d 5521785 1 2024-09-11T00:07:13.219 INFO:tasks.workunit.client.0.smithi111.stdout:5/361: symlink d10/d1e/d23/d30/d46/d47/d66/d76/l79 0 2024-09-11T00:07:13.224 INFO:tasks.workunit.client.0.smithi111.stdout:9/378: dwrite d6/db/d1b/f1e [0,4194304] 0 2024-09-11T00:07:13.228 INFO:tasks.workunit.client.0.smithi111.stdout:0/370: dwrite d3/d1c/f23 [0,4194304] 0 2024-09-11T00:07:13.229 INFO:tasks.workunit.client.1.smithi203.stdout:1/438: rename d8/d9/f1e to d8/d19/d60/d90/d3e/d4b/f92 0 2024-09-11T00:07:13.230 INFO:tasks.workunit.client.1.smithi203.stdout:5/418: sync 2024-09-11T00:07:13.233 INFO:tasks.workunit.client.1.smithi203.stdout:1/439: fsync d8/f1a 0 2024-09-11T00:07:13.234 INFO:tasks.workunit.client.0.smithi111.stdout:9/379: write d6/db/d34/d37/f32 [1933687,55254] 0 2024-09-11T00:07:13.234 INFO:tasks.workunit.client.0.smithi111.stdout:0/371: read d3/da/ff [21359,74430] 0 2024-09-11T00:07:13.234 INFO:tasks.workunit.client.0.smithi111.stdout:2/344: unlink d0/d3/de/d3b/l79 0 2024-09-11T00:07:13.234 INFO:tasks.workunit.client.0.smithi111.stdout:9/380: stat d6/db/d34/d37/f2d 0 2024-09-11T00:07:13.234 INFO:tasks.workunit.client.0.smithi111.stdout:0/372: readlink d3/l30 0 2024-09-11T00:07:13.234 INFO:tasks.workunit.client.1.smithi203.stdout:5/419: fdatasync dc/dd/d4d/f81 0 2024-09-11T00:07:13.235 INFO:tasks.workunit.client.1.smithi203.stdout:5/420: stat dc/dd/d15 0 2024-09-11T00:07:13.235 INFO:tasks.workunit.client.0.smithi111.stdout:9/381: write d6/f38 [1970911,61988] 0 2024-09-11T00:07:13.236 INFO:tasks.workunit.client.0.smithi111.stdout:0/373: readlink d3/dc/l78 0 2024-09-11T00:07:13.236 INFO:tasks.workunit.client.0.smithi111.stdout:2/345: chown d0/d3/d12/f5f 94280 1 2024-09-11T00:07:13.237 INFO:tasks.workunit.client.1.smithi203.stdout:7/345: dread dd/d3b/d5b/d6a/d31/f62 [4194304,4194304] 0 2024-09-11T00:07:13.242 INFO:tasks.workunit.client.0.smithi111.stdout:1/315: creat d2/de/d12/d3c/f69 x:0 0 0 2024-09-11T00:07:13.243 INFO:tasks.workunit.client.1.smithi203.stdout:8/357: dwrite d1/d13/d22/f58 [0,4194304] 0 2024-09-11T00:07:13.245 INFO:tasks.workunit.client.0.smithi111.stdout:1/316: readlink d2/de/d12/d39/l57 0 2024-09-11T00:07:13.245 INFO:tasks.workunit.client.1.smithi203.stdout:0/385: chown d0/d2/la 1699 1 2024-09-11T00:07:13.246 INFO:tasks.workunit.client.1.smithi203.stdout:8/358: write d1/f37 [3296872,111859] 0 2024-09-11T00:07:13.247 INFO:tasks.workunit.client.0.smithi111.stdout:1/317: write d2/d2b/d2c/f42 [3758363,122958] 0 2024-09-11T00:07:13.249 INFO:tasks.workunit.client.0.smithi111.stdout:3/381: unlink d1c/d1d/d22/d23/f40 0 2024-09-11T00:07:13.256 INFO:tasks.workunit.client.0.smithi111.stdout:4/318: creat d18/d3b/d51/f67 x:0 0 0 2024-09-11T00:07:13.256 INFO:tasks.workunit.client.1.smithi203.stdout:9/361: mknod d6/de/d32/c72 0 2024-09-11T00:07:13.257 INFO:tasks.workunit.client.0.smithi111.stdout:6/286: mknod d7/d22/d2c/c5c 0 2024-09-11T00:07:13.259 INFO:tasks.workunit.client.1.smithi203.stdout:3/481: mknod d8/da/cb1 0 2024-09-11T00:07:13.268 INFO:tasks.workunit.client.0.smithi111.stdout:8/410: unlink d11/d23/d2c/d53/c78 0 2024-09-11T00:07:13.270 INFO:tasks.workunit.client.0.smithi111.stdout:8/411: fdatasync d11/d21/d38/f5e 0 2024-09-11T00:07:13.270 INFO:tasks.workunit.client.0.smithi111.stdout:7/349: symlink dd/d49/l72 0 2024-09-11T00:07:13.272 INFO:tasks.workunit.client.1.smithi203.stdout:5/421: symlink dc/dd/d1e/d7b/l8b 0 2024-09-11T00:07:13.272 INFO:tasks.workunit.client.0.smithi111.stdout:7/350: read - dd/d48/d69/f6b zero size 2024-09-11T00:07:13.273 INFO:tasks.workunit.client.1.smithi203.stdout:9/362: dwrite d6/de/d19/d24/f36 [0,4194304] 0 2024-09-11T00:07:13.273 INFO:tasks.workunit.client.0.smithi111.stdout:7/351: chown dd/d1d/d4d 3 1 2024-09-11T00:07:13.275 INFO:tasks.workunit.client.1.smithi203.stdout:9/363: readlink d6/de/d19/d24/l5c 0 2024-09-11T00:07:13.288 INFO:tasks.workunit.client.0.smithi111.stdout:7/352: dwrite dd/d1d/d2d/d2e/f40 [0,4194304] 0 2024-09-11T00:07:13.293 INFO:tasks.workunit.client.0.smithi111.stdout:0/374: rmdir d3/d13/d1e/d29 39 2024-09-11T00:07:13.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:12 smithi203 ceph-mon[33225]: mgrmap e23: smithi203.smuspl(active, since 2s) 2024-09-11T00:07:13.295 INFO:tasks.workunit.client.0.smithi111.stdout:0/375: chown d3/d26/f81 2030424 1 2024-09-11T00:07:13.310 INFO:tasks.workunit.client.1.smithi203.stdout:5/422: dread dc/dd/d13/f48 [0,4194304] 0 2024-09-11T00:07:13.311 INFO:tasks.workunit.client.1.smithi203.stdout:1/440: unlink d8/d9/d15/d27/l2f 0 2024-09-11T00:07:13.312 INFO:tasks.workunit.client.1.smithi203.stdout:5/423: truncate dc/f87 295650 0 2024-09-11T00:07:13.315 INFO:tasks.workunit.client.0.smithi111.stdout:9/382: dwrite d6/db/d1b/f33 [0,4194304] 0 2024-09-11T00:07:13.315 INFO:tasks.workunit.client.0.smithi111.stdout:1/318: rename d2/de/d12/d39 to d2/de/d12/d3c/d4b/d6a 0 2024-09-11T00:07:13.315 INFO:tasks.workunit.client.1.smithi203.stdout:1/441: write d8/d28/d64/f65 [3895099,92609] 0 2024-09-11T00:07:13.317 INFO:tasks.workunit.client.0.smithi111.stdout:1/319: fsync d2/de/d12/d3c/f69 0 2024-09-11T00:07:13.323 INFO:tasks.workunit.client.1.smithi203.stdout:4/353: getdents db/dd/d16 0 2024-09-11T00:07:13.325 INFO:tasks.workunit.client.1.smithi203.stdout:7/346: dwrite dd/d1c/f29 [4194304,4194304] 0 2024-09-11T00:07:13.325 INFO:tasks.workunit.client.0.smithi111.stdout:6/287: mknod d7/d2b/d35/d41/c5d 0 2024-09-11T00:07:13.328 INFO:tasks.workunit.client.0.smithi111.stdout:8/412: creat d11/d23/d2c/d53/f83 x:0 0 0 2024-09-11T00:07:13.330 INFO:tasks.workunit.client.1.smithi203.stdout:0/386: mkdir d0/d2/d7e 0 2024-09-11T00:07:13.331 INFO:tasks.workunit.client.1.smithi203.stdout:7/347: write dd/d3b/f72 [12651,7793] 0 2024-09-11T00:07:13.340 INFO:tasks.workunit.client.0.smithi111.stdout:5/362: mkdir d10/d1e/d23/d26/d78/d7a 0 2024-09-11T00:07:13.341 INFO:tasks.workunit.client.1.smithi203.stdout:8/359: mknod d1/d78/c7b 0 2024-09-11T00:07:13.342 INFO:tasks.workunit.client.0.smithi111.stdout:6/288: dwrite d7/d2b/d35/f57 [0,4194304] 0 2024-09-11T00:07:13.344 INFO:tasks.workunit.client.1.smithi203.stdout:6/332: rename d0/f5 to d0/f63 0 2024-09-11T00:07:13.345 INFO:tasks.workunit.client.1.smithi203.stdout:6/333: write d0/f4 [1023167,106430] 0 2024-09-11T00:07:13.345 INFO:tasks.workunit.client.0.smithi111.stdout:6/289: write d7/fd [4369618,77474] 0 2024-09-11T00:07:13.347 INFO:tasks.workunit.client.0.smithi111.stdout:6/290: readlink d7/d22/d2d/l4b 0 2024-09-11T00:07:13.349 INFO:tasks.workunit.client.0.smithi111.stdout:6/291: chown f6 578192 1 2024-09-11T00:07:13.350 INFO:tasks.workunit.client.1.smithi203.stdout:5/424: symlink dc/d65/l8c 0 2024-09-11T00:07:13.352 INFO:tasks.workunit.client.1.smithi203.stdout:5/425: fsync dc/dd/d4d/d59/f46 0 2024-09-11T00:07:13.358 INFO:tasks.workunit.client.1.smithi203.stdout:1/442: symlink d8/d19/d60/l93 0 2024-09-11T00:07:13.361 INFO:tasks.workunit.client.0.smithi111.stdout:0/376: creat d3/d26/d77/f82 x:0 0 0 2024-09-11T00:07:13.362 INFO:tasks.workunit.client.0.smithi111.stdout:3/382: symlink d1c/l82 0 2024-09-11T00:07:13.365 INFO:tasks.workunit.client.0.smithi111.stdout:4/319: rename d18/d20/d3c/f4b to d18/d3b/d51/f68 0 2024-09-11T00:07:13.366 INFO:tasks.workunit.client.0.smithi111.stdout:3/383: truncate d1c/d1d/d22/d23/d2f/f7a 461509 0 2024-09-11T00:07:13.367 INFO:tasks.workunit.client.0.smithi111.stdout:4/320: stat d18/d20/d4a/f64 0 2024-09-11T00:07:13.367 INFO:tasks.workunit.client.0.smithi111.stdout:9/383: creat d6/db/f79 x:0 0 0 2024-09-11T00:07:13.367 INFO:tasks.workunit.client.0.smithi111.stdout:3/384: chown d1c/d1d/d22 23067787 1 2024-09-11T00:07:13.368 INFO:tasks.workunit.client.0.smithi111.stdout:4/321: chown d18/d3b/d51/f63 107 1 2024-09-11T00:07:13.369 INFO:tasks.workunit.client.1.smithi203.stdout:4/354: creat db/dd/d16/d38/d3c/d41/f6d x:0 0 0 2024-09-11T00:07:13.369 INFO:tasks.workunit.client.0.smithi111.stdout:9/384: readlink d6/db/d34/d37/d4c/l60 0 2024-09-11T00:07:13.369 INFO:tasks.workunit.client.0.smithi111.stdout:4/322: readlink d18/d20/l5c 0 2024-09-11T00:07:13.370 INFO:tasks.workunit.client.1.smithi203.stdout:4/355: read db/dd/d26/d42/f58 [1959437,55037] 0 2024-09-11T00:07:13.371 INFO:tasks.workunit.client.1.smithi203.stdout:7/348: symlink dd/d3b/l82 0 2024-09-11T00:07:13.372 INFO:tasks.workunit.client.0.smithi111.stdout:8/413: stat d11/d21/d6f/l71 0 2024-09-11T00:07:13.376 INFO:tasks.workunit.client.0.smithi111.stdout:2/346: creat d0/f7b x:0 0 0 2024-09-11T00:07:13.377 INFO:tasks.workunit.client.0.smithi111.stdout:5/363: read d10/d1e/d23/d2b/f33 [1602744,39765] 0 2024-09-11T00:07:13.380 INFO:tasks.workunit.client.0.smithi111.stdout:7/353: dread - dd/d48/d69/f71 zero size 2024-09-11T00:07:13.381 INFO:tasks.workunit.client.0.smithi111.stdout:7/354: read - dd/d48/d69/f71 zero size 2024-09-11T00:07:13.382 INFO:tasks.workunit.client.0.smithi111.stdout:3/385: mknod d1c/d1d/d22/d31/d62/c83 0 2024-09-11T00:07:13.383 INFO:tasks.workunit.client.0.smithi111.stdout:1/320: link d2/de/f43 d2/de/d12/d3c/d4b/d6a/d3a/f6b 0 2024-09-11T00:07:13.383 INFO:tasks.workunit.client.0.smithi111.stdout:3/386: chown d1c/d1d/d22/d23/d58/f75 1561336 1 2024-09-11T00:07:13.384 INFO:tasks.workunit.client.0.smithi111.stdout:9/385: dread - d6/db/d1b/d56/f63 zero size 2024-09-11T00:07:13.385 INFO:tasks.workunit.client.0.smithi111.stdout:4/323: unlink d18/d1f/d33/l35 0 2024-09-11T00:07:13.386 INFO:tasks.workunit.client.0.smithi111.stdout:4/324: fdatasync d18/d1f/f26 0 2024-09-11T00:07:13.388 INFO:tasks.workunit.client.0.smithi111.stdout:4/325: fdatasync d18/d20/f30 0 2024-09-11T00:07:13.393 INFO:tasks.workunit.client.0.smithi111.stdout:5/364: rename d10/d1e/d23/d30/d46/d47/d72 to d10/d1e/d23/d30/d59/d7b 0 2024-09-11T00:07:13.394 INFO:tasks.workunit.client.0.smithi111.stdout:0/377: creat d3/da/d7b/f83 x:0 0 0 2024-09-11T00:07:13.395 INFO:tasks.workunit.client.0.smithi111.stdout:9/386: mkdir d6/db/d7a 0 2024-09-11T00:07:13.398 INFO:tasks.workunit.client.1.smithi203.stdout:9/364: creat d6/de/d32/d52/f73 x:0 0 0 2024-09-11T00:07:13.399 INFO:tasks.workunit.client.1.smithi203.stdout:9/365: dread - d6/de/d19/d21/f56 zero size 2024-09-11T00:07:13.401 INFO:tasks.workunit.client.0.smithi111.stdout:7/355: mknod dd/c73 0 2024-09-11T00:07:13.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:12 smithi111 ceph-mon[27539]: mgrmap e23: smithi203.smuspl(active, since 2s) 2024-09-11T00:07:13.402 INFO:tasks.workunit.client.1.smithi203.stdout:4/356: creat db/dd/d16/f6e x:0 0 0 2024-09-11T00:07:13.403 INFO:tasks.workunit.client.0.smithi111.stdout:1/321: dwrite d2/d2b/d2c/f42 [0,4194304] 0 2024-09-11T00:07:13.404 INFO:tasks.workunit.client.0.smithi111.stdout:3/387: symlink d1c/l84 0 2024-09-11T00:07:13.406 INFO:tasks.workunit.client.0.smithi111.stdout:3/388: fsync d1c/d1d/d22/d23/f52 0 2024-09-11T00:07:13.407 INFO:tasks.workunit.client.0.smithi111.stdout:4/326: dread d18/d20/f46 [0,4194304] 0 2024-09-11T00:07:13.408 INFO:tasks.workunit.client.0.smithi111.stdout:3/389: write d1c/d1d/d22/f60 [751277,25575] 0 2024-09-11T00:07:13.417 INFO:tasks.workunit.client.1.smithi203.stdout:6/334: link d0/d54/f61 d0/d5b/f64 0 2024-09-11T00:07:13.419 INFO:tasks.workunit.client.0.smithi111.stdout:0/378: chown d3/d13/d1e/d29/d49/d51/d61/f6b 39975583 1 2024-09-11T00:07:13.423 INFO:tasks.workunit.client.1.smithi203.stdout:7/349: dwrite dd/d1c/f46 [4194304,4194304] 0 2024-09-11T00:07:13.425 INFO:tasks.workunit.client.1.smithi203.stdout:5/426: symlink dc/dd/d1e/l8d 0 2024-09-11T00:07:13.426 INFO:tasks.workunit.client.0.smithi111.stdout:8/414: dwrite d11/d23/d2c/f6b [0,4194304] 0 2024-09-11T00:07:13.432 INFO:tasks.workunit.client.1.smithi203.stdout:8/360: link d1/d13/d22/c23 d1/d13/d43/d46/d76/c7c 0 2024-09-11T00:07:13.436 INFO:tasks.workunit.client.0.smithi111.stdout:2/347: rename d0/d3/d2e/f5a to d0/d3/d12/d52/d6c/f7c 0 2024-09-11T00:07:13.438 INFO:tasks.workunit.client.1.smithi203.stdout:6/335: dwrite d0/f14 [0,4194304] 0 2024-09-11T00:07:13.442 INFO:tasks.workunit.client.0.smithi111.stdout:4/327: unlink d18/d3b/d51/f68 0 2024-09-11T00:07:13.443 INFO:tasks.workunit.client.0.smithi111.stdout:7/356: dread dd/f10 [0,4194304] 0 2024-09-11T00:07:13.443 INFO:tasks.workunit.client.1.smithi203.stdout:1/443: mknod d8/d19/d60/d90/d3e/d4b/d41/d7e/c94 0 2024-09-11T00:07:13.444 INFO:tasks.workunit.client.0.smithi111.stdout:3/390: symlink d1c/d1d/d22/d23/d58/d5c/l85 0 2024-09-11T00:07:13.451 INFO:tasks.workunit.client.1.smithi203.stdout:4/357: truncate db/dd/d26/f2f 742305 0 2024-09-11T00:07:13.453 INFO:tasks.workunit.client.1.smithi203.stdout:5/427: readlink dc/d2b/l7d 0 2024-09-11T00:07:13.457 INFO:tasks.workunit.client.1.smithi203.stdout:1/444: mknod d8/d19/c95 0 2024-09-11T00:07:13.461 INFO:tasks.workunit.client.1.smithi203.stdout:9/366: rename d6/de/f20 to d6/de/f74 0 2024-09-11T00:07:13.461 INFO:tasks.workunit.client.0.smithi111.stdout:9/387: rename d6/db/l2a to d6/d52/l7b 0 2024-09-11T00:07:13.462 INFO:tasks.workunit.client.1.smithi203.stdout:4/358: unlink db/d12/d15/f2d 0 2024-09-11T00:07:13.465 INFO:tasks.workunit.client.1.smithi203.stdout:5/428: rmdir dc/dd/d1e 39 2024-09-11T00:07:13.466 INFO:tasks.workunit.client.0.smithi111.stdout:4/328: mknod d18/d20/d4a/c69 0 2024-09-11T00:07:13.467 INFO:tasks.workunit.client.0.smithi111.stdout:4/329: stat d18/d20/d4e/l5d 0 2024-09-11T00:07:13.468 INFO:tasks.workunit.client.1.smithi203.stdout:8/361: creat d1/d13/d43/d46/d76/f7d x:0 0 0 2024-09-11T00:07:13.472 INFO:tasks.workunit.client.0.smithi111.stdout:3/391: mkdir d1c/d1d/d86 0 2024-09-11T00:07:13.474 INFO:tasks.workunit.client.1.smithi203.stdout:1/445: write d8/d9/d15/d27/f2e [4983821,47245] 0 2024-09-11T00:07:13.474 INFO:tasks.workunit.client.0.smithi111.stdout:5/365: link d10/d1e/d23/f48 d10/d1e/d23/d2b/d55/d6d/f7c 0 2024-09-11T00:07:13.479 INFO:tasks.workunit.client.0.smithi111.stdout:0/379: fdatasync d3/d13/d1e/d29/f3e 0 2024-09-11T00:07:13.482 INFO:tasks.workunit.client.0.smithi111.stdout:8/415: mknod d11/c84 0 2024-09-11T00:07:13.484 INFO:tasks.workunit.client.1.smithi203.stdout:8/362: dwrite d1/d13/f19 [4194304,4194304] 0 2024-09-11T00:07:13.489 INFO:tasks.workunit.client.0.smithi111.stdout:1/322: rmdir d2/de/d62 0 2024-09-11T00:07:13.491 INFO:tasks.workunit.client.1.smithi203.stdout:6/336: creat d0/d27/d35/f65 x:0 0 0 2024-09-11T00:07:13.498 INFO:tasks.workunit.client.0.smithi111.stdout:7/357: mknod dd/d1d/d4d/c74 0 2024-09-11T00:07:13.501 INFO:tasks.workunit.client.0.smithi111.stdout:0/380: mkdir d3/da/d7b/d84 0 2024-09-11T00:07:13.502 INFO:tasks.workunit.client.0.smithi111.stdout:3/392: dread f12 [4194304,4194304] 0 2024-09-11T00:07:13.503 INFO:tasks.workunit.client.1.smithi203.stdout:2/304: sync 2024-09-11T00:07:13.504 INFO:tasks.workunit.client.1.smithi203.stdout:4/359: mknod db/d12/c6f 0 2024-09-11T00:07:13.504 INFO:tasks.workunit.client.0.smithi111.stdout:9/388: mkdir d6/dc/d7c 0 2024-09-11T00:07:13.505 INFO:tasks.workunit.client.0.smithi111.stdout:1/323: dwrite d2/fd [0,4194304] 0 2024-09-11T00:07:13.505 INFO:tasks.workunit.client.0.smithi111.stdout:2/348: truncate d0/d3/de/f11 594 0 2024-09-11T00:07:13.505 INFO:tasks.workunit.client.0.smithi111.stdout:3/393: dread - d1c/d1d/d22/d23/d2f/d63/f6b zero size 2024-09-11T00:07:13.506 INFO:tasks.workunit.client.1.smithi203.stdout:7/350: dwrite dd/d3b/d5b/f7b [0,4194304] 0 2024-09-11T00:07:13.506 INFO:tasks.workunit.client.1.smithi203.stdout:8/363: rmdir d1/d13/d43 39 2024-09-11T00:07:13.506 INFO:tasks.workunit.client.1.smithi203.stdout:9/367: write d6/de/d19/d24/d40/d45/f39 [440401,23360] 0 2024-09-11T00:07:13.507 INFO:tasks.workunit.client.0.smithi111.stdout:2/349: fsync d0/d3/f37 0 2024-09-11T00:07:13.509 INFO:tasks.workunit.client.0.smithi111.stdout:7/358: read - dd/f63 zero size 2024-09-11T00:07:13.511 INFO:tasks.workunit.client.1.smithi203.stdout:9/368: dread - d6/de/d19/f31 zero size 2024-09-11T00:07:13.512 INFO:tasks.workunit.client.1.smithi203.stdout:8/364: dread - d1/d13/d17/f62 zero size 2024-09-11T00:07:13.514 INFO:tasks.workunit.client.0.smithi111.stdout:5/366: creat d10/d1e/d25/d6e/f7d x:0 0 0 2024-09-11T00:07:13.516 INFO:tasks.workunit.client.0.smithi111.stdout:5/367: readlink d10/l1d 0 2024-09-11T00:07:13.522 INFO:tasks.workunit.client.1.smithi203.stdout:2/305: write d13/f41 [301536,104501] 0 2024-09-11T00:07:13.522 INFO:tasks.workunit.client.1.smithi203.stdout:7/351: truncate dd/d3b/d5b/d6a/d31/f36 845669 0 2024-09-11T00:07:13.524 INFO:tasks.workunit.client.1.smithi203.stdout:2/306: stat d13/f17 0 2024-09-11T00:07:13.526 INFO:tasks.workunit.client.1.smithi203.stdout:5/429: getdents dc/d2b 0 2024-09-11T00:07:13.526 INFO:tasks.workunit.client.0.smithi111.stdout:3/394: creat d1c/d1d/d22/d31/f87 x:0 0 0 2024-09-11T00:07:13.528 INFO:tasks.workunit.client.1.smithi203.stdout:7/352: write dd/d1c/f78 [1034400,125385] 0 2024-09-11T00:07:13.528 INFO:tasks.workunit.client.1.smithi203.stdout:8/365: mknod d1/d13/d17/d48/d61/c7e 0 2024-09-11T00:07:13.529 INFO:tasks.workunit.client.0.smithi111.stdout:7/359: stat dd/f18 0 2024-09-11T00:07:13.529 INFO:tasks.workunit.client.0.smithi111.stdout:2/350: dwrite d0/d3/f4e [0,4194304] 0 2024-09-11T00:07:13.530 INFO:tasks.workunit.client.1.smithi203.stdout:2/307: creat d13/d47/f5d x:0 0 0 2024-09-11T00:07:13.530 INFO:tasks.workunit.client.1.smithi203.stdout:5/430: read dc/dd/d4d/f6a [1877341,2244] 0 2024-09-11T00:07:13.531 INFO:tasks.workunit.client.0.smithi111.stdout:7/360: truncate dd/f63 995434 0 2024-09-11T00:07:13.532 INFO:tasks.workunit.client.1.smithi203.stdout:9/369: rename d6/de/d32/d52/f4f to d6/de/d19/d24/d6c/f75 0 2024-09-11T00:07:13.532 INFO:tasks.workunit.client.0.smithi111.stdout:3/395: stat d1c/d1d/d22/d23/d2f/d63/f81 0 2024-09-11T00:07:13.533 INFO:tasks.workunit.client.0.smithi111.stdout:3/396: readlink d1c/d1d/d22/d23/l51 0 2024-09-11T00:07:13.539 INFO:tasks.workunit.client.1.smithi203.stdout:6/337: dread d0/f2d [0,4194304] 0 2024-09-11T00:07:13.542 INFO:tasks.workunit.client.0.smithi111.stdout:1/324: mkdir d2/de/d12/d6c 0 2024-09-11T00:07:13.543 INFO:tasks.workunit.client.0.smithi111.stdout:6/292: sync 2024-09-11T00:07:13.547 INFO:tasks.workunit.client.1.smithi203.stdout:4/360: dread db/dd/d26/d42/f58 [0,4194304] 0 2024-09-11T00:07:13.550 INFO:tasks.workunit.client.0.smithi111.stdout:5/368: fsync d10/d1e/d25/f75 0 2024-09-11T00:07:13.551 INFO:tasks.workunit.client.0.smithi111.stdout:5/369: readlink d10/l1d 0 2024-09-11T00:07:13.552 INFO:tasks.workunit.client.1.smithi203.stdout:8/366: mknod d1/d13/d22/d5d/c7f 0 2024-09-11T00:07:13.554 INFO:tasks.workunit.client.0.smithi111.stdout:5/370: readlink d10/d1e/d23/d30/d46/d47/d66/d76/l79 0 2024-09-11T00:07:13.554 INFO:tasks.workunit.client.1.smithi203.stdout:9/370: rmdir d6/de/d19/d24 39 2024-09-11T00:07:13.556 INFO:tasks.workunit.client.0.smithi111.stdout:7/361: mknod dd/d1d/d4d/c75 0 2024-09-11T00:07:13.557 INFO:tasks.workunit.client.1.smithi203.stdout:2/308: mknod d13/d22/d53/c5e 0 2024-09-11T00:07:13.557 INFO:tasks.workunit.client.1.smithi203.stdout:2/309: stat d13/l34 0 2024-09-11T00:07:13.558 INFO:tasks.workunit.client.0.smithi111.stdout:1/325: unlink d2/d2b/f55 0 2024-09-11T00:07:13.560 INFO:tasks.workunit.client.1.smithi203.stdout:7/353: truncate dd/d3b/d5b/d6a/d31/f50 656299 0 2024-09-11T00:07:13.560 INFO:tasks.workunit.client.0.smithi111.stdout:6/293: creat d7/f5e x:0 0 0 2024-09-11T00:07:13.562 INFO:tasks.workunit.client.1.smithi203.stdout:6/338: creat d0/d27/f66 x:0 0 0 2024-09-11T00:07:13.563 INFO:tasks.workunit.client.1.smithi203.stdout:6/339: readlink d0/d27/la 0 2024-09-11T00:07:13.564 INFO:tasks.workunit.client.0.smithi111.stdout:9/389: rename d6/db/d1b/d56/c6c to d6/c7d 0 2024-09-11T00:07:13.566 INFO:tasks.workunit.client.1.smithi203.stdout:5/431: chown dc/dd/d1e/f27 13355509 1 2024-09-11T00:07:13.566 INFO:tasks.workunit.client.0.smithi111.stdout:0/381: getdents d3/dc 0 2024-09-11T00:07:13.572 INFO:tasks.workunit.client.1.smithi203.stdout:7/354: creat dd/d3b/d5b/f83 x:0 0 0 2024-09-11T00:07:13.572 INFO:tasks.workunit.client.0.smithi111.stdout:3/397: dread d1c/d1d/d22/d44/f4e [0,4194304] 0 2024-09-11T00:07:13.573 INFO:tasks.workunit.client.0.smithi111.stdout:7/362: truncate f7 1862703 0 2024-09-11T00:07:13.577 INFO:tasks.workunit.client.1.smithi203.stdout:4/361: symlink db/l70 0 2024-09-11T00:07:13.578 INFO:tasks.workunit.client.0.smithi111.stdout:6/294: creat d7/d22/d1d/f5f x:0 0 0 2024-09-11T00:07:13.580 INFO:tasks.workunit.client.1.smithi203.stdout:5/432: rmdir dc/dd/d4d 39 2024-09-11T00:07:13.582 INFO:tasks.workunit.client.1.smithi203.stdout:8/367: write d1/d13/f35 [797628,12292] 0 2024-09-11T00:07:13.582 INFO:tasks.workunit.client.0.smithi111.stdout:7/363: dread dd/d1d/d2d/d2e/d4e/f64 [0,4194304] 0 2024-09-11T00:07:13.583 INFO:tasks.workunit.client.0.smithi111.stdout:2/351: rename d0/d3/d12/l5c to d0/d3/d12/d52/l7d 0 2024-09-11T00:07:13.584 INFO:tasks.workunit.client.1.smithi203.stdout:9/371: dread d6/de/d19/d24/d40/d45/f39 [0,4194304] 0 2024-09-11T00:07:13.585 INFO:tasks.workunit.client.0.smithi111.stdout:2/352: readlink d0/d3/d12/l46 0 2024-09-11T00:07:13.587 INFO:tasks.workunit.client.1.smithi203.stdout:9/372: write d6/de/d32/f37 [785717,3636] 0 2024-09-11T00:07:13.591 INFO:tasks.workunit.client.0.smithi111.stdout:5/371: unlink d10/d1e/d23/d2b/d55/d6d/f7c 0 2024-09-11T00:07:13.593 INFO:tasks.workunit.client.1.smithi203.stdout:7/355: read dd/f3e [5718235,16522] 0 2024-09-11T00:07:13.593 INFO:tasks.workunit.client.1.smithi203.stdout:6/340: mknod d0/d5b/d5c/c67 0 2024-09-11T00:07:13.596 INFO:tasks.workunit.client.0.smithi111.stdout:1/326: dread d2/de/d12/f28 [0,4194304] 0 2024-09-11T00:07:13.596 INFO:tasks.workunit.client.1.smithi203.stdout:7/356: truncate dd/d3b/d5b/f7b 4987938 0 2024-09-11T00:07:13.599 INFO:tasks.workunit.client.0.smithi111.stdout:9/390: rename d6/f69 to d6/db/d34/d37/f7e 0 2024-09-11T00:07:13.600 INFO:tasks.workunit.client.0.smithi111.stdout:4/330: sync 2024-09-11T00:07:13.601 INFO:tasks.workunit.client.0.smithi111.stdout:9/391: fsync d6/db/d34/d37/f2d 0 2024-09-11T00:07:13.602 INFO:tasks.workunit.client.1.smithi203.stdout:2/310: link d13/l33 d13/l5f 0 2024-09-11T00:07:13.603 INFO:tasks.workunit.client.0.smithi111.stdout:0/382: dread d3/fd [0,4194304] 0 2024-09-11T00:07:13.605 INFO:tasks.workunit.client.0.smithi111.stdout:7/364: mkdir dd/d1d/d76 0 2024-09-11T00:07:13.605 INFO:tasks.workunit.client.0.smithi111.stdout:0/383: chown d3/d26/f81 3 1 2024-09-11T00:07:13.606 INFO:tasks.workunit.client.1.smithi203.stdout:9/373: write d6/f14 [1153391,33605] 0 2024-09-11T00:07:13.606 INFO:tasks.workunit.client.0.smithi111.stdout:1/327: mknod d2/d2b/c6d 0 2024-09-11T00:07:13.608 INFO:tasks.workunit.client.0.smithi111.stdout:1/328: chown d2/de/d12/d3c 564 1 2024-09-11T00:07:13.609 INFO:tasks.workunit.client.1.smithi203.stdout:6/341: creat d0/d54/f68 x:0 0 0 2024-09-11T00:07:13.611 INFO:tasks.workunit.client.0.smithi111.stdout:3/398: rename d1c/f5e to d1c/d1d/d22/d44/f88 0 2024-09-11T00:07:13.612 INFO:tasks.workunit.client.1.smithi203.stdout:4/362: mkdir db/d12/d15/d2a/d71 0 2024-09-11T00:07:13.613 INFO:tasks.workunit.client.0.smithi111.stdout:2/353: creat d0/d3/d12/d52/d65/f7e x:0 0 0 2024-09-11T00:07:13.615 INFO:tasks.workunit.client.0.smithi111.stdout:4/331: dwrite d18/d20/f30 [0,4194304] 0 2024-09-11T00:07:13.616 INFO:tasks.workunit.client.1.smithi203.stdout:8/368: mknod d1/d13/d17/c80 0 2024-09-11T00:07:13.618 INFO:tasks.workunit.client.0.smithi111.stdout:9/392: mkdir d6/db/d34/d37/d4c/d7f 0 2024-09-11T00:07:13.619 INFO:tasks.workunit.client.1.smithi203.stdout:7/357: dwrite dd/d3b/d5b/d6a/f2c [0,4194304] 0 2024-09-11T00:07:13.621 INFO:tasks.workunit.client.0.smithi111.stdout:0/384: dwrite d3/d26/f81 [0,4194304] 0 2024-09-11T00:07:13.624 INFO:tasks.workunit.client.1.smithi203.stdout:7/358: readlink dd/d3b/d5b/d6a/d31/d4a/l6b 0 2024-09-11T00:07:13.624 INFO:tasks.workunit.client.1.smithi203.stdout:8/369: truncate d1/d13/d22/d5d/f66 898241 0 2024-09-11T00:07:13.626 INFO:tasks.workunit.client.0.smithi111.stdout:0/385: readlink d3/d1c/l3d 0 2024-09-11T00:07:13.628 INFO:tasks.workunit.client.1.smithi203.stdout:4/363: creat db/dd/d16/d38/d3c/f72 x:0 0 0 2024-09-11T00:07:13.631 INFO:tasks.workunit.client.0.smithi111.stdout:4/332: mknod d18/d3b/c6a 0 2024-09-11T00:07:13.632 INFO:tasks.workunit.client.1.smithi203.stdout:2/311: symlink d13/d15/d30/d5a/l60 0 2024-09-11T00:07:13.633 INFO:tasks.workunit.client.0.smithi111.stdout:4/333: dread - d18/f57 zero size 2024-09-11T00:07:13.633 INFO:tasks.workunit.client.0.smithi111.stdout:2/354: dread d0/d3/de/f21 [0,4194304] 0 2024-09-11T00:07:13.634 INFO:tasks.workunit.client.1.smithi203.stdout:2/312: read - d13/d15/d30/f57 zero size 2024-09-11T00:07:13.635 INFO:tasks.workunit.client.0.smithi111.stdout:9/393: mkdir d6/db/d1b/d41/d80 0 2024-09-11T00:07:13.637 INFO:tasks.workunit.client.0.smithi111.stdout:4/334: write f7 [1798979,20423] 0 2024-09-11T00:07:13.639 INFO:tasks.workunit.client.0.smithi111.stdout:1/329: creat d2/de/d12/d3c/d4b/d6a/d63/f6e x:0 0 0 2024-09-11T00:07:13.640 INFO:tasks.workunit.client.0.smithi111.stdout:0/386: unlink d3/da/c41 0 2024-09-11T00:07:13.641 INFO:tasks.workunit.client.1.smithi203.stdout:7/359: mknod dd/d3b/d5b/d6a/d31/d4a/c84 0 2024-09-11T00:07:13.643 INFO:tasks.workunit.client.0.smithi111.stdout:4/335: stat d18/d20/f23 0 2024-09-11T00:07:13.644 INFO:tasks.workunit.client.0.smithi111.stdout:9/394: fdatasync d6/db/d1b/d56/f6b 0 2024-09-11T00:07:13.644 INFO:tasks.workunit.client.0.smithi111.stdout:7/365: dwrite dd/f1c [0,4194304] 0 2024-09-11T00:07:13.645 INFO:tasks.workunit.client.1.smithi203.stdout:5/433: rename dc/dd/d4d/l58 to dc/l8e 0 2024-09-11T00:07:13.647 INFO:tasks.workunit.client.1.smithi203.stdout:9/374: creat d6/f76 x:0 0 0 2024-09-11T00:07:13.649 INFO:tasks.workunit.client.0.smithi111.stdout:6/295: rename d7/d22/d1d/c3b to d7/d22/c60 0 2024-09-11T00:07:13.650 INFO:tasks.workunit.client.1.smithi203.stdout:8/370: mkdir d1/d13/d17/d81 0 2024-09-11T00:07:13.652 INFO:tasks.workunit.client.1.smithi203.stdout:6/342: dread d0/f8 [0,4194304] 0 2024-09-11T00:07:13.652 INFO:tasks.workunit.client.1.smithi203.stdout:2/313: rename fd to d13/d47/f61 0 2024-09-11T00:07:13.653 INFO:tasks.workunit.client.0.smithi111.stdout:4/336: write d18/d1f/d33/f59 [138248,127426] 0 2024-09-11T00:07:13.655 INFO:tasks.workunit.client.0.smithi111.stdout:9/395: mknod d6/db/d1b/d56/c81 0 2024-09-11T00:07:13.655 INFO:tasks.workunit.client.1.smithi203.stdout:5/434: mknod dc/d4f/d5c/c8f 0 2024-09-11T00:07:13.656 INFO:tasks.workunit.client.1.smithi203.stdout:3/482: sync 2024-09-11T00:07:13.657 INFO:tasks.workunit.client.1.smithi203.stdout:9/375: creat d6/de/d19/d30/f77 x:0 0 0 2024-09-11T00:07:13.658 INFO:tasks.workunit.client.1.smithi203.stdout:3/483: stat d8/d2a 0 2024-09-11T00:07:13.659 INFO:tasks.workunit.client.0.smithi111.stdout:5/372: rename d10/d1e/d23/d30/d46 to d10/d1e/d23/d30/d3c/d60/d7e 0 2024-09-11T00:07:13.662 INFO:tasks.workunit.client.1.smithi203.stdout:7/360: mknod dd/c85 0 2024-09-11T00:07:13.663 INFO:tasks.workunit.client.1.smithi203.stdout:8/371: read d1/d13/d17/f50 [4160209,130120] 0 2024-09-11T00:07:13.665 INFO:tasks.workunit.client.0.smithi111.stdout:4/337: mkdir d18/d20/d4a/d6b 0 2024-09-11T00:07:13.669 INFO:tasks.workunit.client.1.smithi203.stdout:7/361: truncate dd/d1c/f66 233274 0 2024-09-11T00:07:13.671 INFO:tasks.workunit.client.0.smithi111.stdout:9/396: symlink d6/db/d1b/d41/l82 0 2024-09-11T00:07:13.672 INFO:tasks.workunit.client.1.smithi203.stdout:3/484: symlink d8/da/d34/lb2 0 2024-09-11T00:07:13.679 INFO:tasks.workunit.client.1.smithi203.stdout:4/364: rmdir db/d12/d15 39 2024-09-11T00:07:13.681 INFO:tasks.workunit.client.0.smithi111.stdout:9/397: dread d6/dc/f1f [0,4194304] 0 2024-09-11T00:07:13.681 INFO:tasks.workunit.client.1.smithi203.stdout:2/314: dwrite d13/d47/f61 [0,4194304] 0 2024-09-11T00:07:13.681 INFO:tasks.workunit.client.0.smithi111.stdout:1/330: creat d2/f6f x:0 0 0 2024-09-11T00:07:13.684 INFO:tasks.workunit.client.1.smithi203.stdout:2/315: fsync d13/d15/d19/d1c/f3d 0 2024-09-11T00:07:13.685 INFO:tasks.workunit.client.1.smithi203.stdout:8/372: rename d1/d13/d22/f29 to d1/d13/d3a/d75/f82 0 2024-09-11T00:07:13.687 INFO:tasks.workunit.client.1.smithi203.stdout:2/316: stat d13/d22/f38 0 2024-09-11T00:07:13.688 INFO:tasks.workunit.client.1.smithi203.stdout:7/362: dwrite dd/d1c/f46 [0,4194304] 0 2024-09-11T00:07:13.688 INFO:tasks.workunit.client.1.smithi203.stdout:9/376: truncate d6/de/d19/f31 319015 0 2024-09-11T00:07:13.690 INFO:tasks.workunit.client.0.smithi111.stdout:4/338: symlink d18/d39/l6c 0 2024-09-11T00:07:13.692 INFO:tasks.workunit.client.0.smithi111.stdout:2/355: link d0/c4c d0/d3/de/d4b/c7f 0 2024-09-11T00:07:13.694 INFO:tasks.workunit.client.0.smithi111.stdout:9/398: dwrite d6/d52/f61 [0,4194304] 0 2024-09-11T00:07:13.697 INFO:tasks.workunit.client.0.smithi111.stdout:9/399: chown d6/db/d1b/f33 4370 1 2024-09-11T00:07:13.700 INFO:tasks.workunit.client.1.smithi203.stdout:5/435: creat dc/dd/d15/d3b/d7a/f90 x:0 0 0 2024-09-11T00:07:13.701 INFO:tasks.workunit.client.0.smithi111.stdout:8/416: sync 2024-09-11T00:07:13.701 INFO:tasks.workunit.client.0.smithi111.stdout:5/373: getdents d10/d1e/d23/d30/d59/d52 0 2024-09-11T00:07:13.702 INFO:tasks.workunit.client.1.smithi203.stdout:5/436: write f8 [4102579,79857] 0 2024-09-11T00:07:13.704 INFO:tasks.workunit.client.0.smithi111.stdout:5/374: chown d10/d1e/d23/d30/d3c/f40 1140705636 1 2024-09-11T00:07:13.705 INFO:tasks.workunit.client.0.smithi111.stdout:3/399: dwrite f5 [0,4194304] 0 2024-09-11T00:07:13.714 INFO:tasks.workunit.client.1.smithi203.stdout:8/373: chown d1/d13/d43/d46 370758 1 2024-09-11T00:07:13.719 INFO:tasks.workunit.client.0.smithi111.stdout:2/356: mknod d0/d3/de/d3b/c80 0 2024-09-11T00:07:13.721 INFO:tasks.workunit.client.0.smithi111.stdout:2/357: stat d0/d3/de/c48 0 2024-09-11T00:07:13.723 INFO:tasks.workunit.client.0.smithi111.stdout:9/400: creat d6/db/f83 x:0 0 0 2024-09-11T00:07:13.727 INFO:tasks.workunit.client.0.smithi111.stdout:7/366: write fa [1661607,53109] 0 2024-09-11T00:07:13.728 INFO:tasks.workunit.client.0.smithi111.stdout:4/339: mknod d18/d20/d4a/d6b/c6d 0 2024-09-11T00:07:13.729 INFO:tasks.workunit.client.0.smithi111.stdout:8/417: read d11/d21/d38/d54/d5b/f61 [105972,46791] 0 2024-09-11T00:07:13.731 INFO:tasks.workunit.client.0.smithi111.stdout:3/400: symlink d1c/d1d/d22/d31/d33/d5f/l89 0 2024-09-11T00:07:13.731 INFO:tasks.workunit.client.0.smithi111.stdout:8/418: write d11/d21/d38/f57 [242966,48448] 0 2024-09-11T00:07:13.733 INFO:tasks.workunit.client.0.smithi111.stdout:3/401: write f17 [4896436,66799] 0 2024-09-11T00:07:13.734 INFO:tasks.workunit.client.0.smithi111.stdout:0/387: sync 2024-09-11T00:07:13.735 INFO:tasks.workunit.client.1.smithi203.stdout:5/437: write dc/dd/d4d/f57 [2053706,67875] 0 2024-09-11T00:07:13.736 INFO:tasks.workunit.client.0.smithi111.stdout:5/375: rename fd to d10/d1e/d23/d26/d78/f7f 0 2024-09-11T00:07:13.738 INFO:tasks.workunit.client.0.smithi111.stdout:0/388: write d3/d13/d1e/f4d [1779064,57564] 0 2024-09-11T00:07:13.738 INFO:tasks.workunit.client.0.smithi111.stdout:5/376: fdatasync d10/f6b 0 2024-09-11T00:07:13.742 INFO:tasks.workunit.client.1.smithi203.stdout:6/343: truncate d0/f14 7458507 0 2024-09-11T00:07:13.743 INFO:tasks.workunit.client.0.smithi111.stdout:6/296: truncate d7/f30 857425 0 2024-09-11T00:07:13.744 INFO:tasks.workunit.client.0.smithi111.stdout:6/297: stat d7/la 0 2024-09-11T00:07:13.750 INFO:tasks.workunit.client.1.smithi203.stdout:5/438: fsync dc/d65/f4a 0 2024-09-11T00:07:13.754 INFO:tasks.workunit.client.1.smithi203.stdout:4/365: rename db/dd/d26/d42/f58 to db/f73 0 2024-09-11T00:07:13.756 INFO:tasks.workunit.client.0.smithi111.stdout:5/377: dwrite d10/d1e/d23/d30/d59/d53/f5e [0,4194304] 0 2024-09-11T00:07:13.758 INFO:tasks.workunit.client.1.smithi203.stdout:3/485: dwrite d8/da/d34/f6d [0,4194304] 0 2024-09-11T00:07:13.760 INFO:tasks.workunit.client.1.smithi203.stdout:6/344: creat d0/d5b/d5c/f69 x:0 0 0 2024-09-11T00:07:13.760 INFO:tasks.workunit.client.1.smithi203.stdout:7/363: link dd/f12 dd/d3b/d5b/d6a/d31/d4a/f86 0 2024-09-11T00:07:13.761 INFO:tasks.workunit.client.0.smithi111.stdout:6/298: dwrite d7/d2b/f5b [0,4194304] 0 2024-09-11T00:07:13.764 INFO:tasks.workunit.client.1.smithi203.stdout:9/377: link d6/de/d32/d52/l4d d6/de/d19/d21/l78 0 2024-09-11T00:07:13.764 INFO:tasks.workunit.client.1.smithi203.stdout:7/364: stat dd/d1c/d4b/f53 0 2024-09-11T00:07:13.767 INFO:tasks.workunit.client.1.smithi203.stdout:7/365: fsync dd/d4d/f73 0 2024-09-11T00:07:13.767 INFO:tasks.workunit.client.1.smithi203.stdout:0/387: sync 2024-09-11T00:07:13.767 INFO:tasks.workunit.client.1.smithi203.stdout:1/446: sync 2024-09-11T00:07:13.772 INFO:tasks.workunit.client.1.smithi203.stdout:8/374: link d1/d13/d17/d2f/d52/d49/c4b d1/d13/d43/d46/d76/c83 0 2024-09-11T00:07:13.774 INFO:tasks.workunit.client.1.smithi203.stdout:1/447: truncate d8/d9/d15/d27/f2e 5911738 0 2024-09-11T00:07:13.776 INFO:tasks.workunit.client.0.smithi111.stdout:9/401: creat d6/db/d1b/d74/f84 x:0 0 0 2024-09-11T00:07:13.781 INFO:tasks.workunit.client.0.smithi111.stdout:1/331: link d2/d2b/d2c/f47 d2/de/d12/d3c/d4b/d6a/d3a/f70 0 2024-09-11T00:07:13.785 INFO:tasks.workunit.client.1.smithi203.stdout:0/388: mkdir d0/d2/d37/d7f 0 2024-09-11T00:07:13.787 INFO:tasks.workunit.client.1.smithi203.stdout:6/345: dwrite d0/d27/d35/f3e [0,4194304] 0 2024-09-11T00:07:13.789 INFO:tasks.workunit.client.1.smithi203.stdout:0/389: write d0/d2/f3 [310698,90237] 0 2024-09-11T00:07:13.789 INFO:tasks.workunit.client.0.smithi111.stdout:7/367: dwrite dd/d1d/d1f/f23 [4194304,4194304] 0 2024-09-11T00:07:13.790 INFO:tasks.workunit.client.1.smithi203.stdout:9/378: creat d6/de/d32/d52/d44/f79 x:0 0 0 2024-09-11T00:07:13.791 INFO:tasks.workunit.client.0.smithi111.stdout:7/368: stat dd/d48/d69/f71 0 2024-09-11T00:07:13.793 INFO:tasks.workunit.client.0.smithi111.stdout:2/358: rename d0/cb to d0/d3/d12/d52/c81 0 2024-09-11T00:07:13.797 INFO:tasks.workunit.client.1.smithi203.stdout:7/366: symlink dd/d1c/d7c/l87 0 2024-09-11T00:07:13.800 INFO:tasks.workunit.client.1.smithi203.stdout:5/439: mkdir dc/d91 0 2024-09-11T00:07:13.801 INFO:tasks.workunit.client.0.smithi111.stdout:0/389: mknod d3/d13/c85 0 2024-09-11T00:07:13.807 INFO:tasks.workunit.client.1.smithi203.stdout:1/448: rmdir d8/d9 39 2024-09-11T00:07:13.811 INFO:tasks.workunit.client.1.smithi203.stdout:4/366: link db/dd/d16/d38/d3c/d41/f6d db/dd/d16/d38/f74 0 2024-09-11T00:07:13.813 INFO:tasks.workunit.client.0.smithi111.stdout:5/378: fdatasync d10/d1e/d23/f48 0 2024-09-11T00:07:13.819 INFO:tasks.workunit.client.0.smithi111.stdout:2/359: dread d0/d3/de/f1e [0,4194304] 0 2024-09-11T00:07:13.819 INFO:tasks.workunit.client.1.smithi203.stdout:9/379: stat d6/cd 0 2024-09-11T00:07:13.821 INFO:tasks.workunit.client.0.smithi111.stdout:3/402: rename d1c/d1d/d22/d31/c5d to d1c/d1d/d22/d31/d33/d5f/c8a 0 2024-09-11T00:07:13.822 INFO:tasks.workunit.client.1.smithi203.stdout:6/346: dread d0/f21 [0,4194304] 0 2024-09-11T00:07:13.822 INFO:tasks.workunit.client.1.smithi203.stdout:0/390: mkdir d0/d2/d37/d80 0 2024-09-11T00:07:13.823 INFO:tasks.workunit.client.0.smithi111.stdout:3/403: fsync d1c/d1d/d22/d31/d62/f78 0 2024-09-11T00:07:13.824 INFO:tasks.workunit.client.0.smithi111.stdout:0/390: creat d3/d26/d77/f86 x:0 0 0 2024-09-11T00:07:13.824 INFO:tasks.workunit.client.1.smithi203.stdout:0/391: dread - d0/d2/f7a zero size 2024-09-11T00:07:13.826 INFO:tasks.workunit.client.0.smithi111.stdout:4/340: dwrite d18/d20/d40/f42 [0,4194304] 0 2024-09-11T00:07:13.827 INFO:tasks.workunit.client.1.smithi203.stdout:5/440: fsync dc/dd/d1e/f53 0 2024-09-11T00:07:13.828 INFO:tasks.workunit.client.0.smithi111.stdout:4/341: truncate d18/d1f/f5f 183948 0 2024-09-11T00:07:13.829 INFO:tasks.workunit.client.0.smithi111.stdout:8/419: getdents d11/d21 0 2024-09-11T00:07:13.830 INFO:tasks.workunit.client.0.smithi111.stdout:4/342: fdatasync d18/d20/d3c/f54 0 2024-09-11T00:07:13.830 INFO:tasks.workunit.client.1.smithi203.stdout:5/441: chown dc/dd/d15/f19 0 1 2024-09-11T00:07:13.831 INFO:tasks.workunit.client.0.smithi111.stdout:8/420: chown d11/d21/f70 163 1 2024-09-11T00:07:13.831 INFO:tasks.workunit.client.1.smithi203.stdout:1/449: rmdir d8/d19/d60/d90/d3e/d66 39 2024-09-11T00:07:13.832 INFO:tasks.workunit.client.0.smithi111.stdout:1/332: write d2/f1f [1440981,84191] 0 2024-09-11T00:07:13.832 INFO:tasks.workunit.client.0.smithi111.stdout:5/379: creat d10/d1e/d25/d6e/f80 x:0 0 0 2024-09-11T00:07:13.835 INFO:tasks.workunit.client.1.smithi203.stdout:4/367: read db/f73 [44595,45317] 0 2024-09-11T00:07:13.837 INFO:tasks.workunit.client.1.smithi203.stdout:3/486: rename d8/da/d34 to d8/da/db3 0 2024-09-11T00:07:13.838 INFO:tasks.workunit.client.0.smithi111.stdout:2/360: symlink d0/d3/de/d50/l82 0 2024-09-11T00:07:13.838 INFO:tasks.workunit.client.1.smithi203.stdout:9/380: dwrite d6/de/d19/d24/f6d [0,4194304] 0 2024-09-11T00:07:13.839 INFO:tasks.workunit.client.0.smithi111.stdout:0/391: dread d3/d13/f17 [0,4194304] 0 2024-09-11T00:07:13.839 INFO:tasks.workunit.client.0.smithi111.stdout:6/299: truncate d7/fd 3690437 0 2024-09-11T00:07:13.843 INFO:tasks.workunit.client.0.smithi111.stdout:7/369: write dd/d1d/f39 [1985833,84886] 0 2024-09-11T00:07:13.843 INFO:tasks.workunit.client.0.smithi111.stdout:9/402: rename d6/l24 to d6/db/d1b/d56/l85 0 2024-09-11T00:07:13.844 INFO:tasks.workunit.client.1.smithi203.stdout:7/367: link fc dd/d1c/d7c/f88 0 2024-09-11T00:07:13.846 INFO:tasks.workunit.client.1.smithi203.stdout:7/368: write dd/f30 [1265063,70484] 0 2024-09-11T00:07:13.848 INFO:tasks.workunit.client.0.smithi111.stdout:7/370: write dd/d48/d69/f6b [843786,9467] 0 2024-09-11T00:07:13.849 INFO:tasks.workunit.client.1.smithi203.stdout:8/375: creat d1/d13/d17/d2f/f84 x:0 0 0 2024-09-11T00:07:13.851 INFO:tasks.workunit.client.1.smithi203.stdout:5/442: creat dc/dd/d4d/f92 x:0 0 0 2024-09-11T00:07:13.853 INFO:tasks.workunit.client.1.smithi203.stdout:5/443: chown dc/dd/d15/f4b 45358 1 2024-09-11T00:07:13.854 INFO:tasks.workunit.client.0.smithi111.stdout:1/333: dread d2/d2b/d2c/f42 [0,4194304] 0 2024-09-11T00:07:13.855 INFO:tasks.workunit.client.1.smithi203.stdout:3/487: symlink d8/da/d11/lb4 0 2024-09-11T00:07:13.856 INFO:tasks.workunit.client.0.smithi111.stdout:8/421: dwrite d11/d23/f65 [0,4194304] 0 2024-09-11T00:07:13.857 INFO:tasks.workunit.client.1.smithi203.stdout:2/317: sync 2024-09-11T00:07:13.859 INFO:tasks.workunit.client.0.smithi111.stdout:7/371: mknod dd/d1d/d4d/c77 0 2024-09-11T00:07:13.860 INFO:tasks.workunit.client.1.smithi203.stdout:8/376: mknod d1/d13/d3a/d4c/c85 0 2024-09-11T00:07:13.862 INFO:tasks.workunit.client.1.smithi203.stdout:8/377: fsync d1/d13/d17/f39 0 2024-09-11T00:07:13.865 INFO:tasks.workunit.client.1.smithi203.stdout:1/450: mkdir d8/d19/d60/d90/d3e/d96 0 2024-09-11T00:07:13.866 INFO:tasks.workunit.client.0.smithi111.stdout:0/392: mkdir d3/d13/d87 0 2024-09-11T00:07:13.869 INFO:tasks.workunit.client.1.smithi203.stdout:5/444: rmdir dc/d4f/d5c 39 2024-09-11T00:07:13.872 INFO:tasks.workunit.client.1.smithi203.stdout:0/392: creat d0/d2/f81 x:0 0 0 2024-09-11T00:07:13.873 INFO:tasks.workunit.client.0.smithi111.stdout:3/404: rmdir d1c/d1d/d22/d31 39 2024-09-11T00:07:13.873 INFO:tasks.workunit.client.0.smithi111.stdout:4/343: link d18/d3b/c6a d18/d1f/d33/c6e 0 2024-09-11T00:07:13.878 INFO:tasks.workunit.client.0.smithi111.stdout:7/372: mknod dd/d48/c78 0 2024-09-11T00:07:13.881 INFO:tasks.workunit.client.0.smithi111.stdout:2/361: dwrite d0/d3/de/f43 [0,4194304] 0 2024-09-11T00:07:13.882 INFO:tasks.workunit.client.0.smithi111.stdout:5/380: creat d10/d1e/d23/f81 x:0 0 0 2024-09-11T00:07:13.891 INFO:tasks.workunit.client.1.smithi203.stdout:2/318: dread d13/d15/f1a [0,4194304] 0 2024-09-11T00:07:13.892 INFO:tasks.workunit.client.1.smithi203.stdout:8/378: mknod d1/d13/d17/d48/d61/c86 0 2024-09-11T00:07:13.893 INFO:tasks.workunit.client.1.smithi203.stdout:6/347: dwrite d0/d5b/f64 [0,4194304] 0 2024-09-11T00:07:13.894 INFO:tasks.workunit.client.0.smithi111.stdout:0/393: dwrite d3/d1c/f4f [0,4194304] 0 2024-09-11T00:07:13.897 INFO:tasks.workunit.client.1.smithi203.stdout:6/348: stat d0/d27/d35/f3f 0 2024-09-11T00:07:13.898 INFO:tasks.workunit.client.1.smithi203.stdout:2/319: write f8 [8452718,35479] 0 2024-09-11T00:07:13.903 INFO:tasks.workunit.client.1.smithi203.stdout:9/381: creat d6/de/d19/f7a x:0 0 0 2024-09-11T00:07:13.907 INFO:tasks.workunit.client.0.smithi111.stdout:7/373: mkdir dd/d1d/d2d/d68/d79 0 2024-09-11T00:07:13.908 INFO:tasks.workunit.client.0.smithi111.stdout:9/403: write d6/db/f49 [3555613,37754] 0 2024-09-11T00:07:13.908 INFO:tasks.workunit.client.0.smithi111.stdout:2/362: stat d0/d3/d2e/l35 0 2024-09-11T00:07:13.910 INFO:tasks.workunit.client.1.smithi203.stdout:7/369: link dd/c85 dd/d4d/d7f/c89 0 2024-09-11T00:07:13.911 INFO:tasks.workunit.client.0.smithi111.stdout:9/404: write d6/db/f79 [10314,23521] 0 2024-09-11T00:07:13.911 INFO:tasks.workunit.client.1.smithi203.stdout:8/379: dread d1/d13/d43/d46/d64/f6b [0,4194304] 0 2024-09-11T00:07:13.917 INFO:tasks.workunit.client.1.smithi203.stdout:1/451: mknod d8/d19/d31/c97 0 2024-09-11T00:07:13.919 INFO:tasks.workunit.client.0.smithi111.stdout:8/422: rename d11/d23/d3d/c74 to d11/d23/d2c/d46/c85 0 2024-09-11T00:07:13.920 INFO:tasks.workunit.client.0.smithi111.stdout:1/334: link d2/de/f43 d2/d2b/d2c/d56/f71 0 2024-09-11T00:07:13.920 INFO:tasks.workunit.client.0.smithi111.stdout:7/374: rmdir dd/d48/d69 39 2024-09-11T00:07:13.922 INFO:tasks.workunit.client.1.smithi203.stdout:6/349: unlink d0/f1 0 2024-09-11T00:07:13.926 INFO:tasks.workunit.client.1.smithi203.stdout:2/320: unlink lf 0 2024-09-11T00:07:13.930 INFO:tasks.workunit.client.1.smithi203.stdout:4/368: rename db/d12/c6f to db/d12/d15/d2a/c75 0 2024-09-11T00:07:13.931 INFO:tasks.workunit.client.0.smithi111.stdout:0/394: rename d3/dc/l78 to d3/d13/d66/l88 0 2024-09-11T00:07:13.933 INFO:tasks.workunit.client.0.smithi111.stdout:8/423: dwrite d11/d23/d2c/f45 [4194304,4194304] 0 2024-09-11T00:07:13.934 INFO:tasks.workunit.client.1.smithi203.stdout:4/369: write db/f23 [79595,90703] 0 2024-09-11T00:07:13.935 INFO:tasks.workunit.client.0.smithi111.stdout:8/424: fdatasync d11/d23/d2c/d53/f83 0 2024-09-11T00:07:13.940 INFO:tasks.workunit.client.1.smithi203.stdout:7/370: unlink dd/f12 0 2024-09-11T00:07:13.942 INFO:tasks.workunit.client.0.smithi111.stdout:6/300: sync 2024-09-11T00:07:13.943 INFO:tasks.workunit.client.0.smithi111.stdout:7/375: chown dd/d1d/d4b/l6a 18104 1 2024-09-11T00:07:13.944 INFO:tasks.workunit.client.1.smithi203.stdout:6/350: dwrite d0/d27/f18 [0,4194304] 0 2024-09-11T00:07:13.944 INFO:tasks.workunit.client.0.smithi111.stdout:6/301: chown d7/d22/d26/c59 27338 1 2024-09-11T00:07:13.947 INFO:tasks.workunit.client.0.smithi111.stdout:7/376: write dd/d1d/d1f/f65 [186512,126350] 0 2024-09-11T00:07:13.949 INFO:tasks.workunit.client.0.smithi111.stdout:2/363: mkdir d0/d83 0 2024-09-11T00:07:13.952 INFO:tasks.workunit.client.1.smithi203.stdout:8/380: mknod d1/d13/d17/d2f/d52/d59/c87 0 2024-09-11T00:07:13.952 INFO:tasks.workunit.client.1.smithi203.stdout:1/452: unlink d8/d19/d60/d90/f61 0 2024-09-11T00:07:13.953 INFO:tasks.workunit.client.0.smithi111.stdout:3/405: write f6 [2372563,60141] 0 2024-09-11T00:07:13.953 INFO:tasks.workunit.client.0.smithi111.stdout:9/405: creat d6/dc/d7c/f86 x:0 0 0 2024-09-11T00:07:13.953 INFO:tasks.workunit.client.0.smithi111.stdout:8/425: dread d11/f1b [0,4194304] 0 2024-09-11T00:07:13.956 INFO:tasks.workunit.client.0.smithi111.stdout:5/381: dwrite d10/d1e/d25/f29 [0,4194304] 0 2024-09-11T00:07:13.969 INFO:tasks.workunit.client.1.smithi203.stdout:9/382: unlink d6/de/l1e 0 2024-09-11T00:07:13.971 INFO:tasks.workunit.client.0.smithi111.stdout:7/377: truncate dd/f1b 4761126 0 2024-09-11T00:07:13.972 INFO:tasks.workunit.client.1.smithi203.stdout:6/351: dwrite d0/d32/f5e [0,4194304] 0 2024-09-11T00:07:13.972 INFO:tasks.workunit.client.1.smithi203.stdout:4/370: unlink db/d12/d15/d2a/c47 0 2024-09-11T00:07:13.973 INFO:tasks.workunit.client.0.smithi111.stdout:5/382: dread d10/d1e/d23/d30/d59/d53/f5e [0,4194304] 0 2024-09-11T00:07:13.979 INFO:tasks.workunit.client.1.smithi203.stdout:4/371: stat db/d12/d15/d2a/f34 0 2024-09-11T00:07:13.979 INFO:tasks.workunit.client.0.smithi111.stdout:7/378: truncate dd/d1d/d2d/d2e/f70 760763 0 2024-09-11T00:07:13.984 INFO:tasks.workunit.client.0.smithi111.stdout:4/344: sync 2024-09-11T00:07:13.986 INFO:tasks.workunit.client.1.smithi203.stdout:0/393: dwrite d0/d1d/d4c/f6d [0,4194304] 0 2024-09-11T00:07:13.995 INFO:tasks.workunit.client.1.smithi203.stdout:2/321: symlink d13/d56/l62 0 2024-09-11T00:07:13.995 INFO:tasks.workunit.client.0.smithi111.stdout:2/364: rmdir d0 39 2024-09-11T00:07:14.000 INFO:tasks.workunit.client.1.smithi203.stdout:5/445: truncate dc/d4f/d5c/f77 413924 0 2024-09-11T00:07:14.001 INFO:tasks.workunit.client.1.smithi203.stdout:5/446: fsync dc/dd/d13/f5d 0 2024-09-11T00:07:14.003 INFO:tasks.workunit.client.1.smithi203.stdout:9/383: creat d6/de/d19/d21/f7b x:0 0 0 2024-09-11T00:07:14.004 INFO:tasks.workunit.client.0.smithi111.stdout:6/302: mkdir d7/d4d/d61 0 2024-09-11T00:07:14.005 INFO:tasks.workunit.client.1.smithi203.stdout:7/371: link dd/d3b/d5b/d6a/f2c dd/d1c/f8a 0 2024-09-11T00:07:14.006 INFO:tasks.workunit.client.0.smithi111.stdout:6/303: dread - d7/f52 zero size 2024-09-11T00:07:14.008 INFO:tasks.workunit.client.1.smithi203.stdout:4/372: creat db/dd/d26/f76 x:0 0 0 2024-09-11T00:07:14.009 INFO:tasks.workunit.client.0.smithi111.stdout:5/383: mkdir d10/d1e/d23/d30/d59/d7b/d82 0 2024-09-11T00:07:14.011 INFO:tasks.workunit.client.1.smithi203.stdout:4/373: truncate db/dd/d26/f76 105555 0 2024-09-11T00:07:14.011 INFO:tasks.workunit.client.0.smithi111.stdout:5/384: write f2 [1788628,81499] 0 2024-09-11T00:07:14.011 INFO:tasks.workunit.client.1.smithi203.stdout:6/352: rename d0/d27/d35/d39/f4b to d0/d27/d35/d39/f6a 0 2024-09-11T00:07:14.013 INFO:tasks.workunit.client.0.smithi111.stdout:5/385: fdatasync d10/d1e/f21 0 2024-09-11T00:07:14.015 INFO:tasks.workunit.client.0.smithi111.stdout:8/426: dwrite d11/f1b [0,4194304] 0 2024-09-11T00:07:14.016 INFO:tasks.workunit.client.0.smithi111.stdout:6/304: read d7/f5a [127756,105319] 0 2024-09-11T00:07:14.019 INFO:tasks.workunit.client.0.smithi111.stdout:3/406: symlink d1c/d1d/d22/d31/d33/d5f/l8b 0 2024-09-11T00:07:14.020 INFO:tasks.workunit.client.0.smithi111.stdout:4/345: mknod d18/d20/d4a/d6b/c6f 0 2024-09-11T00:07:14.020 INFO:tasks.workunit.client.0.smithi111.stdout:6/305: chown d7/f12 6012 1 2024-09-11T00:07:14.025 INFO:tasks.workunit.client.1.smithi203.stdout:2/322: creat d13/d15/d30/f63 x:0 0 0 2024-09-11T00:07:14.032 INFO:tasks.workunit.client.1.smithi203.stdout:8/381: write d1/d13/f33 [1592298,88699] 0 2024-09-11T00:07:14.032 INFO:tasks.workunit.client.1.smithi203.stdout:3/488: sync 2024-09-11T00:07:14.034 INFO:tasks.workunit.client.1.smithi203.stdout:5/447: creat dc/d2b/f93 x:0 0 0 2024-09-11T00:07:14.039 INFO:tasks.workunit.client.1.smithi203.stdout:5/448: truncate dc/dd/d15/f4b 2019762 0 2024-09-11T00:07:14.042 INFO:tasks.workunit.client.1.smithi203.stdout:2/323: dwrite d13/d15/f1f [0,4194304] 0 2024-09-11T00:07:14.043 INFO:tasks.workunit.client.1.smithi203.stdout:7/372: mknod dd/d3b/d5b/c8b 0 2024-09-11T00:07:14.045 INFO:tasks.workunit.client.1.smithi203.stdout:7/373: truncate dd/d1c/f66 341382 0 2024-09-11T00:07:14.049 INFO:tasks.workunit.client.1.smithi203.stdout:6/353: symlink d0/d5b/l6b 0 2024-09-11T00:07:14.050 INFO:tasks.workunit.client.1.smithi203.stdout:4/374: creat db/dd/d26/f77 x:0 0 0 2024-09-11T00:07:14.052 INFO:tasks.workunit.client.1.smithi203.stdout:6/354: rename d0/d27/d35 to d0/d27/d35/d39/d6c 22 2024-09-11T00:07:14.052 INFO:tasks.workunit.client.0.smithi111.stdout:0/395: creat d3/d13/f89 x:0 0 0 2024-09-11T00:07:14.055 INFO:tasks.workunit.client.0.smithi111.stdout:0/396: dread d3/d13/d1e/f44 [0,4194304] 0 2024-09-11T00:07:14.056 INFO:tasks.workunit.client.1.smithi203.stdout:1/453: write d8/d9/d15/d35/f8f [859163,69370] 0 2024-09-11T00:07:14.057 INFO:tasks.workunit.client.0.smithi111.stdout:7/379: fsync dd/f1a 0 2024-09-11T00:07:14.059 INFO:tasks.workunit.client.1.smithi203.stdout:8/382: creat d1/d13/d22/f88 x:0 0 0 2024-09-11T00:07:14.061 INFO:tasks.workunit.client.1.smithi203.stdout:3/489: mkdir d8/da/d37/d53/d63/db5 0 2024-09-11T00:07:14.063 INFO:tasks.workunit.client.0.smithi111.stdout:9/406: creat d6/dc/f87 x:0 0 0 2024-09-11T00:07:14.064 INFO:tasks.workunit.client.1.smithi203.stdout:2/324: symlink d13/d56/l64 0 2024-09-11T00:07:14.065 INFO:tasks.workunit.client.0.smithi111.stdout:9/407: write d6/db/d34/d37/f35 [5202252,4375] 0 2024-09-11T00:07:14.068 INFO:tasks.workunit.client.0.smithi111.stdout:6/306: creat d7/d22/d2c/f62 x:0 0 0 2024-09-11T00:07:14.069 INFO:tasks.workunit.client.1.smithi203.stdout:4/375: creat db/d12/d15/f78 x:0 0 0 2024-09-11T00:07:14.071 INFO:tasks.workunit.client.0.smithi111.stdout:6/307: dread - d7/d22/d1d/f5f zero size 2024-09-11T00:07:14.071 INFO:tasks.workunit.client.0.smithi111.stdout:2/365: chown d0/c60 24 1 2024-09-11T00:07:14.071 INFO:tasks.workunit.client.1.smithi203.stdout:6/355: unlink d0/d27/f3b 0 2024-09-11T00:07:14.072 INFO:tasks.workunit.client.0.smithi111.stdout:6/308: stat d7/f52 0 2024-09-11T00:07:14.072 INFO:tasks.workunit.client.1.smithi203.stdout:4/376: truncate db/dd/d16/f6e 959423 0 2024-09-11T00:07:14.073 INFO:tasks.workunit.client.0.smithi111.stdout:0/397: dwrite d3/dc/f3f [0,4194304] 0 2024-09-11T00:07:14.076 INFO:tasks.workunit.client.0.smithi111.stdout:1/335: rename d2/de/d12/f4c to d2/de/d12/d3c/d4b/d6a/f72 0 2024-09-11T00:07:14.082 INFO:tasks.workunit.client.0.smithi111.stdout:7/380: rmdir dd/d48 39 2024-09-11T00:07:14.085 INFO:tasks.workunit.client.0.smithi111.stdout:4/346: fsync f5 0 2024-09-11T00:07:14.087 INFO:tasks.workunit.client.1.smithi203.stdout:3/490: creat d8/da/d11/fb6 x:0 0 0 2024-09-11T00:07:14.090 INFO:tasks.workunit.client.1.smithi203.stdout:0/394: getdents d0/d2/d37/d5b 0 2024-09-11T00:07:14.092 INFO:tasks.workunit.client.1.smithi203.stdout:0/395: chown d0/l36 0 1 2024-09-11T00:07:14.093 INFO:tasks.workunit.client.0.smithi111.stdout:6/309: dwrite d7/f23 [0,4194304] 0 2024-09-11T00:07:14.095 INFO:tasks.workunit.client.0.smithi111.stdout:8/427: dwrite d11/d23/d2c/d53/f5a [0,4194304] 0 2024-09-11T00:07:14.097 INFO:tasks.workunit.client.0.smithi111.stdout:0/398: dwrite d3/f54 [0,4194304] 0 2024-09-11T00:07:14.098 INFO:tasks.workunit.client.1.smithi203.stdout:0/396: dread - d0/d1d/d4c/f6f zero size 2024-09-11T00:07:14.101 INFO:tasks.workunit.client.0.smithi111.stdout:1/336: mkdir d2/de/d12/d3c/d4b/d6a/d63/d73 0 2024-09-11T00:07:14.104 INFO:tasks.workunit.client.0.smithi111.stdout:1/337: dread - d2/d2b/d2c/f5f zero size 2024-09-11T00:07:14.104 INFO:tasks.workunit.client.1.smithi203.stdout:7/374: dwrite dd/d3b/d5b/d6a/d31/d58/f64 [0,4194304] 0 2024-09-11T00:07:14.105 INFO:tasks.workunit.client.1.smithi203.stdout:0/397: chown d0/d2/fb 355446012 1 2024-09-11T00:07:14.109 INFO:tasks.workunit.client.1.smithi203.stdout:0/398: readlink d0/d1d/l68 0 2024-09-11T00:07:14.109 INFO:tasks.workunit.client.1.smithi203.stdout:4/377: dread db/d12/f66 [0,4194304] 0 2024-09-11T00:07:14.110 INFO:tasks.workunit.client.0.smithi111.stdout:1/338: truncate d2/de/d12/d3c/d4b/d6a/d63/f6e 787579 0 2024-09-11T00:07:14.111 INFO:tasks.workunit.client.0.smithi111.stdout:1/339: stat d2/de 0 2024-09-11T00:07:14.112 INFO:tasks.workunit.client.0.smithi111.stdout:6/310: dwrite d7/d2b/f5b [0,4194304] 0 2024-09-11T00:07:14.118 INFO:tasks.workunit.client.0.smithi111.stdout:6/311: write d7/d22/d3f/f42 [797524,11656] 0 2024-09-11T00:07:14.121 INFO:tasks.workunit.client.0.smithi111.stdout:1/340: truncate d2/de/d12/d3c/d4b/d6a/f64 381616 0 2024-09-11T00:07:14.123 INFO:tasks.workunit.client.1.smithi203.stdout:8/383: dwrite d1/d13/d17/f50 [4194304,4194304] 0 2024-09-11T00:07:14.124 INFO:tasks.workunit.client.0.smithi111.stdout:1/341: readlink d2/de/d12/l22 0 2024-09-11T00:07:14.125 INFO:tasks.workunit.client.1.smithi203.stdout:6/356: dwrite d0/d27/d35/d39/f6a [0,4194304] 0 2024-09-11T00:07:14.130 INFO:tasks.workunit.client.0.smithi111.stdout:8/428: rename d11/d23/d2c/d46/d64/f68 to d11/d23/d3d/f86 0 2024-09-11T00:07:14.133 INFO:tasks.workunit.client.1.smithi203.stdout:9/384: symlink d6/de/d19/d5b/l7c 0 2024-09-11T00:07:14.134 INFO:tasks.workunit.client.1.smithi203.stdout:7/375: mkdir dd/d1c/d7c/d8c 0 2024-09-11T00:07:14.135 INFO:tasks.workunit.client.0.smithi111.stdout:8/429: write d11/d21/f31 [175448,127934] 0 2024-09-11T00:07:14.136 INFO:tasks.workunit.client.0.smithi111.stdout:0/399: mknod d3/d13/d66/c8a 0 2024-09-11T00:07:14.137 INFO:tasks.workunit.client.1.smithi203.stdout:5/449: getdents dc/d65 0 2024-09-11T00:07:14.137 INFO:tasks.workunit.client.1.smithi203.stdout:3/491: write d8/da/d37/d83/d6a/f7d [81409,41719] 0 2024-09-11T00:07:14.138 INFO:tasks.workunit.client.1.smithi203.stdout:3/492: write d8/f16 [7181457,100514] 0 2024-09-11T00:07:14.139 INFO:tasks.workunit.client.1.smithi203.stdout:2/325: creat d13/d15/f65 x:0 0 0 2024-09-11T00:07:14.142 INFO:tasks.workunit.client.1.smithi203.stdout:7/376: chown dd/d3b/d5b/d6a/d31/f62 210 1 2024-09-11T00:07:14.144 INFO:tasks.workunit.client.1.smithi203.stdout:0/399: creat d0/d1d/d5d/f82 x:0 0 0 2024-09-11T00:07:14.146 INFO:tasks.workunit.client.1.smithi203.stdout:0/400: write d0/d2/fe [754360,83132] 0 2024-09-11T00:07:14.149 INFO:tasks.workunit.client.0.smithi111.stdout:3/407: getdents d1c/d21 0 2024-09-11T00:07:14.150 INFO:tasks.workunit.client.0.smithi111.stdout:9/408: dwrite d6/db/d1b/d56/f72 [0,4194304] 0 2024-09-11T00:07:14.151 INFO:tasks.workunit.client.1.smithi203.stdout:8/384: chown d1/d13/d17/d2f/d52/d49/c4b 223789415 1 2024-09-11T00:07:14.151 INFO:tasks.workunit.client.1.smithi203.stdout:6/357: symlink d0/d5b/l6d 0 2024-09-11T00:07:14.156 INFO:tasks.workunit.client.0.smithi111.stdout:1/342: creat d2/de/d12/d3c/d4b/f74 x:0 0 0 2024-09-11T00:07:14.156 INFO:tasks.workunit.client.0.smithi111.stdout:5/386: sync 2024-09-11T00:07:14.159 INFO:tasks.workunit.client.1.smithi203.stdout:8/385: write d1/d13/d3a/d4c/f5c [1370089,104488] 0 2024-09-11T00:07:14.160 INFO:tasks.workunit.client.0.smithi111.stdout:9/409: truncate d6/db/d34/f66 1617827 0 2024-09-11T00:07:14.163 INFO:tasks.workunit.client.0.smithi111.stdout:0/400: dwrite d3/d13/f68 [0,4194304] 0 2024-09-11T00:07:14.163 INFO:tasks.workunit.client.0.smithi111.stdout:7/381: rename dd/d48/d69/f71 to dd/d1d/d2d/d2e/f7a 0 2024-09-11T00:07:14.168 INFO:tasks.workunit.client.0.smithi111.stdout:1/343: write d2/de/d12/d3c/d4b/d6a/d3a/f3b [930939,111450] 0 2024-09-11T00:07:14.168 INFO:tasks.workunit.client.0.smithi111.stdout:0/401: chown d3/dc/f12 0 1 2024-09-11T00:07:14.168 INFO:tasks.workunit.client.0.smithi111.stdout:8/430: link d11/d23/d2c/d46/f4d d11/d21/d6f/f87 0 2024-09-11T00:07:14.168 INFO:tasks.workunit.client.0.smithi111.stdout:1/344: readlink d2/lb 0 2024-09-11T00:07:14.169 INFO:tasks.workunit.client.1.smithi203.stdout:2/326: dwrite d13/d15/d30/f63 [0,4194304] 0 2024-09-11T00:07:14.169 INFO:tasks.workunit.client.1.smithi203.stdout:5/450: mknod dc/dd/d1e/d7b/c94 0 2024-09-11T00:07:14.169 INFO:tasks.workunit.client.0.smithi111.stdout:2/366: dread d0/d3/f13 [0,4194304] 0 2024-09-11T00:07:14.171 INFO:tasks.workunit.client.1.smithi203.stdout:8/386: chown d1/d13/l3e 0 1 2024-09-11T00:07:14.178 INFO:tasks.workunit.client.1.smithi203.stdout:1/454: link d8/d19/f26 d8/d19/d60/d90/f98 0 2024-09-11T00:07:14.182 INFO:tasks.workunit.client.1.smithi203.stdout:2/327: write d13/d47/f61 [4766086,52612] 0 2024-09-11T00:07:14.182 INFO:tasks.workunit.client.1.smithi203.stdout:1/455: chown d8/f6d 33 1 2024-09-11T00:07:14.183 INFO:tasks.workunit.client.0.smithi111.stdout:4/347: getdents d18/d20/d4e 0 2024-09-11T00:07:14.183 INFO:tasks.workunit.client.1.smithi203.stdout:3/493: creat d8/da/d5c/d99/fb7 x:0 0 0 2024-09-11T00:07:14.184 INFO:tasks.workunit.client.1.smithi203.stdout:5/451: read dc/dd/d15/d3b/f47 [3078226,128296] 0 2024-09-11T00:07:14.185 INFO:tasks.workunit.client.1.smithi203.stdout:7/377: link dd/f30 dd/d1c/d52/f8d 0 2024-09-11T00:07:14.187 INFO:tasks.workunit.client.0.smithi111.stdout:6/312: dread d7/f15 [0,4194304] 0 2024-09-11T00:07:14.187 INFO:tasks.workunit.client.0.smithi111.stdout:4/348: fdatasync d18/d20/d4a/f2f 0 2024-09-11T00:07:14.191 INFO:tasks.workunit.client.0.smithi111.stdout:9/410: dwrite d6/db/d34/f3d [0,4194304] 0 2024-09-11T00:07:14.192 INFO:tasks.workunit.client.0.smithi111.stdout:7/382: unlink dd/d1d/d4d/l51 0 2024-09-11T00:07:14.194 INFO:tasks.workunit.client.1.smithi203.stdout:0/401: dwrite d0/d2/fd [0,4194304] 0 2024-09-11T00:07:14.195 INFO:tasks.workunit.client.1.smithi203.stdout:6/358: rename d0/d27/d35/d38/f47 to d0/d27/d35/d39/d3c/f6e 0 2024-09-11T00:07:14.203 INFO:tasks.workunit.client.0.smithi111.stdout:3/408: write d1c/d1d/f1e [545207,115296] 0 2024-09-11T00:07:14.208 INFO:tasks.workunit.client.1.smithi203.stdout:8/387: dwrite d1/d13/d3a/f44 [0,4194304] 0 2024-09-11T00:07:14.210 INFO:tasks.workunit.client.0.smithi111.stdout:8/431: creat d11/d23/d2c/d46/d64/f88 x:0 0 0 2024-09-11T00:07:14.211 INFO:tasks.workunit.client.1.smithi203.stdout:9/385: dwrite d6/de/d19/d24/f27 [0,4194304] 0 2024-09-11T00:07:14.213 INFO:tasks.workunit.client.1.smithi203.stdout:9/386: chown d6/f14 38 1 2024-09-11T00:07:14.213 INFO:tasks.workunit.client.0.smithi111.stdout:5/387: creat d10/d1e/d23/d26/d78/d7a/f83 x:0 0 0 2024-09-11T00:07:14.215 INFO:tasks.workunit.client.0.smithi111.stdout:5/388: fdatasync d10/d1e/f28 0 2024-09-11T00:07:14.217 INFO:tasks.workunit.client.1.smithi203.stdout:5/452: mknod dc/d4f/d5c/c95 0 2024-09-11T00:07:14.221 INFO:tasks.workunit.client.0.smithi111.stdout:6/313: mknod d7/d4d/c63 0 2024-09-11T00:07:14.224 INFO:tasks.workunit.client.0.smithi111.stdout:3/409: dwrite d1c/d1d/d22/f61 [0,4194304] 0 2024-09-11T00:07:14.225 INFO:tasks.workunit.client.1.smithi203.stdout:0/402: dread - d0/d2/d37/f53 zero size 2024-09-11T00:07:14.225 INFO:tasks.workunit.client.0.smithi111.stdout:7/383: chown dd/f33 1380 1 2024-09-11T00:07:14.226 INFO:tasks.workunit.client.0.smithi111.stdout:0/402: creat d3/da/d7b/d84/f8b x:0 0 0 2024-09-11T00:07:14.227 INFO:tasks.workunit.client.1.smithi203.stdout:8/388: mknod d1/d13/d22/c89 0 2024-09-11T00:07:14.235 INFO:tasks.workunit.client.1.smithi203.stdout:5/453: write dc/dd/d13/f48 [1802661,22860] 0 2024-09-11T00:07:14.237 INFO:tasks.workunit.client.0.smithi111.stdout:4/349: dread f14 [0,4194304] 0 2024-09-11T00:07:14.238 INFO:tasks.workunit.client.0.smithi111.stdout:4/350: fdatasync f14 0 2024-09-11T00:07:14.247 INFO:tasks.workunit.client.1.smithi203.stdout:7/378: rename dd/f10 to dd/d3b/d5b/f8e 0 2024-09-11T00:07:14.248 INFO:tasks.workunit.client.0.smithi111.stdout:5/389: symlink d10/d1e/d23/d30/d3c/d60/d7e/d47/d66/l84 0 2024-09-11T00:07:14.251 INFO:tasks.workunit.client.1.smithi203.stdout:0/403: read d0/d2/d37/f3e [579117,100325] 0 2024-09-11T00:07:14.253 INFO:tasks.workunit.client.1.smithi203.stdout:0/404: stat d0/d1d/f3c 0 2024-09-11T00:07:14.255 INFO:tasks.workunit.client.1.smithi203.stdout:9/387: mkdir d6/de/d32/d52/d44/d7d 0 2024-09-11T00:07:14.256 INFO:tasks.workunit.client.0.smithi111.stdout:3/410: write d1c/d1d/f20 [5873019,77988] 0 2024-09-11T00:07:14.259 INFO:tasks.workunit.client.0.smithi111.stdout:3/411: write d1c/d1d/d22/d31/d33/f59 [1461465,73386] 0 2024-09-11T00:07:14.260 INFO:tasks.workunit.client.0.smithi111.stdout:6/314: dread d7/f30 [0,4194304] 0 2024-09-11T00:07:14.261 INFO:tasks.workunit.client.0.smithi111.stdout:7/384: unlink dd/d1d/d4b/f5c 0 2024-09-11T00:07:14.262 INFO:tasks.workunit.client.1.smithi203.stdout:3/494: dwrite d8/f59 [0,4194304] 0 2024-09-11T00:07:14.264 INFO:tasks.workunit.client.0.smithi111.stdout:8/432: write d11/d21/d38/d54/d5b/f61 [814718,28419] 0 2024-09-11T00:07:14.266 INFO:tasks.workunit.client.0.smithi111.stdout:1/345: link d2/de/d12/d34/f20 d2/d2b/f75 0 2024-09-11T00:07:14.268 INFO:tasks.workunit.client.1.smithi203.stdout:2/328: getdents d13/d15/d30 0 2024-09-11T00:07:14.269 INFO:tasks.workunit.client.1.smithi203.stdout:1/456: rename d8/d19/d60/l93 to d8/d9/d15/d27/l99 0 2024-09-11T00:07:14.272 INFO:tasks.workunit.client.0.smithi111.stdout:4/351: unlink d18/d1f/c50 0 2024-09-11T00:07:14.278 INFO:tasks.workunit.client.1.smithi203.stdout:5/454: dwrite dc/dd/d15/d3b/f47 [0,4194304] 0 2024-09-11T00:07:14.282 INFO:tasks.workunit.client.0.smithi111.stdout:3/412: dwrite d1c/d1d/f1e [0,4194304] 0 2024-09-11T00:07:14.283 INFO:tasks.workunit.client.0.smithi111.stdout:2/367: rename d0/d3/de/d4b/f69 to d0/d3/f84 0 2024-09-11T00:07:14.284 INFO:tasks.workunit.client.1.smithi203.stdout:0/405: readlink d0/d2/d3d/l4a 0 2024-09-11T00:07:14.284 INFO:tasks.workunit.client.1.smithi203.stdout:8/389: dwrite d1/d13/d17/f26 [0,4194304] 0 2024-09-11T00:07:14.288 INFO:tasks.workunit.client.0.smithi111.stdout:8/433: dwrite d11/d23/d2c/d53/f55 [0,4194304] 0 2024-09-11T00:07:14.291 INFO:tasks.workunit.client.0.smithi111.stdout:9/411: creat d6/f88 x:0 0 0 2024-09-11T00:07:14.291 INFO:tasks.workunit.client.0.smithi111.stdout:3/413: write d1c/d1d/d22/d31/d33/f36 [2090096,110242] 0 2024-09-11T00:07:14.292 INFO:tasks.workunit.client.0.smithi111.stdout:2/368: truncate d0/d3/de/d3b/d63/f75 896627 0 2024-09-11T00:07:14.294 INFO:tasks.workunit.client.1.smithi203.stdout:6/359: getdents d0/d27/d35/d39/d3c 0 2024-09-11T00:07:14.305 INFO:tasks.workunit.client.1.smithi203.stdout:3/495: creat d8/da/d5c/d80/fb8 x:0 0 0 2024-09-11T00:07:14.308 INFO:tasks.workunit.client.1.smithi203.stdout:2/329: rename d13/d15/f58 to d13/d15/d19/f66 0 2024-09-11T00:07:14.310 INFO:tasks.workunit.client.0.smithi111.stdout:0/403: dread d3/dc/f12 [0,4194304] 0 2024-09-11T00:07:14.312 INFO:tasks.workunit.client.0.smithi111.stdout:0/404: chown d3/d1c/f42 7736606 1 2024-09-11T00:07:14.313 INFO:tasks.workunit.client.1.smithi203.stdout:2/330: fsync f8 0 2024-09-11T00:07:14.313 INFO:tasks.workunit.client.1.smithi203.stdout:4/378: sync 2024-09-11T00:07:14.315 INFO:tasks.workunit.client.0.smithi111.stdout:0/405: fsync d3/d13/d1e/d29/d49/d51/f59 0 2024-09-11T00:07:14.316 INFO:tasks.workunit.client.1.smithi203.stdout:0/406: dwrite d0/d2/d3d/d5a/f7c [0,4194304] 0 2024-09-11T00:07:14.317 INFO:tasks.workunit.client.1.smithi203.stdout:7/379: truncate fc 3076051 0 2024-09-11T00:07:14.318 INFO:tasks.workunit.client.1.smithi203.stdout:5/455: symlink dc/d65/l96 0 2024-09-11T00:07:14.319 INFO:tasks.workunit.client.0.smithi111.stdout:1/346: truncate d2/de/f17 338537 0 2024-09-11T00:07:14.320 INFO:tasks.workunit.client.1.smithi203.stdout:4/379: chown db/l27 92178739 1 2024-09-11T00:07:14.323 INFO:tasks.workunit.client.0.smithi111.stdout:5/390: mkdir d10/d1e/d23/d30/d59/d52/d85 0 2024-09-11T00:07:14.325 INFO:tasks.workunit.client.0.smithi111.stdout:5/391: write d10/d1e/d23/d26/f4c [1055454,84079] 0 2024-09-11T00:07:14.327 INFO:tasks.workunit.client.1.smithi203.stdout:8/390: rename d1/d13/f35 to d1/d13/d22/d6f/f8a 0 2024-09-11T00:07:14.327 INFO:tasks.workunit.client.1.smithi203.stdout:3/496: mkdir d8/da/d37/d83/db9 0 2024-09-11T00:07:14.331 INFO:tasks.workunit.client.0.smithi111.stdout:5/392: write d10/d1e/d23/d30/d3c/d60/d7e/d47/d66/f67 [192399,29674] 0 2024-09-11T00:07:14.332 INFO:tasks.workunit.client.1.smithi203.stdout:1/457: creat d8/d19/d60/d90/d3e/d4b/d41/f9a x:0 0 0 2024-09-11T00:07:14.335 INFO:tasks.workunit.client.0.smithi111.stdout:5/393: write d10/d1e/d23/d26/d3a/f5d [940832,91600] 0 2024-09-11T00:07:14.341 INFO:tasks.workunit.client.1.smithi203.stdout:5/456: rmdir dc/dd/d1e/d7b 39 2024-09-11T00:07:14.347 INFO:tasks.workunit.client.0.smithi111.stdout:6/315: mknod d7/d22/d2d/d4a/c64 0 2024-09-11T00:07:14.354 INFO:tasks.workunit.client.0.smithi111.stdout:5/394: dwrite d10/d1e/d25/d6e/f7d [0,4194304] 0 2024-09-11T00:07:14.355 INFO:tasks.workunit.client.1.smithi203.stdout:9/388: truncate d6/f14 3427987 0 2024-09-11T00:07:14.360 INFO:tasks.workunit.client.1.smithi203.stdout:4/380: dwrite db/dd/d26/d42/d5e/f65 [0,4194304] 0 2024-09-11T00:07:14.361 INFO:tasks.workunit.client.0.smithi111.stdout:4/352: symlink d18/d20/l70 0 2024-09-11T00:07:14.361 INFO:tasks.workunit.client.0.smithi111.stdout:4/353: readlink d18/d1f/l45 0 2024-09-11T00:07:14.362 INFO:tasks.workunit.client.1.smithi203.stdout:2/331: mknod d13/d15/c67 0 2024-09-11T00:07:14.365 INFO:tasks.workunit.client.0.smithi111.stdout:9/412: symlink d6/db/d1b/l89 0 2024-09-11T00:07:14.368 INFO:tasks.workunit.client.0.smithi111.stdout:2/369: creat d0/d83/f85 x:0 0 0 2024-09-11T00:07:14.368 INFO:tasks.workunit.client.1.smithi203.stdout:2/332: chown d13/d15/c4c 200 1 2024-09-11T00:07:14.371 INFO:tasks.workunit.client.0.smithi111.stdout:3/414: rename d1c/d1d/d22/f4d to d1c/d1d/d22/d31/d33/d5f/f8c 0 2024-09-11T00:07:14.373 INFO:tasks.workunit.client.1.smithi203.stdout:5/457: dwrite dc/dd/d15/f2c [0,4194304] 0 2024-09-11T00:07:14.379 INFO:tasks.workunit.client.1.smithi203.stdout:7/380: dwrite dd/d1c/f2b [0,4194304] 0 2024-09-11T00:07:14.395 INFO:tasks.workunit.client.0.smithi111.stdout:1/347: rename d2/de/d12 to d2/de/d12/d34/d76 22 2024-09-11T00:07:14.395 INFO:tasks.workunit.client.0.smithi111.stdout:0/406: dwrite d3/d13/d1e/f44 [0,4194304] 0 2024-09-11T00:07:14.396 INFO:tasks.workunit.client.0.smithi111.stdout:6/316: creat d7/d22/d3f/f65 x:0 0 0 2024-09-11T00:07:14.403 INFO:tasks.workunit.client.0.smithi111.stdout:2/370: mknod d0/d3/d12/d52/d6c/c86 0 2024-09-11T00:07:14.404 INFO:tasks.workunit.client.0.smithi111.stdout:7/385: getdents dd/d1d/d4b 0 2024-09-11T00:07:14.407 INFO:tasks.workunit.client.0.smithi111.stdout:0/407: stat d3/d13/d1e/d29/d49/d51/f71 0 2024-09-11T00:07:14.408 INFO:tasks.workunit.client.0.smithi111.stdout:0/408: fsync d3/f7a 0 2024-09-11T00:07:14.408 INFO:tasks.workunit.client.0.smithi111.stdout:8/434: getdents d11/d21/d38/d54 0 2024-09-11T00:07:14.410 INFO:tasks.workunit.client.0.smithi111.stdout:2/371: write d0/d3/de/d3b/d62/d6d/f71 [985673,75870] 0 2024-09-11T00:07:14.411 INFO:tasks.workunit.client.0.smithi111.stdout:9/413: write d6/db/d34/d37/f48 [136829,40013] 0 2024-09-11T00:07:14.413 INFO:tasks.workunit.client.0.smithi111.stdout:1/348: dread - d2/d2b/d2c/d56/f71 zero size 2024-09-11T00:07:14.417 INFO:tasks.workunit.client.0.smithi111.stdout:6/317: creat d7/d2b/d35/d41/f66 x:0 0 0 2024-09-11T00:07:14.417 INFO:tasks.workunit.client.0.smithi111.stdout:9/414: truncate d6/dc/d73/f77 621515 0 2024-09-11T00:07:14.419 INFO:tasks.workunit.client.1.smithi203.stdout:0/407: mkdir d0/d2/d7e/d83 0 2024-09-11T00:07:14.419 INFO:tasks.workunit.client.0.smithi111.stdout:4/354: creat d18/f71 x:0 0 0 2024-09-11T00:07:14.419 INFO:tasks.workunit.client.0.smithi111.stdout:1/349: write d2/de/d12/d3c/d4b/d6a/f59 [1503222,125221] 0 2024-09-11T00:07:14.421 INFO:tasks.workunit.client.1.smithi203.stdout:0/408: write d0/d2/fe [2825801,12281] 0 2024-09-11T00:07:14.423 INFO:tasks.workunit.client.0.smithi111.stdout:2/372: readlink d0/l1 0 2024-09-11T00:07:14.424 INFO:tasks.workunit.client.0.smithi111.stdout:3/415: dread d1c/d1d/d22/d31/d33/f59 [0,4194304] 0 2024-09-11T00:07:14.424 INFO:tasks.workunit.client.1.smithi203.stdout:0/409: dread - d0/d2/d37/f53 zero size 2024-09-11T00:07:14.424 INFO:tasks.workunit.client.1.smithi203.stdout:4/381: creat db/dd/f79 x:0 0 0 2024-09-11T00:07:14.425 INFO:tasks.workunit.client.0.smithi111.stdout:9/415: mkdir d6/d52/d8a 0 2024-09-11T00:07:14.426 INFO:tasks.workunit.client.0.smithi111.stdout:2/373: chown d0/d3/de/c48 3999908 1 2024-09-11T00:07:14.426 INFO:tasks.workunit.client.1.smithi203.stdout:8/391: mkdir d1/d13/d17/d8b 0 2024-09-11T00:07:14.427 INFO:tasks.workunit.client.0.smithi111.stdout:3/416: chown d1c/d1d/d22/d31 1288 1 2024-09-11T00:07:14.428 INFO:tasks.workunit.client.1.smithi203.stdout:1/458: mkdir d8/d19/d60/d90/d3e/d9b 0 2024-09-11T00:07:14.429 INFO:tasks.workunit.client.1.smithi203.stdout:8/392: read d1/d13/d43/d46/f6d [1358811,112635] 0 2024-09-11T00:07:14.429 INFO:tasks.workunit.client.0.smithi111.stdout:9/416: truncate d6/db/d1b/d56/f6b 729642 0 2024-09-11T00:07:14.429 INFO:tasks.workunit.client.0.smithi111.stdout:1/350: unlink d2/de/c31 0 2024-09-11T00:07:14.431 INFO:tasks.workunit.client.1.smithi203.stdout:2/333: symlink d13/l68 0 2024-09-11T00:07:14.431 INFO:tasks.workunit.client.1.smithi203.stdout:8/393: chown d1/d13/d17/d48/d61 2095026739 1 2024-09-11T00:07:14.432 INFO:tasks.workunit.client.0.smithi111.stdout:1/351: chown d2/de/d12/d3c/d4b/d6a/d3a/f40 0 1 2024-09-11T00:07:14.434 INFO:tasks.workunit.client.1.smithi203.stdout:5/458: creat dc/d65/f97 x:0 0 0 2024-09-11T00:07:14.436 INFO:tasks.workunit.client.0.smithi111.stdout:4/355: mknod d18/d20/d4a/c72 0 2024-09-11T00:07:14.438 INFO:tasks.workunit.client.1.smithi203.stdout:5/459: truncate dc/dd/d15/f42 372764 0 2024-09-11T00:07:14.439 INFO:tasks.workunit.client.0.smithi111.stdout:4/356: write d18/d39/f66 [974087,48112] 0 2024-09-11T00:07:14.440 INFO:tasks.workunit.client.1.smithi203.stdout:9/389: symlink d6/de/d32/d52/d55/l7e 0 2024-09-11T00:07:14.440 INFO:tasks.workunit.client.0.smithi111.stdout:6/318: symlink d7/d4d/d61/l67 0 2024-09-11T00:07:14.442 INFO:tasks.workunit.client.0.smithi111.stdout:3/417: symlink d1c/d1d/d22/d31/d62/l8d 0 2024-09-11T00:07:14.445 INFO:tasks.workunit.client.1.smithi203.stdout:5/460: truncate dc/dd/d15/f42 916805 0 2024-09-11T00:07:14.446 INFO:tasks.workunit.client.1.smithi203.stdout:5/461: chown dc/l1b 950 1 2024-09-11T00:07:14.448 INFO:tasks.workunit.client.1.smithi203.stdout:5/462: fdatasync dc/dd/d4d/f81 0 2024-09-11T00:07:14.448 INFO:tasks.workunit.client.0.smithi111.stdout:2/374: dwrite d0/d3/de/d4b/f7a [0,4194304] 0 2024-09-11T00:07:14.449 INFO:tasks.workunit.client.1.smithi203.stdout:1/459: unlink d8/d9/d15/f43 0 2024-09-11T00:07:14.450 INFO:tasks.workunit.client.1.smithi203.stdout:8/394: dwrite d1/f2 [4194304,4194304] 0 2024-09-11T00:07:14.454 INFO:tasks.workunit.client.1.smithi203.stdout:2/334: mkdir d13/d56/d69 0 2024-09-11T00:07:14.461 INFO:tasks.workunit.client.1.smithi203.stdout:4/382: symlink db/l7a 0 2024-09-11T00:07:14.462 INFO:tasks.workunit.client.0.smithi111.stdout:5/395: sync 2024-09-11T00:07:14.469 INFO:tasks.workunit.client.0.smithi111.stdout:0/409: getdents d3/d13/d1e/d29/d49/d51 0 2024-09-11T00:07:14.472 INFO:tasks.workunit.client.0.smithi111.stdout:3/418: creat d1c/d1d/d22/d23/d2f/f8e x:0 0 0 2024-09-11T00:07:14.473 INFO:tasks.workunit.client.1.smithi203.stdout:5/463: unlink dc/dd/d1e/f71 0 2024-09-11T00:07:14.475 INFO:tasks.workunit.client.0.smithi111.stdout:8/435: write d11/f3c [3616511,129244] 0 2024-09-11T00:07:14.477 INFO:tasks.workunit.client.1.smithi203.stdout:1/460: read - d8/d19/d60/d90/d3e/d4b/d3a/f4f zero size 2024-09-11T00:07:14.478 INFO:tasks.workunit.client.0.smithi111.stdout:2/375: creat d0/d3/d12/d52/f87 x:0 0 0 2024-09-11T00:07:14.478 INFO:tasks.workunit.client.0.smithi111.stdout:8/436: chown d11/d23/d2c/d46/f69 126022939 1 2024-09-11T00:07:14.480 INFO:tasks.workunit.client.0.smithi111.stdout:2/376: write d0/d3/f56 [4705304,12133] 0 2024-09-11T00:07:14.480 INFO:tasks.workunit.client.1.smithi203.stdout:8/395: rename d1/d13/d22/l25 to d1/d13/d43/d46/l8c 0 2024-09-11T00:07:14.481 INFO:tasks.workunit.client.0.smithi111.stdout:1/352: mkdir d2/d77 0 2024-09-11T00:07:14.485 INFO:tasks.workunit.client.0.smithi111.stdout:1/353: write d2/de/d12/d3c/f69 [20708,46920] 0 2024-09-11T00:07:14.486 INFO:tasks.workunit.client.1.smithi203.stdout:8/396: write d1/d13/d3a/d4c/f5e [33472,13115] 0 2024-09-11T00:07:14.486 INFO:tasks.workunit.client.0.smithi111.stdout:4/357: symlink d18/d20/d3c/d5e/l73 0 2024-09-11T00:07:14.487 INFO:tasks.workunit.client.1.smithi203.stdout:7/381: dwrite dd/f30 [0,4194304] 0 2024-09-11T00:07:14.487 INFO:tasks.workunit.client.1.smithi203.stdout:4/383: creat db/dd/d16/f7b x:0 0 0 2024-09-11T00:07:14.492 INFO:tasks.workunit.client.0.smithi111.stdout:3/419: dwrite d1c/d1d/d22/f70 [0,4194304] 0 2024-09-11T00:07:14.495 INFO:tasks.workunit.client.0.smithi111.stdout:7/386: truncate dd/f31 1489384 0 2024-09-11T00:07:14.498 INFO:tasks.workunit.client.1.smithi203.stdout:0/410: truncate d0/d2/fe 2479387 0 2024-09-11T00:07:14.502 INFO:tasks.workunit.client.0.smithi111.stdout:9/417: rename d6/db/d1b/l89 to d6/db/d34/l8b 0 2024-09-11T00:07:14.502 INFO:tasks.workunit.client.1.smithi203.stdout:2/335: dread d13/d15/d19/f28 [4194304,4194304] 0 2024-09-11T00:07:14.507 INFO:tasks.workunit.client.0.smithi111.stdout:8/437: creat d11/d23/d2c/f89 x:0 0 0 2024-09-11T00:07:14.509 INFO:tasks.workunit.client.0.smithi111.stdout:6/319: creat d7/d2b/f68 x:0 0 0 2024-09-11T00:07:14.512 INFO:tasks.workunit.client.0.smithi111.stdout:6/320: write d7/d2b/f5b [1566013,57400] 0 2024-09-11T00:07:14.512 INFO:tasks.workunit.client.1.smithi203.stdout:7/382: rename dd/d3b/d5b/d6a to dd/d1c/d52/d8f 0 2024-09-11T00:07:14.513 INFO:tasks.workunit.client.1.smithi203.stdout:2/336: read d13/f41 [297341,117058] 0 2024-09-11T00:07:14.515 INFO:tasks.workunit.client.1.smithi203.stdout:7/383: write dd/d4d/f73 [4060643,88487] 0 2024-09-11T00:07:14.518 INFO:tasks.workunit.client.1.smithi203.stdout:7/384: chown dd/d1c/d7c 207 1 2024-09-11T00:07:14.519 INFO:tasks.workunit.client.1.smithi203.stdout:2/337: readlink d13/d15/d30/d5a/l60 0 2024-09-11T00:07:14.520 INFO:tasks.workunit.client.1.smithi203.stdout:8/397: dread d1/d13/d17/f26 [0,4194304] 0 2024-09-11T00:07:14.520 INFO:tasks.workunit.client.1.smithi203.stdout:2/338: readlink d13/d56/l62 0 2024-09-11T00:07:14.521 INFO:tasks.workunit.client.0.smithi111.stdout:5/396: mkdir d10/d1e/d23/d30/d59/d7b/d82/d86 0 2024-09-11T00:07:14.522 INFO:tasks.workunit.client.1.smithi203.stdout:1/461: dread d8/d9/d15/d27/f39 [0,4194304] 0 2024-09-11T00:07:14.524 INFO:tasks.workunit.client.0.smithi111.stdout:0/410: mknod d3/d13/d1e/d29/d49/c8c 0 2024-09-11T00:07:14.526 INFO:tasks.workunit.client.1.smithi203.stdout:9/390: getdents d6/de/d19/d21 0 2024-09-11T00:07:14.528 INFO:tasks.workunit.client.1.smithi203.stdout:4/384: dread db/dd/d16/f24 [0,4194304] 0 2024-09-11T00:07:14.529 INFO:tasks.workunit.client.0.smithi111.stdout:3/420: truncate d1c/d1d/d22/d23/f4a 238317 0 2024-09-11T00:07:14.530 INFO:tasks.workunit.client.1.smithi203.stdout:5/464: write dc/d65/f4a [193781,41382] 0 2024-09-11T00:07:14.531 INFO:tasks.workunit.client.1.smithi203.stdout:7/385: creat dd/d4d/f90 x:0 0 0 2024-09-11T00:07:14.533 INFO:tasks.workunit.client.0.smithi111.stdout:3/421: chown d1c/d1d/d22/d23/d58/f75 35 1 2024-09-11T00:07:14.534 INFO:tasks.workunit.client.0.smithi111.stdout:2/377: rename d0/d3/l14 to d0/d3/de/d3b/d62/d6d/l88 0 2024-09-11T00:07:14.539 INFO:tasks.workunit.client.0.smithi111.stdout:9/418: creat d6/db/d34/d37/d4c/f8c x:0 0 0 2024-09-11T00:07:14.540 INFO:tasks.workunit.client.0.smithi111.stdout:8/438: dread d11/d21/d38/f47 [0,4194304] 0 2024-09-11T00:07:14.540 INFO:tasks.workunit.client.1.smithi203.stdout:2/339: creat d13/d15/d30/d59/f6a x:0 0 0 2024-09-11T00:07:14.542 INFO:tasks.workunit.client.0.smithi111.stdout:5/397: dwrite d10/d1e/f21 [0,4194304] 0 2024-09-11T00:07:14.542 INFO:tasks.workunit.client.1.smithi203.stdout:2/340: dread - d13/d15/d30/f4f zero size 2024-09-11T00:07:14.543 INFO:tasks.workunit.client.1.smithi203.stdout:8/398: rename d1/d13/d43/d46/d64 to d1/d13/d22/d6f/d8d 0 2024-09-11T00:07:14.550 INFO:tasks.workunit.client.0.smithi111.stdout:6/321: mkdir d7/d22/d1d/d69 0 2024-09-11T00:07:14.551 INFO:tasks.workunit.client.1.smithi203.stdout:4/385: mkdir db/dd/d26/d42/d7c 0 2024-09-11T00:07:14.553 INFO:tasks.workunit.client.0.smithi111.stdout:1/354: link d2/de/d12/d3c/d4b/f74 d2/de/d12/d3c/d4b/d6a/d63/f78 0 2024-09-11T00:07:14.554 INFO:tasks.workunit.client.0.smithi111.stdout:6/322: dread - d7/d22/d3f/f65 zero size 2024-09-11T00:07:14.557 INFO:tasks.workunit.client.0.smithi111.stdout:7/387: creat dd/d1d/d2d/d68/d79/f7b x:0 0 0 2024-09-11T00:07:14.558 INFO:tasks.workunit.client.1.smithi203.stdout:7/386: mknod dd/d1c/d52/d8f/c91 0 2024-09-11T00:07:14.558 INFO:tasks.workunit.client.0.smithi111.stdout:9/419: dwrite d6/db/f18 [0,4194304] 0 2024-09-11T00:07:14.561 INFO:tasks.workunit.client.0.smithi111.stdout:0/411: dread d3/d13/d1e/d29/d49/d51/d61/f7e [0,4194304] 0 2024-09-11T00:07:14.564 INFO:tasks.workunit.client.1.smithi203.stdout:1/462: rename d8/d19/d60/d90/d3e/d4b/d41/d7e/c94 to d8/d19/d31/d36/c9c 0 2024-09-11T00:07:14.564 INFO:tasks.workunit.client.0.smithi111.stdout:9/420: fsync d6/db/d34/d37/f48 0 2024-09-11T00:07:14.565 INFO:tasks.workunit.client.0.smithi111.stdout:9/421: fsync d6/db/d1b/f1e 0 2024-09-11T00:07:14.568 INFO:tasks.workunit.client.0.smithi111.stdout:9/422: fsync d6/dc/f17 0 2024-09-11T00:07:14.568 INFO:tasks.workunit.client.0.smithi111.stdout:5/398: truncate d10/d1e/d23/d26/f34 2036756 0 2024-09-11T00:07:14.575 INFO:tasks.workunit.client.1.smithi203.stdout:5/465: mknod dc/dd/c98 0 2024-09-11T00:07:14.582 INFO:tasks.workunit.client.0.smithi111.stdout:7/388: dread fa [0,4194304] 0 2024-09-11T00:07:14.583 INFO:tasks.workunit.client.1.smithi203.stdout:1/463: dwrite d8/d19/d31/f88 [0,4194304] 0 2024-09-11T00:07:14.583 INFO:tasks.workunit.client.0.smithi111.stdout:3/422: getdents d1c/d21 0 2024-09-11T00:07:14.584 INFO:tasks.workunit.client.0.smithi111.stdout:7/389: chown dd/d1d/c37 1741811 1 2024-09-11T00:07:14.586 INFO:tasks.workunit.client.0.smithi111.stdout:3/423: write d1c/d1d/d22/d44/d5a/f69 [466114,124975] 0 2024-09-11T00:07:14.586 INFO:tasks.workunit.client.1.smithi203.stdout:3/497: sync 2024-09-11T00:07:14.587 INFO:tasks.workunit.client.1.smithi203.stdout:6/360: sync 2024-09-11T00:07:14.590 INFO:tasks.workunit.client.0.smithi111.stdout:4/358: write d18/d1f/d36/f38 [842544,4850] 0 2024-09-11T00:07:14.591 INFO:tasks.workunit.client.0.smithi111.stdout:4/359: stat d18 0 2024-09-11T00:07:14.593 INFO:tasks.workunit.client.0.smithi111.stdout:2/378: symlink d0/l89 0 2024-09-11T00:07:14.594 INFO:tasks.workunit.client.1.smithi203.stdout:0/411: link d0/d1d/c4e d0/d1d/c84 0 2024-09-11T00:07:14.595 INFO:tasks.workunit.client.0.smithi111.stdout:2/379: chown d0/d3/f4e 2 1 2024-09-11T00:07:14.597 INFO:tasks.workunit.client.1.smithi203.stdout:0/412: chown d0/d1d/c33 22888 1 2024-09-11T00:07:14.599 INFO:tasks.workunit.client.0.smithi111.stdout:0/412: creat d3/d74/f8d x:0 0 0 2024-09-11T00:07:14.600 INFO:tasks.workunit.client.1.smithi203.stdout:0/413: write d0/d2/f81 [104366,110025] 0 2024-09-11T00:07:14.600 INFO:tasks.workunit.client.1.smithi203.stdout:5/466: mknod dc/dd/d15/d3b/c99 0 2024-09-11T00:07:14.603 INFO:tasks.workunit.client.1.smithi203.stdout:8/399: write d1/f8 [4728953,46737] 0 2024-09-11T00:07:14.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.600+0000 7f166fe00700 1 -- 172.21.15.111:0/4165410055 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16701011c0 msgr2=0x7f1670101610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:14.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.600+0000 7f166fe00700 1 --2- 172.21.15.111:0/4165410055 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16701011c0 0x7f1670101610 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f165c009910 tx=0x7f165c009c20 comp rx=0 tx=0).stop 2024-09-11T00:07:14.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.601+0000 7f166fe00700 1 -- 172.21.15.111:0/4165410055 shutdown_connections 2024-09-11T00:07:14.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.601+0000 7f166fe00700 1 --2- 172.21.15.111:0/4165410055 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16701011c0 0x7f1670101610 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.601+0000 7f166fe00700 1 --2- 172.21.15.111:0/4165410055 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f16700fffc0 0x7f16701003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.601+0000 7f166fe00700 1 -- 172.21.15.111:0/4165410055 >> 172.21.15.111:0/4165410055 conn(0x7f16700fb570 msgr2=0x7f16700fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:14.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.601+0000 7f166fe00700 1 -- 172.21.15.111:0/4165410055 shutdown_connections 2024-09-11T00:07:14.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.601+0000 7f166fe00700 1 -- 172.21.15.111:0/4165410055 wait complete. 2024-09-11T00:07:14.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.603+0000 7f166fe00700 1 Processor -- start 2024-09-11T00:07:14.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.603+0000 7f166fe00700 1 -- start start 2024-09-11T00:07:14.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.604+0000 7f166fe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f16700fffc0 0x7f16701935c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.604+0000 7f166fe00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16701011c0 0x7f1670193b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.604+0000 7f166fe00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1670194090 con 0x7f16700fffc0 2024-09-11T00:07:14.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.604+0000 7f166fe00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16701941d0 con 0x7f16701011c0 2024-09-11T00:07:14.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.605+0000 7f166ea00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f16700fffc0 0x7f16701935c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.605+0000 7f166ea00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f16700fffc0 0x7f16701935c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:33370/0 (socket says 172.21.15.111:33370) 2024-09-11T00:07:14.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.605+0000 7f166ea00700 1 -- 172.21.15.111:0/893117222 learned_addr learned my addr 172.21.15.111:0/893117222 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:07:14.608 INFO:tasks.workunit.client.1.smithi203.stdout:8/400: write d1/f5b [966346,57505] 0 2024-09-11T00:07:14.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.605+0000 7f166e000700 1 --2- 172.21.15.111:0/893117222 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16701011c0 0x7f1670193b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.606+0000 7f166ea00700 1 -- 172.21.15.111:0/893117222 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16701011c0 msgr2=0x7f1670193b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:14.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.606+0000 7f166ea00700 1 --2- 172.21.15.111:0/893117222 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16701011c0 0x7f1670193b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:14.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.606+0000 7f166ea00700 1 -- 172.21.15.111:0/893117222 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165c0095f0 con 0x7f16700fffc0 2024-09-11T00:07:14.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.607+0000 7f166ea00700 1 --2- 172.21.15.111:0/893117222 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f16700fffc0 0x7f16701935c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f166000c910 tx=0x7f166000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:14.609 INFO:tasks.workunit.client.0.smithi111.stdout:4/360: dwrite f7 [4194304,4194304] 0 2024-09-11T00:07:14.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.608+0000 7f1667400700 1 -- 172.21.15.111:0/893117222 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16600041f0 con 0x7f16700fffc0 2024-09-11T00:07:14.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.608+0000 7f1667400700 1 -- 172.21.15.111:0/893117222 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f166000ce60 con 0x7f16700fffc0 2024-09-11T00:07:14.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.608+0000 7f1667400700 1 -- 172.21.15.111:0/893117222 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1660003d20 con 0x7f16700fffc0 2024-09-11T00:07:14.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.608+0000 7f166fe00700 1 -- 172.21.15.111:0/893117222 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1670198c90 con 0x7f16700fffc0 2024-09-11T00:07:14.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.608+0000 7f166fe00700 1 -- 172.21.15.111:0/893117222 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16701991b0 con 0x7f16700fffc0 2024-09-11T00:07:14.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.610+0000 7f166fe00700 1 -- 172.21.15.111:0/893117222 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16701052a0 con 0x7f16700fffc0 2024-09-11T00:07:14.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.610+0000 7f1667400700 1 -- 172.21.15.111:0/893117222 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 24) v1 ==== 51505+0+0 (secure 0 0 0) 0x7f1660007900 con 0x7f16700fffc0 2024-09-11T00:07:14.613 INFO:tasks.workunit.client.1.smithi203.stdout:7/387: rename dd/d1c/d7c/f88 to dd/d4d/d7f/f92 0 2024-09-11T00:07:14.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.611+0000 7f1667400700 1 --2- 172.21.15.111:0/893117222 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f165403f5e0 0x7f1654041a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:14.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.611+0000 7f1667400700 1 -- 172.21.15.111:0/893117222 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f16600549a0 con 0x7f16700fffc0 2024-09-11T00:07:14.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.612+0000 7f166e000700 1 --2- 172.21.15.111:0/893117222 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f165403f5e0 0x7f1654041a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:14.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.613+0000 7f166e000700 1 --2- 172.21.15.111:0/893117222 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f165403f5e0 0x7f1654041a90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f165c00b5c0 tx=0x7f165c005fb0 comp rx=0 tx=0).ready entity=mgr.24469 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:14.615 INFO:tasks.workunit.client.0.smithi111.stdout:8/439: write d11/f20 [4791187,84190] 0 2024-09-11T00:07:14.617 INFO:tasks.workunit.client.1.smithi203.stdout:3/498: dwrite d8/da/d11/f89 [0,4194304] 0 2024-09-11T00:07:14.618 INFO:tasks.workunit.client.0.smithi111.stdout:9/423: symlink d6/db/d1b/d41/l8d 0 2024-09-11T00:07:14.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:14.621+0000 7f1667400700 1 -- 172.21.15.111:0/893117222 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f1660004350 con 0x7f16700fffc0 2024-09-11T00:07:14.623 INFO:tasks.workunit.client.0.smithi111.stdout:6/323: unlink d7/d22/l25 0 2024-09-11T00:07:14.625 INFO:tasks.workunit.client.1.smithi203.stdout:2/341: getdents d13/d47 0 2024-09-11T00:07:14.629 INFO:tasks.workunit.client.1.smithi203.stdout:6/361: dread d0/d32/f34 [0,4194304] 0 2024-09-11T00:07:14.630 INFO:tasks.workunit.client.1.smithi203.stdout:2/342: chown d13/d22/f3f 12670 1 2024-09-11T00:07:14.631 INFO:tasks.workunit.client.1.smithi203.stdout:0/414: rename d0/d2/d3d/d5a/f6b to d0/d2/d37/d7f/f85 0 2024-09-11T00:07:14.634 INFO:tasks.workunit.client.0.smithi111.stdout:7/390: read dd/f35 [3219146,75253] 0 2024-09-11T00:07:14.635 INFO:tasks.workunit.client.0.smithi111.stdout:1/355: dwrite d2/f9 [0,4194304] 0 2024-09-11T00:07:14.637 INFO:tasks.workunit.client.1.smithi203.stdout:1/464: creat d8/d19/d31/f9d x:0 0 0 2024-09-11T00:07:14.638 INFO:tasks.workunit.client.0.smithi111.stdout:8/440: dwrite d11/d21/f22 [0,4194304] 0 2024-09-11T00:07:14.638 INFO:tasks.workunit.client.0.smithi111.stdout:0/413: symlink d3/d26/d77/l8e 0 2024-09-11T00:07:14.640 INFO:tasks.workunit.client.1.smithi203.stdout:5/467: dwrite dc/d65/f4a [0,4194304] 0 2024-09-11T00:07:14.642 INFO:tasks.workunit.client.1.smithi203.stdout:4/386: dwrite db/dd/d26/f2f [0,4194304] 0 2024-09-11T00:07:14.645 INFO:tasks.workunit.client.1.smithi203.stdout:1/465: write d8/d19/d31/f88 [559477,47665] 0 2024-09-11T00:07:14.645 INFO:tasks.workunit.client.0.smithi111.stdout:2/380: rename d0/d3/d12/d38/l6e to d0/d3/de/d68/l8a 0 2024-09-11T00:07:14.647 INFO:tasks.workunit.client.1.smithi203.stdout:5/468: dread - dc/d65/f97 zero size 2024-09-11T00:07:14.649 INFO:tasks.workunit.client.0.smithi111.stdout:5/399: link d10/d1e/d23/d26/f4c d10/d1e/d23/d26/d3a/f87 0 2024-09-11T00:07:14.650 INFO:tasks.workunit.client.1.smithi203.stdout:0/415: read d0/d2/f41 [161206,89752] 0 2024-09-11T00:07:14.651 INFO:tasks.workunit.client.0.smithi111.stdout:2/381: chown d0/d3/d2e 14060 1 2024-09-11T00:07:14.651 INFO:tasks.workunit.client.0.smithi111.stdout:4/361: creat d18/d20/d3c/f74 x:0 0 0 2024-09-11T00:07:14.656 INFO:tasks.workunit.client.0.smithi111.stdout:5/400: fsync d10/d1e/d23/d30/d59/d7b/f73 0 2024-09-11T00:07:14.657 INFO:tasks.workunit.client.0.smithi111.stdout:6/324: dwrite d7/f52 [0,4194304] 0 2024-09-11T00:07:14.660 INFO:tasks.workunit.client.0.smithi111.stdout:6/325: chown d7/d22/d1d/d69 32095 1 2024-09-11T00:07:14.660 INFO:tasks.workunit.client.0.smithi111.stdout:5/401: dread - d10/d1e/d25/d6e/f80 zero size 2024-09-11T00:07:14.660 INFO:tasks.workunit.client.1.smithi203.stdout:8/401: dread d1/d13/d3a/d75/f82 [0,4194304] 0 2024-09-11T00:07:14.662 INFO:tasks.workunit.client.1.smithi203.stdout:2/343: symlink d13/d15/d19/l6b 0 2024-09-11T00:07:14.667 INFO:tasks.workunit.client.1.smithi203.stdout:6/362: chown d0/d27/d35/d38/c42 173 1 2024-09-11T00:07:14.668 INFO:tasks.workunit.client.1.smithi203.stdout:6/363: readlink d0/d5b/l6d 0 2024-09-11T00:07:14.671 INFO:tasks.workunit.client.0.smithi111.stdout:2/382: read d0/d3/de/d50/f59 [1121535,20277] 0 2024-09-11T00:07:14.672 INFO:tasks.workunit.client.1.smithi203.stdout:6/364: dread d0/f21 [0,4194304] 0 2024-09-11T00:07:14.674 INFO:tasks.workunit.client.0.smithi111.stdout:2/383: chown d0/d3/de/c48 643806 1 2024-09-11T00:07:14.678 INFO:tasks.workunit.client.0.smithi111.stdout:7/391: symlink dd/d1d/d2d/d2e/d4e/l7c 0 2024-09-11T00:07:14.678 INFO:tasks.workunit.client.0.smithi111.stdout:0/414: creat d3/d13/d1e/d29/d49/d51/d61/f8f x:0 0 0 2024-09-11T00:07:14.679 INFO:tasks.workunit.client.1.smithi203.stdout:6/365: write d0/d27/f66 [347493,109137] 0 2024-09-11T00:07:14.680 INFO:tasks.workunit.client.0.smithi111.stdout:8/441: mknod d11/d21/d38/d54/c8a 0 2024-09-11T00:07:14.682 INFO:tasks.workunit.client.1.smithi203.stdout:5/469: creat dc/dd/d15/d3b/d7a/f9a x:0 0 0 2024-09-11T00:07:14.686 INFO:tasks.workunit.client.0.smithi111.stdout:9/424: mkdir d6/d52/d8a/d8e 0 2024-09-11T00:07:14.686 INFO:tasks.workunit.client.0.smithi111.stdout:4/362: mkdir d18/d20/d3c/d5e/d75 0 2024-09-11T00:07:14.688 INFO:tasks.workunit.client.1.smithi203.stdout:2/344: rename d13/d15/d19/d1c/f27 to d13/d15/d19/f6c 0 2024-09-11T00:07:14.688 INFO:tasks.workunit.client.0.smithi111.stdout:6/326: dread d7/f52 [0,4194304] 0 2024-09-11T00:07:14.689 INFO:tasks.workunit.client.0.smithi111.stdout:5/402: truncate d10/f1c 820713 0 2024-09-11T00:07:14.691 INFO:tasks.workunit.client.1.smithi203.stdout:3/499: getdents d8/da/db3 0 2024-09-11T00:07:14.691 INFO:tasks.workunit.client.1.smithi203.stdout:6/366: fsync d0/f2d 0 2024-09-11T00:07:14.691 INFO:tasks.workunit.client.1.smithi203.stdout:7/388: dwrite dd/d1c/d52/d8f/d31/f62 [0,4194304] 0 2024-09-11T00:07:14.692 INFO:tasks.workunit.client.0.smithi111.stdout:6/327: read - d7/d2b/d35/d41/f66 zero size 2024-09-11T00:07:14.695 INFO:tasks.workunit.client.1.smithi203.stdout:2/345: fsync d13/d15/d19/d1c/f2a 0 2024-09-11T00:07:14.695 INFO:tasks.workunit.client.1.smithi203.stdout:7/389: readlink dd/d1c/l34 0 2024-09-11T00:07:14.698 INFO:tasks.workunit.client.0.smithi111.stdout:2/384: creat d0/d3/d12/d52/d65/f8b x:0 0 0 2024-09-11T00:07:14.698 INFO:tasks.workunit.client.1.smithi203.stdout:5/470: fdatasync dc/dd/d1e/f27 0 2024-09-11T00:07:14.699 INFO:tasks.workunit.client.1.smithi203.stdout:4/387: creat db/d12/f7d x:0 0 0 2024-09-11T00:07:14.700 INFO:tasks.workunit.client.0.smithi111.stdout:0/415: mknod d3/d13/d1e/d29/d49/d51/c90 0 2024-09-11T00:07:14.701 INFO:tasks.workunit.client.0.smithi111.stdout:2/385: dread - d0/d3/d12/d52/d65/f8b zero size 2024-09-11T00:07:14.701 INFO:tasks.workunit.client.1.smithi203.stdout:4/388: chown db 4037286 1 2024-09-11T00:07:14.702 INFO:tasks.workunit.client.0.smithi111.stdout:7/392: mknod dd/d1d/d2d/d68/d79/c7d 0 2024-09-11T00:07:14.702 INFO:tasks.workunit.client.0.smithi111.stdout:0/416: chown f1 1147009 1 2024-09-11T00:07:14.703 INFO:tasks.workunit.client.1.smithi203.stdout:3/500: rmdir d8/da/d37/d83/d6a 39 2024-09-11T00:07:14.703 INFO:tasks.workunit.client.1.smithi203.stdout:4/389: chown db/dd/d16/d38/d3c/d41/c6a 23 1 2024-09-11T00:07:14.704 INFO:tasks.workunit.client.1.smithi203.stdout:6/367: mkdir d0/d5b/d5c/d6f 0 2024-09-11T00:07:14.705 INFO:tasks.workunit.client.0.smithi111.stdout:7/393: chown dd/d48 3714 1 2024-09-11T00:07:14.705 INFO:tasks.workunit.client.0.smithi111.stdout:4/363: read d18/f32 [3253600,36902] 0 2024-09-11T00:07:14.705 INFO:tasks.workunit.client.0.smithi111.stdout:9/425: mkdir d6/db/d8f 0 2024-09-11T00:07:14.706 INFO:tasks.workunit.client.1.smithi203.stdout:7/390: mkdir dd/d1c/d52/d8f/d31/d58/d93 0 2024-09-11T00:07:14.706 INFO:tasks.workunit.client.0.smithi111.stdout:1/356: creat d2/f79 x:0 0 0 2024-09-11T00:07:14.707 INFO:tasks.workunit.client.0.smithi111.stdout:6/328: mkdir d7/d4d/d61/d6a 0 2024-09-11T00:07:14.709 INFO:tasks.workunit.client.0.smithi111.stdout:0/417: truncate d3/f80 901404 0 2024-09-11T00:07:14.711 INFO:tasks.workunit.client.0.smithi111.stdout:0/418: readlink d3/d13/d1e/l58 0 2024-09-11T00:07:14.713 INFO:tasks.workunit.client.0.smithi111.stdout:0/419: readlink d3/d26/d77/l60 0 2024-09-11T00:07:14.716 INFO:tasks.workunit.client.1.smithi203.stdout:2/346: creat d13/d56/d69/f6d x:0 0 0 2024-09-11T00:07:14.719 INFO:tasks.workunit.client.0.smithi111.stdout:9/426: rename d6/d52/f64 to d6/d52/f90 0 2024-09-11T00:07:14.722 INFO:tasks.workunit.client.0.smithi111.stdout:9/427: write d6/db/f5b [864565,97728] 0 2024-09-11T00:07:14.724 INFO:tasks.workunit.client.1.smithi203.stdout:5/471: mkdir dc/dd/d9b 0 2024-09-11T00:07:14.725 INFO:tasks.workunit.client.1.smithi203.stdout:5/472: chown dc/d4f/d5c/d76 155864 1 2024-09-11T00:07:14.725 INFO:tasks.workunit.client.1.smithi203.stdout:7/391: dwrite dd/d3b/f72 [0,4194304] 0 2024-09-11T00:07:14.725 INFO:tasks.workunit.client.0.smithi111.stdout:3/424: truncate d1c/d1d/d22/f60 3983770 0 2024-09-11T00:07:14.729 INFO:tasks.workunit.client.1.smithi203.stdout:7/392: write dd/d3b/f72 [1370272,38846] 0 2024-09-11T00:07:14.733 INFO:tasks.workunit.client.0.smithi111.stdout:7/394: mkdir dd/d1d/d7e 0 2024-09-11T00:07:14.737 INFO:tasks.workunit.client.1.smithi203.stdout:2/347: rename d13/d15/d19/d1c/f44 to d13/d22/f6e 0 2024-09-11T00:07:14.738 INFO:tasks.workunit.client.0.smithi111.stdout:0/420: creat d3/d1c/f91 x:0 0 0 2024-09-11T00:07:14.741 INFO:tasks.workunit.client.1.smithi203.stdout:5/473: creat dc/dd/d56/f9c x:0 0 0 2024-09-11T00:07:14.743 INFO:tasks.workunit.client.1.smithi203.stdout:4/390: creat db/f7e x:0 0 0 2024-09-11T00:07:14.746 INFO:tasks.workunit.client.1.smithi203.stdout:6/368: creat d0/d27/d35/f70 x:0 0 0 2024-09-11T00:07:14.748 INFO:tasks.workunit.client.1.smithi203.stdout:1/466: dread d8/d19/d31/f59 [0,4194304] 0 2024-09-11T00:07:14.749 INFO:tasks.workunit.client.0.smithi111.stdout:8/442: link d11/d21/d38/d54/l7a d11/l8b 0 2024-09-11T00:07:14.753 INFO:tasks.workunit.client.0.smithi111.stdout:9/428: dwrite d6/db/f18 [0,4194304] 0 2024-09-11T00:07:14.756 INFO:tasks.workunit.client.0.smithi111.stdout:4/364: creat d18/d20/d3c/d5e/d75/f76 x:0 0 0 2024-09-11T00:07:14.756 INFO:tasks.workunit.client.1.smithi203.stdout:4/391: mknod db/dd/d16/d38/c7f 0 2024-09-11T00:07:14.769 INFO:tasks.workunit.client.0.smithi111.stdout:6/329: dread - d7/d22/d1d/f5f zero size 2024-09-11T00:07:14.772 INFO:tasks.workunit.client.0.smithi111.stdout:0/421: dwrite d3/d1c/f4f [0,4194304] 0 2024-09-11T00:07:14.772 INFO:tasks.workunit.client.1.smithi203.stdout:4/392: unlink db/dd/d16/d38/d3c/d41/l59 0 2024-09-11T00:07:14.773 INFO:tasks.workunit.client.0.smithi111.stdout:1/357: write d2/de/f43 [829183,108012] 0 2024-09-11T00:07:14.774 INFO:tasks.workunit.client.1.smithi203.stdout:5/474: dread dc/dd/f3d [0,4194304] 0 2024-09-11T00:07:14.774 INFO:tasks.workunit.client.1.smithi203.stdout:6/369: mkdir d0/d71 0 2024-09-11T00:07:14.775 INFO:tasks.workunit.client.0.smithi111.stdout:2/386: getdents d0/d3/de/d3b 0 2024-09-11T00:07:14.778 INFO:tasks.workunit.client.1.smithi203.stdout:1/467: creat d8/d9/d15/d35/d81/f9e x:0 0 0 2024-09-11T00:07:14.785 INFO:tasks.workunit.client.0.smithi111.stdout:4/365: mknod d18/d1f/d33/c77 0 2024-09-11T00:07:14.790 INFO:tasks.workunit.client.1.smithi203.stdout:1/468: creat d8/d19/d60/d90/d3e/d4b/d3a/f9f x:0 0 0 2024-09-11T00:07:14.791 INFO:tasks.workunit.client.0.smithi111.stdout:6/330: creat d7/f6b x:0 0 0 2024-09-11T00:07:14.793 INFO:tasks.workunit.client.1.smithi203.stdout:6/370: rename d0/f14 to d0/d27/f72 0 2024-09-11T00:07:14.794 INFO:tasks.workunit.client.1.smithi203.stdout:7/393: write dd/d1c/d52/d8f/d31/d67/f79 [126263,2421] 0 2024-09-11T00:07:14.798 INFO:tasks.workunit.client.1.smithi203.stdout:1/469: write d8/d19/d60/d90/d3e/d66/f6e [1939011,120889] 0 2024-09-11T00:07:14.798 INFO:tasks.workunit.client.0.smithi111.stdout:3/425: write d1c/d1d/d22/d23/f28 [537854,56198] 0 2024-09-11T00:07:14.800 INFO:tasks.workunit.client.1.smithi203.stdout:7/394: readlink dd/l15 0 2024-09-11T00:07:14.801 INFO:tasks.workunit.client.0.smithi111.stdout:7/395: write dd/f18 [2635083,32006] 0 2024-09-11T00:07:14.801 INFO:tasks.workunit.client.1.smithi203.stdout:7/395: fsync dd/f14 0 2024-09-11T00:07:14.802 INFO:tasks.workunit.client.0.smithi111.stdout:5/403: sync 2024-09-11T00:07:14.803 INFO:tasks.workunit.client.0.smithi111.stdout:8/443: link d11/d23/d3d/f44 d11/d23/d2c/d46/f8c 0 2024-09-11T00:07:14.803 INFO:tasks.workunit.client.1.smithi203.stdout:2/348: truncate d13/d15/f1a 3940482 0 2024-09-11T00:07:14.805 INFO:tasks.workunit.client.1.smithi203.stdout:6/371: mkdir d0/d27/d35/d38/d73 0 2024-09-11T00:07:14.807 INFO:tasks.workunit.client.0.smithi111.stdout:4/366: unlink d18/d1f/f26 0 2024-09-11T00:07:14.809 INFO:tasks.workunit.client.0.smithi111.stdout:4/367: chown d18/d20/d4a/f62 5043 1 2024-09-11T00:07:14.811 INFO:tasks.workunit.client.0.smithi111.stdout:4/368: chown d18/d20/d40/l4f 442952 1 2024-09-11T00:07:14.811 INFO:tasks.workunit.client.0.smithi111.stdout:5/404: dread d10/d1e/d23/d30/d3c/d60/d63/f6f [0,4194304] 0 2024-09-11T00:07:14.811 INFO:tasks.workunit.client.0.smithi111.stdout:9/429: creat d6/f91 x:0 0 0 2024-09-11T00:07:14.813 INFO:tasks.workunit.client.1.smithi203.stdout:1/470: mkdir d8/d28/d64/da0 0 2024-09-11T00:07:14.813 INFO:tasks.workunit.client.0.smithi111.stdout:9/430: chown d6/db/d1b/d74 242096 1 2024-09-11T00:07:14.817 INFO:tasks.workunit.client.1.smithi203.stdout:4/393: truncate db/d12/f37 1467310 0 2024-09-11T00:07:14.819 INFO:tasks.workunit.client.0.smithi111.stdout:2/387: unlink d0/c18 0 2024-09-11T00:07:14.819 INFO:tasks.workunit.client.1.smithi203.stdout:2/349: fsync d13/d15/f29 0 2024-09-11T00:07:14.820 INFO:tasks.workunit.client.1.smithi203.stdout:9/391: sync 2024-09-11T00:07:14.823 INFO:tasks.workunit.client.1.smithi203.stdout:5/475: rename dc/dd/d4d/f57 to dc/dd/f9d 0 2024-09-11T00:07:14.828 INFO:tasks.workunit.client.0.smithi111.stdout:6/331: dwrite d7/d22/d2c/d38/f4c [0,4194304] 0 2024-09-11T00:07:14.828 INFO:tasks.workunit.client.0.smithi111.stdout:3/426: symlink d1c/d1d/d22/d23/d2f/d63/l8f 0 2024-09-11T00:07:14.837 INFO:tasks.workunit.client.0.smithi111.stdout:4/369: mkdir d18/d20/d40/d78 0 2024-09-11T00:07:14.838 INFO:tasks.workunit.client.0.smithi111.stdout:9/431: dwrite d6/db/d34/d37/d4c/f8c [0,4194304] 0 2024-09-11T00:07:14.838 INFO:tasks.workunit.client.1.smithi203.stdout:6/372: mkdir d0/d27/d35/d38/d73/d74 0 2024-09-11T00:07:14.839 INFO:tasks.workunit.client.1.smithi203.stdout:2/350: dwrite d13/d15/d30/d59/f6a [0,4194304] 0 2024-09-11T00:07:14.841 INFO:tasks.workunit.client.0.smithi111.stdout:4/370: chown d18/d20/d40/l55 929152 1 2024-09-11T00:07:14.844 INFO:tasks.workunit.client.1.smithi203.stdout:2/351: fsync d13/d15/f25 0 2024-09-11T00:07:14.845 INFO:tasks.workunit.client.1.smithi203.stdout:7/396: write dd/d1c/d52/d8f/d31/d58/f5e [147759,83166] 0 2024-09-11T00:07:14.846 INFO:tasks.workunit.client.0.smithi111.stdout:2/388: dwrite d0/f7b [0,4194304] 0 2024-09-11T00:07:14.850 INFO:tasks.workunit.client.0.smithi111.stdout:0/422: rename d3/d1c/f91 to d3/d13/d1e/d29/d49/f92 0 2024-09-11T00:07:14.850 INFO:tasks.workunit.client.1.smithi203.stdout:1/471: dwrite d8/d11/f51 [4194304,4194304] 0 2024-09-11T00:07:14.860 INFO:tasks.workunit.client.1.smithi203.stdout:9/392: rmdir d6/de/d32/d52/d44 39 2024-09-11T00:07:14.861 INFO:tasks.workunit.client.0.smithi111.stdout:1/358: link d2/de/f29 d2/de/d12/d3c/d4b/d6a/f7a 0 2024-09-11T00:07:14.865 INFO:tasks.workunit.client.0.smithi111.stdout:8/444: write d11/d21/d6f/f87 [1365935,64802] 0 2024-09-11T00:07:14.867 INFO:tasks.workunit.client.1.smithi203.stdout:5/476: write dc/dd/f9d [3337979,18505] 0 2024-09-11T00:07:14.873 INFO:tasks.workunit.client.0.smithi111.stdout:4/371: dwrite d18/d20/f30 [0,4194304] 0 2024-09-11T00:07:14.877 INFO:tasks.workunit.client.1.smithi203.stdout:7/397: creat dd/d1c/d52/f94 x:0 0 0 2024-09-11T00:07:14.879 INFO:tasks.workunit.client.1.smithi203.stdout:4/394: dwrite db/f3d [0,4194304] 0 2024-09-11T00:07:14.882 INFO:tasks.workunit.client.1.smithi203.stdout:2/352: rename d13/d47/f5d to d13/d22/f6f 0 2024-09-11T00:07:14.885 INFO:tasks.workunit.client.1.smithi203.stdout:1/472: mkdir d8/d9/d15/d35/d81/da1 0 2024-09-11T00:07:14.886 INFO:tasks.workunit.client.1.smithi203.stdout:2/353: dread - d13/d15/f55 zero size 2024-09-11T00:07:14.887 INFO:tasks.workunit.client.0.smithi111.stdout:0/423: mkdir d3/d13/d1e/d29/d49/d51/d61/d93 0 2024-09-11T00:07:14.887 INFO:tasks.workunit.client.0.smithi111.stdout:7/396: dread f8 [0,4194304] 0 2024-09-11T00:07:14.888 INFO:tasks.workunit.client.1.smithi203.stdout:9/393: mknod d6/de/d19/d30/c7f 0 2024-09-11T00:07:14.890 INFO:tasks.workunit.client.1.smithi203.stdout:5/477: chown dc/dd/d15/l16 302471513 1 2024-09-11T00:07:14.893 INFO:tasks.workunit.client.0.smithi111.stdout:8/445: rename d11/d21/d38/d54/d5b to d11/d23/d3d/d8d 0 2024-09-11T00:07:14.896 INFO:tasks.workunit.client.1.smithi203.stdout:6/373: mknod d0/c75 0 2024-09-11T00:07:14.897 INFO:tasks.workunit.client.0.smithi111.stdout:3/427: creat d1c/d1d/d22/d44/d5a/d74/f90 x:0 0 0 2024-09-11T00:07:14.898 INFO:tasks.workunit.client.0.smithi111.stdout:1/359: dwrite d2/de/d12/d3c/d4b/d6a/f46 [0,4194304] 0 2024-09-11T00:07:14.899 INFO:tasks.workunit.client.0.smithi111.stdout:3/428: stat d1c/d21/f3a 0 2024-09-11T00:07:14.900 INFO:tasks.workunit.client.1.smithi203.stdout:2/354: mknod d13/c70 0 2024-09-11T00:07:14.902 INFO:tasks.workunit.client.0.smithi111.stdout:6/332: mknod d7/d22/d2c/d38/d56/c6c 0 2024-09-11T00:07:14.902 INFO:tasks.workunit.client.1.smithi203.stdout:4/395: dwrite db/dd/f79 [0,4194304] 0 2024-09-11T00:07:14.904 INFO:tasks.workunit.client.0.smithi111.stdout:7/397: unlink dd/d1d/d1f/f3f 0 2024-09-11T00:07:14.906 INFO:tasks.workunit.client.0.smithi111.stdout:1/360: chown d2/de/d12/d3c/d4b/d6a 16432 1 2024-09-11T00:07:14.908 INFO:tasks.workunit.client.0.smithi111.stdout:8/446: truncate d11/d21/d38/f47 26576 0 2024-09-11T00:07:14.908 INFO:tasks.workunit.client.0.smithi111.stdout:4/372: mkdir d18/d20/d40/d78/d79 0 2024-09-11T00:07:14.909 INFO:tasks.workunit.client.1.smithi203.stdout:7/398: creat dd/d1c/d7c/d8c/f95 x:0 0 0 2024-09-11T00:07:14.913 INFO:tasks.workunit.client.0.smithi111.stdout:1/361: mkdir d2/d2b/d2c/d56/d7b 0 2024-09-11T00:07:14.914 INFO:tasks.workunit.client.1.smithi203.stdout:1/473: mkdir d8/d19/d60/d90/d3e/d4b/d80/da2 0 2024-09-11T00:07:14.917 INFO:tasks.workunit.client.0.smithi111.stdout:6/333: creat d7/d22/d1d/d69/f6d x:0 0 0 2024-09-11T00:07:14.918 INFO:tasks.workunit.client.1.smithi203.stdout:7/399: creat dd/d4d/d7f/f96 x:0 0 0 2024-09-11T00:07:14.919 INFO:tasks.workunit.client.0.smithi111.stdout:1/362: readlink d2/de/d12/d3c/l48 0 2024-09-11T00:07:14.920 INFO:tasks.workunit.client.1.smithi203.stdout:6/374: symlink d0/d27/d35/d38/d73/d74/l76 0 2024-09-11T00:07:14.920 INFO:tasks.workunit.client.0.smithi111.stdout:4/373: unlink d18/d20/d4a/f62 0 2024-09-11T00:07:14.925 INFO:tasks.workunit.client.1.smithi203.stdout:2/355: truncate f11 1385643 0 2024-09-11T00:07:14.925 INFO:tasks.workunit.client.1.smithi203.stdout:0/416: sync 2024-09-11T00:07:14.925 INFO:tasks.workunit.client.1.smithi203.stdout:6/375: stat d0/d27/d35/l53 0 2024-09-11T00:07:14.930 INFO:tasks.workunit.client.1.smithi203.stdout:5/478: dwrite dc/dd/f89 [0,4194304] 0 2024-09-11T00:07:14.930 INFO:tasks.workunit.client.1.smithi203.stdout:9/394: dwrite d6/de/d32/f59 [0,4194304] 0 2024-09-11T00:07:14.931 INFO:tasks.workunit.client.0.smithi111.stdout:1/363: rename d2/de/d12/d34 to d2/d7c 0 2024-09-11T00:07:14.932 INFO:tasks.workunit.client.1.smithi203.stdout:6/376: stat d0/d27/d35/d39/f56 0 2024-09-11T00:07:14.934 INFO:tasks.workunit.client.1.smithi203.stdout:6/377: chown d0/d27/c60 19903465 1 2024-09-11T00:07:14.936 INFO:tasks.workunit.client.1.smithi203.stdout:4/396: getdents db/d12/d15/d2a 0 2024-09-11T00:07:14.938 INFO:tasks.workunit.client.1.smithi203.stdout:4/397: fdatasync db/dd/d16/f4f 0 2024-09-11T00:07:14.938 INFO:tasks.workunit.client.0.smithi111.stdout:1/364: rmdir d2/de/d12 39 2024-09-11T00:07:14.939 INFO:tasks.workunit.client.1.smithi203.stdout:2/356: rename d13/c4b to d13/c71 0 2024-09-11T00:07:14.941 INFO:tasks.workunit.client.1.smithi203.stdout:5/479: creat dc/dd/d15/d3b/d7a/f9e x:0 0 0 2024-09-11T00:07:14.945 INFO:tasks.workunit.client.1.smithi203.stdout:4/398: truncate db/dd/d16/d38/d3c/d41/f6d 332914 0 2024-09-11T00:07:14.948 INFO:tasks.workunit.client.1.smithi203.stdout:1/474: getdents d8/d19/d60/d90/d3e/d66 0 2024-09-11T00:07:14.953 INFO:tasks.workunit.client.0.smithi111.stdout:4/374: dwrite f15 [0,4194304] 0 2024-09-11T00:07:14.958 INFO:tasks.workunit.client.0.smithi111.stdout:6/334: dwrite d7/d2b/d35/f57 [0,4194304] 0 2024-09-11T00:07:14.958 INFO:tasks.workunit.client.1.smithi203.stdout:5/480: mkdir dc/d9f 0 2024-09-11T00:07:14.963 INFO:tasks.workunit.client.0.smithi111.stdout:5/405: dwrite d10/d1e/d23/d26/f4c [0,4194304] 0 2024-09-11T00:07:14.963 INFO:tasks.workunit.client.1.smithi203.stdout:0/417: dwrite d0/f5c [0,4194304] 0 2024-09-11T00:07:14.965 INFO:tasks.workunit.client.1.smithi203.stdout:2/357: getdents d13/d15/d30/d5a 0 2024-09-11T00:07:14.975 INFO:tasks.workunit.client.0.smithi111.stdout:6/335: write d7/d2b/d35/d41/f66 [751470,59990] 0 2024-09-11T00:07:14.975 INFO:tasks.workunit.client.1.smithi203.stdout:6/378: dwrite d0/d27/d35/f65 [0,4194304] 0 2024-09-11T00:07:14.975 INFO:tasks.workunit.client.1.smithi203.stdout:2/358: chown d13/d15/d19/l6b 6384235 1 2024-09-11T00:07:14.976 INFO:tasks.workunit.client.0.smithi111.stdout:5/406: stat d10/d1e/d25/d6e 0 2024-09-11T00:07:14.976 INFO:tasks.workunit.client.1.smithi203.stdout:3/501: sync 2024-09-11T00:07:14.976 INFO:tasks.workunit.client.1.smithi203.stdout:8/402: sync 2024-09-11T00:07:14.976 INFO:tasks.workunit.client.1.smithi203.stdout:7/400: dread dd/d4d/f73 [0,4194304] 0 2024-09-11T00:07:14.980 INFO:tasks.workunit.client.0.smithi111.stdout:5/407: chown d10/d1e/d23/d30/d59/c68 412604562 1 2024-09-11T00:07:14.983 INFO:tasks.workunit.client.1.smithi203.stdout:8/403: chown d1/d13/d17/d2f/f32 111895 1 2024-09-11T00:07:14.984 INFO:tasks.workunit.client.1.smithi203.stdout:3/502: fsync d8/da/d37/d53/f9b 0 2024-09-11T00:07:14.989 INFO:tasks.workunit.client.0.smithi111.stdout:1/365: dwrite d2/fd [0,4194304] 0 2024-09-11T00:07:14.990 INFO:tasks.workunit.client.1.smithi203.stdout:4/399: dwrite db/dd/d16/d38/d3c/f68 [0,4194304] 0 2024-09-11T00:07:14.993 INFO:tasks.workunit.client.0.smithi111.stdout:9/432: truncate d6/db/d1b/d56/f6b 35663 0 2024-09-11T00:07:14.993 INFO:tasks.workunit.client.0.smithi111.stdout:2/389: truncate d0/d3/de/f21 2510191 0 2024-09-11T00:07:15.000 INFO:tasks.workunit.client.1.smithi203.stdout:6/379: creat d0/d27/d35/d39/d3c/f77 x:0 0 0 2024-09-11T00:07:15.003 INFO:tasks.workunit.client.0.smithi111.stdout:2/390: chown d0/d3/d12/d52/l45 1 1 2024-09-11T00:07:15.004 INFO:tasks.workunit.client.1.smithi203.stdout:2/359: write d13/d15/d19/f28 [7618661,16949] 0 2024-09-11T00:07:15.004 INFO:tasks.workunit.client.1.smithi203.stdout:3/503: chown d8/da/d37/d53/f62 0 1 2024-09-11T00:07:15.005 INFO:tasks.workunit.client.0.smithi111.stdout:5/408: chown d10/c4d 1552315 1 2024-09-11T00:07:15.009 INFO:tasks.workunit.client.0.smithi111.stdout:2/391: chown d0/d3/f37 874608874 1 2024-09-11T00:07:15.011 INFO:tasks.workunit.client.1.smithi203.stdout:0/418: dwrite d0/d2/f32 [0,4194304] 0 2024-09-11T00:07:15.014 INFO:tasks.workunit.client.1.smithi203.stdout:0/419: readlink d0/d1d/l5f 0 2024-09-11T00:07:15.026 INFO:tasks.workunit.client.0.smithi111.stdout:1/366: dwrite d2/d2b/d2c/d56/f5b [0,4194304] 0 2024-09-11T00:07:15.027 INFO:tasks.workunit.client.0.smithi111.stdout:0/424: truncate d3/d13/d1e/d29/f2a 3342409 0 2024-09-11T00:07:15.027 INFO:tasks.workunit.client.1.smithi203.stdout:4/400: read db/dd/f13 [763248,67650] 0 2024-09-11T00:07:15.031 INFO:tasks.workunit.client.0.smithi111.stdout:0/425: fsync d3/d74/f7d 0 2024-09-11T00:07:15.032 INFO:tasks.workunit.client.1.smithi203.stdout:4/401: write db/d12/d15/d2a/f1b [3817793,71696] 0 2024-09-11T00:07:15.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.032+0000 7f166fe00700 1 -- 172.21.15.111:0/893117222 --> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f167019a750 con 0x7f165403f5e0 2024-09-11T00:07:15.039 INFO:tasks.workunit.client.0.smithi111.stdout:4/375: dread d18/f1b [0,4194304] 0 2024-09-11T00:07:15.039 INFO:tasks.workunit.client.1.smithi203.stdout:2/360: unlink d13/d15/c35 0 2024-09-11T00:07:15.043 INFO:tasks.workunit.client.1.smithi203.stdout:9/395: write d6/de/d19/f31 [935270,108390] 0 2024-09-11T00:07:15.043 INFO:tasks.workunit.client.0.smithi111.stdout:3/429: write d1c/d1d/f1f [722978,10247] 0 2024-09-11T00:07:15.045 INFO:tasks.workunit.client.1.smithi203.stdout:1/475: write d8/d19/f26 [672309,85758] 0 2024-09-11T00:07:15.046 INFO:tasks.workunit.client.0.smithi111.stdout:5/409: dwrite d10/d1e/d23/d30/d3c/d60/d7e/d47/d66/f67 [0,4194304] 0 2024-09-11T00:07:15.046 INFO:tasks.workunit.client.0.smithi111.stdout:3/430: chown f12 919086 1 2024-09-11T00:07:15.047 INFO:tasks.workunit.client.0.smithi111.stdout:7/398: sync 2024-09-11T00:07:15.048 INFO:tasks.workunit.client.1.smithi203.stdout:3/504: chown d8/da/d37/d83/d6a 859257 1 2024-09-11T00:07:15.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.046+0000 7f1667400700 1 -- 172.21.15.111:0/893117222 <== mgr.24469 v2:172.21.15.203:6828/1203435425 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f167019a750 con 0x7f165403f5e0 2024-09-11T00:07:15.051 INFO:tasks.workunit.client.0.smithi111.stdout:7/399: chown dd/d1d/d1f/d24/f32 284703 1 2024-09-11T00:07:15.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.050+0000 7f166fe00700 1 -- 172.21.15.111:0/893117222 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f165403f5e0 msgr2=0x7f1654041a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:15.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.050+0000 7f166fe00700 1 --2- 172.21.15.111:0/893117222 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f165403f5e0 0x7f1654041a90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f165c00b5c0 tx=0x7f165c005fb0 comp rx=0 tx=0).stop 2024-09-11T00:07:15.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.050+0000 7f166fe00700 1 -- 172.21.15.111:0/893117222 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f16700fffc0 msgr2=0x7f16701935c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:15.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.050+0000 7f166fe00700 1 --2- 172.21.15.111:0/893117222 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f16700fffc0 0x7f16701935c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f166000c910 tx=0x7f166000cc20 comp rx=0 tx=0).stop 2024-09-11T00:07:15.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.052+0000 7f166fe00700 1 -- 172.21.15.111:0/893117222 shutdown_connections 2024-09-11T00:07:15.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.052+0000 7f166fe00700 1 --2- 172.21.15.111:0/893117222 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f165403f5e0 0x7f1654041a90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:15.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.052+0000 7f166fe00700 1 --2- 172.21.15.111:0/893117222 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f16700fffc0 0x7f16701935c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:15.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.052+0000 7f166fe00700 1 --2- 172.21.15.111:0/893117222 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16701011c0 0x7f1670193b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:15.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.052+0000 7f166fe00700 1 -- 172.21.15.111:0/893117222 >> 172.21.15.111:0/893117222 conn(0x7f16700fb570 msgr2=0x7f16701023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:15.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.052+0000 7f166fe00700 1 -- 172.21.15.111:0/893117222 shutdown_connections 2024-09-11T00:07:15.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.052+0000 7f166fe00700 1 -- 172.21.15.111:0/893117222 wait complete. 2024-09-11T00:07:15.063 INFO:tasks.workunit.client.1.smithi203.stdout:4/402: symlink db/dd/d26/l80 0 2024-09-11T00:07:15.066 INFO:tasks.workunit.client.1.smithi203.stdout:5/481: dwrite dc/dd/f3d [0,4194304] 0 2024-09-11T00:07:15.067 INFO:tasks.workunit.client.1.smithi203.stdout:2/361: rename d13/d15/d19/d1c/c31 to d13/d15/d19/d1c/c72 0 2024-09-11T00:07:15.069 INFO:tasks.workunit.client.1.smithi203.stdout:0/420: symlink d0/d2/d7e/d83/l86 0 2024-09-11T00:07:15.076 INFO:tasks.workunit.client.0.smithi111.stdout:6/336: mknod d7/d22/d2d/d4a/c6e 0 2024-09-11T00:07:15.076 INFO:tasks.workunit.client.1.smithi203.stdout:8/404: link d1/d13/d17/l2b d1/d13/d17/d48/d61/l8e 0 2024-09-11T00:07:15.076 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:07:15.078 INFO:tasks.workunit.client.1.smithi203.stdout:3/505: dread d8/da/d11/f75 [0,4194304] 0 2024-09-11T00:07:15.078 INFO:tasks.workunit.client.0.smithi111.stdout:9/433: rename d6/db/d8f to d6/d52/d8a/d92 0 2024-09-11T00:07:15.081 INFO:tasks.workunit.client.0.smithi111.stdout:1/367: fsync d2/d2b/d2c/d56/f5b 0 2024-09-11T00:07:15.081 INFO:tasks.workunit.client.0.smithi111.stdout:2/392: chown d0/l2b 83469747 1 2024-09-11T00:07:15.084 INFO:tasks.workunit.client.0.smithi111.stdout:9/434: chown d6/db/d1b/d41/l82 127 1 2024-09-11T00:07:15.090 INFO:tasks.workunit.client.1.smithi203.stdout:0/421: dread d0/d2/f65 [0,4194304] 0 2024-09-11T00:07:15.091 INFO:tasks.workunit.client.1.smithi203.stdout:2/362: unlink d13/d15/f25 0 2024-09-11T00:07:15.097 INFO:tasks.workunit.client.1.smithi203.stdout:8/405: dwrite d1/d13/d43/f57 [0,4194304] 0 2024-09-11T00:07:15.100 INFO:tasks.workunit.client.0.smithi111.stdout:3/431: creat d1c/d1d/d22/d23/f91 x:0 0 0 2024-09-11T00:07:15.102 INFO:tasks.workunit.client.1.smithi203.stdout:8/406: truncate d1/d13/d17/d2f/f84 267666 0 2024-09-11T00:07:15.105 INFO:tasks.workunit.client.0.smithi111.stdout:8/447: sync 2024-09-11T00:07:15.105 INFO:tasks.workunit.client.1.smithi203.stdout:8/407: write d1/d13/d17/f39 [663488,53251] 0 2024-09-11T00:07:15.107 INFO:tasks.workunit.client.0.smithi111.stdout:7/400: fdatasync dd/f1a 0 2024-09-11T00:07:15.108 INFO:tasks.workunit.client.0.smithi111.stdout:8/448: chown d11/d23/d2c/d7f 279675 1 2024-09-11T00:07:15.111 INFO:tasks.workunit.client.0.smithi111.stdout:6/337: symlink d7/l6f 0 2024-09-11T00:07:15.113 INFO:tasks.workunit.client.0.smithi111.stdout:8/449: dread d11/d21/d38/f41 [0,4194304] 0 2024-09-11T00:07:15.113 INFO:tasks.workunit.client.1.smithi203.stdout:6/380: getdents d0 0 2024-09-11T00:07:15.115 INFO:tasks.workunit.client.1.smithi203.stdout:6/381: chown d0/d27/d35/d39/d3c/f6e 32218833 1 2024-09-11T00:07:15.118 INFO:tasks.workunit.client.0.smithi111.stdout:1/368: mknod d2/d7c/c7d 0 2024-09-11T00:07:15.119 INFO:tasks.workunit.client.1.smithi203.stdout:0/422: mkdir d0/d87 0 2024-09-11T00:07:15.128 INFO:tasks.workunit.client.1.smithi203.stdout:8/408: chown d1/l18 34 1 2024-09-11T00:07:15.131 INFO:tasks.workunit.client.0.smithi111.stdout:5/410: fdatasync d10/d1e/d23/d26/f34 0 2024-09-11T00:07:15.132 INFO:tasks.workunit.client.1.smithi203.stdout:5/482: creat dc/d4f/fa0 x:0 0 0 2024-09-11T00:07:15.133 INFO:tasks.workunit.client.1.smithi203.stdout:5/483: stat dc/dd/d15/d3b 0 2024-09-11T00:07:15.133 INFO:tasks.workunit.client.0.smithi111.stdout:3/432: mkdir d1c/d21/d92 0 2024-09-11T00:07:15.134 INFO:tasks.workunit.client.1.smithi203.stdout:5/484: chown dc/d4f/fa0 1236091316 1 2024-09-11T00:07:15.136 INFO:tasks.workunit.client.0.smithi111.stdout:3/433: chown d1c/d1d/d22/d31/d33/d5f/l8b 612706377 1 2024-09-11T00:07:15.138 INFO:tasks.workunit.client.1.smithi203.stdout:0/423: unlink d0/d1d/l64 0 2024-09-11T00:07:15.140 INFO:tasks.workunit.client.1.smithi203.stdout:9/396: truncate d6/de/d32/d52/f4b 605133 0 2024-09-11T00:07:15.141 INFO:tasks.workunit.client.1.smithi203.stdout:9/397: fdatasync d6/de/d32/f37 0 2024-09-11T00:07:15.143 INFO:tasks.workunit.client.1.smithi203.stdout:1/476: getdents d8/d9/d15/d35 0 2024-09-11T00:07:15.144 INFO:tasks.workunit.client.1.smithi203.stdout:9/398: chown d6/de/d19/d30 90710 1 2024-09-11T00:07:15.144 INFO:tasks.workunit.client.0.smithi111.stdout:2/393: write d0/d3/de/f1f [2324644,39167] 0 2024-09-11T00:07:15.147 INFO:tasks.workunit.client.1.smithi203.stdout:8/409: unlink d1/l18 0 2024-09-11T00:07:15.147 INFO:tasks.workunit.client.0.smithi111.stdout:5/411: dread d10/d1e/d23/d26/d78/f7f [0,4194304] 0 2024-09-11T00:07:15.149 INFO:tasks.workunit.client.1.smithi203.stdout:3/506: creat d8/da/d5c/fba x:0 0 0 2024-09-11T00:07:15.149 INFO:tasks.workunit.client.0.smithi111.stdout:5/412: write d10/d1e/d25/d6e/f7d [2772200,97321] 0 2024-09-11T00:07:15.151 INFO:tasks.workunit.client.0.smithi111.stdout:9/435: write d6/db/d1b/d41/f5e [6482,14797] 0 2024-09-11T00:07:15.157 INFO:tasks.workunit.client.1.smithi203.stdout:0/424: dwrite d0/d2/f81 [0,4194304] 0 2024-09-11T00:07:15.157 INFO:tasks.workunit.client.0.smithi111.stdout:0/426: rmdir d3/da/d75 0 2024-09-11T00:07:15.160 INFO:tasks.workunit.client.1.smithi203.stdout:6/382: write d0/d32/f43 [1038163,13699] 0 2024-09-11T00:07:15.161 INFO:tasks.workunit.client.1.smithi203.stdout:6/383: fdatasync d0/f5f 0 2024-09-11T00:07:15.163 INFO:tasks.workunit.client.1.smithi203.stdout:6/384: readlink d0/d27/d35/d39/l45 0 2024-09-11T00:07:15.163 INFO:tasks.workunit.client.1.smithi203.stdout:9/399: unlink d6/de/d19/d24/d40/d45/f39 0 2024-09-11T00:07:15.168 INFO:tasks.workunit.client.1.smithi203.stdout:8/410: creat d1/d13/d17/d77/f8f x:0 0 0 2024-09-11T00:07:15.168 INFO:tasks.workunit.client.0.smithi111.stdout:0/427: dread d3/d13/d1e/d29/d49/f76 [0,4194304] 0 2024-09-11T00:07:15.169 INFO:tasks.workunit.client.1.smithi203.stdout:8/411: chown d1/f8 4 1 2024-09-11T00:07:15.176 INFO:tasks.workunit.client.0.smithi111.stdout:6/338: truncate d7/fd 1741747 0 2024-09-11T00:07:15.176 INFO:tasks.workunit.client.0.smithi111.stdout:8/450: mkdir d11/d8e 0 2024-09-11T00:07:15.177 INFO:tasks.workunit.client.1.smithi203.stdout:2/363: getdents d13/d15/d30/d59 0 2024-09-11T00:07:15.177 INFO:tasks.workunit.client.1.smithi203.stdout:0/425: creat d0/d2/d3d/d5a/f88 x:0 0 0 2024-09-11T00:07:15.181 INFO:tasks.workunit.client.0.smithi111.stdout:4/376: rename d18/c1e to d18/d20/c7a 0 2024-09-11T00:07:15.181 INFO:tasks.workunit.client.1.smithi203.stdout:5/485: dwrite dc/dd/d1e/f54 [0,4194304] 0 2024-09-11T00:07:15.182 INFO:tasks.workunit.client.0.smithi111.stdout:4/377: readlink d18/l1c 0 2024-09-11T00:07:15.183 INFO:tasks.workunit.client.0.smithi111.stdout:7/401: truncate dd/f10 1833114 0 2024-09-11T00:07:15.185 INFO:tasks.workunit.client.1.smithi203.stdout:5/486: read - dc/dd/d4d/f81 zero size 2024-09-11T00:07:15.190 INFO:tasks.workunit.client.0.smithi111.stdout:7/402: dread dd/d1d/d2d/d2e/f70 [0,4194304] 0 2024-09-11T00:07:15.191 INFO:tasks.workunit.client.1.smithi203.stdout:5/487: readlink dc/dd/l26 0 2024-09-11T00:07:15.193 INFO:tasks.workunit.client.1.smithi203.stdout:8/412: fdatasync d1/d13/d22/d6f/f8a 0 2024-09-11T00:07:15.194 INFO:tasks.workunit.client.0.smithi111.stdout:8/451: dwrite d11/d23/d2c/d46/f4d [0,4194304] 0 2024-09-11T00:07:15.194 INFO:tasks.workunit.client.0.smithi111.stdout:7/403: write dd/d1d/d4d/f60 [3611823,62663] 0 2024-09-11T00:07:15.197 INFO:tasks.workunit.client.1.smithi203.stdout:5/488: chown dc/dd/d15/d3b 237503 1 2024-09-11T00:07:15.197 INFO:tasks.workunit.client.1.smithi203.stdout:7/401: sync 2024-09-11T00:07:15.198 INFO:tasks.workunit.client.0.smithi111.stdout:0/428: mknod d3/da/d7b/d84/c94 0 2024-09-11T00:07:15.199 INFO:tasks.workunit.client.0.smithi111.stdout:7/404: fsync dd/d1d/d1f/f65 0 2024-09-11T00:07:15.201 INFO:tasks.workunit.client.0.smithi111.stdout:6/339: rmdir d7/d22/d1d 39 2024-09-11T00:07:15.202 INFO:tasks.workunit.client.0.smithi111.stdout:7/405: chown dd/d48/d69/f6b 6 1 2024-09-11T00:07:15.203 INFO:tasks.workunit.client.0.smithi111.stdout:6/340: write f1 [4741601,106785] 0 2024-09-11T00:07:15.203 INFO:tasks.workunit.client.1.smithi203.stdout:0/426: truncate d0/f52 999145 0 2024-09-11T00:07:15.206 INFO:tasks.workunit.client.0.smithi111.stdout:3/434: rename d1c/d1d/d22/d44/d5a/d74/f90 to d1c/d1d/d86/f93 0 2024-09-11T00:07:15.208 INFO:tasks.workunit.client.0.smithi111.stdout:3/435: write f17 [4081675,108325] 0 2024-09-11T00:07:15.208 INFO:tasks.workunit.client.1.smithi203.stdout:2/364: dwrite d13/d15/f32 [4194304,4194304] 0 2024-09-11T00:07:15.213 INFO:tasks.workunit.client.1.smithi203.stdout:7/402: chown dd/d1c/f66 28323 1 2024-09-11T00:07:15.214 INFO:tasks.workunit.client.0.smithi111.stdout:1/369: truncate d2/fd 3507677 0 2024-09-11T00:07:15.216 INFO:tasks.workunit.client.1.smithi203.stdout:6/385: mknod d0/d32/d5a/c78 0 2024-09-11T00:07:15.218 INFO:tasks.workunit.client.1.smithi203.stdout:3/507: dwrite d8/da/d11/f75 [0,4194304] 0 2024-09-11T00:07:15.219 INFO:tasks.workunit.client.1.smithi203.stdout:9/400: dwrite d6/de/d47/f61 [0,4194304] 0 2024-09-11T00:07:15.225 INFO:tasks.workunit.client.1.smithi203.stdout:1/477: getdents d8/d11 0 2024-09-11T00:07:15.227 INFO:tasks.workunit.client.1.smithi203.stdout:3/508: write d8/da/d5c/f8d [918269,53501] 0 2024-09-11T00:07:15.232 INFO:tasks.workunit.client.1.smithi203.stdout:0/427: rmdir d0/d2/d7e 39 2024-09-11T00:07:15.233 INFO:tasks.workunit.client.1.smithi203.stdout:1/478: truncate d8/d19/d31/f9d 425527 0 2024-09-11T00:07:15.236 INFO:tasks.workunit.client.1.smithi203.stdout:1/479: fdatasync d8/d11/f51 0 2024-09-11T00:07:15.240 INFO:tasks.workunit.client.1.smithi203.stdout:2/365: mkdir d13/d15/d19/d1c/d73 0 2024-09-11T00:07:15.244 INFO:tasks.workunit.client.1.smithi203.stdout:6/386: creat d0/d27/d35/d39/d3c/f79 x:0 0 0 2024-09-11T00:07:15.245 INFO:tasks.workunit.client.1.smithi203.stdout:4/403: sync 2024-09-11T00:07:15.249 INFO:tasks.workunit.client.0.smithi111.stdout:9/436: rename d6/db/d34/d37/c6e to d6/db/d1b/d74/c93 0 2024-09-11T00:07:15.252 INFO:tasks.workunit.client.1.smithi203.stdout:0/428: creat d0/f89 x:0 0 0 2024-09-11T00:07:15.253 INFO:tasks.workunit.client.0.smithi111.stdout:3/436: mknod d1c/d1d/d22/d23/d2f/c94 0 2024-09-11T00:07:15.255 INFO:tasks.workunit.client.1.smithi203.stdout:7/403: dwrite dd/d4d/f7a [0,4194304] 0 2024-09-11T00:07:15.255 INFO:tasks.workunit.client.1.smithi203.stdout:3/509: symlink d8/da/d37/d83/da3/lbb 0 2024-09-11T00:07:15.255 INFO:tasks.workunit.client.0.smithi111.stdout:3/437: readlink d1c/d1d/d22/d23/d2f/d63/l73 0 2024-09-11T00:07:15.256 INFO:tasks.workunit.client.1.smithi203.stdout:3/510: readlink d8/le 0 2024-09-11T00:07:15.257 INFO:tasks.workunit.client.0.smithi111.stdout:0/429: dread f1 [0,4194304] 0 2024-09-11T00:07:15.259 INFO:tasks.workunit.client.0.smithi111.stdout:0/430: chown d3/d13/d1e/f2e 286 1 2024-09-11T00:07:15.259 INFO:tasks.workunit.client.1.smithi203.stdout:3/511: read - d8/da/d37/d83/da3/fa6 zero size 2024-09-11T00:07:15.260 INFO:tasks.workunit.client.0.smithi111.stdout:1/370: mknod d2/d2b/d2c/c7e 0 2024-09-11T00:07:15.265 INFO:tasks.workunit.client.1.smithi203.stdout:5/489: creat dc/dd/d1e/fa1 x:0 0 0 2024-09-11T00:07:15.266 INFO:tasks.workunit.client.1.smithi203.stdout:5/490: chown dc/dd/d4d/f81 943 1 2024-09-11T00:07:15.269 INFO:tasks.workunit.client.1.smithi203.stdout:5/491: write dc/d65/f4a [3655774,102970] 0 2024-09-11T00:07:15.270 INFO:tasks.workunit.client.0.smithi111.stdout:7/406: write dd/d1d/d2d/d2e/d4e/f64 [626589,120579] 0 2024-09-11T00:07:15.271 INFO:tasks.workunit.client.1.smithi203.stdout:5/492: chown dc/dd/c98 542039 1 2024-09-11T00:07:15.272 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:14 smithi111 ceph-mon[27539]: mgrmap e24: smithi203.smuspl(active, since 4s) 2024-09-11T00:07:15.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.269+0000 7f841f800700 1 -- 172.21.15.111:0/215892699 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84180737b0 msgr2=0x7f8418073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:15.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.269+0000 7f841f800700 1 --2- 172.21.15.111:0/215892699 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84180737b0 0x7f8418073c20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8404009910 tx=0x7f8404009c20 comp rx=0 tx=0).stop 2024-09-11T00:07:15.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.270+0000 7f841f800700 1 -- 172.21.15.111:0/215892699 shutdown_connections 2024-09-11T00:07:15.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.270+0000 7f841f800700 1 --2- 172.21.15.111:0/215892699 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84180737b0 0x7f8418073c20 secure :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8404009910 tx=0x7f8404009c20 comp rx=0 tx=0).stop 2024-09-11T00:07:15.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.270+0000 7f841f800700 1 --2- 172.21.15.111:0/215892699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8418074d80 0x7f84180731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:15.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.270+0000 7f841f800700 1 -- 172.21.15.111:0/215892699 >> 172.21.15.111:0/215892699 conn(0x7f84180fb6e0 msgr2=0x7f84180fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:15.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.270+0000 7f841f800700 1 -- 172.21.15.111:0/215892699 shutdown_connections 2024-09-11T00:07:15.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.270+0000 7f841f800700 1 -- 172.21.15.111:0/215892699 wait complete. 2024-09-11T00:07:15.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.271+0000 7f841f800700 1 Processor -- start 2024-09-11T00:07:15.274 INFO:tasks.workunit.client.1.smithi203.stdout:6/387: creat d0/d32/f7a x:0 0 0 2024-09-11T00:07:15.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.272+0000 7f841f800700 1 -- start start 2024-09-11T00:07:15.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.272+0000 7f841f800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8418074d80 0x7f841819c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:15.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.272+0000 7f841f800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f841819c6e0 0x7f84181a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:15.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.272+0000 7f841f800700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841819cbe0 con 0x7f8418074d80 2024-09-11T00:07:15.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.272+0000 7f841f800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841819cd50 con 0x7f841819c6e0 2024-09-11T00:07:15.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.273+0000 7f841ce00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8418074d80 0x7f841819c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:15.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.273+0000 7f841ce00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8418074d80 0x7f841819c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:33386/0 (socket says 172.21.15.111:33386) 2024-09-11T00:07:15.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.273+0000 7f841ce00700 1 -- 172.21.15.111:0/4029194045 learned_addr learned my addr 172.21.15.111:0/4029194045 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:07:15.276 INFO:tasks.workunit.client.0.smithi111.stdout:2/394: link d0/l57 d0/d3/de/d4b/l8c 0 2024-09-11T00:07:15.276 INFO:tasks.workunit.client.1.smithi203.stdout:6/388: readlink d0/d32/l44 0 2024-09-11T00:07:15.276 INFO:tasks.workunit.client.1.smithi203.stdout:8/413: dread d1/f8 [0,4194304] 0 2024-09-11T00:07:15.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.273+0000 7f8417e00700 1 --2- 172.21.15.111:0/4029194045 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f841819c6e0 0x7f84181a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:15.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.274+0000 7f841ce00700 1 -- 172.21.15.111:0/4029194045 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f841819c6e0 msgr2=0x7f84181a1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:15.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.274+0000 7f841ce00700 1 --2- 172.21.15.111:0/4029194045 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f841819c6e0 0x7f84181a1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:15.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.274+0000 7f841ce00700 1 -- 172.21.15.111:0/4029194045 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84040095f0 con 0x7f8418074d80 2024-09-11T00:07:15.277 INFO:tasks.workunit.client.1.smithi203.stdout:2/366: rename d13/d15/c49 to d13/d15/d19/d1c/d73/c74 0 2024-09-11T00:07:15.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.275+0000 7f841ce00700 1 --2- 172.21.15.111:0/4029194045 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8418074d80 0x7f841819c1a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f840c00c8a0 tx=0x7f840c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:15.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.276+0000 7f8415600700 1 -- 172.21.15.111:0/4029194045 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f840c0078e0 con 0x7f8418074d80 2024-09-11T00:07:15.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.276+0000 7f8415600700 1 -- 172.21.15.111:0/4029194045 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f840c00f450 con 0x7f8418074d80 2024-09-11T00:07:15.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.276+0000 7f841f800700 1 -- 172.21.15.111:0/4029194045 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84181a1cf0 con 0x7f8418074d80 2024-09-11T00:07:15.278 INFO:tasks.workunit.client.0.smithi111.stdout:2/395: chown d0/d3/f1c 254382 1 2024-09-11T00:07:15.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.276+0000 7f8415600700 1 -- 172.21.15.111:0/4029194045 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f840c00e5e0 con 0x7f8418074d80 2024-09-11T00:07:15.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.276+0000 7f841f800700 1 -- 172.21.15.111:0/4029194045 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84181a21c0 con 0x7f8418074d80 2024-09-11T00:07:15.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.278+0000 7f841f800700 1 -- 172.21.15.111:0/4029194045 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f841810f290 con 0x7f8418074d80 2024-09-11T00:07:15.280 INFO:tasks.workunit.client.0.smithi111.stdout:6/341: creat d7/d4d/d61/d6a/f70 x:0 0 0 2024-09-11T00:07:15.280 INFO:tasks.workunit.client.1.smithi203.stdout:4/404: mknod db/dd/d16/d38/d3c/d41/c81 0 2024-09-11T00:07:15.281 INFO:tasks.workunit.client.1.smithi203.stdout:2/367: truncate d13/d15/d19/f26 1540901 0 2024-09-11T00:07:15.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.278+0000 7f8415600700 1 -- 172.21.15.111:0/4029194045 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 24) v1 ==== 51505+0+0 (secure 0 0 0) 0x7f840c00e740 con 0x7f8418074d80 2024-09-11T00:07:15.283 INFO:tasks.workunit.client.1.smithi203.stdout:4/405: chown db/d12/f1e 70003 1 2024-09-11T00:07:15.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.281+0000 7f8415600700 1 --2- 172.21.15.111:0/4029194045 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f840003f580 0x7f8400041a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:15.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.281+0000 7f8415600700 1 -- 172.21.15.111:0/4029194045 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f840c054c70 con 0x7f8418074d80 2024-09-11T00:07:15.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.282+0000 7f8417e00700 1 --2- 172.21.15.111:0/4029194045 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f840003f580 0x7f8400041a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:15.284 INFO:tasks.workunit.client.1.smithi203.stdout:4/406: fsync db/f49 0 2024-09-11T00:07:15.284 INFO:tasks.workunit.client.0.smithi111.stdout:8/452: rename d11/d23/d2c/f4b to d11/d23/d2c/d46/f8f 0 2024-09-11T00:07:15.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.283+0000 7f8417e00700 1 --2- 172.21.15.111:0/4029194045 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f840003f580 0x7f8400041a30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8404005090 tx=0x7f840400b560 comp rx=0 tx=0).ready entity=mgr.24469 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:15.285 INFO:tasks.workunit.client.1.smithi203.stdout:3/512: creat d8/da/d5c/d80/fbc x:0 0 0 2024-09-11T00:07:15.286 INFO:tasks.workunit.client.0.smithi111.stdout:8/453: write d11/d23/d2c/f6b [1219232,36305] 0 2024-09-11T00:07:15.288 INFO:tasks.workunit.client.0.smithi111.stdout:5/413: getdents d10/d1e/d23/d26/d78/d7a 0 2024-09-11T00:07:15.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.287+0000 7f8415600700 1 -- 172.21.15.111:0/4029194045 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f840c016300 con 0x7f8418074d80 2024-09-11T00:07:15.289 INFO:tasks.workunit.client.1.smithi203.stdout:9/401: chown d6/de/f74 23041 1 2024-09-11T00:07:15.290 INFO:tasks.workunit.client.1.smithi203.stdout:1/480: mkdir d8/d19/d60/d90/d3e/d4b/d80/d8d/da3 0 2024-09-11T00:07:15.292 INFO:tasks.workunit.client.1.smithi203.stdout:3/513: fsync d8/da/d5c/f61 0 2024-09-11T00:07:15.292 INFO:tasks.workunit.client.0.smithi111.stdout:0/431: symlink d3/da/l95 0 2024-09-11T00:07:15.294 INFO:tasks.workunit.client.1.smithi203.stdout:5/493: mknod dc/dd/d15/d3b/d7a/ca2 0 2024-09-11T00:07:15.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:14 smithi203 ceph-mon[33225]: mgrmap e24: smithi203.smuspl(active, since 4s) 2024-09-11T00:07:15.299 INFO:tasks.workunit.client.1.smithi203.stdout:8/414: dwrite d1/f3f [0,4194304] 0 2024-09-11T00:07:15.302 INFO:tasks.workunit.client.1.smithi203.stdout:8/415: fsync d1/d13/d3a/f44 0 2024-09-11T00:07:15.304 INFO:tasks.workunit.client.0.smithi111.stdout:9/437: dwrite d6/db/d34/f65 [0,4194304] 0 2024-09-11T00:07:15.306 INFO:tasks.workunit.client.1.smithi203.stdout:6/389: unlink d0/c48 0 2024-09-11T00:07:15.307 INFO:tasks.workunit.client.1.smithi203.stdout:8/416: chown d1/d13/d22/d5d/c7f 213910977 1 2024-09-11T00:07:15.310 INFO:tasks.workunit.client.0.smithi111.stdout:7/407: symlink dd/d1d/d2d/d68/l7f 0 2024-09-11T00:07:15.312 INFO:tasks.workunit.client.1.smithi203.stdout:8/417: stat d1/d13/d17/d2f/d52/d59/c87 0 2024-09-11T00:07:15.313 INFO:tasks.workunit.client.0.smithi111.stdout:6/342: fdatasync d7/f15 0 2024-09-11T00:07:15.319 INFO:tasks.workunit.client.1.smithi203.stdout:2/368: creat d13/d56/f75 x:0 0 0 2024-09-11T00:07:15.321 INFO:tasks.workunit.client.1.smithi203.stdout:4/407: dread db/dd/f13 [0,4194304] 0 2024-09-11T00:07:15.322 INFO:tasks.workunit.client.1.smithi203.stdout:2/369: fdatasync d13/d56/d69/f6d 0 2024-09-11T00:07:15.332 INFO:tasks.workunit.client.0.smithi111.stdout:3/438: mknod d1c/d1d/d22/d44/d5a/d74/d7b/c95 0 2024-09-11T00:07:15.335 INFO:tasks.workunit.client.0.smithi111.stdout:0/432: symlink d3/d13/d1e/d29/d49/d51/l96 0 2024-09-11T00:07:15.337 INFO:tasks.workunit.client.0.smithi111.stdout:0/433: read - d3/da/d7b/d84/f8b zero size 2024-09-11T00:07:15.345 INFO:tasks.workunit.client.0.smithi111.stdout:9/438: unlink d6/db/d1b/d56/l70 0 2024-09-11T00:07:15.346 INFO:tasks.workunit.client.1.smithi203.stdout:1/481: creat d8/d19/d60/d90/d3e/d4b/d3a/fa4 x:0 0 0 2024-09-11T00:07:15.350 INFO:tasks.workunit.client.0.smithi111.stdout:0/434: dread d3/dc/f1f [0,4194304] 0 2024-09-11T00:07:15.352 INFO:tasks.workunit.client.0.smithi111.stdout:6/343: rename d7/d2b/d35/f3a to d7/d22/d2c/d38/f71 0 2024-09-11T00:07:15.353 INFO:tasks.workunit.client.1.smithi203.stdout:9/402: dwrite d6/de/d32/d52/d44/f79 [0,4194304] 0 2024-09-11T00:07:15.357 INFO:tasks.workunit.client.1.smithi203.stdout:8/418: rename d1/d13/d17/d2f/d52/l6a to d1/d13/d17/d2f/d52/d59/l90 0 2024-09-11T00:07:15.359 INFO:tasks.workunit.client.1.smithi203.stdout:1/482: rename d8 to d8/d19/d60/d90/d3e/d66/da5 22 2024-09-11T00:07:15.362 INFO:tasks.workunit.client.1.smithi203.stdout:0/429: creat d0/d2/f8a x:0 0 0 2024-09-11T00:07:15.383 INFO:tasks.workunit.client.0.smithi111.stdout:4/378: sync 2024-09-11T00:07:15.416 INFO:tasks.workunit.client.1.smithi203.stdout:2/370: mkdir d13/d15/d19/d1c/d76 0 2024-09-11T00:07:15.416 INFO:tasks.workunit.client.0.smithi111.stdout:3/439: mknod d1c/d1d/c96 0 2024-09-11T00:07:15.417 INFO:tasks.workunit.client.1.smithi203.stdout:2/371: dread - d13/d15/d30/f57 zero size 2024-09-11T00:07:15.424 INFO:tasks.workunit.client.0.smithi111.stdout:9/439: readlink d6/db/d1b/d56/l85 0 2024-09-11T00:07:15.426 INFO:tasks.workunit.client.0.smithi111.stdout:1/371: write d2/de/d12/d3c/d4b/f74 [319062,13684] 0 2024-09-11T00:07:15.429 INFO:tasks.workunit.client.0.smithi111.stdout:9/440: readlink d6/db/d34/d37/d4c/l60 0 2024-09-11T00:07:15.433 INFO:tasks.workunit.client.1.smithi203.stdout:3/514: dwrite d8/da/d37/d83/d65/f66 [0,4194304] 0 2024-09-11T00:07:15.438 INFO:tasks.workunit.client.0.smithi111.stdout:0/435: rename d3/d74/f8d to d3/d13/d1e/d29/d49/d51/d61/d93/f97 0 2024-09-11T00:07:15.438 INFO:tasks.workunit.client.0.smithi111.stdout:1/372: rename d2/de/d12 to d2/de/d12/d3c/d4b/d7f 22 2024-09-11T00:07:15.441 INFO:tasks.workunit.client.0.smithi111.stdout:8/454: creat d11/f90 x:0 0 0 2024-09-11T00:07:15.445 INFO:tasks.workunit.client.0.smithi111.stdout:3/440: creat d1c/d1d/d22/d44/f97 x:0 0 0 2024-09-11T00:07:15.446 INFO:tasks.workunit.client.0.smithi111.stdout:8/455: readlink d11/d21/d38/d54/l7d 0 2024-09-11T00:07:15.446 INFO:tasks.workunit.client.0.smithi111.stdout:3/441: chown fb 3303983 1 2024-09-11T00:07:15.450 INFO:tasks.workunit.client.0.smithi111.stdout:6/344: mknod d7/d22/d1d/c72 0 2024-09-11T00:07:15.454 INFO:tasks.workunit.client.0.smithi111.stdout:9/441: symlink d6/dc/d7c/l94 0 2024-09-11T00:07:15.460 INFO:tasks.workunit.client.0.smithi111.stdout:6/345: truncate d7/d2b/f68 100706 0 2024-09-11T00:07:15.460 INFO:tasks.workunit.client.0.smithi111.stdout:9/442: read - d6/db/d34/f71 zero size 2024-09-11T00:07:15.460 INFO:tasks.workunit.client.0.smithi111.stdout:6/346: readlink d7/l18 0 2024-09-11T00:07:15.464 INFO:tasks.workunit.client.0.smithi111.stdout:6/347: fdatasync d7/d22/d3f/f54 0 2024-09-11T00:07:15.466 INFO:tasks.workunit.client.0.smithi111.stdout:6/348: chown f6 31042119 1 2024-09-11T00:07:15.466 INFO:tasks.workunit.client.0.smithi111.stdout:0/436: link d3/d13/d1e/f72 d3/d26/f98 0 2024-09-11T00:07:15.468 INFO:tasks.workunit.client.0.smithi111.stdout:6/349: chown d7/d4d/d61 6895350 1 2024-09-11T00:07:15.469 INFO:tasks.workunit.client.0.smithi111.stdout:2/396: sync 2024-09-11T00:07:15.471 INFO:tasks.workunit.client.0.smithi111.stdout:0/437: symlink d3/d1c/d50/l99 0 2024-09-11T00:07:15.479 INFO:tasks.workunit.client.0.smithi111.stdout:2/397: symlink d0/d3/de/d3b/d63/l8d 0 2024-09-11T00:07:15.481 INFO:tasks.workunit.client.1.smithi203.stdout:1/483: dread d8/d19/f57 [0,4194304] 0 2024-09-11T00:07:15.487 INFO:tasks.workunit.client.0.smithi111.stdout:3/442: dwrite f6 [0,4194304] 0 2024-09-11T00:07:15.490 INFO:tasks.workunit.client.1.smithi203.stdout:9/403: mkdir d6/de/d32/d52/d55/d66/d80 0 2024-09-11T00:07:15.492 INFO:tasks.workunit.client.1.smithi203.stdout:9/404: fsync d6/de/d19/d24/f27 0 2024-09-11T00:07:15.493 INFO:tasks.workunit.client.1.smithi203.stdout:6/390: dwrite d0/d27/d35/d39/d3c/f79 [0,4194304] 0 2024-09-11T00:07:15.493 INFO:tasks.workunit.client.0.smithi111.stdout:5/414: dwrite d10/f1c [0,4194304] 0 2024-09-11T00:07:15.494 INFO:tasks.workunit.client.1.smithi203.stdout:5/494: sync 2024-09-11T00:07:15.494 INFO:tasks.workunit.client.1.smithi203.stdout:7/404: sync 2024-09-11T00:07:15.496 INFO:tasks.workunit.client.0.smithi111.stdout:6/350: getdents d7/d22 0 2024-09-11T00:07:15.496 INFO:tasks.workunit.client.1.smithi203.stdout:8/419: mknod d1/d13/d17/d2f/d52/d49/d68/c91 0 2024-09-11T00:07:15.502 INFO:tasks.workunit.client.1.smithi203.stdout:6/391: truncate d0/d27/d35/d39/f56 2796814 0 2024-09-11T00:07:15.505 INFO:tasks.workunit.client.1.smithi203.stdout:3/515: dwrite d8/fb [0,4194304] 0 2024-09-11T00:07:15.507 INFO:tasks.workunit.client.1.smithi203.stdout:1/484: creat d8/d19/fa6 x:0 0 0 2024-09-11T00:07:15.510 INFO:tasks.workunit.client.0.smithi111.stdout:3/443: chown d1c/d1d/d22/d31/d33/d5f/l80 121 1 2024-09-11T00:07:15.511 INFO:tasks.workunit.client.1.smithi203.stdout:2/372: rename d13/c71 to d13/d47/c77 0 2024-09-11T00:07:15.517 INFO:tasks.workunit.client.0.smithi111.stdout:8/456: rename d11/d23/d3d/d5f/f62 to d11/d23/d2c/f91 0 2024-09-11T00:07:15.517 INFO:tasks.workunit.client.1.smithi203.stdout:9/405: fdatasync f5 0 2024-09-11T00:07:15.524 INFO:tasks.workunit.client.1.smithi203.stdout:9/406: dread - d6/de/d19/f7a zero size 2024-09-11T00:07:15.525 INFO:tasks.workunit.client.1.smithi203.stdout:7/405: mknod dd/d1c/d7c/d8c/c97 0 2024-09-11T00:07:15.527 INFO:tasks.workunit.client.0.smithi111.stdout:6/351: dread d7/d22/d1d/f21 [0,4194304] 0 2024-09-11T00:07:15.529 INFO:tasks.workunit.client.1.smithi203.stdout:0/430: sync 2024-09-11T00:07:15.535 INFO:tasks.workunit.client.1.smithi203.stdout:3/516: dwrite d8/d17/f7e [0,4194304] 0 2024-09-11T00:07:15.541 INFO:tasks.workunit.client.1.smithi203.stdout:1/485: mknod d8/d28/d64/ca7 0 2024-09-11T00:07:15.546 INFO:tasks.workunit.client.1.smithi203.stdout:2/373: creat d13/d56/f78 x:0 0 0 2024-09-11T00:07:15.548 INFO:tasks.workunit.client.0.smithi111.stdout:8/457: rename d11/d23/d2c/d53/c58 to d11/d23/d3d/d5f/c92 0 2024-09-11T00:07:15.550 INFO:tasks.workunit.client.0.smithi111.stdout:7/408: truncate dd/f18 996456 0 2024-09-11T00:07:15.552 INFO:tasks.workunit.client.1.smithi203.stdout:2/374: chown d13/d22/f38 42054 1 2024-09-11T00:07:15.556 INFO:tasks.workunit.client.1.smithi203.stdout:9/407: creat d6/de/d32/d52/d44/f81 x:0 0 0 2024-09-11T00:07:15.558 INFO:tasks.workunit.client.1.smithi203.stdout:0/431: dwrite d0/d2/f7a [0,4194304] 0 2024-09-11T00:07:15.559 INFO:tasks.workunit.client.0.smithi111.stdout:2/398: dread d0/f22 [4194304,4194304] 0 2024-09-11T00:07:15.560 INFO:tasks.workunit.client.1.smithi203.stdout:9/408: write d6/de/d32/d52/d44/f5e [417539,45734] 0 2024-09-11T00:07:15.560 INFO:tasks.workunit.client.1.smithi203.stdout:0/432: chown d0/c2c 18783662 1 2024-09-11T00:07:15.561 INFO:tasks.workunit.client.0.smithi111.stdout:3/444: dread d1c/f34 [0,4194304] 0 2024-09-11T00:07:15.564 INFO:tasks.workunit.client.1.smithi203.stdout:9/409: readlink d6/de/d19/d21/l63 0 2024-09-11T00:07:15.564 INFO:tasks.workunit.client.1.smithi203.stdout:3/517: creat d8/da/d37/d53/da2/fbd x:0 0 0 2024-09-11T00:07:15.566 INFO:tasks.workunit.client.0.smithi111.stdout:2/399: write d0/d3/d12/d52/f87 [611976,115461] 0 2024-09-11T00:07:15.570 INFO:tasks.workunit.client.1.smithi203.stdout:2/375: mknod d13/d15/d30/c79 0 2024-09-11T00:07:15.573 INFO:tasks.workunit.client.1.smithi203.stdout:3/518: truncate d8/da/d5c/f8d 1287477 0 2024-09-11T00:07:15.575 INFO:tasks.workunit.client.0.smithi111.stdout:3/445: mkdir d1c/d1d/d22/d31/d33/d5f/d98 0 2024-09-11T00:07:15.577 INFO:tasks.workunit.client.0.smithi111.stdout:8/458: dwrite d11/d21/d38/f5e [0,4194304] 0 2024-09-11T00:07:15.580 INFO:tasks.workunit.client.1.smithi203.stdout:7/406: mkdir dd/d1c/d52/d8f/d31/d58/d93/d98 0 2024-09-11T00:07:15.580 INFO:tasks.workunit.client.1.smithi203.stdout:1/486: rename d8/d19/d60/d90/d3e/d4b/f75 to d8/d19/d60/d90/d3e/d9b/fa8 0 2024-09-11T00:07:15.583 INFO:tasks.workunit.client.1.smithi203.stdout:5/495: dread dc/dd/d1e/f21 [0,4194304] 0 2024-09-11T00:07:15.583 INFO:tasks.workunit.client.1.smithi203.stdout:2/376: rmdir d13/d56/d69 39 2024-09-11T00:07:15.591 INFO:tasks.workunit.client.1.smithi203.stdout:9/410: mknod d6/de/d32/d52/d55/d66/d80/c82 0 2024-09-11T00:07:15.609 INFO:tasks.workunit.client.0.smithi111.stdout:8/459: dwrite f8 [0,4194304] 0 2024-09-11T00:07:15.617 INFO:tasks.workunit.client.0.smithi111.stdout:8/460: stat d11/d23/d2c 0 2024-09-11T00:07:15.625 INFO:tasks.workunit.client.0.smithi111.stdout:7/409: dread dd/d48/f5f [0,4194304] 0 2024-09-11T00:07:15.628 INFO:tasks.workunit.client.0.smithi111.stdout:2/400: dread d0/d3/de/f44 [0,4194304] 0 2024-09-11T00:07:15.630 INFO:tasks.workunit.client.1.smithi203.stdout:2/377: write d13/d15/d30/f39 [1168283,34023] 0 2024-09-11T00:07:15.630 INFO:tasks.workunit.client.1.smithi203.stdout:2/378: chown c3 9972760 1 2024-09-11T00:07:15.630 INFO:tasks.workunit.client.1.smithi203.stdout:3/519: symlink d8/lbe 0 2024-09-11T00:07:15.631 INFO:tasks.workunit.client.1.smithi203.stdout:2/379: chown d13/d15/d19/d1c/f3c 96859953 1 2024-09-11T00:07:15.632 INFO:tasks.workunit.client.0.smithi111.stdout:8/461: mkdir d11/d23/d7e/d93 0 2024-09-11T00:07:15.633 INFO:tasks.workunit.client.1.smithi203.stdout:2/380: dread - d13/d15/f48 zero size 2024-09-11T00:07:15.634 INFO:tasks.workunit.client.1.smithi203.stdout:2/381: write d13/d15/f32 [5716021,35306] 0 2024-09-11T00:07:15.635 INFO:tasks.workunit.client.0.smithi111.stdout:3/446: getdents d1c/d1d/d22/d23/d58 0 2024-09-11T00:07:15.636 INFO:tasks.workunit.client.0.smithi111.stdout:8/462: stat d11/d21/d6f/f79 0 2024-09-11T00:07:15.637 INFO:tasks.workunit.client.1.smithi203.stdout:5/496: creat dc/d91/fa3 x:0 0 0 2024-09-11T00:07:15.639 INFO:tasks.workunit.client.1.smithi203.stdout:5/497: chown dc/dd/d15/l1f 12 1 2024-09-11T00:07:15.639 INFO:tasks.workunit.client.1.smithi203.stdout:3/520: fdatasync d8/da/db3/f94 0 2024-09-11T00:07:15.640 INFO:tasks.workunit.client.0.smithi111.stdout:5/415: sync 2024-09-11T00:07:15.640 INFO:tasks.workunit.client.0.smithi111.stdout:3/447: write d1c/d1d/d22/d23/f91 [921927,120390] 0 2024-09-11T00:07:15.643 INFO:tasks.workunit.client.0.smithi111.stdout:8/463: chown d11/d23/d2c/d53/f55 9644431 1 2024-09-11T00:07:15.646 INFO:tasks.workunit.client.0.smithi111.stdout:4/379: truncate d18/d20/d3c/f58 2687894 0 2024-09-11T00:07:15.646 INFO:tasks.workunit.client.1.smithi203.stdout:2/382: mkdir d13/d15/d19/d1c/d73/d7a 0 2024-09-11T00:07:15.647 INFO:tasks.workunit.client.0.smithi111.stdout:0/438: rename d3/d13/d1e/d29/f2a to d3/d13/d1e/d29/f9a 0 2024-09-11T00:07:15.650 INFO:tasks.workunit.client.1.smithi203.stdout:5/498: mknod dc/dd/d15/d3b/d73/ca4 0 2024-09-11T00:07:15.652 INFO:tasks.workunit.client.0.smithi111.stdout:2/401: rename d0/d3/d12/d52/l7d to d0/d3/de/l8e 0 2024-09-11T00:07:15.652 INFO:tasks.workunit.client.0.smithi111.stdout:7/410: dread f8 [0,4194304] 0 2024-09-11T00:07:15.654 INFO:tasks.workunit.client.1.smithi203.stdout:3/521: dwrite d8/da/d37/f9f [4194304,4194304] 0 2024-09-11T00:07:15.658 INFO:tasks.workunit.client.1.smithi203.stdout:3/522: write d8/da/d5c/d6b/d6c/f7b [4309082,125523] 0 2024-09-11T00:07:15.660 INFO:tasks.workunit.client.1.smithi203.stdout:3/523: dread - d8/da/d5c/d6b/d6c/fac zero size 2024-09-11T00:07:15.662 INFO:tasks.workunit.client.0.smithi111.stdout:7/411: mknod dd/d1d/d1f/c80 0 2024-09-11T00:07:15.665 INFO:tasks.workunit.client.0.smithi111.stdout:2/402: creat d0/d3/d12/d52/d6c/f8f x:0 0 0 2024-09-11T00:07:15.666 INFO:tasks.workunit.client.1.smithi203.stdout:4/408: truncate db/dd/f79 1868378 0 2024-09-11T00:07:15.667 INFO:tasks.workunit.client.0.smithi111.stdout:1/373: dread d2/de/f29 [0,4194304] 0 2024-09-11T00:07:15.668 INFO:tasks.workunit.client.1.smithi203.stdout:2/383: dread f11 [0,4194304] 0 2024-09-11T00:07:15.669 INFO:tasks.workunit.client.0.smithi111.stdout:2/403: chown d0/d3/f27 352136497 1 2024-09-11T00:07:15.670 INFO:tasks.workunit.client.1.smithi203.stdout:4/409: rename f6 to db/d12/d15/d2a/f82 0 2024-09-11T00:07:15.672 INFO:tasks.workunit.client.1.smithi203.stdout:2/384: creat d13/d15/d30/d59/f7b x:0 0 0 2024-09-11T00:07:15.674 INFO:tasks.workunit.client.1.smithi203.stdout:2/385: fdatasync d13/d22/f3f 0 2024-09-11T00:07:15.676 INFO:tasks.workunit.client.0.smithi111.stdout:4/380: read f5 [165495,63034] 0 2024-09-11T00:07:15.679 INFO:tasks.workunit.client.0.smithi111.stdout:1/374: mkdir d2/de/d12/d3c/d4b/d6a/d63/d73/d80 0 2024-09-11T00:07:15.681 INFO:tasks.workunit.client.1.smithi203.stdout:9/411: write f5 [340780,46207] 0 2024-09-11T00:07:15.681 INFO:tasks.workunit.client.0.smithi111.stdout:0/439: mknod d3/d1c/c9b 0 2024-09-11T00:07:15.682 INFO:tasks.workunit.client.1.smithi203.stdout:9/412: chown d6/de/d19/d30/f42 3 1 2024-09-11T00:07:15.685 INFO:tasks.workunit.client.1.smithi203.stdout:8/420: write d1/d13/d22/d6f/d8d/f6b [1291486,74051] 0 2024-09-11T00:07:15.685 INFO:tasks.workunit.client.0.smithi111.stdout:8/464: link d11/d21/f31 d11/d23/d3d/f94 0 2024-09-11T00:07:15.687 INFO:tasks.workunit.client.0.smithi111.stdout:9/443: mknod d6/db/d34/c95 0 2024-09-11T00:07:15.689 INFO:tasks.workunit.client.0.smithi111.stdout:4/381: rename f14 to d18/d20/f7b 0 2024-09-11T00:07:15.690 INFO:tasks.workunit.client.0.smithi111.stdout:6/352: write d7/f30 [1895040,58770] 0 2024-09-11T00:07:15.691 INFO:tasks.workunit.client.0.smithi111.stdout:0/440: fsync d3/d13/d1e/d29/d49/d51/d61/d93/f97 0 2024-09-11T00:07:15.693 INFO:tasks.workunit.client.0.smithi111.stdout:4/382: dread - d18/f57 zero size 2024-09-11T00:07:15.695 INFO:tasks.workunit.client.0.smithi111.stdout:4/383: read - d18/f71 zero size 2024-09-11T00:07:15.697 INFO:tasks.workunit.client.1.smithi203.stdout:9/413: link d6/de/d19/d24/l5c d6/de/d19/d24/d40/d45/l83 0 2024-09-11T00:07:15.700 INFO:tasks.workunit.client.0.smithi111.stdout:6/353: creat d7/d22/d26/f73 x:0 0 0 2024-09-11T00:07:15.701 INFO:tasks.workunit.client.0.smithi111.stdout:9/444: creat d6/db/d34/d37/d4c/d7f/f96 x:0 0 0 2024-09-11T00:07:15.702 INFO:tasks.workunit.client.1.smithi203.stdout:9/414: rmdir d6/de/d19 39 2024-09-11T00:07:15.703 INFO:tasks.workunit.client.1.smithi203.stdout:8/421: dwrite d1/f2 [4194304,4194304] 0 2024-09-11T00:07:15.707 INFO:tasks.workunit.client.0.smithi111.stdout:6/354: read d7/d22/d1d/f31 [3700925,99020] 0 2024-09-11T00:07:15.708 INFO:tasks.workunit.client.1.smithi203.stdout:6/392: dwrite d0/f4f [0,4194304] 0 2024-09-11T00:07:15.709 INFO:tasks.workunit.client.0.smithi111.stdout:4/384: rename d18/d1f/d33/f3d to d18/d3b/d61/f7c 0 2024-09-11T00:07:15.711 INFO:tasks.workunit.client.0.smithi111.stdout:4/385: readlink d18/d20/l5c 0 2024-09-11T00:07:15.715 INFO:tasks.workunit.client.1.smithi203.stdout:8/422: fdatasync d1/d13/d43/d46/f6d 0 2024-09-11T00:07:15.717 INFO:tasks.workunit.client.1.smithi203.stdout:8/423: truncate d1/f8 5790453 0 2024-09-11T00:07:15.722 INFO:tasks.workunit.client.1.smithi203.stdout:6/393: mkdir d0/d27/d7b 0 2024-09-11T00:07:15.723 INFO:tasks.workunit.client.1.smithi203.stdout:0/433: write d0/f5 [2634250,112233] 0 2024-09-11T00:07:15.729 INFO:tasks.workunit.client.1.smithi203.stdout:0/434: chown d0/c2b 2641 1 2024-09-11T00:07:15.730 INFO:tasks.workunit.client.0.smithi111.stdout:6/355: mkdir d7/d22/d3f/d74 0 2024-09-11T00:07:15.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.730+0000 7f841f800700 1 -- 172.21.15.111:0/4029194045 --> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8418103150 con 0x7f840003f580 2024-09-11T00:07:15.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.733+0000 7f8415600700 1 -- 172.21.15.111:0/4029194045 <== mgr.24469 v2:172.21.15.203:6828/1203435425 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f8418103150 con 0x7f840003f580 2024-09-11T00:07:15.737 INFO:tasks.workunit.client.0.smithi111.stdout:6/356: read d7/d22/d3f/f42 [613556,66639] 0 2024-09-11T00:07:15.737 INFO:tasks.workunit.client.1.smithi203.stdout:9/415: dwrite d6/de/d19/d24/f27 [4194304,4194304] 0 2024-09-11T00:07:15.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.737+0000 7f841f800700 1 -- 172.21.15.111:0/4029194045 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f840003f580 msgr2=0x7f8400041a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:15.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.737+0000 7f841f800700 1 --2- 172.21.15.111:0/4029194045 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f840003f580 0x7f8400041a30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8404005090 tx=0x7f840400b560 comp rx=0 tx=0).stop 2024-09-11T00:07:15.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.737+0000 7f841f800700 1 -- 172.21.15.111:0/4029194045 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8418074d80 msgr2=0x7f841819c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:15.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.737+0000 7f841f800700 1 --2- 172.21.15.111:0/4029194045 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8418074d80 0x7f841819c1a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f840c00c8a0 tx=0x7f840c00cbb0 comp rx=0 tx=0).stop 2024-09-11T00:07:15.739 INFO:tasks.workunit.client.0.smithi111.stdout:5/416: write d10/d1e/d23/d2b/f33 [1630739,74512] 0 2024-09-11T00:07:15.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.737+0000 7f841f800700 1 -- 172.21.15.111:0/4029194045 shutdown_connections 2024-09-11T00:07:15.741 INFO:tasks.workunit.client.1.smithi203.stdout:8/424: dwrite d1/f3f [0,4194304] 0 2024-09-11T00:07:15.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.737+0000 7f841f800700 1 --2- 172.21.15.111:0/4029194045 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f840003f580 0x7f8400041a30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:15.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.737+0000 7f841f800700 1 --2- 172.21.15.111:0/4029194045 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8418074d80 0x7f841819c1a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:15.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.737+0000 7f841f800700 1 --2- 172.21.15.111:0/4029194045 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f841819c6e0 0x7f84181a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:15.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.737+0000 7f841f800700 1 -- 172.21.15.111:0/4029194045 >> 172.21.15.111:0/4029194045 conn(0x7f84180fb6e0 msgr2=0x7f84181019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:15.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.740+0000 7f841f800700 1 -- 172.21.15.111:0/4029194045 shutdown_connections 2024-09-11T00:07:15.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:15.740+0000 7f841f800700 1 -- 172.21.15.111:0/4029194045 wait complete. 2024-09-11T00:07:15.746 INFO:tasks.workunit.client.0.smithi111.stdout:3/448: write d1c/f24 [1756956,107345] 0 2024-09-11T00:07:15.746 INFO:tasks.workunit.client.1.smithi203.stdout:5/499: write dc/d4f/d5c/f77 [724864,3437] 0 2024-09-11T00:07:15.747 INFO:tasks.workunit.client.0.smithi111.stdout:9/445: getdents d6/d52 0 2024-09-11T00:07:15.749 INFO:tasks.workunit.client.1.smithi203.stdout:5/500: dread - dc/dd/d1e/fa1 zero size 2024-09-11T00:07:15.751 INFO:tasks.workunit.client.0.smithi111.stdout:3/449: readlink d1c/d1d/d22/d31/d33/d5f/l89 0 2024-09-11T00:07:15.752 INFO:tasks.workunit.client.0.smithi111.stdout:6/357: creat d7/d22/d1d/f75 x:0 0 0 2024-09-11T00:07:15.753 INFO:tasks.workunit.client.1.smithi203.stdout:3/524: write d8/da/db3/f4d [1356143,128524] 0 2024-09-11T00:07:15.756 INFO:tasks.workunit.client.0.smithi111.stdout:3/450: chown d1c/d1d/d22/d23/d58/f75 12 1 2024-09-11T00:07:15.761 INFO:tasks.workunit.client.1.smithi203.stdout:5/501: mkdir dc/d65/da5 0 2024-09-11T00:07:15.763 INFO:tasks.workunit.client.1.smithi203.stdout:5/502: write dc/dd/d13/f3e [5661212,96249] 0 2024-09-11T00:07:15.771 INFO:tasks.workunit.client.0.smithi111.stdout:3/451: mkdir d1c/d1d/d22/d44/d5a/d74/d7b/d99 0 2024-09-11T00:07:15.771 INFO:tasks.workunit.client.1.smithi203.stdout:9/416: creat d6/de/d19/f84 x:0 0 0 2024-09-11T00:07:15.774 INFO:tasks.workunit.client.1.smithi203.stdout:5/503: mknod dc/d2b/ca6 0 2024-09-11T00:07:15.775 INFO:tasks.workunit.client.0.smithi111.stdout:5/417: getdents d10/d1e/d23/d2b/d55/d6d 0 2024-09-11T00:07:15.776 INFO:tasks.workunit.client.1.smithi203.stdout:8/425: truncate d1/f16 714181 0 2024-09-11T00:07:15.783 INFO:tasks.workunit.client.1.smithi203.stdout:4/410: creat db/d12/d15/d2a/d71/f83 x:0 0 0 2024-09-11T00:07:15.784 INFO:tasks.workunit.client.1.smithi203.stdout:5/504: mknod dc/dd/d15/ca7 0 2024-09-11T00:07:15.788 INFO:tasks.workunit.client.1.smithi203.stdout:0/435: write d0/f52 [842497,77553] 0 2024-09-11T00:07:15.788 INFO:tasks.workunit.client.0.smithi111.stdout:5/418: stat d10/d1e/d25 0 2024-09-11T00:07:15.789 INFO:tasks.workunit.client.1.smithi203.stdout:4/411: symlink db/dd/d16/d38/d3c/d41/l84 0 2024-09-11T00:07:15.789 INFO:tasks.workunit.client.1.smithi203.stdout:0/436: stat d0/d2/f8a 0 2024-09-11T00:07:15.789 INFO:tasks.workunit.client.1.smithi203.stdout:7/407: sync 2024-09-11T00:07:15.789 INFO:tasks.workunit.client.1.smithi203.stdout:9/417: dwrite d6/de/d32/d52/d55/f3f [0,4194304] 0 2024-09-11T00:07:15.792 INFO:tasks.workunit.client.1.smithi203.stdout:6/394: truncate d0/d27/d35/d39/f51 236281 0 2024-09-11T00:07:15.793 INFO:tasks.workunit.client.1.smithi203.stdout:5/505: mkdir dc/dd/d4d/d59/da8 0 2024-09-11T00:07:15.794 INFO:tasks.workunit.client.1.smithi203.stdout:0/437: chown d0/d2/d7e 6137 1 2024-09-11T00:07:15.794 INFO:tasks.workunit.client.0.smithi111.stdout:6/358: dwrite d7/d22/d2c/d38/f4c [4194304,4194304] 0 2024-09-11T00:07:15.794 INFO:tasks.workunit.client.1.smithi203.stdout:7/408: symlink dd/d1c/d7c/l99 0 2024-09-11T00:07:15.796 INFO:tasks.workunit.client.0.smithi111.stdout:2/404: dwrite d0/d3/de/f11 [0,4194304] 0 2024-09-11T00:07:15.800 INFO:tasks.workunit.client.0.smithi111.stdout:9/446: dwrite d6/dc/d73/f77 [0,4194304] 0 2024-09-11T00:07:15.801 INFO:tasks.workunit.client.1.smithi203.stdout:5/506: readlink dc/dd/d1e/d7b/l88 0 2024-09-11T00:07:15.803 INFO:tasks.workunit.client.1.smithi203.stdout:6/395: symlink d0/d5b/l7c 0 2024-09-11T00:07:15.809 INFO:tasks.workunit.client.1.smithi203.stdout:7/409: rename dd/d1c/d4b/f59 to dd/d1c/d52/d8f/d31/f9a 0 2024-09-11T00:07:15.810 INFO:tasks.workunit.client.0.smithi111.stdout:0/441: dwrite d3/d26/d77/f45 [0,4194304] 0 2024-09-11T00:07:15.810 INFO:tasks.workunit.client.0.smithi111.stdout:5/419: creat d10/d1e/d23/d30/d3c/d60/d7e/f88 x:0 0 0 2024-09-11T00:07:15.812 INFO:tasks.workunit.client.1.smithi203.stdout:5/507: dread dc/dd/d15/f42 [0,4194304] 0 2024-09-11T00:07:15.812 INFO:tasks.workunit.client.0.smithi111.stdout:7/412: sync 2024-09-11T00:07:15.813 INFO:tasks.workunit.client.0.smithi111.stdout:1/375: sync 2024-09-11T00:07:15.818 INFO:tasks.workunit.client.1.smithi203.stdout:7/410: chown dd/l61 21251 1 2024-09-11T00:07:15.819 INFO:tasks.workunit.client.0.smithi111.stdout:3/452: write fb [1269875,115894] 0 2024-09-11T00:07:15.820 INFO:tasks.workunit.client.0.smithi111.stdout:7/413: stat dd/d1d/d2d/d2e/f70 0 2024-09-11T00:07:15.820 INFO:tasks.workunit.client.0.smithi111.stdout:4/386: dwrite d18/d20/d4a/f2c [4194304,4194304] 0 2024-09-11T00:07:15.821 INFO:tasks.workunit.client.1.smithi203.stdout:9/418: dwrite d6/de/d19/d24/f6d [4194304,4194304] 0 2024-09-11T00:07:15.824 INFO:tasks.workunit.client.0.smithi111.stdout:9/447: mkdir d6/db/d34/d37/d4c/d7f/d97 0 2024-09-11T00:07:15.826 INFO:tasks.workunit.client.0.smithi111.stdout:5/420: truncate d10/d1e/d23/d30/f37 5011898 0 2024-09-11T00:07:15.826 INFO:tasks.workunit.client.1.smithi203.stdout:0/438: getdents d0/d1d/d5d 0 2024-09-11T00:07:15.826 INFO:tasks.workunit.client.1.smithi203.stdout:3/525: dwrite d8/da/d37/d83/d6a/f8c [0,4194304] 0 2024-09-11T00:07:15.828 INFO:tasks.workunit.client.1.smithi203.stdout:9/419: rmdir d6/de 39 2024-09-11T00:07:15.830 INFO:tasks.workunit.client.0.smithi111.stdout:8/465: sync 2024-09-11T00:07:15.830 INFO:tasks.workunit.client.0.smithi111.stdout:9/448: write d6/db/f83 [179983,48331] 0 2024-09-11T00:07:15.831 INFO:tasks.workunit.client.0.smithi111.stdout:0/442: symlink d3/da/d7b/d84/l9c 0 2024-09-11T00:07:15.832 INFO:tasks.workunit.client.0.smithi111.stdout:3/453: write d1c/d1d/d22/f70 [2375432,26560] 0 2024-09-11T00:07:15.833 INFO:tasks.workunit.client.1.smithi203.stdout:7/411: rename dd/d1c/d52/d8f/d31/f63 to dd/d1c/d52/d8f/d31/d58/d93/f9b 0 2024-09-11T00:07:15.837 INFO:tasks.workunit.client.1.smithi203.stdout:0/439: rename d0/d2/d37 to d0/d2/d37/d8b 22 2024-09-11T00:07:15.837 INFO:tasks.workunit.client.1.smithi203.stdout:7/412: chown dd/f22 2045 1 2024-09-11T00:07:15.838 INFO:tasks.workunit.client.0.smithi111.stdout:7/414: creat dd/d1d/d1f/f81 x:0 0 0 2024-09-11T00:07:15.838 INFO:tasks.workunit.client.0.smithi111.stdout:4/387: mknod d18/d20/d3c/d5e/c7d 0 2024-09-11T00:07:15.838 INFO:tasks.workunit.client.0.smithi111.stdout:0/443: chown d3/d13/d1e/d29/f3e 1480303 1 2024-09-11T00:07:15.839 INFO:tasks.workunit.client.0.smithi111.stdout:3/454: stat d1c/d1d/d22/d23/f68 0 2024-09-11T00:07:15.842 INFO:tasks.workunit.client.0.smithi111.stdout:0/444: chown d3/dc/f1f 871950254 1 2024-09-11T00:07:15.844 INFO:tasks.workunit.client.0.smithi111.stdout:2/405: getdents d0/d3/d2e 0 2024-09-11T00:07:15.845 INFO:tasks.workunit.client.1.smithi203.stdout:5/508: dwrite dc/dd/d15/f4b [0,4194304] 0 2024-09-11T00:07:15.846 INFO:tasks.workunit.client.0.smithi111.stdout:8/466: fsync d11/f12 0 2024-09-11T00:07:15.848 INFO:tasks.workunit.client.0.smithi111.stdout:7/415: mkdir dd/d1d/d4d/d82 0 2024-09-11T00:07:15.849 INFO:tasks.workunit.client.1.smithi203.stdout:0/440: write d0/d2/d37/f4b [665874,2831] 0 2024-09-11T00:07:15.850 INFO:tasks.workunit.client.1.smithi203.stdout:0/441: chown d0/d2/f40 4 1 2024-09-11T00:07:15.850 INFO:tasks.workunit.client.0.smithi111.stdout:9/449: creat d6/db/d1b/d74/f98 x:0 0 0 2024-09-11T00:07:15.855 INFO:tasks.workunit.client.0.smithi111.stdout:4/388: mknod d18/d20/d40/c7e 0 2024-09-11T00:07:15.856 INFO:tasks.workunit.client.0.smithi111.stdout:1/376: creat d2/de/d12/d3c/d4b/d6a/f81 x:0 0 0 2024-09-11T00:07:15.862 INFO:tasks.workunit.client.0.smithi111.stdout:8/467: stat d11/d23/d7e/c82 0 2024-09-11T00:07:15.865 INFO:tasks.workunit.client.0.smithi111.stdout:2/406: symlink d0/d3/de/l90 0 2024-09-11T00:07:15.866 INFO:tasks.workunit.client.1.smithi203.stdout:0/442: truncate d0/d2/f41 2226249 0 2024-09-11T00:07:15.867 INFO:tasks.workunit.client.0.smithi111.stdout:8/468: write d11/f6d [429601,18298] 0 2024-09-11T00:07:15.868 INFO:tasks.workunit.client.1.smithi203.stdout:9/420: creat d6/de/f85 x:0 0 0 2024-09-11T00:07:15.869 INFO:tasks.workunit.client.0.smithi111.stdout:2/407: dread - d0/d3/f84 zero size 2024-09-11T00:07:15.870 INFO:tasks.workunit.client.0.smithi111.stdout:6/359: getdents d7/d22 0 2024-09-11T00:07:15.871 INFO:tasks.workunit.client.0.smithi111.stdout:0/445: creat d3/d13/d1e/d29/d70/f9d x:0 0 0 2024-09-11T00:07:15.872 INFO:tasks.workunit.client.0.smithi111.stdout:5/421: read d10/d1e/d23/d30/d3c/d60/d7e/d47/f58 [96354,125073] 0 2024-09-11T00:07:15.873 INFO:tasks.workunit.client.1.smithi203.stdout:0/443: unlink d0/d2/c54 0 2024-09-11T00:07:15.875 INFO:tasks.workunit.client.1.smithi203.stdout:7/413: mknod dd/d1c/d52/d8f/d31/d4a/c9c 0 2024-09-11T00:07:15.876 INFO:tasks.workunit.client.0.smithi111.stdout:2/408: write d0/d3/f3e [514779,63564] 0 2024-09-11T00:07:15.876 INFO:tasks.workunit.client.0.smithi111.stdout:9/450: mkdir d6/db/d34/d37/d4c/d99 0 2024-09-11T00:07:15.880 INFO:tasks.workunit.client.0.smithi111.stdout:9/451: truncate d6/f91 737912 0 2024-09-11T00:07:15.888 INFO:tasks.workunit.client.0.smithi111.stdout:8/469: creat d11/d23/d2c/d46/f95 x:0 0 0 2024-09-11T00:07:15.890 INFO:tasks.workunit.client.1.smithi203.stdout:9/421: link d6/de/d19/d30/l3a d6/de/d19/d5b/l86 0 2024-09-11T00:07:15.892 INFO:tasks.workunit.client.0.smithi111.stdout:0/446: mknod d3/d26/c9e 0 2024-09-11T00:07:15.893 INFO:tasks.workunit.client.1.smithi203.stdout:6/396: write d0/d32/f34 [1845381,68746] 0 2024-09-11T00:07:15.893 INFO:tasks.workunit.client.1.smithi203.stdout:9/422: chown d6/de/d19/d21/f56 23797 1 2024-09-11T00:07:15.897 INFO:tasks.workunit.client.1.smithi203.stdout:9/423: truncate d6/de/d32/d52/d44/f79 4528956 0 2024-09-11T00:07:15.898 INFO:tasks.workunit.client.1.smithi203.stdout:6/397: read d0/d27/d35/f3f [1930521,48967] 0 2024-09-11T00:07:15.898 INFO:tasks.workunit.client.0.smithi111.stdout:1/377: mkdir d2/de/d82 0 2024-09-11T00:07:15.898 INFO:tasks.workunit.client.0.smithi111.stdout:2/409: symlink d0/d3/de/d3b/d62/l91 0 2024-09-11T00:07:15.901 INFO:tasks.workunit.client.0.smithi111.stdout:1/378: dread - d2/de/d12/d3c/d4b/d6a/f65 zero size 2024-09-11T00:07:15.902 INFO:tasks.workunit.client.1.smithi203.stdout:6/398: write d0/f5f [688039,86678] 0 2024-09-11T00:07:15.904 INFO:tasks.workunit.client.0.smithi111.stdout:8/470: symlink d11/d23/d7e/l96 0 2024-09-11T00:07:15.906 INFO:tasks.workunit.client.1.smithi203.stdout:9/424: unlink d6/de/d19/f1c 0 2024-09-11T00:07:15.908 INFO:tasks.workunit.client.1.smithi203.stdout:9/425: write d6/de/d19/f31 [281147,9682] 0 2024-09-11T00:07:15.911 INFO:tasks.workunit.client.0.smithi111.stdout:4/389: truncate d18/f32 2443912 0 2024-09-11T00:07:15.911 INFO:tasks.workunit.client.0.smithi111.stdout:5/422: symlink d10/d1e/d23/d30/l89 0 2024-09-11T00:07:15.915 INFO:tasks.workunit.client.0.smithi111.stdout:2/410: write d0/d3/de/f51 [3973152,38738] 0 2024-09-11T00:07:15.919 INFO:tasks.workunit.client.0.smithi111.stdout:0/447: dwrite d3/d13/d1e/d29/f4e [0,4194304] 0 2024-09-11T00:07:15.924 INFO:tasks.workunit.client.1.smithi203.stdout:3/526: dread d8/da/d5c/f61 [0,4194304] 0 2024-09-11T00:07:15.925 INFO:tasks.workunit.client.0.smithi111.stdout:3/455: dwrite f2 [0,4194304] 0 2024-09-11T00:07:15.925 INFO:tasks.workunit.client.1.smithi203.stdout:5/509: dwrite dc/d4f/f50 [0,4194304] 0 2024-09-11T00:07:15.926 INFO:tasks.workunit.client.1.smithi203.stdout:5/510: chown dc/d65/da5 0 1 2024-09-11T00:07:15.929 INFO:tasks.workunit.client.1.smithi203.stdout:3/527: write d8/da/d37/f3f [4150040,126013] 0 2024-09-11T00:07:15.930 INFO:tasks.workunit.client.0.smithi111.stdout:4/390: symlink d18/d1f/d36/l7f 0 2024-09-11T00:07:15.931 INFO:tasks.workunit.client.1.smithi203.stdout:9/426: dwrite d6/de/d32/f59 [0,4194304] 0 2024-09-11T00:07:15.932 INFO:tasks.workunit.client.1.smithi203.stdout:3/528: read d8/da/d37/d83/d6a/f8c [2360384,77806] 0 2024-09-11T00:07:15.933 INFO:tasks.workunit.client.0.smithi111.stdout:8/471: dread d11/d21/f22 [0,4194304] 0 2024-09-11T00:07:15.933 INFO:tasks.workunit.client.1.smithi203.stdout:9/427: chown d6/de/d32/d52/d44 5539 1 2024-09-11T00:07:15.934 INFO:tasks.workunit.client.0.smithi111.stdout:5/423: mknod d10/d1e/d23/d2b/d2f/c8a 0 2024-09-11T00:07:15.935 INFO:tasks.workunit.client.0.smithi111.stdout:7/416: truncate dd/d1d/d1f/f23 5126751 0 2024-09-11T00:07:15.936 INFO:tasks.workunit.client.1.smithi203.stdout:6/399: getdents d0/d27 0 2024-09-11T00:07:15.938 INFO:tasks.workunit.client.1.smithi203.stdout:9/428: readlink d6/de/d32/d52/d55/l6b 0 2024-09-11T00:07:15.939 INFO:tasks.workunit.client.0.smithi111.stdout:1/379: symlink d2/d77/l83 0 2024-09-11T00:07:15.942 INFO:tasks.workunit.client.1.smithi203.stdout:9/429: write d6/de/d19/d21/f56 [26803,85524] 0 2024-09-11T00:07:15.942 INFO:tasks.workunit.client.0.smithi111.stdout:5/424: write d10/d1e/d23/d30/d3c/d60/d7e/d47/d66/f67 [1021403,89994] 0 2024-09-11T00:07:15.944 INFO:tasks.workunit.client.0.smithi111.stdout:2/411: mkdir d0/d3/de/d3b/d92 0 2024-09-11T00:07:15.947 INFO:tasks.workunit.client.0.smithi111.stdout:8/472: rmdir d11/d23/d3d/d8d 39 2024-09-11T00:07:15.947 INFO:tasks.workunit.client.0.smithi111.stdout:0/448: mknod d3/d26/c9f 0 2024-09-11T00:07:15.948 INFO:tasks.workunit.client.1.smithi203.stdout:7/414: dwrite dd/d1c/f21 [0,4194304] 0 2024-09-11T00:07:15.948 INFO:tasks.workunit.client.1.smithi203.stdout:6/400: mkdir d0/d27/d35/d38/d7d 0 2024-09-11T00:07:15.948 INFO:tasks.workunit.client.1.smithi203.stdout:9/430: stat d6/de/d32/d52/d55/f2b 0 2024-09-11T00:07:15.952 INFO:tasks.workunit.client.0.smithi111.stdout:9/452: write d6/db/d34/d37/f1d [1098559,85830] 0 2024-09-11T00:07:15.953 INFO:tasks.workunit.client.0.smithi111.stdout:5/425: write d10/d1e/d23/d26/d3a/f87 [1060798,21179] 0 2024-09-11T00:07:15.953 INFO:tasks.workunit.client.1.smithi203.stdout:9/431: fsync d6/de/d19/d24/f6f 0 2024-09-11T00:07:15.954 INFO:tasks.workunit.client.1.smithi203.stdout:6/401: write d0/d27/d35/f70 [758887,94610] 0 2024-09-11T00:07:15.956 INFO:tasks.workunit.client.0.smithi111.stdout:7/417: symlink dd/d1d/d2d/d2e/d4e/l83 0 2024-09-11T00:07:15.957 INFO:tasks.workunit.client.1.smithi203.stdout:3/529: rmdir d8/da/d37/d53/d63/db5 0 2024-09-11T00:07:15.962 INFO:tasks.workunit.client.0.smithi111.stdout:3/456: creat d1c/d21/d92/f9a x:0 0 0 2024-09-11T00:07:15.966 INFO:tasks.workunit.client.0.smithi111.stdout:4/391: dwrite d18/d20/d4a/f64 [0,4194304] 0 2024-09-11T00:07:15.966 INFO:tasks.workunit.client.1.smithi203.stdout:9/432: mkdir d6/de/d19/d21/d87 0 2024-09-11T00:07:15.967 INFO:tasks.workunit.client.0.smithi111.stdout:8/473: rmdir d11/d23/d7e 39 2024-09-11T00:07:15.972 INFO:tasks.workunit.client.0.smithi111.stdout:4/392: chown d18/c21 176 1 2024-09-11T00:07:15.976 INFO:tasks.workunit.client.1.smithi203.stdout:7/415: rename dd/d1c/f3a to dd/f9d 0 2024-09-11T00:07:15.977 INFO:tasks.workunit.client.0.smithi111.stdout:5/426: mkdir d10/d1e/d25/d6e/d8b 0 2024-09-11T00:07:15.980 INFO:tasks.workunit.client.1.smithi203.stdout:3/530: rmdir d8/da/d37/d83/da1 0 2024-09-11T00:07:15.980 INFO:tasks.workunit.client.1.smithi203.stdout:9/433: mknod d6/de/d19/d24/d40/d45/c88 0 2024-09-11T00:07:15.982 INFO:tasks.workunit.client.1.smithi203.stdout:6/402: read d0/d32/f43 [695979,8535] 0 2024-09-11T00:07:15.983 INFO:tasks.workunit.client.0.smithi111.stdout:7/418: mknod dd/d1d/d2d/d68/c84 0 2024-09-11T00:07:15.983 INFO:tasks.workunit.client.0.smithi111.stdout:1/380: mknod d2/d2b/d2c/d56/d7b/c84 0 2024-09-11T00:07:15.983 INFO:tasks.workunit.client.0.smithi111.stdout:6/360: sync 2024-09-11T00:07:15.984 INFO:tasks.workunit.client.1.smithi203.stdout:7/416: unlink dd/d1c/f46 0 2024-09-11T00:07:15.987 INFO:tasks.workunit.client.1.smithi203.stdout:3/531: unlink c4 0 2024-09-11T00:07:15.988 INFO:tasks.workunit.client.0.smithi111.stdout:5/427: write d10/d1e/d25/f4a [2299472,35239] 0 2024-09-11T00:07:15.993 INFO:tasks.workunit.client.0.smithi111.stdout:6/361: dread - d7/d22/d3f/f65 zero size 2024-09-11T00:07:15.995 INFO:tasks.workunit.client.0.smithi111.stdout:9/453: dwrite d6/f91 [0,4194304] 0 2024-09-11T00:07:15.995 INFO:tasks.workunit.client.0.smithi111.stdout:4/393: rename c16 to d18/d20/d3c/c80 0 2024-09-11T00:07:15.997 INFO:tasks.workunit.client.1.smithi203.stdout:2/386: sync 2024-09-11T00:07:15.997 INFO:tasks.workunit.client.0.smithi111.stdout:2/412: creat d0/d3/f93 x:0 0 0 2024-09-11T00:07:15.997 INFO:tasks.workunit.client.1.smithi203.stdout:1/487: sync 2024-09-11T00:07:15.998 INFO:tasks.workunit.client.1.smithi203.stdout:9/434: truncate d6/f76 94879 0 2024-09-11T00:07:15.999 INFO:tasks.workunit.client.1.smithi203.stdout:2/387: dread - d13/d22/f4e zero size 2024-09-11T00:07:16.000 INFO:tasks.workunit.client.1.smithi203.stdout:6/403: mkdir d0/d27/d7b/d7e 0 2024-09-11T00:07:16.005 INFO:tasks.workunit.client.0.smithi111.stdout:8/474: creat d11/d23/d7e/f97 x:0 0 0 2024-09-11T00:07:16.005 INFO:tasks.workunit.client.0.smithi111.stdout:2/413: stat d0/d3/de/d50/f59 0 2024-09-11T00:07:16.013 INFO:tasks.workunit.client.0.smithi111.stdout:6/362: mknod d7/d4d/d61/d6a/c76 0 2024-09-11T00:07:16.013 INFO:tasks.workunit.client.0.smithi111.stdout:0/449: dread d3/f54 [0,4194304] 0 2024-09-11T00:07:16.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.013+0000 7f5671a00700 1 -- 172.21.15.111:0/369669802 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f566c1079a0 msgr2=0x7f566c107df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:16.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.013+0000 7f5671a00700 1 --2- 172.21.15.111:0/369669802 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f566c1079a0 0x7f566c107df0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5654009870 tx=0x7f5654009b80 comp rx=0 tx=0).stop 2024-09-11T00:07:16.016 INFO:tasks.workunit.client.1.smithi203.stdout:6/404: read d0/f2d [2667191,40321] 0 2024-09-11T00:07:16.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.013+0000 7f5671a00700 1 -- 172.21.15.111:0/369669802 shutdown_connections 2024-09-11T00:07:16.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.013+0000 7f5671a00700 1 --2- 172.21.15.111:0/369669802 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f566c1079a0 0x7f566c107df0 secure :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5654009870 tx=0x7f5654009b80 comp rx=0 tx=0).stop 2024-09-11T00:07:16.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.013+0000 7f5671a00700 1 --2- 172.21.15.111:0/369669802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f566c1067a0 0x7f566c106bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:16.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.013+0000 7f5671a00700 1 -- 172.21.15.111:0/369669802 >> 172.21.15.111:0/369669802 conn(0x7f566c069ae0 msgr2=0x7f566c069f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:16.017 INFO:tasks.workunit.client.0.smithi111.stdout:1/381: rename d2/d2b/d2c/c67 to d2/d2b/c85 0 2024-09-11T00:07:16.017 INFO:tasks.workunit.client.1.smithi203.stdout:1/488: creat d8/d28/fa9 x:0 0 0 2024-09-11T00:07:16.018 INFO:tasks.workunit.client.1.smithi203.stdout:6/405: chown d0/d27/d35/c5d 691 1 2024-09-11T00:07:16.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.015+0000 7f5671a00700 1 -- 172.21.15.111:0/369669802 shutdown_connections 2024-09-11T00:07:16.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.015+0000 7f5671a00700 1 -- 172.21.15.111:0/369669802 wait complete. 2024-09-11T00:07:16.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.017+0000 7f5671a00700 1 Processor -- start 2024-09-11T00:07:16.022 INFO:tasks.workunit.client.1.smithi203.stdout:6/406: chown d0/d27/d35/c5d 888 1 2024-09-11T00:07:16.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.017+0000 7f5671a00700 1 -- start start 2024-09-11T00:07:16.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.017+0000 7f5671a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f566c1067a0 0x7f566c1a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:16.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.017+0000 7f5671a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f566c1a4f30 0x7f566c112a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:16.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.017+0000 7f5671a00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c1a5430 con 0x7f566c1067a0 2024-09-11T00:07:16.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.017+0000 7f5671a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c1a55a0 con 0x7f566c1a4f30 2024-09-11T00:07:16.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.018+0000 7f566a000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f566c1a4f30 0x7f566c112a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:16.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.018+0000 7f566a000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f566c1a4f30 0x7f566c112a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.111:43766/0 (socket says 172.21.15.111:43766) 2024-09-11T00:07:16.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.018+0000 7f566a000700 1 -- 172.21.15.111:0/2663458476 learned_addr learned my addr 172.21.15.111:0/2663458476 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:07:16.024 INFO:tasks.workunit.client.1.smithi203.stdout:1/489: creat d8/d9/d15/d35/faa x:0 0 0 2024-09-11T00:07:16.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.021+0000 7f566aa00700 1 --2- 172.21.15.111:0/2663458476 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f566c1067a0 0x7f566c1a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:16.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.021+0000 7f566a000700 1 -- 172.21.15.111:0/2663458476 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f566c1067a0 msgr2=0x7f566c1a49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:16.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.021+0000 7f566a000700 1 --2- 172.21.15.111:0/2663458476 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f566c1067a0 0x7f566c1a49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:16.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.021+0000 7f566a000700 1 -- 172.21.15.111:0/2663458476 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5654009520 con 0x7f566c1a4f30 2024-09-11T00:07:16.025 INFO:tasks.workunit.client.1.smithi203.stdout:1/490: chown d8/d9 32126134 1 2024-09-11T00:07:16.027 INFO:tasks.workunit.client.1.smithi203.stdout:2/388: dwrite d13/d22/f4e [0,4194304] 0 2024-09-11T00:07:16.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.026+0000 7f566a000700 1 --2- 172.21.15.111:0/2663458476 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f566c1a4f30 0x7f566c112a80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5654015000 tx=0x7f565400f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:16.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.030+0000 7f5663400700 1 -- 172.21.15.111:0/2663458476 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f565401c070 con 0x7f566c1a4f30 2024-09-11T00:07:16.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.030+0000 7f5663400700 1 -- 172.21.15.111:0/2663458476 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f565400b5a0 con 0x7f566c1a4f30 2024-09-11T00:07:16.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.030+0000 7f5663400700 1 -- 172.21.15.111:0/2663458476 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56540173f0 con 0x7f566c1a4f30 2024-09-11T00:07:16.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.030+0000 7f5671a00700 1 -- 172.21.15.111:0/2663458476 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f566c112fc0 con 0x7f566c1a4f30 2024-09-11T00:07:16.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.031+0000 7f5671a00700 1 -- 172.21.15.111:0/2663458476 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f566c113590 con 0x7f566c1a4f30 2024-09-11T00:07:16.034 INFO:tasks.workunit.client.1.smithi203.stdout:2/389: chown cc 11 1 2024-09-11T00:07:16.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.034+0000 7f5663400700 1 -- 172.21.15.111:0/2663458476 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) v1 ==== 51561+0+0 (secure 0 0 0) 0x7f5654020070 con 0x7f566c1a4f30 2024-09-11T00:07:16.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.035+0000 7f5671a00700 1 -- 172.21.15.111:0/2663458476 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f566c079e30 con 0x7f566c1a4f30 2024-09-11T00:07:16.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.036+0000 7f5663400700 1 --2- 172.21.15.111:0/2663458476 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f565003f6b0 0x7f5650041b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:16.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.037+0000 7f5663400700 1 -- 172.21.15.111:0/2663458476 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f5654055fb0 con 0x7f566c1a4f30 2024-09-11T00:07:16.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.038+0000 7f566aa00700 1 --2- 172.21.15.111:0/2663458476 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f565003f6b0 0x7f5650041b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:16.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.039+0000 7f566aa00700 1 --2- 172.21.15.111:0/2663458476 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f565003f6b0 0x7f5650041b60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f565c005950 tx=0x7f565c0058e0 comp rx=0 tx=0).ready entity=mgr.24469 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:16.042 INFO:tasks.workunit.client.0.smithi111.stdout:2/414: dread d0/d3/d12/d52/d6c/f7c [0,4194304] 0 2024-09-11T00:07:16.043 INFO:tasks.workunit.client.0.smithi111.stdout:7/419: mknod dd/d49/c85 0 2024-09-11T00:07:16.046 INFO:tasks.workunit.client.0.smithi111.stdout:7/420: chown dd/f1a 14 1 2024-09-11T00:07:16.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.046+0000 7f5663400700 1 -- 172.21.15.111:0/2663458476 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f5654017550 con 0x7f566c1a4f30 2024-09-11T00:07:16.050 INFO:tasks.workunit.client.1.smithi203.stdout:2/390: dwrite d13/d47/f61 [0,4194304] 0 2024-09-11T00:07:16.052 INFO:tasks.workunit.client.0.smithi111.stdout:9/454: mkdir d6/db/d7a/d9a 0 2024-09-11T00:07:16.053 INFO:tasks.workunit.client.0.smithi111.stdout:1/382: fdatasync d2/de/d12/f1c 0 2024-09-11T00:07:16.056 INFO:tasks.workunit.client.0.smithi111.stdout:4/394: fdatasync d18/d20/d3c/f58 0 2024-09-11T00:07:16.057 INFO:tasks.workunit.client.1.smithi203.stdout:2/391: creat d13/d22/f7c x:0 0 0 2024-09-11T00:07:16.059 INFO:tasks.workunit.client.0.smithi111.stdout:2/415: mknod d0/d3/d12/d52/d65/c94 0 2024-09-11T00:07:16.061 INFO:tasks.workunit.client.0.smithi111.stdout:3/457: write d1c/f34 [2073177,110542] 0 2024-09-11T00:07:16.064 INFO:tasks.workunit.client.1.smithi203.stdout:2/392: unlink d13/d56/f75 0 2024-09-11T00:07:16.071 INFO:tasks.workunit.client.0.smithi111.stdout:3/458: chown d1c/d1d/d22/d31/d33/l65 273930676 1 2024-09-11T00:07:16.073 INFO:tasks.workunit.client.1.smithi203.stdout:2/393: read - d13/d56/d69/f6d zero size 2024-09-11T00:07:16.076 INFO:tasks.workunit.client.1.smithi203.stdout:3/532: dwrite d8/da/f97 [0,4194304] 0 2024-09-11T00:07:16.077 INFO:tasks.workunit.client.0.smithi111.stdout:5/428: getdents d10/d1e/d23/d2b/d55 0 2024-09-11T00:07:16.079 INFO:tasks.workunit.client.0.smithi111.stdout:2/416: mknod d0/d3/de/d3b/d62/d6d/c95 0 2024-09-11T00:07:16.079 INFO:tasks.workunit.client.1.smithi203.stdout:2/394: unlink d13/d15/d19/l20 0 2024-09-11T00:07:16.081 INFO:tasks.workunit.client.0.smithi111.stdout:9/455: fsync d6/db/d1b/d56/f6b 0 2024-09-11T00:07:16.083 INFO:tasks.workunit.client.1.smithi203.stdout:2/395: truncate d13/d22/f4e 5057564 0 2024-09-11T00:07:16.085 INFO:tasks.workunit.client.1.smithi203.stdout:9/435: dwrite d6/f14 [0,4194304] 0 2024-09-11T00:07:16.086 INFO:tasks.workunit.client.1.smithi203.stdout:3/533: write d8/f59 [1047078,92285] 0 2024-09-11T00:07:16.086 INFO:tasks.workunit.client.0.smithi111.stdout:9/456: write d6/db/d34/d37/f3f [515707,26757] 0 2024-09-11T00:07:16.088 INFO:tasks.workunit.client.0.smithi111.stdout:5/429: read d10/f1b [497490,215] 0 2024-09-11T00:07:16.089 INFO:tasks.workunit.client.0.smithi111.stdout:0/450: dread d3/d13/f17 [0,4194304] 0 2024-09-11T00:07:16.093 INFO:tasks.workunit.client.0.smithi111.stdout:7/421: dread dd/d48/f5f [0,4194304] 0 2024-09-11T00:07:16.094 INFO:tasks.workunit.client.0.smithi111.stdout:1/383: link d2/de/d12/d3c/d4b/d6a/d3a/f3b d2/de/d82/f86 0 2024-09-11T00:07:16.094 INFO:tasks.workunit.client.1.smithi203.stdout:9/436: rmdir d6/de/d19/d24 39 2024-09-11T00:07:16.096 INFO:tasks.workunit.client.1.smithi203.stdout:9/437: read d6/de/d32/d52/d44/f79 [925336,125899] 0 2024-09-11T00:07:16.097 INFO:tasks.workunit.client.1.smithi203.stdout:3/534: creat d8/da/d37/d53/d63/fbf x:0 0 0 2024-09-11T00:07:16.098 INFO:tasks.workunit.client.1.smithi203.stdout:9/438: dread - d6/de/d19/f7a zero size 2024-09-11T00:07:16.099 INFO:tasks.workunit.client.0.smithi111.stdout:4/395: creat d18/f81 x:0 0 0 2024-09-11T00:07:16.100 INFO:tasks.workunit.client.1.smithi203.stdout:6/407: truncate d0/d32/f5e 27401 0 2024-09-11T00:07:16.100 INFO:tasks.workunit.client.1.smithi203.stdout:3/535: write d8/da/db3/f4d [3761628,118634] 0 2024-09-11T00:07:16.100 INFO:tasks.workunit.client.0.smithi111.stdout:7/422: chown dd/d1d/d2d/d68/d79/c7d 4040 1 2024-09-11T00:07:16.101 INFO:tasks.workunit.client.1.smithi203.stdout:2/396: mknod d13/d15/d19/d1c/d76/c7d 0 2024-09-11T00:07:16.101 INFO:tasks.workunit.client.0.smithi111.stdout:4/396: chown cf 1 1 2024-09-11T00:07:16.101 INFO:tasks.workunit.client.1.smithi203.stdout:1/491: write d8/d19/d60/d90/d3e/d9b/fa8 [240667,29108] 0 2024-09-11T00:07:16.103 INFO:tasks.workunit.client.0.smithi111.stdout:9/457: readlink d6/db/d34/l8b 0 2024-09-11T00:07:16.110 INFO:tasks.workunit.client.0.smithi111.stdout:5/430: symlink d10/d1e/d23/d2b/d55/l8c 0 2024-09-11T00:07:16.114 INFO:tasks.workunit.client.1.smithi203.stdout:2/397: rmdir d13/d22 39 2024-09-11T00:07:16.115 INFO:tasks.workunit.client.0.smithi111.stdout:6/363: truncate d7/d2b/d35/f57 1839751 0 2024-09-11T00:07:16.116 INFO:tasks.workunit.client.1.smithi203.stdout:2/398: chown d13/d15/f65 0 1 2024-09-11T00:07:16.117 INFO:tasks.workunit.client.1.smithi203.stdout:2/399: write f8 [1895263,68048] 0 2024-09-11T00:07:16.117 INFO:tasks.workunit.client.1.smithi203.stdout:1/492: mknod d8/d19/d60/d90/d3e/d4b/d80/d8d/cab 0 2024-09-11T00:07:16.120 INFO:tasks.workunit.client.0.smithi111.stdout:8/475: dwrite d11/d23/d3d/f94 [0,4194304] 0 2024-09-11T00:07:16.122 INFO:tasks.workunit.client.1.smithi203.stdout:1/493: write d8/d19/d60/d90/d3e/d4b/d3a/f9f [882861,17189] 0 2024-09-11T00:07:16.127 INFO:tasks.workunit.client.1.smithi203.stdout:1/494: write d8/d19/d60/d90/d3e/d4b/d41/f8a [657890,80416] 0 2024-09-11T00:07:16.127 INFO:tasks.workunit.client.1.smithi203.stdout:9/439: unlink d6/de/d19/d24/d40/d45/l58 0 2024-09-11T00:07:16.129 INFO:tasks.workunit.client.0.smithi111.stdout:9/458: rename d6/db/d34/d37/d4c/l60 to d6/d52/d8a/l9b 0 2024-09-11T00:07:16.130 INFO:tasks.workunit.client.1.smithi203.stdout:9/440: write d6/de/d32/d52/f73 [197228,18121] 0 2024-09-11T00:07:16.133 INFO:tasks.workunit.client.1.smithi203.stdout:6/408: creat d0/d27/d35/d38/d7d/f7f x:0 0 0 2024-09-11T00:07:16.136 INFO:tasks.workunit.client.0.smithi111.stdout:2/417: truncate d0/d3/f37 1778118 0 2024-09-11T00:07:16.136 INFO:tasks.workunit.client.1.smithi203.stdout:2/400: rmdir d13/d47 39 2024-09-11T00:07:16.140 INFO:tasks.workunit.client.0.smithi111.stdout:9/459: read - d6/db/d34/f45 zero size 2024-09-11T00:07:16.141 INFO:tasks.workunit.client.1.smithi203.stdout:9/441: chown d6/cd 194859 1 2024-09-11T00:07:16.143 INFO:tasks.workunit.client.0.smithi111.stdout:0/451: dwrite d3/dc/f12 [0,4194304] 0 2024-09-11T00:07:16.144 INFO:tasks.workunit.client.1.smithi203.stdout:1/495: fsync d8/d19/d60/d90/f53 0 2024-09-11T00:07:16.146 INFO:tasks.workunit.client.1.smithi203.stdout:3/536: getdents d8/da/d37/d83/d65 0 2024-09-11T00:07:16.146 INFO:tasks.workunit.client.1.smithi203.stdout:9/442: mknod d6/de/d19/d5b/c89 0 2024-09-11T00:07:16.147 INFO:tasks.workunit.client.1.smithi203.stdout:1/496: fdatasync d8/d19/d60/d90/d3e/d66/f6e 0 2024-09-11T00:07:16.148 INFO:tasks.workunit.client.1.smithi203.stdout:2/401: fdatasync d13/d15/d19/d1c/f2d 0 2024-09-11T00:07:16.149 INFO:tasks.workunit.client.0.smithi111.stdout:0/452: chown d3/d74/f7d 17769 1 2024-09-11T00:07:16.149 INFO:tasks.workunit.client.0.smithi111.stdout:4/397: dwrite d18/d1f/f25 [0,4194304] 0 2024-09-11T00:07:16.150 INFO:tasks.workunit.client.1.smithi203.stdout:6/409: read d0/d27/d35/f3f [635457,50205] 0 2024-09-11T00:07:16.152 INFO:tasks.workunit.client.0.smithi111.stdout:2/418: creat d0/d3/d12/f96 x:0 0 0 2024-09-11T00:07:16.152 INFO:tasks.workunit.client.0.smithi111.stdout:5/431: dread d10/d1e/d23/d26/d3a/f4b [0,4194304] 0 2024-09-11T00:07:16.153 INFO:tasks.workunit.client.1.smithi203.stdout:9/443: truncate d6/de/d32/d52/f73 1144136 0 2024-09-11T00:07:16.153 INFO:tasks.workunit.client.0.smithi111.stdout:0/453: dread - d3/d74/f7d zero size 2024-09-11T00:07:16.153 INFO:tasks.workunit.client.0.smithi111.stdout:3/459: truncate d1c/d1d/d22/f70 3422320 0 2024-09-11T00:07:16.154 INFO:tasks.workunit.client.1.smithi203.stdout:9/444: readlink d6/de/d32/d52/d55/l7e 0 2024-09-11T00:07:16.164 INFO:tasks.workunit.client.0.smithi111.stdout:0/454: readlink d3/dc/l5e 0 2024-09-11T00:07:16.164 INFO:tasks.workunit.client.1.smithi203.stdout:6/410: creat d0/d27/d35/d38/d73/d74/f80 x:0 0 0 2024-09-11T00:07:16.169 INFO:tasks.workunit.client.1.smithi203.stdout:8/426: sync 2024-09-11T00:07:16.169 INFO:tasks.workunit.client.1.smithi203.stdout:9/445: symlink d6/de/d47/l8a 0 2024-09-11T00:07:16.172 INFO:tasks.workunit.client.0.smithi111.stdout:5/432: unlink d10/d1e/d23/d30/f64 0 2024-09-11T00:07:16.172 INFO:tasks.workunit.client.1.smithi203.stdout:3/537: mkdir d8/da/d37/d83/dc0 0 2024-09-11T00:07:16.175 INFO:tasks.workunit.client.0.smithi111.stdout:6/364: dwrite d7/d22/d3f/f54 [0,4194304] 0 2024-09-11T00:07:16.178 INFO:tasks.workunit.client.1.smithi203.stdout:2/402: write d13/d22/f6e [923658,47582] 0 2024-09-11T00:07:16.181 INFO:tasks.workunit.client.0.smithi111.stdout:1/384: truncate d2/de/d12/d3c/d4b/d6a/d3a/f70 472681 0 2024-09-11T00:07:16.181 INFO:tasks.workunit.client.1.smithi203.stdout:1/497: mkdir d8/d19/d60/d90/d3e/d4b/d80/d91/dac 0 2024-09-11T00:07:16.185 INFO:tasks.workunit.client.0.smithi111.stdout:0/455: creat d3/d13/d66/fa0 x:0 0 0 2024-09-11T00:07:16.186 INFO:tasks.workunit.client.0.smithi111.stdout:8/476: truncate d11/d23/d2c/d46/d64/f76 981612 0 2024-09-11T00:07:16.187 INFO:tasks.workunit.client.1.smithi203.stdout:6/411: dwrite d0/d27/d35/f3e [0,4194304] 0 2024-09-11T00:07:16.187 INFO:tasks.workunit.client.0.smithi111.stdout:0/456: stat d3/c4 0 2024-09-11T00:07:16.187 INFO:tasks.workunit.client.0.smithi111.stdout:8/477: chown d11/d21 9154 1 2024-09-11T00:07:16.189 INFO:tasks.workunit.client.0.smithi111.stdout:5/433: fdatasync d10/f13 0 2024-09-11T00:07:16.192 INFO:tasks.workunit.client.0.smithi111.stdout:8/478: chown d11/d21/d38/d54/l6e 79933 1 2024-09-11T00:07:16.196 INFO:tasks.workunit.client.0.smithi111.stdout:7/423: dwrite f8 [0,4194304] 0 2024-09-11T00:07:16.197 INFO:tasks.workunit.client.1.smithi203.stdout:2/403: fsync d13/d47/f54 0 2024-09-11T00:07:16.197 INFO:tasks.workunit.client.1.smithi203.stdout:2/404: dread - d13/d15/f55 zero size 2024-09-11T00:07:16.197 INFO:tasks.workunit.client.0.smithi111.stdout:7/424: readlink dd/d1d/d1f/l55 0 2024-09-11T00:07:16.198 INFO:tasks.workunit.client.0.smithi111.stdout:2/419: rename d0/d3/d12/d52/d65 to d0/d3/de/d3b/d97 0 2024-09-11T00:07:16.201 INFO:tasks.workunit.client.1.smithi203.stdout:1/498: mknod d8/d11/cad 0 2024-09-11T00:07:16.203 INFO:tasks.workunit.client.0.smithi111.stdout:9/460: getdents d6/dc/d7c 0 2024-09-11T00:07:16.205 INFO:tasks.workunit.client.1.smithi203.stdout:3/538: symlink d8/da/d37/d83/dc0/lc1 0 2024-09-11T00:07:16.207 INFO:tasks.workunit.client.1.smithi203.stdout:3/539: write d8/da/d37/d83/d65/f66 [704320,16860] 0 2024-09-11T00:07:16.208 INFO:tasks.workunit.client.1.smithi203.stdout:6/412: mknod d0/d27/d35/d39/c81 0 2024-09-11T00:07:16.209 INFO:tasks.workunit.client.1.smithi203.stdout:3/540: write d8/da/d5c/fba [907388,94625] 0 2024-09-11T00:07:16.209 INFO:tasks.workunit.client.0.smithi111.stdout:6/365: unlink d7/d22/d1d/f21 0 2024-09-11T00:07:16.212 INFO:tasks.workunit.client.0.smithi111.stdout:1/385: mkdir d2/d2b/d2c/d56/d7b/d87 0 2024-09-11T00:07:16.215 INFO:tasks.workunit.client.0.smithi111.stdout:1/386: chown d2/d2b/f75 164 1 2024-09-11T00:07:16.218 INFO:tasks.workunit.client.1.smithi203.stdout:2/405: creat d13/d15/d30/d5a/f7e x:0 0 0 2024-09-11T00:07:16.220 INFO:tasks.workunit.client.1.smithi203.stdout:1/499: creat d8/d11/fae x:0 0 0 2024-09-11T00:07:16.222 INFO:tasks.workunit.client.1.smithi203.stdout:7/417: sync 2024-09-11T00:07:16.222 INFO:tasks.workunit.client.1.smithi203.stdout:5/511: sync 2024-09-11T00:07:16.223 INFO:tasks.workunit.client.1.smithi203.stdout:0/444: sync 2024-09-11T00:07:16.223 INFO:tasks.workunit.client.1.smithi203.stdout:4/412: sync 2024-09-11T00:07:16.224 INFO:tasks.workunit.client.0.smithi111.stdout:4/398: link d18/c1a d18/d20/d3c/d5e/c82 0 2024-09-11T00:07:16.227 INFO:tasks.workunit.client.0.smithi111.stdout:5/434: dwrite d10/d1e/d23/d30/d3c/d60/d7e/d47/d66/f67 [4194304,4194304] 0 2024-09-11T00:07:16.228 INFO:tasks.workunit.client.0.smithi111.stdout:4/399: write d18/f81 [213425,3013] 0 2024-09-11T00:07:16.228 INFO:tasks.workunit.client.0.smithi111.stdout:0/457: creat d3/d13/d1e/d29/d49/d51/d61/d93/fa1 x:0 0 0 2024-09-11T00:07:16.231 INFO:tasks.workunit.client.0.smithi111.stdout:5/435: fsync d10/f19 0 2024-09-11T00:07:16.234 INFO:tasks.workunit.client.1.smithi203.stdout:2/406: symlink d13/d22/d53/l7f 0 2024-09-11T00:07:16.236 INFO:tasks.workunit.client.0.smithi111.stdout:7/425: creat dd/d1d/d2d/f86 x:0 0 0 2024-09-11T00:07:16.237 INFO:tasks.workunit.client.1.smithi203.stdout:2/407: chown d13/d15/d19/d1c/d76 44 1 2024-09-11T00:07:16.237 INFO:tasks.workunit.client.1.smithi203.stdout:9/446: getdents d6/de/d32 0 2024-09-11T00:07:16.239 INFO:tasks.workunit.client.1.smithi203.stdout:0/445: creat d0/f8c x:0 0 0 2024-09-11T00:07:16.242 INFO:tasks.workunit.client.1.smithi203.stdout:4/413: unlink db/l7a 0 2024-09-11T00:07:16.243 INFO:tasks.workunit.client.0.smithi111.stdout:6/366: mkdir d7/d2b/d35/d41/d77 0 2024-09-11T00:07:16.244 INFO:tasks.workunit.client.1.smithi203.stdout:5/512: rmdir dc/dd/d4d/d59 39 2024-09-11T00:07:16.245 INFO:tasks.workunit.client.0.smithi111.stdout:9/461: truncate d6/db/d34/f45 870205 0 2024-09-11T00:07:16.247 INFO:tasks.workunit.client.1.smithi203.stdout:9/447: read d6/de/d19/d30/f51 [551716,29640] 0 2024-09-11T00:07:16.249 INFO:tasks.workunit.client.0.smithi111.stdout:9/462: stat d6/dc/d7c/l94 0 2024-09-11T00:07:16.250 INFO:tasks.workunit.client.0.smithi111.stdout:6/367: fdatasync d7/d22/d2c/d38/f4c 0 2024-09-11T00:07:16.251 INFO:tasks.workunit.client.0.smithi111.stdout:2/420: rmdir d0/d3/de/d3b/d97 39 2024-09-11T00:07:16.252 INFO:tasks.workunit.client.1.smithi203.stdout:9/448: stat d6/de/f74 0 2024-09-11T00:07:16.252 INFO:tasks.workunit.client.1.smithi203.stdout:6/413: unlink d0/f4 0 2024-09-11T00:07:16.252 INFO:tasks.workunit.client.0.smithi111.stdout:3/460: getdents d1c/d1d/d22/d44/d5a/d74 0 2024-09-11T00:07:16.255 INFO:tasks.workunit.client.0.smithi111.stdout:9/463: write d6/db/d34/d37/d4c/d7f/f96 [862073,82010] 0 2024-09-11T00:07:16.256 INFO:tasks.workunit.client.0.smithi111.stdout:4/400: rmdir d18/d3b 39 2024-09-11T00:07:16.257 INFO:tasks.workunit.client.1.smithi203.stdout:8/427: truncate d1/d13/d3a/d75/f82 1761069 0 2024-09-11T00:07:16.261 INFO:tasks.workunit.client.0.smithi111.stdout:0/458: dwrite d3/d26/d77/f86 [0,4194304] 0 2024-09-11T00:07:16.262 INFO:tasks.workunit.client.0.smithi111.stdout:5/436: mkdir d10/d8d 0 2024-09-11T00:07:16.264 INFO:tasks.workunit.client.0.smithi111.stdout:0/459: chown d3/d1c/d50/c64 9 1 2024-09-11T00:07:16.266 INFO:tasks.workunit.client.1.smithi203.stdout:5/513: symlink dc/d65/la9 0 2024-09-11T00:07:16.267 INFO:tasks.workunit.client.0.smithi111.stdout:1/387: mkdir d2/de/d12/d88 0 2024-09-11T00:07:16.269 INFO:tasks.workunit.client.1.smithi203.stdout:5/514: write dc/dd/d15/d3b/d7a/f9a [815081,112755] 0 2024-09-11T00:07:16.273 INFO:tasks.workunit.client.1.smithi203.stdout:8/428: dwrite d1/fc [4194304,4194304] 0 2024-09-11T00:07:16.281 INFO:tasks.workunit.client.1.smithi203.stdout:3/541: creat d8/da/d37/d83/fc2 x:0 0 0 2024-09-11T00:07:16.286 INFO:tasks.workunit.client.1.smithi203.stdout:0/446: mkdir d0/d2/d67/d8d 0 2024-09-11T00:07:16.288 INFO:tasks.workunit.client.1.smithi203.stdout:0/447: stat d0/d2/d37/d5b/d73/l7d 0 2024-09-11T00:07:16.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:16 smithi203 ceph-mon[33225]: Checking for cert/key for grafana.smithi111 2024-09-11T00:07:16.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:16 smithi203 ceph-mon[33225]: Migrating grafana.smithi111 cert to cert store 2024-09-11T00:07:16.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:16 smithi203 ceph-mon[33225]: Migrating grafana.smithi111 key to cert store 2024-09-11T00:07:16.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:16 smithi203 ceph-mon[33225]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-11T00:07:16.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:16 smithi203 ceph-mon[33225]: pgmap v4: 65 pgs: 65 active+clean; 1.4 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2024-09-11T00:07:16.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:16 smithi203 ceph-mon[33225]: Deploying cephadm binary to smithi111 2024-09-11T00:07:16.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:16 smithi203 ceph-mon[33225]: [11/Sep/2024:00:07:12] ENGINE Bus STARTING 2024-09-11T00:07:16.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:16 smithi203 ceph-mon[33225]: Deploying cephadm binary to smithi203 2024-09-11T00:07:16.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:16 smithi203 ceph-mon[33225]: [11/Sep/2024:00:07:12] ENGINE Serving on http://172.21.15.203:8765 2024-09-11T00:07:16.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:16 smithi203 ceph-mon[33225]: [11/Sep/2024:00:07:12] ENGINE Serving on https://172.21.15.203:7150 2024-09-11T00:07:16.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:16 smithi203 ceph-mon[33225]: [11/Sep/2024:00:07:12] ENGINE Bus STARTED 2024-09-11T00:07:16.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:16 smithi203 ceph-mon[33225]: [11/Sep/2024:00:07:12] ENGINE Error in HTTPServer.serve 2024-09-11T00:07:16.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Traceback (most recent call last): 2024-09-11T00:07:16.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T00:07:16.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: self._connections.run(self.expiration_interval) 2024-09-11T00:07:16.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T00:07:16.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: self._run(expiration_interval) 2024-09-11T00:07:16.298 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T00:07:16.298 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T00:07:16.298 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T00:07:16.298 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T00:07:16.298 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T00:07:16.298 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: s = self.context.wrap_socket( 2024-09-11T00:07:16.298 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T00:07:16.298 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: return self.sslsocket_class._create( 2024-09-11T00:07:16.298 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T00:07:16.298 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: self.do_handshake() 2024-09-11T00:07:16.298 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T00:07:16.299 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: self._sslobj.do_handshake() 2024-09-11T00:07:16.299 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T00:07:16.299 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:16 smithi203 ceph-mon[33225]: pgmap v5: 65 pgs: 65 active+clean; 1.4 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2024-09-11T00:07:16.299 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:16 smithi203 ceph-mon[33225]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:07:16.299 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:16 smithi203 ceph-mon[33225]: pgmap v6: 65 pgs: 65 active+clean; 1.5 GiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 7.1 MiB/s rd, 23 MiB/s wr, 83 op/s 2024-09-11T00:07:16.299 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:16 smithi203 ceph-mon[33225]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:07:16.300 INFO:tasks.workunit.client.1.smithi203.stdout:1/500: truncate d8/d19/d31/f9d 30065 0 2024-09-11T00:07:16.300 INFO:tasks.workunit.client.1.smithi203.stdout:7/418: mknod dd/d1c/d52/d8f/d31/d4a/c9e 0 2024-09-11T00:07:16.304 INFO:tasks.workunit.client.0.smithi111.stdout:9/464: creat d6/dc/d7c/f9c x:0 0 0 2024-09-11T00:07:16.308 INFO:tasks.workunit.client.1.smithi203.stdout:2/408: dread d13/d15/f23 [0,4194304] 0 2024-09-11T00:07:16.309 INFO:tasks.workunit.client.0.smithi111.stdout:5/437: unlink d10/d1e/d23/d2b/d55/l8c 0 2024-09-11T00:07:16.312 INFO:tasks.workunit.client.1.smithi203.stdout:5/515: fdatasync dc/d4f/d5c/f66 0 2024-09-11T00:07:16.316 INFO:tasks.workunit.client.1.smithi203.stdout:6/414: mkdir d0/d27/d35/d38/d7d/d82 0 2024-09-11T00:07:16.317 INFO:tasks.workunit.client.0.smithi111.stdout:2/421: mkdir d0/d3/d98 0 2024-09-11T00:07:16.319 INFO:tasks.workunit.client.0.smithi111.stdout:8/479: getdents d11/d21/d38 0 2024-09-11T00:07:16.322 INFO:tasks.workunit.client.1.smithi203.stdout:1/501: dwrite d8/d19/d60/d90/d3e/d4b/d41/f9a [0,4194304] 0 2024-09-11T00:07:16.322 INFO:tasks.workunit.client.1.smithi203.stdout:0/448: mknod d0/d2/d7e/c8e 0 2024-09-11T00:07:16.325 INFO:tasks.workunit.client.0.smithi111.stdout:4/401: unlink d18/d3b/c49 0 2024-09-11T00:07:16.325 INFO:tasks.workunit.client.1.smithi203.stdout:7/419: mkdir dd/d3b/d9f 0 2024-09-11T00:07:16.328 INFO:tasks.workunit.client.1.smithi203.stdout:4/414: rmdir db/dd/d26/d42/d7c 0 2024-09-11T00:07:16.330 INFO:tasks.workunit.client.1.smithi203.stdout:8/429: dread d1/d13/d22/f58 [0,4194304] 0 2024-09-11T00:07:16.332 INFO:tasks.workunit.client.1.smithi203.stdout:8/430: write d1/d13/d17/d2f/d52/d59/f6e [423290,95729] 0 2024-09-11T00:07:16.338 INFO:tasks.workunit.client.0.smithi111.stdout:9/465: stat d6/l8 0 2024-09-11T00:07:16.340 INFO:tasks.workunit.client.0.smithi111.stdout:5/438: unlink d10/d1e/d23/d30/l49 0 2024-09-11T00:07:16.341 INFO:tasks.workunit.client.1.smithi203.stdout:2/409: rename d13/d15/d19/d1c/f40 to d13/d15/d30/d59/f80 0 2024-09-11T00:07:16.349 INFO:tasks.workunit.client.1.smithi203.stdout:2/410: chown d13/d15/d30/d5a/l60 904712 1 2024-09-11T00:07:16.351 INFO:tasks.workunit.client.1.smithi203.stdout:3/542: mknod d8/da/d37/d83/d6a/dad/cc3 0 2024-09-11T00:07:16.352 INFO:tasks.workunit.client.0.smithi111.stdout:3/461: creat d1c/d1d/d22/f9b x:0 0 0 2024-09-11T00:07:16.354 INFO:tasks.workunit.client.1.smithi203.stdout:0/449: truncate d0/d2/fb 2099747 0 2024-09-11T00:07:16.355 INFO:tasks.workunit.client.0.smithi111.stdout:6/368: link d7/d22/d2c/d38/c4f d7/d4d/d61/c78 0 2024-09-11T00:07:16.357 INFO:tasks.workunit.client.0.smithi111.stdout:7/426: getdents dd/d48/d69 0 2024-09-11T00:07:16.357 INFO:tasks.workunit.client.1.smithi203.stdout:7/420: dread - dd/d1c/d52/d8f/d31/d58/d93/f9b zero size 2024-09-11T00:07:16.358 INFO:tasks.workunit.client.0.smithi111.stdout:0/460: link d3/d13/d1e/f4d d3/d13/d1e/d29/d70/fa2 0 2024-09-11T00:07:16.360 INFO:tasks.workunit.client.1.smithi203.stdout:8/431: dwrite d1/d13/d17/d2f/f84 [0,4194304] 0 2024-09-11T00:07:16.363 INFO:tasks.workunit.client.1.smithi203.stdout:5/516: dwrite dc/dd/d1e/f29 [4194304,4194304] 0 2024-09-11T00:07:16.365 INFO:tasks.workunit.client.1.smithi203.stdout:7/421: write dd/d1c/d52/d8f/d31/d58/f64 [4457087,14698] 0 2024-09-11T00:07:16.365 INFO:tasks.workunit.client.0.smithi111.stdout:2/422: mkdir d0/d3/de/d3b/d99 0 2024-09-11T00:07:16.369 INFO:tasks.workunit.client.0.smithi111.stdout:5/439: dwrite d10/d1e/d23/f81 [0,4194304] 0 2024-09-11T00:07:16.370 INFO:tasks.workunit.client.0.smithi111.stdout:9/466: dwrite d6/db/d34/f71 [0,4194304] 0 2024-09-11T00:07:16.385 INFO:tasks.workunit.client.0.smithi111.stdout:1/388: getdents d2/de/d12/d3c/d4b/d6a 0 2024-09-11T00:07:16.385 INFO:tasks.workunit.client.0.smithi111.stdout:5/440: write d10/d1e/d23/d2b/d2f/f3f [1148773,63391] 0 2024-09-11T00:07:16.389 INFO:tasks.workunit.client.0.smithi111.stdout:8/480: creat d11/d23/f98 x:0 0 0 2024-09-11T00:07:16.390 INFO:tasks.workunit.client.0.smithi111.stdout:2/423: rmdir d0/d3/de/d3b 39 2024-09-11T00:07:16.393 INFO:tasks.workunit.client.0.smithi111.stdout:2/424: fdatasync d0/f72 0 2024-09-11T00:07:16.393 INFO:tasks.workunit.client.0.smithi111.stdout:0/461: symlink d3/d13/d1e/d29/d49/la3 0 2024-09-11T00:07:16.393 INFO:tasks.workunit.client.0.smithi111.stdout:1/389: stat d2/d2b/d2c/f5f 0 2024-09-11T00:07:16.402 INFO:tasks.workunit.client.0.smithi111.stdout:4/402: write d18/f32 [93267,35590] 0 2024-09-11T00:07:16.402 INFO:tasks.workunit.client.0.smithi111.stdout:6/369: mkdir d7/d4d/d79 0 2024-09-11T00:07:16.402 INFO:tasks.workunit.client.0.smithi111.stdout:4/403: readlink d18/d20/d3c/d5e/l73 0 2024-09-11T00:07:16.403 INFO:tasks.workunit.client.0.smithi111.stdout:8/481: mkdir d11/d23/d3d/d5f/d99 0 2024-09-11T00:07:16.405 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:16 smithi111 ceph-mon[27539]: Checking for cert/key for grafana.smithi111 2024-09-11T00:07:16.405 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:16 smithi111 ceph-mon[27539]: Migrating grafana.smithi111 cert to cert store 2024-09-11T00:07:16.405 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:16 smithi111 ceph-mon[27539]: Migrating grafana.smithi111 key to cert store 2024-09-11T00:07:16.406 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:16 smithi111 ceph-mon[27539]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-11T00:07:16.406 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:16 smithi111 ceph-mon[27539]: pgmap v4: 65 pgs: 65 active+clean; 1.4 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2024-09-11T00:07:16.406 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:16 smithi111 ceph-mon[27539]: Deploying cephadm binary to smithi111 2024-09-11T00:07:16.406 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:16 smithi111 ceph-mon[27539]: [11/Sep/2024:00:07:12] ENGINE Bus STARTING 2024-09-11T00:07:16.406 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:16 smithi111 ceph-mon[27539]: Deploying cephadm binary to smithi203 2024-09-11T00:07:16.406 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:16 smithi111 ceph-mon[27539]: [11/Sep/2024:00:07:12] ENGINE Serving on http://172.21.15.203:8765 2024-09-11T00:07:16.406 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:16 smithi111 ceph-mon[27539]: [11/Sep/2024:00:07:12] ENGINE Serving on https://172.21.15.203:7150 2024-09-11T00:07:16.406 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:16 smithi111 ceph-mon[27539]: [11/Sep/2024:00:07:12] ENGINE Bus STARTED 2024-09-11T00:07:16.406 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:16 smithi111 ceph-mon[27539]: [11/Sep/2024:00:07:12] ENGINE Error in HTTPServer.serve 2024-09-11T00:07:16.406 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Traceback (most recent call last): 2024-09-11T00:07:16.406 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T00:07:16.407 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self._connections.run(self.expiration_interval) 2024-09-11T00:07:16.407 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T00:07:16.407 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self._run(expiration_interval) 2024-09-11T00:07:16.407 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T00:07:16.407 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T00:07:16.407 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T00:07:16.407 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T00:07:16.407 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T00:07:16.407 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: s = self.context.wrap_socket( 2024-09-11T00:07:16.407 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T00:07:16.407 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: return self.sslsocket_class._create( 2024-09-11T00:07:16.407 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T00:07:16.407 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self.do_handshake() 2024-09-11T00:07:16.408 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T00:07:16.408 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self._sslobj.do_handshake() 2024-09-11T00:07:16.408 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T00:07:16.408 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:16 smithi111 ceph-mon[27539]: pgmap v5: 65 pgs: 65 active+clean; 1.4 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail 2024-09-11T00:07:16.408 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:16 smithi111 ceph-mon[27539]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:07:16.408 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:16 smithi111 ceph-mon[27539]: pgmap v6: 65 pgs: 65 active+clean; 1.5 GiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 7.1 MiB/s rd, 23 MiB/s wr, 83 op/s 2024-09-11T00:07:16.408 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:16 smithi111 ceph-mon[27539]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:07:16.409 INFO:tasks.workunit.client.0.smithi111.stdout:2/425: unlink d0/d3/c30 0 2024-09-11T00:07:16.409 INFO:tasks.workunit.client.0.smithi111.stdout:0/462: creat d3/da/d7b/fa4 x:0 0 0 2024-09-11T00:07:16.409 INFO:tasks.workunit.client.1.smithi203.stdout:9/449: getdents d6/de/d32/d52/d55/d66/d80 0 2024-09-11T00:07:16.411 INFO:tasks.workunit.client.0.smithi111.stdout:5/441: creat d10/d1e/d23/d2b/d5c/f8e x:0 0 0 2024-09-11T00:07:16.411 INFO:tasks.workunit.client.0.smithi111.stdout:8/482: truncate d11/d23/d2c/d53/f83 165399 0 2024-09-11T00:07:16.411 INFO:tasks.workunit.client.0.smithi111.stdout:4/404: creat d18/d1f/d33/f83 x:0 0 0 2024-09-11T00:07:16.413 INFO:tasks.workunit.client.1.smithi203.stdout:0/450: creat d0/d2/d7e/f8f x:0 0 0 2024-09-11T00:07:16.415 INFO:tasks.workunit.client.1.smithi203.stdout:3/543: truncate d8/da/db3/f35 1556297 0 2024-09-11T00:07:16.418 INFO:tasks.workunit.client.1.smithi203.stdout:8/432: readlink d1/d13/d17/l2b 0 2024-09-11T00:07:16.420 INFO:tasks.workunit.client.1.smithi203.stdout:5/517: mknod dc/d2b/caa 0 2024-09-11T00:07:16.420 INFO:tasks.workunit.client.0.smithi111.stdout:0/463: creat d3/dc/fa5 x:0 0 0 2024-09-11T00:07:16.423 INFO:tasks.workunit.client.0.smithi111.stdout:0/464: stat d3/d13/d1e/d29/d70 0 2024-09-11T00:07:16.424 INFO:tasks.workunit.client.0.smithi111.stdout:4/405: fsync d18/d20/d4a/f64 0 2024-09-11T00:07:16.425 INFO:tasks.workunit.client.0.smithi111.stdout:8/483: rename d11/f20 to d11/d21/f9a 0 2024-09-11T00:07:16.426 INFO:tasks.workunit.client.0.smithi111.stdout:7/427: dwrite dd/d1d/d2d/d2e/f70 [0,4194304] 0 2024-09-11T00:07:16.426 INFO:tasks.workunit.client.0.smithi111.stdout:5/442: mknod d10/d1e/d23/d2b/d5c/c8f 0 2024-09-11T00:07:16.429 INFO:tasks.workunit.client.1.smithi203.stdout:1/502: creat d8/faf x:0 0 0 2024-09-11T00:07:16.431 INFO:tasks.workunit.client.1.smithi203.stdout:9/450: stat d6/de/d19/d24/d40/d45/l83 0 2024-09-11T00:07:16.431 INFO:tasks.workunit.client.0.smithi111.stdout:4/406: read d18/d20/d4a/f2c [7629654,75393] 0 2024-09-11T00:07:16.435 INFO:tasks.workunit.client.1.smithi203.stdout:1/503: truncate d8/d19/d60/d90/d3e/d4b/d3a/fa4 940608 0 2024-09-11T00:07:16.435 INFO:tasks.workunit.client.0.smithi111.stdout:2/426: mknod d0/d3/de/d3b/d62/d6d/c9a 0 2024-09-11T00:07:16.437 INFO:tasks.workunit.client.1.smithi203.stdout:1/504: chown d8/d19/d60/d90/d3e/c3f 6310096 1 2024-09-11T00:07:16.439 INFO:tasks.workunit.client.0.smithi111.stdout:0/465: unlink d3/d13/d1e/f44 0 2024-09-11T00:07:16.439 INFO:tasks.workunit.client.1.smithi203.stdout:9/451: dread d6/de/d32/d52/d44/f5e [0,4194304] 0 2024-09-11T00:07:16.441 INFO:tasks.workunit.client.1.smithi203.stdout:3/544: chown l3 231297 1 2024-09-11T00:07:16.444 INFO:tasks.workunit.client.1.smithi203.stdout:4/415: rename db/dd/l14 to db/d12/d15/d2a/l85 0 2024-09-11T00:07:16.448 INFO:tasks.workunit.client.0.smithi111.stdout:5/443: symlink d10/d1e/d23/d30/d59/d7b/l90 0 2024-09-11T00:07:16.448 INFO:tasks.workunit.client.0.smithi111.stdout:5/444: chown d10/d8d 5100644 1 2024-09-11T00:07:16.448 INFO:tasks.workunit.client.0.smithi111.stdout:6/370: dwrite d7/f6b [0,4194304] 0 2024-09-11T00:07:16.449 INFO:tasks.workunit.client.0.smithi111.stdout:5/445: readlink l8 0 2024-09-11T00:07:16.450 INFO:tasks.workunit.client.1.smithi203.stdout:8/433: creat d1/d13/d17/d2f/d52/f92 x:0 0 0 2024-09-11T00:07:16.452 INFO:tasks.workunit.client.1.smithi203.stdout:7/422: mknod dd/d3b/d9f/ca0 0 2024-09-11T00:07:16.458 INFO:tasks.workunit.client.1.smithi203.stdout:2/411: link d13/d15/f55 d13/d15/d19/d1c/d73/f81 0 2024-09-11T00:07:16.459 INFO:tasks.workunit.client.0.smithi111.stdout:1/390: write d2/d7c/f1a [1730476,115379] 0 2024-09-11T00:07:16.460 INFO:tasks.workunit.client.0.smithi111.stdout:7/428: mknod dd/d1d/d7e/c87 0 2024-09-11T00:07:16.462 INFO:tasks.workunit.client.1.smithi203.stdout:1/505: dwrite d8/d19/d60/d90/d3e/d9b/fa8 [0,4194304] 0 2024-09-11T00:07:16.472 INFO:tasks.workunit.client.0.smithi111.stdout:0/466: dwrite d3/d13/d1e/f7f [0,4194304] 0 2024-09-11T00:07:16.472 INFO:tasks.workunit.client.1.smithi203.stdout:1/506: chown d8/d9/d15/d27/f39 20638909 1 2024-09-11T00:07:16.472 INFO:tasks.workunit.client.1.smithi203.stdout:9/452: unlink d6/de/d19/l12 0 2024-09-11T00:07:16.472 INFO:tasks.workunit.client.1.smithi203.stdout:2/412: read d13/d15/d19/f28 [2849529,4389] 0 2024-09-11T00:07:16.473 INFO:tasks.workunit.client.0.smithi111.stdout:5/446: symlink d10/d1e/d23/d2b/d5c/l91 0 2024-09-11T00:07:16.484 INFO:tasks.workunit.client.1.smithi203.stdout:6/415: truncate d0/d5b/f64 312713 0 2024-09-11T00:07:16.485 INFO:tasks.workunit.client.1.smithi203.stdout:5/518: dread dc/dd/d15/d3b/f47 [0,4194304] 0 2024-09-11T00:07:16.487 INFO:tasks.workunit.client.0.smithi111.stdout:6/371: dwrite f3 [0,4194304] 0 2024-09-11T00:07:16.492 INFO:tasks.workunit.client.1.smithi203.stdout:8/434: rename d1/d13/d17/d77/f8f to d1/d13/d17/d2f/d52/d49/f93 0 2024-09-11T00:07:16.492 INFO:tasks.workunit.client.1.smithi203.stdout:5/519: chown dc/dd/d15/d3b/d7a/f90 443 1 2024-09-11T00:07:16.495 INFO:tasks.workunit.client.1.smithi203.stdout:5/520: chown dc/dd/d15/c5e 965829 1 2024-09-11T00:07:16.499 INFO:tasks.workunit.client.1.smithi203.stdout:1/507: dwrite d8/d11/fae [0,4194304] 0 2024-09-11T00:07:16.500 INFO:tasks.workunit.client.1.smithi203.stdout:7/423: mknod dd/d1c/d52/d8f/d31/d58/d93/ca1 0 2024-09-11T00:07:16.500 INFO:tasks.workunit.client.0.smithi111.stdout:1/391: symlink d2/de/d12/d3c/d4b/l89 0 2024-09-11T00:07:16.502 INFO:tasks.workunit.client.0.smithi111.stdout:1/392: read d2/d2b/d2c/d56/f5b [1394479,65089] 0 2024-09-11T00:07:16.503 INFO:tasks.workunit.client.0.smithi111.stdout:1/393: chown d2/d2b/f75 496871 1 2024-09-11T00:07:16.504 INFO:tasks.workunit.client.1.smithi203.stdout:7/424: readlink dd/d1c/d52/d8f/l28 0 2024-09-11T00:07:16.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.506+0000 7f5671a00700 1 -- 172.21.15.111:0/2663458476 --> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f566c10c2f0 con 0x7f565003f6b0 2024-09-11T00:07:16.509 INFO:tasks.workunit.client.0.smithi111.stdout:0/467: symlink d3/d74/la6 0 2024-09-11T00:07:16.514 INFO:tasks.workunit.client.1.smithi203.stdout:0/451: creat d0/d1d/f90 x:0 0 0 2024-09-11T00:07:16.514 INFO:tasks.workunit.client.0.smithi111.stdout:5/447: unlink d10/d1e/d23/d30/d59/d53/c65 0 2024-09-11T00:07:16.518 INFO:tasks.workunit.client.1.smithi203.stdout:2/413: truncate d13/f41 1440236 0 2024-09-11T00:07:16.519 INFO:tasks.workunit.client.0.smithi111.stdout:6/372: write d7/f15 [1343297,75629] 0 2024-09-11T00:07:16.520 INFO:tasks.workunit.client.0.smithi111.stdout:4/407: truncate d18/d1f/f25 3846117 0 2024-09-11T00:07:16.521 INFO:tasks.workunit.client.0.smithi111.stdout:5/448: dread d10/d1e/d23/d30/d3c/d60/d7e/d47/f58 [0,4194304] 0 2024-09-11T00:07:16.532 INFO:tasks.workunit.client.0.smithi111.stdout:2/427: rename d0/d3/d12/d52/l54 to d0/l9b 0 2024-09-11T00:07:16.534 INFO:tasks.workunit.client.0.smithi111.stdout:2/428: stat d0/d3/d12/l29 0 2024-09-11T00:07:16.535 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:07:16.535 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (8m) 2m ago 10m 13.3M - 0.25.0 c8568f914cd2 eb9e393000ec 2024-09-11T00:07:16.535 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (10m) 2m ago 10m 7453k - 18.2.0 dc2bc1663786 b6e7b6bd4d27 2024-09-11T00:07:16.535 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi203 smithi203 running (9m) 29s ago 9m 7578k - 18.2.0 dc2bc1663786 7bbfd9c27900 2024-09-11T00:07:16.535 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (10m) 2m ago 10m 6665k - 18.2.0 dc2bc1663786 72a36c166ffa 2024-09-11T00:07:16.535 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi203 smithi203 running (9m) 29s ago 9m 6669k - 18.2.0 dc2bc1663786 9b102b6f6d70 2024-09-11T00:07:16.536 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (8m) 2m ago 10m 75.0M - 9.4.7 954c08fa6188 e599624a9c9e 2024-09-11T00:07:16.536 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.gmgsay smithi111 running (3m) 2m ago 3m 11.6M - 18.2.0 dc2bc1663786 795e4ff0075c 2024-09-11T00:07:16.536 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.rucaba smithi111 running (3m) 2m ago 3m 11.6M - 18.2.0 dc2bc1663786 02885adac62c 2024-09-11T00:07:16.536 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.tcrqop smithi203 running (3m) 29s ago 3m 188M - 18.2.0 dc2bc1663786 4df492159bb4 2024-09-11T00:07:16.536 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.uqkbkn smithi203 running (3m) 29s ago 3m 12.9M - 18.2.0 dc2bc1663786 619aa58ea314 2024-09-11T00:07:16.536 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.ypucji smithi111 *:9283,8765,8443 running (12m) 2m ago 12m 488M - 18.2.0 dc2bc1663786 0329ec697a09 2024-09-11T00:07:16.536 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi203.smuspl smithi203 *:8443,9283,8765 running (34s) 29s ago 9m 73.9M - 19.3.0-4854-g8f219c47 589dd18248e4 5c2e09508810 2024-09-11T00:07:16.536 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (12m) 2m ago 12m 44.6M 2048M 18.2.0 dc2bc1663786 2596322539fb 2024-09-11T00:07:16.536 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi203 smithi203 running (9m) 29s ago 9m 35.3M 2048M 18.2.0 dc2bc1663786 ff8eb7ca85ea 2024-09-11T00:07:16.537 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (10m) 2m ago 10m 7604k - 1.5.0 0da6a335fe13 4fd66ebc9c0d 2024-09-11T00:07:16.537 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi203 smithi203 *:9100 running (9m) 29s ago 9m 7650k - 1.5.0 0da6a335fe13 1cb3ca740f4a 2024-09-11T00:07:16.537 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (7m) 2m ago 7m 46.8M 3947M 18.2.0 dc2bc1663786 162b7249a591 2024-09-11T00:07:16.537 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (7m) 2m ago 7m 46.7M 3947M 18.2.0 dc2bc1663786 3614d95b1425 2024-09-11T00:07:16.537 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (6m) 2m ago 6m 45.2M 3947M 18.2.0 dc2bc1663786 db175d4b09b9 2024-09-11T00:07:16.537 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi203 running (6m) 29s ago 6m 91.2M 4971M 18.2.0 dc2bc1663786 60b1cef7a70d 2024-09-11T00:07:16.537 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi203 running (5m) 29s ago 5m 90.2M 4971M 18.2.0 dc2bc1663786 769c7942c42b 2024-09-11T00:07:16.537 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi203 running (5m) 29s ago 5m 86.8M 4971M 18.2.0 dc2bc1663786 6d824001d40c 2024-09-11T00:07:16.537 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (7m) 2m ago 9m 62.5M - 2.43.0 a07b618ecd1d bd707157a41b 2024-09-11T00:07:16.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.532+0000 7f5663400700 1 -- 172.21.15.111:0/2663458476 <== mgr.24469 v2:172.21.15.203:6828/1203435425 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f566c10c2f0 con 0x7f565003f6b0 2024-09-11T00:07:16.538 INFO:tasks.workunit.client.0.smithi111.stdout:2/429: truncate d0/d83/f85 569565 0 2024-09-11T00:07:16.538 INFO:tasks.workunit.client.0.smithi111.stdout:4/408: dread - d18/d39/f53 zero size 2024-09-11T00:07:16.539 INFO:tasks.workunit.client.1.smithi203.stdout:8/435: mkdir d1/d13/d17/d2f/d52/d49/d68/d94 0 2024-09-11T00:07:16.539 INFO:tasks.workunit.client.1.smithi203.stdout:7/425: chown dd/c1d 29978 1 2024-09-11T00:07:16.540 INFO:tasks.workunit.client.1.smithi203.stdout:8/436: dread - d1/d13/d17/d77/f79 zero size 2024-09-11T00:07:16.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.537+0000 7f5671a00700 1 -- 172.21.15.111:0/2663458476 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f565003f6b0 msgr2=0x7f5650041b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:16.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.537+0000 7f5671a00700 1 --2- 172.21.15.111:0/2663458476 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f565003f6b0 0x7f5650041b60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f565c005950 tx=0x7f565c0058e0 comp rx=0 tx=0).stop 2024-09-11T00:07:16.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.537+0000 7f5671a00700 1 -- 172.21.15.111:0/2663458476 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f566c1a4f30 msgr2=0x7f566c112a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:16.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.537+0000 7f5671a00700 1 --2- 172.21.15.111:0/2663458476 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f566c1a4f30 0x7f566c112a80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5654015000 tx=0x7f565400f740 comp rx=0 tx=0).stop 2024-09-11T00:07:16.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.537+0000 7f5671a00700 1 -- 172.21.15.111:0/2663458476 shutdown_connections 2024-09-11T00:07:16.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.537+0000 7f5671a00700 1 --2- 172.21.15.111:0/2663458476 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f565003f6b0 0x7f5650041b60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:16.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.537+0000 7f5671a00700 1 --2- 172.21.15.111:0/2663458476 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f566c1067a0 0x7f566c1a49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:16.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.537+0000 7f5671a00700 1 --2- 172.21.15.111:0/2663458476 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f566c1a4f30 0x7f566c112a80 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5654015000 tx=0x7f565400f740 comp rx=0 tx=0).stop 2024-09-11T00:07:16.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.537+0000 7f5671a00700 1 -- 172.21.15.111:0/2663458476 >> 172.21.15.111:0/2663458476 conn(0x7f566c069ae0 msgr2=0x7f566c10abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:16.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.537+0000 7f5671a00700 1 -- 172.21.15.111:0/2663458476 shutdown_connections 2024-09-11T00:07:16.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.537+0000 7f5671a00700 1 -- 172.21.15.111:0/2663458476 wait complete. 2024-09-11T00:07:16.542 INFO:tasks.workunit.client.0.smithi111.stdout:6/373: read d7/fd [647103,110202] 0 2024-09-11T00:07:16.542 INFO:tasks.workunit.client.0.smithi111.stdout:5/449: mkdir d10/d1e/d23/d2b/d92 0 2024-09-11T00:07:16.542 INFO:tasks.workunit.client.1.smithi203.stdout:4/416: dwrite db/dd/d26/f3f [0,4194304] 0 2024-09-11T00:07:16.546 INFO:tasks.workunit.client.1.smithi203.stdout:1/508: mkdir d8/d19/d60/d90/d3e/d4b/d80/d8d/db0 0 2024-09-11T00:07:16.548 INFO:tasks.workunit.client.0.smithi111.stdout:1/394: rename d2/d2b/d2c/c7e to d2/de/d12/d3c/d4b/d6a/d63/d73/c8a 0 2024-09-11T00:07:16.557 INFO:tasks.workunit.client.0.smithi111.stdout:7/429: truncate dd/d1d/d1f/f5e 2263928 0 2024-09-11T00:07:16.560 INFO:tasks.workunit.client.0.smithi111.stdout:0/468: truncate d3/d1c/f42 1392806 0 2024-09-11T00:07:16.562 INFO:tasks.workunit.client.1.smithi203.stdout:1/509: dwrite d8/d19/fa6 [0,4194304] 0 2024-09-11T00:07:16.572 INFO:tasks.workunit.client.0.smithi111.stdout:1/395: creat d2/d2b/d2c/d56/f8b x:0 0 0 2024-09-11T00:07:16.575 INFO:tasks.workunit.client.0.smithi111.stdout:6/374: mkdir d7/d2b/d35/d7a 0 2024-09-11T00:07:16.579 INFO:tasks.workunit.client.0.smithi111.stdout:4/409: write d18/d20/d3c/f58 [2966998,31515] 0 2024-09-11T00:07:16.583 INFO:tasks.workunit.client.1.smithi203.stdout:7/426: fdatasync dd/d1c/f5f 0 2024-09-11T00:07:16.590 INFO:tasks.workunit.client.1.smithi203.stdout:6/416: truncate d0/d27/d35/f65 148236 0 2024-09-11T00:07:16.591 INFO:tasks.workunit.client.1.smithi203.stdout:8/437: creat d1/d13/d17/d2f/d52/f95 x:0 0 0 2024-09-11T00:07:16.591 INFO:tasks.workunit.client.0.smithi111.stdout:0/469: fsync d3/d1c/f42 0 2024-09-11T00:07:16.591 INFO:tasks.workunit.client.0.smithi111.stdout:7/430: rename dd/d1d/d4d/c75 to dd/d1d/d2d/d2e/c88 0 2024-09-11T00:07:16.601 INFO:tasks.workunit.client.0.smithi111.stdout:4/410: dwrite d18/d3b/f60 [0,4194304] 0 2024-09-11T00:07:16.603 INFO:tasks.workunit.client.0.smithi111.stdout:5/450: dwrite d10/d1e/d23/d26/f34 [0,4194304] 0 2024-09-11T00:07:16.604 INFO:tasks.workunit.client.1.smithi203.stdout:2/414: symlink d13/d56/l82 0 2024-09-11T00:07:16.608 INFO:tasks.workunit.client.1.smithi203.stdout:5/521: truncate dc/d4f/d5c/f77 430954 0 2024-09-11T00:07:16.609 INFO:tasks.workunit.client.0.smithi111.stdout:1/396: dread d2/fd [0,4194304] 0 2024-09-11T00:07:16.613 INFO:tasks.workunit.client.1.smithi203.stdout:2/415: truncate d13/d15/d30/d5a/f7e 45350 0 2024-09-11T00:07:16.614 INFO:tasks.workunit.client.0.smithi111.stdout:0/470: fdatasync d3/d13/f17 0 2024-09-11T00:07:16.614 INFO:tasks.workunit.client.1.smithi203.stdout:9/453: getdents d6/de/d19/d24/d6c 0 2024-09-11T00:07:16.615 INFO:tasks.workunit.client.0.smithi111.stdout:6/375: dread f1 [0,4194304] 0 2024-09-11T00:07:16.615 INFO:tasks.workunit.client.1.smithi203.stdout:2/416: write d13/d15/f1b [1963267,39517] 0 2024-09-11T00:07:16.617 INFO:tasks.workunit.client.0.smithi111.stdout:7/431: creat dd/d1d/d2d/f89 x:0 0 0 2024-09-11T00:07:16.618 INFO:tasks.workunit.client.1.smithi203.stdout:1/510: getdents d8/d19/d60/d90/d3e/d66 0 2024-09-11T00:07:16.624 INFO:tasks.workunit.client.0.smithi111.stdout:3/462: sync 2024-09-11T00:07:16.632 INFO:tasks.workunit.client.1.smithi203.stdout:5/522: dwrite dc/dd/f3d [0,4194304] 0 2024-09-11T00:07:16.634 INFO:tasks.workunit.client.1.smithi203.stdout:2/417: dread d13/d15/f23 [0,4194304] 0 2024-09-11T00:07:16.634 INFO:tasks.workunit.client.1.smithi203.stdout:4/417: dread db/dd/d26/f30 [0,4194304] 0 2024-09-11T00:07:16.639 INFO:tasks.workunit.client.1.smithi203.stdout:1/511: chown d8/d9/d15/d35/d81 475081455 1 2024-09-11T00:07:16.639 INFO:tasks.workunit.client.1.smithi203.stdout:6/417: link d0/d32/l44 d0/d27/d35/d38/d73/d74/l83 0 2024-09-11T00:07:16.639 INFO:tasks.workunit.client.1.smithi203.stdout:2/418: chown d13/d22/d53/c5e 7 1 2024-09-11T00:07:16.640 INFO:tasks.workunit.client.0.smithi111.stdout:6/376: truncate d7/d22/d2c/f46 418512 0 2024-09-11T00:07:16.640 INFO:tasks.workunit.client.1.smithi203.stdout:2/419: chown c12 2214 1 2024-09-11T00:07:16.642 INFO:tasks.workunit.client.0.smithi111.stdout:3/463: dread f5 [4194304,4194304] 0 2024-09-11T00:07:16.644 INFO:tasks.workunit.client.0.smithi111.stdout:0/471: dread d3/d13/d1e/f7f [0,4194304] 0 2024-09-11T00:07:16.647 INFO:tasks.workunit.client.0.smithi111.stdout:6/377: mknod d7/d4d/d61/c7b 0 2024-09-11T00:07:16.648 INFO:tasks.workunit.client.0.smithi111.stdout:7/432: dread dd/d1d/d2d/d2e/f70 [0,4194304] 0 2024-09-11T00:07:16.649 INFO:tasks.workunit.client.1.smithi203.stdout:2/420: symlink d13/d22/d53/l83 0 2024-09-11T00:07:16.650 INFO:tasks.workunit.client.1.smithi203.stdout:5/523: creat dc/dd/d4d/fab x:0 0 0 2024-09-11T00:07:16.650 INFO:tasks.workunit.client.1.smithi203.stdout:4/418: dwrite db/f6c [0,4194304] 0 2024-09-11T00:07:16.654 INFO:tasks.workunit.client.0.smithi111.stdout:6/378: write d7/d22/d2c/d38/f4c [6855699,38159] 0 2024-09-11T00:07:16.655 INFO:tasks.workunit.client.0.smithi111.stdout:3/464: rename f5 to d1c/d1d/d22/d31/d62/f9c 0 2024-09-11T00:07:16.657 INFO:tasks.workunit.client.1.smithi203.stdout:4/419: unlink db/dd/f11 0 2024-09-11T00:07:16.658 INFO:tasks.workunit.client.0.smithi111.stdout:4/411: write d18/d1f/f25 [2265793,92858] 0 2024-09-11T00:07:16.658 INFO:tasks.workunit.client.0.smithi111.stdout:7/433: creat dd/d1d/d2d/d68/d79/f8a x:0 0 0 2024-09-11T00:07:16.661 INFO:tasks.workunit.client.1.smithi203.stdout:2/421: symlink d13/l84 0 2024-09-11T00:07:16.661 INFO:tasks.workunit.client.0.smithi111.stdout:5/451: dwrite d10/d1e/d25/f75 [0,4194304] 0 2024-09-11T00:07:16.662 INFO:tasks.workunit.client.0.smithi111.stdout:5/452: chown d10/d1e/d25 5899 1 2024-09-11T00:07:16.662 INFO:tasks.workunit.client.1.smithi203.stdout:4/420: mknod db/d12/d15/c86 0 2024-09-11T00:07:16.663 INFO:tasks.workunit.client.1.smithi203.stdout:5/524: mkdir dc/dd/d15/dac 0 2024-09-11T00:07:16.664 INFO:tasks.workunit.client.1.smithi203.stdout:1/512: dwrite d8/d19/f26 [0,4194304] 0 2024-09-11T00:07:16.668 INFO:tasks.workunit.client.0.smithi111.stdout:1/397: truncate d2/d2b/f3e 882980 0 2024-09-11T00:07:16.669 INFO:tasks.workunit.client.0.smithi111.stdout:0/472: mkdir d3/d13/d1e/d29/d49/d51/d61/d93/da7 0 2024-09-11T00:07:16.670 INFO:tasks.workunit.client.0.smithi111.stdout:4/412: mknod d18/d3b/d51/c84 0 2024-09-11T00:07:16.670 INFO:tasks.workunit.client.0.smithi111.stdout:6/379: fdatasync d7/d22/d1d/f31 0 2024-09-11T00:07:16.672 INFO:tasks.workunit.client.0.smithi111.stdout:1/398: fdatasync d2/d2b/d2c/d56/f8b 0 2024-09-11T00:07:16.673 INFO:tasks.workunit.client.0.smithi111.stdout:3/465: creat d1c/d1d/d22/d31/d33/d5f/f9d x:0 0 0 2024-09-11T00:07:16.674 INFO:tasks.workunit.client.0.smithi111.stdout:4/413: readlink d18/d20/d4a/l48 0 2024-09-11T00:07:16.674 INFO:tasks.workunit.client.0.smithi111.stdout:5/453: creat d10/d1e/d25/f93 x:0 0 0 2024-09-11T00:07:16.677 INFO:tasks.workunit.client.0.smithi111.stdout:5/454: fsync d10/d1e/d25/d6e/f7d 0 2024-09-11T00:07:16.677 INFO:tasks.workunit.client.1.smithi203.stdout:7/427: dwrite dd/d1c/d52/d8f/d31/d4a/f68 [0,4194304] 0 2024-09-11T00:07:16.680 INFO:tasks.workunit.client.0.smithi111.stdout:5/455: write d10/f27 [4383000,38146] 0 2024-09-11T00:07:16.680 INFO:tasks.workunit.client.1.smithi203.stdout:5/525: rename dc/d65 to dc/dd/d56/dad 0 2024-09-11T00:07:16.683 INFO:tasks.workunit.client.1.smithi203.stdout:2/422: mknod d13/d56/c85 0 2024-09-11T00:07:16.688 INFO:tasks.workunit.client.1.smithi203.stdout:2/423: dread - d13/d15/d19/f66 zero size 2024-09-11T00:07:16.690 INFO:tasks.workunit.client.0.smithi111.stdout:7/434: dwrite dd/d1d/d2d/f89 [0,4194304] 0 2024-09-11T00:07:16.690 INFO:tasks.workunit.client.0.smithi111.stdout:0/473: mkdir d3/da/d7b/d84/da8 0 2024-09-11T00:07:16.692 INFO:tasks.workunit.client.1.smithi203.stdout:1/513: mknod d8/d9/d15/d35/d81/da1/cb1 0 2024-09-11T00:07:16.697 INFO:tasks.workunit.client.1.smithi203.stdout:1/514: write d8/d11/f51 [2764100,47898] 0 2024-09-11T00:07:16.701 INFO:tasks.workunit.client.1.smithi203.stdout:6/418: dwrite d0/d27/d35/f3f [0,4194304] 0 2024-09-11T00:07:16.704 INFO:tasks.workunit.client.1.smithi203.stdout:4/421: dwrite db/dd/d26/f60 [0,4194304] 0 2024-09-11T00:07:16.704 INFO:tasks.workunit.client.0.smithi111.stdout:5/456: dread d10/d1e/d23/d26/f4c [0,4194304] 0 2024-09-11T00:07:16.707 INFO:tasks.workunit.client.0.smithi111.stdout:5/457: dread - d10/d1e/d23/d30/d3c/f4e zero size 2024-09-11T00:07:16.707 INFO:tasks.workunit.client.0.smithi111.stdout:6/380: mkdir d7/d2b/d7c 0 2024-09-11T00:07:16.711 INFO:tasks.workunit.client.1.smithi203.stdout:4/422: write db/f23 [499444,72426] 0 2024-09-11T00:07:16.716 INFO:tasks.workunit.client.0.smithi111.stdout:1/399: fdatasync d2/de/f17 0 2024-09-11T00:07:16.720 INFO:tasks.workunit.client.0.smithi111.stdout:1/400: write d2/d2b/d2c/d56/f5d [836448,29408] 0 2024-09-11T00:07:16.721 INFO:tasks.workunit.client.1.smithi203.stdout:4/423: dread - db/dd/d16/d38/f5f zero size 2024-09-11T00:07:16.722 INFO:tasks.workunit.client.0.smithi111.stdout:1/401: chown d2/de/d12/d6c 506382 1 2024-09-11T00:07:16.723 INFO:tasks.workunit.client.1.smithi203.stdout:7/428: dread dd/d1c/d52/d8f/d31/f49 [0,4194304] 0 2024-09-11T00:07:16.728 INFO:tasks.workunit.client.1.smithi203.stdout:1/515: truncate d8/d19/d60/d90/d3e/d4b/d41/f70 1315411 0 2024-09-11T00:07:16.732 INFO:tasks.workunit.client.0.smithi111.stdout:6/381: symlink d7/d22/d2c/d38/d39/l7d 0 2024-09-11T00:07:16.733 INFO:tasks.workunit.client.0.smithi111.stdout:5/458: creat d10/d1e/d23/d26/d78/f94 x:0 0 0 2024-09-11T00:07:16.739 INFO:tasks.workunit.client.1.smithi203.stdout:4/424: fsync db/dd/f13 0 2024-09-11T00:07:16.740 INFO:tasks.workunit.client.1.smithi203.stdout:6/419: dwrite d0/d27/d35/d39/d3c/f79 [0,4194304] 0 2024-09-11T00:07:16.741 INFO:tasks.workunit.client.0.smithi111.stdout:3/466: creat d1c/f9e x:0 0 0 2024-09-11T00:07:16.741 INFO:tasks.workunit.client.0.smithi111.stdout:1/402: symlink d2/de/d12/d3c/l8c 0 2024-09-11T00:07:16.743 INFO:tasks.workunit.client.0.smithi111.stdout:4/414: creat d18/d20/f85 x:0 0 0 2024-09-11T00:07:16.744 INFO:tasks.workunit.client.1.smithi203.stdout:4/425: chown db/f57 983356 1 2024-09-11T00:07:16.745 INFO:tasks.workunit.client.0.smithi111.stdout:9/467: sync 2024-09-11T00:07:16.748 INFO:tasks.workunit.client.0.smithi111.stdout:9/468: fsync d6/db/d34/d37/f1d 0 2024-09-11T00:07:16.750 INFO:tasks.workunit.client.0.smithi111.stdout:5/459: rename d10/d1e/d23/d26/d3a/f4b to d10/d1e/d23/d30/d59/d52/f95 0 2024-09-11T00:07:16.751 INFO:tasks.workunit.client.1.smithi203.stdout:2/424: dread d13/d15/f1a [0,4194304] 0 2024-09-11T00:07:16.751 INFO:tasks.workunit.client.0.smithi111.stdout:9/469: chown d6/db/d34/f65 340435972 1 2024-09-11T00:07:16.752 INFO:tasks.workunit.client.0.smithi111.stdout:3/467: symlink d1c/d1d/d22/d31/d33/l9f 0 2024-09-11T00:07:16.753 INFO:tasks.workunit.client.0.smithi111.stdout:3/468: read f6 [3474449,69316] 0 2024-09-11T00:07:16.754 INFO:tasks.workunit.client.1.smithi203.stdout:6/420: creat d0/d27/d35/d38/f84 x:0 0 0 2024-09-11T00:07:16.756 INFO:tasks.workunit.client.1.smithi203.stdout:5/526: dread dc/dd/d15/d3b/f63 [0,4194304] 0 2024-09-11T00:07:16.757 INFO:tasks.workunit.client.1.smithi203.stdout:1/516: mkdir d8/d19/d60/d90/d3e/d4b/db2 0 2024-09-11T00:07:16.757 INFO:tasks.workunit.client.0.smithi111.stdout:3/469: dread - d1c/d1d/d22/d23/d2f/f8e zero size 2024-09-11T00:07:16.761 INFO:tasks.workunit.client.0.smithi111.stdout:7/435: link c2 dd/d1d/d2d/d68/c8b 0 2024-09-11T00:07:16.761 INFO:tasks.workunit.client.0.smithi111.stdout:1/403: symlink d2/de/d12/d3c/d4b/d6a/d3a/l8d 0 2024-09-11T00:07:16.764 INFO:tasks.workunit.client.0.smithi111.stdout:0/474: dwrite d3/fd [0,4194304] 0 2024-09-11T00:07:16.768 INFO:tasks.workunit.client.0.smithi111.stdout:5/460: symlink d10/d1e/d23/d2b/d5c/d61/l96 0 2024-09-11T00:07:16.768 INFO:tasks.workunit.client.1.smithi203.stdout:5/527: write dc/dd/d4d/d59/f46 [5785726,65620] 0 2024-09-11T00:07:16.771 INFO:tasks.workunit.client.0.smithi111.stdout:1/404: mknod d2/d2b/d2c/c8e 0 2024-09-11T00:07:16.771 INFO:tasks.workunit.client.0.smithi111.stdout:5/461: chown d10/d1e/d25/f75 0 1 2024-09-11T00:07:16.772 INFO:tasks.workunit.client.0.smithi111.stdout:7/436: truncate dd/d1d/d2d/d2e/f7a 1027227 0 2024-09-11T00:07:16.776 INFO:tasks.workunit.client.0.smithi111.stdout:1/405: rename d2/d2b/d2c/d56 to d2/d2b/d2c/d56/d7b/d87/d8f 22 2024-09-11T00:07:16.777 INFO:tasks.workunit.client.0.smithi111.stdout:9/470: creat d6/db/d1b/d41/d80/f9d x:0 0 0 2024-09-11T00:07:16.779 INFO:tasks.workunit.client.1.smithi203.stdout:7/429: link dd/d4d/d7f/f92 dd/d1c/d52/d8f/d31/d67/fa2 0 2024-09-11T00:07:16.780 INFO:tasks.workunit.client.1.smithi203.stdout:7/430: dread - dd/d1c/d52/f94 zero size 2024-09-11T00:07:16.780 INFO:tasks.workunit.client.0.smithi111.stdout:1/406: chown d2/de/d12/d3c/d4b/d6a/f7a 40257 1 2024-09-11T00:07:16.781 INFO:tasks.workunit.client.1.smithi203.stdout:6/421: dread d0/f4f [0,4194304] 0 2024-09-11T00:07:16.782 INFO:tasks.workunit.client.1.smithi203.stdout:4/426: rename db/dd/d26/d42/d5e/f65 to db/d12/d15/d2a/f87 0 2024-09-11T00:07:16.782 INFO:tasks.workunit.client.1.smithi203.stdout:5/528: getdents dc/dd/d56/dad/da5 0 2024-09-11T00:07:16.783 INFO:tasks.workunit.client.1.smithi203.stdout:7/431: stat dd/d1c/d7c/l99 0 2024-09-11T00:07:16.784 INFO:tasks.workunit.client.1.smithi203.stdout:5/529: chown dc/f87 27 1 2024-09-11T00:07:16.785 INFO:tasks.workunit.client.1.smithi203.stdout:6/422: stat d0/d27/d35/d38/d73/d74/f80 0 2024-09-11T00:07:16.786 INFO:tasks.workunit.client.1.smithi203.stdout:5/530: readlink dc/dd/l26 0 2024-09-11T00:07:16.787 INFO:tasks.workunit.client.0.smithi111.stdout:6/382: dwrite d7/d22/d2c/f4e [0,4194304] 0 2024-09-11T00:07:16.790 INFO:tasks.workunit.client.1.smithi203.stdout:4/427: unlink db/dd/d16/d38/d3c/c3e 0 2024-09-11T00:07:16.792 INFO:tasks.workunit.client.1.smithi203.stdout:6/423: fsync d0/d32/f43 0 2024-09-11T00:07:16.797 INFO:tasks.workunit.client.0.smithi111.stdout:6/383: rename d7/d22/c60 to d7/d22/d3f/c7e 0 2024-09-11T00:07:16.800 INFO:tasks.workunit.client.0.smithi111.stdout:0/475: dread d3/d1c/f42 [0,4194304] 0 2024-09-11T00:07:16.802 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.800+0000 7ff14ea00700 1 -- 172.21.15.111:0/2763993794 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff148100be0 msgr2=0x7ff148102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:16.802 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.800+0000 7ff14ea00700 1 --2- 172.21.15.111:0/2763993794 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff148100be0 0x7ff148102fc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff138009910 tx=0x7ff138009c20 comp rx=0 tx=0).stop 2024-09-11T00:07:16.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.802+0000 7ff14ea00700 1 -- 172.21.15.111:0/2763993794 shutdown_connections 2024-09-11T00:07:16.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.802+0000 7ff14ea00700 1 --2- 172.21.15.111:0/2763993794 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff148103500 0x7ff1481058e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:16.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.802+0000 7ff14ea00700 1 --2- 172.21.15.111:0/2763993794 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff148100be0 0x7ff148102fc0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:16.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.802+0000 7ff14ea00700 1 -- 172.21.15.111:0/2763993794 >> 172.21.15.111:0/2763993794 conn(0x7ff1480fa5e0 msgr2=0x7ff1480fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:16.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.803+0000 7ff14ea00700 1 -- 172.21.15.111:0/2763993794 shutdown_connections 2024-09-11T00:07:16.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.804+0000 7ff14ea00700 1 -- 172.21.15.111:0/2763993794 wait complete. 2024-09-11T00:07:16.806 INFO:tasks.workunit.client.1.smithi203.stdout:6/424: symlink d0/d5b/l85 0 2024-09-11T00:07:16.807 INFO:tasks.workunit.client.0.smithi111.stdout:9/471: getdents d6/d52/d8a 0 2024-09-11T00:07:16.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.805+0000 7ff14ea00700 1 Processor -- start 2024-09-11T00:07:16.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.805+0000 7ff14ea00700 1 -- start start 2024-09-11T00:07:16.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.806+0000 7ff14ea00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff148100be0 0x7ff1481959c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:16.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.806+0000 7ff14ea00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff148103500 0x7ff148195f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:16.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.806+0000 7ff14ea00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff148196520 con 0x7ff148100be0 2024-09-11T00:07:16.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.806+0000 7ff14ea00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff148196660 con 0x7ff148103500 2024-09-11T00:07:16.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.806+0000 7ff147e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff148100be0 0x7ff1481959c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:16.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.807+0000 7ff147e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff148100be0 0x7ff1481959c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:33408/0 (socket says 172.21.15.111:33408) 2024-09-11T00:07:16.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.807+0000 7ff147e00700 1 -- 172.21.15.111:0/1560813386 learned_addr learned my addr 172.21.15.111:0/1560813386 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:07:16.810 INFO:tasks.workunit.client.1.smithi203.stdout:5/531: mkdir dc/dd/d9b/dae 0 2024-09-11T00:07:16.810 INFO:tasks.workunit.client.1.smithi203.stdout:1/517: dread d8/d19/d31/f88 [0,4194304] 0 2024-09-11T00:07:16.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.807+0000 7ff147e00700 1 -- 172.21.15.111:0/1560813386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff148103500 msgr2=0x7ff148195f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:16.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.807+0000 7ff147400700 1 --2- 172.21.15.111:0/1560813386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff148103500 0x7ff148195f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:16.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.807+0000 7ff147e00700 1 --2- 172.21.15.111:0/1560813386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff148103500 0x7ff148195f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:16.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.808+0000 7ff147e00700 1 -- 172.21.15.111:0/1560813386 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1380095f0 con 0x7ff148100be0 2024-09-11T00:07:16.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.808+0000 7ff147400700 1 --2- 172.21.15.111:0/1560813386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff148103500 0x7ff148195f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:07:16.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.808+0000 7ff147e00700 1 --2- 172.21.15.111:0/1560813386 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff148100be0 0x7ff1481959c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff138009fd0 tx=0x7ff13800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:16.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.809+0000 7ff144c00700 1 -- 172.21.15.111:0/1560813386 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff13801d070 con 0x7ff148100be0 2024-09-11T00:07:16.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.809+0000 7ff144c00700 1 -- 172.21.15.111:0/1560813386 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff138004bf0 con 0x7ff148100be0 2024-09-11T00:07:16.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.809+0000 7ff14ea00700 1 -- 172.21.15.111:0/1560813386 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14819b0b0 con 0x7ff148100be0 2024-09-11T00:07:16.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.810+0000 7ff14ea00700 1 -- 172.21.15.111:0/1560813386 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14819b620 con 0x7ff148100be0 2024-09-11T00:07:16.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.810+0000 7ff144c00700 1 -- 172.21.15.111:0/1560813386 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff13800f6b0 con 0x7ff148100be0 2024-09-11T00:07:16.812 INFO:tasks.workunit.client.1.smithi203.stdout:5/532: chown dc/dd/d15/d3b/d73/f83 28104 1 2024-09-11T00:07:16.812 INFO:tasks.workunit.client.1.smithi203.stdout:1/518: chown d8/d19/d60/d90/d3e/d4b/d80/d8d/db0 3989 1 2024-09-11T00:07:16.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.811+0000 7ff144c00700 1 -- 172.21.15.111:0/1560813386 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 25) v1 ==== 51561+0+0 (secure 0 0 0) 0x7ff13800f810 con 0x7ff148100be0 2024-09-11T00:07:16.817 INFO:tasks.workunit.client.1.smithi203.stdout:4/428: mkdir db/d12/d15/d2a/d88 0 2024-09-11T00:07:16.817 INFO:tasks.workunit.client.0.smithi111.stdout:6/384: write d7/d22/d2c/d38/f71 [4008096,117334] 0 2024-09-11T00:07:16.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.812+0000 7ff144c00700 1 --2- 172.21.15.111:0/1560813386 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7ff12c03f660 0x7ff12c041b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:16.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.812+0000 7ff144c00700 1 -- 172.21.15.111:0/1560813386 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ff138056560 con 0x7ff148100be0 2024-09-11T00:07:16.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.813+0000 7ff147400700 1 --2- 172.21.15.111:0/1560813386 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7ff12c03f660 0x7ff12c041b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:16.818 INFO:tasks.workunit.client.0.smithi111.stdout:7/437: link dd/d1d/d1f/f5e dd/f8c 0 2024-09-11T00:07:16.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.814+0000 7ff14ea00700 1 -- 172.21.15.111:0/1560813386 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff14818fc10 con 0x7ff148100be0 2024-09-11T00:07:16.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.816+0000 7ff147400700 1 --2- 172.21.15.111:0/1560813386 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7ff12c03f660 0x7ff12c041b10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff134006fd0 tx=0x7ff134008040 comp rx=0 tx=0).ready entity=mgr.24469 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:16.821 INFO:tasks.workunit.client.1.smithi203.stdout:1/519: creat d8/d19/d60/d90/d3e/d4b/d80/da2/fb3 x:0 0 0 2024-09-11T00:07:16.822 INFO:tasks.workunit.client.0.smithi111.stdout:4/415: dwrite d18/d39/f53 [0,4194304] 0 2024-09-11T00:07:16.822 INFO:tasks.workunit.client.0.smithi111.stdout:5/462: dread d10/f22 [0,4194304] 0 2024-09-11T00:07:16.822 INFO:tasks.workunit.client.1.smithi203.stdout:4/429: creat db/d12/d15/d2a/d88/f89 x:0 0 0 2024-09-11T00:07:16.825 INFO:tasks.workunit.client.1.smithi203.stdout:4/430: stat db/dd/d26/f77 0 2024-09-11T00:07:16.829 INFO:tasks.workunit.client.1.smithi203.stdout:2/425: dwrite d13/d15/f29 [0,4194304] 0 2024-09-11T00:07:16.829 INFO:tasks.workunit.client.1.smithi203.stdout:5/533: creat dc/dd/d15/faf x:0 0 0 2024-09-11T00:07:16.830 INFO:tasks.workunit.client.0.smithi111.stdout:5/463: chown d10/d1e/d25/f75 259875 1 2024-09-11T00:07:16.830 INFO:tasks.workunit.client.0.smithi111.stdout:9/472: fsync d6/db/d34/f45 0 2024-09-11T00:07:16.830 INFO:tasks.workunit.client.0.smithi111.stdout:6/385: rename d7/d4d to d7/d22/d3f/d74/d7f 0 2024-09-11T00:07:16.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:16.822+0000 7ff144c00700 1 -- 172.21.15.111:0/1560813386 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7ff138027080 con 0x7ff148100be0 2024-09-11T00:07:16.833 INFO:tasks.workunit.client.1.smithi203.stdout:5/534: fsync dc/dd/f89 0 2024-09-11T00:07:16.835 INFO:tasks.workunit.client.1.smithi203.stdout:1/520: truncate d8/d11/f20 1735573 0 2024-09-11T00:07:16.837 INFO:tasks.workunit.client.0.smithi111.stdout:1/407: dread d2/f10 [0,4194304] 0 2024-09-11T00:07:16.838 INFO:tasks.workunit.client.0.smithi111.stdout:1/408: write d2/f9 [1932045,47236] 0 2024-09-11T00:07:16.839 INFO:tasks.workunit.client.1.smithi203.stdout:6/425: dwrite d0/f5f [0,4194304] 0 2024-09-11T00:07:16.841 INFO:tasks.workunit.client.0.smithi111.stdout:6/386: fsync d7/d2b/d35/f57 0 2024-09-11T00:07:16.847 INFO:tasks.workunit.client.0.smithi111.stdout:6/387: stat d7/d22/d2c/d38/d56 0 2024-09-11T00:07:16.848 INFO:tasks.workunit.client.1.smithi203.stdout:4/431: creat db/f8a x:0 0 0 2024-09-11T00:07:16.851 INFO:tasks.workunit.client.1.smithi203.stdout:2/426: dread d13/d15/f55 [0,4194304] 0 2024-09-11T00:07:16.855 INFO:tasks.workunit.client.0.smithi111.stdout:4/416: dwrite d18/d20/d3c/f54 [0,4194304] 0 2024-09-11T00:07:16.855 INFO:tasks.workunit.client.0.smithi111.stdout:7/438: dwrite dd/d1d/d2d/d2e/f40 [0,4194304] 0 2024-09-11T00:07:16.858 INFO:tasks.workunit.client.1.smithi203.stdout:2/427: chown d13/d15/d30/c79 1355 1 2024-09-11T00:07:16.863 INFO:tasks.workunit.client.0.smithi111.stdout:9/473: getdents d6/db/d1b/d41 0 2024-09-11T00:07:16.866 INFO:tasks.workunit.client.1.smithi203.stdout:2/428: fdatasync d13/d15/f1f 0 2024-09-11T00:07:16.867 INFO:tasks.workunit.client.0.smithi111.stdout:4/417: creat d18/d20/d40/d78/f86 x:0 0 0 2024-09-11T00:07:16.870 INFO:tasks.workunit.client.1.smithi203.stdout:7/432: dwrite dd/f9d [4194304,4194304] 0 2024-09-11T00:07:16.872 INFO:tasks.workunit.client.0.smithi111.stdout:7/439: creat dd/d1d/d2d/d2e/d4e/f8d x:0 0 0 2024-09-11T00:07:16.874 INFO:tasks.workunit.client.0.smithi111.stdout:8/484: sync 2024-09-11T00:07:16.874 INFO:tasks.workunit.client.0.smithi111.stdout:2/430: sync 2024-09-11T00:07:16.874 INFO:tasks.workunit.client.0.smithi111.stdout:6/388: symlink d7/d22/d3f/d74/d7f/d61/d6a/l80 0 2024-09-11T00:07:16.875 INFO:tasks.workunit.client.0.smithi111.stdout:1/409: rmdir d2/de/d12/d3c/d4b/d6a/d63/d73/d80 0 2024-09-11T00:07:16.875 INFO:tasks.workunit.client.1.smithi203.stdout:6/426: mknod d0/d71/c86 0 2024-09-11T00:07:16.876 INFO:tasks.workunit.client.1.smithi203.stdout:1/521: link d8/d19/d60/f87 d8/d9/d15/d35/d81/da1/fb4 0 2024-09-11T00:07:16.877 INFO:tasks.workunit.client.1.smithi203.stdout:5/535: getdents dc/dd/d4d 0 2024-09-11T00:07:16.878 INFO:tasks.workunit.client.0.smithi111.stdout:8/485: write d11/d23/d7e/f97 [10432,3334] 0 2024-09-11T00:07:16.879 INFO:tasks.workunit.client.0.smithi111.stdout:9/474: creat d6/db/d1b/d41/f9e x:0 0 0 2024-09-11T00:07:16.881 INFO:tasks.workunit.client.0.smithi111.stdout:9/475: fsync d6/db/f5b 0 2024-09-11T00:07:16.883 INFO:tasks.workunit.client.0.smithi111.stdout:5/464: dread d10/f1a [0,4194304] 0 2024-09-11T00:07:16.883 INFO:tasks.workunit.client.1.smithi203.stdout:2/429: dread - d13/d15/d30/d59/f80 zero size 2024-09-11T00:07:16.883 INFO:tasks.workunit.client.1.smithi203.stdout:6/427: dread - d0/d54/f68 zero size 2024-09-11T00:07:16.885 INFO:tasks.workunit.client.1.smithi203.stdout:2/430: write d13/d15/d19/d1c/f3d [3629434,53469] 0 2024-09-11T00:07:16.886 INFO:tasks.workunit.client.1.smithi203.stdout:5/536: creat dc/dd/d9b/fb0 x:0 0 0 2024-09-11T00:07:16.888 INFO:tasks.workunit.client.0.smithi111.stdout:7/440: mknod dd/d1d/d2d/d2e/d4e/c8e 0 2024-09-11T00:07:16.888 INFO:tasks.workunit.client.0.smithi111.stdout:9/476: chown d6/db/d34/d37/f29 25648 1 2024-09-11T00:07:16.888 INFO:tasks.workunit.client.0.smithi111.stdout:2/431: unlink d0/d3/c2c 0 2024-09-11T00:07:16.888 INFO:tasks.workunit.client.0.smithi111.stdout:5/465: write d10/d1e/d25/d6e/f80 [985352,77861] 0 2024-09-11T00:07:16.889 INFO:tasks.workunit.client.1.smithi203.stdout:7/433: fdatasync dd/d1c/d52/d8f/d31/f50 0 2024-09-11T00:07:16.890 INFO:tasks.workunit.client.1.smithi203.stdout:1/522: symlink d8/d28/d64/da0/lb5 0 2024-09-11T00:07:16.892 INFO:tasks.workunit.client.0.smithi111.stdout:0/476: dread d3/d13/d1e/d29/f9a [0,4194304] 0 2024-09-11T00:07:16.893 INFO:tasks.workunit.client.1.smithi203.stdout:6/428: mknod d0/d27/d35/d38/d73/d74/c87 0 2024-09-11T00:07:16.893 INFO:tasks.workunit.client.0.smithi111.stdout:1/410: mknod d2/de/d82/c90 0 2024-09-11T00:07:16.895 INFO:tasks.workunit.client.1.smithi203.stdout:6/429: dread - d0/d27/d35/d39/f62 zero size 2024-09-11T00:07:16.896 INFO:tasks.workunit.client.0.smithi111.stdout:5/466: stat d10/d1e/d23/d30/d3c/f4e 0 2024-09-11T00:07:16.899 INFO:tasks.workunit.client.0.smithi111.stdout:3/470: sync 2024-09-11T00:07:16.900 INFO:tasks.workunit.client.1.smithi203.stdout:5/537: creat dc/dd/d1e/d7b/fb1 x:0 0 0 2024-09-11T00:07:16.904 INFO:tasks.workunit.client.0.smithi111.stdout:2/432: creat d0/d83/f9c x:0 0 0 2024-09-11T00:07:16.905 INFO:tasks.workunit.client.1.smithi203.stdout:1/523: creat d8/d9/d15/d27/fb6 x:0 0 0 2024-09-11T00:07:16.907 INFO:tasks.workunit.client.0.smithi111.stdout:4/418: getdents d18/d1f/d36 0 2024-09-11T00:07:16.908 INFO:tasks.workunit.client.0.smithi111.stdout:8/486: dread ff [0,4194304] 0 2024-09-11T00:07:16.909 INFO:tasks.workunit.client.0.smithi111.stdout:9/477: rename d6/db/d34/l51 to d6/db/d1b/d41/l9f 0 2024-09-11T00:07:16.914 INFO:tasks.workunit.client.1.smithi203.stdout:6/430: dwrite d0/d27/d35/d39/f56 [0,4194304] 0 2024-09-11T00:07:16.914 INFO:tasks.workunit.client.0.smithi111.stdout:0/477: mknod d3/d13/d1e/d29/ca9 0 2024-09-11T00:07:16.915 INFO:tasks.workunit.client.1.smithi203.stdout:5/538: creat dc/d4f/d5c/d76/fb2 x:0 0 0 2024-09-11T00:07:16.915 INFO:tasks.workunit.client.0.smithi111.stdout:8/487: fdatasync d11/d23/f4e 0 2024-09-11T00:07:16.917 INFO:tasks.workunit.client.0.smithi111.stdout:6/389: link d7/fd d7/d22/d3f/d74/d7f/d61/f81 0 2024-09-11T00:07:16.918 INFO:tasks.workunit.client.0.smithi111.stdout:7/441: dwrite dd/d1d/d2d/d2e/f70 [0,4194304] 0 2024-09-11T00:07:16.920 INFO:tasks.workunit.client.1.smithi203.stdout:6/431: symlink d0/d54/l88 0 2024-09-11T00:07:16.922 INFO:tasks.workunit.client.0.smithi111.stdout:6/390: write d7/d22/d2c/d38/f4c [2381479,101429] 0 2024-09-11T00:07:16.923 INFO:tasks.workunit.client.1.smithi203.stdout:5/539: rename dc/dd/d15/d3b/f4c to dc/dd/d9b/dae/fb3 0 2024-09-11T00:07:16.925 INFO:tasks.workunit.client.0.smithi111.stdout:4/419: creat d18/d3b/d61/f87 x:0 0 0 2024-09-11T00:07:16.930 INFO:tasks.workunit.client.0.smithi111.stdout:0/478: unlink d3/d26/c9e 0 2024-09-11T00:07:16.931 INFO:tasks.workunit.client.0.smithi111.stdout:9/478: symlink d6/db/d34/d37/d4c/d7f/la0 0 2024-09-11T00:07:16.933 INFO:tasks.workunit.client.0.smithi111.stdout:0/479: fdatasync d3/d1c/f4a 0 2024-09-11T00:07:16.933 INFO:tasks.workunit.client.0.smithi111.stdout:1/411: getdents d2/de/d12/d88 0 2024-09-11T00:07:16.933 INFO:tasks.workunit.client.1.smithi203.stdout:7/434: write dd/d1c/f5f [337222,68666] 0 2024-09-11T00:07:16.935 INFO:tasks.workunit.client.0.smithi111.stdout:2/433: rmdir d0/d3/de 39 2024-09-11T00:07:16.938 INFO:tasks.workunit.client.1.smithi203.stdout:5/540: rename dc/dd/d15/c55 to dc/d4f/cb4 0 2024-09-11T00:07:16.938 INFO:tasks.workunit.client.0.smithi111.stdout:1/412: write d2/de/d12/d3c/d4b/d6a/f46 [3954173,122129] 0 2024-09-11T00:07:16.939 INFO:tasks.workunit.client.0.smithi111.stdout:9/479: read d6/db/d1b/d41/f42 [734946,99370] 0 2024-09-11T00:07:16.939 INFO:tasks.workunit.client.1.smithi203.stdout:2/431: dwrite d13/d15/f45 [0,4194304] 0 2024-09-11T00:07:16.941 INFO:tasks.workunit.client.0.smithi111.stdout:1/413: write d2/de/f43 [1386591,72417] 0 2024-09-11T00:07:16.943 INFO:tasks.workunit.client.1.smithi203.stdout:7/435: chown dd/d1c/d52/d8f/d31/d4a/f86 3 1 2024-09-11T00:07:16.945 INFO:tasks.workunit.client.0.smithi111.stdout:3/471: write d1c/d1d/d22/d44/f56 [14088,86530] 0 2024-09-11T00:07:16.945 INFO:tasks.workunit.client.1.smithi203.stdout:5/541: symlink dc/dd/d15/d3b/lb5 0 2024-09-11T00:07:16.947 INFO:tasks.workunit.client.1.smithi203.stdout:7/436: chown dd/d1c/d52/d8f/d31/d4a/f86 69 1 2024-09-11T00:07:16.951 INFO:tasks.workunit.client.1.smithi203.stdout:5/542: mknod dc/d9f/cb6 0 2024-09-11T00:07:16.953 INFO:tasks.workunit.client.1.smithi203.stdout:7/437: mknod dd/d1c/d52/d8f/ca3 0 2024-09-11T00:07:16.956 INFO:tasks.workunit.client.0.smithi111.stdout:8/488: creat d11/f9b x:0 0 0 2024-09-11T00:07:16.956 INFO:tasks.workunit.client.0.smithi111.stdout:0/480: mkdir d3/d13/daa 0 2024-09-11T00:07:16.957 INFO:tasks.workunit.client.1.smithi203.stdout:2/432: dread d13/d15/d19/d1c/f2a [0,4194304] 0 2024-09-11T00:07:16.959 INFO:tasks.workunit.client.1.smithi203.stdout:7/438: readlink dd/d1c/d52/d8f/l76 0 2024-09-11T00:07:16.961 INFO:tasks.workunit.client.0.smithi111.stdout:9/480: mkdir d6/da1 0 2024-09-11T00:07:16.964 INFO:tasks.workunit.client.0.smithi111.stdout:2/434: write d0/d3/de/d3b/d62/f78 [814763,52087] 0 2024-09-11T00:07:16.964 INFO:tasks.workunit.client.1.smithi203.stdout:7/439: unlink dd/d1c/d52/d8f/d31/d58/f5e 0 2024-09-11T00:07:16.965 INFO:tasks.workunit.client.0.smithi111.stdout:8/489: chown d11/d21/d38/d54/l7a 29 1 2024-09-11T00:07:16.967 INFO:tasks.workunit.client.1.smithi203.stdout:7/440: creat dd/d3b/fa4 x:0 0 0 2024-09-11T00:07:16.969 INFO:tasks.workunit.client.0.smithi111.stdout:2/435: stat d0/d3/d12/d52/d6c/f7c 0 2024-09-11T00:07:16.969 INFO:tasks.workunit.client.0.smithi111.stdout:3/472: dwrite d1c/f24 [0,4194304] 0 2024-09-11T00:07:16.969 INFO:tasks.workunit.client.0.smithi111.stdout:9/481: symlink d6/db/d1b/d74/la2 0 2024-09-11T00:07:16.969 INFO:tasks.workunit.client.0.smithi111.stdout:0/481: truncate d3/d13/f17 226904 0 2024-09-11T00:07:16.970 INFO:tasks.workunit.client.1.smithi203.stdout:7/441: read dd/d1c/d52/f8d [2906056,10997] 0 2024-09-11T00:07:16.974 INFO:tasks.workunit.client.0.smithi111.stdout:9/482: chown l1 120 1 2024-09-11T00:07:16.976 INFO:tasks.workunit.client.0.smithi111.stdout:0/482: write d3/d26/f81 [3448966,23200] 0 2024-09-11T00:07:16.978 INFO:tasks.workunit.client.0.smithi111.stdout:2/436: dread - d0/d3/de/f5d zero size 2024-09-11T00:07:16.980 INFO:tasks.workunit.client.0.smithi111.stdout:9/483: read d6/db/d34/d37/f7e [662935,35939] 0 2024-09-11T00:07:16.981 INFO:tasks.workunit.client.0.smithi111.stdout:6/391: dread d7/fd [0,4194304] 0 2024-09-11T00:07:16.982 INFO:tasks.workunit.client.1.smithi203.stdout:5/543: rmdir dc/dd/d15 39 2024-09-11T00:07:16.985 INFO:tasks.workunit.client.0.smithi111.stdout:7/442: truncate dd/d1d/d4d/f60 3962154 0 2024-09-11T00:07:16.986 INFO:tasks.workunit.client.1.smithi203.stdout:5/544: creat dc/dd/d1e/d7b/fb7 x:0 0 0 2024-09-11T00:07:16.987 INFO:tasks.workunit.client.1.smithi203.stdout:7/442: dwrite dd/d3b/d5b/f7b [4194304,4194304] 0 2024-09-11T00:07:16.989 INFO:tasks.workunit.client.0.smithi111.stdout:6/392: creat d7/d2b/d35/d41/f82 x:0 0 0 2024-09-11T00:07:16.990 INFO:tasks.workunit.client.0.smithi111.stdout:1/414: write d2/d7c/f20 [6105621,66781] 0 2024-09-11T00:07:16.991 INFO:tasks.workunit.client.0.smithi111.stdout:9/484: creat d6/db/d7a/fa3 x:0 0 0 2024-09-11T00:07:16.993 INFO:tasks.workunit.client.0.smithi111.stdout:4/420: truncate d18/d20/f30 2611116 0 2024-09-11T00:07:16.995 INFO:tasks.workunit.client.1.smithi203.stdout:5/545: rename dc/d4f/d5c/f62 to dc/d4f/d5c/fb8 0 2024-09-11T00:07:16.996 INFO:tasks.workunit.client.0.smithi111.stdout:9/485: stat d6/dc/d73 0 2024-09-11T00:07:16.998 INFO:tasks.workunit.client.0.smithi111.stdout:2/437: mkdir d0/d3/de/d50/d9d 0 2024-09-11T00:07:17.000 INFO:tasks.workunit.client.0.smithi111.stdout:7/443: mkdir dd/d1d/d4b/d8f 0 2024-09-11T00:07:17.000 INFO:tasks.workunit.client.1.smithi203.stdout:5/546: mknod dc/dd/d56/cb9 0 2024-09-11T00:07:17.004 INFO:tasks.workunit.client.1.smithi203.stdout:2/433: truncate d13/d15/d30/d59/f6a 1018379 0 2024-09-11T00:07:17.004 INFO:tasks.workunit.client.1.smithi203.stdout:5/547: chown dc/dd/d1e/d7b/c84 5600 1 2024-09-11T00:07:17.005 INFO:tasks.workunit.client.0.smithi111.stdout:3/473: dwrite d1c/d1d/d22/d23/d2f/d63/f6b [0,4194304] 0 2024-09-11T00:07:17.009 INFO:tasks.workunit.client.1.smithi203.stdout:2/434: creat d13/d47/f86 x:0 0 0 2024-09-11T00:07:17.011 INFO:tasks.workunit.client.0.smithi111.stdout:3/474: chown d1c/d1d/d22/d23/d2f/d63/d7e 397574033 1 2024-09-11T00:07:17.012 INFO:tasks.workunit.client.1.smithi203.stdout:2/435: chown d13/d15/d30/c79 157 1 2024-09-11T00:07:17.013 INFO:tasks.workunit.client.1.smithi203.stdout:7/443: dwrite dd/d1c/d4b/f65 [0,4194304] 0 2024-09-11T00:07:17.015 INFO:tasks.workunit.client.0.smithi111.stdout:4/421: chown d18/d1f/d33/c6e 1 1 2024-09-11T00:07:17.020 INFO:tasks.workunit.client.1.smithi203.stdout:2/436: write d13/d15/f1b [3600449,112767] 0 2024-09-11T00:07:17.025 INFO:tasks.workunit.client.1.smithi203.stdout:7/444: unlink dd/d1c/d52/d8f/d31/l43 0 2024-09-11T00:07:17.028 INFO:tasks.workunit.client.1.smithi203.stdout:5/548: dwrite dc/d91/fa3 [0,4194304] 0 2024-09-11T00:07:17.028 INFO:tasks.workunit.client.1.smithi203.stdout:7/445: chown dd/d1c/d4b/f53 12 1 2024-09-11T00:07:17.030 INFO:tasks.workunit.client.0.smithi111.stdout:0/483: dwrite d3/d13/d1e/d29/f4e [0,4194304] 0 2024-09-11T00:07:17.031 INFO:tasks.workunit.client.1.smithi203.stdout:7/446: readlink dd/d1c/d52/d8f/d31/l38 0 2024-09-11T00:07:17.034 INFO:tasks.workunit.client.0.smithi111.stdout:2/438: dread d0/d3/de/f44 [0,4194304] 0 2024-09-11T00:07:17.034 INFO:tasks.workunit.client.1.smithi203.stdout:2/437: symlink d13/l87 0 2024-09-11T00:07:17.036 INFO:tasks.workunit.client.0.smithi111.stdout:6/393: dwrite d7/d22/d2c/d38/f45 [0,4194304] 0 2024-09-11T00:07:17.037 INFO:tasks.workunit.client.1.smithi203.stdout:5/549: mkdir dc/d2b/dba 0 2024-09-11T00:07:17.043 INFO:tasks.workunit.client.1.smithi203.stdout:2/438: mknod d13/d47/c88 0 2024-09-11T00:07:17.044 INFO:tasks.workunit.client.1.smithi203.stdout:5/550: mkdir dc/dd/d4d/d59/dbb 0 2024-09-11T00:07:17.052 INFO:tasks.workunit.client.0.smithi111.stdout:1/415: dwrite d2/de/d12/d3c/d4b/d6a/f3d [0,4194304] 0 2024-09-11T00:07:17.055 INFO:tasks.workunit.client.1.smithi203.stdout:7/447: rename dd/d1c/d52/d8f/d31/d67/fa2 to dd/d1c/d52/d8f/d31/d4a/d6e/fa5 0 2024-09-11T00:07:17.055 INFO:tasks.workunit.client.1.smithi203.stdout:2/439: dread d13/d47/f61 [0,4194304] 0 2024-09-11T00:07:17.062 INFO:tasks.workunit.client.0.smithi111.stdout:0/484: symlink d3/da/lab 0 2024-09-11T00:07:17.063 INFO:tasks.workunit.client.0.smithi111.stdout:6/394: fdatasync d7/f30 0 2024-09-11T00:07:17.064 INFO:tasks.workunit.client.0.smithi111.stdout:2/439: stat d0/d3/de/f1e 0 2024-09-11T00:07:17.065 INFO:tasks.workunit.client.0.smithi111.stdout:9/486: mkdir d6/db/d34/d37/d4c/d99/da4 0 2024-09-11T00:07:17.066 INFO:tasks.workunit.client.1.smithi203.stdout:7/448: dread dd/d1c/d4b/f75 [0,4194304] 0 2024-09-11T00:07:17.066 INFO:tasks.workunit.client.1.smithi203.stdout:5/551: getdents dc/dd/d15/d3b 0 2024-09-11T00:07:17.066 INFO:tasks.workunit.client.0.smithi111.stdout:2/440: stat d0/d3/c34 0 2024-09-11T00:07:17.069 INFO:tasks.workunit.client.0.smithi111.stdout:1/416: rmdir d2/d77 39 2024-09-11T00:07:17.069 INFO:tasks.workunit.client.1.smithi203.stdout:2/440: link d13/l51 d13/l89 0 2024-09-11T00:07:17.071 INFO:tasks.workunit.client.1.smithi203.stdout:5/552: fdatasync dc/d4f/d5c/f66 0 2024-09-11T00:07:17.071 INFO:tasks.workunit.client.0.smithi111.stdout:2/441: chown d0/d3/d12/d52/d6c/f7c 238928924 1 2024-09-11T00:07:17.072 INFO:tasks.workunit.client.0.smithi111.stdout:0/485: rmdir d3/d13/d1e/d29/d70 39 2024-09-11T00:07:17.073 INFO:tasks.workunit.client.0.smithi111.stdout:6/395: mkdir d7/d22/d1d/d83 0 2024-09-11T00:07:17.074 INFO:tasks.workunit.client.1.smithi203.stdout:5/553: write dc/dd/d13/f5d [1556617,120128] 0 2024-09-11T00:07:17.075 INFO:tasks.workunit.client.0.smithi111.stdout:9/487: getdents d6/db/d7a/d9a 0 2024-09-11T00:07:17.076 INFO:tasks.workunit.client.0.smithi111.stdout:6/396: readlink d7/d22/d26/l55 0 2024-09-11T00:07:17.080 INFO:tasks.workunit.client.0.smithi111.stdout:9/488: dread - d6/dc/d7c/f86 zero size 2024-09-11T00:07:17.081 INFO:tasks.workunit.client.1.smithi203.stdout:7/449: dwrite dd/d1c/f78 [0,4194304] 0 2024-09-11T00:07:17.084 INFO:tasks.workunit.client.0.smithi111.stdout:9/489: readlink d6/l8 0 2024-09-11T00:07:17.085 INFO:tasks.workunit.client.1.smithi203.stdout:7/450: creat dd/d4d/fa6 x:0 0 0 2024-09-11T00:07:17.085 INFO:tasks.workunit.client.0.smithi111.stdout:5/467: sync 2024-09-11T00:07:17.086 INFO:tasks.workunit.client.1.smithi203.stdout:7/451: chown dd/d1c/f32 1271838909 1 2024-09-11T00:07:17.087 INFO:tasks.workunit.client.0.smithi111.stdout:5/468: stat d10/l1d 0 2024-09-11T00:07:17.088 INFO:tasks.workunit.client.0.smithi111.stdout:9/490: dread - d6/dc/f87 zero size 2024-09-11T00:07:17.090 INFO:tasks.workunit.client.1.smithi203.stdout:7/452: truncate dd/d1c/d52/d8f/d31/d67/f79 1800752 0 2024-09-11T00:07:17.091 INFO:tasks.workunit.client.0.smithi111.stdout:2/442: dread d0/d3/d12/f41 [4194304,4194304] 0 2024-09-11T00:07:17.095 INFO:tasks.workunit.client.0.smithi111.stdout:5/469: unlink d10/d1e/d23/d30/d3c/c43 0 2024-09-11T00:07:17.095 INFO:tasks.workunit.client.0.smithi111.stdout:9/491: dread d6/db/d1b/d56/f6b [0,4194304] 0 2024-09-11T00:07:17.097 INFO:tasks.workunit.client.0.smithi111.stdout:0/486: dwrite d3/dc/f43 [0,4194304] 0 2024-09-11T00:07:17.103 INFO:tasks.workunit.client.0.smithi111.stdout:6/397: dread d7/ff [0,4194304] 0 2024-09-11T00:07:17.105 INFO:tasks.workunit.client.0.smithi111.stdout:4/422: truncate d18/d3b/d51/f5b 9719 0 2024-09-11T00:07:17.108 INFO:tasks.workunit.client.0.smithi111.stdout:7/444: write f7 [59889,30130] 0 2024-09-11T00:07:17.108 INFO:tasks.workunit.client.0.smithi111.stdout:0/487: symlink d3/da/d7b/lac 0 2024-09-11T00:07:17.112 INFO:tasks.workunit.client.0.smithi111.stdout:6/398: mknod d7/d2b/d35/d41/c84 0 2024-09-11T00:07:17.114 INFO:tasks.workunit.client.0.smithi111.stdout:0/488: write d3/d74/f7d [118949,121576] 0 2024-09-11T00:07:17.114 INFO:tasks.workunit.client.0.smithi111.stdout:4/423: rename d18/d1f/d36/f38 to d18/d20/d4e/f88 0 2024-09-11T00:07:17.116 INFO:tasks.workunit.client.0.smithi111.stdout:7/445: rmdir dd/d1d/d2d 39 2024-09-11T00:07:17.117 INFO:tasks.workunit.client.0.smithi111.stdout:4/424: write d18/d3b/d61/f87 [473474,18923] 0 2024-09-11T00:07:17.118 INFO:tasks.workunit.client.0.smithi111.stdout:7/446: stat dd/d1d/d4d/c77 0 2024-09-11T00:07:17.119 INFO:tasks.workunit.client.0.smithi111.stdout:4/425: readlink d18/l28 0 2024-09-11T00:07:17.120 INFO:tasks.workunit.client.0.smithi111.stdout:3/475: truncate d1c/d1d/f20 119006 0 2024-09-11T00:07:17.122 INFO:tasks.workunit.client.1.smithi203.stdout:5/554: dread dc/dd/d56/dad/f4a [0,4194304] 0 2024-09-11T00:07:17.123 INFO:tasks.workunit.client.0.smithi111.stdout:5/470: dwrite d10/f6b [0,4194304] 0 2024-09-11T00:07:17.126 INFO:tasks.workunit.client.0.smithi111.stdout:0/489: dread - d3/d13/d1e/d29/d49/d51/d61/d93/f97 zero size 2024-09-11T00:07:17.126 INFO:tasks.workunit.client.0.smithi111.stdout:4/426: dread - d18/d1f/f2e zero size 2024-09-11T00:07:17.127 INFO:tasks.workunit.client.0.smithi111.stdout:6/399: creat d7/d22/d2d/d4a/f85 x:0 0 0 2024-09-11T00:07:17.127 INFO:tasks.workunit.client.1.smithi203.stdout:7/453: dread dd/d3b/d5b/f8e [0,4194304] 0 2024-09-11T00:07:17.129 INFO:tasks.workunit.client.1.smithi203.stdout:5/555: link dc/dd/f32 dc/dd/d1e/fbc 0 2024-09-11T00:07:17.129 INFO:tasks.workunit.client.1.smithi203.stdout:7/454: chown dd/d1c/l34 1090 1 2024-09-11T00:07:17.131 INFO:tasks.workunit.client.0.smithi111.stdout:1/417: dwrite d2/de/f5e [0,4194304] 0 2024-09-11T00:07:17.131 INFO:tasks.workunit.client.0.smithi111.stdout:2/443: write d0/d3/de/f44 [1726033,102111] 0 2024-09-11T00:07:17.132 INFO:tasks.workunit.client.1.smithi203.stdout:7/455: chown dd/d1c/d52/d8f/f4f 36 1 2024-09-11T00:07:17.137 INFO:tasks.workunit.client.1.smithi203.stdout:5/556: rename dc/dd/d4d to dc/dd/d15/dbd 0 2024-09-11T00:07:17.140 INFO:tasks.workunit.client.0.smithi111.stdout:1/418: truncate d2/d7c/f1a 2679831 0 2024-09-11T00:07:17.141 INFO:tasks.workunit.client.1.smithi203.stdout:3/545: sync 2024-09-11T00:07:17.141 INFO:tasks.workunit.client.1.smithi203.stdout:9/454: sync 2024-09-11T00:07:17.141 INFO:tasks.workunit.client.1.smithi203.stdout:8/438: sync 2024-09-11T00:07:17.142 INFO:tasks.workunit.client.1.smithi203.stdout:0/452: sync 2024-09-11T00:07:17.143 INFO:tasks.workunit.client.0.smithi111.stdout:8/490: sync 2024-09-11T00:07:17.143 INFO:tasks.workunit.client.1.smithi203.stdout:7/456: read dd/f18 [3712348,59812] 0 2024-09-11T00:07:17.143 INFO:tasks.workunit.client.1.smithi203.stdout:5/557: write dc/dd/d15/d3b/d7a/f9e [829959,36968] 0 2024-09-11T00:07:17.145 INFO:tasks.workunit.client.1.smithi203.stdout:7/457: write dd/d1c/f5f [463612,118132] 0 2024-09-11T00:07:17.147 INFO:tasks.workunit.client.0.smithi111.stdout:2/444: write d0/d3/de/f51 [3426646,80967] 0 2024-09-11T00:07:17.152 INFO:tasks.workunit.client.0.smithi111.stdout:4/427: rename d18/d1f/f25 to d18/d20/d40/d78/d79/f89 0 2024-09-11T00:07:17.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:17 smithi111 ceph-mon[27539]: mgrmap e25: smithi203.smuspl(active, since 6s) 2024-09-11T00:07:17.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:17 smithi111 ceph-mon[27539]: from='client.24519 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:07:17.153 INFO:tasks.workunit.client.1.smithi203.stdout:3/546: mknod d8/d3c/cc4 0 2024-09-11T00:07:17.154 INFO:tasks.workunit.client.0.smithi111.stdout:5/471: dread d10/f6b [0,4194304] 0 2024-09-11T00:07:17.157 INFO:tasks.workunit.client.1.smithi203.stdout:7/458: dread dd/d4d/f5a [4194304,4194304] 0 2024-09-11T00:07:17.163 INFO:tasks.workunit.client.0.smithi111.stdout:1/419: symlink d2/de/d12/d3c/d4b/d6a/d63/d73/l91 0 2024-09-11T00:07:17.164 INFO:tasks.workunit.client.0.smithi111.stdout:6/400: mknod d7/d22/d3f/d74/d7f/d79/c86 0 2024-09-11T00:07:17.167 INFO:tasks.workunit.client.1.smithi203.stdout:5/558: dread dc/dd/d1e/f29 [4194304,4194304] 0 2024-09-11T00:07:17.168 INFO:tasks.workunit.client.0.smithi111.stdout:1/420: fsync d2/de/d12/d3c/d4b/d6a/d3a/f6b 0 2024-09-11T00:07:17.170 INFO:tasks.workunit.client.0.smithi111.stdout:2/445: dwrite d0/d3/d2e/f66 [0,4194304] 0 2024-09-11T00:07:17.171 INFO:tasks.workunit.client.1.smithi203.stdout:9/455: symlink d6/de/d19/d5b/l8b 0 2024-09-11T00:07:17.172 INFO:tasks.workunit.client.0.smithi111.stdout:5/472: dread d10/d1e/d23/d26/f34 [0,4194304] 0 2024-09-11T00:07:17.173 INFO:tasks.workunit.client.0.smithi111.stdout:2/446: chown d0/d3/f13 6 1 2024-09-11T00:07:17.174 INFO:tasks.workunit.client.0.smithi111.stdout:4/428: creat d18/d20/d40/d78/d79/f8a x:0 0 0 2024-09-11T00:07:17.175 INFO:tasks.workunit.client.0.smithi111.stdout:4/429: readlink d18/l1c 0 2024-09-11T00:07:17.176 INFO:tasks.workunit.client.0.smithi111.stdout:4/430: readlink d18/d20/d40/l4d 0 2024-09-11T00:07:17.179 INFO:tasks.workunit.client.0.smithi111.stdout:6/401: dread d7/d22/d3f/f54 [0,4194304] 0 2024-09-11T00:07:17.182 INFO:tasks.workunit.client.0.smithi111.stdout:6/402: chown l5 333241765 1 2024-09-11T00:07:17.182 INFO:tasks.workunit.client.0.smithi111.stdout:3/476: rmdir d1c/d1d/d22/d44/d5a/d74/d7b/d99 0 2024-09-11T00:07:17.186 INFO:tasks.workunit.client.0.smithi111.stdout:3/477: write d1c/d21/f7d [1273775,89693] 0 2024-09-11T00:07:17.186 INFO:tasks.workunit.client.1.smithi203.stdout:3/547: rmdir d8/da/d5c/d6b/d8e 0 2024-09-11T00:07:17.188 INFO:tasks.workunit.client.0.smithi111.stdout:8/491: dwrite d11/d23/d2c/d46/f4d [4194304,4194304] 0 2024-09-11T00:07:17.188 INFO:tasks.workunit.client.0.smithi111.stdout:5/473: unlink d10/f27 0 2024-09-11T00:07:17.189 INFO:tasks.workunit.client.1.smithi203.stdout:7/459: creat dd/fa7 x:0 0 0 2024-09-11T00:07:17.189 INFO:tasks.workunit.client.1.smithi203.stdout:0/453: dwrite d0/d1d/f2e [0,4194304] 0 2024-09-11T00:07:17.190 INFO:tasks.workunit.client.0.smithi111.stdout:5/474: stat d10/d1e/d23/f48 0 2024-09-11T00:07:17.194 INFO:tasks.workunit.client.0.smithi111.stdout:6/403: dread d7/d22/d3f/d74/d7f/d61/f81 [0,4194304] 0 2024-09-11T00:07:17.203 INFO:tasks.workunit.client.1.smithi203.stdout:3/548: mkdir d8/da/d5c/d6b/dc5 0 2024-09-11T00:07:17.203 INFO:tasks.workunit.client.0.smithi111.stdout:2/447: mknod d0/d3/d12/d52/c9e 0 2024-09-11T00:07:17.207 INFO:tasks.workunit.client.1.smithi203.stdout:7/460: symlink dd/d3b/la8 0 2024-09-11T00:07:17.209 INFO:tasks.workunit.client.1.smithi203.stdout:5/559: dread dc/dd/f89 [0,4194304] 0 2024-09-11T00:07:17.210 INFO:tasks.workunit.client.1.smithi203.stdout:0/454: symlink d0/d2/d7e/d83/l91 0 2024-09-11T00:07:17.210 INFO:tasks.workunit.client.1.smithi203.stdout:9/456: creat d6/f8c x:0 0 0 2024-09-11T00:07:17.222 INFO:tasks.workunit.client.1.smithi203.stdout:7/461: rename dd/d1c/d52/d8f/l28 to dd/d1c/d52/d8f/d31/la9 0 2024-09-11T00:07:17.226 INFO:tasks.workunit.client.0.smithi111.stdout:5/475: rmdir d10/d1e/d25/d6e 39 2024-09-11T00:07:17.229 INFO:tasks.workunit.client.0.smithi111.stdout:5/476: fdatasync d10/d1e/d23/d2b/f33 0 2024-09-11T00:07:17.229 INFO:tasks.workunit.client.1.smithi203.stdout:9/457: creat d6/de/d47/f8d x:0 0 0 2024-09-11T00:07:17.230 INFO:tasks.workunit.client.0.smithi111.stdout:6/404: rename d7/d2b/d35 to d7/d22/d26/d87 0 2024-09-11T00:07:17.232 INFO:tasks.workunit.client.0.smithi111.stdout:0/490: getdents d3/d13/d1e/d29/d70 0 2024-09-11T00:07:17.233 INFO:tasks.workunit.client.1.smithi203.stdout:3/549: write d8/da/db3/f54 [930228,2048] 0 2024-09-11T00:07:17.235 INFO:tasks.workunit.client.0.smithi111.stdout:5/477: symlink d10/d1e/d23/d2b/d5c/d61/l97 0 2024-09-11T00:07:17.236 INFO:tasks.workunit.client.0.smithi111.stdout:1/421: dread d2/de/d12/f26 [0,4194304] 0 2024-09-11T00:07:17.239 INFO:tasks.workunit.client.0.smithi111.stdout:8/492: creat d11/f9c x:0 0 0 2024-09-11T00:07:17.241 INFO:tasks.workunit.client.0.smithi111.stdout:0/491: rename d3/d13/d1e/f7f to d3/d1c/fad 0 2024-09-11T00:07:17.242 INFO:tasks.workunit.client.0.smithi111.stdout:1/422: dread - d2/de/f53 zero size 2024-09-11T00:07:17.243 INFO:tasks.workunit.client.1.smithi203.stdout:5/560: getdents dc/dd 0 2024-09-11T00:07:17.243 INFO:tasks.workunit.client.1.smithi203.stdout:0/455: rename d0/d2/d7e/d83 to d0/d2/d92 0 2024-09-11T00:07:17.244 INFO:tasks.workunit.client.1.smithi203.stdout:7/462: rename dd/d1c/d52/d8f/d31/d58 to dd/d1c/d52/d8f/d31/d58/daa 22 2024-09-11T00:07:17.245 INFO:tasks.workunit.client.0.smithi111.stdout:8/493: unlink d11/d21/d6f/f87 0 2024-09-11T00:07:17.245 INFO:tasks.workunit.client.1.smithi203.stdout:0/456: dread - d0/d1d/d4c/f6f zero size 2024-09-11T00:07:17.246 INFO:tasks.workunit.client.1.smithi203.stdout:7/463: chown dd/f22 4632 1 2024-09-11T00:07:17.246 INFO:tasks.workunit.client.1.smithi203.stdout:5/561: stat dc/d4f/d5c/fb8 0 2024-09-11T00:07:17.247 INFO:tasks.workunit.client.1.smithi203.stdout:0/457: chown d0/d2/f3 1 1 2024-09-11T00:07:17.248 INFO:tasks.workunit.client.1.smithi203.stdout:9/458: getdents d6/de 0 2024-09-11T00:07:17.249 INFO:tasks.workunit.client.1.smithi203.stdout:5/562: chown dc/dd/d15/l1f 144765139 1 2024-09-11T00:07:17.251 INFO:tasks.workunit.client.1.smithi203.stdout:3/550: rename d8/da/d37/d83/d65/f7c to d8/d2a/fc6 0 2024-09-11T00:07:17.256 INFO:tasks.workunit.client.0.smithi111.stdout:1/423: dread d2/de/f5e [0,4194304] 0 2024-09-11T00:07:17.257 INFO:tasks.workunit.client.0.smithi111.stdout:0/492: getdents d3/d13/d87 0 2024-09-11T00:07:17.258 INFO:tasks.workunit.client.0.smithi111.stdout:6/405: dread d7/f5a [0,4194304] 0 2024-09-11T00:07:17.259 INFO:tasks.workunit.client.1.smithi203.stdout:0/458: creat d0/d2/d67/f93 x:0 0 0 2024-09-11T00:07:17.261 INFO:tasks.workunit.client.1.smithi203.stdout:9/459: symlink d6/de/l8e 0 2024-09-11T00:07:17.263 INFO:tasks.workunit.client.0.smithi111.stdout:0/493: rmdir d3/d1c/d50 39 2024-09-11T00:07:17.265 INFO:tasks.workunit.client.0.smithi111.stdout:8/494: creat d11/f9d x:0 0 0 2024-09-11T00:07:17.267 INFO:tasks.workunit.client.0.smithi111.stdout:1/424: creat d2/de/d12/d3c/d4b/d6a/d3a/f92 x:0 0 0 2024-09-11T00:07:17.267 INFO:tasks.workunit.client.1.smithi203.stdout:3/551: read d8/d2a/f40 [1957203,110902] 0 2024-09-11T00:07:17.269 INFO:tasks.workunit.client.0.smithi111.stdout:6/406: creat d7/d22/d1d/f88 x:0 0 0 2024-09-11T00:07:17.269 INFO:tasks.workunit.client.1.smithi203.stdout:5/563: dwrite dc/d91/fa3 [4194304,4194304] 0 2024-09-11T00:07:17.272 INFO:tasks.workunit.client.1.smithi203.stdout:7/464: dread dd/d3b/f72 [0,4194304] 0 2024-09-11T00:07:17.272 INFO:tasks.workunit.client.1.smithi203.stdout:5/564: chown dc/dd/d15/dbd/f6a 6714640 1 2024-09-11T00:07:17.273 INFO:tasks.workunit.client.1.smithi203.stdout:0/459: unlink d0/d2/d3d/d5a/d77/c78 0 2024-09-11T00:07:17.280 INFO:tasks.workunit.client.0.smithi111.stdout:1/425: dread d2/de/f5e [0,4194304] 0 2024-09-11T00:07:17.285 INFO:tasks.workunit.client.0.smithi111.stdout:1/426: mkdir d2/de/d93 0 2024-09-11T00:07:17.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:17 smithi203 ceph-mon[33225]: mgrmap e25: smithi203.smuspl(active, since 6s) 2024-09-11T00:07:17.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:17 smithi203 ceph-mon[33225]: from='client.24519 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:07:17.296 INFO:tasks.workunit.client.1.smithi203.stdout:5/565: dwrite dc/d4f/fa0 [0,4194304] 0 2024-09-11T00:07:17.305 INFO:tasks.workunit.client.0.smithi111.stdout:8/495: dwrite d11/d23/d2c/d46/f69 [0,4194304] 0 2024-09-11T00:07:17.306 INFO:tasks.workunit.client.1.smithi203.stdout:5/566: rename dc/dd/d13/f5d to dc/dd/d15/dbd/d59/da8/fbe 0 2024-09-11T00:07:17.307 INFO:tasks.workunit.client.0.smithi111.stdout:0/494: dwrite d3/d13/d1e/d29/d70/fa2 [0,4194304] 0 2024-09-11T00:07:17.308 INFO:tasks.workunit.client.0.smithi111.stdout:1/427: dread d2/de/f43 [0,4194304] 0 2024-09-11T00:07:17.314 INFO:tasks.workunit.client.1.smithi203.stdout:0/460: dread d0/d2/f7a [0,4194304] 0 2024-09-11T00:07:17.315 INFO:tasks.workunit.client.0.smithi111.stdout:0/495: creat d3/d74/fae x:0 0 0 2024-09-11T00:07:17.318 INFO:tasks.workunit.client.0.smithi111.stdout:8/496: rename d11/d23/f98 to d11/d21/d38/f9e 0 2024-09-11T00:07:17.320 INFO:tasks.workunit.client.0.smithi111.stdout:1/428: rmdir d2/de/d12/d3c/d4b 39 2024-09-11T00:07:17.325 INFO:tasks.workunit.client.1.smithi203.stdout:0/461: stat d0/d2/d67/c74 0 2024-09-11T00:07:17.325 INFO:tasks.workunit.client.0.smithi111.stdout:6/407: dread d7/f23 [0,4194304] 0 2024-09-11T00:07:17.330 INFO:tasks.workunit.client.1.smithi203.stdout:0/462: fsync d0/d2/d37/f53 0 2024-09-11T00:07:17.331 INFO:tasks.workunit.client.1.smithi203.stdout:9/460: dread d6/de/d19/d24/d40/d45/f15 [0,4194304] 0 2024-09-11T00:07:17.332 INFO:tasks.workunit.client.0.smithi111.stdout:6/408: rmdir d7/d22/d26/d87/d41 39 2024-09-11T00:07:17.333 INFO:tasks.workunit.client.0.smithi111.stdout:0/496: mkdir d3/daf 0 2024-09-11T00:07:17.337 INFO:tasks.workunit.client.0.smithi111.stdout:6/409: mknod d7/d22/d2c/d38/c89 0 2024-09-11T00:07:17.338 INFO:tasks.workunit.client.0.smithi111.stdout:1/429: dread d2/f1f [0,4194304] 0 2024-09-11T00:07:17.338 INFO:tasks.workunit.client.1.smithi203.stdout:9/461: unlink d6/de/d32/c70 0 2024-09-11T00:07:17.339 INFO:tasks.workunit.client.0.smithi111.stdout:0/497: truncate d3/d1c/d50/f5f 925024 0 2024-09-11T00:07:17.339 INFO:tasks.workunit.client.0.smithi111.stdout:6/410: write d7/d22/d2d/d4a/f85 [640939,97485] 0 2024-09-11T00:07:17.341 INFO:tasks.workunit.client.0.smithi111.stdout:6/411: chown d7/d22/d2c/d38 1963 1 2024-09-11T00:07:17.342 INFO:tasks.workunit.client.1.smithi203.stdout:0/463: rename d0/d1d/f3f to d0/d2/d67/f94 0 2024-09-11T00:07:17.345 INFO:tasks.workunit.client.1.smithi203.stdout:9/462: readlink d6/de/d19/d21/l78 0 2024-09-11T00:07:17.347 INFO:tasks.workunit.client.1.smithi203.stdout:9/463: dread - d6/de/d32/d52/d44/f81 zero size 2024-09-11T00:07:17.347 INFO:tasks.workunit.client.1.smithi203.stdout:5/567: dwrite dc/dd/d1e/f27 [0,4194304] 0 2024-09-11T00:07:17.349 INFO:tasks.workunit.client.0.smithi111.stdout:6/412: creat d7/d22/d26/f8a x:0 0 0 2024-09-11T00:07:17.355 INFO:tasks.workunit.client.1.smithi203.stdout:5/568: fdatasync dc/dd/d15/d3b/d7a/f90 0 2024-09-11T00:07:17.360 INFO:tasks.workunit.client.1.smithi203.stdout:0/464: dwrite d0/d2/d3d/d5a/f6e [0,4194304] 0 2024-09-11T00:07:17.361 INFO:tasks.workunit.client.0.smithi111.stdout:0/498: truncate d3/d1c/f23 692636 0 2024-09-11T00:07:17.362 INFO:tasks.workunit.client.0.smithi111.stdout:6/413: unlink d7/d22/d2c/f46 0 2024-09-11T00:07:17.366 INFO:tasks.workunit.client.0.smithi111.stdout:0/499: unlink d3/dc/f12 0 2024-09-11T00:07:17.370 INFO:tasks.workunit.client.0.smithi111.stdout:1/430: dwrite d2/fd [0,4194304] 0 2024-09-11T00:07:17.371 INFO:tasks.workunit.client.0.smithi111.stdout:9/492: sync 2024-09-11T00:07:17.374 INFO:tasks.workunit.client.0.smithi111.stdout:0/500: mkdir d3/d13/d1e/d29/db0 0 2024-09-11T00:07:17.374 INFO:tasks.workunit.client.0.smithi111.stdout:6/414: creat d7/d2b/f8b x:0 0 0 2024-09-11T00:07:17.375 INFO:tasks.workunit.client.0.smithi111.stdout:9/493: chown d6/db/d34/d37/f2d 0 1 2024-09-11T00:07:17.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.374+0000 7ff14ea00700 1 -- 172.21.15.111:0/1560813386 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff14802ccd0 con 0x7ff148100be0 2024-09-11T00:07:17.376 INFO:tasks.workunit.client.0.smithi111.stdout:9/494: stat d6/d52/l7b 0 2024-09-11T00:07:17.379 INFO:tasks.workunit.client.0.smithi111.stdout:0/501: fsync d3/d1c/fad 0 2024-09-11T00:07:17.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.378+0000 7ff144c00700 1 -- 172.21.15.111:0/1560813386 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7ff13802d980 con 0x7ff148100be0 2024-09-11T00:07:17.380 INFO:tasks.workunit.client.0.smithi111.stdout:6/415: rmdir d7/d22/d2c/d38 39 2024-09-11T00:07:17.381 INFO:tasks.workunit.client.0.smithi111.stdout:8/497: truncate d11/d21/d38/f5e 1287659 0 2024-09-11T00:07:17.383 INFO:tasks.workunit.client.0.smithi111.stdout:9/495: unlink d6/db/d34/l5d 0 2024-09-11T00:07:17.384 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:07:17.384 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-11T00:07:17.384 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-11T00:07:17.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:07:17.384 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-11T00:07:17.384 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 1 2024-09-11T00:07:17.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:07:17.384 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-11T00:07:17.385 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-11T00:07:17.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:07:17.385 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-11T00:07:17.385 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-11T00:07:17.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:07:17.385 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-11T00:07:17.385 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-11T00:07:17.385 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 1 2024-09-11T00:07:17.385 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-11T00:07:17.385 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:07:17.386 INFO:tasks.workunit.client.0.smithi111.stdout:0/502: rename d3 to d3/d1c/db1 22 2024-09-11T00:07:17.386 INFO:tasks.workunit.client.0.smithi111.stdout:6/416: rmdir d7/d22/d26 39 2024-09-11T00:07:17.387 INFO:tasks.workunit.client.1.smithi203.stdout:9/464: creat d6/de/d19/d24/f8f x:0 0 0 2024-09-11T00:07:17.388 INFO:tasks.workunit.client.0.smithi111.stdout:9/496: write d6/db/d34/d37/f2d [4505594,109857] 0 2024-09-11T00:07:17.388 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.386+0000 7ff14ea00700 1 -- 172.21.15.111:0/1560813386 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7ff12c03f660 msgr2=0x7ff12c041b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:17.388 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.386+0000 7ff14ea00700 1 --2- 172.21.15.111:0/1560813386 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7ff12c03f660 0x7ff12c041b10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff134006fd0 tx=0x7ff134008040 comp rx=0 tx=0).stop 2024-09-11T00:07:17.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.386+0000 7ff14ea00700 1 -- 172.21.15.111:0/1560813386 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff148100be0 msgr2=0x7ff1481959c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:17.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.386+0000 7ff14ea00700 1 --2- 172.21.15.111:0/1560813386 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff148100be0 0x7ff1481959c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff138009fd0 tx=0x7ff13800be20 comp rx=0 tx=0).stop 2024-09-11T00:07:17.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.387+0000 7ff14ea00700 1 -- 172.21.15.111:0/1560813386 shutdown_connections 2024-09-11T00:07:17.390 INFO:tasks.workunit.client.1.smithi203.stdout:5/569: creat dc/d9f/fbf x:0 0 0 2024-09-11T00:07:17.390 INFO:tasks.workunit.client.1.smithi203.stdout:0/465: dread - d0/d1d/d5d/f71 zero size 2024-09-11T00:07:17.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.387+0000 7ff14ea00700 1 --2- 172.21.15.111:0/1560813386 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7ff12c03f660 0x7ff12c041b10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.387+0000 7ff14ea00700 1 --2- 172.21.15.111:0/1560813386 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff148100be0 0x7ff1481959c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.387+0000 7ff14ea00700 1 --2- 172.21.15.111:0/1560813386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff148103500 0x7ff148195f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.387+0000 7ff14ea00700 1 -- 172.21.15.111:0/1560813386 >> 172.21.15.111:0/1560813386 conn(0x7ff1480fa5e0 msgr2=0x7ff1480fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:17.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.387+0000 7ff14ea00700 1 -- 172.21.15.111:0/1560813386 shutdown_connections 2024-09-11T00:07:17.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.387+0000 7ff14ea00700 1 -- 172.21.15.111:0/1560813386 wait complete. 2024-09-11T00:07:17.391 INFO:tasks.workunit.client.0.smithi111.stdout:8/498: mknod d11/d23/d2c/c9f 0 2024-09-11T00:07:17.392 INFO:tasks.workunit.client.1.smithi203.stdout:9/465: creat d6/de/d19/d21/d87/f90 x:0 0 0 2024-09-11T00:07:17.394 INFO:tasks.workunit.client.1.smithi203.stdout:0/466: unlink d0/f29 0 2024-09-11T00:07:17.395 INFO:tasks.workunit.client.1.smithi203.stdout:0/467: readlink d0/d2/d92/l86 0 2024-09-11T00:07:17.397 INFO:tasks.workunit.client.0.smithi111.stdout:8/499: mknod d11/d23/d2c/ca0 0 2024-09-11T00:07:17.399 INFO:tasks.workunit.client.1.smithi203.stdout:9/466: mknod d6/de/d19/d24/d54/c91 0 2024-09-11T00:07:17.400 INFO:tasks.workunit.client.1.smithi203.stdout:0/468: creat d0/d2/d3d/d5a/d77/f95 x:0 0 0 2024-09-11T00:07:17.400 INFO:tasks.workunit.client.1.smithi203.stdout:5/570: getdents dc/d4f/d5c 0 2024-09-11T00:07:17.402 INFO:tasks.workunit.client.1.smithi203.stdout:9/467: read - d6/de/f85 zero size 2024-09-11T00:07:17.402 INFO:tasks.workunit.client.0.smithi111.stdout:1/431: dwrite d2/d2b/f75 [4194304,4194304] 0 2024-09-11T00:07:17.409 INFO:tasks.workunit.client.1.smithi203.stdout:4/432: sync 2024-09-11T00:07:17.410 INFO:tasks.workunit.client.0.smithi111.stdout:6/417: dwrite d7/d22/d1d/f75 [0,4194304] 0 2024-09-11T00:07:17.411 INFO:tasks.workunit.client.0.smithi111.stdout:8/500: unlink d11/d21/c7c 0 2024-09-11T00:07:17.416 INFO:tasks.workunit.client.0.smithi111.stdout:9/497: getdents d6 0 2024-09-11T00:07:17.418 INFO:tasks.workunit.client.1.smithi203.stdout:5/571: mknod dc/dd/cc0 0 2024-09-11T00:07:17.423 INFO:tasks.workunit.client.0.smithi111.stdout:0/503: dread d3/d13/d1e/d29/f2d [0,4194304] 0 2024-09-11T00:07:17.428 INFO:tasks.workunit.client.0.smithi111.stdout:6/418: truncate d7/d22/d1d/f27 611969 0 2024-09-11T00:07:17.428 INFO:tasks.workunit.client.0.smithi111.stdout:9/498: creat d6/fa5 x:0 0 0 2024-09-11T00:07:17.432 INFO:tasks.workunit.client.1.smithi203.stdout:0/469: dread d0/d2/d3d/d5a/f7c [0,4194304] 0 2024-09-11T00:07:17.434 INFO:tasks.workunit.client.1.smithi203.stdout:0/470: symlink d0/d2/d7e/l96 0 2024-09-11T00:07:17.438 INFO:tasks.workunit.client.0.smithi111.stdout:8/501: creat d11/fa1 x:0 0 0 2024-09-11T00:07:17.439 INFO:tasks.workunit.client.0.smithi111.stdout:1/432: truncate d2/de/d12/d3c/d4b/d6a/d3a/f3b 1222831 0 2024-09-11T00:07:17.440 INFO:tasks.workunit.client.1.smithi203.stdout:0/471: creat d0/d2/d67/d8d/f97 x:0 0 0 2024-09-11T00:07:17.445 INFO:tasks.workunit.client.0.smithi111.stdout:1/433: truncate d2/f6f 265614 0 2024-09-11T00:07:17.445 INFO:tasks.workunit.client.1.smithi203.stdout:0/472: symlink d0/d1d/d4c/l98 0 2024-09-11T00:07:17.446 INFO:tasks.workunit.client.0.smithi111.stdout:0/504: dwrite d3/d13/f89 [0,4194304] 0 2024-09-11T00:07:17.447 INFO:tasks.workunit.client.1.smithi203.stdout:0/473: dread - d0/d1d/d4c/f6f zero size 2024-09-11T00:07:17.447 INFO:tasks.workunit.client.1.smithi203.stdout:4/433: dread db/f3d [0,4194304] 0 2024-09-11T00:07:17.448 INFO:tasks.workunit.client.0.smithi111.stdout:6/419: dwrite d7/d22/d1d/f75 [0,4194304] 0 2024-09-11T00:07:17.451 INFO:tasks.workunit.client.1.smithi203.stdout:5/572: creat dc/dd/d15/d3b/fc1 x:0 0 0 2024-09-11T00:07:17.453 INFO:tasks.workunit.client.1.smithi203.stdout:9/468: truncate d6/de/d19/d24/f36 797826 0 2024-09-11T00:07:17.463 INFO:tasks.workunit.client.0.smithi111.stdout:6/420: rmdir d7/d22/d3f/d74/d7f/d61/d6a 39 2024-09-11T00:07:17.467 INFO:tasks.workunit.client.0.smithi111.stdout:7/447: sync 2024-09-11T00:07:17.467 INFO:tasks.workunit.client.1.smithi203.stdout:0/474: getdents d0/d2 0 2024-09-11T00:07:17.472 INFO:tasks.workunit.client.0.smithi111.stdout:0/505: mkdir d3/daf/db2 0 2024-09-11T00:07:17.473 INFO:tasks.workunit.client.0.smithi111.stdout:1/434: link d2/fd d2/d2b/d2c/d56/d7b/d87/f94 0 2024-09-11T00:07:17.476 INFO:tasks.workunit.client.1.smithi203.stdout:0/475: creat d0/d2/d37/d5b/d73/f99 x:0 0 0 2024-09-11T00:07:17.477 INFO:tasks.workunit.client.1.smithi203.stdout:0/476: fdatasync d0/d1d/f90 0 2024-09-11T00:07:17.478 INFO:tasks.workunit.client.1.smithi203.stdout:4/434: rename db/dd/d26/f60 to db/d12/d15/d2a/f8b 0 2024-09-11T00:07:17.479 INFO:tasks.workunit.client.0.smithi111.stdout:8/502: dwrite d11/d21/d38/f47 [0,4194304] 0 2024-09-11T00:07:17.480 INFO:tasks.workunit.client.1.smithi203.stdout:4/435: truncate db/dd/d26/f76 728412 0 2024-09-11T00:07:17.481 INFO:tasks.workunit.client.1.smithi203.stdout:9/469: creat d6/de/d32/d52/f92 x:0 0 0 2024-09-11T00:07:17.482 INFO:tasks.workunit.client.0.smithi111.stdout:1/435: fdatasync d2/f10 0 2024-09-11T00:07:17.484 INFO:tasks.workunit.client.0.smithi111.stdout:6/421: dwrite d7/f30 [0,4194304] 0 2024-09-11T00:07:17.485 INFO:tasks.workunit.client.1.smithi203.stdout:0/477: mknod d0/d1d/d4c/c9a 0 2024-09-11T00:07:17.486 INFO:tasks.workunit.client.0.smithi111.stdout:9/499: mknod d6/db/d1b/ca6 0 2024-09-11T00:07:17.486 INFO:tasks.workunit.client.0.smithi111.stdout:0/506: mkdir d3/da/d7b/db3 0 2024-09-11T00:07:17.487 INFO:tasks.workunit.client.1.smithi203.stdout:9/470: creat d6/de/d19/d21/f93 x:0 0 0 2024-09-11T00:07:17.488 INFO:tasks.workunit.client.0.smithi111.stdout:1/436: truncate d2/de/d12/d3c/f69 169034 0 2024-09-11T00:07:17.489 INFO:tasks.workunit.client.1.smithi203.stdout:9/471: stat d6/de/d19/d21/f93 0 2024-09-11T00:07:17.491 INFO:tasks.workunit.client.1.smithi203.stdout:9/472: chown d6/f8c 3 1 2024-09-11T00:07:17.492 INFO:tasks.workunit.client.0.smithi111.stdout:8/503: symlink d11/d21/la2 0 2024-09-11T00:07:17.493 INFO:tasks.workunit.client.1.smithi203.stdout:9/473: chown d6/de/d19/d21/f7b 319041 1 2024-09-11T00:07:17.496 INFO:tasks.workunit.client.0.smithi111.stdout:7/448: link dd/d49/c5a dd/d1d/d4d/d82/c90 0 2024-09-11T00:07:17.501 INFO:tasks.workunit.client.0.smithi111.stdout:0/507: fdatasync d3/d13/f6f 0 2024-09-11T00:07:17.502 INFO:tasks.workunit.client.1.smithi203.stdout:5/573: truncate dc/dd/d1e/f54 2471755 0 2024-09-11T00:07:17.503 INFO:tasks.workunit.client.0.smithi111.stdout:1/437: write d2/f10 [1585150,35775] 0 2024-09-11T00:07:17.506 INFO:tasks.workunit.client.1.smithi203.stdout:9/474: mknod d6/de/d47/c94 0 2024-09-11T00:07:17.510 INFO:tasks.workunit.client.1.smithi203.stdout:4/436: dread db/d12/d15/d2a/f87 [0,4194304] 0 2024-09-11T00:07:17.510 INFO:tasks.workunit.client.0.smithi111.stdout:7/449: chown dd/d1d/d2d/d2e/l56 108578051 1 2024-09-11T00:07:17.510 INFO:tasks.workunit.client.0.smithi111.stdout:9/500: dwrite d6/db/d1b/f1e [0,4194304] 0 2024-09-11T00:07:17.511 INFO:tasks.workunit.client.1.smithi203.stdout:9/475: symlink d6/de/d32/d52/d55/d66/d80/l95 0 2024-09-11T00:07:17.514 INFO:tasks.workunit.client.0.smithi111.stdout:0/508: fdatasync d3/d13/d1e/d29/f9a 0 2024-09-11T00:07:17.514 INFO:tasks.workunit.client.1.smithi203.stdout:5/574: link dc/dd/d15/faf dc/d2b/fc2 0 2024-09-11T00:07:17.516 INFO:tasks.workunit.client.0.smithi111.stdout:1/438: mkdir d2/de/d12/d3c/d4b/d6a/d63/d95 0 2024-09-11T00:07:17.516 INFO:tasks.workunit.client.0.smithi111.stdout:7/450: chown dd/d1d/d76 463036 1 2024-09-11T00:07:17.518 INFO:tasks.workunit.client.1.smithi203.stdout:9/476: unlink d6/de/d32/d52/d44/f5e 0 2024-09-11T00:07:17.520 INFO:tasks.workunit.client.1.smithi203.stdout:5/575: unlink dc/dd/d15/d3b/d7a/ca2 0 2024-09-11T00:07:17.524 INFO:tasks.workunit.client.0.smithi111.stdout:9/501: write d6/db/d34/f65 [1026154,32606] 0 2024-09-11T00:07:17.525 INFO:tasks.workunit.client.1.smithi203.stdout:4/437: rename db/l32 to db/d12/d15/d2a/d71/l8c 0 2024-09-11T00:07:17.526 INFO:tasks.workunit.client.1.smithi203.stdout:5/576: write dc/dd/d1e/f27 [2390643,80088] 0 2024-09-11T00:07:17.526 INFO:tasks.workunit.client.0.smithi111.stdout:9/502: dread d6/db/d1b/d56/f6b [0,4194304] 0 2024-09-11T00:07:17.527 INFO:tasks.workunit.client.1.smithi203.stdout:0/478: dwrite d0/d1d/f69 [0,4194304] 0 2024-09-11T00:07:17.530 INFO:tasks.workunit.client.0.smithi111.stdout:1/439: creat d2/de/d82/f96 x:0 0 0 2024-09-11T00:07:17.537 INFO:tasks.workunit.client.0.smithi111.stdout:1/440: mkdir d2/d2b/d2c/d97 0 2024-09-11T00:07:17.541 INFO:tasks.workunit.client.1.smithi203.stdout:9/477: creat d6/f96 x:0 0 0 2024-09-11T00:07:17.542 INFO:tasks.workunit.client.0.smithi111.stdout:8/504: dread d11/f1b [0,4194304] 0 2024-09-11T00:07:17.544 INFO:tasks.workunit.client.0.smithi111.stdout:9/503: chown d6/dc/d7c/f9c 5473941 1 2024-09-11T00:07:17.546 INFO:tasks.workunit.client.0.smithi111.stdout:0/509: getdents d3 0 2024-09-11T00:07:17.551 INFO:tasks.workunit.client.0.smithi111.stdout:1/441: mknod d2/c98 0 2024-09-11T00:07:17.555 INFO:tasks.workunit.client.0.smithi111.stdout:7/451: dwrite dd/d1d/d2d/f89 [0,4194304] 0 2024-09-11T00:07:17.557 INFO:tasks.workunit.client.0.smithi111.stdout:8/505: write d11/d21/d38/f57 [1639550,88752] 0 2024-09-11T00:07:17.557 INFO:tasks.workunit.client.0.smithi111.stdout:9/504: rename d6/db/d7a/fa3 to d6/db/d1b/d56/fa7 0 2024-09-11T00:07:17.557 INFO:tasks.workunit.client.0.smithi111.stdout:8/506: stat d11/d21/c3a 0 2024-09-11T00:07:17.558 INFO:tasks.workunit.client.1.smithi203.stdout:1/524: sync 2024-09-11T00:07:17.559 INFO:tasks.workunit.client.0.smithi111.stdout:1/442: symlink d2/de/d82/l99 0 2024-09-11T00:07:17.560 INFO:tasks.workunit.client.1.smithi203.stdout:5/577: dread dc/dd/d15/f4b [0,4194304] 0 2024-09-11T00:07:17.562 INFO:tasks.workunit.client.1.smithi203.stdout:5/578: chown dc/dd/d1e/d7b 0 1 2024-09-11T00:07:17.563 INFO:tasks.workunit.client.0.smithi111.stdout:0/510: rename d3/d13/l22 to d3/d1c/d50/lb4 0 2024-09-11T00:07:17.563 INFO:tasks.workunit.client.0.smithi111.stdout:1/443: write d2/d7c/f1a [2642946,43634] 0 2024-09-11T00:07:17.565 INFO:tasks.workunit.client.0.smithi111.stdout:7/452: mknod dd/d1d/d2d/d2e/d4e/c91 0 2024-09-11T00:07:17.567 INFO:tasks.workunit.client.0.smithi111.stdout:5/478: sync 2024-09-11T00:07:17.567 INFO:tasks.workunit.client.0.smithi111.stdout:2/448: sync 2024-09-11T00:07:17.568 INFO:tasks.workunit.client.0.smithi111.stdout:4/431: sync 2024-09-11T00:07:17.569 INFO:tasks.workunit.client.0.smithi111.stdout:3/478: sync 2024-09-11T00:07:17.569 INFO:tasks.workunit.client.0.smithi111.stdout:1/444: write d2/d2b/d2c/d56/f61 [134154,63312] 0 2024-09-11T00:07:17.569 INFO:tasks.workunit.client.1.smithi203.stdout:1/525: rename d8/d9/d15/d27/f2e to d8/d19/d60/d90/d3e/d4b/d80/d8d/db0/fb7 0 2024-09-11T00:07:17.571 INFO:tasks.workunit.client.1.smithi203.stdout:1/526: fdatasync d8/d28/fa9 0 2024-09-11T00:07:17.572 INFO:tasks.workunit.client.1.smithi203.stdout:0/479: truncate d0/d2/f13 3892965 0 2024-09-11T00:07:17.573 INFO:tasks.workunit.client.1.smithi203.stdout:5/579: dread dc/dd/d15/d3b/d7a/f9a [0,4194304] 0 2024-09-11T00:07:17.575 INFO:tasks.workunit.client.1.smithi203.stdout:4/438: dwrite db/dd/d16/d38/d3c/d41/f5a [0,4194304] 0 2024-09-11T00:07:17.578 INFO:tasks.workunit.client.1.smithi203.stdout:9/478: write d6/de/d32/d52/d55/f2b [74878,48432] 0 2024-09-11T00:07:17.578 INFO:tasks.workunit.client.0.smithi111.stdout:3/479: write d1c/d1d/d22/d23/f52 [1579367,56773] 0 2024-09-11T00:07:17.579 INFO:tasks.workunit.client.1.smithi203.stdout:4/439: rmdir db/dd/d26 39 2024-09-11T00:07:17.580 INFO:tasks.workunit.client.1.smithi203.stdout:5/580: chown dc/dd/d13/f14 6 1 2024-09-11T00:07:17.583 INFO:tasks.workunit.client.0.smithi111.stdout:8/507: rename d11/d21/d38/d54/f75 to d11/d23/d3d/d8d/fa3 0 2024-09-11T00:07:17.589 INFO:tasks.workunit.client.0.smithi111.stdout:9/505: dwrite d6/db/f79 [0,4194304] 0 2024-09-11T00:07:17.590 INFO:tasks.workunit.client.0.smithi111.stdout:1/445: unlink d2/de/d12/f26 0 2024-09-11T00:07:17.591 INFO:tasks.workunit.client.0.smithi111.stdout:8/508: write d11/d23/d2c/d46/f63 [1869701,120249] 0 2024-09-11T00:07:17.592 INFO:tasks.workunit.client.1.smithi203.stdout:5/581: rmdir dc/dd 39 2024-09-11T00:07:17.593 INFO:tasks.workunit.client.0.smithi111.stdout:5/479: readlink d10/d1e/d23/d30/l5a 0 2024-09-11T00:07:17.596 INFO:tasks.workunit.client.1.smithi203.stdout:4/440: rmdir db/d12/d15/d2a/d71 39 2024-09-11T00:07:17.599 INFO:tasks.workunit.client.1.smithi203.stdout:1/527: symlink d8/d19/d60/d90/d3e/d4b/d80/d8d/da3/lb8 0 2024-09-11T00:07:17.603 INFO:tasks.workunit.client.0.smithi111.stdout:3/480: mknod d1c/d1d/d22/d23/d58/ca0 0 2024-09-11T00:07:17.606 INFO:tasks.workunit.client.1.smithi203.stdout:9/479: creat d6/de/d19/f97 x:0 0 0 2024-09-11T00:07:17.608 INFO:tasks.workunit.client.1.smithi203.stdout:1/528: mkdir d8/d9/d15/d35/d81/db9 0 2024-09-11T00:07:17.610 INFO:tasks.workunit.client.1.smithi203.stdout:0/480: dwrite d0/d2/f3 [4194304,4194304] 0 2024-09-11T00:07:17.611 INFO:tasks.workunit.client.1.smithi203.stdout:6/432: sync 2024-09-11T00:07:17.611 INFO:tasks.workunit.client.1.smithi203.stdout:7/465: sync 2024-09-11T00:07:17.611 INFO:tasks.workunit.client.1.smithi203.stdout:3/552: sync 2024-09-11T00:07:17.611 INFO:tasks.workunit.client.1.smithi203.stdout:8/439: sync 2024-09-11T00:07:17.611 INFO:tasks.workunit.client.1.smithi203.stdout:2/441: sync 2024-09-11T00:07:17.612 INFO:tasks.workunit.client.1.smithi203.stdout:4/441: symlink db/dd/d26/d42/d5e/l8d 0 2024-09-11T00:07:17.614 INFO:tasks.workunit.client.1.smithi203.stdout:5/582: dwrite dc/d2b/f93 [0,4194304] 0 2024-09-11T00:07:17.616 INFO:tasks.workunit.client.1.smithi203.stdout:6/433: chown d0/d5b/d5c/f69 2037997 1 2024-09-11T00:07:17.617 INFO:tasks.workunit.client.0.smithi111.stdout:8/509: dwrite d11/f12 [4194304,4194304] 0 2024-09-11T00:07:17.618 INFO:tasks.workunit.client.1.smithi203.stdout:0/481: chown d0/d2/l27 1031159545 1 2024-09-11T00:07:17.619 INFO:tasks.workunit.client.1.smithi203.stdout:1/529: unlink d8/d9/d15/d27/l5d 0 2024-09-11T00:07:17.624 INFO:tasks.workunit.client.1.smithi203.stdout:1/530: dread - d8/d19/d60/d90/d3e/d4b/d3a/f4f zero size 2024-09-11T00:07:17.626 INFO:tasks.workunit.client.0.smithi111.stdout:7/453: getdents dd/d1d/d2d/d2e 0 2024-09-11T00:07:17.626 INFO:tasks.workunit.client.0.smithi111.stdout:9/506: symlink d6/db/d34/la8 0 2024-09-11T00:07:17.628 INFO:tasks.workunit.client.1.smithi203.stdout:9/480: truncate d6/de/d32/d52/d44/f79 2078421 0 2024-09-11T00:07:17.628 INFO:tasks.workunit.client.1.smithi203.stdout:1/531: dread - d8/d9/d15/d35/d81/f9e zero size 2024-09-11T00:07:17.628 INFO:tasks.workunit.client.1.smithi203.stdout:9/481: dread - d6/f96 zero size 2024-09-11T00:07:17.628 INFO:tasks.workunit.client.1.smithi203.stdout:4/442: creat db/dd/d16/d38/d3c/d41/f8e x:0 0 0 2024-09-11T00:07:17.629 INFO:tasks.workunit.client.0.smithi111.stdout:4/432: getdents d18/d20 0 2024-09-11T00:07:17.629 INFO:tasks.workunit.client.1.smithi203.stdout:1/532: stat d8/d9/c7f 0 2024-09-11T00:07:17.630 INFO:tasks.workunit.client.0.smithi111.stdout:5/480: dread d10/d1e/d25/f75 [0,4194304] 0 2024-09-11T00:07:17.632 INFO:tasks.workunit.client.0.smithi111.stdout:2/449: rename d0/d3/de/d3b/d62/d6d/f71 to d0/f9f 0 2024-09-11T00:07:17.633 INFO:tasks.workunit.client.0.smithi111.stdout:2/450: readlink d0/l2b 0 2024-09-11T00:07:17.635 INFO:tasks.workunit.client.0.smithi111.stdout:0/511: truncate d3/d13/d1e/f4d 2194777 0 2024-09-11T00:07:17.638 INFO:tasks.workunit.client.0.smithi111.stdout:9/507: truncate d6/dc/f17 4803945 0 2024-09-11T00:07:17.639 INFO:tasks.workunit.client.0.smithi111.stdout:0/512: readlink d3/d13/l25 0 2024-09-11T00:07:17.643 INFO:tasks.workunit.client.0.smithi111.stdout:6/422: sync 2024-09-11T00:07:17.646 INFO:tasks.workunit.client.0.smithi111.stdout:5/481: rename d10/d1e/d23/d2b/d55 to d10/d1e/d23/d26/d3a/d98 0 2024-09-11T00:07:17.648 INFO:tasks.workunit.client.0.smithi111.stdout:2/451: creat d0/d3/de/d50/fa0 x:0 0 0 2024-09-11T00:07:17.648 INFO:tasks.workunit.client.0.smithi111.stdout:0/513: symlink d3/dc/lb5 0 2024-09-11T00:07:17.654 INFO:tasks.workunit.client.0.smithi111.stdout:9/508: readlink d6/db/d1b/d56/l5f 0 2024-09-11T00:07:17.655 INFO:tasks.workunit.client.0.smithi111.stdout:5/482: rmdir d10/d1e 39 2024-09-11T00:07:17.656 INFO:tasks.workunit.client.0.smithi111.stdout:2/452: mkdir d0/d3/de/d3b/d62/d6d/da1 0 2024-09-11T00:07:17.657 INFO:tasks.workunit.client.0.smithi111.stdout:6/423: rename d7/d22/d2d to d7/d22/d1d/d8c 0 2024-09-11T00:07:17.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.656+0000 7f3a7f400700 1 -- 172.21.15.111:0/3097989513 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a78101350 msgr2=0x7f3a781017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:17.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.656+0000 7f3a7f400700 1 --2- 172.21.15.111:0/3097989513 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a78101350 0x7f3a781017a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3a68009910 tx=0x7f3a68009c20 comp rx=0 tx=0).stop 2024-09-11T00:07:17.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.656+0000 7f3a7f400700 1 -- 172.21.15.111:0/3097989513 shutdown_connections 2024-09-11T00:07:17.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.656+0000 7f3a7f400700 1 --2- 172.21.15.111:0/3097989513 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a78101350 0x7f3a781017a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.656+0000 7f3a7f400700 1 --2- 172.21.15.111:0/3097989513 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a78100150 0x7f3a78100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.656+0000 7f3a7f400700 1 -- 172.21.15.111:0/3097989513 >> 172.21.15.111:0/3097989513 conn(0x7f3a780fb6e0 msgr2=0x7f3a780fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:17.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.656+0000 7f3a7f400700 1 -- 172.21.15.111:0/3097989513 shutdown_connections 2024-09-11T00:07:17.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.656+0000 7f3a7f400700 1 -- 172.21.15.111:0/3097989513 wait complete. 2024-09-11T00:07:17.659 INFO:tasks.workunit.client.0.smithi111.stdout:4/433: creat d18/d1f/f8b x:0 0 0 2024-09-11T00:07:17.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.658+0000 7f3a7f400700 1 Processor -- start 2024-09-11T00:07:17.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.658+0000 7f3a7f400700 1 -- start start 2024-09-11T00:07:17.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.658+0000 7f3a7f400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a78100150 0x7f3a7819c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:17.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.658+0000 7f3a7f400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a78101350 0x7f3a7819c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:17.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.658+0000 7f3a7f400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7819cba0 con 0x7f3a78101350 2024-09-11T00:07:17.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.658+0000 7f3a7f400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7819cce0 con 0x7f3a78100150 2024-09-11T00:07:17.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.659+0000 7f3a77e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a78101350 0x7f3a7819c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:17.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.660+0000 7f3a7ca00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a78100150 0x7f3a7819c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:17.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.660+0000 7f3a7ca00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a78100150 0x7f3a7819c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.111:43788/0 (socket says 172.21.15.111:43788) 2024-09-11T00:07:17.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.660+0000 7f3a7ca00700 1 -- 172.21.15.111:0/1751359962 learned_addr learned my addr 172.21.15.111:0/1751359962 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:07:17.662 INFO:tasks.workunit.client.0.smithi111.stdout:8/510: fdatasync d11/f12 0 2024-09-11T00:07:17.663 INFO:tasks.workunit.client.0.smithi111.stdout:0/514: rmdir d3/d13/d87 0 2024-09-11T00:07:17.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.661+0000 7f3a7ca00700 1 -- 172.21.15.111:0/1751359962 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a78101350 msgr2=0x7f3a7819c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:17.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.661+0000 7f3a7ca00700 1 --2- 172.21.15.111:0/1751359962 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a78101350 0x7f3a7819c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:17.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.661+0000 7f3a7ca00700 1 -- 172.21.15.111:0/1751359962 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a680095f0 con 0x7f3a78100150 2024-09-11T00:07:17.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.662+0000 7f3a7ca00700 1 --2- 172.21.15.111:0/1751359962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a78100150 0x7f3a7819c040 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00b480 tx=0x7f3a6c00b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:17.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.663+0000 7f3a75600700 1 -- 172.21.15.111:0/1751359962 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a6c011800 con 0x7f3a78100150 2024-09-11T00:07:17.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.663+0000 7f3a75600700 1 -- 172.21.15.111:0/1751359962 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3a6c011e10 con 0x7f3a78100150 2024-09-11T00:07:17.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.663+0000 7f3a75600700 1 -- 172.21.15.111:0/1751359962 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a6c010ea0 con 0x7f3a78100150 2024-09-11T00:07:17.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.663+0000 7f3a7f400700 1 -- 172.21.15.111:0/1751359962 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a781a1790 con 0x7f3a78100150 2024-09-11T00:07:17.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.663+0000 7f3a7f400700 1 -- 172.21.15.111:0/1751359962 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a781a1d10 con 0x7f3a78100150 2024-09-11T00:07:17.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.665+0000 7f3a7f400700 1 -- 172.21.15.111:0/1751359962 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a78106b70 con 0x7f3a78100150 2024-09-11T00:07:17.669 INFO:tasks.workunit.client.0.smithi111.stdout:2/453: write d0/d3/f37 [811960,103521] 0 2024-09-11T00:07:17.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.667+0000 7f3a75600700 1 -- 172.21.15.111:0/1751359962 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) v1 ==== 51561+0+0 (secure 0 0 0) 0x7f3a6c01a400 con 0x7f3a78100150 2024-09-11T00:07:17.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.667+0000 7f3a75600700 1 --2- 172.21.15.111:0/1751359962 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f3a6003f620 0x7f3a60041ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:17.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.668+0000 7f3a75600700 1 -- 172.21.15.111:0/1751359962 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f3a6c0548b0 con 0x7f3a78100150 2024-09-11T00:07:17.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.668+0000 7f3a77e00700 1 --2- 172.21.15.111:0/1751359962 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f3a6003f620 0x7f3a60041ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:17.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.670+0000 7f3a77e00700 1 --2- 172.21.15.111:0/1751359962 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f3a6003f620 0x7f3a60041ad0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3a68006010 tx=0x7f3a6800b560 comp rx=0 tx=0).ready entity=mgr.24469 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:17.672 INFO:tasks.workunit.client.0.smithi111.stdout:4/434: creat d18/d20/d40/f8c x:0 0 0 2024-09-11T00:07:17.672 INFO:tasks.workunit.client.0.smithi111.stdout:3/481: truncate d1c/d21/f3b 1629915 0 2024-09-11T00:07:17.672 INFO:tasks.workunit.client.0.smithi111.stdout:6/424: chown d7/d22/d26/d87/f57 58 1 2024-09-11T00:07:17.674 INFO:tasks.workunit.client.0.smithi111.stdout:2/454: fsync d0/d3/d12/d52/f87 0 2024-09-11T00:07:17.675 INFO:tasks.workunit.client.0.smithi111.stdout:5/483: mknod d10/d1e/d23/d2b/d2f/c99 0 2024-09-11T00:07:17.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:17.674+0000 7f3a75600700 1 -- 172.21.15.111:0/1751359962 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f3a6c00f810 con 0x7f3a78100150 2024-09-11T00:07:17.677 INFO:tasks.workunit.client.0.smithi111.stdout:2/455: dread - d0/d83/f9c zero size 2024-09-11T00:07:17.677 INFO:tasks.workunit.client.0.smithi111.stdout:1/446: dwrite d2/fd [0,4194304] 0 2024-09-11T00:07:17.681 INFO:tasks.workunit.client.0.smithi111.stdout:0/515: creat d3/daf/db2/fb6 x:0 0 0 2024-09-11T00:07:17.682 INFO:tasks.workunit.client.0.smithi111.stdout:8/511: mknod d11/d23/d2c/d46/d81/ca4 0 2024-09-11T00:07:17.686 INFO:tasks.workunit.client.0.smithi111.stdout:4/435: write d18/d20/f7b [3493315,74655] 0 2024-09-11T00:07:17.688 INFO:tasks.workunit.client.0.smithi111.stdout:7/454: write dd/d1d/d4d/f60 [168107,34255] 0 2024-09-11T00:07:17.689 INFO:tasks.workunit.client.0.smithi111.stdout:4/436: chown d18/d20/d3c 21 1 2024-09-11T00:07:17.690 INFO:tasks.workunit.client.0.smithi111.stdout:3/482: rename d1c/d1d/c96 to d1c/d1d/d22/d23/d2f/d63/ca1 0 2024-09-11T00:07:17.690 INFO:tasks.workunit.client.0.smithi111.stdout:6/425: read d7/d22/d2c/d38/f71 [918904,106204] 0 2024-09-11T00:07:17.691 INFO:tasks.workunit.client.0.smithi111.stdout:7/455: chown dd/d1d/d2d/d68/l7f 698394 1 2024-09-11T00:07:17.693 INFO:tasks.workunit.client.0.smithi111.stdout:7/456: write dd/f63 [1505378,48465] 0 2024-09-11T00:07:17.696 INFO:tasks.workunit.client.0.smithi111.stdout:8/512: readlink d11/l2d 0 2024-09-11T00:07:17.697 INFO:tasks.workunit.client.0.smithi111.stdout:8/513: chown d11/d23/d2c/d7f 26124 1 2024-09-11T00:07:17.697 INFO:tasks.workunit.client.0.smithi111.stdout:0/516: creat d3/d13/d1e/d29/d49/d51/fb7 x:0 0 0 2024-09-11T00:07:17.699 INFO:tasks.workunit.client.0.smithi111.stdout:8/514: write d11/fa1 [810675,124826] 0 2024-09-11T00:07:17.699 INFO:tasks.workunit.client.0.smithi111.stdout:1/447: creat d2/de/d12/d3c/d4b/d6a/d63/f9a x:0 0 0 2024-09-11T00:07:17.701 INFO:tasks.workunit.client.0.smithi111.stdout:3/483: rmdir d1c/d1d/d22/d31/d33 39 2024-09-11T00:07:17.702 INFO:tasks.workunit.client.0.smithi111.stdout:5/484: mknod d10/d1e/d23/d30/c9a 0 2024-09-11T00:07:17.704 INFO:tasks.workunit.client.0.smithi111.stdout:9/509: dread d6/d52/f59 [0,4194304] 0 2024-09-11T00:07:17.705 INFO:tasks.workunit.client.0.smithi111.stdout:9/510: chown d6/db/d34/f47 28575661 1 2024-09-11T00:07:17.709 INFO:tasks.workunit.client.0.smithi111.stdout:7/457: fdatasync dd/f3a 0 2024-09-11T00:07:17.711 INFO:tasks.workunit.client.0.smithi111.stdout:6/426: mknod d7/d22/d3f/d74/d7f/d61/d6a/c8d 0 2024-09-11T00:07:17.713 INFO:tasks.workunit.client.0.smithi111.stdout:7/458: write dd/d1d/d2d/d2e/f40 [1647519,8290] 0 2024-09-11T00:07:17.716 INFO:tasks.workunit.client.0.smithi111.stdout:2/456: dread d0/d3/f1c [0,4194304] 0 2024-09-11T00:07:17.716 INFO:tasks.workunit.client.0.smithi111.stdout:0/517: rename d3/daf/db2/fb6 to d3/d13/d1e/d29/db0/fb8 0 2024-09-11T00:07:17.717 INFO:tasks.workunit.client.0.smithi111.stdout:5/485: symlink d10/d1e/d23/d2b/d92/l9b 0 2024-09-11T00:07:17.717 INFO:tasks.workunit.client.0.smithi111.stdout:0/518: dread - d3/f65 zero size 2024-09-11T00:07:17.718 INFO:tasks.workunit.client.0.smithi111.stdout:2/457: write d0/d3/d12/d52/f87 [104001,9629] 0 2024-09-11T00:07:17.719 INFO:tasks.workunit.client.0.smithi111.stdout:6/427: rmdir d7/d22/d2c/d38 39 2024-09-11T00:07:17.720 INFO:tasks.workunit.client.0.smithi111.stdout:2/458: stat d0 0 2024-09-11T00:07:17.725 INFO:tasks.workunit.client.1.smithi203.stdout:7/466: rename dd/d1c/d52/d8f/l76 to dd/d1c/d7c/d7e/lab 0 2024-09-11T00:07:17.726 INFO:tasks.workunit.client.0.smithi111.stdout:9/511: truncate d6/db/d1b/f4b 2446477 0 2024-09-11T00:07:17.726 INFO:tasks.workunit.client.1.smithi203.stdout:4/443: truncate db/dd/d16/d38/f74 927892 0 2024-09-11T00:07:17.729 INFO:tasks.workunit.client.1.smithi203.stdout:2/442: rename d13/d22/d53/l5b to d13/d15/d30/d5a/l8a 0 2024-09-11T00:07:17.729 INFO:tasks.workunit.client.1.smithi203.stdout:5/583: read - dc/dd/d56/f9c zero size 2024-09-11T00:07:17.731 INFO:tasks.workunit.client.1.smithi203.stdout:2/443: stat d13/d15 0 2024-09-11T00:07:17.734 INFO:tasks.workunit.client.0.smithi111.stdout:2/459: unlink d0/d3/de/d3b/d63/c76 0 2024-09-11T00:07:17.737 INFO:tasks.workunit.client.1.smithi203.stdout:9/482: dwrite d6/de/d19/d21/f7b [0,4194304] 0 2024-09-11T00:07:17.738 INFO:tasks.workunit.client.1.smithi203.stdout:9/483: dread - d6/f8c zero size 2024-09-11T00:07:17.740 INFO:tasks.workunit.client.0.smithi111.stdout:0/519: link d3/d26/l57 d3/d26/d77/lb9 0 2024-09-11T00:07:17.740 INFO:tasks.workunit.client.1.smithi203.stdout:9/484: dread - d6/f8c zero size 2024-09-11T00:07:17.742 INFO:tasks.workunit.client.0.smithi111.stdout:7/459: dread fa [0,4194304] 0 2024-09-11T00:07:17.742 INFO:tasks.workunit.client.1.smithi203.stdout:1/533: rename d8/d9/l18 to d8/d9/d15/lba 0 2024-09-11T00:07:17.744 INFO:tasks.workunit.client.0.smithi111.stdout:1/448: dwrite d2/de/d12/d3c/d4b/d6a/d63/f9a [0,4194304] 0 2024-09-11T00:07:17.748 INFO:tasks.workunit.client.1.smithi203.stdout:0/482: getdents d0/d1d/d4c 0 2024-09-11T00:07:17.749 INFO:tasks.workunit.client.0.smithi111.stdout:2/460: rmdir d0/d3/de/d3b/d62 39 2024-09-11T00:07:17.752 INFO:tasks.workunit.client.1.smithi203.stdout:2/444: dwrite d13/d47/f54 [0,4194304] 0 2024-09-11T00:07:17.752 INFO:tasks.workunit.client.0.smithi111.stdout:0/520: creat d3/daf/fba x:0 0 0 2024-09-11T00:07:17.754 INFO:tasks.workunit.client.1.smithi203.stdout:9/485: rmdir d6/de/d32/d52 39 2024-09-11T00:07:17.757 INFO:tasks.workunit.client.0.smithi111.stdout:4/437: truncate d18/d20/f7b 1366888 0 2024-09-11T00:07:17.760 INFO:tasks.workunit.client.0.smithi111.stdout:7/460: rmdir dd/d1d/d4b 39 2024-09-11T00:07:17.761 INFO:tasks.workunit.client.0.smithi111.stdout:8/515: write d11/d21/d38/f5e [254270,16458] 0 2024-09-11T00:07:17.762 INFO:tasks.workunit.client.0.smithi111.stdout:3/484: write d1c/d1d/f42 [1487195,51759] 0 2024-09-11T00:07:17.763 INFO:tasks.workunit.client.1.smithi203.stdout:5/584: creat dc/fc3 x:0 0 0 2024-09-11T00:07:17.765 INFO:tasks.workunit.client.1.smithi203.stdout:2/445: dread d13/d15/f55 [0,4194304] 0 2024-09-11T00:07:17.766 INFO:tasks.workunit.client.1.smithi203.stdout:5/585: stat dc/dd/d15/d3b/d73 0 2024-09-11T00:07:17.769 INFO:tasks.workunit.client.1.smithi203.stdout:0/483: link d0/d2/d3d/d5a/f7c d0/d1d/d5d/f9b 0 2024-09-11T00:07:17.770 INFO:tasks.workunit.client.0.smithi111.stdout:8/516: readlink d11/d21/d6f/l71 0 2024-09-11T00:07:17.772 INFO:tasks.workunit.client.0.smithi111.stdout:3/485: chown d1c/d1d/d22/d31/d62/f9c 130233 1 2024-09-11T00:07:17.772 INFO:tasks.workunit.client.1.smithi203.stdout:2/446: write d13/d15/d30/f63 [1700058,74420] 0 2024-09-11T00:07:17.773 INFO:tasks.workunit.client.0.smithi111.stdout:8/517: readlink d11/d23/d2c/d46/l4a 0 2024-09-11T00:07:17.774 INFO:tasks.workunit.client.0.smithi111.stdout:4/438: mkdir d18/d20/d3c/d5e/d75/d8d 0 2024-09-11T00:07:17.774 INFO:tasks.workunit.client.1.smithi203.stdout:5/586: read - dc/dd/d15/d3b/d7a/f90 zero size 2024-09-11T00:07:17.776 INFO:tasks.workunit.client.0.smithi111.stdout:0/521: creat d3/d13/d1e/d29/d49/fbb x:0 0 0 2024-09-11T00:07:17.776 INFO:tasks.workunit.client.1.smithi203.stdout:1/534: creat d8/d9/fbb x:0 0 0 2024-09-11T00:07:17.777 INFO:tasks.workunit.client.0.smithi111.stdout:2/461: symlink d0/d3/de/d3b/d62/d6d/da1/la2 0 2024-09-11T00:07:17.779 INFO:tasks.workunit.client.1.smithi203.stdout:2/447: mkdir d13/d15/d30/d5a/d8b 0 2024-09-11T00:07:17.782 INFO:tasks.workunit.client.1.smithi203.stdout:5/587: read dc/dd/d15/dbd/d59/da8/fbe [3064577,27849] 0 2024-09-11T00:07:17.783 INFO:tasks.workunit.client.1.smithi203.stdout:9/486: rename d6/de/d47/c94 to d6/de/d19/c98 0 2024-09-11T00:07:17.787 INFO:tasks.workunit.client.1.smithi203.stdout:3/553: dread d8/d3c/fa8 [0,4194304] 0 2024-09-11T00:07:17.787 INFO:tasks.workunit.client.1.smithi203.stdout:2/448: unlink d13/d15/d30/f4f 0 2024-09-11T00:07:17.792 INFO:tasks.workunit.client.1.smithi203.stdout:1/535: symlink d8/d19/d60/d90/d3e/d4b/d80/d8d/lbc 0 2024-09-11T00:07:17.795 INFO:tasks.workunit.client.1.smithi203.stdout:0/484: rename d0/d2/d67/f94 to d0/d2/f9c 0 2024-09-11T00:07:17.796 INFO:tasks.workunit.client.1.smithi203.stdout:0/485: fsync d0/f5c 0 2024-09-11T00:07:17.798 INFO:tasks.workunit.client.0.smithi111.stdout:0/522: creat d3/d26/d77/fbc x:0 0 0 2024-09-11T00:07:17.799 INFO:tasks.workunit.client.1.smithi203.stdout:5/588: symlink dc/dd/d56/lc4 0 2024-09-11T00:07:17.803 INFO:tasks.workunit.client.0.smithi111.stdout:9/512: dread d6/f38 [0,4194304] 0 2024-09-11T00:07:17.807 INFO:tasks.workunit.client.1.smithi203.stdout:1/536: dread d8/d19/fa6 [0,4194304] 0 2024-09-11T00:07:17.807 INFO:tasks.workunit.client.1.smithi203.stdout:9/487: mknod d6/de/d19/d24/d54/c99 0 2024-09-11T00:07:17.808 INFO:tasks.workunit.client.1.smithi203.stdout:3/554: truncate d8/da/d5c/fa0 3394163 0 2024-09-11T00:07:17.809 INFO:tasks.workunit.client.1.smithi203.stdout:7/467: dwrite dd/d1c/d52/d8f/d31/f9a [0,4194304] 0 2024-09-11T00:07:17.811 INFO:tasks.workunit.client.0.smithi111.stdout:8/518: write d11/d21/d38/f41 [154070,70190] 0 2024-09-11T00:07:17.811 INFO:tasks.workunit.client.1.smithi203.stdout:4/444: dwrite db/dd/d16/d38/d3c/d41/f46 [0,4194304] 0 2024-09-11T00:07:17.813 INFO:tasks.workunit.client.0.smithi111.stdout:7/461: dread dd/f33 [0,4194304] 0 2024-09-11T00:07:17.814 INFO:tasks.workunit.client.1.smithi203.stdout:9/488: chown d6/de/d19/d24/d40/d45/l83 6 1 2024-09-11T00:07:17.816 INFO:tasks.workunit.client.0.smithi111.stdout:2/462: creat d0/d3/de/d50/d9d/fa3 x:0 0 0 2024-09-11T00:07:17.819 INFO:tasks.workunit.client.0.smithi111.stdout:8/519: chown d11/d23/d2c/d53/f55 92 1 2024-09-11T00:07:17.821 INFO:tasks.workunit.client.0.smithi111.stdout:0/523: rename d3/d26/d77/c5d to d3/cbd 0 2024-09-11T00:07:17.823 INFO:tasks.workunit.client.0.smithi111.stdout:1/449: link d2/l4f d2/de/d12/d3c/l9b 0 2024-09-11T00:07:17.825 INFO:tasks.workunit.client.0.smithi111.stdout:8/520: write d11/d23/d2c/d53/f83 [999576,91282] 0 2024-09-11T00:07:17.825 INFO:tasks.workunit.client.0.smithi111.stdout:7/462: mkdir dd/d1d/d1f/d92 0 2024-09-11T00:07:17.827 INFO:tasks.workunit.client.0.smithi111.stdout:3/486: write d1c/d1d/d22/d23/f68 [371617,39716] 0 2024-09-11T00:07:17.830 INFO:tasks.workunit.client.1.smithi203.stdout:7/468: creat dd/d1c/d52/fac x:0 0 0 2024-09-11T00:07:17.833 INFO:tasks.workunit.client.1.smithi203.stdout:3/555: creat d8/da/d37/d83/dc0/fc7 x:0 0 0 2024-09-11T00:07:17.834 INFO:tasks.workunit.client.0.smithi111.stdout:3/487: chown d1c/d1d/d22/d31/d62/l8d 27 1 2024-09-11T00:07:17.834 INFO:tasks.workunit.client.0.smithi111.stdout:2/463: mknod d0/d3/de/d3b/d62/d6d/ca4 0 2024-09-11T00:07:17.834 INFO:tasks.workunit.client.0.smithi111.stdout:4/439: dread d18/d3b/d61/f7c [0,4194304] 0 2024-09-11T00:07:17.841 INFO:tasks.workunit.client.1.smithi203.stdout:1/537: mknod d8/d19/d60/d90/d3e/d4b/d80/d91/cbd 0 2024-09-11T00:07:17.841 INFO:tasks.workunit.client.1.smithi203.stdout:5/589: mknod dc/dd/d9b/cc5 0 2024-09-11T00:07:17.841 INFO:tasks.workunit.client.1.smithi203.stdout:1/538: stat d8/d9/d15/d27/c5f 0 2024-09-11T00:07:17.842 INFO:tasks.workunit.client.0.smithi111.stdout:8/521: mkdir d11/d23/d2c/d46/d81/da5 0 2024-09-11T00:07:17.842 INFO:tasks.workunit.client.0.smithi111.stdout:1/450: dread d2/de/d12/d3c/d4b/d6a/d3a/f6b [0,4194304] 0 2024-09-11T00:07:17.842 INFO:tasks.workunit.client.0.smithi111.stdout:9/513: link d6/db/d1b/d74/la2 d6/db/d7a/la9 0 2024-09-11T00:07:17.842 INFO:tasks.workunit.client.0.smithi111.stdout:4/440: read d18/f81 [59528,65518] 0 2024-09-11T00:07:17.842 INFO:tasks.workunit.client.1.smithi203.stdout:5/590: fdatasync dc/dd/d1e/f27 0 2024-09-11T00:07:17.843 INFO:tasks.workunit.client.1.smithi203.stdout:9/489: creat d6/de/d19/f9a x:0 0 0 2024-09-11T00:07:17.845 INFO:tasks.workunit.client.1.smithi203.stdout:5/591: dread - dc/dd/d1e/d7b/fb7 zero size 2024-09-11T00:07:17.848 INFO:tasks.workunit.client.1.smithi203.stdout:7/469: rename dd/d3b/d5b/f8e to dd/d1c/d7c/fad 0 2024-09-11T00:07:17.848 INFO:tasks.workunit.client.0.smithi111.stdout:3/488: fsync d1c/d1d/d22/d23/f4a 0 2024-09-11T00:07:17.849 INFO:tasks.workunit.client.0.smithi111.stdout:9/514: write d6/dc/f17 [4126283,121117] 0 2024-09-11T00:07:17.849 INFO:tasks.workunit.client.0.smithi111.stdout:2/464: write d0/d3/d12/d52/d6c/f8f [755526,20757] 0 2024-09-11T00:07:17.849 INFO:tasks.workunit.client.1.smithi203.stdout:4/445: creat db/d12/d15/d2a/f8f x:0 0 0 2024-09-11T00:07:17.851 INFO:tasks.workunit.client.1.smithi203.stdout:7/470: write dd/d1c/d52/d8f/d31/d67/f79 [2003001,35002] 0 2024-09-11T00:07:17.857 INFO:tasks.workunit.client.0.smithi111.stdout:2/465: chown d0/d3/de/d3b/d62/l91 1108 1 2024-09-11T00:07:17.860 INFO:tasks.workunit.client.0.smithi111.stdout:3/489: chown d1c/l43 0 1 2024-09-11T00:07:17.860 INFO:tasks.workunit.client.1.smithi203.stdout:3/556: rename d8/da/d5c/c9d to d8/da/d37/d83/d6a/cc8 0 2024-09-11T00:07:17.861 INFO:tasks.workunit.client.1.smithi203.stdout:0/486: write d0/d2/f81 [4326031,41125] 0 2024-09-11T00:07:17.865 INFO:tasks.workunit.client.1.smithi203.stdout:4/446: write f1 [5911256,85523] 0 2024-09-11T00:07:17.866 INFO:tasks.workunit.client.0.smithi111.stdout:8/522: creat d11/d23/d2c/d46/d64/fa6 x:0 0 0 2024-09-11T00:07:17.866 INFO:tasks.workunit.client.0.smithi111.stdout:9/515: rmdir d6/db/d34/d37/d4c/d99 39 2024-09-11T00:07:17.868 INFO:tasks.workunit.client.1.smithi203.stdout:9/490: creat d6/de/d32/d52/d55/d66/d80/f9b x:0 0 0 2024-09-11T00:07:17.869 INFO:tasks.workunit.client.1.smithi203.stdout:9/491: fsync d6/de/d19/f3e 0 2024-09-11T00:07:17.870 INFO:tasks.workunit.client.1.smithi203.stdout:5/592: mkdir dc/dd/d1e/dc6 0 2024-09-11T00:07:17.871 INFO:tasks.workunit.client.1.smithi203.stdout:4/447: truncate db/dd/d16/d38/d3c/d41/f46 4512048 0 2024-09-11T00:07:17.873 INFO:tasks.workunit.client.0.smithi111.stdout:2/466: rename d0/f9f to d0/d3/de/d3b/d63/fa5 0 2024-09-11T00:07:17.876 INFO:tasks.workunit.client.1.smithi203.stdout:2/449: truncate d13/d15/d19/f6c 1737217 0 2024-09-11T00:07:17.876 INFO:tasks.workunit.client.1.smithi203.stdout:0/487: dread d0/d2/fb [0,4194304] 0 2024-09-11T00:07:17.878 INFO:tasks.workunit.client.0.smithi111.stdout:1/451: dread d2/de/d12/d3c/d4b/d6a/f59 [0,4194304] 0 2024-09-11T00:07:17.879 INFO:tasks.workunit.client.1.smithi203.stdout:3/557: creat d8/d3c/fc9 x:0 0 0 2024-09-11T00:07:17.879 INFO:tasks.workunit.client.0.smithi111.stdout:7/463: dwrite dd/f63 [0,4194304] 0 2024-09-11T00:07:17.883 INFO:tasks.workunit.client.0.smithi111.stdout:5/486: sync 2024-09-11T00:07:17.883 INFO:tasks.workunit.client.0.smithi111.stdout:6/428: sync 2024-09-11T00:07:17.884 INFO:tasks.workunit.client.1.smithi203.stdout:9/492: creat d6/de/d19/d24/d54/f9c x:0 0 0 2024-09-11T00:07:17.886 INFO:tasks.workunit.client.0.smithi111.stdout:8/523: symlink d11/d23/d2c/d46/la7 0 2024-09-11T00:07:17.889 INFO:tasks.workunit.client.1.smithi203.stdout:7/471: mknod dd/d1c/d52/d8f/d31/d58/d93/d98/cae 0 2024-09-11T00:07:17.889 INFO:tasks.workunit.client.0.smithi111.stdout:5/487: read d10/d1e/d23/d26/d3a/f87 [3621265,27261] 0 2024-09-11T00:07:17.893 INFO:tasks.workunit.client.1.smithi203.stdout:2/450: creat d13/d47/f8c x:0 0 0 2024-09-11T00:07:17.898 INFO:tasks.workunit.client.1.smithi203.stdout:3/558: creat d8/da/d37/d83/da3/fca x:0 0 0 2024-09-11T00:07:17.903 INFO:tasks.workunit.client.1.smithi203.stdout:5/593: symlink dc/dd/d56/dad/da5/lc7 0 2024-09-11T00:07:17.905 INFO:tasks.workunit.client.1.smithi203.stdout:5/594: readlink dc/l8a 0 2024-09-11T00:07:17.905 INFO:tasks.workunit.client.1.smithi203.stdout:9/493: dwrite d6/de/d19/d30/f77 [0,4194304] 0 2024-09-11T00:07:17.908 INFO:tasks.workunit.client.1.smithi203.stdout:9/494: write d6/de/d19/f7a [751617,78444] 0 2024-09-11T00:07:17.909 INFO:tasks.workunit.client.0.smithi111.stdout:6/429: mknod d7/d22/d3f/d74/d7f/d79/c8e 0 2024-09-11T00:07:17.909 INFO:tasks.workunit.client.0.smithi111.stdout:8/524: mknod d11/d23/d3d/d8d/ca8 0 2024-09-11T00:07:17.910 INFO:tasks.workunit.client.1.smithi203.stdout:7/472: rename dd/d1c/d52/d8f/f2c to dd/d1c/d52/d8f/d31/d58/d93/d98/faf 0 2024-09-11T00:07:17.912 INFO:tasks.workunit.client.1.smithi203.stdout:7/473: chown dd/d3b/f72 11 1 2024-09-11T00:07:17.913 INFO:tasks.workunit.client.0.smithi111.stdout:9/516: dwrite d6/db/d1b/d41/f9e [0,4194304] 0 2024-09-11T00:07:17.914 INFO:tasks.workunit.client.1.smithi203.stdout:2/451: dwrite d13/d47/f54 [0,4194304] 0 2024-09-11T00:07:17.915 INFO:tasks.workunit.client.1.smithi203.stdout:1/539: truncate d8/d19/d60/d90/d3e/d4b/d41/f8a 409243 0 2024-09-11T00:07:17.915 INFO:tasks.workunit.client.0.smithi111.stdout:8/525: truncate d11/d23/d7e/f97 127314 0 2024-09-11T00:07:17.917 INFO:tasks.workunit.client.0.smithi111.stdout:4/441: getdents d18/d20/d3c/d5e/d75 0 2024-09-11T00:07:17.917 INFO:tasks.workunit.client.1.smithi203.stdout:1/540: stat d8/d19/d60/d90/f98 0 2024-09-11T00:07:17.919 INFO:tasks.workunit.client.0.smithi111.stdout:3/490: write ff [2687504,78815] 0 2024-09-11T00:07:17.919 INFO:tasks.workunit.client.0.smithi111.stdout:2/467: dread d0/d3/de/f51 [0,4194304] 0 2024-09-11T00:07:17.920 INFO:tasks.workunit.client.1.smithi203.stdout:4/448: truncate db/dd/d16/f4f 2158623 0 2024-09-11T00:07:17.922 INFO:tasks.workunit.client.0.smithi111.stdout:8/526: truncate d11/d23/d7e/f97 853395 0 2024-09-11T00:07:17.923 INFO:tasks.workunit.client.0.smithi111.stdout:2/468: fsync d0/d83/f9c 0 2024-09-11T00:07:17.924 INFO:tasks.workunit.client.0.smithi111.stdout:9/517: rmdir d6/db/d34 39 2024-09-11T00:07:17.926 INFO:tasks.workunit.client.1.smithi203.stdout:7/474: mknod dd/d3b/d9f/cb0 0 2024-09-11T00:07:17.927 INFO:tasks.workunit.client.0.smithi111.stdout:4/442: creat d18/d3b/f8e x:0 0 0 2024-09-11T00:07:17.928 INFO:tasks.workunit.client.1.smithi203.stdout:3/559: creat d8/da/d37/d83/db9/fcb x:0 0 0 2024-09-11T00:07:17.929 INFO:tasks.workunit.client.0.smithi111.stdout:3/491: creat d1c/d21/fa2 x:0 0 0 2024-09-11T00:07:17.933 INFO:tasks.workunit.client.1.smithi203.stdout:2/452: dread d13/d15/f23 [0,4194304] 0 2024-09-11T00:07:17.933 INFO:tasks.workunit.client.1.smithi203.stdout:3/560: dread - d8/da/d37/d83/db9/fcb zero size 2024-09-11T00:07:17.942 INFO:tasks.workunit.client.1.smithi203.stdout:4/449: rename db/d12/f66 to db/d12/d15/d2a/d88/f90 0 2024-09-11T00:07:17.944 INFO:tasks.workunit.client.0.smithi111.stdout:8/527: fsync d11/d21/d38/f52 0 2024-09-11T00:07:17.945 INFO:tasks.workunit.client.1.smithi203.stdout:0/488: dread d0/d2/fe [0,4194304] 0 2024-09-11T00:07:17.949 INFO:tasks.workunit.client.1.smithi203.stdout:5/595: dwrite dc/dd/d15/dbd/d59/da8/fbe [4194304,4194304] 0 2024-09-11T00:07:17.951 INFO:tasks.workunit.client.0.smithi111.stdout:2/469: rmdir d0/d3/de/d3b/d62/d6d 39 2024-09-11T00:07:17.953 INFO:tasks.workunit.client.0.smithi111.stdout:2/470: stat d0/d3 0 2024-09-11T00:07:17.954 INFO:tasks.workunit.client.1.smithi203.stdout:7/475: truncate dd/d1c/d7c/fad 1832569 0 2024-09-11T00:07:17.955 INFO:tasks.workunit.client.1.smithi203.stdout:7/476: chown dd/d1c/f57 17762780 1 2024-09-11T00:07:17.958 INFO:tasks.workunit.client.0.smithi111.stdout:7/464: link dd/d1d/d1f/l3b dd/d1d/d4b/l93 0 2024-09-11T00:07:17.963 INFO:tasks.workunit.client.0.smithi111.stdout:6/430: rename d7/ff to d7/d22/d3f/d74/d7f/d61/f8f 0 2024-09-11T00:07:17.965 INFO:tasks.workunit.client.0.smithi111.stdout:0/524: dwrite d3/d13/d1e/f2e [0,4194304] 0 2024-09-11T00:07:17.965 INFO:tasks.workunit.client.1.smithi203.stdout:5/596: fdatasync dc/d2b/f6e 0 2024-09-11T00:07:17.968 INFO:tasks.workunit.client.1.smithi203.stdout:0/489: mknod d0/d1d/c9d 0 2024-09-11T00:07:17.968 INFO:tasks.workunit.client.1.smithi203.stdout:7/477: dread dd/d1c/d52/d8f/d31/f50 [0,4194304] 0 2024-09-11T00:07:17.970 INFO:tasks.workunit.client.1.smithi203.stdout:9/495: write d6/de/d47/f65 [922803,95557] 0 2024-09-11T00:07:17.972 INFO:tasks.workunit.client.0.smithi111.stdout:5/488: getdents d10/d1e/d23/d2b/d2f 0 2024-09-11T00:07:17.986 INFO:tasks.workunit.client.0.smithi111.stdout:7/465: chown dd/c20 30564953 1 2024-09-11T00:07:17.990 INFO:tasks.workunit.client.0.smithi111.stdout:6/431: symlink d7/d22/d1d/l90 0 2024-09-11T00:07:17.990 INFO:tasks.workunit.client.1.smithi203.stdout:0/490: rmdir d0/d2 39 2024-09-11T00:07:17.991 INFO:tasks.workunit.client.1.smithi203.stdout:1/541: dread d8/d19/d60/d90/d3e/d4b/d41/f4d [0,4194304] 0 2024-09-11T00:07:17.993 INFO:tasks.workunit.client.0.smithi111.stdout:9/518: write d6/f3b [651195,37825] 0 2024-09-11T00:07:17.994 INFO:tasks.workunit.client.1.smithi203.stdout:4/450: rename db/d12/d15/l1d to db/d12/l91 0 2024-09-11T00:07:17.994 INFO:tasks.workunit.client.1.smithi203.stdout:7/478: dread dd/d4d/f73 [0,4194304] 0 2024-09-11T00:07:17.994 INFO:tasks.workunit.client.1.smithi203.stdout:9/496: creat d6/de/d19/d24/d54/f9d x:0 0 0 2024-09-11T00:07:17.996 INFO:tasks.workunit.client.0.smithi111.stdout:9/519: dread - d6/dc/f87 zero size 2024-09-11T00:07:17.998 INFO:tasks.workunit.client.0.smithi111.stdout:5/489: fdatasync d10/d1e/d23/d30/d3c/d60/d7e/d47/f58 0 2024-09-11T00:07:17.999 INFO:tasks.workunit.client.1.smithi203.stdout:2/453: getdents d13/d15/d19 0 2024-09-11T00:07:18.000 INFO:tasks.workunit.client.0.smithi111.stdout:2/471: symlink d0/d3/de/d3b/d97/la6 0 2024-09-11T00:07:18.002 INFO:tasks.workunit.client.0.smithi111.stdout:4/443: getdents d18/d20/d4a/d6b 0 2024-09-11T00:07:18.003 INFO:tasks.workunit.client.0.smithi111.stdout:8/528: truncate d11/fa1 500539 0 2024-09-11T00:07:18.004 INFO:tasks.workunit.client.0.smithi111.stdout:3/492: dwrite d1c/d1d/d22/d44/f6f [0,4194304] 0 2024-09-11T00:07:18.004 INFO:tasks.workunit.client.0.smithi111.stdout:6/432: fsync d7/d22/d3f/d74/d7f/d61/f81 0 2024-09-11T00:07:18.007 INFO:tasks.workunit.client.1.smithi203.stdout:7/479: unlink dd/d1c/d7c/f7d 0 2024-09-11T00:07:18.011 INFO:tasks.workunit.client.1.smithi203.stdout:2/454: fdatasync d13/d15/d19/d1c/f3c 0 2024-09-11T00:07:18.013 INFO:tasks.workunit.client.1.smithi203.stdout:2/455: read d13/d15/d19/d1c/f2a [2415371,71491] 0 2024-09-11T00:07:18.014 INFO:tasks.workunit.client.0.smithi111.stdout:9/520: creat d6/d52/d8a/d92/faa x:0 0 0 2024-09-11T00:07:18.015 INFO:tasks.workunit.client.0.smithi111.stdout:5/490: symlink d10/d1e/d23/d30/d59/d7b/l9c 0 2024-09-11T00:07:18.016 INFO:tasks.workunit.client.1.smithi203.stdout:4/451: mknod db/d12/d15/d2a/c92 0 2024-09-11T00:07:18.016 INFO:tasks.workunit.client.1.smithi203.stdout:0/491: dread d0/d2/f8 [4194304,4194304] 0 2024-09-11T00:07:18.016 INFO:tasks.workunit.client.0.smithi111.stdout:6/433: write d7/d2b/f5b [1709949,118035] 0 2024-09-11T00:07:18.017 INFO:tasks.workunit.client.1.smithi203.stdout:4/452: write db/f7e [1043183,74870] 0 2024-09-11T00:07:18.019 INFO:tasks.workunit.client.0.smithi111.stdout:8/529: dread - d11/d23/d2c/d46/f8c zero size 2024-09-11T00:07:18.021 INFO:tasks.workunit.client.1.smithi203.stdout:7/480: fsync dd/d1c/d52/d8f/d31/d4a/f86 0 2024-09-11T00:07:18.023 INFO:tasks.workunit.client.1.smithi203.stdout:5/597: getdents dc/dd/d9b/dae 0 2024-09-11T00:07:18.025 INFO:tasks.workunit.client.0.smithi111.stdout:5/491: write d10/d1e/d23/d30/d3c/d60/d7e/d47/d66/f67 [917591,103208] 0 2024-09-11T00:07:18.025 INFO:tasks.workunit.client.0.smithi111.stdout:5/492: stat d10/f1a 0 2024-09-11T00:07:18.027 INFO:tasks.workunit.client.0.smithi111.stdout:5/493: chown d10/l1d 236 1 2024-09-11T00:07:18.029 INFO:tasks.workunit.client.1.smithi203.stdout:1/542: write d8/d9/d15/d35/d81/f83 [3705354,1456] 0 2024-09-11T00:07:18.030 INFO:tasks.workunit.client.1.smithi203.stdout:9/497: rmdir d6/de/d32/d52/d44/d7d 0 2024-09-11T00:07:18.037 INFO:tasks.workunit.client.1.smithi203.stdout:7/481: creat dd/d1c/d52/fb1 x:0 0 0 2024-09-11T00:07:18.037 INFO:tasks.workunit.client.0.smithi111.stdout:7/466: write dd/f10 [2240969,103008] 0 2024-09-11T00:07:18.038 INFO:tasks.workunit.client.0.smithi111.stdout:7/467: write dd/d1d/d4d/f60 [4689186,6052] 0 2024-09-11T00:07:18.038 INFO:tasks.workunit.client.1.smithi203.stdout:7/482: dread - dd/d3b/fa4 zero size 2024-09-11T00:07:18.039 INFO:tasks.workunit.client.0.smithi111.stdout:2/472: dwrite d0/d3/de/d3b/d97/f8b [0,4194304] 0 2024-09-11T00:07:18.039 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:18 smithi111 ceph-mon[27539]: pgmap v7: 65 pgs: 65 active+clean; 1.9 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 46 MiB/s rd, 144 MiB/s wr, 282 op/s 2024-09-11T00:07:18.039 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:18 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/1560813386' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:07:18.041 INFO:tasks.workunit.client.0.smithi111.stdout:2/473: dread - d0/d3/f84 zero size 2024-09-11T00:07:18.051 INFO:tasks.workunit.client.1.smithi203.stdout:7/483: truncate dd/d1c/d52/d8f/d31/f45 2945858 0 2024-09-11T00:07:18.055 INFO:tasks.workunit.client.1.smithi203.stdout:9/498: mkdir d6/de/d32/d9e 0 2024-09-11T00:07:18.057 INFO:tasks.workunit.client.1.smithi203.stdout:0/492: link d0/d2/d92/l91 d0/d2/d3d/l9e 0 2024-09-11T00:07:18.059 INFO:tasks.workunit.client.0.smithi111.stdout:4/444: write d18/d20/d40/d78/d79/f89 [3376652,60303] 0 2024-09-11T00:07:18.059 INFO:tasks.workunit.client.1.smithi203.stdout:5/598: link dc/dd/d56/c6d dc/dd/d1e/dc6/cc8 0 2024-09-11T00:07:18.063 INFO:tasks.workunit.client.0.smithi111.stdout:3/493: read d1c/d1d/d22/f5b [2238004,71280] 0 2024-09-11T00:07:18.065 INFO:tasks.workunit.client.0.smithi111.stdout:3/494: chown d1c/d1d/d22 0 1 2024-09-11T00:07:18.065 INFO:tasks.workunit.client.0.smithi111.stdout:9/521: fdatasync d6/db/d34/f66 0 2024-09-11T00:07:18.065 INFO:tasks.workunit.client.1.smithi203.stdout:2/456: truncate d13/d15/d30/f39 405369 0 2024-09-11T00:07:18.068 INFO:tasks.workunit.client.1.smithi203.stdout:5/599: rmdir dc/dd/d13 39 2024-09-11T00:07:18.070 INFO:tasks.workunit.client.1.smithi203.stdout:7/484: dwrite dd/d1c/d52/d8f/d31/f62 [0,4194304] 0 2024-09-11T00:07:18.073 INFO:tasks.workunit.client.0.smithi111.stdout:6/434: symlink d7/d22/d1d/d69/l91 0 2024-09-11T00:07:18.074 INFO:tasks.workunit.client.0.smithi111.stdout:4/445: dwrite f15 [0,4194304] 0 2024-09-11T00:07:18.074 INFO:tasks.workunit.client.1.smithi203.stdout:7/485: chown dd/d1c 22959 1 2024-09-11T00:07:18.075 INFO:tasks.workunit.client.0.smithi111.stdout:4/446: stat d18/d3b 0 2024-09-11T00:07:18.076 INFO:tasks.workunit.client.0.smithi111.stdout:8/530: mknod d11/d23/d3d/d8d/ca9 0 2024-09-11T00:07:18.079 INFO:tasks.workunit.client.1.smithi203.stdout:7/486: write dd/d1c/f21 [965259,91697] 0 2024-09-11T00:07:18.084 INFO:tasks.workunit.client.1.smithi203.stdout:1/543: write d8/d19/d60/d90/f3d [1187950,60549] 0 2024-09-11T00:07:18.085 INFO:tasks.workunit.client.0.smithi111.stdout:8/531: dread d11/d21/d38/f52 [0,4194304] 0 2024-09-11T00:07:18.086 INFO:tasks.workunit.client.1.smithi203.stdout:1/544: readlink d8/d9/l1d 0 2024-09-11T00:07:18.091 INFO:tasks.workunit.client.0.smithi111.stdout:8/532: write d11/d21/d38/f41 [746055,32371] 0 2024-09-11T00:07:18.091 INFO:tasks.workunit.client.0.smithi111.stdout:7/468: unlink dd/d1d/d2d/d68/d79/f8a 0 2024-09-11T00:07:18.091 INFO:tasks.workunit.client.0.smithi111.stdout:2/474: rmdir d0 39 2024-09-11T00:07:18.093 INFO:tasks.workunit.client.1.smithi203.stdout:0/493: dread d0/d2/f13 [0,4194304] 0 2024-09-11T00:07:18.095 INFO:tasks.workunit.client.1.smithi203.stdout:2/457: dwrite d13/d15/f65 [0,4194304] 0 2024-09-11T00:07:18.097 INFO:tasks.workunit.client.1.smithi203.stdout:1/545: mknod d8/d9/d15/d35/d81/da1/cbe 0 2024-09-11T00:07:18.101 INFO:tasks.workunit.client.0.smithi111.stdout:6/435: symlink d7/d22/d1d/d69/l92 0 2024-09-11T00:07:18.106 INFO:tasks.workunit.client.0.smithi111.stdout:4/447: creat d18/d20/d40/f8f x:0 0 0 2024-09-11T00:07:18.107 INFO:tasks.workunit.client.1.smithi203.stdout:0/494: mkdir d0/d9f 0 2024-09-11T00:07:18.110 INFO:tasks.workunit.client.1.smithi203.stdout:7/487: dwrite dd/d1c/d52/fac [0,4194304] 0 2024-09-11T00:07:18.111 INFO:tasks.workunit.client.0.smithi111.stdout:5/494: symlink d10/d1e/d23/d30/d59/d7b/d82/d86/l9d 0 2024-09-11T00:07:18.113 INFO:tasks.workunit.client.1.smithi203.stdout:7/488: chown dd/d1c/l70 11791 1 2024-09-11T00:07:18.113 INFO:tasks.workunit.client.1.smithi203.stdout:5/600: dwrite dc/dd/d9b/dae/fb3 [0,4194304] 0 2024-09-11T00:07:18.114 INFO:tasks.workunit.client.0.smithi111.stdout:4/448: chown d18/d20/l5c 2554 1 2024-09-11T00:07:18.116 INFO:tasks.workunit.client.0.smithi111.stdout:4/449: stat d18/d20/d3c/f74 0 2024-09-11T00:07:18.117 INFO:tasks.workunit.client.0.smithi111.stdout:8/533: dwrite d11/d23/d2c/d53/f55 [0,4194304] 0 2024-09-11T00:07:18.121 INFO:tasks.workunit.client.0.smithi111.stdout:4/450: fdatasync d18/d20/d4a/f64 0 2024-09-11T00:07:18.124 INFO:tasks.workunit.client.1.smithi203.stdout:5/601: mkdir dc/d4f/d5c/dc9 0 2024-09-11T00:07:18.129 INFO:tasks.workunit.client.0.smithi111.stdout:9/522: rename d6/db/d1b/d74/la2 to d6/db/d34/d37/d4c/d7f/d97/lab 0 2024-09-11T00:07:18.132 INFO:tasks.workunit.client.0.smithi111.stdout:6/436: chown d7/l1a 10626584 1 2024-09-11T00:07:18.133 INFO:tasks.workunit.client.1.smithi203.stdout:0/495: mknod d0/d9f/ca0 0 2024-09-11T00:07:18.134 INFO:tasks.workunit.client.0.smithi111.stdout:2/475: fsync d0/d3/de/f43 0 2024-09-11T00:07:18.134 INFO:tasks.workunit.client.0.smithi111.stdout:4/451: mkdir d18/d20/d40/d78/d79/d90 0 2024-09-11T00:07:18.138 INFO:tasks.workunit.client.1.smithi203.stdout:1/546: link d8/d19/d60/d90/d3e/d4b/d80/d91/cbd d8/d28/d64/cbf 0 2024-09-11T00:07:18.139 INFO:tasks.workunit.client.0.smithi111.stdout:4/452: fdatasync d18/d20/d40/f8c 0 2024-09-11T00:07:18.149 INFO:tasks.workunit.client.0.smithi111.stdout:9/523: truncate d6/db/d34/f66 1231258 0 2024-09-11T00:07:18.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:18.149+0000 7f3a7f400700 1 -- 172.21.15.111:0/1751359962 --> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a78105ca0 con 0x7f3a6003f620 2024-09-11T00:07:18.151 INFO:tasks.workunit.client.0.smithi111.stdout:7/469: dwrite dd/f63 [0,4194304] 0 2024-09-11T00:07:18.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:18.150+0000 7f3a75600700 1 -- 172.21.15.111:0/1751359962 <== mgr.24469 v2:172.21.15.203:6828/1203435425 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f3a78105ca0 con 0x7f3a6003f620 2024-09-11T00:07:18.152 INFO:tasks.workunit.client.0.smithi111.stdout:9/524: fsync d6/db/d1b/f1e 0 2024-09-11T00:07:18.156 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:07:18.156 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e", 2024-09-11T00:07:18.156 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-11T00:07:18.156 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-11T00:07:18.156 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [], 2024-09-11T00:07:18.156 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "1/2 daemons upgraded", 2024-09-11T00:07:18.156 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "", 2024-09-11T00:07:18.156 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-11T00:07:18.156 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:07:18.157 INFO:tasks.workunit.client.0.smithi111.stdout:8/534: dwrite d11/d23/d2c/d46/d64/fa6 [0,4194304] 0 2024-09-11T00:07:18.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:18.154+0000 7f3a7f400700 1 -- 172.21.15.111:0/1751359962 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f3a6003f620 msgr2=0x7f3a60041ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:18.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:18.154+0000 7f3a7f400700 1 --2- 172.21.15.111:0/1751359962 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f3a6003f620 0x7f3a60041ad0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3a68006010 tx=0x7f3a6800b560 comp rx=0 tx=0).stop 2024-09-11T00:07:18.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:18.154+0000 7f3a7f400700 1 -- 172.21.15.111:0/1751359962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a78100150 msgr2=0x7f3a7819c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:18.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:18.154+0000 7f3a7f400700 1 --2- 172.21.15.111:0/1751359962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a78100150 0x7f3a7819c040 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00b480 tx=0x7f3a6c00b790 comp rx=0 tx=0).stop 2024-09-11T00:07:18.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:18.154+0000 7f3a7f400700 1 -- 172.21.15.111:0/1751359962 shutdown_connections 2024-09-11T00:07:18.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:18.154+0000 7f3a7f400700 1 --2- 172.21.15.111:0/1751359962 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f3a6003f620 0x7f3a60041ad0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:18.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:18.154+0000 7f3a7f400700 1 --2- 172.21.15.111:0/1751359962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a78100150 0x7f3a7819c040 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:18.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:18.154+0000 7f3a7f400700 1 --2- 172.21.15.111:0/1751359962 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a78101350 0x7f3a7819c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:18.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:18.154+0000 7f3a7f400700 1 -- 172.21.15.111:0/1751359962 >> 172.21.15.111:0/1751359962 conn(0x7f3a780fb6e0 msgr2=0x7f3a78104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:18.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:18.154+0000 7f3a7f400700 1 -- 172.21.15.111:0/1751359962 shutdown_connections 2024-09-11T00:07:18.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:18.158+0000 7f3a7f400700 1 -- 172.21.15.111:0/1751359962 wait complete. 2024-09-11T00:07:18.162 INFO:tasks.workunit.client.0.smithi111.stdout:7/470: readlink dd/l13 0 2024-09-11T00:07:18.166 INFO:tasks.workunit.client.0.smithi111.stdout:9/525: write d6/f91 [1449505,50147] 0 2024-09-11T00:07:18.169 INFO:tasks.workunit.client.0.smithi111.stdout:5/495: dread d10/f13 [0,4194304] 0 2024-09-11T00:07:18.172 INFO:tasks.workunit.client.0.smithi111.stdout:7/471: creat dd/d1d/d7e/f94 x:0 0 0 2024-09-11T00:07:18.175 INFO:tasks.workunit.client.0.smithi111.stdout:7/472: stat dd/d1d/d1f/l5b 0 2024-09-11T00:07:18.178 INFO:tasks.workunit.client.0.smithi111.stdout:9/526: dread - d6/db/d1b/d74/f84 zero size 2024-09-11T00:07:18.178 INFO:tasks.workunit.client.0.smithi111.stdout:7/473: chown dd 38103311 1 2024-09-11T00:07:18.184 INFO:tasks.workunit.client.0.smithi111.stdout:5/496: write d10/d1e/d23/d30/d3c/d60/d7e/f88 [672658,70127] 0 2024-09-11T00:07:18.184 INFO:tasks.workunit.client.0.smithi111.stdout:9/527: readlink d6/l31 0 2024-09-11T00:07:18.186 INFO:tasks.workunit.client.0.smithi111.stdout:4/453: dwrite d18/d20/d4a/f64 [0,4194304] 0 2024-09-11T00:07:18.193 INFO:tasks.workunit.client.0.smithi111.stdout:0/525: sync 2024-09-11T00:07:18.193 INFO:tasks.workunit.client.0.smithi111.stdout:1/452: sync 2024-09-11T00:07:18.194 INFO:tasks.workunit.client.0.smithi111.stdout:3/495: sync 2024-09-11T00:07:18.194 INFO:tasks.workunit.client.0.smithi111.stdout:9/528: write d6/db/d34/f65 [4964518,96638] 0 2024-09-11T00:07:18.196 INFO:tasks.workunit.client.0.smithi111.stdout:8/535: dwrite d11/d23/d3d/f86 [0,4194304] 0 2024-09-11T00:07:18.198 INFO:tasks.workunit.client.0.smithi111.stdout:7/474: write dd/d1d/d1f/f23 [4019042,117521] 0 2024-09-11T00:07:18.200 INFO:tasks.workunit.client.0.smithi111.stdout:4/454: rmdir d18/d20 39 2024-09-11T00:07:18.201 INFO:tasks.workunit.client.0.smithi111.stdout:9/529: chown d6/db/d34/f3d 5066 1 2024-09-11T00:07:18.204 INFO:tasks.workunit.client.0.smithi111.stdout:7/475: fsync dd/d1d/d2d/d2e/f70 0 2024-09-11T00:07:18.205 INFO:tasks.workunit.client.0.smithi111.stdout:7/476: stat dd/d1d/f39 0 2024-09-11T00:07:18.205 INFO:tasks.workunit.client.0.smithi111.stdout:0/526: chown d3/d26/f98 98694851 1 2024-09-11T00:07:18.206 INFO:tasks.workunit.client.0.smithi111.stdout:2/476: dread d0/f1a [0,4194304] 0 2024-09-11T00:07:18.211 INFO:tasks.workunit.client.0.smithi111.stdout:1/453: mkdir d2/de/d93/d9c 0 2024-09-11T00:07:18.211 INFO:tasks.workunit.client.0.smithi111.stdout:4/455: chown d18/d20/f30 20937080 1 2024-09-11T00:07:18.211 INFO:tasks.workunit.client.0.smithi111.stdout:6/437: dread f1 [0,4194304] 0 2024-09-11T00:07:18.215 INFO:tasks.workunit.client.0.smithi111.stdout:0/527: write d3/f7a [171007,55998] 0 2024-09-11T00:07:18.215 INFO:tasks.workunit.client.0.smithi111.stdout:8/536: symlink d11/d23/d2c/laa 0 2024-09-11T00:07:18.215 INFO:tasks.workunit.client.0.smithi111.stdout:7/477: symlink dd/d1d/d2d/d2e/d4e/l95 0 2024-09-11T00:07:18.216 INFO:tasks.workunit.client.0.smithi111.stdout:1/454: write d2/de/d12/d3c/d4b/f74 [1133711,111893] 0 2024-09-11T00:07:18.218 INFO:tasks.workunit.client.0.smithi111.stdout:8/537: readlink d11/l2d 0 2024-09-11T00:07:18.221 INFO:tasks.workunit.client.1.smithi203.stdout:0/496: mkdir d0/d2/d7e/da1 0 2024-09-11T00:07:18.222 INFO:tasks.workunit.client.1.smithi203.stdout:7/489: write dd/f22 [997856,58787] 0 2024-09-11T00:07:18.225 INFO:tasks.workunit.client.0.smithi111.stdout:0/528: symlink d3/d13/lbe 0 2024-09-11T00:07:18.226 INFO:tasks.workunit.client.1.smithi203.stdout:2/458: dread d13/d15/d19/d1c/f2d [0,4194304] 0 2024-09-11T00:07:18.226 INFO:tasks.workunit.client.0.smithi111.stdout:8/538: read d11/f1d [3120978,112110] 0 2024-09-11T00:07:18.229 INFO:tasks.workunit.client.0.smithi111.stdout:7/478: write dd/d1d/d1f/d24/f2f [3836490,29857] 0 2024-09-11T00:07:18.230 INFO:tasks.workunit.client.1.smithi203.stdout:5/602: dwrite dc/dd/d15/f42 [0,4194304] 0 2024-09-11T00:07:18.232 INFO:tasks.workunit.client.1.smithi203.stdout:2/459: dread d13/d15/d19/d1c/f2d [4194304,4194304] 0 2024-09-11T00:07:18.235 INFO:tasks.workunit.client.1.smithi203.stdout:0/497: truncate d0/d2/d3d/d5a/f7c 1828757 0 2024-09-11T00:07:18.235 INFO:tasks.workunit.client.0.smithi111.stdout:4/456: write d18/d3b/d61/f7c [4381433,107127] 0 2024-09-11T00:07:18.235 INFO:tasks.workunit.client.0.smithi111.stdout:1/455: readlink d2/de/d12/d3c/d4b/d6a/l4e 0 2024-09-11T00:07:18.237 INFO:tasks.workunit.client.1.smithi203.stdout:0/498: dread - d0/d1d/d5d/f71 zero size 2024-09-11T00:07:18.245 INFO:tasks.workunit.client.0.smithi111.stdout:7/479: write f7 [2080934,45649] 0 2024-09-11T00:07:18.245 INFO:tasks.workunit.client.0.smithi111.stdout:5/497: dwrite d10/d1e/d23/d30/d3c/f40 [0,4194304] 0 2024-09-11T00:07:18.245 INFO:tasks.workunit.client.1.smithi203.stdout:1/547: rename d8/d9/d15/d35/d81/da1/fb4 to d8/d28/fc0 0 2024-09-11T00:07:18.245 INFO:tasks.workunit.client.1.smithi203.stdout:5/603: symlink dc/dd/d1e/d7b/lca 0 2024-09-11T00:07:18.245 INFO:tasks.workunit.client.1.smithi203.stdout:1/548: dread - d8/f6d zero size 2024-09-11T00:07:18.246 INFO:tasks.workunit.client.0.smithi111.stdout:8/539: mkdir d11/d21/d6f/dab 0 2024-09-11T00:07:18.247 INFO:tasks.workunit.client.1.smithi203.stdout:5/604: creat dc/d91/fcb x:0 0 0 2024-09-11T00:07:18.248 INFO:tasks.workunit.client.0.smithi111.stdout:3/496: dwrite d1c/d1d/d22/d23/f68 [0,4194304] 0 2024-09-11T00:07:18.249 INFO:tasks.workunit.client.0.smithi111.stdout:2/477: dread d0/d3/de/d3b/d97/f8b [0,4194304] 0 2024-09-11T00:07:18.250 INFO:tasks.workunit.client.0.smithi111.stdout:1/456: write d2/de/d12/d3c/d4b/d6a/d63/f78 [111482,31568] 0 2024-09-11T00:07:18.250 INFO:tasks.workunit.client.1.smithi203.stdout:1/549: creat d8/d9/d15/fc1 x:0 0 0 2024-09-11T00:07:18.252 INFO:tasks.workunit.client.1.smithi203.stdout:5/605: mknod dc/dd/d56/dad/da5/ccc 0 2024-09-11T00:07:18.252 INFO:tasks.workunit.client.1.smithi203.stdout:0/499: link d0/d1d/d5d/d70/c7b d0/d2/d92/ca2 0 2024-09-11T00:07:18.253 INFO:tasks.workunit.client.0.smithi111.stdout:1/457: write d2/f79 [782403,40119] 0 2024-09-11T00:07:18.254 INFO:tasks.workunit.client.1.smithi203.stdout:5/606: symlink dc/dd/d9b/lcd 0 2024-09-11T00:07:18.255 INFO:tasks.workunit.client.0.smithi111.stdout:7/480: dread - dd/d1d/d2d/d68/d79/f7b zero size 2024-09-11T00:07:18.257 INFO:tasks.workunit.client.0.smithi111.stdout:3/497: dread - d1c/d1d/d22/d44/f97 zero size 2024-09-11T00:07:18.257 INFO:tasks.workunit.client.1.smithi203.stdout:5/607: truncate dc/dd/d15/dbd/f81 676353 0 2024-09-11T00:07:18.258 INFO:tasks.workunit.client.0.smithi111.stdout:4/457: write d18/d3b/d61/f87 [795436,7697] 0 2024-09-11T00:07:18.259 INFO:tasks.workunit.client.1.smithi203.stdout:5/608: write dc/dd/d15/d3b/f63 [5222889,53447] 0 2024-09-11T00:07:18.262 INFO:tasks.workunit.client.0.smithi111.stdout:0/529: dread d3/d13/d1e/d29/d70/fa2 [0,4194304] 0 2024-09-11T00:07:18.266 INFO:tasks.workunit.client.0.smithi111.stdout:1/458: creat d2/de/d12/d3c/d4b/d6a/d63/f9d x:0 0 0 2024-09-11T00:07:18.266 INFO:tasks.workunit.client.0.smithi111.stdout:7/481: mknod dd/d1d/d2d/c96 0 2024-09-11T00:07:18.268 INFO:tasks.workunit.client.0.smithi111.stdout:3/498: symlink d1c/d1d/d22/d44/d5a/d74/la3 0 2024-09-11T00:07:18.269 INFO:tasks.workunit.client.1.smithi203.stdout:5/609: truncate dc/dd/d1e/d7b/fb7 600552 0 2024-09-11T00:07:18.270 INFO:tasks.workunit.client.0.smithi111.stdout:9/530: dread d6/dc/f20 [0,4194304] 0 2024-09-11T00:07:18.273 INFO:tasks.workunit.client.0.smithi111.stdout:9/531: read - d6/db/d1b/d74/f84 zero size 2024-09-11T00:07:18.273 INFO:tasks.workunit.client.1.smithi203.stdout:7/490: truncate dd/d1c/f78 1996953 0 2024-09-11T00:07:18.276 INFO:tasks.workunit.client.1.smithi203.stdout:0/500: dwrite d0/d2/d37/d5b/f79 [0,4194304] 0 2024-09-11T00:07:18.277 INFO:tasks.workunit.client.0.smithi111.stdout:0/530: stat d3/da/lab 0 2024-09-11T00:07:18.277 INFO:tasks.workunit.client.1.smithi203.stdout:1/550: dwrite d8/faf [0,4194304] 0 2024-09-11T00:07:18.278 INFO:tasks.workunit.client.1.smithi203.stdout:7/491: write dd/d3b/d5b/f83 [461260,46015] 0 2024-09-11T00:07:18.280 INFO:tasks.workunit.client.1.smithi203.stdout:7/492: readlink dd/l15 0 2024-09-11T00:07:18.281 INFO:tasks.workunit.client.0.smithi111.stdout:5/498: dread d10/d1e/d23/d2b/d2f/f3f [0,4194304] 0 2024-09-11T00:07:18.282 INFO:tasks.workunit.client.0.smithi111.stdout:8/540: dread d11/d23/d2c/d46/d64/f76 [0,4194304] 0 2024-09-11T00:07:18.284 INFO:tasks.workunit.client.0.smithi111.stdout:2/478: symlink d0/d3/de/d3b/d62/d6d/da1/la7 0 2024-09-11T00:07:18.286 INFO:tasks.workunit.client.0.smithi111.stdout:5/499: chown d10/d1e/d23/d30/f37 45522736 1 2024-09-11T00:07:18.287 INFO:tasks.workunit.client.1.smithi203.stdout:5/610: mkdir dc/dd/d15/dbd/dce 0 2024-09-11T00:07:18.288 INFO:tasks.workunit.client.1.smithi203.stdout:0/501: mknod d0/d2/d37/d7f/ca3 0 2024-09-11T00:07:18.292 INFO:tasks.workunit.client.1.smithi203.stdout:2/460: truncate f8 1509561 0 2024-09-11T00:07:18.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:18 smithi203 ceph-mon[33225]: pgmap v7: 65 pgs: 65 active+clean; 1.9 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 46 MiB/s rd, 144 MiB/s wr, 282 op/s 2024-09-11T00:07:18.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:18 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/1560813386' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:07:18.298 INFO:tasks.workunit.client.1.smithi203.stdout:1/551: mknod d8/d9/cc2 0 2024-09-11T00:07:18.299 INFO:tasks.workunit.client.0.smithi111.stdout:0/531: creat d3/d26/fbf x:0 0 0 2024-09-11T00:07:18.301 INFO:tasks.workunit.client.1.smithi203.stdout:0/502: symlink d0/d2/d7e/la4 0 2024-09-11T00:07:18.305 INFO:tasks.workunit.client.1.smithi203.stdout:1/552: truncate d8/d9/d15/d27/fb6 368309 0 2024-09-11T00:07:18.305 INFO:tasks.workunit.client.1.smithi203.stdout:2/461: rmdir d13/d15/d19/d1c 39 2024-09-11T00:07:18.305 INFO:tasks.workunit.client.1.smithi203.stdout:7/493: dwrite dd/d1c/f5f [0,4194304] 0 2024-09-11T00:07:18.306 INFO:tasks.workunit.client.0.smithi111.stdout:4/458: mkdir d18/d20/d40/d78/d79/d90/d91 0 2024-09-11T00:07:18.307 INFO:tasks.workunit.client.1.smithi203.stdout:2/462: write d13/d15/d30/d59/f7b [876443,37637] 0 2024-09-11T00:07:18.308 INFO:tasks.workunit.client.0.smithi111.stdout:2/479: dread - d0/d3/d12/f5f zero size 2024-09-11T00:07:18.310 INFO:tasks.workunit.client.0.smithi111.stdout:8/541: truncate d11/d23/d2c/d46/f8c 530928 0 2024-09-11T00:07:18.311 INFO:tasks.workunit.client.1.smithi203.stdout:1/553: read d8/f1a [657475,32945] 0 2024-09-11T00:07:18.313 INFO:tasks.workunit.client.0.smithi111.stdout:5/500: rmdir d10/d1e/d23/d30/d59/d53 39 2024-09-11T00:07:18.315 INFO:tasks.workunit.client.0.smithi111.stdout:8/542: write d11/d23/d7e/f97 [507159,86498] 0 2024-09-11T00:07:18.315 INFO:tasks.workunit.client.1.smithi203.stdout:7/494: mkdir dd/d1c/d52/d8f/d31/d58/d93/d98/db2 0 2024-09-11T00:07:18.316 INFO:tasks.workunit.client.1.smithi203.stdout:1/554: truncate d8/d19/d60/d90/d3e/d4b/d3a/f9f 1465994 0 2024-09-11T00:07:18.317 INFO:tasks.workunit.client.1.smithi203.stdout:6/434: sync 2024-09-11T00:07:18.317 INFO:tasks.workunit.client.1.smithi203.stdout:8/440: sync 2024-09-11T00:07:18.318 INFO:tasks.workunit.client.1.smithi203.stdout:1/555: chown d8/d19/d60/d90/d3e/d9b 611 1 2024-09-11T00:07:18.322 INFO:tasks.workunit.client.0.smithi111.stdout:0/532: dwrite d3/d13/d1e/d29/d49/d51/d61/d93/f97 [0,4194304] 0 2024-09-11T00:07:18.323 INFO:tasks.workunit.client.0.smithi111.stdout:9/532: fdatasync d6/db/d34/f66 0 2024-09-11T00:07:18.324 INFO:tasks.workunit.client.0.smithi111.stdout:4/459: creat d18/d20/d3c/d5e/f92 x:0 0 0 2024-09-11T00:07:18.326 INFO:tasks.workunit.client.1.smithi203.stdout:7/495: creat dd/d3b/d9f/fb3 x:0 0 0 2024-09-11T00:07:18.329 INFO:tasks.workunit.client.0.smithi111.stdout:3/499: dread f17 [0,4194304] 0 2024-09-11T00:07:18.331 INFO:tasks.workunit.client.0.smithi111.stdout:4/460: write d18/d20/f46 [4671214,53192] 0 2024-09-11T00:07:18.334 INFO:tasks.workunit.client.0.smithi111.stdout:1/459: dread d2/d2b/d2c/f42 [0,4194304] 0 2024-09-11T00:07:18.338 INFO:tasks.workunit.client.0.smithi111.stdout:1/460: stat d2/de/d12/d3c/l52 0 2024-09-11T00:07:18.338 INFO:tasks.workunit.client.0.smithi111.stdout:7/482: getdents dd/d1d/d2d/d2e 0 2024-09-11T00:07:18.338 INFO:tasks.workunit.client.1.smithi203.stdout:2/463: mknod d13/d15/d30/d5a/d8b/c8d 0 2024-09-11T00:07:18.342 INFO:tasks.workunit.client.0.smithi111.stdout:7/483: truncate dd/d1d/d1f/f50 202013 0 2024-09-11T00:07:18.342 INFO:tasks.workunit.client.0.smithi111.stdout:5/501: mkdir d10/d1e/d23/d26/d3a/d98/d6d/d9e 0 2024-09-11T00:07:18.342 INFO:tasks.workunit.client.0.smithi111.stdout:2/480: dwrite d0/d3/d12/d52/d6c/f8f [0,4194304] 0 2024-09-11T00:07:18.345 INFO:tasks.workunit.client.1.smithi203.stdout:6/435: dwrite d0/d27/d35/d39/d3c/f79 [0,4194304] 0 2024-09-11T00:07:18.345 INFO:tasks.workunit.client.1.smithi203.stdout:0/503: getdents d0/d2/d67/d8d 0 2024-09-11T00:07:18.345 INFO:tasks.workunit.client.0.smithi111.stdout:2/481: write d0/d83/f85 [539925,108261] 0 2024-09-11T00:07:18.348 INFO:tasks.workunit.client.0.smithi111.stdout:2/482: stat d0/f7b 0 2024-09-11T00:07:18.349 INFO:tasks.workunit.client.1.smithi203.stdout:7/496: readlink dd/d1c/l60 0 2024-09-11T00:07:18.349 INFO:tasks.workunit.client.0.smithi111.stdout:9/533: chown d6/db/d1b/l68 1163 1 2024-09-11T00:07:18.351 INFO:tasks.workunit.client.1.smithi203.stdout:2/464: rmdir d13 39 2024-09-11T00:07:18.353 INFO:tasks.workunit.client.0.smithi111.stdout:8/543: mknod d11/d23/cac 0 2024-09-11T00:07:18.361 INFO:tasks.workunit.client.0.smithi111.stdout:3/500: creat d1c/d1d/fa4 x:0 0 0 2024-09-11T00:07:18.361 INFO:tasks.workunit.client.0.smithi111.stdout:6/438: sync 2024-09-11T00:07:18.365 INFO:tasks.workunit.client.0.smithi111.stdout:0/533: read d3/d13/d1e/d29/f3e [2175871,117401] 0 2024-09-11T00:07:18.365 INFO:tasks.workunit.client.1.smithi203.stdout:0/504: rename d0/d2/d3d/d5a/f88 to d0/d2/d67/fa5 0 2024-09-11T00:07:18.367 INFO:tasks.workunit.client.0.smithi111.stdout:1/461: creat d2/de/d12/d3c/d4b/d6a/f9e x:0 0 0 2024-09-11T00:07:18.369 INFO:tasks.workunit.client.0.smithi111.stdout:1/462: read - d2/de/d12/d3c/d4b/d6a/d3a/f92 zero size 2024-09-11T00:07:18.370 INFO:tasks.workunit.client.0.smithi111.stdout:5/502: rmdir d10/d1e/d23/d30/d3c/d60/d7e/d47/d66/d76 39 2024-09-11T00:07:18.371 INFO:tasks.workunit.client.0.smithi111.stdout:5/503: chown d10/d1e/l24 3956408 1 2024-09-11T00:07:18.372 INFO:tasks.workunit.client.0.smithi111.stdout:5/504: stat d10/d1e/d23/d30 0 2024-09-11T00:07:18.377 INFO:tasks.workunit.client.0.smithi111.stdout:8/544: rename d11/d21/d38/f41 to d11/d23/d2c/d7f/fad 0 2024-09-11T00:07:18.378 INFO:tasks.workunit.client.1.smithi203.stdout:7/497: dread dd/d1c/d52/d8f/f3f [0,4194304] 0 2024-09-11T00:07:18.382 INFO:tasks.workunit.client.1.smithi203.stdout:7/498: write dd/d4d/f7a [4693669,65051] 0 2024-09-11T00:07:18.383 INFO:tasks.workunit.client.1.smithi203.stdout:8/441: dread d1/d13/d17/d2f/f32 [0,4194304] 0 2024-09-11T00:07:18.384 INFO:tasks.workunit.client.0.smithi111.stdout:3/501: mknod d1c/d1d/d22/d44/d5a/d74/ca5 0 2024-09-11T00:07:18.386 INFO:tasks.workunit.client.1.smithi203.stdout:8/442: write d1/d13/d22/d6f/d8d/f6b [1590210,18530] 0 2024-09-11T00:07:18.389 INFO:tasks.workunit.client.0.smithi111.stdout:0/534: creat d3/da/d7b/fc0 x:0 0 0 2024-09-11T00:07:18.392 INFO:tasks.workunit.client.0.smithi111.stdout:5/505: symlink d10/d1e/d23/d30/d3c/d60/d63/l9f 0 2024-09-11T00:07:18.397 INFO:tasks.workunit.client.1.smithi203.stdout:1/556: dwrite d8/d9/f63 [4194304,4194304] 0 2024-09-11T00:07:18.398 INFO:tasks.workunit.client.0.smithi111.stdout:3/502: dwrite d1c/d21/d92/f9a [0,4194304] 0 2024-09-11T00:07:18.400 INFO:tasks.workunit.client.0.smithi111.stdout:3/503: fdatasync d1c/d1d/d22/d23/d2f/f8e 0 2024-09-11T00:07:18.400 INFO:tasks.workunit.client.1.smithi203.stdout:0/505: dread d0/d2/fd [0,4194304] 0 2024-09-11T00:07:18.401 INFO:tasks.workunit.client.0.smithi111.stdout:1/463: rename d2/d7c to d2/de/d93/d9f 0 2024-09-11T00:07:18.402 INFO:tasks.workunit.client.1.smithi203.stdout:0/506: write d0/f8c [594671,84650] 0 2024-09-11T00:07:18.404 INFO:tasks.workunit.client.0.smithi111.stdout:1/464: fdatasync d2/de/d12/d3c/d4b/d6a/d63/f78 0 2024-09-11T00:07:18.404 INFO:tasks.workunit.client.1.smithi203.stdout:0/507: write d0/f8c [1447481,101787] 0 2024-09-11T00:07:18.406 INFO:tasks.workunit.client.0.smithi111.stdout:4/461: creat d18/d1f/f93 x:0 0 0 2024-09-11T00:07:18.406 INFO:tasks.workunit.client.0.smithi111.stdout:2/483: write d0/d3/d12/f41 [1251667,29348] 0 2024-09-11T00:07:18.410 INFO:tasks.workunit.client.0.smithi111.stdout:8/545: creat d11/d23/d2c/d7f/fae x:0 0 0 2024-09-11T00:07:18.410 INFO:tasks.workunit.client.0.smithi111.stdout:8/546: readlink d11/l2d 0 2024-09-11T00:07:18.411 INFO:tasks.workunit.client.0.smithi111.stdout:2/484: truncate d0/d3/d2e/f66 4529061 0 2024-09-11T00:07:18.411 INFO:tasks.workunit.client.0.smithi111.stdout:7/484: creat dd/f97 x:0 0 0 2024-09-11T00:07:18.414 INFO:tasks.workunit.client.0.smithi111.stdout:5/506: creat d10/d1e/d23/d2b/fa0 x:0 0 0 2024-09-11T00:07:18.415 INFO:tasks.workunit.client.1.smithi203.stdout:6/436: fsync d0/d32/f5e 0 2024-09-11T00:07:18.419 INFO:tasks.workunit.client.1.smithi203.stdout:6/437: write d0/d27/d35/d38/d7d/f7f [4724,51849] 0 2024-09-11T00:07:18.419 INFO:tasks.workunit.client.0.smithi111.stdout:6/439: rename d7/d22/d2c/d38/f4c to d7/d2b/d7c/f93 0 2024-09-11T00:07:18.421 INFO:tasks.workunit.client.0.smithi111.stdout:6/440: fdatasync d7/d2b/f68 0 2024-09-11T00:07:18.423 INFO:tasks.workunit.client.0.smithi111.stdout:1/465: creat d2/d2b/d2c/d56/fa0 x:0 0 0 2024-09-11T00:07:18.426 INFO:tasks.workunit.client.0.smithi111.stdout:4/462: symlink d18/d20/d3c/d5e/l94 0 2024-09-11T00:07:18.426 INFO:tasks.workunit.client.0.smithi111.stdout:6/441: write d7/d22/d1d/d69/f6d [866777,108120] 0 2024-09-11T00:07:18.427 INFO:tasks.workunit.client.0.smithi111.stdout:8/547: mknod d11/d23/d2c/caf 0 2024-09-11T00:07:18.428 INFO:tasks.workunit.client.1.smithi203.stdout:7/499: creat dd/d1c/d52/d8f/d31/d58/d93/d98/fb4 x:0 0 0 2024-09-11T00:07:18.430 INFO:tasks.workunit.client.0.smithi111.stdout:0/535: creat d3/da/d7b/d84/da8/fc1 x:0 0 0 2024-09-11T00:07:18.432 INFO:tasks.workunit.client.0.smithi111.stdout:2/485: dwrite d0/d3/f4e [0,4194304] 0 2024-09-11T00:07:18.433 INFO:tasks.workunit.client.1.smithi203.stdout:8/443: symlink d1/d13/d22/d5d/l96 0 2024-09-11T00:07:18.434 INFO:tasks.workunit.client.0.smithi111.stdout:5/507: dwrite d10/f1c [4194304,4194304] 0 2024-09-11T00:07:18.437 INFO:tasks.workunit.client.0.smithi111.stdout:0/536: write d3/d13/f89 [2293026,1258] 0 2024-09-11T00:07:18.437 INFO:tasks.workunit.client.0.smithi111.stdout:5/508: chown d10/d1e/d23/c56 42285463 1 2024-09-11T00:07:18.439 INFO:tasks.workunit.client.1.smithi203.stdout:0/508: symlink d0/d2/d92/la6 0 2024-09-11T00:07:18.441 INFO:tasks.workunit.client.0.smithi111.stdout:3/504: rename l1b to d1c/d1d/d22/d31/d33/d5f/la6 0 2024-09-11T00:07:18.449 INFO:tasks.workunit.client.1.smithi203.stdout:0/509: dread d0/d2/d37/f4b [0,4194304] 0 2024-09-11T00:07:18.449 INFO:tasks.workunit.client.0.smithi111.stdout:6/442: chown d7/d2b/l3c 85 1 2024-09-11T00:07:18.453 INFO:tasks.workunit.client.0.smithi111.stdout:8/548: creat d11/d23/d3d/d5f/fb0 x:0 0 0 2024-09-11T00:07:18.455 INFO:tasks.workunit.client.0.smithi111.stdout:4/463: dread d18/d3b/d61/f7c [0,4194304] 0 2024-09-11T00:07:18.455 INFO:tasks.workunit.client.0.smithi111.stdout:5/509: dread d10/d1e/d23/d26/d3a/f5d [0,4194304] 0 2024-09-11T00:07:18.460 INFO:tasks.workunit.client.0.smithi111.stdout:0/537: symlink d3/d13/d66/lc2 0 2024-09-11T00:07:18.461 INFO:tasks.workunit.client.0.smithi111.stdout:4/464: dread - d18/f71 zero size 2024-09-11T00:07:18.461 INFO:tasks.workunit.client.1.smithi203.stdout:6/438: mknod d0/d27/d7b/d7e/c89 0 2024-09-11T00:07:18.461 INFO:tasks.workunit.client.0.smithi111.stdout:8/549: chown d11/d23/d2c/d7f/fae 1307768 1 2024-09-11T00:07:18.463 INFO:tasks.workunit.client.0.smithi111.stdout:4/465: fsync f15 0 2024-09-11T00:07:18.466 INFO:tasks.workunit.client.0.smithi111.stdout:2/486: dwrite d0/d3/de/f44 [0,4194304] 0 2024-09-11T00:07:18.466 INFO:tasks.workunit.client.0.smithi111.stdout:1/466: dwrite d2/de/d12/d3c/d4b/d6a/d63/f9d [0,4194304] 0 2024-09-11T00:07:18.467 INFO:tasks.workunit.client.1.smithi203.stdout:3/561: sync 2024-09-11T00:07:18.468 INFO:tasks.workunit.client.1.smithi203.stdout:4/453: sync 2024-09-11T00:07:18.469 INFO:tasks.workunit.client.0.smithi111.stdout:4/466: truncate d18/d1f/d33/f83 826076 0 2024-09-11T00:07:18.470 INFO:tasks.workunit.client.0.smithi111.stdout:6/443: mknod d7/d2b/d7c/c94 0 2024-09-11T00:07:18.473 INFO:tasks.workunit.client.1.smithi203.stdout:2/465: link d13/d15/d19/d1c/f2d d13/d15/d19/d1c/d76/f8e 0 2024-09-11T00:07:18.475 INFO:tasks.workunit.client.0.smithi111.stdout:9/534: sync 2024-09-11T00:07:18.476 INFO:tasks.workunit.client.0.smithi111.stdout:1/467: dread d2/de/d12/d3c/d4b/d6a/d3a/f6b [0,4194304] 0 2024-09-11T00:07:18.478 INFO:tasks.workunit.client.0.smithi111.stdout:1/468: chown d2/de/d82/l99 228 1 2024-09-11T00:07:18.483 INFO:tasks.workunit.client.0.smithi111.stdout:5/510: rmdir d10/d1e/d23/d26 39 2024-09-11T00:07:18.483 INFO:tasks.workunit.client.0.smithi111.stdout:7/485: write dd/f8c [2033195,99849] 0 2024-09-11T00:07:18.483 INFO:tasks.workunit.client.1.smithi203.stdout:1/557: getdents d8/d9/d15/d35/d81 0 2024-09-11T00:07:18.486 INFO:tasks.workunit.client.0.smithi111.stdout:8/550: chown d11/d21/d38 867856548 1 2024-09-11T00:07:18.489 INFO:tasks.workunit.client.0.smithi111.stdout:4/467: dwrite d18/d20/d40/d78/f86 [0,4194304] 0 2024-09-11T00:07:18.491 INFO:tasks.workunit.client.1.smithi203.stdout:1/558: rmdir d8/d9/d15/d35 39 2024-09-11T00:07:18.492 INFO:tasks.workunit.client.0.smithi111.stdout:4/468: truncate d18/d20/d40/f8f 620912 0 2024-09-11T00:07:18.493 INFO:tasks.workunit.client.0.smithi111.stdout:6/444: mkdir d7/d22/d26/d95 0 2024-09-11T00:07:18.494 INFO:tasks.workunit.client.0.smithi111.stdout:4/469: write d18/f57 [507654,87438] 0 2024-09-11T00:07:18.494 INFO:tasks.workunit.client.1.smithi203.stdout:3/562: symlink d8/da/d5c/lcc 0 2024-09-11T00:07:18.494 INFO:tasks.workunit.client.1.smithi203.stdout:8/444: truncate d1/d13/f19 1429628 0 2024-09-11T00:07:18.496 INFO:tasks.workunit.client.0.smithi111.stdout:4/470: fdatasync d18/d1f/f8b 0 2024-09-11T00:07:18.497 INFO:tasks.workunit.client.0.smithi111.stdout:3/505: link d1c/d1d/d22/f60 d1c/d1d/d22/d31/d33/d5f/fa7 0 2024-09-11T00:07:18.497 INFO:tasks.workunit.client.1.smithi203.stdout:1/559: readlink d8/d19/d60/d90/d3e/d4b/d80/d8d/lbc 0 2024-09-11T00:07:18.498 INFO:tasks.workunit.client.0.smithi111.stdout:3/506: fsync d1c/d1d/d22/d31/d33/d5f/f9d 0 2024-09-11T00:07:18.499 INFO:tasks.workunit.client.0.smithi111.stdout:3/507: readlink d1c/d1d/d22/d31/d33/l65 0 2024-09-11T00:07:18.504 INFO:tasks.workunit.client.0.smithi111.stdout:1/469: rename d2/d2b/d2c to d2/de/d12/d3c/d4b/d6a/d63/d73/da1 0 2024-09-11T00:07:18.507 INFO:tasks.workunit.client.0.smithi111.stdout:2/487: symlink d0/d3/de/d3b/d92/la8 0 2024-09-11T00:07:18.507 INFO:tasks.workunit.client.0.smithi111.stdout:6/445: readlink d7/la 0 2024-09-11T00:07:18.508 INFO:tasks.workunit.client.0.smithi111.stdout:9/535: mknod d6/db/d34/d37/d4c/d99/cac 0 2024-09-11T00:07:18.509 INFO:tasks.workunit.client.0.smithi111.stdout:2/488: chown d0/d3/de/d50 10224985 1 2024-09-11T00:07:18.511 INFO:tasks.workunit.client.0.smithi111.stdout:0/538: rename d3/d13/d1e/d29/d49/fbb to d3/dc/fc3 0 2024-09-11T00:07:18.513 INFO:tasks.workunit.client.0.smithi111.stdout:8/551: creat d11/d21/d6f/dab/fb1 x:0 0 0 2024-09-11T00:07:18.513 INFO:tasks.workunit.client.0.smithi111.stdout:9/536: write d6/db/d34/d37/f29 [1845588,114693] 0 2024-09-11T00:07:18.514 INFO:tasks.workunit.client.0.smithi111.stdout:1/470: creat d2/de/d93/d9c/fa2 x:0 0 0 2024-09-11T00:07:18.515 INFO:tasks.workunit.client.0.smithi111.stdout:3/508: chown d1c/d1d/d22/d23/d58/f75 107112059 1 2024-09-11T00:07:18.518 INFO:tasks.workunit.client.0.smithi111.stdout:5/511: link d10/d1e/d23/d26/d3a/f5d d10/d1e/d23/fa1 0 2024-09-11T00:07:18.519 INFO:tasks.workunit.client.0.smithi111.stdout:0/539: fsync d3/f3b 0 2024-09-11T00:07:18.521 INFO:tasks.workunit.client.0.smithi111.stdout:9/537: creat d6/db/d1b/d41/d80/fad x:0 0 0 2024-09-11T00:07:18.526 INFO:tasks.workunit.client.0.smithi111.stdout:4/471: write f5 [981523,107460] 0 2024-09-11T00:07:18.529 INFO:tasks.workunit.client.0.smithi111.stdout:5/512: rename d10/d1e/d23/d30/d3c/d60/d7e/d47 to d10/d1e/d23/d30/d3c/d60/da2 0 2024-09-11T00:07:18.529 INFO:tasks.workunit.client.0.smithi111.stdout:9/538: write d6/db/d1b/f22 [3379679,11098] 0 2024-09-11T00:07:18.533 INFO:tasks.workunit.client.0.smithi111.stdout:5/513: stat d10/d1e/d23/d2b/l31 0 2024-09-11T00:07:18.533 INFO:tasks.workunit.client.0.smithi111.stdout:1/471: truncate d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/f71 105946 0 2024-09-11T00:07:18.535 INFO:tasks.workunit.client.0.smithi111.stdout:5/514: chown d10/d1e 3031112 1 2024-09-11T00:07:18.538 INFO:tasks.workunit.client.0.smithi111.stdout:9/539: symlink d6/db/d7a/d9a/lae 0 2024-09-11T00:07:18.538 INFO:tasks.workunit.client.0.smithi111.stdout:4/472: truncate d18/d1f/f2e 417779 0 2024-09-11T00:07:18.540 INFO:tasks.workunit.client.0.smithi111.stdout:5/515: chown d10/d1e/d23/d30/d3c/d60/da2 1324 1 2024-09-11T00:07:18.542 INFO:tasks.workunit.client.0.smithi111.stdout:7/486: dread dd/f26 [0,4194304] 0 2024-09-11T00:07:18.543 INFO:tasks.workunit.client.0.smithi111.stdout:3/509: dwrite d1c/d1d/d22/d23/d2f/d63/f81 [0,4194304] 0 2024-09-11T00:07:18.545 INFO:tasks.workunit.client.0.smithi111.stdout:9/540: write d6/db/f79 [1630441,22208] 0 2024-09-11T00:07:18.551 INFO:tasks.workunit.client.0.smithi111.stdout:7/487: mknod dd/d1d/d4d/c98 0 2024-09-11T00:07:18.552 INFO:tasks.workunit.client.0.smithi111.stdout:1/472: dread d2/fd [0,4194304] 0 2024-09-11T00:07:18.554 INFO:tasks.workunit.client.0.smithi111.stdout:3/510: creat d1c/d1d/d22/d44/d5a/d74/fa8 x:0 0 0 2024-09-11T00:07:18.555 INFO:tasks.workunit.client.0.smithi111.stdout:7/488: chown dd/d1d/f66 0 1 2024-09-11T00:07:18.557 INFO:tasks.workunit.client.0.smithi111.stdout:4/473: getdents d18/d20/d3c/d5e 0 2024-09-11T00:07:18.558 INFO:tasks.workunit.client.0.smithi111.stdout:2/489: dread d0/d3/de/d3b/f58 [0,4194304] 0 2024-09-11T00:07:18.560 INFO:tasks.workunit.client.0.smithi111.stdout:4/474: fdatasync d18/d1f/f93 0 2024-09-11T00:07:18.561 INFO:tasks.workunit.client.0.smithi111.stdout:5/516: dread d10/d1e/d23/d26/f50 [0,4194304] 0 2024-09-11T00:07:18.563 INFO:tasks.workunit.client.0.smithi111.stdout:3/511: creat d1c/d1d/d22/d31/d62/fa9 x:0 0 0 2024-09-11T00:07:18.565 INFO:tasks.workunit.client.0.smithi111.stdout:4/475: write d18/d20/d4a/f2f [582764,540] 0 2024-09-11T00:07:18.565 INFO:tasks.workunit.client.0.smithi111.stdout:9/541: dwrite d6/db/d34/d37/f35 [0,4194304] 0 2024-09-11T00:07:18.566 INFO:tasks.workunit.client.0.smithi111.stdout:1/473: rename d2/de/f11 to d2/de/d12/fa3 0 2024-09-11T00:07:18.568 INFO:tasks.workunit.client.0.smithi111.stdout:3/512: mknod d1c/d1d/d86/caa 0 2024-09-11T00:07:18.570 INFO:tasks.workunit.client.0.smithi111.stdout:5/517: write d10/d1e/d23/d30/d3c/d60/d63/f6f [1067853,127437] 0 2024-09-11T00:07:18.571 INFO:tasks.workunit.client.0.smithi111.stdout:9/542: fsync d6/db/d1b/f22 0 2024-09-11T00:07:18.573 INFO:tasks.workunit.client.0.smithi111.stdout:4/476: rmdir d18/d1f/d33 39 2024-09-11T00:07:18.575 INFO:tasks.workunit.client.0.smithi111.stdout:5/518: chown l9 8183562 1 2024-09-11T00:07:18.575 INFO:tasks.workunit.client.0.smithi111.stdout:1/474: symlink d2/d77/la4 0 2024-09-11T00:07:18.580 INFO:tasks.workunit.client.0.smithi111.stdout:2/490: write d0/d3/de/d3b/f49 [1063680,91905] 0 2024-09-11T00:07:18.581 INFO:tasks.workunit.client.0.smithi111.stdout:5/519: rmdir d10/d1e/d23/d2b/d2f 39 2024-09-11T00:07:18.586 INFO:tasks.workunit.client.0.smithi111.stdout:2/491: read d0/d3/f3e [109702,67938] 0 2024-09-11T00:07:18.586 INFO:tasks.workunit.client.0.smithi111.stdout:1/475: write d2/de/d12/d3c/d4b/d6a/d3a/f68 [7050,92058] 0 2024-09-11T00:07:18.589 INFO:tasks.workunit.client.0.smithi111.stdout:4/477: truncate d18/d39/f53 1751243 0 2024-09-11T00:07:18.590 INFO:tasks.workunit.client.0.smithi111.stdout:9/543: truncate d6/db/d34/d37/f28 1069706 0 2024-09-11T00:07:18.591 INFO:tasks.workunit.client.1.smithi203.stdout:8/445: write d1/d13/f33 [938095,129092] 0 2024-09-11T00:07:18.592 INFO:tasks.workunit.client.0.smithi111.stdout:7/489: dwrite dd/d1d/d1f/f47 [0,4194304] 0 2024-09-11T00:07:18.592 INFO:tasks.workunit.client.0.smithi111.stdout:2/492: write d0/d3/f84 [152373,18735] 0 2024-09-11T00:07:18.592 INFO:tasks.workunit.client.0.smithi111.stdout:5/520: creat d10/d1e/d23/d30/d59/d7b/fa3 x:0 0 0 2024-09-11T00:07:18.593 INFO:tasks.workunit.client.0.smithi111.stdout:1/476: stat d2/de/d12/d3c/d4b/d6a/d3a/l8d 0 2024-09-11T00:07:18.596 INFO:tasks.workunit.client.1.smithi203.stdout:8/446: chown d1/d13/d22/c89 140620 1 2024-09-11T00:07:18.599 INFO:tasks.workunit.client.0.smithi111.stdout:4/478: unlink d18/f29 0 2024-09-11T00:07:18.600 INFO:tasks.workunit.client.1.smithi203.stdout:2/466: dwrite d13/d47/f61 [0,4194304] 0 2024-09-11T00:07:18.600 INFO:tasks.workunit.client.0.smithi111.stdout:1/477: write d2/de/d12/d3c/d4b/d6a/f9e [495323,5549] 0 2024-09-11T00:07:18.600 INFO:tasks.workunit.client.0.smithi111.stdout:9/544: write d6/db/d1b/d41/f42 [570020,36544] 0 2024-09-11T00:07:18.601 INFO:tasks.workunit.client.0.smithi111.stdout:2/493: rmdir d0/d3/de/d3b/d97 39 2024-09-11T00:07:18.603 INFO:tasks.workunit.client.0.smithi111.stdout:5/521: write d10/d1e/d23/d30/d3c/d60/da2/d66/f67 [7076579,7113] 0 2024-09-11T00:07:18.608 INFO:tasks.workunit.client.0.smithi111.stdout:5/522: write d10/d1e/d23/d30/d3c/d60/d7e/f88 [1583864,124707] 0 2024-09-11T00:07:18.611 INFO:tasks.workunit.client.1.smithi203.stdout:0/510: dwrite d0/d2/d37/f3e [0,4194304] 0 2024-09-11T00:07:18.612 INFO:tasks.workunit.client.1.smithi203.stdout:6/439: dwrite d0/d27/f72 [4194304,4194304] 0 2024-09-11T00:07:18.614 INFO:tasks.workunit.client.1.smithi203.stdout:8/447: unlink d1/d13/d17/d48/c74 0 2024-09-11T00:07:18.614 INFO:tasks.workunit.client.1.smithi203.stdout:3/563: dread d8/da/d37/d83/d65/d8b/f9e [4194304,4194304] 0 2024-09-11T00:07:18.615 INFO:tasks.workunit.client.0.smithi111.stdout:4/479: mkdir d18/d1f/d36/d95 0 2024-09-11T00:07:18.616 INFO:tasks.workunit.client.1.smithi203.stdout:3/564: dread - d8/da/d5c/d80/fb8 zero size 2024-09-11T00:07:18.618 INFO:tasks.workunit.client.0.smithi111.stdout:1/478: unlink d2/l6 0 2024-09-11T00:07:18.621 INFO:tasks.workunit.client.0.smithi111.stdout:9/545: mknod d6/db/d1b/d74/caf 0 2024-09-11T00:07:18.625 INFO:tasks.workunit.client.1.smithi203.stdout:0/511: creat d0/d2/d37/d5b/d73/fa7 x:0 0 0 2024-09-11T00:07:18.625 INFO:tasks.workunit.client.0.smithi111.stdout:3/513: dread d1c/d1d/d22/d31/d33/f3f [0,4194304] 0 2024-09-11T00:07:18.626 INFO:tasks.workunit.client.1.smithi203.stdout:6/440: dread d0/d27/d35/d38/d7d/f7f [0,4194304] 0 2024-09-11T00:07:18.626 INFO:tasks.workunit.client.1.smithi203.stdout:8/448: read d1/fe [5072937,119366] 0 2024-09-11T00:07:18.628 INFO:tasks.workunit.client.0.smithi111.stdout:7/490: dread dd/d1d/f39 [0,4194304] 0 2024-09-11T00:07:18.629 INFO:tasks.workunit.client.1.smithi203.stdout:6/441: write d0/d5b/d5c/f69 [856990,86671] 0 2024-09-11T00:07:18.630 INFO:tasks.workunit.client.0.smithi111.stdout:3/514: readlink d1c/d1d/d22/d31/d62/l8d 0 2024-09-11T00:07:18.630 INFO:tasks.workunit.client.0.smithi111.stdout:2/494: rename d0/d3/de/c16 to d0/d3/d2e/ca9 0 2024-09-11T00:07:18.631 INFO:tasks.workunit.client.1.smithi203.stdout:6/442: chown d0/d27/d7b 1 1 2024-09-11T00:07:18.632 INFO:tasks.workunit.client.0.smithi111.stdout:7/491: fdatasync dd/d1d/d7e/f94 0 2024-09-11T00:07:18.634 INFO:tasks.workunit.client.0.smithi111.stdout:7/492: fsync dd/d1d/d1f/f65 0 2024-09-11T00:07:18.637 INFO:tasks.workunit.client.0.smithi111.stdout:5/523: symlink d10/d1e/la4 0 2024-09-11T00:07:18.637 INFO:tasks.workunit.client.1.smithi203.stdout:0/512: mknod d0/d2/d3d/d5a/ca8 0 2024-09-11T00:07:18.638 INFO:tasks.workunit.client.0.smithi111.stdout:5/524: stat d10/d1e/la4 0 2024-09-11T00:07:18.640 INFO:tasks.workunit.client.0.smithi111.stdout:4/480: rename d18/d20/d4a/f2c to d18/d20/d3c/d5e/d75/d8d/f96 0 2024-09-11T00:07:18.642 INFO:tasks.workunit.client.1.smithi203.stdout:1/560: dwrite d8/d19/fa6 [4194304,4194304] 0 2024-09-11T00:07:18.645 INFO:tasks.workunit.client.1.smithi203.stdout:2/467: link d13/d22/f6e d13/d56/f8f 0 2024-09-11T00:07:18.647 INFO:tasks.workunit.client.1.smithi203.stdout:6/443: chown d0/d27/d35/d39/f51 21116920 1 2024-09-11T00:07:18.647 INFO:tasks.workunit.client.0.smithi111.stdout:3/515: symlink d1c/d1d/d22/d31/d33/lab 0 2024-09-11T00:07:18.648 INFO:tasks.workunit.client.1.smithi203.stdout:3/565: mkdir d8/da/d37/d53/dcd 0 2024-09-11T00:07:18.650 INFO:tasks.workunit.client.1.smithi203.stdout:0/513: fdatasync d0/d2/f51 0 2024-09-11T00:07:18.651 INFO:tasks.workunit.client.0.smithi111.stdout:3/516: write d1c/d1d/d22/d23/d2f/f7a [18245,5803] 0 2024-09-11T00:07:18.652 INFO:tasks.workunit.client.1.smithi203.stdout:8/449: mkdir d1/d13/d17/d81/d97 0 2024-09-11T00:07:18.658 INFO:tasks.workunit.client.1.smithi203.stdout:9/499: sync 2024-09-11T00:07:18.660 INFO:tasks.workunit.client.1.smithi203.stdout:6/444: rename d0/d27/d35/d39/f62 to d0/d27/d7b/f8a 0 2024-09-11T00:07:18.661 INFO:tasks.workunit.client.0.smithi111.stdout:1/479: rename d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d97 to d2/de/d93/d9f/da5 0 2024-09-11T00:07:18.662 INFO:tasks.workunit.client.1.smithi203.stdout:3/566: fdatasync d8/da/d37/f82 0 2024-09-11T00:07:18.662 INFO:tasks.workunit.client.0.smithi111.stdout:4/481: dread d18/d3b/d61/f87 [0,4194304] 0 2024-09-11T00:07:18.664 INFO:tasks.workunit.client.1.smithi203.stdout:0/514: symlink d0/d2/la9 0 2024-09-11T00:07:18.668 INFO:tasks.workunit.client.1.smithi203.stdout:2/468: fdatasync d13/f14 0 2024-09-11T00:07:18.669 INFO:tasks.workunit.client.0.smithi111.stdout:7/493: dread dd/d1d/d1f/f5e [0,4194304] 0 2024-09-11T00:07:18.669 INFO:tasks.workunit.client.0.smithi111.stdout:3/517: mkdir d1c/d1d/dac 0 2024-09-11T00:07:18.670 INFO:tasks.workunit.client.1.smithi203.stdout:6/445: read d0/d5b/f64 [285200,110524] 0 2024-09-11T00:07:18.672 INFO:tasks.workunit.client.1.smithi203.stdout:6/446: fdatasync d0/d27/f72 0 2024-09-11T00:07:18.672 INFO:tasks.workunit.client.0.smithi111.stdout:4/482: symlink d18/d20/d4e/l97 0 2024-09-11T00:07:18.674 INFO:tasks.workunit.client.1.smithi203.stdout:8/450: dwrite d1/d13/d17/f62 [0,4194304] 0 2024-09-11T00:07:18.675 INFO:tasks.workunit.client.0.smithi111.stdout:5/525: rmdir d10/d8d 0 2024-09-11T00:07:18.676 INFO:tasks.workunit.client.1.smithi203.stdout:8/451: stat d1/d13/d3a/d4c/c85 0 2024-09-11T00:07:18.679 INFO:tasks.workunit.client.0.smithi111.stdout:1/480: dread d2/de/d12/d3c/d4b/d6a/d63/d73/da1/f50 [0,4194304] 0 2024-09-11T00:07:18.679 INFO:tasks.workunit.client.1.smithi203.stdout:8/452: chown d1/d13/d17/d2f/d52/d59/f6e 2 1 2024-09-11T00:07:18.680 INFO:tasks.workunit.client.1.smithi203.stdout:1/561: dread d8/d19/d60/d90/d3e/d4b/d80/d8d/db0/fb7 [0,4194304] 0 2024-09-11T00:07:18.680 INFO:tasks.workunit.client.0.smithi111.stdout:7/494: fsync dd/d48/f5f 0 2024-09-11T00:07:18.682 INFO:tasks.workunit.client.0.smithi111.stdout:3/518: mknod d1c/d1d/d22/d23/d2f/cad 0 2024-09-11T00:07:18.682 INFO:tasks.workunit.client.0.smithi111.stdout:7/495: stat dd/d1d/d2d/d2e/d4e/l52 0 2024-09-11T00:07:18.683 INFO:tasks.workunit.client.1.smithi203.stdout:9/500: symlink d6/de/d19/d24/d40/d45/l9f 0 2024-09-11T00:07:18.686 INFO:tasks.workunit.client.1.smithi203.stdout:9/501: write d6/de/d19/d24/d54/f9c [789148,75764] 0 2024-09-11T00:07:18.687 INFO:tasks.workunit.client.0.smithi111.stdout:5/526: symlink d10/d1e/d23/d30/d3c/d60/d7e/la5 0 2024-09-11T00:07:18.689 INFO:tasks.workunit.client.1.smithi203.stdout:9/502: chown d6/de/d19/d24/f6d 74 1 2024-09-11T00:07:18.690 INFO:tasks.workunit.client.1.smithi203.stdout:3/567: mkdir d8/dce 0 2024-09-11T00:07:18.691 INFO:tasks.workunit.client.0.smithi111.stdout:2/495: dread d0/d3/d12/d52/d6c/f7c [0,4194304] 0 2024-09-11T00:07:18.695 INFO:tasks.workunit.client.0.smithi111.stdout:9/546: dwrite d6/db/fd [0,4194304] 0 2024-09-11T00:07:18.697 INFO:tasks.workunit.client.1.smithi203.stdout:6/447: mknod d0/d27/d35/d39/d3c/c8b 0 2024-09-11T00:07:18.699 INFO:tasks.workunit.client.0.smithi111.stdout:1/481: symlink d2/de/d12/d3c/d4b/d6a/d63/la6 0 2024-09-11T00:07:18.702 INFO:tasks.workunit.client.1.smithi203.stdout:9/503: dread d6/de/d19/f31 [0,4194304] 0 2024-09-11T00:07:18.704 INFO:tasks.workunit.client.1.smithi203.stdout:2/469: mkdir d13/d15/d90 0 2024-09-11T00:07:18.705 INFO:tasks.workunit.client.0.smithi111.stdout:7/496: creat dd/d49/f99 x:0 0 0 2024-09-11T00:07:18.709 INFO:tasks.workunit.client.1.smithi203.stdout:8/453: creat d1/d13/d43/d46/d76/f98 x:0 0 0 2024-09-11T00:07:18.712 INFO:tasks.workunit.client.0.smithi111.stdout:2/496: rmdir d0/d3 39 2024-09-11T00:07:18.716 INFO:tasks.workunit.client.1.smithi203.stdout:3/568: creat d8/da/d5c/d6b/fcf x:0 0 0 2024-09-11T00:07:18.721 INFO:tasks.workunit.client.1.smithi203.stdout:0/515: rename d0/d1d/d4c/f6f to d0/faa 0 2024-09-11T00:07:18.722 INFO:tasks.workunit.client.0.smithi111.stdout:8/552: sync 2024-09-11T00:07:18.722 INFO:tasks.workunit.client.0.smithi111.stdout:0/540: sync 2024-09-11T00:07:18.722 INFO:tasks.workunit.client.0.smithi111.stdout:6/446: sync 2024-09-11T00:07:18.723 INFO:tasks.workunit.client.0.smithi111.stdout:9/547: rename d6/db/f5b to d6/db/d1b/d41/fb0 0 2024-09-11T00:07:18.725 INFO:tasks.workunit.client.1.smithi203.stdout:9/504: mkdir d6/de/d19/d21/da0 0 2024-09-11T00:07:18.726 INFO:tasks.workunit.client.0.smithi111.stdout:1/482: creat d2/de/d93/fa7 x:0 0 0 2024-09-11T00:07:18.728 INFO:tasks.workunit.client.0.smithi111.stdout:4/483: dwrite d18/d20/d40/d78/f86 [0,4194304] 0 2024-09-11T00:07:18.728 INFO:tasks.workunit.client.1.smithi203.stdout:2/470: fdatasync d13/d22/f4a 0 2024-09-11T00:07:18.729 INFO:tasks.workunit.client.0.smithi111.stdout:3/519: fdatasync d1c/d1d/d22/f70 0 2024-09-11T00:07:18.733 INFO:tasks.workunit.client.1.smithi203.stdout:1/562: symlink d8/d19/d31/lc3 0 2024-09-11T00:07:18.737 INFO:tasks.workunit.client.0.smithi111.stdout:5/527: symlink d10/d1e/d23/d2b/d2f/la6 0 2024-09-11T00:07:18.738 INFO:tasks.workunit.client.1.smithi203.stdout:1/563: chown d8/d9/f5c 21923 1 2024-09-11T00:07:18.738 INFO:tasks.workunit.client.0.smithi111.stdout:9/548: dwrite d6/db/f18 [0,4194304] 0 2024-09-11T00:07:18.740 INFO:tasks.workunit.client.1.smithi203.stdout:3/569: dwrite d8/da/d11/fb6 [0,4194304] 0 2024-09-11T00:07:18.745 INFO:tasks.workunit.client.1.smithi203.stdout:5/611: sync 2024-09-11T00:07:18.747 INFO:tasks.workunit.client.1.smithi203.stdout:6/448: rename d0/d27/d35/c5d to d0/d32/d5a/c8c 0 2024-09-11T00:07:18.750 INFO:tasks.workunit.client.1.smithi203.stdout:0/516: dwrite d0/d2/f41 [0,4194304] 0 2024-09-11T00:07:18.758 INFO:tasks.workunit.client.1.smithi203.stdout:9/505: dwrite d6/de/d19/f97 [0,4194304] 0 2024-09-11T00:07:18.767 INFO:tasks.workunit.client.1.smithi203.stdout:9/506: write d6/de/d32/d52/d55/d66/d80/f9b [62300,84439] 0 2024-09-11T00:07:18.769 INFO:tasks.workunit.client.0.smithi111.stdout:8/553: chown d11/d23/d2c/d46/f4d 1303 1 2024-09-11T00:07:18.773 INFO:tasks.workunit.client.0.smithi111.stdout:6/447: rename d7/d22/d2c/f4e to d7/d22/d3f/d74/f96 0 2024-09-11T00:07:18.780 INFO:tasks.workunit.client.0.smithi111.stdout:1/483: rmdir d2/de 39 2024-09-11T00:07:18.781 INFO:tasks.workunit.client.1.smithi203.stdout:3/570: fdatasync d8/f3d 0 2024-09-11T00:07:18.784 INFO:tasks.workunit.client.0.smithi111.stdout:3/520: fsync d1c/d1d/d22/d44/f88 0 2024-09-11T00:07:18.785 INFO:tasks.workunit.client.0.smithi111.stdout:3/521: readlink d1c/d1d/l30 0 2024-09-11T00:07:18.786 INFO:tasks.workunit.client.0.smithi111.stdout:7/497: symlink dd/d1d/d76/l9a 0 2024-09-11T00:07:18.789 INFO:tasks.workunit.client.0.smithi111.stdout:9/549: creat d6/d52/fb1 x:0 0 0 2024-09-11T00:07:18.791 INFO:tasks.workunit.client.0.smithi111.stdout:9/550: chown d6/db/d1b/d41/f57 45 1 2024-09-11T00:07:18.791 INFO:tasks.workunit.client.1.smithi203.stdout:9/507: mknod d6/de/d19/d24/d54/ca1 0 2024-09-11T00:07:18.791 INFO:tasks.workunit.client.1.smithi203.stdout:8/454: dwrite d1/f3b [0,4194304] 0 2024-09-11T00:07:18.792 INFO:tasks.workunit.client.0.smithi111.stdout:5/528: symlink d10/d1e/d23/d2b/d5c/la7 0 2024-09-11T00:07:18.794 INFO:tasks.workunit.client.1.smithi203.stdout:8/455: chown d1/d13/d17/d2f/d52/f92 15073361 1 2024-09-11T00:07:18.799 INFO:tasks.workunit.client.1.smithi203.stdout:7/500: sync 2024-09-11T00:07:18.799 INFO:tasks.workunit.client.1.smithi203.stdout:4/454: sync 2024-09-11T00:07:18.801 INFO:tasks.workunit.client.1.smithi203.stdout:7/501: readlink dd/l44 0 2024-09-11T00:07:18.801 INFO:tasks.workunit.client.1.smithi203.stdout:4/455: dread - db/d12/d15/f78 zero size 2024-09-11T00:07:18.803 INFO:tasks.workunit.client.1.smithi203.stdout:3/571: mkdir d8/d2a/dd0 0 2024-09-11T00:07:18.804 INFO:tasks.workunit.client.0.smithi111.stdout:5/529: dread d10/d1e/d23/d30/d3c/f40 [0,4194304] 0 2024-09-11T00:07:18.810 INFO:tasks.workunit.client.1.smithi203.stdout:2/471: truncate d13/d15/d19/d1c/f2a 2322190 0 2024-09-11T00:07:18.810 INFO:tasks.workunit.client.0.smithi111.stdout:2/497: write d0/d3/d12/d52/f74 [88651,69443] 0 2024-09-11T00:07:18.812 INFO:tasks.workunit.client.1.smithi203.stdout:1/564: write d8/d28/fc0 [259650,59556] 0 2024-09-11T00:07:18.813 INFO:tasks.workunit.client.1.smithi203.stdout:8/456: symlink d1/d13/d17/d48/d61/l99 0 2024-09-11T00:07:18.814 INFO:tasks.workunit.client.0.smithi111.stdout:3/522: mkdir d1c/d21/dae 0 2024-09-11T00:07:18.814 INFO:tasks.workunit.client.1.smithi203.stdout:9/508: dread d6/de/d19/d30/f42 [0,4194304] 0 2024-09-11T00:07:18.816 INFO:tasks.workunit.client.0.smithi111.stdout:7/498: creat dd/d1d/d1f/f9b x:0 0 0 2024-09-11T00:07:18.820 INFO:tasks.workunit.client.1.smithi203.stdout:7/502: mkdir dd/d3b/d9f/db5 0 2024-09-11T00:07:18.820 INFO:tasks.workunit.client.1.smithi203.stdout:3/572: mknod d8/da/d37/d53/d63/cd1 0 2024-09-11T00:07:18.821 INFO:tasks.workunit.client.1.smithi203.stdout:5/612: symlink dc/dd/d13/lcf 0 2024-09-11T00:07:18.822 INFO:tasks.workunit.client.0.smithi111.stdout:0/541: creat d3/fc4 x:0 0 0 2024-09-11T00:07:18.824 INFO:tasks.workunit.client.0.smithi111.stdout:8/554: truncate d11/d23/d2c/d46/f8c 528828 0 2024-09-11T00:07:18.825 INFO:tasks.workunit.client.1.smithi203.stdout:2/472: creat d13/d15/d30/f91 x:0 0 0 2024-09-11T00:07:18.825 INFO:tasks.workunit.client.0.smithi111.stdout:6/448: mknod d7/d22/d26/d87/d7a/c97 0 2024-09-11T00:07:18.828 INFO:tasks.workunit.client.0.smithi111.stdout:5/530: fsync d10/d1e/d25/d6e/f80 0 2024-09-11T00:07:18.829 INFO:tasks.workunit.client.1.smithi203.stdout:6/449: dwrite d0/d27/d35/d38/d7d/f7f [0,4194304] 0 2024-09-11T00:07:18.829 INFO:tasks.workunit.client.1.smithi203.stdout:5/613: write dc/d2b/f93 [1043593,62502] 0 2024-09-11T00:07:18.829 INFO:tasks.workunit.client.1.smithi203.stdout:1/565: mknod d8/d28/d64/cc4 0 2024-09-11T00:07:18.831 INFO:tasks.workunit.client.0.smithi111.stdout:7/499: dwrite dd/d1d/d2d/d68/d79/f7b [0,4194304] 0 2024-09-11T00:07:18.832 INFO:tasks.workunit.client.1.smithi203.stdout:4/456: dwrite db/dd/d16/d38/d3c/d41/f8e [0,4194304] 0 2024-09-11T00:07:18.839 INFO:tasks.workunit.client.0.smithi111.stdout:2/498: creat d0/d3/de/d3b/d62/d6d/faa x:0 0 0 2024-09-11T00:07:18.841 INFO:tasks.workunit.client.0.smithi111.stdout:2/499: chown d0/d3 5528 1 2024-09-11T00:07:18.850 INFO:tasks.workunit.client.0.smithi111.stdout:8/555: unlink d11/d21/d6f/f79 0 2024-09-11T00:07:18.851 INFO:tasks.workunit.client.1.smithi203.stdout:2/473: mknod d13/d15/d30/d5a/c92 0 2024-09-11T00:07:18.853 INFO:tasks.workunit.client.0.smithi111.stdout:5/531: dwrite d10/d1e/d23/d2b/d5c/f8e [0,4194304] 0 2024-09-11T00:07:18.854 INFO:tasks.workunit.client.0.smithi111.stdout:7/500: dread dd/f1a [0,4194304] 0 2024-09-11T00:07:18.855 INFO:tasks.workunit.client.1.smithi203.stdout:5/614: creat dc/dd/d56/fd0 x:0 0 0 2024-09-11T00:07:18.856 INFO:tasks.workunit.client.0.smithi111.stdout:7/501: chown dd/d1d/d4b/d8f 148 1 2024-09-11T00:07:18.860 INFO:tasks.workunit.client.1.smithi203.stdout:9/509: unlink d6/de/d19/d30/l3a 0 2024-09-11T00:07:18.862 INFO:tasks.workunit.client.0.smithi111.stdout:3/523: dwrite d1c/d1d/d22/d31/d33/f36 [4194304,4194304] 0 2024-09-11T00:07:18.862 INFO:tasks.workunit.client.0.smithi111.stdout:1/484: write d2/de/ff [1106278,78890] 0 2024-09-11T00:07:18.866 INFO:tasks.workunit.client.0.smithi111.stdout:2/500: symlink d0/d3/d12/d38/lab 0 2024-09-11T00:07:18.869 INFO:tasks.workunit.client.1.smithi203.stdout:7/503: creat dd/d3b/d9f/db5/fb6 x:0 0 0 2024-09-11T00:07:18.872 INFO:tasks.workunit.client.0.smithi111.stdout:0/542: symlink d3/lc5 0 2024-09-11T00:07:18.876 INFO:tasks.workunit.client.1.smithi203.stdout:2/474: mknod d13/d22/c93 0 2024-09-11T00:07:18.877 INFO:tasks.workunit.client.1.smithi203.stdout:5/615: dread - dc/dd/d13/f7f zero size 2024-09-11T00:07:18.878 INFO:tasks.workunit.client.0.smithi111.stdout:4/484: getdents d18/d20/d40/d78/d79 0 2024-09-11T00:07:18.881 INFO:tasks.workunit.client.0.smithi111.stdout:3/524: symlink d1c/d1d/d22/d23/laf 0 2024-09-11T00:07:18.882 INFO:tasks.workunit.client.1.smithi203.stdout:3/573: creat d8/fd2 x:0 0 0 2024-09-11T00:07:18.887 INFO:tasks.workunit.client.1.smithi203.stdout:8/457: getdents d1/d13/d43/d46 0 2024-09-11T00:07:18.887 INFO:tasks.workunit.client.0.smithi111.stdout:9/551: truncate d6/d52/f59 1539914 0 2024-09-11T00:07:18.888 INFO:tasks.workunit.client.0.smithi111.stdout:6/449: creat d7/d22/d26/d87/d41/d77/f98 x:0 0 0 2024-09-11T00:07:18.890 INFO:tasks.workunit.client.1.smithi203.stdout:1/566: link d8/d9/f63 d8/d9/d15/fc5 0 2024-09-11T00:07:18.892 INFO:tasks.workunit.client.0.smithi111.stdout:8/556: dwrite d11/d23/d2c/d7f/fad [0,4194304] 0 2024-09-11T00:07:18.893 INFO:tasks.workunit.client.0.smithi111.stdout:5/532: mknod d10/d1e/d23/d30/d3c/d60/da2/d66/d76/ca8 0 2024-09-11T00:07:18.894 INFO:tasks.workunit.client.1.smithi203.stdout:4/457: creat db/d12/f93 x:0 0 0 2024-09-11T00:07:18.899 INFO:tasks.workunit.client.0.smithi111.stdout:4/485: creat d18/d20/d3c/f98 x:0 0 0 2024-09-11T00:07:18.899 INFO:tasks.workunit.client.1.smithi203.stdout:2/475: mkdir d13/d15/d19/d1c/d76/d94 0 2024-09-11T00:07:18.902 INFO:tasks.workunit.client.1.smithi203.stdout:9/510: mkdir d6/de/d32/d52/d55/da2 0 2024-09-11T00:07:18.903 INFO:tasks.workunit.client.0.smithi111.stdout:4/486: chown f7 17 1 2024-09-11T00:07:18.903 INFO:tasks.workunit.client.0.smithi111.stdout:2/501: symlink d0/d3/de/lac 0 2024-09-11T00:07:18.904 INFO:tasks.workunit.client.0.smithi111.stdout:2/502: truncate d0/d3/de/f5d 399425 0 2024-09-11T00:07:18.904 INFO:tasks.workunit.client.0.smithi111.stdout:3/525: unlink d1c/d1d/d22/d44/d5a/d74/la3 0 2024-09-11T00:07:18.911 INFO:tasks.workunit.client.1.smithi203.stdout:7/504: write dd/d1c/d52/d8f/f4f [1027537,69964] 0 2024-09-11T00:07:18.912 INFO:tasks.workunit.client.1.smithi203.stdout:1/567: creat d8/d19/d60/d90/d3e/d66/fc6 x:0 0 0 2024-09-11T00:07:18.918 INFO:tasks.workunit.client.1.smithi203.stdout:6/450: dwrite d0/f63 [0,4194304] 0 2024-09-11T00:07:18.920 INFO:tasks.workunit.client.1.smithi203.stdout:4/458: dwrite db/dd/d16/d38/d3c/f72 [0,4194304] 0 2024-09-11T00:07:18.922 INFO:tasks.workunit.client.1.smithi203.stdout:5/616: write dc/dd/d15/d3b/f40 [638300,45886] 0 2024-09-11T00:07:18.923 INFO:tasks.workunit.client.1.smithi203.stdout:5/617: chown dc/d4f 121848795 1 2024-09-11T00:07:18.925 INFO:tasks.workunit.client.1.smithi203.stdout:9/511: rmdir d6/de/d19/d21 39 2024-09-11T00:07:18.927 INFO:tasks.workunit.client.0.smithi111.stdout:1/485: creat d2/de/d12/d3c/fa8 x:0 0 0 2024-09-11T00:07:18.934 INFO:tasks.workunit.client.0.smithi111.stdout:4/487: symlink d18/d20/d3c/d5e/d75/d8d/l99 0 2024-09-11T00:07:18.935 INFO:tasks.workunit.client.0.smithi111.stdout:0/543: creat d3/d13/d1e/d29/d49/d51/d61/d93/da7/fc6 x:0 0 0 2024-09-11T00:07:18.943 INFO:tasks.workunit.client.0.smithi111.stdout:3/526: creat d1c/d1d/d22/d31/d33/fb0 x:0 0 0 2024-09-11T00:07:18.943 INFO:tasks.workunit.client.1.smithi203.stdout:9/512: dwrite d6/de/d19/d30/f77 [0,4194304] 0 2024-09-11T00:07:18.945 INFO:tasks.workunit.client.1.smithi203.stdout:7/505: creat dd/d1c/fb7 x:0 0 0 2024-09-11T00:07:18.946 INFO:tasks.workunit.client.0.smithi111.stdout:1/486: dwrite d2/f10 [0,4194304] 0 2024-09-11T00:07:18.947 INFO:tasks.workunit.client.1.smithi203.stdout:7/506: dread - dd/d3b/d9f/fb3 zero size 2024-09-11T00:07:18.948 INFO:tasks.workunit.client.1.smithi203.stdout:0/517: sync 2024-09-11T00:07:18.948 INFO:tasks.workunit.client.1.smithi203.stdout:2/476: mkdir d13/d95 0 2024-09-11T00:07:18.949 INFO:tasks.workunit.client.0.smithi111.stdout:3/527: fdatasync d1c/d1d/d22/d23/d2f/d63/f81 0 2024-09-11T00:07:18.950 INFO:tasks.workunit.client.0.smithi111.stdout:6/450: symlink d7/d22/d26/d87/l99 0 2024-09-11T00:07:18.952 INFO:tasks.workunit.client.1.smithi203.stdout:1/568: creat d8/d19/d60/d90/d3e/d4b/d80/d8d/db0/fc7 x:0 0 0 2024-09-11T00:07:18.953 INFO:tasks.workunit.client.0.smithi111.stdout:7/502: getdents dd/d1d/d1f 0 2024-09-11T00:07:18.953 INFO:tasks.workunit.client.1.smithi203.stdout:7/507: chown dd/d1c/d52/d8f/d31/d58 689578 1 2024-09-11T00:07:18.954 INFO:tasks.workunit.client.1.smithi203.stdout:4/459: fsync f1 0 2024-09-11T00:07:18.957 INFO:tasks.workunit.client.1.smithi203.stdout:6/451: creat d0/d27/d7b/d7e/f8d x:0 0 0 2024-09-11T00:07:18.961 INFO:tasks.workunit.client.0.smithi111.stdout:7/503: write dd/d1d/d4d/f60 [104208,58438] 0 2024-09-11T00:07:18.962 INFO:tasks.workunit.client.1.smithi203.stdout:3/574: link d8/da/d11/f55 d8/da/d5c/d99/fd3 0 2024-09-11T00:07:18.964 INFO:tasks.workunit.client.1.smithi203.stdout:7/508: dread - dd/d1c/d52/d8f/d31/d58/d93/d98/fb4 zero size 2024-09-11T00:07:18.964 INFO:tasks.workunit.client.0.smithi111.stdout:4/488: fdatasync d18/d20/f34 0 2024-09-11T00:07:18.966 INFO:tasks.workunit.client.1.smithi203.stdout:8/458: rmdir d1/d13/d17/d2f/d52/d49/d68/d94 0 2024-09-11T00:07:18.968 INFO:tasks.workunit.client.1.smithi203.stdout:0/518: creat d0/d2/d37/d5b/fab x:0 0 0 2024-09-11T00:07:18.968 INFO:tasks.workunit.client.1.smithi203.stdout:7/509: write dd/d3b/d9f/db5/fb6 [807653,67589] 0 2024-09-11T00:07:18.969 INFO:tasks.workunit.client.1.smithi203.stdout:0/519: dread - d0/d2/f8a zero size 2024-09-11T00:07:18.973 INFO:tasks.workunit.client.1.smithi203.stdout:0/520: fdatasync d0/d2/d67/f93 0 2024-09-11T00:07:18.974 INFO:tasks.workunit.client.0.smithi111.stdout:9/552: creat d6/db/d34/d37/d4c/fb2 x:0 0 0 2024-09-11T00:07:18.974 INFO:tasks.workunit.client.1.smithi203.stdout:7/510: write dd/d1c/d52/d8f/f4f [3922975,58479] 0 2024-09-11T00:07:18.974 INFO:tasks.workunit.client.0.smithi111.stdout:5/533: dwrite d10/d1e/d23/d30/d59/d53/f5e [0,4194304] 0 2024-09-11T00:07:18.975 INFO:tasks.workunit.client.0.smithi111.stdout:1/487: symlink d2/d2b/la9 0 2024-09-11T00:07:18.976 INFO:tasks.workunit.client.1.smithi203.stdout:5/618: write dc/dd/d56/dad/f64 [892905,65843] 0 2024-09-11T00:07:18.977 INFO:tasks.workunit.client.0.smithi111.stdout:8/557: truncate d11/d23/d2c/d53/f5a 2048538 0 2024-09-11T00:07:18.980 INFO:tasks.workunit.client.1.smithi203.stdout:6/452: symlink d0/d32/d5a/l8e 0 2024-09-11T00:07:18.981 INFO:tasks.workunit.client.1.smithi203.stdout:6/453: readlink d0/d27/le 0 2024-09-11T00:07:18.981 INFO:tasks.workunit.client.0.smithi111.stdout:1/488: stat d2/de/d12/d3c/d4b/d6a/d63/d73/l91 0 2024-09-11T00:07:18.982 INFO:tasks.workunit.client.0.smithi111.stdout:0/544: write f1 [1019997,3482] 0 2024-09-11T00:07:18.982 INFO:tasks.workunit.client.1.smithi203.stdout:6/454: stat d0/d27/le 0 2024-09-11T00:07:18.983 INFO:tasks.workunit.client.0.smithi111.stdout:6/451: rename d7/d22/d1d/d69/l92 to d7/d22/d3f/d74/d7f/d61/d6a/l9a 0 2024-09-11T00:07:18.990 INFO:tasks.workunit.client.1.smithi203.stdout:8/459: dwrite d1/d13/d17/d2f/d52/d59/f6e [0,4194304] 0 2024-09-11T00:07:18.992 INFO:tasks.workunit.client.1.smithi203.stdout:4/460: fdatasync db/d12/f37 0 2024-09-11T00:07:19.004 INFO:tasks.workunit.client.1.smithi203.stdout:0/521: read d0/d2/d37/f3b [33593,47506] 0 2024-09-11T00:07:19.004 INFO:tasks.workunit.client.0.smithi111.stdout:4/489: creat d18/d20/d3c/f9a x:0 0 0 2024-09-11T00:07:19.004 INFO:tasks.workunit.client.0.smithi111.stdout:9/553: rmdir d6/db/d1b/d41 39 2024-09-11T00:07:19.005 INFO:tasks.workunit.client.1.smithi203.stdout:5/619: mknod dc/dd/d15/d3b/d7a/cd1 0 2024-09-11T00:07:19.006 INFO:tasks.workunit.client.0.smithi111.stdout:9/554: stat d6 0 2024-09-11T00:07:19.006 INFO:tasks.workunit.client.1.smithi203.stdout:1/569: creat d8/d19/d60/d90/d3e/d4b/d80/d91/dac/fc8 x:0 0 0 2024-09-11T00:07:19.007 INFO:tasks.workunit.client.1.smithi203.stdout:5/620: chown dc/dd/d15/dbd 172153 1 2024-09-11T00:07:19.008 INFO:tasks.workunit.client.1.smithi203.stdout:1/570: chown d8/l37 1729 1 2024-09-11T00:07:19.009 INFO:tasks.workunit.client.0.smithi111.stdout:4/490: chown f8 3 1 2024-09-11T00:07:19.010 INFO:tasks.workunit.client.1.smithi203.stdout:6/455: creat d0/d5b/f8f x:0 0 0 2024-09-11T00:07:19.014 INFO:tasks.workunit.client.1.smithi203.stdout:8/460: dread - d1/f3d zero size 2024-09-11T00:07:19.015 INFO:tasks.workunit.client.0.smithi111.stdout:5/534: dwrite d10/d1e/d25/f93 [0,4194304] 0 2024-09-11T00:07:19.015 INFO:tasks.workunit.client.0.smithi111.stdout:7/504: mknod dd/d48/c9c 0 2024-09-11T00:07:19.015 INFO:tasks.workunit.client.0.smithi111.stdout:2/503: getdents d0/d3/de/d50 0 2024-09-11T00:07:19.015 INFO:tasks.workunit.client.1.smithi203.stdout:2/477: link cc d13/d15/d19/d1c/d76/d94/c96 0 2024-09-11T00:07:19.021 INFO:tasks.workunit.client.1.smithi203.stdout:9/513: truncate d6/de/d19/d24/f27 3083150 0 2024-09-11T00:07:19.021 INFO:tasks.workunit.client.1.smithi203.stdout:8/461: truncate d1/d13/d22/d5d/f66 1464703 0 2024-09-11T00:07:19.023 INFO:tasks.workunit.client.0.smithi111.stdout:0/545: stat d3/dc/l10 0 2024-09-11T00:07:19.024 INFO:tasks.workunit.client.1.smithi203.stdout:1/571: creat d8/d11/fc9 x:0 0 0 2024-09-11T00:07:19.028 INFO:tasks.workunit.client.1.smithi203.stdout:7/511: dread dd/f1a [4194304,4194304] 0 2024-09-11T00:07:19.030 INFO:tasks.workunit.client.0.smithi111.stdout:3/528: dwrite d1c/d1d/d22/d31/d62/f9c [0,4194304] 0 2024-09-11T00:07:19.031 INFO:tasks.workunit.client.1.smithi203.stdout:3/575: rename d8/da/d37/d83/dc0/fc7 to d8/da/d37/d83/fd4 0 2024-09-11T00:07:19.032 INFO:tasks.workunit.client.0.smithi111.stdout:4/491: dread - d18/d20/d3c/f74 zero size 2024-09-11T00:07:19.034 INFO:tasks.workunit.client.1.smithi203.stdout:3/576: write d8/d3c/f5a [2835371,45336] 0 2024-09-11T00:07:19.034 INFO:tasks.workunit.client.1.smithi203.stdout:6/456: rmdir d0/d27/d35 39 2024-09-11T00:07:19.036 INFO:tasks.workunit.client.0.smithi111.stdout:6/452: dwrite d7/d22/d3f/f65 [0,4194304] 0 2024-09-11T00:07:19.037 INFO:tasks.workunit.client.0.smithi111.stdout:8/558: dwrite d11/d23/f65 [0,4194304] 0 2024-09-11T00:07:19.045 INFO:tasks.workunit.client.1.smithi203.stdout:4/461: write db/d12/d15/d2a/f34 [524694,108559] 0 2024-09-11T00:07:19.049 INFO:tasks.workunit.client.1.smithi203.stdout:9/514: unlink d6/de/d47/f65 0 2024-09-11T00:07:19.058 INFO:tasks.workunit.client.1.smithi203.stdout:7/512: symlink dd/d1c/d52/d8f/d31/d67/lb8 0 2024-09-11T00:07:19.064 INFO:tasks.workunit.client.1.smithi203.stdout:7/513: fsync dd/d3b/d5b/f7b 0 2024-09-11T00:07:19.064 INFO:tasks.workunit.client.1.smithi203.stdout:2/478: mkdir d13/d15/d19/d1c/d76/d94/d97 0 2024-09-11T00:07:19.064 INFO:tasks.workunit.client.1.smithi203.stdout:0/522: link d0/d2/d37/f4b d0/d2/d37/fac 0 2024-09-11T00:07:19.066 INFO:tasks.workunit.client.1.smithi203.stdout:0/523: chown d0/d2/d3d/d5a/f6e 6350 1 2024-09-11T00:07:19.066 INFO:tasks.workunit.client.1.smithi203.stdout:0/524: fdatasync d0/d2/f8a 0 2024-09-11T00:07:19.068 INFO:tasks.workunit.client.1.smithi203.stdout:8/462: mknod d1/d13/c9a 0 2024-09-11T00:07:19.082 INFO:tasks.workunit.client.1.smithi203.stdout:2/479: creat d13/d22/d53/f98 x:0 0 0 2024-09-11T00:07:19.087 INFO:tasks.workunit.client.1.smithi203.stdout:1/572: dread d8/d28/d64/f65 [0,4194304] 0 2024-09-11T00:07:19.088 INFO:tasks.workunit.client.0.smithi111.stdout:1/489: creat d2/de/d12/faa x:0 0 0 2024-09-11T00:07:19.090 INFO:tasks.workunit.client.1.smithi203.stdout:7/514: dread dd/f18 [0,4194304] 0 2024-09-11T00:07:19.091 INFO:tasks.workunit.client.1.smithi203.stdout:8/463: symlink d1/d13/d22/d6f/l9b 0 2024-09-11T00:07:19.093 INFO:tasks.workunit.client.1.smithi203.stdout:7/515: chown dd/d1c/d52/f8d 337906 1 2024-09-11T00:07:19.094 INFO:tasks.workunit.client.0.smithi111.stdout:9/555: read d6/db/d1b/f33 [853869,27633] 0 2024-09-11T00:07:19.097 INFO:tasks.workunit.client.0.smithi111.stdout:7/505: creat dd/d1d/d1f/f9d x:0 0 0 2024-09-11T00:07:19.098 INFO:tasks.workunit.client.1.smithi203.stdout:2/480: read d13/d15/f1b [206103,95457] 0 2024-09-11T00:07:19.098 INFO:tasks.workunit.client.1.smithi203.stdout:5/621: truncate dc/dd/d15/d3b/f47 1809576 0 2024-09-11T00:07:19.099 INFO:tasks.workunit.client.0.smithi111.stdout:5/535: mknod d10/d1e/d23/d30/d3c/d60/ca9 0 2024-09-11T00:07:19.100 INFO:tasks.workunit.client.1.smithi203.stdout:1/573: rmdir d8/d19/d60/d90/d3e/d4b/d80/d8d 39 2024-09-11T00:07:19.101 INFO:tasks.workunit.client.1.smithi203.stdout:2/481: dread - d13/d15/f48 zero size 2024-09-11T00:07:19.102 INFO:tasks.workunit.client.0.smithi111.stdout:2/504: rmdir d0/d3/de 39 2024-09-11T00:07:19.103 INFO:tasks.workunit.client.0.smithi111.stdout:5/536: stat d10/d1e/d23/d30/d3c/d60/da2/d66/l69 0 2024-09-11T00:07:19.106 INFO:tasks.workunit.client.1.smithi203.stdout:9/515: rename d6/de/d19/d24/f8f to d6/de/fa3 0 2024-09-11T00:07:19.157 INFO:tasks.workunit.client.1.smithi203.stdout:7/516: chown dd/d1c/d52/d8f/d31/f45 0 1 2024-09-11T00:07:19.157 INFO:tasks.workunit.client.1.smithi203.stdout:7/517: chown dd/d1c/d4b/f65 18548165 1 2024-09-11T00:07:19.157 INFO:tasks.workunit.client.1.smithi203.stdout:6/457: write d0/d27/d35/d39/f51 [103019,36905] 0 2024-09-11T00:07:19.157 INFO:tasks.workunit.client.1.smithi203.stdout:8/464: dread d1/f2 [4194304,4194304] 0 2024-09-11T00:07:19.157 INFO:tasks.workunit.client.1.smithi203.stdout:8/465: readlink d1/d13/d3a/d4c/l4d 0 2024-09-11T00:07:19.157 INFO:tasks.workunit.client.1.smithi203.stdout:0/525: write d0/d1d/d5d/f71 [6846,70077] 0 2024-09-11T00:07:19.157 INFO:tasks.workunit.client.1.smithi203.stdout:7/518: creat dd/d3b/fb9 x:0 0 0 2024-09-11T00:07:19.157 INFO:tasks.workunit.client.1.smithi203.stdout:8/466: dwrite d1/d13/d43/d46/d76/f7d [0,4194304] 0 2024-09-11T00:07:19.157 INFO:tasks.workunit.client.1.smithi203.stdout:2/482: write d13/d15/f1a [4859475,107144] 0 2024-09-11T00:07:19.157 INFO:tasks.workunit.client.1.smithi203.stdout:4/462: rename db/dd/f2c to db/d12/d15/d2a/d71/f94 0 2024-09-11T00:07:19.157 INFO:tasks.workunit.client.1.smithi203.stdout:9/516: mknod d6/de/d32/ca4 0 2024-09-11T00:07:19.157 INFO:tasks.workunit.client.1.smithi203.stdout:1/574: write d8/d11/f20 [2043764,104536] 0 2024-09-11T00:07:19.158 INFO:tasks.workunit.client.0.smithi111.stdout:3/529: symlink d1c/d1d/d22/d31/d33/d5f/lb1 0 2024-09-11T00:07:19.158 INFO:tasks.workunit.client.0.smithi111.stdout:0/546: dwrite d3/f7a [0,4194304] 0 2024-09-11T00:07:19.158 INFO:tasks.workunit.client.0.smithi111.stdout:1/490: fsync d2/de/d12/d3c/d4b/d6a/d63/d73/da1/f42 0 2024-09-11T00:07:19.158 INFO:tasks.workunit.client.0.smithi111.stdout:1/491: read d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/f5b [3734391,120820] 0 2024-09-11T00:07:19.158 INFO:tasks.workunit.client.0.smithi111.stdout:9/556: creat d6/db/d34/d37/d4c/d7f/d97/fb3 x:0 0 0 2024-09-11T00:07:19.158 INFO:tasks.workunit.client.0.smithi111.stdout:9/557: chown d6/db/d34/f67 2 1 2024-09-11T00:07:19.158 INFO:tasks.workunit.client.0.smithi111.stdout:4/492: getdents d18/d20/d4a/d6b 0 2024-09-11T00:07:19.158 INFO:tasks.workunit.client.0.smithi111.stdout:5/537: symlink d10/d1e/d23/d30/d59/d53/laa 0 2024-09-11T00:07:19.158 INFO:tasks.workunit.client.0.smithi111.stdout:6/453: write f6 [2097152,128910] 0 2024-09-11T00:07:19.158 INFO:tasks.workunit.client.0.smithi111.stdout:5/538: chown d10/d1e/d23/d30/d3c/d60/d7e 7991111 1 2024-09-11T00:07:19.158 INFO:tasks.workunit.client.0.smithi111.stdout:5/539: chown d10/d1e 51 1 2024-09-11T00:07:19.158 INFO:tasks.workunit.client.0.smithi111.stdout:9/558: dwrite d6/db/d34/d37/f29 [0,4194304] 0 2024-09-11T00:07:19.158 INFO:tasks.workunit.client.0.smithi111.stdout:3/530: creat d1c/d1d/d22/d31/d33/d5f/fb2 x:0 0 0 2024-09-11T00:07:19.158 INFO:tasks.workunit.client.0.smithi111.stdout:1/492: unlink d2/de/d93/d9f/l2a 0 2024-09-11T00:07:19.159 INFO:tasks.workunit.client.0.smithi111.stdout:2/505: fsync d0/d3/de/d50/f59 0 2024-09-11T00:07:19.160 INFO:tasks.workunit.client.0.smithi111.stdout:4/493: creat d18/d20/d3c/d5e/d75/f9b x:0 0 0 2024-09-11T00:07:19.160 INFO:tasks.workunit.client.1.smithi203.stdout:2/483: mkdir d13/d56/d69/d99 0 2024-09-11T00:07:19.161 INFO:tasks.workunit.client.0.smithi111.stdout:6/454: mknod d7/d22/d1d/d8c/d4a/c9b 0 2024-09-11T00:07:19.163 INFO:tasks.workunit.client.1.smithi203.stdout:2/484: chown d13/d15/d30/d59/f80 1 1 2024-09-11T00:07:19.164 INFO:tasks.workunit.client.1.smithi203.stdout:5/622: rename dc/dd/d1e/d7b/lca to dc/dd/d1e/dc6/ld2 0 2024-09-11T00:07:19.168 INFO:tasks.workunit.client.0.smithi111.stdout:5/540: rename d10/d1e/d23/f81 to d10/d1e/d23/d30/d3c/d60/d7e/fab 0 2024-09-11T00:07:19.171 INFO:tasks.workunit.client.1.smithi203.stdout:0/526: symlink d0/d2/d37/d80/lad 0 2024-09-11T00:07:19.176 INFO:tasks.workunit.client.1.smithi203.stdout:7/519: write dd/d1c/d52/d8f/d31/d58/d93/d98/faf [463057,36669] 0 2024-09-11T00:07:19.178 INFO:tasks.workunit.client.0.smithi111.stdout:1/493: creat d2/de/d12/d3c/d4b/d6a/fab x:0 0 0 2024-09-11T00:07:19.178 INFO:tasks.workunit.client.1.smithi203.stdout:8/467: write d1/d13/d43/d46/f6d [1929948,128756] 0 2024-09-11T00:07:19.183 INFO:tasks.workunit.client.1.smithi203.stdout:8/468: dread - d1/d13/d22/d6f/f60 zero size 2024-09-11T00:07:19.185 INFO:tasks.workunit.client.1.smithi203.stdout:8/469: dread - d1/d13/d43/d46/d76/f98 zero size 2024-09-11T00:07:19.186 INFO:tasks.workunit.client.0.smithi111.stdout:4/494: write d18/d20/d3c/d5e/d75/d8d/f96 [3607399,114865] 0 2024-09-11T00:07:19.188 INFO:tasks.workunit.client.0.smithi111.stdout:0/547: mknod d3/da/d7b/db3/cc7 0 2024-09-11T00:07:19.192 INFO:tasks.workunit.client.1.smithi203.stdout:6/458: truncate d0/f16 1966038 0 2024-09-11T00:07:19.192 INFO:tasks.workunit.client.0.smithi111.stdout:2/506: dread d0/d3/de/d50/f59 [0,4194304] 0 2024-09-11T00:07:19.194 INFO:tasks.workunit.client.1.smithi203.stdout:7/520: rename dd/d1c/f32 to dd/d1c/d7c/fba 0 2024-09-11T00:07:19.194 INFO:tasks.workunit.client.1.smithi203.stdout:6/459: chown d0/d32/f43 107590 1 2024-09-11T00:07:19.198 INFO:tasks.workunit.client.0.smithi111.stdout:5/541: rmdir d10/d1e/d23 39 2024-09-11T00:07:19.199 INFO:tasks.workunit.client.1.smithi203.stdout:1/575: dwrite d8/d28/d64/f65 [0,4194304] 0 2024-09-11T00:07:19.200 INFO:tasks.workunit.client.1.smithi203.stdout:1/576: chown d8/d9 459 1 2024-09-11T00:07:19.201 INFO:tasks.workunit.client.0.smithi111.stdout:8/559: getdents d11/d23/d2c 0 2024-09-11T00:07:19.202 INFO:tasks.workunit.client.1.smithi203.stdout:9/517: dread d6/f4a [0,4194304] 0 2024-09-11T00:07:19.204 INFO:tasks.workunit.client.1.smithi203.stdout:2/485: creat d13/d95/f9a x:0 0 0 2024-09-11T00:07:19.210 INFO:tasks.workunit.client.0.smithi111.stdout:7/506: getdents dd/d1d/d1f 0 2024-09-11T00:07:19.213 INFO:tasks.workunit.client.1.smithi203.stdout:5/623: symlink dc/d4f/ld3 0 2024-09-11T00:07:19.214 INFO:tasks.workunit.client.1.smithi203.stdout:7/521: mkdir dd/d1c/d4b/dbb 0 2024-09-11T00:07:19.215 INFO:tasks.workunit.client.0.smithi111.stdout:0/548: truncate d3/f54 4708271 0 2024-09-11T00:07:19.216 INFO:tasks.workunit.client.0.smithi111.stdout:4/495: rename d18/f57 to d18/d1f/d36/d95/f9c 0 2024-09-11T00:07:19.218 INFO:tasks.workunit.client.1.smithi203.stdout:7/522: write dd/d1c/f2b [790817,98864] 0 2024-09-11T00:07:19.219 INFO:tasks.workunit.client.1.smithi203.stdout:0/527: dwrite d0/d2/d37/d5b/f5e [0,4194304] 0 2024-09-11T00:07:19.219 INFO:tasks.workunit.client.0.smithi111.stdout:4/496: truncate d18/d20/d4a/f2f 4486765 0 2024-09-11T00:07:19.219 INFO:tasks.workunit.client.1.smithi203.stdout:8/470: creat d1/d13/d17/d8b/f9c x:0 0 0 2024-09-11T00:07:19.220 INFO:tasks.workunit.client.1.smithi203.stdout:6/460: dwrite d0/d27/d35/d39/d3c/f79 [0,4194304] 0 2024-09-11T00:07:19.224 INFO:tasks.workunit.client.1.smithi203.stdout:6/461: chown d0/d54/l88 924541 1 2024-09-11T00:07:19.229 INFO:tasks.workunit.client.1.smithi203.stdout:6/462: chown d0/d27 1200358071 1 2024-09-11T00:07:19.229 INFO:tasks.workunit.client.0.smithi111.stdout:1/494: creat d2/de/d12/d88/fac x:0 0 0 2024-09-11T00:07:19.231 INFO:tasks.workunit.client.1.smithi203.stdout:8/471: dread d1/d13/d17/d48/d61/f71 [4194304,4194304] 0 2024-09-11T00:07:19.233 INFO:tasks.workunit.client.0.smithi111.stdout:7/507: creat dd/d1d/d7e/f9e x:0 0 0 2024-09-11T00:07:19.236 INFO:tasks.workunit.client.1.smithi203.stdout:9/518: write d6/de/d19/f4c [2379395,125419] 0 2024-09-11T00:07:19.240 INFO:tasks.workunit.client.1.smithi203.stdout:1/577: creat d8/d9/d15/d35/d81/db9/fca x:0 0 0 2024-09-11T00:07:19.240 INFO:tasks.workunit.client.1.smithi203.stdout:6/463: creat d0/d5b/d5c/f90 x:0 0 0 2024-09-11T00:07:19.242 INFO:tasks.workunit.client.0.smithi111.stdout:5/542: mknod d10/d1e/d23/d2b/d92/cac 0 2024-09-11T00:07:19.243 INFO:tasks.workunit.client.1.smithi203.stdout:6/464: fdatasync d0/d27/d35/d39/f51 0 2024-09-11T00:07:19.243 INFO:tasks.workunit.client.0.smithi111.stdout:9/559: getdents d6/db/d34/d37/d4c/d7f/d97 0 2024-09-11T00:07:19.243 INFO:tasks.workunit.client.1.smithi203.stdout:5/624: creat dc/fd4 x:0 0 0 2024-09-11T00:07:19.244 INFO:tasks.workunit.client.1.smithi203.stdout:6/465: readlink d0/d32/l33 0 2024-09-11T00:07:19.244 INFO:tasks.workunit.client.0.smithi111.stdout:9/560: fsync d6/d52/fb1 0 2024-09-11T00:07:19.245 INFO:tasks.workunit.client.0.smithi111.stdout:3/531: getdents d1c/d1d/d22/d44 0 2024-09-11T00:07:19.246 INFO:tasks.workunit.client.1.smithi203.stdout:8/472: mkdir d1/d13/d17/d48/d9d 0 2024-09-11T00:07:19.246 INFO:tasks.workunit.client.1.smithi203.stdout:5/625: chown dc/dd/d15/d3b/lb5 411 1 2024-09-11T00:07:19.246 INFO:tasks.workunit.client.0.smithi111.stdout:3/532: fdatasync d1c/d21/f7d 0 2024-09-11T00:07:19.247 INFO:tasks.workunit.client.0.smithi111.stdout:6/455: getdents d7/d22/d2c/d38/d39 0 2024-09-11T00:07:19.250 INFO:tasks.workunit.client.0.smithi111.stdout:6/456: fdatasync d7/f6b 0 2024-09-11T00:07:19.251 INFO:tasks.workunit.client.1.smithi203.stdout:1/578: symlink d8/d19/d31/d36/lcb 0 2024-09-11T00:07:19.252 INFO:tasks.workunit.client.0.smithi111.stdout:7/508: rename dd/d1d/d2d/d68 to dd/d1d/d4b/d8f/d9f 0 2024-09-11T00:07:19.254 INFO:tasks.workunit.client.1.smithi203.stdout:2/486: link d13/d15/d30/d59/f6a d13/d56/d69/f9b 0 2024-09-11T00:07:19.255 INFO:tasks.workunit.client.0.smithi111.stdout:7/509: stat dd/d1d/d2d/d2e/d4e/l46 0 2024-09-11T00:07:19.256 INFO:tasks.workunit.client.1.smithi203.stdout:8/473: unlink d1/f5b 0 2024-09-11T00:07:19.256 INFO:tasks.workunit.client.1.smithi203.stdout:2/487: fdatasync d13/d15/d19/d1c/f3d 0 2024-09-11T00:07:19.256 INFO:tasks.workunit.client.0.smithi111.stdout:8/560: creat d11/d23/d3d/fb2 x:0 0 0 2024-09-11T00:07:19.257 INFO:tasks.workunit.client.1.smithi203.stdout:5/626: chown dc/d4f/l6c 55205 1 2024-09-11T00:07:19.258 INFO:tasks.workunit.client.1.smithi203.stdout:9/519: mknod d6/de/d32/d9e/ca5 0 2024-09-11T00:07:19.258 INFO:tasks.workunit.client.1.smithi203.stdout:5/627: chown dc/fc3 3274908 1 2024-09-11T00:07:19.258 INFO:tasks.workunit.client.0.smithi111.stdout:1/495: mkdir d2/dad 0 2024-09-11T00:07:19.259 INFO:tasks.workunit.client.0.smithi111.stdout:4/497: dread f15 [0,4194304] 0 2024-09-11T00:07:19.260 INFO:tasks.workunit.client.0.smithi111.stdout:9/561: fdatasync d6/db/f43 0 2024-09-11T00:07:19.260 INFO:tasks.workunit.client.0.smithi111.stdout:2/507: dread d0/d3/f27 [0,4194304] 0 2024-09-11T00:07:19.262 INFO:tasks.workunit.client.1.smithi203.stdout:6/466: rename d0/d27/d35/f3e to d0/d27/d35/d38/d7d/d82/f91 0 2024-09-11T00:07:19.264 INFO:tasks.workunit.client.1.smithi203.stdout:1/579: symlink d8/d9/d15/d35/d81/lcc 0 2024-09-11T00:07:19.265 INFO:tasks.workunit.client.0.smithi111.stdout:4/498: chown d18/d20/d3c/d5e/d75/f9b 59 1 2024-09-11T00:07:19.267 INFO:tasks.workunit.client.1.smithi203.stdout:1/580: readlink d8/d19/d60/d90/d3e/d66/l82 0 2024-09-11T00:07:19.270 INFO:tasks.workunit.client.1.smithi203.stdout:8/474: dwrite d1/d13/f1f [0,4194304] 0 2024-09-11T00:07:19.273 INFO:tasks.workunit.client.0.smithi111.stdout:5/543: mkdir d10/d1e/d23/d2b/dad 0 2024-09-11T00:07:19.275 INFO:tasks.workunit.client.1.smithi203.stdout:2/488: mknod d13/d22/c9c 0 2024-09-11T00:07:19.284 INFO:tasks.workunit.client.0.smithi111.stdout:2/508: dwrite d0/d3/de/f44 [0,4194304] 0 2024-09-11T00:07:19.288 INFO:tasks.workunit.client.0.smithi111.stdout:9/562: rmdir d6/db/d34/d37/d4c/d7f/d97 39 2024-09-11T00:07:19.289 INFO:tasks.workunit.client.1.smithi203.stdout:6/467: write d0/d27/d35/d39/d3c/f6e [268305,106305] 0 2024-09-11T00:07:19.290 INFO:tasks.workunit.client.0.smithi111.stdout:6/457: creat d7/d22/d26/d95/f9c x:0 0 0 2024-09-11T00:07:19.292 INFO:tasks.workunit.client.0.smithi111.stdout:1/496: truncate d2/de/d12/d3c/d4b/d6a/d63/d73/da1/f47 769478 0 2024-09-11T00:07:19.293 INFO:tasks.workunit.client.1.smithi203.stdout:1/581: chown d8/d9/d15/lba 264802376 1 2024-09-11T00:07:19.294 INFO:tasks.workunit.client.0.smithi111.stdout:4/499: mknod d18/d1f/d36/d95/c9d 0 2024-09-11T00:07:19.294 INFO:tasks.workunit.client.0.smithi111.stdout:0/549: dwrite d3/d1c/f42 [0,4194304] 0 2024-09-11T00:07:19.295 INFO:tasks.workunit.client.0.smithi111.stdout:9/563: write d6/db/f83 [1081333,106167] 0 2024-09-11T00:07:19.296 INFO:tasks.workunit.client.1.smithi203.stdout:2/489: symlink d13/d47/l9d 0 2024-09-11T00:07:19.296 INFO:tasks.workunit.client.0.smithi111.stdout:6/458: fsync d7/d22/d3f/f65 0 2024-09-11T00:07:19.298 INFO:tasks.workunit.client.1.smithi203.stdout:5/628: dwrite dc/dd/d1e/f29 [4194304,4194304] 0 2024-09-11T00:07:19.300 INFO:tasks.workunit.client.0.smithi111.stdout:7/510: unlink dd/d49/c5a 0 2024-09-11T00:07:19.302 INFO:tasks.workunit.client.0.smithi111.stdout:8/561: symlink d11/lb3 0 2024-09-11T00:07:19.308 INFO:tasks.workunit.client.0.smithi111.stdout:0/550: chown d3/d1c/c9b 1496 1 2024-09-11T00:07:19.313 INFO:tasks.workunit.client.0.smithi111.stdout:1/497: chown d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/d7b/c84 236 1 2024-09-11T00:07:19.317 INFO:tasks.workunit.client.1.smithi203.stdout:8/475: rename d1/d13/d22/d5d to d1/d13/d17/d2f/d9e 0 2024-09-11T00:07:19.318 INFO:tasks.workunit.client.0.smithi111.stdout:9/564: stat d6/db/d1b/l1c 0 2024-09-11T00:07:19.318 INFO:tasks.workunit.client.1.smithi203.stdout:6/468: creat d0/d5b/d5c/d6f/f92 x:0 0 0 2024-09-11T00:07:19.319 INFO:tasks.workunit.client.1.smithi203.stdout:2/490: dwrite d13/d15/f45 [0,4194304] 0 2024-09-11T00:07:19.320 INFO:tasks.workunit.client.0.smithi111.stdout:4/500: creat d18/d3b/d61/f9e x:0 0 0 2024-09-11T00:07:19.320 INFO:tasks.workunit.client.0.smithi111.stdout:1/498: fdatasync d2/de/d12/d3c/d4b/d6a/d3a/f92 0 2024-09-11T00:07:19.321 INFO:tasks.workunit.client.1.smithi203.stdout:9/520: dwrite d6/de/d19/f31 [0,4194304] 0 2024-09-11T00:07:19.323 INFO:tasks.workunit.client.1.smithi203.stdout:1/582: symlink d8/d9/d15/d35/lcd 0 2024-09-11T00:07:19.327 INFO:tasks.workunit.client.1.smithi203.stdout:1/583: fdatasync d8/d19/d60/d90/f3d 0 2024-09-11T00:07:19.329 INFO:tasks.workunit.client.0.smithi111.stdout:7/511: symlink dd/d1d/d2d/la0 0 2024-09-11T00:07:19.331 INFO:tasks.workunit.client.1.smithi203.stdout:1/584: chown d8/d28/fa9 328 1 2024-09-11T00:07:19.333 INFO:tasks.workunit.client.0.smithi111.stdout:5/544: dread d10/f6b [0,4194304] 0 2024-09-11T00:07:19.333 INFO:tasks.workunit.client.0.smithi111.stdout:6/459: symlink d7/d22/d3f/d74/d7f/d61/d6a/l9d 0 2024-09-11T00:07:19.333 INFO:tasks.workunit.client.1.smithi203.stdout:1/585: chown d8/f1a 5240 1 2024-09-11T00:07:19.334 INFO:tasks.workunit.client.0.smithi111.stdout:5/545: readlink d10/l1d 0 2024-09-11T00:07:19.339 INFO:tasks.workunit.client.1.smithi203.stdout:8/476: mknod d1/d13/d17/d2f/d52/d49/d7a/c9f 0 2024-09-11T00:07:19.341 INFO:tasks.workunit.client.0.smithi111.stdout:7/512: mknod dd/d1d/d4d/d82/ca1 0 2024-09-11T00:07:19.344 INFO:tasks.workunit.client.0.smithi111.stdout:6/460: truncate d7/d22/d3f/f54 4807150 0 2024-09-11T00:07:19.345 INFO:tasks.workunit.client.1.smithi203.stdout:8/477: creat d1/d13/d17/d2f/d52/fa0 x:0 0 0 2024-09-11T00:07:19.346 INFO:tasks.workunit.client.1.smithi203.stdout:9/521: rename d6/de/d19/d5b/c89 to d6/de/d32/d52/d44/ca6 0 2024-09-11T00:07:19.348 INFO:tasks.workunit.client.0.smithi111.stdout:0/551: getdents d3/daf/db2 0 2024-09-11T00:07:19.349 INFO:tasks.workunit.client.0.smithi111.stdout:4/501: dwrite d18/d20/d4a/f64 [0,4194304] 0 2024-09-11T00:07:19.350 INFO:tasks.workunit.client.0.smithi111.stdout:9/565: getdents d6/db/d1b/d41/d80 0 2024-09-11T00:07:19.351 INFO:tasks.workunit.client.0.smithi111.stdout:0/552: rmdir d3/d1c 39 2024-09-11T00:07:19.353 INFO:tasks.workunit.client.1.smithi203.stdout:9/522: dread d6/de/d19/d30/f42 [0,4194304] 0 2024-09-11T00:07:19.353 INFO:tasks.workunit.client.1.smithi203.stdout:8/478: truncate d1/d13/d17/d2f/d52/d49/f93 9496 0 2024-09-11T00:07:19.354 INFO:tasks.workunit.client.1.smithi203.stdout:5/629: dread dc/d4f/d5c/f66 [0,4194304] 0 2024-09-11T00:07:19.355 INFO:tasks.workunit.client.1.smithi203.stdout:9/523: stat d6/de/d19/d24/f57 0 2024-09-11T00:07:19.356 INFO:tasks.workunit.client.0.smithi111.stdout:9/566: mkdir d6/db/d34/d37/d4c/d99/db4 0 2024-09-11T00:07:19.357 INFO:tasks.workunit.client.1.smithi203.stdout:6/469: dwrite d0/f2d [0,4194304] 0 2024-09-11T00:07:19.358 INFO:tasks.workunit.client.0.smithi111.stdout:0/553: mknod d3/da/d7b/d84/da8/cc8 0 2024-09-11T00:07:19.365 INFO:tasks.workunit.client.0.smithi111.stdout:4/502: dwrite d18/d1f/f8b [0,4194304] 0 2024-09-11T00:07:19.368 INFO:tasks.workunit.client.0.smithi111.stdout:0/554: rename d3/d13/d1e/d29/d49/d51/c90 to d3/d26/d77/cc9 0 2024-09-11T00:07:19.371 INFO:tasks.workunit.client.0.smithi111.stdout:6/461: dread d7/f23 [0,4194304] 0 2024-09-11T00:07:19.371 INFO:tasks.workunit.client.1.smithi203.stdout:5/630: rmdir dc/dd/d56/dad/da5 39 2024-09-11T00:07:19.372 INFO:tasks.workunit.client.0.smithi111.stdout:0/555: creat d3/d13/d1e/d29/d49/d51/d61/fca x:0 0 0 2024-09-11T00:07:19.375 INFO:tasks.workunit.client.0.smithi111.stdout:6/462: creat d7/d22/d3f/d74/f9e x:0 0 0 2024-09-11T00:07:19.377 INFO:tasks.workunit.client.0.smithi111.stdout:6/463: truncate f1 5010520 0 2024-09-11T00:07:19.377 INFO:tasks.workunit.client.0.smithi111.stdout:0/556: creat d3/dc/fcb x:0 0 0 2024-09-11T00:07:19.378 INFO:tasks.workunit.client.1.smithi203.stdout:6/470: dread d0/f2a [0,4194304] 0 2024-09-11T00:07:19.379 INFO:tasks.workunit.client.1.smithi203.stdout:5/631: fdatasync dc/d4f/d5c/f77 0 2024-09-11T00:07:19.379 INFO:tasks.workunit.client.0.smithi111.stdout:4/503: getdents d18/d20 0 2024-09-11T00:07:19.379 INFO:tasks.workunit.client.0.smithi111.stdout:6/464: chown d7/d22/d1d/d8c/d4a/f85 1350167 1 2024-09-11T00:07:19.380 INFO:tasks.workunit.client.1.smithi203.stdout:9/524: truncate d6/de/d19/d24/f27 2885816 0 2024-09-11T00:07:19.381 INFO:tasks.workunit.client.1.smithi203.stdout:8/479: dread d1/d13/d17/d48/d61/f71 [0,4194304] 0 2024-09-11T00:07:19.382 INFO:tasks.workunit.client.1.smithi203.stdout:5/632: write dc/dd/d1e/f29 [5303800,51745] 0 2024-09-11T00:07:19.383 INFO:tasks.workunit.client.1.smithi203.stdout:6/471: stat d0/l20 0 2024-09-11T00:07:19.386 INFO:tasks.workunit.client.1.smithi203.stdout:9/525: creat d6/de/d19/fa7 x:0 0 0 2024-09-11T00:07:19.387 INFO:tasks.workunit.client.1.smithi203.stdout:8/480: symlink d1/d13/d43/d46/la1 0 2024-09-11T00:07:19.388 INFO:tasks.workunit.client.1.smithi203.stdout:5/633: mkdir dc/dd/d9b/dae/dd5 0 2024-09-11T00:07:19.389 INFO:tasks.workunit.client.0.smithi111.stdout:4/504: dread d18/d3b/d61/f7c [0,4194304] 0 2024-09-11T00:07:19.390 INFO:tasks.workunit.client.1.smithi203.stdout:9/526: mkdir d6/de/d19/d24/d6c/da8 0 2024-09-11T00:07:19.391 INFO:tasks.workunit.client.1.smithi203.stdout:6/472: creat d0/f93 x:0 0 0 2024-09-11T00:07:19.392 INFO:tasks.workunit.client.1.smithi203.stdout:9/527: write d6/f96 [185449,85329] 0 2024-09-11T00:07:19.393 INFO:tasks.workunit.client.1.smithi203.stdout:6/473: chown d0/d5b/l6d 1959871 1 2024-09-11T00:07:19.398 INFO:tasks.workunit.client.1.smithi203.stdout:8/481: link d1/c10 d1/d13/d43/ca2 0 2024-09-11T00:07:19.399 INFO:tasks.workunit.client.1.smithi203.stdout:6/474: mkdir d0/d27/d7b/d7e/d94 0 2024-09-11T00:07:19.400 INFO:tasks.workunit.client.1.smithi203.stdout:6/475: fsync d0/d5b/d5c/f69 0 2024-09-11T00:07:19.401 INFO:tasks.workunit.client.1.smithi203.stdout:9/528: unlink d6/de/d19/d5b/l7c 0 2024-09-11T00:07:19.401 INFO:tasks.workunit.client.0.smithi111.stdout:4/505: dread d18/d39/f66 [0,4194304] 0 2024-09-11T00:07:19.405 INFO:tasks.workunit.client.1.smithi203.stdout:9/529: creat d6/de/fa9 x:0 0 0 2024-09-11T00:07:19.405 INFO:tasks.workunit.client.0.smithi111.stdout:4/506: dread d18/d3b/d61/f87 [0,4194304] 0 2024-09-11T00:07:19.408 INFO:tasks.workunit.client.1.smithi203.stdout:9/530: mkdir d6/de/d32/d52/d55/d66/daa 0 2024-09-11T00:07:19.409 INFO:tasks.workunit.client.1.smithi203.stdout:9/531: readlink d6/de/d19/d24/l5c 0 2024-09-11T00:07:19.414 INFO:tasks.workunit.client.1.smithi203.stdout:9/532: unlink d6/de/d19/d21/f56 0 2024-09-11T00:07:19.415 INFO:tasks.workunit.client.1.smithi203.stdout:6/476: dwrite d0/d27/f66 [0,4194304] 0 2024-09-11T00:07:19.415 INFO:tasks.workunit.client.1.smithi203.stdout:9/533: dread - d6/de/d32/d52/d44/f81 zero size 2024-09-11T00:07:19.429 INFO:tasks.workunit.client.0.smithi111.stdout:2/509: write d0/d3/f13 [1144995,51359] 0 2024-09-11T00:07:19.430 INFO:tasks.workunit.client.1.smithi203.stdout:6/477: dwrite d0/d32/f7a [0,4194304] 0 2024-09-11T00:07:19.438 INFO:tasks.workunit.client.1.smithi203.stdout:6/478: creat d0/f95 x:0 0 0 2024-09-11T00:07:19.439 INFO:tasks.workunit.client.1.smithi203.stdout:8/482: rmdir d1/d13/d17/d2f/d9e 39 2024-09-11T00:07:19.440 INFO:tasks.workunit.client.1.smithi203.stdout:6/479: fdatasync d0/d27/d35/d39/f56 0 2024-09-11T00:07:19.447 INFO:tasks.workunit.client.1.smithi203.stdout:6/480: mknod d0/d54/c96 0 2024-09-11T00:07:19.449 INFO:tasks.workunit.client.1.smithi203.stdout:6/481: stat d0/d5b 0 2024-09-11T00:07:19.450 INFO:tasks.workunit.client.1.smithi203.stdout:9/534: dread d6/de/d32/f37 [0,4194304] 0 2024-09-11T00:07:19.453 INFO:tasks.workunit.client.1.smithi203.stdout:9/535: truncate d6/de/fa9 59686 0 2024-09-11T00:07:19.454 INFO:tasks.workunit.client.1.smithi203.stdout:8/483: creat d1/d13/d17/d2f/d52/d49/d68/fa3 x:0 0 0 2024-09-11T00:07:19.457 INFO:tasks.workunit.client.1.smithi203.stdout:1/586: mkdir d8/d9/d15/d35/d81/db9/dce 0 2024-09-11T00:07:19.461 INFO:tasks.workunit.client.0.smithi111.stdout:8/562: truncate d11/d23/d3d/f86 1258797 0 2024-09-11T00:07:19.464 INFO:tasks.workunit.client.1.smithi203.stdout:9/536: symlink d6/lab 0 2024-09-11T00:07:19.467 INFO:tasks.workunit.client.1.smithi203.stdout:2/491: dwrite d13/d22/f6e [0,4194304] 0 2024-09-11T00:07:19.467 INFO:tasks.workunit.client.0.smithi111.stdout:8/563: read d11/d21/f22 [3199316,52702] 0 2024-09-11T00:07:19.469 INFO:tasks.workunit.client.1.smithi203.stdout:2/492: stat d13/d47/f8c 0 2024-09-11T00:07:19.472 INFO:tasks.workunit.client.0.smithi111.stdout:5/546: truncate d10/f6b 3077307 0 2024-09-11T00:07:19.475 INFO:tasks.workunit.client.1.smithi203.stdout:8/484: dread d1/d13/d43/d46/d76/f7d [0,4194304] 0 2024-09-11T00:07:19.475 INFO:tasks.workunit.client.0.smithi111.stdout:7/513: truncate dd/f63 3716391 0 2024-09-11T00:07:19.475 INFO:tasks.workunit.client.1.smithi203.stdout:1/587: dread d8/d19/d31/f9d [0,4194304] 0 2024-09-11T00:07:19.476 INFO:tasks.workunit.client.0.smithi111.stdout:8/564: mknod d11/d23/d2c/cb4 0 2024-09-11T00:07:19.485 INFO:tasks.workunit.client.1.smithi203.stdout:2/493: mkdir d13/d22/d53/d9e 0 2024-09-11T00:07:19.486 INFO:tasks.workunit.client.0.smithi111.stdout:5/547: rename d10/f1c to d10/d1e/d23/d30/d3c/d60/da2/d66/d76/fae 0 2024-09-11T00:07:19.486 INFO:tasks.workunit.client.1.smithi203.stdout:8/485: mkdir d1/d13/d3a/da4 0 2024-09-11T00:07:19.488 INFO:tasks.workunit.client.1.smithi203.stdout:8/486: stat d1/d13/d17/f38 0 2024-09-11T00:07:19.488 INFO:tasks.workunit.client.0.smithi111.stdout:5/548: fdatasync d10/d1e/d25/d6e/f7d 0 2024-09-11T00:07:19.489 INFO:tasks.workunit.client.1.smithi203.stdout:1/588: chown d8/d19/d60/d90/d3e/d4b/d80/d8d/db0 2 1 2024-09-11T00:07:19.490 INFO:tasks.workunit.client.1.smithi203.stdout:8/487: dread - d1/d13/d17/d2f/d52/fa0 zero size 2024-09-11T00:07:19.492 INFO:tasks.workunit.client.1.smithi203.stdout:6/482: getdents d0/d5b/d5c/d6f 0 2024-09-11T00:07:19.494 INFO:tasks.workunit.client.0.smithi111.stdout:5/549: truncate d10/d1e/d23/d30/d3c/d60/da2/d66/d76/fae 8832861 0 2024-09-11T00:07:19.496 INFO:tasks.workunit.client.1.smithi203.stdout:6/483: mknod d0/d5b/d5c/c97 0 2024-09-11T00:07:19.497 INFO:tasks.workunit.client.1.smithi203.stdout:2/494: truncate d13/d47/f61 1249699 0 2024-09-11T00:07:19.500 INFO:tasks.workunit.client.1.smithi203.stdout:6/484: rmdir d0/d27/d35/d39/d3c 39 2024-09-11T00:07:19.502 INFO:tasks.workunit.client.0.smithi111.stdout:4/507: dread f7 [4194304,4194304] 0 2024-09-11T00:07:19.509 INFO:tasks.workunit.client.1.smithi203.stdout:8/488: dwrite d1/d13/d17/d2f/d52/d49/f93 [0,4194304] 0 2024-09-11T00:07:19.510 INFO:tasks.workunit.client.1.smithi203.stdout:6/485: dread d0/d27/d35/f70 [0,4194304] 0 2024-09-11T00:07:19.512 INFO:tasks.workunit.client.1.smithi203.stdout:8/489: write d1/fc [4147338,73794] 0 2024-09-11T00:07:19.512 INFO:tasks.workunit.client.0.smithi111.stdout:5/550: dwrite d10/d1e/d23/d30/d3c/d60/da2/f58 [0,4194304] 0 2024-09-11T00:07:19.522 INFO:tasks.workunit.client.0.smithi111.stdout:0/557: dwrite d3/d13/d1e/f4d [0,4194304] 0 2024-09-11T00:07:19.523 INFO:tasks.workunit.client.1.smithi203.stdout:6/486: creat d0/d27/f98 x:0 0 0 2024-09-11T00:07:19.530 INFO:tasks.workunit.client.0.smithi111.stdout:5/551: mknod d10/d1e/d23/d26/caf 0 2024-09-11T00:07:19.537 INFO:tasks.workunit.client.0.smithi111.stdout:4/508: dread d18/d20/f30 [0,4194304] 0 2024-09-11T00:07:19.539 INFO:tasks.workunit.client.0.smithi111.stdout:5/552: write d10/d1e/d23/d26/f4c [4791198,99801] 0 2024-09-11T00:07:19.540 INFO:tasks.workunit.client.1.smithi203.stdout:6/487: dread d0/d32/f43 [0,4194304] 0 2024-09-11T00:07:19.541 INFO:tasks.workunit.client.1.smithi203.stdout:5/634: dwrite dc/dd/d15/d3b/d73/f83 [0,4194304] 0 2024-09-11T00:07:19.543 INFO:tasks.workunit.client.0.smithi111.stdout:4/509: rename d18/d20/d4e to d18/d3b/d9f 0 2024-09-11T00:07:19.544 INFO:tasks.workunit.client.0.smithi111.stdout:2/510: write d0/d3/de/f11 [1358981,119126] 0 2024-09-11T00:07:19.545 INFO:tasks.workunit.client.0.smithi111.stdout:5/553: write d10/d1e/d23/d30/d3c/d60/d7e/f88 [2630337,102766] 0 2024-09-11T00:07:19.545 INFO:tasks.workunit.client.1.smithi203.stdout:5/635: creat dc/d91/fd6 x:0 0 0 2024-09-11T00:07:19.549 INFO:tasks.workunit.client.0.smithi111.stdout:5/554: fdatasync d10/f19 0 2024-09-11T00:07:19.551 INFO:tasks.workunit.client.0.smithi111.stdout:5/555: chown ce 25821177 1 2024-09-11T00:07:19.553 INFO:tasks.workunit.client.0.smithi111.stdout:5/556: chown d10/d1e/d23/d30/d3c/d60 165133 1 2024-09-11T00:07:19.558 INFO:tasks.workunit.client.0.smithi111.stdout:2/511: fdatasync d0/d3/f3e 0 2024-09-11T00:07:19.562 INFO:tasks.workunit.client.1.smithi203.stdout:9/537: write d6/de/d19/d30/f51 [1548072,118807] 0 2024-09-11T00:07:19.566 INFO:tasks.workunit.client.1.smithi203.stdout:5/636: creat dc/dd/d15/dbd/d59/fd7 x:0 0 0 2024-09-11T00:07:19.569 INFO:tasks.workunit.client.1.smithi203.stdout:8/490: dread d1/d13/d43/f57 [0,4194304] 0 2024-09-11T00:07:19.574 INFO:tasks.workunit.client.0.smithi111.stdout:2/512: symlink d0/d3/d12/d52/lad 0 2024-09-11T00:07:19.576 INFO:tasks.workunit.client.1.smithi203.stdout:2/495: dread d13/d47/f61 [0,4194304] 0 2024-09-11T00:07:19.577 INFO:tasks.workunit.client.1.smithi203.stdout:9/538: rename d6/de/d32/d52/d55/d66/d80/l95 to d6/de/d19/d24/d6c/da8/lac 0 2024-09-11T00:07:19.577 INFO:tasks.workunit.client.0.smithi111.stdout:2/513: truncate d0/f72 797556 0 2024-09-11T00:07:19.579 INFO:tasks.workunit.client.1.smithi203.stdout:9/539: write d6/de/d19/fa7 [835927,214] 0 2024-09-11T00:07:19.581 INFO:tasks.workunit.client.1.smithi203.stdout:6/488: link d0/f10 d0/d27/d35/f99 0 2024-09-11T00:07:19.583 INFO:tasks.workunit.client.1.smithi203.stdout:6/489: write d0/d27/f98 [424574,123489] 0 2024-09-11T00:07:19.585 INFO:tasks.workunit.client.0.smithi111.stdout:4/510: link d18/c2a d18/d20/d4a/ca0 0 2024-09-11T00:07:19.586 INFO:tasks.workunit.client.0.smithi111.stdout:0/558: write d3/d13/d1e/d29/f9a [1742542,113289] 0 2024-09-11T00:07:19.587 INFO:tasks.workunit.client.0.smithi111.stdout:2/514: mknod d0/d3/de/d3b/cae 0 2024-09-11T00:07:19.589 INFO:tasks.workunit.client.1.smithi203.stdout:2/496: creat d13/d15/d19/d1c/f9f x:0 0 0 2024-09-11T00:07:19.593 INFO:tasks.workunit.client.0.smithi111.stdout:7/514: dread dd/f63 [0,4194304] 0 2024-09-11T00:07:19.596 INFO:tasks.workunit.client.0.smithi111.stdout:2/515: dread d0/d3/d12/f41 [4194304,4194304] 0 2024-09-11T00:07:19.596 INFO:tasks.workunit.client.1.smithi203.stdout:6/490: fsync d0/d27/d35/d38/f49 0 2024-09-11T00:07:19.598 INFO:tasks.workunit.client.1.smithi203.stdout:6/491: chown d0/d27/d35/d39/l45 103834112 1 2024-09-11T00:07:19.598 INFO:tasks.workunit.client.1.smithi203.stdout:2/497: rename d13/d22/f6e to d13/d56/d69/d99/fa0 0 2024-09-11T00:07:19.600 INFO:tasks.workunit.client.0.smithi111.stdout:7/515: creat dd/d1d/d76/fa2 x:0 0 0 2024-09-11T00:07:19.600 INFO:tasks.workunit.client.1.smithi203.stdout:6/492: chown d0/d27/d35/d38/f84 43 1 2024-09-11T00:07:19.601 INFO:tasks.workunit.client.0.smithi111.stdout:5/557: dread d10/f16 [0,4194304] 0 2024-09-11T00:07:19.601 INFO:tasks.workunit.client.1.smithi203.stdout:9/540: mknod d6/de/d32/d52/d55/cad 0 2024-09-11T00:07:19.602 INFO:tasks.workunit.client.1.smithi203.stdout:6/493: readlink d0/d5b/l6b 0 2024-09-11T00:07:19.604 INFO:tasks.workunit.client.0.smithi111.stdout:4/511: dwrite d18/d20/d4a/f64 [0,4194304] 0 2024-09-11T00:07:19.605 INFO:tasks.workunit.client.0.smithi111.stdout:2/516: unlink d0/d3/d12/d52/f74 0 2024-09-11T00:07:19.607 INFO:tasks.workunit.client.1.smithi203.stdout:5/637: dwrite dc/d2b/fc2 [0,4194304] 0 2024-09-11T00:07:19.609 INFO:tasks.workunit.client.1.smithi203.stdout:8/491: write d1/d13/d17/d48/f53 [903106,127524] 0 2024-09-11T00:07:19.611 INFO:tasks.workunit.client.1.smithi203.stdout:2/498: creat d13/d95/fa1 x:0 0 0 2024-09-11T00:07:19.617 INFO:tasks.workunit.client.1.smithi203.stdout:6/494: read d0/d27/f18 [1436937,72378] 0 2024-09-11T00:07:19.617 INFO:tasks.workunit.client.1.smithi203.stdout:2/499: mkdir d13/d15/d19/da2 0 2024-09-11T00:07:19.618 INFO:tasks.workunit.client.1.smithi203.stdout:2/500: write d13/d47/f8c [830504,26070] 0 2024-09-11T00:07:19.626 INFO:tasks.workunit.client.0.smithi111.stdout:2/517: link d0/d3/de/d3b/d62/d6d/c9a d0/d3/de/d50/caf 0 2024-09-11T00:07:19.628 INFO:tasks.workunit.client.0.smithi111.stdout:3/533: sync 2024-09-11T00:07:19.628 INFO:tasks.workunit.client.0.smithi111.stdout:5/558: truncate d10/d1e/d23/d30/d59/d52/f95 1107781 0 2024-09-11T00:07:19.632 INFO:tasks.workunit.client.0.smithi111.stdout:5/559: chown d10/d1e/d23/f48 3492725 1 2024-09-11T00:07:19.638 INFO:tasks.workunit.client.0.smithi111.stdout:0/559: dwrite d3/d13/d66/fa0 [0,4194304] 0 2024-09-11T00:07:19.643 INFO:tasks.workunit.client.0.smithi111.stdout:4/512: dwrite d18/d3b/d61/f9e [0,4194304] 0 2024-09-11T00:07:19.644 INFO:tasks.workunit.client.0.smithi111.stdout:3/534: mknod d1c/d1d/d22/d23/d2f/d63/d7e/cb3 0 2024-09-11T00:07:19.644 INFO:tasks.workunit.client.0.smithi111.stdout:0/560: stat d3/dc/f1f 0 2024-09-11T00:07:19.651 INFO:tasks.workunit.client.0.smithi111.stdout:3/535: mkdir d1c/d21/db4 0 2024-09-11T00:07:19.652 INFO:tasks.workunit.client.0.smithi111.stdout:7/516: dwrite dd/d1d/d1f/f50 [0,4194304] 0 2024-09-11T00:07:19.653 INFO:tasks.workunit.client.0.smithi111.stdout:2/518: creat d0/d3/de/d3b/fb0 x:0 0 0 2024-09-11T00:07:19.659 INFO:tasks.workunit.client.0.smithi111.stdout:3/536: chown ld 8691 1 2024-09-11T00:07:19.661 INFO:tasks.workunit.client.0.smithi111.stdout:2/519: stat d0/d3/d12/d52/d6c/c86 0 2024-09-11T00:07:19.661 INFO:tasks.workunit.client.0.smithi111.stdout:3/537: readlink d1c/d1d/d22/d31/d33/l65 0 2024-09-11T00:07:19.664 INFO:tasks.workunit.client.0.smithi111.stdout:7/517: creat dd/d1d/d76/fa3 x:0 0 0 2024-09-11T00:07:19.665 INFO:tasks.workunit.client.0.smithi111.stdout:3/538: mknod d1c/d1d/d22/d31/d33/d5f/cb5 0 2024-09-11T00:07:19.666 INFO:tasks.workunit.client.0.smithi111.stdout:4/513: write d18/d20/d4a/f3f [956376,51142] 0 2024-09-11T00:07:19.668 INFO:tasks.workunit.client.0.smithi111.stdout:7/518: truncate fa 926295 0 2024-09-11T00:07:19.670 INFO:tasks.workunit.client.0.smithi111.stdout:2/520: creat d0/d3/fb1 x:0 0 0 2024-09-11T00:07:19.674 INFO:tasks.workunit.client.0.smithi111.stdout:4/514: fdatasync d18/d3b/d61/f9e 0 2024-09-11T00:07:19.677 INFO:tasks.workunit.client.0.smithi111.stdout:7/519: write dd/d1d/d2d/f89 [3977099,85751] 0 2024-09-11T00:07:19.688 INFO:tasks.workunit.client.0.smithi111.stdout:5/560: dwrite d10/d1e/d23/fa1 [0,4194304] 0 2024-09-11T00:07:19.689 INFO:tasks.workunit.client.0.smithi111.stdout:4/515: rename d18/c2a to d18/d3b/d9f/ca1 0 2024-09-11T00:07:19.689 INFO:tasks.workunit.client.0.smithi111.stdout:2/521: creat d0/d3/de/d4b/fb2 x:0 0 0 2024-09-11T00:07:19.693 INFO:tasks.workunit.client.0.smithi111.stdout:0/561: dwrite d3/d26/d77/f82 [0,4194304] 0 2024-09-11T00:07:19.695 INFO:tasks.workunit.client.0.smithi111.stdout:4/516: mknod d18/d20/d3c/d5e/ca2 0 2024-09-11T00:07:19.697 INFO:tasks.workunit.client.0.smithi111.stdout:2/522: rmdir d0/d3/d12/d52/d6c 39 2024-09-11T00:07:19.698 INFO:tasks.workunit.client.0.smithi111.stdout:5/561: symlink d10/d1e/d23/d26/d78/lb0 0 2024-09-11T00:07:19.699 INFO:tasks.workunit.client.0.smithi111.stdout:7/520: link dd/d1d/d2d/d2e/d4e/l52 dd/d1d/d76/la4 0 2024-09-11T00:07:19.699 INFO:tasks.workunit.client.1.smithi203.stdout:3/577: sync 2024-09-11T00:07:19.699 INFO:tasks.workunit.client.1.smithi203.stdout:4/463: sync 2024-09-11T00:07:19.700 INFO:tasks.workunit.client.0.smithi111.stdout:3/539: dwrite d1c/d1d/d22/d31/d33/d5f/fb2 [0,4194304] 0 2024-09-11T00:07:19.703 INFO:tasks.workunit.client.1.smithi203.stdout:8/492: write d1/d13/d17/d77/f79 [286792,17734] 0 2024-09-11T00:07:19.705 INFO:tasks.workunit.client.1.smithi203.stdout:3/578: creat d8/da/d37/fd5 x:0 0 0 2024-09-11T00:07:19.707 INFO:tasks.workunit.client.1.smithi203.stdout:4/464: chown db/d12/d15/f64 1024797786 1 2024-09-11T00:07:19.708 INFO:tasks.workunit.client.0.smithi111.stdout:6/465: sync 2024-09-11T00:07:19.708 INFO:tasks.workunit.client.0.smithi111.stdout:1/499: sync 2024-09-11T00:07:19.710 INFO:tasks.workunit.client.1.smithi203.stdout:8/493: write d1/d13/d17/d2f/d52/d49/f93 [5235759,122270] 0 2024-09-11T00:07:19.710 INFO:tasks.workunit.client.0.smithi111.stdout:0/562: rename d3/d13/d1e/d29/d49/d51/f71 to d3/d13/d1e/d29/d49/fcc 0 2024-09-11T00:07:19.711 INFO:tasks.workunit.client.0.smithi111.stdout:3/540: mknod d1c/d1d/d22/d23/d2f/d63/cb6 0 2024-09-11T00:07:19.713 INFO:tasks.workunit.client.1.smithi203.stdout:3/579: read d8/da/d37/d83/d65/f66 [954897,78902] 0 2024-09-11T00:07:19.714 INFO:tasks.workunit.client.0.smithi111.stdout:5/562: creat d10/d1e/d23/d30/d3c/d60/d7e/fb1 x:0 0 0 2024-09-11T00:07:19.716 INFO:tasks.workunit.client.1.smithi203.stdout:6/495: dwrite d0/f95 [0,4194304] 0 2024-09-11T00:07:19.719 INFO:tasks.workunit.client.0.smithi111.stdout:7/521: write dd/f1c [1704274,90052] 0 2024-09-11T00:07:19.721 INFO:tasks.workunit.client.0.smithi111.stdout:4/517: dwrite d18/d1f/d33/f59 [0,4194304] 0 2024-09-11T00:07:19.721 INFO:tasks.workunit.client.1.smithi203.stdout:4/465: mkdir db/d12/d15/d2a/d88/d95 0 2024-09-11T00:07:19.724 INFO:tasks.workunit.client.0.smithi111.stdout:1/500: creat d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/fae x:0 0 0 2024-09-11T00:07:19.725 INFO:tasks.workunit.client.1.smithi203.stdout:8/494: truncate d1/f11 4120902 0 2024-09-11T00:07:19.726 INFO:tasks.workunit.client.1.smithi203.stdout:3/580: readlink d8/da/d11/l7a 0 2024-09-11T00:07:19.729 INFO:tasks.workunit.client.1.smithi203.stdout:2/501: write d13/d15/d19/f28 [424646,104835] 0 2024-09-11T00:07:19.730 INFO:tasks.workunit.client.1.smithi203.stdout:6/496: write d0/d27/d35/d39/d3c/f6e [252243,37772] 0 2024-09-11T00:07:19.735 INFO:tasks.workunit.client.0.smithi111.stdout:7/522: creat dd/d49/fa5 x:0 0 0 2024-09-11T00:07:19.737 INFO:tasks.workunit.client.0.smithi111.stdout:7/523: chown dd/d1d/f39 2205977 1 2024-09-11T00:07:19.739 INFO:tasks.workunit.client.0.smithi111.stdout:7/524: write dd/d1d/d7e/f9e [522028,30411] 0 2024-09-11T00:07:19.741 INFO:tasks.workunit.client.0.smithi111.stdout:4/518: unlink d18/d1f/d33/f83 0 2024-09-11T00:07:19.744 INFO:tasks.workunit.client.0.smithi111.stdout:0/563: write d3/da/f21 [1141581,63917] 0 2024-09-11T00:07:19.745 INFO:tasks.workunit.client.0.smithi111.stdout:1/501: read - d2/de/d12/d3c/d4b/f51 zero size 2024-09-11T00:07:19.745 INFO:tasks.workunit.client.0.smithi111.stdout:2/523: link d0/d3/de/c48 d0/d3/de/d3b/cb3 0 2024-09-11T00:07:19.745 INFO:tasks.workunit.client.0.smithi111.stdout:4/519: read d18/d3b/d61/f7c [3487760,72015] 0 2024-09-11T00:07:19.749 INFO:tasks.workunit.client.0.smithi111.stdout:1/502: fdatasync d2/de/d12/d3c/d4b/d6a/d63/f9a 0 2024-09-11T00:07:19.750 INFO:tasks.workunit.client.0.smithi111.stdout:3/541: rename d1c/d1d/f20 to d1c/d1d/d22/d23/fb7 0 2024-09-11T00:07:19.752 INFO:tasks.workunit.client.0.smithi111.stdout:6/466: write d7/f12 [1208832,57705] 0 2024-09-11T00:07:19.752 INFO:tasks.workunit.client.1.smithi203.stdout:6/497: mknod d0/d27/d35/d38/d73/c9a 0 2024-09-11T00:07:19.752 INFO:tasks.workunit.client.1.smithi203.stdout:4/466: write db/dd/d26/d42/f45 [417816,35627] 0 2024-09-11T00:07:19.752 INFO:tasks.workunit.client.0.smithi111.stdout:1/503: write d2/de/d12/d3c/f69 [813692,39460] 0 2024-09-11T00:07:19.755 INFO:tasks.workunit.client.0.smithi111.stdout:6/467: chown d7/d22/d1d/d83 813957954 1 2024-09-11T00:07:19.756 INFO:tasks.workunit.client.1.smithi203.stdout:6/498: truncate d0/d27/d7b/d7e/f8d 337264 0 2024-09-11T00:07:19.758 INFO:tasks.workunit.client.0.smithi111.stdout:6/468: write d7/f12 [1803947,90512] 0 2024-09-11T00:07:19.759 INFO:tasks.workunit.client.0.smithi111.stdout:0/564: creat d3/daf/db2/fcd x:0 0 0 2024-09-11T00:07:19.761 INFO:tasks.workunit.client.1.smithi203.stdout:6/499: truncate d0/d5b/d5c/f90 422208 0 2024-09-11T00:07:19.761 INFO:tasks.workunit.client.1.smithi203.stdout:3/581: creat d8/da/d5c/fd6 x:0 0 0 2024-09-11T00:07:19.762 INFO:tasks.workunit.client.0.smithi111.stdout:4/520: dread d18/d20/f46 [0,4194304] 0 2024-09-11T00:07:19.766 INFO:tasks.workunit.client.0.smithi111.stdout:5/563: rename d10/d1e/d23/d2b/l31 to d10/d1e/d23/d30/d3c/d60/d63/lb2 0 2024-09-11T00:07:19.767 INFO:tasks.workunit.client.1.smithi203.stdout:2/502: getdents d13/d47 0 2024-09-11T00:07:19.768 INFO:tasks.workunit.client.1.smithi203.stdout:2/503: chown d13/d15 86464362 1 2024-09-11T00:07:19.774 INFO:tasks.workunit.client.0.smithi111.stdout:1/504: creat d2/d77/faf x:0 0 0 2024-09-11T00:07:19.774 INFO:tasks.workunit.client.0.smithi111.stdout:8/565: sync 2024-09-11T00:07:19.774 INFO:tasks.workunit.client.0.smithi111.stdout:9/567: sync 2024-09-11T00:07:19.775 INFO:tasks.workunit.client.1.smithi203.stdout:6/500: mknod d0/d27/d7b/d7e/d94/c9b 0 2024-09-11T00:07:19.776 INFO:tasks.workunit.client.0.smithi111.stdout:1/505: readlink d2/de/d12/d3c/l49 0 2024-09-11T00:07:19.776 INFO:tasks.workunit.client.1.smithi203.stdout:3/582: dread d8/da/d37/d83/d6a/f87 [0,4194304] 0 2024-09-11T00:07:19.779 INFO:tasks.workunit.client.0.smithi111.stdout:1/506: truncate d2/de/d93/d9f/f20 8933147 0 2024-09-11T00:07:19.779 INFO:tasks.workunit.client.0.smithi111.stdout:2/524: mkdir d0/d3/de/db4 0 2024-09-11T00:07:19.780 INFO:tasks.workunit.client.0.smithi111.stdout:1/507: chown d2/de/d12/d3c/d4b 1 1 2024-09-11T00:07:19.781 INFO:tasks.workunit.client.0.smithi111.stdout:0/565: mkdir d3/d13/d1e/d29/db0/dce 0 2024-09-11T00:07:19.784 INFO:tasks.workunit.client.0.smithi111.stdout:0/566: write d3/d13/d1e/f2e [922166,115346] 0 2024-09-11T00:07:19.785 INFO:tasks.workunit.client.0.smithi111.stdout:6/469: mkdir d7/d22/d3f/d74/d7f/d61/d6a/d9f 0 2024-09-11T00:07:19.787 INFO:tasks.workunit.client.0.smithi111.stdout:4/521: truncate d18/d1f/f5f 241021 0 2024-09-11T00:07:19.789 INFO:tasks.workunit.client.0.smithi111.stdout:4/522: chown d18/d3b/d9f 5498 1 2024-09-11T00:07:19.789 INFO:tasks.workunit.client.1.smithi203.stdout:6/501: rename d0/d27 to d0/d54/d9c 0 2024-09-11T00:07:19.789 INFO:tasks.workunit.client.1.smithi203.stdout:3/583: creat d8/da/d37/d83/dc0/fd7 x:0 0 0 2024-09-11T00:07:19.791 INFO:tasks.workunit.client.1.smithi203.stdout:6/502: dread - d0/d5b/d5c/d6f/f92 zero size 2024-09-11T00:07:19.791 INFO:tasks.workunit.client.0.smithi111.stdout:5/564: creat d10/d1e/d23/d2b/d5c/fb3 x:0 0 0 2024-09-11T00:07:19.791 INFO:tasks.workunit.client.0.smithi111.stdout:4/523: chown d18/d20/d3c/f54 15 1 2024-09-11T00:07:19.792 INFO:tasks.workunit.client.1.smithi203.stdout:2/504: link d13/d47/l9d d13/d15/d19/d1c/d76/d94/la3 0 2024-09-11T00:07:19.792 INFO:tasks.workunit.client.1.smithi203.stdout:2/505: chown d13/d95 5 1 2024-09-11T00:07:19.793 INFO:tasks.workunit.client.0.smithi111.stdout:3/542: mknod d1c/d21/dae/cb8 0 2024-09-11T00:07:19.794 INFO:tasks.workunit.client.0.smithi111.stdout:7/525: dread dd/f1b [0,4194304] 0 2024-09-11T00:07:19.794 INFO:tasks.workunit.client.0.smithi111.stdout:4/524: write d18/d3b/f60 [4739549,109751] 0 2024-09-11T00:07:19.795 INFO:tasks.workunit.client.0.smithi111.stdout:8/566: chown d11/d21/d38/l56 45916 1 2024-09-11T00:07:19.796 INFO:tasks.workunit.client.1.smithi203.stdout:8/495: dread d1/f11 [0,4194304] 0 2024-09-11T00:07:19.799 INFO:tasks.workunit.client.0.smithi111.stdout:2/525: dwrite d0/d3/de/d50/fa0 [0,4194304] 0 2024-09-11T00:07:19.800 INFO:tasks.workunit.client.1.smithi203.stdout:8/496: creat d1/d13/d43/fa5 x:0 0 0 2024-09-11T00:07:19.803 INFO:tasks.workunit.client.1.smithi203.stdout:3/584: link d8/da/d37/d83/d6a/dad/cc3 d8/da/d5c/d80/cd8 0 2024-09-11T00:07:19.808 INFO:tasks.workunit.client.0.smithi111.stdout:7/526: dread dd/d1d/d7e/f9e [0,4194304] 0 2024-09-11T00:07:19.811 INFO:tasks.workunit.client.1.smithi203.stdout:2/506: dwrite d13/d15/d19/d1c/f9f [0,4194304] 0 2024-09-11T00:07:19.815 INFO:tasks.workunit.client.0.smithi111.stdout:3/543: dwrite d1c/d21/d92/f9a [0,4194304] 0 2024-09-11T00:07:19.816 INFO:tasks.workunit.client.0.smithi111.stdout:9/568: chown d6/db/d34/d37/d4c/d7f/d97/lab 28830231 1 2024-09-11T00:07:19.817 INFO:tasks.workunit.client.1.smithi203.stdout:3/585: truncate d8/da/d11/f5d 2182180 0 2024-09-11T00:07:19.818 INFO:tasks.workunit.client.0.smithi111.stdout:1/508: symlink d2/de/lb0 0 2024-09-11T00:07:19.818 INFO:tasks.workunit.client.0.smithi111.stdout:9/569: write d6/db/fd [2638910,49527] 0 2024-09-11T00:07:19.821 INFO:tasks.workunit.client.0.smithi111.stdout:0/567: symlink d3/lcf 0 2024-09-11T00:07:19.823 INFO:tasks.workunit.client.1.smithi203.stdout:2/507: mknod d13/d15/d19/d1c/d76/d94/d97/ca4 0 2024-09-11T00:07:19.825 INFO:tasks.workunit.client.0.smithi111.stdout:1/509: chown d2/de/d12/d3c/d4b/d6a/l4e 100 1 2024-09-11T00:07:19.825 INFO:tasks.workunit.client.0.smithi111.stdout:1/510: chown d2/d77 0 1 2024-09-11T00:07:19.825 INFO:tasks.workunit.client.0.smithi111.stdout:8/567: dwrite d11/d23/d2c/d53/f55 [0,4194304] 0 2024-09-11T00:07:19.826 INFO:tasks.workunit.client.0.smithi111.stdout:2/526: stat d0/d3/de/f1f 0 2024-09-11T00:07:19.832 INFO:tasks.workunit.client.1.smithi203.stdout:8/497: dwrite d1/d13/d17/f31 [0,4194304] 0 2024-09-11T00:07:19.836 INFO:tasks.workunit.client.1.smithi203.stdout:8/498: write d1/d13/d22/d6f/d8d/f6b [280179,88292] 0 2024-09-11T00:07:19.839 INFO:tasks.workunit.client.1.smithi203.stdout:3/586: write d8/da/f44 [2877696,60729] 0 2024-09-11T00:07:19.848 INFO:tasks.workunit.client.1.smithi203.stdout:8/499: mkdir d1/d13/d3a/d4c/da6 0 2024-09-11T00:07:19.850 INFO:tasks.workunit.client.0.smithi111.stdout:6/470: write d7/d22/d1d/f27 [576972,29327] 0 2024-09-11T00:07:19.852 INFO:tasks.workunit.client.0.smithi111.stdout:8/568: write d11/d21/f31 [3067902,123466] 0 2024-09-11T00:07:19.852 INFO:tasks.workunit.client.0.smithi111.stdout:9/570: dwrite d6/db/f49 [0,4194304] 0 2024-09-11T00:07:19.853 INFO:tasks.workunit.client.0.smithi111.stdout:7/527: mkdir dd/da6 0 2024-09-11T00:07:19.854 INFO:tasks.workunit.client.0.smithi111.stdout:6/471: chown d7/d22/d1d/d83 24 1 2024-09-11T00:07:19.854 INFO:tasks.workunit.client.0.smithi111.stdout:1/511: rename d2/de/d12/d3c/d4b/d6a/d63/d73/da1/l5a to d2/dad/lb1 0 2024-09-11T00:07:19.859 INFO:tasks.workunit.client.0.smithi111.stdout:5/565: link d10/d1e/d23/d30/d59/c68 d10/d1e/d23/cb4 0 2024-09-11T00:07:19.861 INFO:tasks.workunit.client.0.smithi111.stdout:0/568: mkdir d3/d1c/dd0 0 2024-09-11T00:07:19.862 INFO:tasks.workunit.client.1.smithi203.stdout:2/508: dwrite d13/d15/d19/d1c/f2d [0,4194304] 0 2024-09-11T00:07:19.867 INFO:tasks.workunit.client.0.smithi111.stdout:2/527: creat d0/d3/de/d3b/d62/fb5 x:0 0 0 2024-09-11T00:07:19.868 INFO:tasks.workunit.client.1.smithi203.stdout:2/509: mknod d13/d15/d19/d1c/d73/d7a/ca5 0 2024-09-11T00:07:19.869 INFO:tasks.workunit.client.0.smithi111.stdout:9/571: fsync d6/db/d34/f66 0 2024-09-11T00:07:19.870 INFO:tasks.workunit.client.0.smithi111.stdout:6/472: mknod d7/d22/ca0 0 2024-09-11T00:07:19.875 INFO:tasks.workunit.client.1.smithi203.stdout:2/510: fdatasync d13/d15/d19/d1c/f2a 0 2024-09-11T00:07:19.876 INFO:tasks.workunit.client.0.smithi111.stdout:2/528: rmdir d0/d3/d12/d52 39 2024-09-11T00:07:19.876 INFO:tasks.workunit.client.0.smithi111.stdout:3/544: dwrite d1c/d1d/d22/d44/f7c [0,4194304] 0 2024-09-11T00:07:19.879 INFO:tasks.workunit.client.1.smithi203.stdout:2/511: mkdir d13/d15/d19/d1c/d76/da6 0 2024-09-11T00:07:19.881 INFO:tasks.workunit.client.0.smithi111.stdout:6/473: creat d7/d22/d1d/d83/fa1 x:0 0 0 2024-09-11T00:07:19.881 INFO:tasks.workunit.client.0.smithi111.stdout:2/529: dread d0/d3/f84 [0,4194304] 0 2024-09-11T00:07:19.884 INFO:tasks.workunit.client.1.smithi203.stdout:2/512: unlink d13/c70 0 2024-09-11T00:07:19.884 INFO:tasks.workunit.client.0.smithi111.stdout:7/528: dread dd/f63 [0,4194304] 0 2024-09-11T00:07:19.885 INFO:tasks.workunit.client.0.smithi111.stdout:6/474: dread - d7/d22/d1d/f88 zero size 2024-09-11T00:07:19.887 INFO:tasks.workunit.client.0.smithi111.stdout:3/545: rename d1c/d1d/d22/d23/d2f/d63/cb6 to d1c/d1d/d22/d31/d33/d5f/d98/cb9 0 2024-09-11T00:07:19.894 INFO:tasks.workunit.client.1.smithi203.stdout:2/513: rmdir d13/d22/d53 39 2024-09-11T00:07:19.894 INFO:tasks.workunit.client.0.smithi111.stdout:9/572: fdatasync d6/db/f49 0 2024-09-11T00:07:19.896 INFO:tasks.workunit.client.0.smithi111.stdout:6/475: symlink d7/d22/d1d/d69/la2 0 2024-09-11T00:07:19.897 INFO:tasks.workunit.client.0.smithi111.stdout:2/530: symlink d0/d3/d12/lb6 0 2024-09-11T00:07:19.898 INFO:tasks.workunit.client.0.smithi111.stdout:0/569: dwrite d3/d26/d77/fbc [0,4194304] 0 2024-09-11T00:07:19.900 INFO:tasks.workunit.client.1.smithi203.stdout:8/500: dread d1/fe [4194304,4194304] 0 2024-09-11T00:07:19.901 INFO:tasks.workunit.client.0.smithi111.stdout:5/566: dwrite d10/d1e/d25/f4a [0,4194304] 0 2024-09-11T00:07:19.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:19 smithi111 ceph-mon[27539]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:07:19.906 INFO:tasks.workunit.client.1.smithi203.stdout:2/514: rmdir d13/d15/d19/d1c/d76/da6 0 2024-09-11T00:07:19.908 INFO:tasks.workunit.client.0.smithi111.stdout:8/569: truncate d11/d23/d3d/f94 3577732 0 2024-09-11T00:07:19.910 INFO:tasks.workunit.client.1.smithi203.stdout:8/501: creat d1/d13/d17/d2f/d9e/fa7 x:0 0 0 2024-09-11T00:07:19.912 INFO:tasks.workunit.client.0.smithi111.stdout:7/529: dwrite dd/d1d/d4b/d8f/d9f/d79/f7b [0,4194304] 0 2024-09-11T00:07:19.914 INFO:tasks.workunit.client.0.smithi111.stdout:2/531: write d0/d3/de/f51 [65550,72586] 0 2024-09-11T00:07:19.914 INFO:tasks.workunit.client.0.smithi111.stdout:0/570: mknod d3/da/d7b/db3/cd1 0 2024-09-11T00:07:19.915 INFO:tasks.workunit.client.0.smithi111.stdout:3/546: mkdir d1c/d1d/d22/d44/d5a/dba 0 2024-09-11T00:07:19.916 INFO:tasks.workunit.client.0.smithi111.stdout:7/530: fsync dd/d1d/d2d/f89 0 2024-09-11T00:07:19.917 INFO:tasks.workunit.client.0.smithi111.stdout:1/512: dwrite d2/de/f43 [0,4194304] 0 2024-09-11T00:07:19.917 INFO:tasks.workunit.client.0.smithi111.stdout:4/525: sync 2024-09-11T00:07:19.917 INFO:tasks.workunit.client.0.smithi111.stdout:6/476: symlink d7/d22/la3 0 2024-09-11T00:07:19.918 INFO:tasks.workunit.client.1.smithi203.stdout:8/502: creat d1/d13/d17/d8b/fa8 x:0 0 0 2024-09-11T00:07:19.925 INFO:tasks.workunit.client.0.smithi111.stdout:1/513: write d2/de/d93/d9c/fa2 [937613,62080] 0 2024-09-11T00:07:19.929 INFO:tasks.workunit.client.1.smithi203.stdout:8/503: mkdir d1/d13/d17/d48/d9d/da9 0 2024-09-11T00:07:19.930 INFO:tasks.workunit.client.0.smithi111.stdout:1/514: dread - d2/de/d12/d3c/d4b/d6a/d3a/f92 zero size 2024-09-11T00:07:19.934 INFO:tasks.workunit.client.0.smithi111.stdout:5/567: mkdir d10/d1e/d25/d6e/d8b/db5 0 2024-09-11T00:07:19.934 INFO:tasks.workunit.client.1.smithi203.stdout:8/504: mkdir d1/d13/d3a/daa 0 2024-09-11T00:07:19.935 INFO:tasks.workunit.client.0.smithi111.stdout:6/477: mkdir d7/d22/d3f/d74/d7f/d79/da4 0 2024-09-11T00:07:19.936 INFO:tasks.workunit.client.0.smithi111.stdout:8/570: mkdir d11/d23/d7e/d93/db5 0 2024-09-11T00:07:19.938 INFO:tasks.workunit.client.0.smithi111.stdout:8/571: stat d11/d23/d3d/d8d/ca8 0 2024-09-11T00:07:19.940 INFO:tasks.workunit.client.1.smithi203.stdout:8/505: mkdir d1/d13/d43/dab 0 2024-09-11T00:07:19.942 INFO:tasks.workunit.client.0.smithi111.stdout:0/571: dread d3/d13/d66/fa0 [0,4194304] 0 2024-09-11T00:07:19.943 INFO:tasks.workunit.client.0.smithi111.stdout:9/573: rename d6/da1 to d6/db/d34/db5 0 2024-09-11T00:07:19.951 INFO:tasks.workunit.client.0.smithi111.stdout:6/478: chown d7/d22/d2c/c44 53 1 2024-09-11T00:07:19.953 INFO:tasks.workunit.client.0.smithi111.stdout:4/526: write d18/d20/f30 [1249012,100801] 0 2024-09-11T00:07:19.953 INFO:tasks.workunit.client.1.smithi203.stdout:2/515: dwrite d13/d22/f4a [0,4194304] 0 2024-09-11T00:07:19.955 INFO:tasks.workunit.client.0.smithi111.stdout:8/572: truncate d11/d21/d38/f57 1887873 0 2024-09-11T00:07:19.956 INFO:tasks.workunit.client.0.smithi111.stdout:8/573: stat d11/d21 0 2024-09-11T00:07:19.960 INFO:tasks.workunit.client.0.smithi111.stdout:0/572: rmdir d3/daf 39 2024-09-11T00:07:19.963 INFO:tasks.workunit.client.1.smithi203.stdout:2/516: mknod d13/d22/ca7 0 2024-09-11T00:07:19.965 INFO:tasks.workunit.client.0.smithi111.stdout:2/532: getdents d0/d3/de/d3b 0 2024-09-11T00:07:19.967 INFO:tasks.workunit.client.0.smithi111.stdout:4/527: creat d18/d1f/d36/d95/fa3 x:0 0 0 2024-09-11T00:07:19.968 INFO:tasks.workunit.client.0.smithi111.stdout:1/515: creat d2/de/d12/d3c/fb2 x:0 0 0 2024-09-11T00:07:19.969 INFO:tasks.workunit.client.0.smithi111.stdout:2/533: dread d0/d3/f84 [0,4194304] 0 2024-09-11T00:07:19.970 INFO:tasks.workunit.client.0.smithi111.stdout:0/573: creat d3/da/d7b/d84/da8/fd2 x:0 0 0 2024-09-11T00:07:19.970 INFO:tasks.workunit.client.0.smithi111.stdout:6/479: symlink d7/d22/d3f/d74/d7f/d61/d6a/d9f/la5 0 2024-09-11T00:07:19.973 INFO:tasks.workunit.client.0.smithi111.stdout:3/547: dread f6 [0,4194304] 0 2024-09-11T00:07:19.973 INFO:tasks.workunit.client.0.smithi111.stdout:8/574: mknod d11/d23/d3d/cb6 0 2024-09-11T00:07:19.974 INFO:tasks.workunit.client.1.smithi203.stdout:8/506: dwrite d1/d13/d3a/f44 [0,4194304] 0 2024-09-11T00:07:19.975 INFO:tasks.workunit.client.0.smithi111.stdout:0/574: chown d3/d13/d1e/c6c 16820 1 2024-09-11T00:07:19.975 INFO:tasks.workunit.client.0.smithi111.stdout:6/480: dread - d7/d22/d3f/d74/f9e zero size 2024-09-11T00:07:19.975 INFO:tasks.workunit.client.0.smithi111.stdout:7/531: rename dd/d1d/d2d/d2e/d4e/f8d to dd/fa7 0 2024-09-11T00:07:19.976 INFO:tasks.workunit.client.0.smithi111.stdout:1/516: symlink d2/d2b/lb3 0 2024-09-11T00:07:19.977 INFO:tasks.workunit.client.0.smithi111.stdout:8/575: write d11/f9c [232677,103839] 0 2024-09-11T00:07:19.978 INFO:tasks.workunit.client.0.smithi111.stdout:0/575: write d3/d1c/f4a [218140,101285] 0 2024-09-11T00:07:19.979 INFO:tasks.workunit.client.1.smithi203.stdout:7/523: sync 2024-09-11T00:07:19.980 INFO:tasks.workunit.client.1.smithi203.stdout:0/528: sync 2024-09-11T00:07:19.980 INFO:tasks.workunit.client.1.smithi203.stdout:8/507: mkdir d1/d13/d43/d46/d76/dac 0 2024-09-11T00:07:19.982 INFO:tasks.workunit.client.1.smithi203.stdout:8/508: stat d1/d13/d17/d8b/fa8 0 2024-09-11T00:07:19.985 INFO:tasks.workunit.client.1.smithi203.stdout:8/509: write d1/d13/d3a/f44 [1365498,19847] 0 2024-09-11T00:07:19.986 INFO:tasks.workunit.client.1.smithi203.stdout:2/517: dwrite d13/d56/f8f [0,4194304] 0 2024-09-11T00:07:19.987 INFO:tasks.workunit.client.0.smithi111.stdout:5/568: dwrite d10/f1b [0,4194304] 0 2024-09-11T00:07:19.990 INFO:tasks.workunit.client.1.smithi203.stdout:2/518: chown d13/d15/d19/d1c/d73/f81 102167252 1 2024-09-11T00:07:19.994 INFO:tasks.workunit.client.0.smithi111.stdout:8/576: write d11/d21/d38/f52 [2031432,44645] 0 2024-09-11T00:07:19.999 INFO:tasks.workunit.client.0.smithi111.stdout:9/574: dwrite d6/db/d34/d37/f35 [0,4194304] 0 2024-09-11T00:07:20.004 INFO:tasks.workunit.client.0.smithi111.stdout:0/576: mknod d3/d13/d1e/d29/db0/cd3 0 2024-09-11T00:07:20.004 INFO:tasks.workunit.client.0.smithi111.stdout:4/528: creat d18/fa4 x:0 0 0 2024-09-11T00:07:20.004 INFO:tasks.workunit.client.0.smithi111.stdout:2/534: mknod d0/d3/de/d3b/d62/cb7 0 2024-09-11T00:07:20.007 INFO:tasks.workunit.client.1.smithi203.stdout:2/519: fdatasync d13/d15/f55 0 2024-09-11T00:07:20.009 INFO:tasks.workunit.client.1.smithi203.stdout:2/520: readlink d13/d15/d19/l2b 0 2024-09-11T00:07:20.011 INFO:tasks.workunit.client.1.smithi203.stdout:7/524: link dd/d1c/d52/d8f/d31/d67/lb8 dd/d1c/d4b/dbb/lbc 0 2024-09-11T00:07:20.013 INFO:tasks.workunit.client.1.smithi203.stdout:0/529: write d0/d2/f51 [121627,116479] 0 2024-09-11T00:07:20.014 INFO:tasks.workunit.client.0.smithi111.stdout:1/517: mkdir d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/d7b/db4 0 2024-09-11T00:07:20.014 INFO:tasks.workunit.client.1.smithi203.stdout:8/510: link d1/l54 d1/d13/d17/d77/lad 0 2024-09-11T00:07:20.016 INFO:tasks.workunit.client.1.smithi203.stdout:8/511: stat d1/d13/d43/d46/d76 0 2024-09-11T00:07:20.017 INFO:tasks.workunit.client.0.smithi111.stdout:5/569: dwrite d10/d1e/d23/d30/d3c/d60/d7e/fb1 [0,4194304] 0 2024-09-11T00:07:20.017 INFO:tasks.workunit.client.0.smithi111.stdout:8/577: fsync d11/d23/d2c/d46/d64/f76 0 2024-09-11T00:07:20.018 INFO:tasks.workunit.client.1.smithi203.stdout:8/512: stat d1/d13/d17/d8b/f9c 0 2024-09-11T00:07:20.020 INFO:tasks.workunit.client.1.smithi203.stdout:7/525: fdatasync dd/d1c/d52/d8f/f3f 0 2024-09-11T00:07:20.020 INFO:tasks.workunit.client.0.smithi111.stdout:0/577: creat d3/dc/fd4 x:0 0 0 2024-09-11T00:07:20.025 INFO:tasks.workunit.client.1.smithi203.stdout:2/521: creat d13/d15/fa8 x:0 0 0 2024-09-11T00:07:20.028 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:19 smithi203 ceph-mon[33225]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:07:20.032 INFO:tasks.workunit.client.0.smithi111.stdout:0/578: truncate d3/dc/fd4 564521 0 2024-09-11T00:07:20.032 INFO:tasks.workunit.client.0.smithi111.stdout:9/575: dwrite d6/db/f49 [0,4194304] 0 2024-09-11T00:07:20.034 INFO:tasks.workunit.client.0.smithi111.stdout:0/579: dread - d3/d26/f98 zero size 2024-09-11T00:07:20.036 INFO:tasks.workunit.client.1.smithi203.stdout:2/522: creat d13/d15/d30/fa9 x:0 0 0 2024-09-11T00:07:20.036 INFO:tasks.workunit.client.1.smithi203.stdout:0/530: dwrite d0/d2/f41 [0,4194304] 0 2024-09-11T00:07:20.056 INFO:tasks.workunit.client.0.smithi111.stdout:7/532: dread dd/d1d/d1f/f23 [0,4194304] 0 2024-09-11T00:07:20.059 INFO:tasks.workunit.client.1.smithi203.stdout:2/523: rename f11 to d13/faa 0 2024-09-11T00:07:20.063 INFO:tasks.workunit.client.1.smithi203.stdout:0/531: dwrite d0/d2/d67/fa5 [0,4194304] 0 2024-09-11T00:07:20.068 INFO:tasks.workunit.client.1.smithi203.stdout:8/513: dread d1/f37 [0,4194304] 0 2024-09-11T00:07:20.069 INFO:tasks.workunit.client.1.smithi203.stdout:7/526: dread dd/d1c/f8a [0,4194304] 0 2024-09-11T00:07:20.072 INFO:tasks.workunit.client.1.smithi203.stdout:0/532: mknod d0/d2/d37/d5b/cae 0 2024-09-11T00:07:20.080 INFO:tasks.workunit.client.1.smithi203.stdout:2/524: dwrite d13/d15/d30/f63 [0,4194304] 0 2024-09-11T00:07:20.085 INFO:tasks.workunit.client.1.smithi203.stdout:2/525: stat d13/d15/d30/d5a/d8b 0 2024-09-11T00:07:20.087 INFO:tasks.workunit.client.1.smithi203.stdout:2/526: write d13/d56/f78 [195061,105790] 0 2024-09-11T00:07:20.089 INFO:tasks.workunit.client.0.smithi111.stdout:6/481: rename d7/d22/d1d/d69/f6d to d7/d22/d26/d87/fa6 0 2024-09-11T00:07:20.093 INFO:tasks.workunit.client.0.smithi111.stdout:3/548: link d1c/d1d/d22/f70 d1c/d1d/d22/d23/d58/fbb 0 2024-09-11T00:07:20.095 INFO:tasks.workunit.client.0.smithi111.stdout:2/535: creat d0/d3/fb8 x:0 0 0 2024-09-11T00:07:20.096 INFO:tasks.workunit.client.1.smithi203.stdout:2/527: creat d13/d22/d53/fab x:0 0 0 2024-09-11T00:07:20.098 INFO:tasks.workunit.client.1.smithi203.stdout:8/514: getdents d1/d13/d17/d48/d9d 0 2024-09-11T00:07:20.100 INFO:tasks.workunit.client.1.smithi203.stdout:8/515: write d1/f3f [1824831,70524] 0 2024-09-11T00:07:20.101 INFO:tasks.workunit.client.0.smithi111.stdout:9/576: mknod d6/d52/d8a/cb6 0 2024-09-11T00:07:20.103 INFO:tasks.workunit.client.1.smithi203.stdout:2/528: unlink d13/d15/d30/d59/f80 0 2024-09-11T00:07:20.108 INFO:tasks.workunit.client.0.smithi111.stdout:5/570: rename d10/d1e/d23/d26/d3a/l54 to d10/d1e/d23/d26/d78/d7a/lb6 0 2024-09-11T00:07:20.109 INFO:tasks.workunit.client.1.smithi203.stdout:2/529: mkdir d13/d15/d30/d5a/dac 0 2024-09-11T00:07:20.111 INFO:tasks.workunit.client.0.smithi111.stdout:1/518: creat d2/fb5 x:0 0 0 2024-09-11T00:07:20.112 INFO:tasks.workunit.client.0.smithi111.stdout:3/549: mkdir d1c/d1d/d86/dbc 0 2024-09-11T00:07:20.113 INFO:tasks.workunit.client.1.smithi203.stdout:2/530: symlink d13/d47/lad 0 2024-09-11T00:07:20.117 INFO:tasks.workunit.client.0.smithi111.stdout:9/577: symlink d6/db/d7a/d9a/lb7 0 2024-09-11T00:07:20.118 INFO:tasks.workunit.client.1.smithi203.stdout:8/516: dwrite d1/d13/d17/f26 [0,4194304] 0 2024-09-11T00:07:20.120 INFO:tasks.workunit.client.1.smithi203.stdout:8/517: chown d1/d13/d22/c40 42456 1 2024-09-11T00:07:20.120 INFO:tasks.workunit.client.1.smithi203.stdout:2/531: mknod d13/d15/d30/d5a/d8b/cae 0 2024-09-11T00:07:20.120 INFO:tasks.workunit.client.0.smithi111.stdout:7/533: mknod dd/da6/ca8 0 2024-09-11T00:07:20.122 INFO:tasks.workunit.client.0.smithi111.stdout:7/534: dread - dd/d49/f99 zero size 2024-09-11T00:07:20.122 INFO:tasks.workunit.client.0.smithi111.stdout:5/571: write d10/d1e/d23/d2b/d2f/f3f [2147567,91106] 0 2024-09-11T00:07:20.122 INFO:tasks.workunit.client.0.smithi111.stdout:4/529: getdents d18/d20/d3c/d5e/d75/d8d 0 2024-09-11T00:07:20.123 INFO:tasks.workunit.client.1.smithi203.stdout:7/527: write dd/d1c/f57 [411078,38718] 0 2024-09-11T00:07:20.124 INFO:tasks.workunit.client.0.smithi111.stdout:7/535: fdatasync dd/d49/f99 0 2024-09-11T00:07:20.125 INFO:tasks.workunit.client.1.smithi203.stdout:7/528: readlink dd/d1c/l60 0 2024-09-11T00:07:20.125 INFO:tasks.workunit.client.1.smithi203.stdout:8/518: creat d1/d13/d43/fae x:0 0 0 2024-09-11T00:07:20.126 INFO:tasks.workunit.client.0.smithi111.stdout:7/536: read - dd/d1d/d76/fa2 zero size 2024-09-11T00:07:20.126 INFO:tasks.workunit.client.0.smithi111.stdout:5/572: write d10/d1e/d23/d30/d3c/f4e [693470,102284] 0 2024-09-11T00:07:20.126 INFO:tasks.workunit.client.0.smithi111.stdout:6/482: getdents d7/d22/d2c/d38/d39 0 2024-09-11T00:07:20.127 INFO:tasks.workunit.client.0.smithi111.stdout:7/537: fdatasync dd/d1d/d76/fa3 0 2024-09-11T00:07:20.130 INFO:tasks.workunit.client.0.smithi111.stdout:6/483: dread - d7/d22/d26/f73 zero size 2024-09-11T00:07:20.130 INFO:tasks.workunit.client.0.smithi111.stdout:7/538: stat dd/d1d/d1f/d92 0 2024-09-11T00:07:20.131 INFO:tasks.workunit.client.0.smithi111.stdout:5/573: write d10/d1e/d23/d2b/d5c/f8e [3673482,101220] 0 2024-09-11T00:07:20.137 INFO:tasks.workunit.client.1.smithi203.stdout:7/529: creat dd/d1c/d52/d8f/d31/d58/d93/d98/fbd x:0 0 0 2024-09-11T00:07:20.138 INFO:tasks.workunit.client.0.smithi111.stdout:0/580: creat d3/d1c/fd5 x:0 0 0 2024-09-11T00:07:20.140 INFO:tasks.workunit.client.1.smithi203.stdout:0/533: dwrite d0/f18 [0,4194304] 0 2024-09-11T00:07:20.144 INFO:tasks.workunit.client.0.smithi111.stdout:2/536: creat d0/d3/fb9 x:0 0 0 2024-09-11T00:07:20.147 INFO:tasks.workunit.client.0.smithi111.stdout:6/484: mknod d7/d22/d3f/d74/d7f/ca7 0 2024-09-11T00:07:20.149 INFO:tasks.workunit.client.1.smithi203.stdout:0/534: rename d0/d2/l28 to d0/d2/d3d/d5a/d77/laf 0 2024-09-11T00:07:20.152 INFO:tasks.workunit.client.0.smithi111.stdout:7/539: symlink dd/d1d/d4b/d8f/d9f/d79/la9 0 2024-09-11T00:07:20.157 INFO:tasks.workunit.client.1.smithi203.stdout:0/535: readlink d0/d2/d92/l91 0 2024-09-11T00:07:20.158 INFO:tasks.workunit.client.1.smithi203.stdout:7/530: link dd/d1c/d52/d8f/d31/f45 dd/d1c/d52/d8f/d31/d58/fbe 0 2024-09-11T00:07:20.159 INFO:tasks.workunit.client.1.smithi203.stdout:0/536: chown d0/d2/d37/d7f/f85 3463226 1 2024-09-11T00:07:20.160 INFO:tasks.workunit.client.0.smithi111.stdout:9/578: mkdir d6/db/db8 0 2024-09-11T00:07:20.160 INFO:tasks.workunit.client.1.smithi203.stdout:7/531: stat dd/d1c/d52/d8f/d31/d58/f64 0 2024-09-11T00:07:20.161 INFO:tasks.workunit.client.0.smithi111.stdout:0/581: mkdir d3/d26/d77/dd6 0 2024-09-11T00:07:20.162 INFO:tasks.workunit.client.0.smithi111.stdout:4/530: fdatasync d18/d39/f53 0 2024-09-11T00:07:20.162 INFO:tasks.workunit.client.0.smithi111.stdout:0/582: stat d3/da/d7b/fa4 0 2024-09-11T00:07:20.164 INFO:tasks.workunit.client.1.smithi203.stdout:0/537: creat d0/d9f/fb0 x:0 0 0 2024-09-11T00:07:20.165 INFO:tasks.workunit.client.0.smithi111.stdout:3/550: creat d1c/d1d/d22/d31/fbd x:0 0 0 2024-09-11T00:07:20.168 INFO:tasks.workunit.client.1.smithi203.stdout:2/532: dwrite d13/d22/f38 [0,4194304] 0 2024-09-11T00:07:20.173 INFO:tasks.workunit.client.1.smithi203.stdout:0/538: rename d0/d1d/l68 to d0/d2/lb1 0 2024-09-11T00:07:20.174 INFO:tasks.workunit.client.1.smithi203.stdout:0/539: chown d0/d2/f1a 21825 1 2024-09-11T00:07:20.175 INFO:tasks.workunit.client.0.smithi111.stdout:5/574: link d10/d1e/d23/fa1 d10/d1e/d23/d2b/d5c/fb7 0 2024-09-11T00:07:20.176 INFO:tasks.workunit.client.0.smithi111.stdout:1/519: truncate d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/d7b/d87/f94 3121491 0 2024-09-11T00:07:20.177 INFO:tasks.workunit.client.0.smithi111.stdout:1/520: stat d2/dad 0 2024-09-11T00:07:20.178 INFO:tasks.workunit.client.0.smithi111.stdout:9/579: dread - d6/db/d1b/d56/f63 zero size 2024-09-11T00:07:20.179 INFO:tasks.workunit.client.1.smithi203.stdout:2/533: mkdir d13/d95/daf 0 2024-09-11T00:07:20.180 INFO:tasks.workunit.client.0.smithi111.stdout:9/580: dread - d6/db/d34/d37/d4c/fb2 zero size 2024-09-11T00:07:20.180 INFO:tasks.workunit.client.1.smithi203.stdout:2/534: readlink d13/l34 0 2024-09-11T00:07:20.182 INFO:tasks.workunit.client.1.smithi203.stdout:2/535: readlink d13/d15/d30/d59/l5c 0 2024-09-11T00:07:20.183 INFO:tasks.workunit.client.0.smithi111.stdout:0/583: write d3/d74/fae [516178,96443] 0 2024-09-11T00:07:20.183 INFO:tasks.workunit.client.1.smithi203.stdout:7/532: write dd/f18 [2732873,100725] 0 2024-09-11T00:07:20.186 INFO:tasks.workunit.client.1.smithi203.stdout:0/540: rename d0/d1d/c4e to d0/d2/d37/d5b/cb2 0 2024-09-11T00:07:20.186 INFO:tasks.workunit.client.1.smithi203.stdout:7/533: write dd/d4d/f7a [88531,16912] 0 2024-09-11T00:07:20.186 INFO:tasks.workunit.client.0.smithi111.stdout:3/551: mknod d1c/d1d/d86/cbe 0 2024-09-11T00:07:20.190 INFO:tasks.workunit.client.1.smithi203.stdout:0/541: mkdir d0/d2/db3 0 2024-09-11T00:07:20.192 INFO:tasks.workunit.client.1.smithi203.stdout:0/542: chown d0/d2/d7e/la4 2 1 2024-09-11T00:07:20.193 INFO:tasks.workunit.client.1.smithi203.stdout:7/534: mknod dd/d3b/d9f/db5/cbf 0 2024-09-11T00:07:20.194 INFO:tasks.workunit.client.1.smithi203.stdout:0/543: dread d0/d1d/d5d/f71 [0,4194304] 0 2024-09-11T00:07:20.195 INFO:tasks.workunit.client.1.smithi203.stdout:7/535: write dd/d3b/fb9 [444242,33354] 0 2024-09-11T00:07:20.199 INFO:tasks.workunit.client.1.smithi203.stdout:2/536: rename c12 to d13/d56/cb0 0 2024-09-11T00:07:20.206 INFO:tasks.workunit.client.1.smithi203.stdout:7/536: dread dd/f18 [0,4194304] 0 2024-09-11T00:07:20.207 INFO:tasks.workunit.client.1.smithi203.stdout:2/537: mknod d13/d56/cb1 0 2024-09-11T00:07:20.209 INFO:tasks.workunit.client.1.smithi203.stdout:7/537: mknod dd/d1c/cc0 0 2024-09-11T00:07:20.211 INFO:tasks.workunit.client.1.smithi203.stdout:2/538: creat d13/fb2 x:0 0 0 2024-09-11T00:07:20.251 INFO:tasks.workunit.client.0.smithi111.stdout:8/578: sync 2024-09-11T00:07:20.257 INFO:tasks.workunit.client.1.smithi203.stdout:1/589: sync 2024-09-11T00:07:20.257 INFO:tasks.workunit.client.1.smithi203.stdout:2/539: creat d13/d15/d19/d1c/d76/fb3 x:0 0 0 2024-09-11T00:07:20.258 INFO:tasks.workunit.client.0.smithi111.stdout:1/521: rename d2/c98 to d2/de/d93/d9f/cb6 0 2024-09-11T00:07:20.259 INFO:tasks.workunit.client.1.smithi203.stdout:2/540: mknod d13/d15/d90/cb4 0 2024-09-11T00:07:20.259 INFO:tasks.workunit.client.0.smithi111.stdout:0/584: rename d3/d26/l56 to d3/d26/ld7 0 2024-09-11T00:07:20.259 INFO:tasks.workunit.client.0.smithi111.stdout:2/537: symlink d0/d3/d12/d52/d6c/lba 0 2024-09-11T00:07:20.260 INFO:tasks.workunit.client.1.smithi203.stdout:2/541: fdatasync d13/d15/f29 0 2024-09-11T00:07:20.263 INFO:tasks.workunit.client.0.smithi111.stdout:4/531: truncate d18/d3b/d61/f7c 5670444 0 2024-09-11T00:07:20.265 INFO:tasks.workunit.client.1.smithi203.stdout:2/542: chown d13/d15/d30/l3a 1617737 1 2024-09-11T00:07:20.265 INFO:tasks.workunit.client.1.smithi203.stdout:7/538: dwrite dd/d1c/d52/d8f/f3f [0,4194304] 0 2024-09-11T00:07:20.266 INFO:tasks.workunit.client.0.smithi111.stdout:4/532: read d18/d1f/f8b [2720956,94609] 0 2024-09-11T00:07:20.266 INFO:tasks.workunit.client.0.smithi111.stdout:9/581: rename d6/db/f43 to d6/dc/d73/fb9 0 2024-09-11T00:07:20.270 INFO:tasks.workunit.client.0.smithi111.stdout:6/485: link d7/f52 d7/d22/fa8 0 2024-09-11T00:07:20.272 INFO:tasks.workunit.client.1.smithi203.stdout:7/539: fsync dd/f1a 0 2024-09-11T00:07:20.273 INFO:tasks.workunit.client.1.smithi203.stdout:1/590: dwrite d8/f68 [4194304,4194304] 0 2024-09-11T00:07:20.274 INFO:tasks.workunit.client.1.smithi203.stdout:2/543: creat d13/d15/d30/d5a/d8b/fb5 x:0 0 0 2024-09-11T00:07:20.277 INFO:tasks.workunit.client.0.smithi111.stdout:1/522: creat d2/de/d12/d3c/d4b/d6a/d63/fb7 x:0 0 0 2024-09-11T00:07:20.285 INFO:tasks.workunit.client.0.smithi111.stdout:4/533: stat d18/d20/d40/l4d 0 2024-09-11T00:07:20.287 INFO:tasks.workunit.client.0.smithi111.stdout:9/582: creat d6/dc/d7c/fba x:0 0 0 2024-09-11T00:07:20.293 INFO:tasks.workunit.client.1.smithi203.stdout:7/540: dwrite dd/d1c/fb7 [0,4194304] 0 2024-09-11T00:07:20.294 INFO:tasks.workunit.client.0.smithi111.stdout:3/552: link d1c/d1d/d22/d31/f79 d1c/d1d/d22/d31/d33/fbf 0 2024-09-11T00:07:20.296 INFO:tasks.workunit.client.0.smithi111.stdout:2/538: creat d0/d3/d98/fbb x:0 0 0 2024-09-11T00:07:20.296 INFO:tasks.workunit.client.1.smithi203.stdout:2/544: dread d13/faa [0,4194304] 0 2024-09-11T00:07:20.300 INFO:tasks.workunit.client.1.smithi203.stdout:2/545: truncate d13/d15/d30/f57 265479 0 2024-09-11T00:07:20.301 INFO:tasks.workunit.client.1.smithi203.stdout:7/541: symlink dd/d1c/d52/d8f/lc1 0 2024-09-11T00:07:20.303 INFO:tasks.workunit.client.1.smithi203.stdout:7/542: chown dd/d4d/f73 6517 1 2024-09-11T00:07:20.304 INFO:tasks.workunit.client.0.smithi111.stdout:0/585: rename d3/d1c/d50/lb4 to d3/d13/d1e/d29/d49/d51/ld8 0 2024-09-11T00:07:20.304 INFO:tasks.workunit.client.0.smithi111.stdout:8/579: dwrite d11/f13 [0,4194304] 0 2024-09-11T00:07:20.305 INFO:tasks.workunit.client.0.smithi111.stdout:0/586: dread - d3/dc/fc3 zero size 2024-09-11T00:07:20.309 INFO:tasks.workunit.client.1.smithi203.stdout:2/546: unlink d13/f14 0 2024-09-11T00:07:20.312 INFO:tasks.workunit.client.1.smithi203.stdout:7/543: rmdir dd/d1c/d52/d8f/d31/d67 39 2024-09-11T00:07:20.314 INFO:tasks.workunit.client.1.smithi203.stdout:2/547: write d13/d56/d69/d99/fa0 [1113015,24322] 0 2024-09-11T00:07:20.317 INFO:tasks.workunit.client.1.smithi203.stdout:7/544: dread - dd/d1c/d7c/d8c/f95 zero size 2024-09-11T00:07:20.321 INFO:tasks.workunit.client.0.smithi111.stdout:9/583: rename d6/db/d34/d37/d4c/f8c to d6/db/d1b/d41/d80/fbb 0 2024-09-11T00:07:20.322 INFO:tasks.workunit.client.1.smithi203.stdout:1/591: dwrite d8/d9/d15/d35/f8f [0,4194304] 0 2024-09-11T00:07:20.326 INFO:tasks.workunit.client.1.smithi203.stdout:1/592: chown d8/d19/d60/d90/d3e/d4b/d3a/fa4 24958269 1 2024-09-11T00:07:20.329 INFO:tasks.workunit.client.0.smithi111.stdout:9/584: read d6/db/f18 [1034363,129237] 0 2024-09-11T00:07:20.329 INFO:tasks.workunit.client.1.smithi203.stdout:7/545: mknod dd/d3b/d9f/db5/cc2 0 2024-09-11T00:07:20.330 INFO:tasks.workunit.client.0.smithi111.stdout:8/580: symlink d11/d23/d2c/d46/lb7 0 2024-09-11T00:07:20.331 INFO:tasks.workunit.client.0.smithi111.stdout:1/523: rmdir d2/de/d93/d9f/da5 0 2024-09-11T00:07:20.338 INFO:tasks.workunit.client.0.smithi111.stdout:6/486: dwrite d7/d22/d3f/f54 [0,4194304] 0 2024-09-11T00:07:20.340 INFO:tasks.workunit.client.0.smithi111.stdout:6/487: stat d7/d22/d3f/d74/d7f/d79 0 2024-09-11T00:07:20.340 INFO:tasks.workunit.client.1.smithi203.stdout:2/548: getdents d13 0 2024-09-11T00:07:20.342 INFO:tasks.workunit.client.1.smithi203.stdout:2/549: dread - d13/d56/d69/f6d zero size 2024-09-11T00:07:20.342 INFO:tasks.workunit.client.1.smithi203.stdout:1/593: mknod d8/d19/d60/d90/d3e/d4b/db2/ccf 0 2024-09-11T00:07:20.347 INFO:tasks.workunit.client.0.smithi111.stdout:0/587: fsync d3/f7 0 2024-09-11T00:07:20.349 INFO:tasks.workunit.client.0.smithi111.stdout:9/585: mknod d6/dc/d73/cbc 0 2024-09-11T00:07:20.349 INFO:tasks.workunit.client.0.smithi111.stdout:0/588: chown d3/d26/d77 307113429 1 2024-09-11T00:07:20.350 INFO:tasks.workunit.client.1.smithi203.stdout:7/546: mkdir dd/d1c/d52/d8f/d31/d67/dc3 0 2024-09-11T00:07:20.350 INFO:tasks.workunit.client.1.smithi203.stdout:2/550: symlink d13/d15/d19/d1c/d76/lb6 0 2024-09-11T00:07:20.351 INFO:tasks.workunit.client.0.smithi111.stdout:9/586: chown d6/db/f49 7 1 2024-09-11T00:07:20.352 INFO:tasks.workunit.client.0.smithi111.stdout:8/581: truncate d11/f3c 523186 0 2024-09-11T00:07:20.353 INFO:tasks.workunit.client.1.smithi203.stdout:1/594: symlink d8/d19/d60/d90/d3e/d4b/d41/ld0 0 2024-09-11T00:07:20.355 INFO:tasks.workunit.client.0.smithi111.stdout:6/488: dwrite d7/f12 [0,4194304] 0 2024-09-11T00:07:20.355 INFO:tasks.workunit.client.0.smithi111.stdout:3/553: link d1c/d1d/d22/d23/d2f/d63/l73 d1c/d1d/d22/d44/lc0 0 2024-09-11T00:07:20.357 INFO:tasks.workunit.client.1.smithi203.stdout:2/551: unlink d13/faa 0 2024-09-11T00:07:20.357 INFO:tasks.workunit.client.0.smithi111.stdout:3/554: write fb [1605668,94208] 0 2024-09-11T00:07:20.358 INFO:tasks.workunit.client.0.smithi111.stdout:2/539: creat d0/d3/d12/d52/fbc x:0 0 0 2024-09-11T00:07:20.359 INFO:tasks.workunit.client.0.smithi111.stdout:1/524: mkdir d2/de/d12/d3c/d4b/d6a/d63/d73/db8 0 2024-09-11T00:07:20.360 INFO:tasks.workunit.client.1.smithi203.stdout:1/595: creat d8/d19/d60/d90/d3e/d4b/d3a/fd1 x:0 0 0 2024-09-11T00:07:20.371 INFO:tasks.workunit.client.0.smithi111.stdout:0/589: dwrite d3/d13/d1e/d29/d49/d51/d61/d93/fa1 [0,4194304] 0 2024-09-11T00:07:20.372 INFO:tasks.workunit.client.1.smithi203.stdout:9/541: sync 2024-09-11T00:07:20.372 INFO:tasks.workunit.client.0.smithi111.stdout:6/489: dwrite d7/d22/d26/f8a [0,4194304] 0 2024-09-11T00:07:20.397 INFO:tasks.workunit.client.0.smithi111.stdout:7/540: sync 2024-09-11T00:07:20.397 INFO:tasks.workunit.client.0.smithi111.stdout:5/575: sync 2024-09-11T00:07:20.438 INFO:tasks.workunit.client.1.smithi203.stdout:3/587: sync 2024-09-11T00:07:20.438 INFO:tasks.workunit.client.1.smithi203.stdout:8/519: sync 2024-09-11T00:07:20.438 INFO:tasks.workunit.client.1.smithi203.stdout:5/638: sync 2024-09-11T00:07:20.438 INFO:tasks.workunit.client.1.smithi203.stdout:4/467: sync 2024-09-11T00:07:20.438 INFO:tasks.workunit.client.1.smithi203.stdout:0/544: sync 2024-09-11T00:07:20.438 INFO:tasks.workunit.client.1.smithi203.stdout:6/503: sync 2024-09-11T00:07:20.443 INFO:tasks.workunit.client.1.smithi203.stdout:4/468: chown db/f6c 1903200 1 2024-09-11T00:07:20.447 INFO:tasks.workunit.client.1.smithi203.stdout:4/469: write db/dd/d16/d38/d3c/f72 [2602994,84438] 0 2024-09-11T00:07:20.461 INFO:tasks.workunit.client.0.smithi111.stdout:4/534: getdents d18/d20/d3c/d5e 0 2024-09-11T00:07:20.466 INFO:tasks.workunit.client.1.smithi203.stdout:7/547: creat dd/d1c/d52/d8f/d31/d58/d93/d98/db2/fc4 x:0 0 0 2024-09-11T00:07:20.481 INFO:tasks.workunit.client.0.smithi111.stdout:3/555: chown d1c/c29 212739 1 2024-09-11T00:07:20.499 INFO:tasks.workunit.client.0.smithi111.stdout:6/490: creat d7/d22/d1d/d83/fa9 x:0 0 0 2024-09-11T00:07:20.500 INFO:tasks.workunit.client.0.smithi111.stdout:6/491: readlink d7/d22/d2c/d38/d39/l7d 0 2024-09-11T00:07:20.514 INFO:tasks.workunit.client.0.smithi111.stdout:8/582: symlink d11/d8e/lb8 0 2024-09-11T00:07:20.514 INFO:tasks.workunit.client.0.smithi111.stdout:7/541: dwrite dd/fa7 [0,4194304] 0 2024-09-11T00:07:20.517 INFO:tasks.workunit.client.0.smithi111.stdout:8/583: chown d11/d23/d2c/f89 1 1 2024-09-11T00:07:20.517 INFO:tasks.workunit.client.0.smithi111.stdout:7/542: chown dd/d1d/d1f/f9b 81113 1 2024-09-11T00:07:20.520 INFO:tasks.workunit.client.0.smithi111.stdout:1/525: mkdir d2/de/d12/d3c/d4b/d6a/d63/d73/da1/db9 0 2024-09-11T00:07:20.522 INFO:tasks.workunit.client.0.smithi111.stdout:0/590: symlink d3/d1c/dd0/ld9 0 2024-09-11T00:07:20.534 INFO:tasks.workunit.client.0.smithi111.stdout:7/543: creat dd/da6/faa x:0 0 0 2024-09-11T00:07:20.537 INFO:tasks.workunit.client.0.smithi111.stdout:0/591: write d3/f65 [518291,25787] 0 2024-09-11T00:07:20.538 INFO:tasks.workunit.client.1.smithi203.stdout:1/596: mkdir d8/d19/d60/d90/d3e/d4b/d80/d8d/da3/dd2 0 2024-09-11T00:07:20.540 INFO:tasks.workunit.client.1.smithi203.stdout:9/542: rmdir d6/de/d32/d9e 39 2024-09-11T00:07:20.542 INFO:tasks.workunit.client.1.smithi203.stdout:9/543: truncate d6/de/fa9 990949 0 2024-09-11T00:07:20.547 INFO:tasks.workunit.client.0.smithi111.stdout:1/526: mkdir d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/d7b/db4/dba 0 2024-09-11T00:07:20.547 INFO:tasks.workunit.client.1.smithi203.stdout:9/544: dread d6/de/fa9 [0,4194304] 0 2024-09-11T00:07:20.549 INFO:tasks.workunit.client.1.smithi203.stdout:3/588: truncate d8/d17/f84 964970 0 2024-09-11T00:07:20.551 INFO:tasks.workunit.client.0.smithi111.stdout:0/592: creat d3/d26/d77/dd6/fda x:0 0 0 2024-09-11T00:07:20.553 INFO:tasks.workunit.client.0.smithi111.stdout:0/593: truncate d3/d74/fae 989117 0 2024-09-11T00:07:20.553 INFO:tasks.workunit.client.1.smithi203.stdout:5/639: dread dc/dd/d13/f14 [0,4194304] 0 2024-09-11T00:07:20.554 INFO:tasks.workunit.client.1.smithi203.stdout:6/504: creat d0/d54/d9c/d7b/d7e/f9d x:0 0 0 2024-09-11T00:07:20.554 INFO:tasks.workunit.client.0.smithi111.stdout:0/594: stat d3/da/lab 0 2024-09-11T00:07:20.555 INFO:tasks.workunit.client.0.smithi111.stdout:7/544: dread dd/d1d/d1f/d24/f32 [0,4194304] 0 2024-09-11T00:07:20.563 INFO:tasks.workunit.client.1.smithi203.stdout:2/552: dread - d13/d22/d53/f98 zero size 2024-09-11T00:07:20.570 INFO:tasks.workunit.client.0.smithi111.stdout:0/595: mkdir d3/d13/d1e/d29/db0/dce/ddb 0 2024-09-11T00:07:20.571 INFO:tasks.workunit.client.0.smithi111.stdout:0/596: chown d3/d26/f81 3 1 2024-09-11T00:07:20.572 INFO:tasks.workunit.client.0.smithi111.stdout:0/597: chown d3/d13/d66/lc2 8 1 2024-09-11T00:07:20.573 INFO:tasks.workunit.client.0.smithi111.stdout:0/598: dread - d3/d26/f98 zero size 2024-09-11T00:07:20.575 INFO:tasks.workunit.client.1.smithi203.stdout:3/589: creat d8/da/d5c/d6b/d6c/fd9 x:0 0 0 2024-09-11T00:07:20.577 INFO:tasks.workunit.client.0.smithi111.stdout:1/527: getdents d2/de/d93/d9f 0 2024-09-11T00:07:20.580 INFO:tasks.workunit.client.0.smithi111.stdout:1/528: read d2/de/d12/d3c/d4b/d6a/d63/f9a [3039512,101534] 0 2024-09-11T00:07:20.583 INFO:tasks.workunit.client.0.smithi111.stdout:1/529: stat d2/de/d12/d3c/d4b/d6a/d63/d73/da1/c8e 0 2024-09-11T00:07:20.584 INFO:tasks.workunit.client.0.smithi111.stdout:1/530: write d2/d77/faf [1006917,23955] 0 2024-09-11T00:07:20.585 INFO:tasks.workunit.client.0.smithi111.stdout:0/599: link d3/d1c/fad d3/d13/d1e/d29/db0/dce/fdc 0 2024-09-11T00:07:20.587 INFO:tasks.workunit.client.0.smithi111.stdout:0/600: write d3/d13/f89 [1273020,76983] 0 2024-09-11T00:07:20.590 INFO:tasks.workunit.client.1.smithi203.stdout:2/553: chown d13/d95 2145 1 2024-09-11T00:07:20.593 INFO:tasks.workunit.client.1.smithi203.stdout:1/597: symlink d8/d9/d15/d35/d81/db9/dce/ld3 0 2024-09-11T00:07:20.599 INFO:tasks.workunit.client.1.smithi203.stdout:9/545: creat d6/de/d32/d52/d55/d66/daa/fae x:0 0 0 2024-09-11T00:07:20.600 INFO:tasks.workunit.client.1.smithi203.stdout:3/590: mknod d8/da/d11/cda 0 2024-09-11T00:07:20.603 INFO:tasks.workunit.client.1.smithi203.stdout:6/505: mknod d0/d54/d9c/d35/c9e 0 2024-09-11T00:07:20.608 INFO:tasks.workunit.client.1.smithi203.stdout:2/554: dread - d13/d15/d19/d1c/f3c zero size 2024-09-11T00:07:20.611 INFO:tasks.workunit.client.1.smithi203.stdout:4/470: link db/d12/d15/d2a/d71/f94 db/d12/d15/d2a/d71/f96 0 2024-09-11T00:07:20.613 INFO:tasks.workunit.client.1.smithi203.stdout:1/598: symlink d8/d9/d15/ld4 0 2024-09-11T00:07:20.613 INFO:tasks.workunit.client.1.smithi203.stdout:6/506: mkdir d0/d5b/d9f 0 2024-09-11T00:07:20.615 INFO:tasks.workunit.client.1.smithi203.stdout:1/599: dread d8/d19/d31/f9d [0,4194304] 0 2024-09-11T00:07:20.618 INFO:tasks.workunit.client.1.smithi203.stdout:4/471: readlink db/d12/d15/d2a/d71/l8c 0 2024-09-11T00:07:20.623 INFO:tasks.workunit.client.1.smithi203.stdout:1/600: symlink d8/d9/d15/d35/d81/db9/ld5 0 2024-09-11T00:07:20.623 INFO:tasks.workunit.client.1.smithi203.stdout:9/546: link d6/c69 d6/de/d32/d52/d55/d66/caf 0 2024-09-11T00:07:20.628 INFO:tasks.workunit.client.1.smithi203.stdout:0/545: symlink d0/d2/d7e/lb4 0 2024-09-11T00:07:20.628 INFO:tasks.workunit.client.1.smithi203.stdout:2/555: dwrite d13/d15/d30/f91 [0,4194304] 0 2024-09-11T00:07:20.631 INFO:tasks.workunit.client.1.smithi203.stdout:9/547: creat d6/de/d19/d24/fb0 x:0 0 0 2024-09-11T00:07:20.632 INFO:tasks.workunit.client.1.smithi203.stdout:2/556: write d13/d15/d30/f91 [1359862,22953] 0 2024-09-11T00:07:20.633 INFO:tasks.workunit.client.1.smithi203.stdout:6/507: getdents d0/d54/d9c/d35/d38/d7d 0 2024-09-11T00:07:20.634 INFO:tasks.workunit.client.1.smithi203.stdout:9/548: chown d6/de/d32/d52/d55 939362 1 2024-09-11T00:07:20.638 INFO:tasks.workunit.client.1.smithi203.stdout:6/508: dread d0/d32/f58 [0,4194304] 0 2024-09-11T00:07:20.648 INFO:tasks.workunit.client.1.smithi203.stdout:1/601: rename d8/d19/d60/d90/d3e/d4b/d41/f4d to d8/d19/d60/d90/d3e/d4b/d80/d91/dac/fd6 0 2024-09-11T00:07:20.648 INFO:tasks.workunit.client.0.smithi111.stdout:9/587: dwrite d6/dc/f6f [0,4194304] 0 2024-09-11T00:07:20.650 INFO:tasks.workunit.client.0.smithi111.stdout:2/540: creat d0/d3/d12/d52/fbd x:0 0 0 2024-09-11T00:07:20.659 INFO:tasks.workunit.client.0.smithi111.stdout:9/588: rename d6/db/d34/d37/d4c/fb2 to d6/db/d34/d37/d4c/d99/da4/fbd 0 2024-09-11T00:07:20.666 INFO:tasks.workunit.client.0.smithi111.stdout:2/541: dwrite d0/d3/de/d50/fa0 [0,4194304] 0 2024-09-11T00:07:20.669 INFO:tasks.workunit.client.1.smithi203.stdout:2/557: dread d13/d15/f65 [0,4194304] 0 2024-09-11T00:07:20.670 INFO:tasks.workunit.client.0.smithi111.stdout:2/542: chown d0/d3/de/d3b/d63/f75 11624360 1 2024-09-11T00:07:20.670 INFO:tasks.workunit.client.1.smithi203.stdout:6/509: link d0/d32/d5a/c8c d0/d54/d9c/d35/d39/ca0 0 2024-09-11T00:07:20.672 INFO:tasks.workunit.client.0.smithi111.stdout:9/589: read d6/db/d1b/d56/f72 [1486580,123540] 0 2024-09-11T00:07:20.672 INFO:tasks.workunit.client.0.smithi111.stdout:2/543: dread - d0/d3/fb8 zero size 2024-09-11T00:07:20.674 INFO:tasks.workunit.client.0.smithi111.stdout:9/590: dread - d6/db/d1b/d41/f57 zero size 2024-09-11T00:07:20.674 INFO:tasks.workunit.client.1.smithi203.stdout:2/558: write d13/d15/d30/f63 [143410,7066] 0 2024-09-11T00:07:20.676 INFO:tasks.workunit.client.0.smithi111.stdout:1/531: symlink d2/de/lbb 0 2024-09-11T00:07:20.682 INFO:tasks.workunit.client.1.smithi203.stdout:6/510: fsync d0/d32/f3a 0 2024-09-11T00:07:20.690 INFO:tasks.workunit.client.0.smithi111.stdout:9/591: link d6/db/d1b/d41/l82 d6/d52/lbe 0 2024-09-11T00:07:20.693 INFO:tasks.workunit.client.1.smithi203.stdout:2/559: dwrite d13/d15/f1a [0,4194304] 0 2024-09-11T00:07:20.694 INFO:tasks.workunit.client.1.smithi203.stdout:6/511: dread d0/d5b/d5c/f69 [0,4194304] 0 2024-09-11T00:07:20.695 INFO:tasks.workunit.client.0.smithi111.stdout:4/535: dwrite d18/d3b/d51/f63 [0,4194304] 0 2024-09-11T00:07:20.695 INFO:tasks.workunit.client.1.smithi203.stdout:2/560: readlink d13/l89 0 2024-09-11T00:07:20.697 INFO:tasks.workunit.client.1.smithi203.stdout:9/549: rename f5 to d6/de/d32/d52/d55/d66/fb1 0 2024-09-11T00:07:20.697 INFO:tasks.workunit.client.1.smithi203.stdout:9/550: chown d6/de 1020714076 1 2024-09-11T00:07:20.700 INFO:tasks.workunit.client.1.smithi203.stdout:9/551: dread - d6/de/d19/d24/fb0 zero size 2024-09-11T00:07:20.701 INFO:tasks.workunit.client.0.smithi111.stdout:3/556: write d1c/d1d/d22/d44/d5a/f69 [745958,55049] 0 2024-09-11T00:07:20.703 INFO:tasks.workunit.client.1.smithi203.stdout:2/561: rmdir d13/d15/d19/da2 0 2024-09-11T00:07:20.707 INFO:tasks.workunit.client.1.smithi203.stdout:9/552: rename d6/de/d19/d5b to d6/de/d19/d24/d54/db2 0 2024-09-11T00:07:20.707 INFO:tasks.workunit.client.0.smithi111.stdout:9/592: dwrite d6/d52/f90 [0,4194304] 0 2024-09-11T00:07:20.708 INFO:tasks.workunit.client.0.smithi111.stdout:9/593: readlink d6/dc/d73/l75 0 2024-09-11T00:07:20.713 INFO:tasks.workunit.client.0.smithi111.stdout:5/576: rmdir d10/d1e/d23/d30/d3c/d60/d7e 39 2024-09-11T00:07:20.715 INFO:tasks.workunit.client.1.smithi203.stdout:2/562: mknod d13/d15/d30/d5a/dac/cb7 0 2024-09-11T00:07:20.716 INFO:tasks.workunit.client.0.smithi111.stdout:5/577: readlink d10/d1e/d23/d2b/d5c/l62 0 2024-09-11T00:07:20.719 INFO:tasks.workunit.client.1.smithi203.stdout:2/563: mknod d13/d15/d19/d1c/cb8 0 2024-09-11T00:07:20.723 INFO:tasks.workunit.client.1.smithi203.stdout:9/553: symlink d6/de/d19/d21/da0/lb3 0 2024-09-11T00:07:20.726 INFO:tasks.workunit.client.1.smithi203.stdout:2/564: dread - d13/fb2 zero size 2024-09-11T00:07:20.727 INFO:tasks.workunit.client.1.smithi203.stdout:9/554: symlink d6/de/d19/d21/d87/lb4 0 2024-09-11T00:07:20.731 INFO:tasks.workunit.client.1.smithi203.stdout:9/555: truncate d6/de/d32/f59 4379480 0 2024-09-11T00:07:20.733 INFO:tasks.workunit.client.0.smithi111.stdout:5/578: dread d10/d1e/d23/d30/d3c/d60/d63/f6f [0,4194304] 0 2024-09-11T00:07:20.734 INFO:tasks.workunit.client.0.smithi111.stdout:8/584: dwrite d11/d23/d3d/d8d/f61 [0,4194304] 0 2024-09-11T00:07:20.735 INFO:tasks.workunit.client.1.smithi203.stdout:2/565: fdatasync d13/d15/d30/d59/f6a 0 2024-09-11T00:07:20.739 INFO:tasks.workunit.client.1.smithi203.stdout:8/520: dwrite d1/d13/d3a/d4c/f5c [0,4194304] 0 2024-09-11T00:07:20.739 INFO:tasks.workunit.client.1.smithi203.stdout:2/566: fdatasync d13/d15/d30/f57 0 2024-09-11T00:07:20.749 INFO:tasks.workunit.client.1.smithi203.stdout:9/556: link d6/de/d19/d24/d54/ca1 d6/de/d19/d24/d6c/cb5 0 2024-09-11T00:07:20.750 INFO:tasks.workunit.client.0.smithi111.stdout:1/532: dread d2/de/d12/d3c/d4b/d6a/d63/f9a [0,4194304] 0 2024-09-11T00:07:20.752 INFO:tasks.workunit.client.0.smithi111.stdout:7/545: truncate dd/d1d/d1f/d24/f2f 1101306 0 2024-09-11T00:07:20.754 INFO:tasks.workunit.client.1.smithi203.stdout:7/548: symlink dd/lc5 0 2024-09-11T00:07:20.754 INFO:tasks.workunit.client.0.smithi111.stdout:5/579: dwrite d10/d1e/d23/d2b/f33 [0,4194304] 0 2024-09-11T00:07:20.755 INFO:tasks.workunit.client.0.smithi111.stdout:8/585: dwrite d11/d23/d2c/d53/f83 [0,4194304] 0 2024-09-11T00:07:20.756 INFO:tasks.workunit.client.0.smithi111.stdout:5/580: read d10/f19 [120749,20844] 0 2024-09-11T00:07:20.758 INFO:tasks.workunit.client.0.smithi111.stdout:8/586: chown d11/d8e/lb8 1577 1 2024-09-11T00:07:20.758 INFO:tasks.workunit.client.1.smithi203.stdout:8/521: creat d1/d13/d17/d81/d97/faf x:0 0 0 2024-09-11T00:07:20.759 INFO:tasks.workunit.client.0.smithi111.stdout:5/581: fsync d10/d1e/d23/d2b/fa0 0 2024-09-11T00:07:20.762 INFO:tasks.workunit.client.1.smithi203.stdout:9/557: mknod d6/cb6 0 2024-09-11T00:07:20.762 INFO:tasks.workunit.client.1.smithi203.stdout:8/522: write d1/d13/d43/fa5 [114357,55612] 0 2024-09-11T00:07:20.764 INFO:tasks.workunit.client.1.smithi203.stdout:5/640: write dc/f87 [668007,103918] 0 2024-09-11T00:07:20.764 INFO:tasks.workunit.client.0.smithi111.stdout:7/546: read dd/d1d/d2d/d2e/d4e/f64 [353193,7910] 0 2024-09-11T00:07:20.766 INFO:tasks.workunit.client.0.smithi111.stdout:7/547: readlink dd/d1d/d4b/d8f/d9f/l7f 0 2024-09-11T00:07:20.768 INFO:tasks.workunit.client.1.smithi203.stdout:7/549: creat dd/d1c/d52/d8f/d31/d67/dc3/fc6 x:0 0 0 2024-09-11T00:07:20.771 INFO:tasks.workunit.client.0.smithi111.stdout:1/533: dwrite d2/de/d82/f96 [0,4194304] 0 2024-09-11T00:07:20.771 INFO:tasks.workunit.client.0.smithi111.stdout:5/582: mkdir d10/d1e/d23/d2b/d92/db8 0 2024-09-11T00:07:20.772 INFO:tasks.workunit.client.0.smithi111.stdout:1/534: stat d2/de/d82 0 2024-09-11T00:07:20.774 INFO:tasks.workunit.client.0.smithi111.stdout:0/601: creat d3/d13/fdd x:0 0 0 2024-09-11T00:07:20.775 INFO:tasks.workunit.client.1.smithi203.stdout:8/523: mkdir d1/d13/d43/d46/db0 0 2024-09-11T00:07:20.777 INFO:tasks.workunit.client.0.smithi111.stdout:0/602: chown d3/d13/daa 113633093 1 2024-09-11T00:07:20.779 INFO:tasks.workunit.client.1.smithi203.stdout:9/558: mknod d6/de/d32/d52/d55/da2/cb7 0 2024-09-11T00:07:20.781 INFO:tasks.workunit.client.0.smithi111.stdout:7/548: rename dd/f33 to dd/da6/fab 0 2024-09-11T00:07:20.786 INFO:tasks.workunit.client.1.smithi203.stdout:7/550: rename dd/d1c/f71 to dd/d1c/d4b/dbb/fc7 0 2024-09-11T00:07:20.787 INFO:tasks.workunit.client.0.smithi111.stdout:8/587: dwrite d11/d21/f70 [0,4194304] 0 2024-09-11T00:07:20.789 INFO:tasks.workunit.client.0.smithi111.stdout:5/583: symlink d10/d1e/d23/d30/d59/d7b/d82/d86/lb9 0 2024-09-11T00:07:20.791 INFO:tasks.workunit.client.1.smithi203.stdout:4/472: mknod db/dd/c97 0 2024-09-11T00:07:20.791 INFO:tasks.workunit.client.1.smithi203.stdout:5/641: truncate dc/dd/f9d 760175 0 2024-09-11T00:07:20.795 INFO:tasks.workunit.client.0.smithi111.stdout:0/603: creat d3/d74/fde x:0 0 0 2024-09-11T00:07:20.795 INFO:tasks.workunit.client.1.smithi203.stdout:4/473: read db/f7e [746942,34707] 0 2024-09-11T00:07:20.796 INFO:tasks.workunit.client.0.smithi111.stdout:3/557: creat d1c/d1d/d22/fc1 x:0 0 0 2024-09-11T00:07:20.796 INFO:tasks.workunit.client.0.smithi111.stdout:3/558: chown l16 0 1 2024-09-11T00:07:20.798 INFO:tasks.workunit.client.1.smithi203.stdout:8/524: creat d1/d13/d17/d81/d97/fb1 x:0 0 0 2024-09-11T00:07:20.799 INFO:tasks.workunit.client.0.smithi111.stdout:7/549: mkdir dd/d1d/d4b/d8f/dac 0 2024-09-11T00:07:20.801 INFO:tasks.workunit.client.0.smithi111.stdout:7/550: read dd/d1d/d2d/f89 [362002,37328] 0 2024-09-11T00:07:20.802 INFO:tasks.workunit.client.0.smithi111.stdout:8/588: read d11/fa1 [14030,66852] 0 2024-09-11T00:07:20.803 INFO:tasks.workunit.client.0.smithi111.stdout:7/551: chown dd/d1d/d1f/f5e 1 1 2024-09-11T00:07:20.805 INFO:tasks.workunit.client.1.smithi203.stdout:7/551: rename dd/d3b/d9f/db5 to dd/d1c/d52/d8f/d31/d67/dc8 0 2024-09-11T00:07:20.806 INFO:tasks.workunit.client.0.smithi111.stdout:5/584: dread - d10/d1e/d23/d26/d78/d7a/f83 zero size 2024-09-11T00:07:20.809 INFO:tasks.workunit.client.1.smithi203.stdout:9/559: symlink d6/de/lb8 0 2024-09-11T00:07:20.812 INFO:tasks.workunit.client.1.smithi203.stdout:5/642: truncate dc/dd/d13/f48 2701110 0 2024-09-11T00:07:20.814 INFO:tasks.workunit.client.1.smithi203.stdout:3/591: truncate d8/da/d5c/f8d 844393 0 2024-09-11T00:07:20.815 INFO:tasks.workunit.client.1.smithi203.stdout:4/474: mknod db/dd/d16/c98 0 2024-09-11T00:07:20.817 INFO:tasks.workunit.client.1.smithi203.stdout:4/475: write db/dd/d16/d38/f5f [264473,30819] 0 2024-09-11T00:07:20.819 INFO:tasks.workunit.client.0.smithi111.stdout:8/589: mkdir d11/d23/d3d/d8d/db9 0 2024-09-11T00:07:20.820 INFO:tasks.workunit.client.1.smithi203.stdout:8/525: readlink d1/d13/d17/d2f/d52/d59/l90 0 2024-09-11T00:07:20.821 INFO:tasks.workunit.client.1.smithi203.stdout:1/602: mknod d8/d19/d31/cd7 0 2024-09-11T00:07:20.824 INFO:tasks.workunit.client.0.smithi111.stdout:6/492: unlink d7/d22/d1d/f27 0 2024-09-11T00:07:20.826 INFO:tasks.workunit.client.1.smithi203.stdout:7/552: mknod dd/d1c/d7c/d7e/cc9 0 2024-09-11T00:07:20.826 INFO:tasks.workunit.client.0.smithi111.stdout:6/493: chown d7/d22/d26/d87/l40 5836438 1 2024-09-11T00:07:20.827 INFO:tasks.workunit.client.0.smithi111.stdout:6/494: fsync d7/d22/d26/d95/f9c 0 2024-09-11T00:07:20.828 INFO:tasks.workunit.client.0.smithi111.stdout:7/552: dread dd/d48/d69/f6b [0,4194304] 0 2024-09-11T00:07:20.828 INFO:tasks.workunit.client.0.smithi111.stdout:5/585: mkdir d10/d1e/d23/d30/d3c/d60/da2/d66/d76/dba 0 2024-09-11T00:07:20.830 INFO:tasks.workunit.client.0.smithi111.stdout:6/495: chown d7/d22/d2c/d38/d56/c6c 332740 1 2024-09-11T00:07:20.831 INFO:tasks.workunit.client.0.smithi111.stdout:0/604: symlink d3/d13/d1e/d29/d49/ldf 0 2024-09-11T00:07:20.832 INFO:tasks.workunit.client.0.smithi111.stdout:0/605: chown d3/d13/c27 7 1 2024-09-11T00:07:20.833 INFO:tasks.workunit.client.1.smithi203.stdout:9/560: dread d6/de/d32/d52/f4b [0,4194304] 0 2024-09-11T00:07:20.833 INFO:tasks.workunit.client.1.smithi203.stdout:5/643: creat dc/dd/d15/dbd/d59/da8/fd8 x:0 0 0 2024-09-11T00:07:20.834 INFO:tasks.workunit.client.1.smithi203.stdout:0/546: write d0/d1d/d5d/f82 [402487,76809] 0 2024-09-11T00:07:20.839 INFO:tasks.workunit.client.1.smithi203.stdout:0/547: write d0/d2/f51 [1234494,59469] 0 2024-09-11T00:07:20.842 INFO:tasks.workunit.client.1.smithi203.stdout:0/548: write d0/d2/d7e/f8f [708863,14173] 0 2024-09-11T00:07:20.843 INFO:tasks.workunit.client.1.smithi203.stdout:4/476: creat db/dd/d16/d38/f99 x:0 0 0 2024-09-11T00:07:20.848 INFO:tasks.workunit.client.1.smithi203.stdout:1/603: truncate d8/d19/d31/f9d 902909 0 2024-09-11T00:07:20.848 INFO:tasks.workunit.client.0.smithi111.stdout:5/586: rename d10/d1e/d25/d6e/d8b to d10/d1e/d23/d30/d3c/d60/d63/dbb 0 2024-09-11T00:07:20.849 INFO:tasks.workunit.client.1.smithi203.stdout:2/567: rmdir d13/d47 39 2024-09-11T00:07:20.851 INFO:tasks.workunit.client.0.smithi111.stdout:6/496: mknod d7/d22/d3f/d74/d7f/d79/caa 0 2024-09-11T00:07:20.855 INFO:tasks.workunit.client.1.smithi203.stdout:5/644: fdatasync dc/d4f/d5c/f69 0 2024-09-11T00:07:20.860 INFO:tasks.workunit.client.0.smithi111.stdout:6/497: creat d7/d22/d3f/d74/d7f/d79/da4/fab x:0 0 0 2024-09-11T00:07:20.862 INFO:tasks.workunit.client.0.smithi111.stdout:2/544: write d0/f7b [4830107,111678] 0 2024-09-11T00:07:20.865 INFO:tasks.workunit.client.0.smithi111.stdout:6/498: creat d7/d22/d3f/d74/d7f/d61/d6a/fac x:0 0 0 2024-09-11T00:07:20.867 INFO:tasks.workunit.client.1.smithi203.stdout:1/604: creat d8/d19/d60/d90/d3e/d4b/d80/d8d/db0/fd8 x:0 0 0 2024-09-11T00:07:20.870 INFO:tasks.workunit.client.1.smithi203.stdout:7/553: rename dd/d1c/d52/d8f/d31/l38 to dd/d1c/d52/lca 0 2024-09-11T00:07:20.872 INFO:tasks.workunit.client.1.smithi203.stdout:6/512: write d0/d32/f46 [600034,35925] 0 2024-09-11T00:07:20.873 INFO:tasks.workunit.client.0.smithi111.stdout:6/499: write d7/f5a [377890,66955] 0 2024-09-11T00:07:20.877 INFO:tasks.workunit.client.1.smithi203.stdout:5/645: truncate dc/dd/d56/dad/f60 2611703 0 2024-09-11T00:07:20.877 INFO:tasks.workunit.client.1.smithi203.stdout:6/513: write d0/d54/d9c/f66 [640864,83144] 0 2024-09-11T00:07:20.878 INFO:tasks.workunit.client.1.smithi203.stdout:5/646: fdatasync dc/dd/d56/fd0 0 2024-09-11T00:07:20.880 INFO:tasks.workunit.client.0.smithi111.stdout:5/587: dread d10/d1e/d25/f29 [0,4194304] 0 2024-09-11T00:07:20.882 INFO:tasks.workunit.client.1.smithi203.stdout:6/514: chown d0/d54/d9c/d7b/d7e/d94 40549 1 2024-09-11T00:07:20.883 INFO:tasks.workunit.client.1.smithi203.stdout:6/515: readlink d0/d54/l88 0 2024-09-11T00:07:20.887 INFO:tasks.workunit.client.1.smithi203.stdout:2/568: write d13/d15/f32 [3851602,120747] 0 2024-09-11T00:07:20.888 INFO:tasks.workunit.client.0.smithi111.stdout:5/588: creat d10/d1e/d23/d2b/d92/fbc x:0 0 0 2024-09-11T00:07:20.889 INFO:tasks.workunit.client.0.smithi111.stdout:9/594: dwrite d6/db/d1b/d56/f6b [0,4194304] 0 2024-09-11T00:07:20.891 INFO:tasks.workunit.client.0.smithi111.stdout:5/589: write d10/d1e/d23/d30/d3c/f4e [1425536,30005] 0 2024-09-11T00:07:20.895 INFO:tasks.workunit.client.1.smithi203.stdout:7/554: symlink dd/d1c/d4b/dbb/lcb 0 2024-09-11T00:07:20.896 INFO:tasks.workunit.client.0.smithi111.stdout:6/500: dread d7/d22/d3f/d74/f96 [0,4194304] 0 2024-09-11T00:07:20.896 INFO:tasks.workunit.client.1.smithi203.stdout:5/647: mknod dc/d91/cd9 0 2024-09-11T00:07:20.900 INFO:tasks.workunit.client.1.smithi203.stdout:6/516: rmdir d0/d54 39 2024-09-11T00:07:20.902 INFO:tasks.workunit.client.0.smithi111.stdout:9/595: dread - d6/dc/f62 zero size 2024-09-11T00:07:20.905 INFO:tasks.workunit.client.0.smithi111.stdout:1/535: write d2/de/d82/f96 [4290680,3061] 0 2024-09-11T00:07:20.906 INFO:tasks.workunit.client.1.smithi203.stdout:1/605: mkdir d8/d19/d60/d90/dd9 0 2024-09-11T00:07:20.908 INFO:tasks.workunit.client.0.smithi111.stdout:1/536: read d2/de/d12/d3c/d4b/d6a/f7a [3601061,25360] 0 2024-09-11T00:07:20.909 INFO:tasks.workunit.client.1.smithi203.stdout:9/561: rename d6/f64 to d6/de/d19/d24/d40/fb9 0 2024-09-11T00:07:20.909 INFO:tasks.workunit.client.0.smithi111.stdout:6/501: dread - d7/d22/d2c/f62 zero size 2024-09-11T00:07:20.912 INFO:tasks.workunit.client.1.smithi203.stdout:2/569: truncate d13/d15/d19/d1c/f2a 1895456 0 2024-09-11T00:07:20.912 INFO:tasks.workunit.client.0.smithi111.stdout:9/596: fdatasync d6/db/d34/f66 0 2024-09-11T00:07:20.915 INFO:tasks.workunit.client.1.smithi203.stdout:7/555: mkdir dd/d1c/d52/d8f/d31/d4a/d6e/dcc 0 2024-09-11T00:07:20.916 INFO:tasks.workunit.client.1.smithi203.stdout:2/570: write d13/d15/f45 [781612,43741] 0 2024-09-11T00:07:20.920 INFO:tasks.workunit.client.1.smithi203.stdout:7/556: chown dd/f30 6656 1 2024-09-11T00:07:20.920 INFO:tasks.workunit.client.1.smithi203.stdout:5/648: creat dc/d4f/d5c/fda x:0 0 0 2024-09-11T00:07:20.930 INFO:tasks.workunit.client.0.smithi111.stdout:9/597: symlink d6/db/d34/d37/lbf 0 2024-09-11T00:07:20.930 INFO:tasks.workunit.client.0.smithi111.stdout:1/537: dread d2/de/d93/d9f/f1a [0,4194304] 0 2024-09-11T00:07:20.934 INFO:tasks.workunit.client.1.smithi203.stdout:2/571: write d13/d22/f4a [892029,14185] 0 2024-09-11T00:07:20.938 INFO:tasks.workunit.client.1.smithi203.stdout:2/572: chown d13/d15/d19/d1c/cb8 8 1 2024-09-11T00:07:20.938 INFO:tasks.workunit.client.1.smithi203.stdout:7/557: chown dd/c3c 25 1 2024-09-11T00:07:20.939 INFO:tasks.workunit.client.1.smithi203.stdout:9/562: dwrite d6/de/d19/d30/f51 [0,4194304] 0 2024-09-11T00:07:20.940 INFO:tasks.workunit.client.1.smithi203.stdout:2/573: dread - d13/d22/f7c zero size 2024-09-11T00:07:20.942 INFO:tasks.workunit.client.1.smithi203.stdout:9/563: readlink d6/de/d32/d52/l4d 0 2024-09-11T00:07:20.943 INFO:tasks.workunit.client.0.smithi111.stdout:4/536: sync 2024-09-11T00:07:20.944 INFO:tasks.workunit.client.0.smithi111.stdout:3/559: dwrite d1c/d1d/d22/d23/f28 [0,4194304] 0 2024-09-11T00:07:20.945 INFO:tasks.workunit.client.0.smithi111.stdout:6/502: creat d7/d22/d26/d87/fad x:0 0 0 2024-09-11T00:07:20.948 INFO:tasks.workunit.client.1.smithi203.stdout:6/517: mkdir d0/d54/d9c/d35/d38/d73/da1 0 2024-09-11T00:07:20.953 INFO:tasks.workunit.client.1.smithi203.stdout:1/606: dread d8/d19/d60/d90/f3d [0,4194304] 0 2024-09-11T00:07:20.958 INFO:tasks.workunit.client.0.smithi111.stdout:9/598: creat d6/db/d1b/fc0 x:0 0 0 2024-09-11T00:07:20.962 INFO:tasks.workunit.client.0.smithi111.stdout:8/590: write d11/d23/d2c/f3b [391607,17244] 0 2024-09-11T00:07:20.969 INFO:tasks.workunit.client.1.smithi203.stdout:6/518: dread d0/d54/d9c/d35/d39/d3c/f79 [0,4194304] 0 2024-09-11T00:07:20.972 INFO:tasks.workunit.client.1.smithi203.stdout:7/558: symlink dd/d1c/d52/d8f/d31/d4a/d6e/dcc/lcd 0 2024-09-11T00:07:20.973 INFO:tasks.workunit.client.0.smithi111.stdout:7/553: dwrite dd/f1a [0,4194304] 0 2024-09-11T00:07:20.974 INFO:tasks.workunit.client.1.smithi203.stdout:3/592: dwrite d8/da/d37/d83/d65/d8b/f9e [0,4194304] 0 2024-09-11T00:07:20.976 INFO:tasks.workunit.client.1.smithi203.stdout:8/526: dwrite d1/d13/d17/f42 [0,4194304] 0 2024-09-11T00:07:20.978 INFO:tasks.workunit.client.1.smithi203.stdout:1/607: creat d8/d19/d60/d90/d3e/d4b/d41/fda x:0 0 0 2024-09-11T00:07:20.980 INFO:tasks.workunit.client.0.smithi111.stdout:8/591: fdatasync d11/d23/d2c/f89 0 2024-09-11T00:07:20.981 INFO:tasks.workunit.client.0.smithi111.stdout:4/537: creat d18/fa5 x:0 0 0 2024-09-11T00:07:20.984 INFO:tasks.workunit.client.0.smithi111.stdout:3/560: dread d1c/d1d/d22/d23/d2f/d63/f81 [0,4194304] 0 2024-09-11T00:07:20.988 INFO:tasks.workunit.client.1.smithi203.stdout:0/549: truncate d0/d2/d3d/d5a/f6e 2641964 0 2024-09-11T00:07:20.990 INFO:tasks.workunit.client.0.smithi111.stdout:2/545: truncate d0/d3/d12/f41 2194467 0 2024-09-11T00:07:20.991 INFO:tasks.workunit.client.0.smithi111.stdout:9/599: mkdir d6/dc/dc1 0 2024-09-11T00:07:20.995 INFO:tasks.workunit.client.0.smithi111.stdout:6/503: rename d7/d22/d3f/d74/d7f/d61/d6a/f70 to d7/d2b/fae 0 2024-09-11T00:07:20.999 INFO:tasks.workunit.client.1.smithi203.stdout:8/527: truncate d1/d13/d17/d2f/d9e/f66 1592081 0 2024-09-11T00:07:21.000 INFO:tasks.workunit.client.1.smithi203.stdout:4/477: dwrite db/dd/d16/f55 [0,4194304] 0 2024-09-11T00:07:21.003 INFO:tasks.workunit.client.0.smithi111.stdout:5/590: dwrite d10/d1e/f28 [0,4194304] 0 2024-09-11T00:07:21.013 INFO:tasks.workunit.client.1.smithi203.stdout:7/559: creat dd/d1c/d52/fce x:0 0 0 2024-09-11T00:07:21.014 INFO:tasks.workunit.client.0.smithi111.stdout:0/606: sync 2024-09-11T00:07:21.019 INFO:tasks.workunit.client.1.smithi203.stdout:3/593: creat d8/d17/fdb x:0 0 0 2024-09-11T00:07:21.021 INFO:tasks.workunit.client.0.smithi111.stdout:5/591: dread d10/d1e/d23/d2b/d5c/fb7 [0,4194304] 0 2024-09-11T00:07:21.023 INFO:tasks.workunit.client.0.smithi111.stdout:1/538: truncate d2/f10 4129373 0 2024-09-11T00:07:21.026 INFO:tasks.workunit.client.0.smithi111.stdout:1/539: read - d2/de/d12/d3c/d4b/d6a/d63/fb7 zero size 2024-09-11T00:07:21.029 INFO:tasks.workunit.client.1.smithi203.stdout:1/608: dwrite d8/d11/fc9 [0,4194304] 0 2024-09-11T00:07:21.032 INFO:tasks.workunit.client.0.smithi111.stdout:6/504: dread - d7/f5e zero size 2024-09-11T00:07:21.033 INFO:tasks.workunit.client.0.smithi111.stdout:1/540: dread - d2/de/d12/d3c/d4b/f51 zero size 2024-09-11T00:07:21.036 INFO:tasks.workunit.client.1.smithi203.stdout:8/528: mknod d1/d13/d17/d2f/d52/d49/d68/cb2 0 2024-09-11T00:07:21.040 INFO:tasks.workunit.client.1.smithi203.stdout:8/529: fdatasync d1/d13/d17/f42 0 2024-09-11T00:07:21.043 INFO:tasks.workunit.client.1.smithi203.stdout:5/649: dwrite dc/dd/d15/f23 [0,4194304] 0 2024-09-11T00:07:21.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:20 smithi203 ceph-mon[33225]: pgmap v8: 65 pgs: 65 active+clean; 1.9 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 35 MiB/s rd, 111 MiB/s wr, 219 op/s 2024-09-11T00:07:21.050 INFO:tasks.workunit.client.0.smithi111.stdout:4/538: getdents d18/d20/d40/d78/d79/d90/d91 0 2024-09-11T00:07:21.051 INFO:tasks.workunit.client.0.smithi111.stdout:4/539: fsync d18/fa5 0 2024-09-11T00:07:21.053 INFO:tasks.workunit.client.0.smithi111.stdout:4/540: readlink d18/d39/l6c 0 2024-09-11T00:07:21.058 INFO:tasks.workunit.client.0.smithi111.stdout:7/554: dread dd/f35 [0,4194304] 0 2024-09-11T00:07:21.059 INFO:tasks.workunit.client.0.smithi111.stdout:7/555: chown dd/d1d/d4b/d8f/dac 0 1 2024-09-11T00:07:21.061 INFO:tasks.workunit.client.0.smithi111.stdout:7/556: chown dd/d1d/d2d/d2e/l56 389 1 2024-09-11T00:07:21.064 INFO:tasks.workunit.client.0.smithi111.stdout:3/561: write d1c/d1d/d22/f61 [5074846,101981] 0 2024-09-11T00:07:21.065 INFO:tasks.workunit.client.1.smithi203.stdout:9/564: getdents d6/de/d19/d24/d54 0 2024-09-11T00:07:21.067 INFO:tasks.workunit.client.0.smithi111.stdout:2/546: write d0/d3/f56 [2880720,85577] 0 2024-09-11T00:07:21.067 INFO:tasks.workunit.client.1.smithi203.stdout:0/550: mknod d0/d2/d7e/da1/cb5 0 2024-09-11T00:07:21.068 INFO:tasks.workunit.client.0.smithi111.stdout:5/592: read d10/d1e/f21 [3943725,103134] 0 2024-09-11T00:07:21.070 INFO:tasks.workunit.client.0.smithi111.stdout:2/547: chown d0/d3/de/d3b/d63/f75 253445040 1 2024-09-11T00:07:21.073 INFO:tasks.workunit.client.1.smithi203.stdout:6/519: dwrite d0/f2a [0,4194304] 0 2024-09-11T00:07:21.084 INFO:tasks.workunit.client.1.smithi203.stdout:3/594: dread d8/d17/f84 [0,4194304] 0 2024-09-11T00:07:21.099 INFO:tasks.workunit.client.1.smithi203.stdout:7/560: dread dd/d1c/d52/d8f/d31/f50 [0,4194304] 0 2024-09-11T00:07:21.100 INFO:tasks.workunit.client.1.smithi203.stdout:5/650: creat dc/d91/fdb x:0 0 0 2024-09-11T00:07:21.102 INFO:tasks.workunit.client.1.smithi203.stdout:5/651: chown dc/dd/d15/d3b/d7a/f9e 13 1 2024-09-11T00:07:21.111 INFO:tasks.workunit.client.1.smithi203.stdout:2/574: link d13/d47/l9d d13/d95/daf/lb9 0 2024-09-11T00:07:21.115 INFO:tasks.workunit.client.1.smithi203.stdout:3/595: symlink d8/da/d37/d83/dc0/ldc 0 2024-09-11T00:07:21.118 INFO:tasks.workunit.client.1.smithi203.stdout:4/478: rename db/f3d to db/d12/f9a 0 2024-09-11T00:07:21.119 INFO:tasks.workunit.client.1.smithi203.stdout:4/479: stat db/d12/f1e 0 2024-09-11T00:07:21.124 INFO:tasks.workunit.client.0.smithi111.stdout:6/505: creat d7/d22/d2c/d38/d56/faf x:0 0 0 2024-09-11T00:07:21.124 INFO:tasks.workunit.client.0.smithi111.stdout:1/541: creat d2/de/d93/fbc x:0 0 0 2024-09-11T00:07:21.124 INFO:tasks.workunit.client.1.smithi203.stdout:4/480: truncate db/dd/d16/d38/f5f 1076315 0 2024-09-11T00:07:21.125 INFO:tasks.workunit.client.1.smithi203.stdout:2/575: mknod d13/d15/d19/d1c/d76/cba 0 2024-09-11T00:07:21.127 INFO:tasks.workunit.client.1.smithi203.stdout:3/596: mkdir d8/d17/ddd 0 2024-09-11T00:07:21.128 INFO:tasks.workunit.client.0.smithi111.stdout:3/562: symlink d1c/d1d/d22/d44/lc2 0 2024-09-11T00:07:21.128 INFO:tasks.workunit.client.0.smithi111.stdout:3/563: chown d1c/d21/db4 6662 1 2024-09-11T00:07:21.130 INFO:tasks.workunit.client.1.smithi203.stdout:7/561: mknod dd/d1c/d52/d8f/d31/d4a/ccf 0 2024-09-11T00:07:21.131 INFO:tasks.workunit.client.1.smithi203.stdout:5/652: creat dc/dd/d15/dbd/dce/fdc x:0 0 0 2024-09-11T00:07:21.132 INFO:tasks.workunit.client.1.smithi203.stdout:6/520: dwrite d0/d54/d9c/f18 [0,4194304] 0 2024-09-11T00:07:21.135 INFO:tasks.workunit.client.1.smithi203.stdout:5/653: write dc/dd/d1e/f29 [7053490,113959] 0 2024-09-11T00:07:21.137 INFO:tasks.workunit.client.1.smithi203.stdout:6/521: fdatasync d0/d5b/d5c/d6f/f92 0 2024-09-11T00:07:21.138 INFO:tasks.workunit.client.1.smithi203.stdout:7/562: write dd/d1c/d52/d8f/d31/d58/d93/d98/fb4 [441563,53806] 0 2024-09-11T00:07:21.138 INFO:tasks.workunit.client.0.smithi111.stdout:9/600: rename d6/db/d34/f67 to d6/fc2 0 2024-09-11T00:07:21.139 INFO:tasks.workunit.client.1.smithi203.stdout:1/609: getdents d8/d19/d60/d90/d3e 0 2024-09-11T00:07:21.141 INFO:tasks.workunit.client.1.smithi203.stdout:6/522: write d0/d32/f43 [444135,119538] 0 2024-09-11T00:07:21.142 INFO:tasks.workunit.client.0.smithi111.stdout:8/592: getdents d11/d23 0 2024-09-11T00:07:21.145 INFO:tasks.workunit.client.1.smithi203.stdout:2/576: stat d13/d56/l82 0 2024-09-11T00:07:21.146 INFO:tasks.workunit.client.1.smithi203.stdout:4/481: unlink db/d12/d15/f78 0 2024-09-11T00:07:21.150 INFO:tasks.workunit.client.1.smithi203.stdout:8/530: getdents d1/d13/d17/d2f/d52/d49/d7a 0 2024-09-11T00:07:21.150 INFO:tasks.workunit.client.0.smithi111.stdout:4/541: dwrite d18/d1f/f8b [4194304,4194304] 0 2024-09-11T00:07:21.152 INFO:tasks.workunit.client.1.smithi203.stdout:8/531: stat d1/d13/d17/d2f/d52/d59/f6e 0 2024-09-11T00:07:21.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:20 smithi111 ceph-mon[27539]: pgmap v8: 65 pgs: 65 active+clean; 1.9 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 35 MiB/s rd, 111 MiB/s wr, 219 op/s 2024-09-11T00:07:21.153 INFO:tasks.workunit.client.1.smithi203.stdout:9/565: getdents d6/de/d47 0 2024-09-11T00:07:21.153 INFO:tasks.workunit.client.0.smithi111.stdout:5/593: creat d10/d1e/d23/d30/d3c/d60/da2/d66/d76/dba/fbd x:0 0 0 2024-09-11T00:07:21.155 INFO:tasks.workunit.client.0.smithi111.stdout:1/542: dread d2/de/d12/d3c/d4b/d6a/d63/d73/da1/f47 [0,4194304] 0 2024-09-11T00:07:21.159 INFO:tasks.workunit.client.0.smithi111.stdout:7/557: rename dd/d1d/d1f/d92 to dd/d1d/d4b/dad 0 2024-09-11T00:07:21.159 INFO:tasks.workunit.client.1.smithi203.stdout:3/597: mknod d8/cde 0 2024-09-11T00:07:21.160 INFO:tasks.workunit.client.0.smithi111.stdout:9/601: truncate d6/db/d34/f47 4873699 0 2024-09-11T00:07:21.162 INFO:tasks.workunit.client.0.smithi111.stdout:2/548: dwrite d0/d3/de/d3b/d63/f75 [0,4194304] 0 2024-09-11T00:07:21.162 INFO:tasks.workunit.client.0.smithi111.stdout:8/593: mkdir d11/d23/d7e/d93/dba 0 2024-09-11T00:07:21.163 INFO:tasks.workunit.client.1.smithi203.stdout:3/598: truncate d8/da/d37/d83/fd4 881689 0 2024-09-11T00:07:21.164 INFO:tasks.workunit.client.1.smithi203.stdout:8/532: fdatasync d1/d13/d17/f39 0 2024-09-11T00:07:21.164 INFO:tasks.workunit.client.0.smithi111.stdout:9/602: write d6/db/d34/d37/d4c/d7f/d97/fb3 [342149,107203] 0 2024-09-11T00:07:21.166 INFO:tasks.workunit.client.0.smithi111.stdout:0/607: link d3/da/d7b/d84/f8b d3/d13/d1e/fe0 0 2024-09-11T00:07:21.168 INFO:tasks.workunit.client.1.smithi203.stdout:6/523: mknod d0/d54/d9c/d35/ca2 0 2024-09-11T00:07:21.169 INFO:tasks.workunit.client.1.smithi203.stdout:6/524: fsync d0/d32/f7a 0 2024-09-11T00:07:21.170 INFO:tasks.workunit.client.1.smithi203.stdout:9/566: creat d6/de/d32/d52/d55/d66/d80/fba x:0 0 0 2024-09-11T00:07:21.173 INFO:tasks.workunit.client.1.smithi203.stdout:7/563: link dd/d1c/d52/d8f/d31/d67/dc3/fc6 dd/d1c/d52/d8f/d31/d58/fd0 0 2024-09-11T00:07:21.173 INFO:tasks.workunit.client.1.smithi203.stdout:6/525: chown d0/d54/d9c/d35/d39/f51 604835 1 2024-09-11T00:07:21.175 INFO:tasks.workunit.client.1.smithi203.stdout:9/567: dread - d6/de/d32/d52/d55/d66/d80/fba zero size 2024-09-11T00:07:21.176 INFO:tasks.workunit.client.1.smithi203.stdout:8/533: creat d1/d13/d3a/fb3 x:0 0 0 2024-09-11T00:07:21.178 INFO:tasks.workunit.client.1.smithi203.stdout:9/568: write d6/de/d19/d24/d54/f9d [561983,117047] 0 2024-09-11T00:07:21.179 INFO:tasks.workunit.client.0.smithi111.stdout:2/549: mkdir d0/d3/d98/dbe 0 2024-09-11T00:07:21.182 INFO:tasks.workunit.client.1.smithi203.stdout:6/526: fdatasync d0/d54/d9c/d35/d39/f6a 0 2024-09-11T00:07:21.182 INFO:tasks.workunit.client.1.smithi203.stdout:2/577: write d13/d15/d19/f26 [281310,21802] 0 2024-09-11T00:07:21.186 INFO:tasks.workunit.client.1.smithi203.stdout:6/527: chown d0/d54/d9c/d35/d38/c42 58567694 1 2024-09-11T00:07:21.188 INFO:tasks.workunit.client.1.smithi203.stdout:4/482: write db/d12/d15/d2a/f22 [1482857,75413] 0 2024-09-11T00:07:21.188 INFO:tasks.workunit.client.0.smithi111.stdout:3/564: dwrite d1c/d1d/d22/f70 [0,4194304] 0 2024-09-11T00:07:21.189 INFO:tasks.workunit.client.1.smithi203.stdout:9/569: creat d6/de/d19/d21/d87/fbb x:0 0 0 2024-09-11T00:07:21.191 INFO:tasks.workunit.client.0.smithi111.stdout:0/608: mknod d3/d26/ce1 0 2024-09-11T00:07:21.191 INFO:tasks.workunit.client.1.smithi203.stdout:1/610: write d8/d19/d60/d90/f5e [4218442,36848] 0 2024-09-11T00:07:21.198 INFO:tasks.workunit.client.1.smithi203.stdout:8/534: symlink d1/d13/d17/d2f/lb4 0 2024-09-11T00:07:21.202 INFO:tasks.workunit.client.1.smithi203.stdout:2/578: rename d13/d15/d19/d1c/d76/lb6 to d13/d15/d30/d5a/lbb 0 2024-09-11T00:07:21.203 INFO:tasks.workunit.client.0.smithi111.stdout:6/506: getdents d7/d22/d1d/d8c 0 2024-09-11T00:07:21.205 INFO:tasks.workunit.client.0.smithi111.stdout:6/507: chown d7/d22/d3f/d74/d7f/ca7 4567 1 2024-09-11T00:07:21.206 INFO:tasks.workunit.client.1.smithi203.stdout:6/528: creat d0/d5b/fa3 x:0 0 0 2024-09-11T00:07:21.207 INFO:tasks.workunit.client.0.smithi111.stdout:9/603: symlink d6/db/d34/d37/d4c/d7f/lc3 0 2024-09-11T00:07:21.207 INFO:tasks.workunit.client.1.smithi203.stdout:4/483: rmdir db/d12 39 2024-09-11T00:07:21.210 INFO:tasks.workunit.client.1.smithi203.stdout:6/529: write d0/d54/d9c/d35/d38/d73/d74/f80 [894441,83614] 0 2024-09-11T00:07:21.212 INFO:tasks.workunit.client.0.smithi111.stdout:8/594: symlink d11/d23/d7e/d93/dba/lbb 0 2024-09-11T00:07:21.212 INFO:tasks.workunit.client.1.smithi203.stdout:7/564: truncate dd/d4d/f73 516077 0 2024-09-11T00:07:21.215 INFO:tasks.workunit.client.1.smithi203.stdout:7/565: chown dd/d1c/f20 0 1 2024-09-11T00:07:21.218 INFO:tasks.workunit.client.1.smithi203.stdout:2/579: readlink d13/l34 0 2024-09-11T00:07:21.219 INFO:tasks.workunit.client.0.smithi111.stdout:4/542: dwrite d18/d20/d40/f42 [0,4194304] 0 2024-09-11T00:07:21.221 INFO:tasks.workunit.client.0.smithi111.stdout:7/558: creat dd/d48/fae x:0 0 0 2024-09-11T00:07:21.221 INFO:tasks.workunit.client.1.smithi203.stdout:9/570: dread d6/de/d32/d52/d55/f3f [0,4194304] 0 2024-09-11T00:07:21.221 INFO:tasks.workunit.client.0.smithi111.stdout:1/543: write d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/d7b/d87/f94 [1383396,98426] 0 2024-09-11T00:07:21.226 INFO:tasks.workunit.client.0.smithi111.stdout:5/594: creat d10/d1e/d23/d30/d3c/d60/da2/d66/fbe x:0 0 0 2024-09-11T00:07:21.226 INFO:tasks.workunit.client.0.smithi111.stdout:1/544: fsync d2/de/d12/d3c/f69 0 2024-09-11T00:07:21.226 INFO:tasks.workunit.client.0.smithi111.stdout:6/508: rmdir d7/d22/d26/d95 39 2024-09-11T00:07:21.226 INFO:tasks.workunit.client.1.smithi203.stdout:9/571: write d6/de/d19/d30/f77 [1500335,124649] 0 2024-09-11T00:07:21.228 INFO:tasks.workunit.client.1.smithi203.stdout:2/580: symlink d13/d15/d90/lbc 0 2024-09-11T00:07:21.229 INFO:tasks.workunit.client.1.smithi203.stdout:4/484: dread db/dd/d16/f55 [0,4194304] 0 2024-09-11T00:07:21.232 INFO:tasks.workunit.client.1.smithi203.stdout:8/535: creat d1/d13/fb5 x:0 0 0 2024-09-11T00:07:21.233 INFO:tasks.workunit.client.0.smithi111.stdout:3/565: getdents d1c/d21/db4 0 2024-09-11T00:07:21.239 INFO:tasks.workunit.client.1.smithi203.stdout:6/530: dwrite d0/d5b/d5c/f69 [0,4194304] 0 2024-09-11T00:07:21.243 INFO:tasks.workunit.client.1.smithi203.stdout:7/566: dwrite dd/d3b/d9f/fb3 [0,4194304] 0 2024-09-11T00:07:21.244 INFO:tasks.workunit.client.1.smithi203.stdout:6/531: write d0/d54/d9c/d7b/d7e/f8d [1326743,35822] 0 2024-09-11T00:07:21.245 INFO:tasks.workunit.client.1.smithi203.stdout:9/572: symlink d6/de/d32/d52/d55/d66/lbc 0 2024-09-11T00:07:21.247 INFO:tasks.workunit.client.1.smithi203.stdout:6/532: chown d0/d54/d9c/c22 495751919 1 2024-09-11T00:07:21.247 INFO:tasks.workunit.client.0.smithi111.stdout:1/545: stat d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/f61 0 2024-09-11T00:07:21.251 INFO:tasks.workunit.client.1.smithi203.stdout:6/533: write d0/d54/d9c/d35/d38/d73/d74/f80 [458748,37784] 0 2024-09-11T00:07:21.253 INFO:tasks.workunit.client.1.smithi203.stdout:1/611: write d8/d19/d60/d90/d3e/d4b/d41/f70 [94383,11515] 0 2024-09-11T00:07:21.253 INFO:tasks.workunit.client.1.smithi203.stdout:6/534: chown d0/d5b/d5c/d6f 1 1 2024-09-11T00:07:21.254 INFO:tasks.workunit.client.0.smithi111.stdout:9/604: creat d6/db/db8/fc4 x:0 0 0 2024-09-11T00:07:21.259 INFO:tasks.workunit.client.0.smithi111.stdout:5/595: dwrite d10/d1e/d25/f4a [4194304,4194304] 0 2024-09-11T00:07:21.259 INFO:tasks.workunit.client.0.smithi111.stdout:4/543: dwrite d18/d20/d4a/f2f [4194304,4194304] 0 2024-09-11T00:07:21.261 INFO:tasks.workunit.client.1.smithi203.stdout:6/535: truncate d0/d54/d9c/d35/d38/d73/d74/f80 1458124 0 2024-09-11T00:07:21.263 INFO:tasks.workunit.client.1.smithi203.stdout:4/485: write db/dd/d16/f7b [202954,26439] 0 2024-09-11T00:07:21.265 INFO:tasks.workunit.client.1.smithi203.stdout:7/567: creat dd/d1c/d52/d8f/d31/d67/dc3/fd1 x:0 0 0 2024-09-11T00:07:21.271 INFO:tasks.workunit.client.1.smithi203.stdout:1/612: creat d8/d19/d60/d90/d3e/fdb x:0 0 0 2024-09-11T00:07:21.274 INFO:tasks.workunit.client.0.smithi111.stdout:5/596: symlink d10/d1e/d23/d30/d59/d52/lbf 0 2024-09-11T00:07:21.276 INFO:tasks.workunit.client.0.smithi111.stdout:9/605: write d6/dc/f6f [1158945,80786] 0 2024-09-11T00:07:21.278 INFO:tasks.workunit.client.0.smithi111.stdout:6/509: symlink d7/d22/d3f/d74/d7f/d61/lb0 0 2024-09-11T00:07:21.281 INFO:tasks.workunit.client.0.smithi111.stdout:5/597: stat d10/l11 0 2024-09-11T00:07:21.282 INFO:tasks.workunit.client.0.smithi111.stdout:0/609: dread d3/fd [0,4194304] 0 2024-09-11T00:07:21.289 INFO:tasks.workunit.client.1.smithi203.stdout:7/568: creat dd/d1c/d52/d8f/fd2 x:0 0 0 2024-09-11T00:07:21.290 INFO:tasks.workunit.client.1.smithi203.stdout:2/581: rename d13/d15/d30/f39 to d13/d22/fbd 0 2024-09-11T00:07:21.290 INFO:tasks.workunit.client.1.smithi203.stdout:8/536: write d1/d13/d17/f39 [6309,70486] 0 2024-09-11T00:07:21.293 INFO:tasks.workunit.client.0.smithi111.stdout:7/559: dwrite dd/d1d/d1f/f23 [0,4194304] 0 2024-09-11T00:07:21.294 INFO:tasks.workunit.client.1.smithi203.stdout:9/573: creat d6/de/fbd x:0 0 0 2024-09-11T00:07:21.296 INFO:tasks.workunit.client.1.smithi203.stdout:7/569: stat dd/d1c/d52/d8f/d31/d58/f64 0 2024-09-11T00:07:21.299 INFO:tasks.workunit.client.1.smithi203.stdout:8/537: creat d1/d13/d17/d48/d9d/fb6 x:0 0 0 2024-09-11T00:07:21.300 INFO:tasks.workunit.client.0.smithi111.stdout:8/595: dwrite d11/d23/d2c/d46/d64/f88 [0,4194304] 0 2024-09-11T00:07:21.301 INFO:tasks.workunit.client.0.smithi111.stdout:2/550: sync 2024-09-11T00:07:21.302 INFO:tasks.workunit.client.0.smithi111.stdout:0/610: creat d3/da/d7b/d84/fe2 x:0 0 0 2024-09-11T00:07:21.303 INFO:tasks.workunit.client.1.smithi203.stdout:6/536: link d0/cf d0/d54/d9c/d7b/d7e/ca4 0 2024-09-11T00:07:21.303 INFO:tasks.workunit.client.1.smithi203.stdout:7/570: stat dd/d1c/d52/d8f/fd2 0 2024-09-11T00:07:21.305 INFO:tasks.workunit.client.0.smithi111.stdout:5/598: read f2 [4225666,68826] 0 2024-09-11T00:07:21.305 INFO:tasks.workunit.client.1.smithi203.stdout:2/582: rmdir d13/d22/d53/d9e 0 2024-09-11T00:07:21.308 INFO:tasks.workunit.client.1.smithi203.stdout:9/574: mknod d6/de/d19/d24/d6c/da8/cbe 0 2024-09-11T00:07:21.309 INFO:tasks.workunit.client.1.smithi203.stdout:8/538: read d1/d13/d3a/d4c/f5c [4182990,113758] 0 2024-09-11T00:07:21.312 INFO:tasks.workunit.client.0.smithi111.stdout:0/611: readlink d3/d1c/dd0/ld9 0 2024-09-11T00:07:21.314 INFO:tasks.workunit.client.1.smithi203.stdout:6/537: stat d0/c50 0 2024-09-11T00:07:21.317 INFO:tasks.workunit.client.1.smithi203.stdout:4/486: dwrite db/d12/d15/d2a/f8f [0,4194304] 0 2024-09-11T00:07:21.318 INFO:tasks.workunit.client.0.smithi111.stdout:1/546: write d2/de/d12/d3c/d4b/d6a/f65 [645044,123033] 0 2024-09-11T00:07:21.320 INFO:tasks.workunit.client.1.smithi203.stdout:7/571: truncate dd/d4d/f90 842872 0 2024-09-11T00:07:21.322 INFO:tasks.workunit.client.0.smithi111.stdout:8/596: chown d11/d23/d2c/caf 189584684 1 2024-09-11T00:07:21.323 INFO:tasks.workunit.client.1.smithi203.stdout:6/538: mknod d0/d54/ca5 0 2024-09-11T00:07:21.325 INFO:tasks.workunit.client.0.smithi111.stdout:3/566: dwrite d1c/d1d/d22/d23/f91 [0,4194304] 0 2024-09-11T00:07:21.332 INFO:tasks.workunit.client.0.smithi111.stdout:8/597: fdatasync f8 0 2024-09-11T00:07:21.334 INFO:tasks.workunit.client.0.smithi111.stdout:5/599: write d10/d1e/d23/d2b/d92/fbc [586230,75125] 0 2024-09-11T00:07:21.334 INFO:tasks.workunit.client.0.smithi111.stdout:7/560: link dd/f10 dd/d1d/d4b/d8f/dac/faf 0 2024-09-11T00:07:21.337 INFO:tasks.workunit.client.0.smithi111.stdout:6/510: dwrite d7/d22/d1d/d83/fa9 [0,4194304] 0 2024-09-11T00:07:21.338 INFO:tasks.workunit.client.1.smithi203.stdout:4/487: mkdir db/d12/d15/d2a/d9b 0 2024-09-11T00:07:21.341 INFO:tasks.workunit.client.1.smithi203.stdout:4/488: chown db/f8a 1515164674 1 2024-09-11T00:07:21.345 INFO:tasks.workunit.client.1.smithi203.stdout:2/583: dwrite d13/d15/d30/fa9 [0,4194304] 0 2024-09-11T00:07:21.345 INFO:tasks.workunit.client.0.smithi111.stdout:8/598: write d11/d21/d38/f52 [113384,43556] 0 2024-09-11T00:07:21.346 INFO:tasks.workunit.client.1.smithi203.stdout:4/489: write db/d12/d15/d2a/f8f [3963996,76795] 0 2024-09-11T00:07:21.346 INFO:tasks.workunit.client.1.smithi203.stdout:8/539: dwrite d1/f3b [0,4194304] 0 2024-09-11T00:07:21.348 INFO:tasks.workunit.client.0.smithi111.stdout:9/606: dwrite d6/dc/f1f [0,4194304] 0 2024-09-11T00:07:21.352 INFO:tasks.workunit.client.0.smithi111.stdout:0/612: mknod d3/d13/d1e/d29/d49/d51/d61/d93/ce3 0 2024-09-11T00:07:21.354 INFO:tasks.workunit.client.0.smithi111.stdout:5/600: truncate d10/d1e/d23/d2b/d92/fbc 1289836 0 2024-09-11T00:07:21.356 INFO:tasks.workunit.client.0.smithi111.stdout:7/561: symlink dd/d1d/d1f/d24/lb0 0 2024-09-11T00:07:21.358 INFO:tasks.workunit.client.0.smithi111.stdout:4/544: dwrite d18/d1f/f5f [0,4194304] 0 2024-09-11T00:07:21.360 INFO:tasks.workunit.client.0.smithi111.stdout:7/562: fdatasync dd/d49/f99 0 2024-09-11T00:07:21.363 INFO:tasks.workunit.client.1.smithi203.stdout:9/575: rename d6/de/d19/d24/d40/c71 to d6/de/d32/cbf 0 2024-09-11T00:07:21.366 INFO:tasks.workunit.client.0.smithi111.stdout:7/563: write dd/f1c [3540228,123598] 0 2024-09-11T00:07:21.368 INFO:tasks.workunit.client.0.smithi111.stdout:7/564: chown dd/d1d/d4b/d8f/d9f 1634484438 1 2024-09-11T00:07:21.379 INFO:tasks.workunit.client.1.smithi203.stdout:7/572: write dd/d1c/d52/d8f/d31/d67/dc3/fc6 [970156,122522] 0 2024-09-11T00:07:21.379 INFO:tasks.workunit.client.0.smithi111.stdout:0/613: creat d3/d1c/dd0/fe4 x:0 0 0 2024-09-11T00:07:21.380 INFO:tasks.workunit.client.1.smithi203.stdout:4/490: read db/dd/d16/f7b [153611,46157] 0 2024-09-11T00:07:21.380 INFO:tasks.workunit.client.1.smithi203.stdout:6/539: creat d0/d5b/d9f/fa6 x:0 0 0 2024-09-11T00:07:21.384 INFO:tasks.workunit.client.0.smithi111.stdout:9/607: dwrite d6/db/d1b/f1e [0,4194304] 0 2024-09-11T00:07:21.387 INFO:tasks.workunit.client.0.smithi111.stdout:4/545: symlink d18/d20/d3c/d5e/la6 0 2024-09-11T00:07:21.391 INFO:tasks.workunit.client.1.smithi203.stdout:7/573: readlink dd/d1c/d52/d8f/l48 0 2024-09-11T00:07:21.391 INFO:tasks.workunit.client.1.smithi203.stdout:2/584: dwrite d13/d15/d19/d1c/d73/f81 [0,4194304] 0 2024-09-11T00:07:21.392 INFO:tasks.workunit.client.0.smithi111.stdout:9/608: write d6/db/f49 [1174943,128159] 0 2024-09-11T00:07:21.392 INFO:tasks.workunit.client.0.smithi111.stdout:4/546: write d18/d20/d4a/f3f [1867908,41838] 0 2024-09-11T00:07:21.393 INFO:tasks.workunit.client.0.smithi111.stdout:7/565: mknod dd/d1d/d76/cb1 0 2024-09-11T00:07:21.394 INFO:tasks.workunit.client.0.smithi111.stdout:8/599: symlink d11/d21/d38/d54/lbc 0 2024-09-11T00:07:21.400 INFO:tasks.workunit.client.1.smithi203.stdout:2/585: stat d13/d22/d53/l83 0 2024-09-11T00:07:21.404 INFO:tasks.workunit.client.0.smithi111.stdout:0/614: creat d3/d13/d1e/d29/d49/d51/d61/d93/fe5 x:0 0 0 2024-09-11T00:07:21.405 INFO:tasks.workunit.client.1.smithi203.stdout:2/586: fdatasync d13/d22/d53/fab 0 2024-09-11T00:07:21.409 INFO:tasks.workunit.client.1.smithi203.stdout:1/613: dwrite d8/d19/d60/d90/d3e/f8c [0,4194304] 0 2024-09-11T00:07:21.410 INFO:tasks.workunit.client.0.smithi111.stdout:9/609: mkdir d6/d52/d8a/d92/dc5 0 2024-09-11T00:07:21.412 INFO:tasks.workunit.client.0.smithi111.stdout:9/610: truncate d6/db/f49 4743617 0 2024-09-11T00:07:21.416 INFO:tasks.workunit.client.0.smithi111.stdout:7/566: unlink dd/d1d/d1f/f47 0 2024-09-11T00:07:21.417 INFO:tasks.workunit.client.0.smithi111.stdout:7/567: chown f8 22 1 2024-09-11T00:07:21.418 INFO:tasks.workunit.client.0.smithi111.stdout:6/511: link d7/fd d7/d22/d3f/d74/d7f/d61/d6a/d9f/fb1 0 2024-09-11T00:07:21.429 INFO:tasks.workunit.client.1.smithi203.stdout:4/491: dwrite db/dd/d26/d42/f45 [0,4194304] 0 2024-09-11T00:07:21.431 INFO:tasks.workunit.client.0.smithi111.stdout:1/547: write d2/de/d12/d3c/d4b/d6a/d63/f6e [353294,48953] 0 2024-09-11T00:07:21.436 INFO:tasks.workunit.client.0.smithi111.stdout:9/611: symlink d6/dc/d7c/lc6 0 2024-09-11T00:07:21.441 INFO:tasks.workunit.client.0.smithi111.stdout:7/568: creat dd/d1d/d4b/d8f/fb2 x:0 0 0 2024-09-11T00:07:21.442 INFO:tasks.workunit.client.0.smithi111.stdout:6/512: fsync d7/d22/d3f/d74/f96 0 2024-09-11T00:07:21.445 INFO:tasks.workunit.client.0.smithi111.stdout:6/513: truncate d7/d22/d1d/d83/fa1 11433 0 2024-09-11T00:07:21.446 INFO:tasks.workunit.client.1.smithi203.stdout:7/574: dwrite dd/f22 [0,4194304] 0 2024-09-11T00:07:21.446 INFO:tasks.workunit.client.0.smithi111.stdout:6/514: stat d7/la 0 2024-09-11T00:07:21.448 INFO:tasks.workunit.client.0.smithi111.stdout:7/569: creat dd/d1d/d4d/fb3 x:0 0 0 2024-09-11T00:07:21.449 INFO:tasks.workunit.client.1.smithi203.stdout:1/614: dwrite d8/d9/d15/fc1 [0,4194304] 0 2024-09-11T00:07:21.452 INFO:tasks.workunit.client.0.smithi111.stdout:6/515: fsync d7/d22/d26/d87/d41/f66 0 2024-09-11T00:07:21.454 INFO:tasks.workunit.client.0.smithi111.stdout:6/516: dread - d7/f5e zero size 2024-09-11T00:07:21.455 INFO:tasks.workunit.client.0.smithi111.stdout:7/570: symlink dd/d1d/d2d/d2e/lb4 0 2024-09-11T00:07:21.463 INFO:tasks.workunit.client.1.smithi203.stdout:9/576: truncate d6/de/d32/d52/d55/f3f 421858 0 2024-09-11T00:07:21.464 INFO:tasks.workunit.client.0.smithi111.stdout:1/548: dread d2/de/d82/f86 [0,4194304] 0 2024-09-11T00:07:21.465 INFO:tasks.workunit.client.1.smithi203.stdout:2/587: unlink d13/d95/fa1 0 2024-09-11T00:07:21.469 INFO:tasks.workunit.client.1.smithi203.stdout:4/492: truncate db/f57 4039961 0 2024-09-11T00:07:21.469 INFO:tasks.workunit.client.0.smithi111.stdout:2/551: sync 2024-09-11T00:07:21.470 INFO:tasks.workunit.client.1.smithi203.stdout:4/493: readlink db/dd/d16/d38/d3c/l67 0 2024-09-11T00:07:21.472 INFO:tasks.workunit.client.0.smithi111.stdout:1/549: write d2/de/d12/d3c/d4b/d6a/d63/fb7 [886556,64809] 0 2024-09-11T00:07:21.473 INFO:tasks.workunit.client.1.smithi203.stdout:7/575: write dd/d1c/d52/d8f/d31/d58/d93/d98/faf [4754844,87517] 0 2024-09-11T00:07:21.477 INFO:tasks.workunit.client.1.smithi203.stdout:8/540: rename d1/d13/d43/f57 to d1/d13/d17/d2f/fb7 0 2024-09-11T00:07:21.480 INFO:tasks.workunit.client.0.smithi111.stdout:6/517: dwrite d7/d22/d1d/d83/fa1 [0,4194304] 0 2024-09-11T00:07:21.481 INFO:tasks.workunit.client.0.smithi111.stdout:2/552: creat d0/d3/de/d3b/fbf x:0 0 0 2024-09-11T00:07:21.483 INFO:tasks.workunit.client.1.smithi203.stdout:9/577: mkdir d6/de/d19/d21/d87/dc0 0 2024-09-11T00:07:21.484 INFO:tasks.workunit.client.0.smithi111.stdout:6/518: dread - d7/d22/d3f/d74/f9e zero size 2024-09-11T00:07:21.490 INFO:tasks.workunit.client.1.smithi203.stdout:2/588: symlink d13/d15/d30/d5a/d8b/lbe 0 2024-09-11T00:07:21.490 INFO:tasks.workunit.client.0.smithi111.stdout:0/615: write d3/d13/d1e/d29/d49/d51/f59 [4453200,85412] 0 2024-09-11T00:07:21.494 INFO:tasks.workunit.client.1.smithi203.stdout:1/615: dwrite d8/d19/d60/d90/d3e/d4b/d80/d91/dac/fc8 [0,4194304] 0 2024-09-11T00:07:21.495 INFO:tasks.workunit.client.1.smithi203.stdout:7/576: truncate dd/d1c/f35 1364822 0 2024-09-11T00:07:21.498 INFO:tasks.workunit.client.0.smithi111.stdout:6/519: creat d7/d22/d3f/d74/d7f/d79/fb2 x:0 0 0 2024-09-11T00:07:21.499 INFO:tasks.workunit.client.1.smithi203.stdout:7/577: write dd/d1c/f8a [4714032,18461] 0 2024-09-11T00:07:21.510 INFO:tasks.workunit.client.0.smithi111.stdout:6/520: mkdir d7/d22/d2c/d38/d39/db3 0 2024-09-11T00:07:21.510 INFO:tasks.workunit.client.0.smithi111.stdout:1/550: dread d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/f71 [0,4194304] 0 2024-09-11T00:07:21.510 INFO:tasks.workunit.client.0.smithi111.stdout:0/616: unlink d3/d13/d1e/d29/d49/d51/d61/f6b 0 2024-09-11T00:07:21.511 INFO:tasks.workunit.client.1.smithi203.stdout:2/589: symlink d13/d56/d69/d99/lbf 0 2024-09-11T00:07:21.512 INFO:tasks.workunit.client.0.smithi111.stdout:6/521: chown d7/d22/d3f/d74/d7f/d61 1 1 2024-09-11T00:07:21.514 INFO:tasks.workunit.client.1.smithi203.stdout:1/616: creat d8/d9/d15/d35/d81/da1/fdc x:0 0 0 2024-09-11T00:07:21.514 INFO:tasks.workunit.client.1.smithi203.stdout:2/590: truncate d13/d56/d69/f6d 188591 0 2024-09-11T00:07:21.515 INFO:tasks.workunit.client.0.smithi111.stdout:6/522: read d7/d22/d26/d87/d41/f66 [711149,12408] 0 2024-09-11T00:07:21.515 INFO:tasks.workunit.client.1.smithi203.stdout:7/578: creat dd/d1c/d52/d8f/d31/d67/dc8/fd3 x:0 0 0 2024-09-11T00:07:21.516 INFO:tasks.workunit.client.0.smithi111.stdout:6/523: stat d7/d2b/fae 0 2024-09-11T00:07:21.517 INFO:tasks.workunit.client.1.smithi203.stdout:1/617: truncate d8/faf 4648689 0 2024-09-11T00:07:21.517 INFO:tasks.workunit.client.1.smithi203.stdout:9/578: symlink d6/de/d32/d52/lc1 0 2024-09-11T00:07:21.519 INFO:tasks.workunit.client.1.smithi203.stdout:8/541: dwrite d1/d13/d17/d2f/f84 [0,4194304] 0 2024-09-11T00:07:21.519 INFO:tasks.workunit.client.0.smithi111.stdout:9/612: truncate d6/db/d1b/f1e 342661 0 2024-09-11T00:07:21.522 INFO:tasks.workunit.client.1.smithi203.stdout:8/542: write d1/d13/d43/fa5 [907137,87579] 0 2024-09-11T00:07:21.524 INFO:tasks.workunit.client.0.smithi111.stdout:0/617: mkdir d3/d13/d1e/d29/db0/dce/ddb/de6 0 2024-09-11T00:07:21.524 INFO:tasks.workunit.client.1.smithi203.stdout:2/591: creat d13/d15/d30/fc0 x:0 0 0 2024-09-11T00:07:21.527 INFO:tasks.workunit.client.1.smithi203.stdout:1/618: creat d8/d19/d60/d90/d3e/d4b/db2/fdd x:0 0 0 2024-09-11T00:07:21.528 INFO:tasks.workunit.client.0.smithi111.stdout:6/524: mkdir d7/d22/d1d/d69/db4 0 2024-09-11T00:07:21.528 INFO:tasks.workunit.client.1.smithi203.stdout:2/592: fsync d13/d15/d19/d1c/d76/fb3 0 2024-09-11T00:07:21.529 INFO:tasks.workunit.client.0.smithi111.stdout:1/551: getdents d2/de/d12/d3c/d4b/d6a/d63/d73/db8 0 2024-09-11T00:07:21.530 INFO:tasks.workunit.client.0.smithi111.stdout:1/552: chown d2/d77 127 1 2024-09-11T00:07:21.532 INFO:tasks.workunit.client.0.smithi111.stdout:1/553: readlink d2/de/d12/d3c/d4b/d6a/d63/la6 0 2024-09-11T00:07:21.532 INFO:tasks.workunit.client.1.smithi203.stdout:4/494: getdents db/d12/d15/d2a/d71 0 2024-09-11T00:07:21.534 INFO:tasks.workunit.client.0.smithi111.stdout:0/618: fsync d3/d13/d1e/d29/db0/dce/fdc 0 2024-09-11T00:07:21.541 INFO:tasks.workunit.client.0.smithi111.stdout:0/619: chown d3/d1c/fad 83813 1 2024-09-11T00:07:21.541 INFO:tasks.workunit.client.0.smithi111.stdout:9/613: symlink d6/db/d34/lc7 0 2024-09-11T00:07:21.541 INFO:tasks.workunit.client.1.smithi203.stdout:2/593: rmdir d13/d47 39 2024-09-11T00:07:21.543 INFO:tasks.workunit.client.0.smithi111.stdout:9/614: chown d6/db/d34/d37/d4c/d7f 243684 1 2024-09-11T00:07:21.546 INFO:tasks.workunit.client.0.smithi111.stdout:0/620: rename d3/d26/f81 to d3/da/d7b/db3/fe7 0 2024-09-11T00:07:21.546 INFO:tasks.workunit.client.0.smithi111.stdout:6/525: dwrite d7/d22/d1d/d83/fa9 [4194304,4194304] 0 2024-09-11T00:07:21.547 INFO:tasks.workunit.client.0.smithi111.stdout:1/554: dread d2/de/d12/d3c/d4b/d6a/d3a/f6b [0,4194304] 0 2024-09-11T00:07:21.550 INFO:tasks.workunit.client.0.smithi111.stdout:7/571: dwrite dd/d1d/f66 [0,4194304] 0 2024-09-11T00:07:21.551 INFO:tasks.workunit.client.0.smithi111.stdout:7/572: dread - dd/d49/fa5 zero size 2024-09-11T00:07:21.552 INFO:tasks.workunit.client.1.smithi203.stdout:9/579: rename d6/de/d32/d52/d55/d66/caf to d6/de/d19/d24/d6c/da8/cc2 0 2024-09-11T00:07:21.555 INFO:tasks.workunit.client.1.smithi203.stdout:2/594: mknod d13/d56/d69/cc1 0 2024-09-11T00:07:21.559 INFO:tasks.workunit.client.0.smithi111.stdout:2/553: dread - d0/d3/de/d3b/fbf zero size 2024-09-11T00:07:21.561 INFO:tasks.workunit.client.0.smithi111.stdout:5/601: sync 2024-09-11T00:07:21.561 INFO:tasks.workunit.client.0.smithi111.stdout:3/567: sync 2024-09-11T00:07:21.561 INFO:tasks.workunit.client.0.smithi111.stdout:4/547: sync 2024-09-11T00:07:21.562 INFO:tasks.workunit.client.1.smithi203.stdout:2/595: write d13/d15/f29 [1672915,60637] 0 2024-09-11T00:07:21.565 INFO:tasks.workunit.client.1.smithi203.stdout:6/540: truncate d0/d54/d9c/d35/d38/d73/d74/f80 1213401 0 2024-09-11T00:07:21.567 INFO:tasks.workunit.client.0.smithi111.stdout:4/548: truncate d18/d20/d4a/f64 5064794 0 2024-09-11T00:07:21.568 INFO:tasks.workunit.client.0.smithi111.stdout:0/621: dwrite f1 [0,4194304] 0 2024-09-11T00:07:21.569 INFO:tasks.workunit.client.1.smithi203.stdout:9/580: mkdir d6/de/d47/dc3 0 2024-09-11T00:07:21.573 INFO:tasks.workunit.client.1.smithi203.stdout:8/543: link d1/d13/d22/c3c d1/d13/d3a/da4/cb8 0 2024-09-11T00:07:21.575 INFO:tasks.workunit.client.0.smithi111.stdout:6/526: symlink d7/d22/d26/d87/d7a/lb5 0 2024-09-11T00:07:21.578 INFO:tasks.workunit.client.1.smithi203.stdout:2/596: rmdir d13/d15/d90 39 2024-09-11T00:07:21.585 INFO:tasks.workunit.client.1.smithi203.stdout:6/541: rename d0/d54/d9c/d7b/d7e/f8d to d0/d54/d9c/d35/d38/d73/d74/fa7 0 2024-09-11T00:07:21.586 INFO:tasks.workunit.client.0.smithi111.stdout:1/555: mkdir d2/de/d12/d6c/dbd 0 2024-09-11T00:07:21.590 INFO:tasks.workunit.client.0.smithi111.stdout:0/622: unlink d3/d13/d1e/d29/f3e 0 2024-09-11T00:07:21.591 INFO:tasks.workunit.client.0.smithi111.stdout:8/600: sync 2024-09-11T00:07:21.595 INFO:tasks.workunit.client.0.smithi111.stdout:1/556: dread d2/de/d93/d9f/f1a [0,4194304] 0 2024-09-11T00:07:21.597 INFO:tasks.workunit.client.1.smithi203.stdout:9/581: truncate d6/de/d19/d24/d40/fb9 1486245 0 2024-09-11T00:07:21.598 INFO:tasks.workunit.client.0.smithi111.stdout:6/527: mkdir d7/d22/d3f/d74/d7f/d61/d6a/d9f/db6 0 2024-09-11T00:07:21.602 INFO:tasks.workunit.client.1.smithi203.stdout:1/619: dwrite d8/d9/f63 [4194304,4194304] 0 2024-09-11T00:07:21.605 INFO:tasks.workunit.client.1.smithi203.stdout:2/597: mknod d13/d15/d90/cc2 0 2024-09-11T00:07:21.606 INFO:tasks.workunit.client.1.smithi203.stdout:1/620: chown d8/d19/d31/d36 9639 1 2024-09-11T00:07:21.607 INFO:tasks.workunit.client.1.smithi203.stdout:8/544: dread d1/d13/d43/d46/f6d [0,4194304] 0 2024-09-11T00:07:21.611 INFO:tasks.workunit.client.0.smithi111.stdout:6/528: dwrite d7/d22/d1d/d83/fa1 [4194304,4194304] 0 2024-09-11T00:07:21.613 INFO:tasks.workunit.client.0.smithi111.stdout:3/568: link d1c/d1d/d22/d31/d33/d5f/fb2 d1c/d1d/d22/d31/d33/d5f/d98/fc3 0 2024-09-11T00:07:21.615 INFO:tasks.workunit.client.0.smithi111.stdout:3/569: write d1c/d21/f7d [1729444,20072] 0 2024-09-11T00:07:21.626 INFO:tasks.workunit.client.0.smithi111.stdout:8/601: mkdir d11/d23/d2c/d53/dbd 0 2024-09-11T00:07:21.627 INFO:tasks.workunit.client.1.smithi203.stdout:8/545: mknod d1/d13/d22/cb9 0 2024-09-11T00:07:21.628 INFO:tasks.workunit.client.1.smithi203.stdout:8/546: fdatasync d1/d13/fb5 0 2024-09-11T00:07:21.629 INFO:tasks.workunit.client.0.smithi111.stdout:8/602: write d11/d23/f65 [4916114,72320] 0 2024-09-11T00:07:21.630 INFO:tasks.workunit.client.1.smithi203.stdout:4/495: dwrite db/d12/d15/d2a/d71/f94 [0,4194304] 0 2024-09-11T00:07:21.631 INFO:tasks.workunit.client.1.smithi203.stdout:6/542: dwrite d0/d54/d9c/d7b/f8a [0,4194304] 0 2024-09-11T00:07:21.632 INFO:tasks.workunit.client.1.smithi203.stdout:4/496: stat db/d12/d15/d2a/d71 0 2024-09-11T00:07:21.635 INFO:tasks.workunit.client.0.smithi111.stdout:2/554: creat d0/d3/fc0 x:0 0 0 2024-09-11T00:07:21.636 INFO:tasks.workunit.client.0.smithi111.stdout:9/615: getdents d6/d52/d8a/d92 0 2024-09-11T00:07:21.637 INFO:tasks.workunit.client.1.smithi203.stdout:4/497: readlink db/dd/d26/d42/l61 0 2024-09-11T00:07:21.638 INFO:tasks.workunit.client.1.smithi203.stdout:6/543: stat d0/d54/d9c/d35/d39/l45 0 2024-09-11T00:07:21.640 INFO:tasks.workunit.client.0.smithi111.stdout:5/602: rename d10/d1e/d23/d30/d59/c71 to d10/d1e/d25/cc0 0 2024-09-11T00:07:21.642 INFO:tasks.workunit.client.0.smithi111.stdout:7/573: getdents dd/d1d/d1f/d24 0 2024-09-11T00:07:21.642 INFO:tasks.workunit.client.0.smithi111.stdout:5/603: stat d10/d1e/d23/d30/d59/d52 0 2024-09-11T00:07:21.643 INFO:tasks.workunit.client.0.smithi111.stdout:1/557: unlink d2/de/d12/d3c/d4b/d6a/d63/d73/c8a 0 2024-09-11T00:07:21.644 INFO:tasks.workunit.client.0.smithi111.stdout:8/603: rmdir d11/d21/d38/d54 39 2024-09-11T00:07:21.646 INFO:tasks.workunit.client.1.smithi203.stdout:4/498: rename db/d12/d15/c86 to db/dd/d26/d42/c9c 0 2024-09-11T00:07:21.647 INFO:tasks.workunit.client.0.smithi111.stdout:5/604: read d10/d1e/d23/d2b/d92/fbc [649097,91378] 0 2024-09-11T00:07:21.650 INFO:tasks.workunit.client.0.smithi111.stdout:6/529: mknod d7/d22/d1d/d69/db4/cb7 0 2024-09-11T00:07:21.653 INFO:tasks.workunit.client.1.smithi203.stdout:6/544: link d0/d54/d9c/d35/d38/f84 d0/d5b/d5c/fa8 0 2024-09-11T00:07:21.654 INFO:tasks.workunit.client.0.smithi111.stdout:0/623: dread d3/dc/f3f [0,4194304] 0 2024-09-11T00:07:21.656 INFO:tasks.workunit.client.1.smithi203.stdout:8/547: dread d1/d13/d17/f42 [0,4194304] 0 2024-09-11T00:07:21.662 INFO:tasks.workunit.client.0.smithi111.stdout:2/555: dwrite d0/d3/de/d3b/fbf [0,4194304] 0 2024-09-11T00:07:21.667 INFO:tasks.workunit.client.0.smithi111.stdout:4/549: truncate d18/d1f/f8b 4197522 0 2024-09-11T00:07:21.669 INFO:tasks.workunit.client.1.smithi203.stdout:2/598: dread d13/d15/f1f [0,4194304] 0 2024-09-11T00:07:21.670 INFO:tasks.workunit.client.1.smithi203.stdout:8/548: mkdir d1/d13/d17/d2f/d52/d49/d68/dba 0 2024-09-11T00:07:21.671 INFO:tasks.workunit.client.1.smithi203.stdout:9/582: dwrite d6/de/d32/d52/d55/d66/fb1 [0,4194304] 0 2024-09-11T00:07:21.673 INFO:tasks.workunit.client.0.smithi111.stdout:8/604: creat d11/d21/d6f/dab/fbe x:0 0 0 2024-09-11T00:07:21.674 INFO:tasks.workunit.client.1.smithi203.stdout:1/621: dwrite d8/d19/d31/f59 [0,4194304] 0 2024-09-11T00:07:21.675 INFO:tasks.workunit.client.0.smithi111.stdout:5/605: symlink d10/d1e/d23/d30/d3c/lc1 0 2024-09-11T00:07:21.675 INFO:tasks.workunit.client.1.smithi203.stdout:8/549: dread - d1/d13/d17/d8b/f9c zero size 2024-09-11T00:07:21.677 INFO:tasks.workunit.client.1.smithi203.stdout:2/599: write d13/d15/d30/fc0 [241297,41227] 0 2024-09-11T00:07:21.683 INFO:tasks.workunit.client.1.smithi203.stdout:6/545: fsync d0/f23 0 2024-09-11T00:07:21.684 INFO:tasks.workunit.client.0.smithi111.stdout:3/570: write d1c/d1d/d22/d23/f25 [639747,29111] 0 2024-09-11T00:07:21.684 INFO:tasks.workunit.client.0.smithi111.stdout:5/606: dread d10/d1e/f28 [0,4194304] 0 2024-09-11T00:07:21.686 INFO:tasks.workunit.client.1.smithi203.stdout:2/600: chown d13/d15/d30/d5a/d8b/lbe 885 1 2024-09-11T00:07:21.687 INFO:tasks.workunit.client.0.smithi111.stdout:0/624: rmdir d3/d13/d1e/d29/d49/d51/d61/d93/da7 39 2024-09-11T00:07:21.688 INFO:tasks.workunit.client.0.smithi111.stdout:0/625: readlink d3/d13/lbe 0 2024-09-11T00:07:21.689 INFO:tasks.workunit.client.1.smithi203.stdout:4/499: rmdir db/d12/d15/d2a/d9b 0 2024-09-11T00:07:21.689 INFO:tasks.workunit.client.0.smithi111.stdout:0/626: fdatasync d3/d1c/f42 0 2024-09-11T00:07:21.693 INFO:tasks.workunit.client.0.smithi111.stdout:1/558: symlink d2/de/d12/d3c/lbe 0 2024-09-11T00:07:21.696 INFO:tasks.workunit.client.0.smithi111.stdout:1/559: chown d2/de/d82/l99 0 1 2024-09-11T00:07:21.698 INFO:tasks.workunit.client.0.smithi111.stdout:4/550: rmdir d18/d20/d3c/d5e/d75/d8d 39 2024-09-11T00:07:21.702 INFO:tasks.workunit.client.1.smithi203.stdout:2/601: truncate d13/d15/f23 4379314 0 2024-09-11T00:07:21.705 INFO:tasks.workunit.client.1.smithi203.stdout:4/500: truncate db/dd/d16/d38/f3b 4625532 0 2024-09-11T00:07:21.710 INFO:tasks.workunit.client.1.smithi203.stdout:1/622: dwrite d8/d19/d60/d90/d3e/d4b/d3a/fa4 [0,4194304] 0 2024-09-11T00:07:21.711 INFO:tasks.workunit.client.1.smithi203.stdout:6/546: unlink d0/c9 0 2024-09-11T00:07:21.714 INFO:tasks.workunit.client.0.smithi111.stdout:7/574: dwrite dd/d48/f61 [4194304,4194304] 0 2024-09-11T00:07:21.715 INFO:tasks.workunit.client.1.smithi203.stdout:1/623: write d8/d19/d60/d90/d3e/d4b/d3a/fd1 [1021013,53761] 0 2024-09-11T00:07:21.720 INFO:tasks.workunit.client.0.smithi111.stdout:9/616: getdents d6/db/d34 0 2024-09-11T00:07:21.725 INFO:tasks.workunit.client.1.smithi203.stdout:2/602: rename d13/d15/d19/d1c/cb8 to d13/d47/cc3 0 2024-09-11T00:07:21.726 INFO:tasks.workunit.client.0.smithi111.stdout:1/560: truncate d2/de/d12/d3c/d4b/d6a/d63/d73/da1/f2d 929429 0 2024-09-11T00:07:21.731 INFO:tasks.workunit.client.1.smithi203.stdout:6/547: symlink d0/la9 0 2024-09-11T00:07:21.732 INFO:tasks.workunit.client.0.smithi111.stdout:1/561: dread d2/de/d82/f86 [0,4194304] 0 2024-09-11T00:07:21.733 INFO:tasks.workunit.client.0.smithi111.stdout:7/575: creat dd/d1d/d1f/d24/fb5 x:0 0 0 2024-09-11T00:07:21.734 INFO:tasks.workunit.client.0.smithi111.stdout:0/627: symlink d3/d13/d1e/d29/le8 0 2024-09-11T00:07:21.735 INFO:tasks.workunit.client.0.smithi111.stdout:4/551: dwrite d18/d1f/d33/f59 [0,4194304] 0 2024-09-11T00:07:21.736 INFO:tasks.workunit.client.1.smithi203.stdout:8/550: dwrite d1/d13/d17/f50 [0,4194304] 0 2024-09-11T00:07:21.737 INFO:tasks.workunit.client.1.smithi203.stdout:9/583: write d6/de/d32/d52/d44/f79 [3052725,87939] 0 2024-09-11T00:07:21.738 INFO:tasks.workunit.client.0.smithi111.stdout:2/556: rename d0/d3/de/l8e to d0/d3/de/d3b/d97/lc1 0 2024-09-11T00:07:21.740 INFO:tasks.workunit.client.0.smithi111.stdout:0/628: chown d3/f65 91582718 1 2024-09-11T00:07:21.741 INFO:tasks.workunit.client.0.smithi111.stdout:9/617: mkdir d6/db/d1b/d56/dc8 0 2024-09-11T00:07:21.742 INFO:tasks.workunit.client.1.smithi203.stdout:2/603: rename d13/d15/d90 to d13/d15/d19/d1c/d73/dc4 0 2024-09-11T00:07:21.743 INFO:tasks.workunit.client.0.smithi111.stdout:5/607: write d10/d1e/d23/d30/f37 [3273679,114399] 0 2024-09-11T00:07:21.744 INFO:tasks.workunit.client.0.smithi111.stdout:6/530: getdents d7/d22/d1d/d83 0 2024-09-11T00:07:21.748 INFO:tasks.workunit.client.1.smithi203.stdout:6/548: chown d0/l12 54 1 2024-09-11T00:07:21.748 INFO:tasks.workunit.client.1.smithi203.stdout:9/584: write d6/de/d32/d52/f92 [819635,83337] 0 2024-09-11T00:07:21.754 INFO:tasks.workunit.client.0.smithi111.stdout:7/576: mkdir dd/d1d/d76/db6 0 2024-09-11T00:07:21.754 INFO:tasks.workunit.client.1.smithi203.stdout:8/551: symlink d1/d13/d17/d2f/d9e/lbb 0 2024-09-11T00:07:21.756 INFO:tasks.workunit.client.0.smithi111.stdout:1/562: dwrite d2/de/d12/d3c/d4b/d6a/f46 [0,4194304] 0 2024-09-11T00:07:21.757 INFO:tasks.workunit.client.1.smithi203.stdout:8/552: chown d1/d13/d17/f39 2038 1 2024-09-11T00:07:21.758 INFO:tasks.workunit.client.0.smithi111.stdout:6/531: symlink d7/d22/d1d/d69/lb8 0 2024-09-11T00:07:21.761 INFO:tasks.workunit.client.0.smithi111.stdout:5/608: mkdir d10/d1e/d23/d26/d3a/dc2 0 2024-09-11T00:07:21.763 INFO:tasks.workunit.client.0.smithi111.stdout:1/563: symlink d2/de/d93/d9c/lbf 0 2024-09-11T00:07:21.764 INFO:tasks.workunit.client.1.smithi203.stdout:4/501: dread db/dd/d16/d38/d3c/f72 [0,4194304] 0 2024-09-11T00:07:21.764 INFO:tasks.workunit.client.0.smithi111.stdout:4/552: truncate d18/d1f/f2e 5302 0 2024-09-11T00:07:21.766 INFO:tasks.workunit.client.1.smithi203.stdout:8/553: write d1/d13/d17/d2f/d9e/f66 [1351013,123435] 0 2024-09-11T00:07:21.766 INFO:tasks.workunit.client.1.smithi203.stdout:9/585: rename d6/de/d19/d30 to d6/de/dc4 0 2024-09-11T00:07:21.767 INFO:tasks.workunit.client.0.smithi111.stdout:5/609: fsync d10/d1e/d25/f4a 0 2024-09-11T00:07:21.770 INFO:tasks.workunit.client.0.smithi111.stdout:9/618: dwrite d6/db/fd [0,4194304] 0 2024-09-11T00:07:21.770 INFO:tasks.workunit.client.0.smithi111.stdout:1/564: stat d2/de/d12/d3c/d4b/d6a/d63/f6e 0 2024-09-11T00:07:21.770 INFO:tasks.workunit.client.1.smithi203.stdout:4/502: fsync db/dd/d16/d38/f99 0 2024-09-11T00:07:21.771 INFO:tasks.workunit.client.1.smithi203.stdout:8/554: chown d1/d13/d17/c4f 68153 1 2024-09-11T00:07:21.778 INFO:tasks.workunit.client.0.smithi111.stdout:9/619: chown d6/db/d1b/d56/f6b 851535 1 2024-09-11T00:07:21.778 INFO:tasks.workunit.client.0.smithi111.stdout:4/553: rmdir d18/d20/d4a/d6b 39 2024-09-11T00:07:21.781 INFO:tasks.workunit.client.1.smithi203.stdout:1/624: dread d8/f1a [0,4194304] 0 2024-09-11T00:07:21.783 INFO:tasks.workunit.client.1.smithi203.stdout:9/586: truncate d6/de/d32/d52/d55/f3f 580983 0 2024-09-11T00:07:21.784 INFO:tasks.workunit.client.0.smithi111.stdout:9/620: write d6/db/d34/d37/f7e [1473262,5679] 0 2024-09-11T00:07:21.790 INFO:tasks.workunit.client.0.smithi111.stdout:7/577: read dd/f18 [432838,130140] 0 2024-09-11T00:07:21.790 INFO:tasks.workunit.client.0.smithi111.stdout:3/571: sync 2024-09-11T00:07:21.791 INFO:tasks.workunit.client.0.smithi111.stdout:8/605: sync 2024-09-11T00:07:21.793 INFO:tasks.workunit.client.0.smithi111.stdout:9/621: mknod d6/db/d34/cc9 0 2024-09-11T00:07:21.793 INFO:tasks.workunit.client.0.smithi111.stdout:5/610: dread d10/d1e/d23/d26/d3a/f5d [0,4194304] 0 2024-09-11T00:07:21.795 INFO:tasks.workunit.client.0.smithi111.stdout:1/565: getdents d2/de/d82 0 2024-09-11T00:07:21.795 INFO:tasks.workunit.client.0.smithi111.stdout:7/578: dread - dd/d1d/d1f/f9d zero size 2024-09-11T00:07:21.801 INFO:tasks.workunit.client.0.smithi111.stdout:7/579: fsync f7 0 2024-09-11T00:07:21.802 INFO:tasks.workunit.client.0.smithi111.stdout:8/606: rename d11/f6d to d11/d8e/fbf 0 2024-09-11T00:07:21.803 INFO:tasks.workunit.client.0.smithi111.stdout:1/566: unlink d2/de/d12/l58 0 2024-09-11T00:07:21.803 INFO:tasks.workunit.client.0.smithi111.stdout:0/629: dread d3/da/f21 [0,4194304] 0 2024-09-11T00:07:21.805 INFO:tasks.workunit.client.0.smithi111.stdout:3/572: symlink d1c/d21/db4/lc4 0 2024-09-11T00:07:21.810 INFO:tasks.workunit.client.1.smithi203.stdout:6/549: dread d0/d54/d9c/d35/f3f [0,4194304] 0 2024-09-11T00:07:21.810 INFO:tasks.workunit.client.1.smithi203.stdout:2/604: dwrite d13/d15/d19/f42 [0,4194304] 0 2024-09-11T00:07:21.810 INFO:tasks.workunit.client.0.smithi111.stdout:3/573: dread - d1c/d1d/f77 zero size 2024-09-11T00:07:21.811 INFO:tasks.workunit.client.0.smithi111.stdout:8/607: write d11/d23/d7e/f97 [1366208,33959] 0 2024-09-11T00:07:21.812 INFO:tasks.workunit.client.0.smithi111.stdout:0/630: symlink d3/d26/d77/le9 0 2024-09-11T00:07:21.817 INFO:tasks.workunit.client.0.smithi111.stdout:2/557: dwrite d0/d3/de/f1e [0,4194304] 0 2024-09-11T00:07:21.817 INFO:tasks.workunit.client.1.smithi203.stdout:6/550: write d0/f95 [264982,118737] 0 2024-09-11T00:07:21.818 INFO:tasks.workunit.client.1.smithi203.stdout:1/625: dwrite d8/d19/d31/f59 [0,4194304] 0 2024-09-11T00:07:21.819 INFO:tasks.workunit.client.1.smithi203.stdout:2/605: write d13/d15/d30/fa9 [710007,94362] 0 2024-09-11T00:07:21.823 INFO:tasks.workunit.client.1.smithi203.stdout:1/626: chown d8/l37 105757484 1 2024-09-11T00:07:21.823 INFO:tasks.workunit.client.1.smithi203.stdout:8/555: dread d1/fe [4194304,4194304] 0 2024-09-11T00:07:21.824 INFO:tasks.workunit.client.0.smithi111.stdout:6/532: dwrite d7/d22/d1d/f31 [4194304,4194304] 0 2024-09-11T00:07:21.824 INFO:tasks.workunit.client.0.smithi111.stdout:5/611: truncate d10/d1e/d23/d26/d78/d7a/f83 499863 0 2024-09-11T00:07:21.827 INFO:tasks.workunit.client.1.smithi203.stdout:8/556: dread - d1/d13/d17/d8b/fa8 zero size 2024-09-11T00:07:21.830 INFO:tasks.workunit.client.0.smithi111.stdout:4/554: dread d18/d20/f34 [0,4194304] 0 2024-09-11T00:07:21.831 INFO:tasks.workunit.client.1.smithi203.stdout:4/503: dwrite db/d12/d15/d2a/f1b [0,4194304] 0 2024-09-11T00:07:21.834 INFO:tasks.workunit.client.0.smithi111.stdout:0/631: chown d3/d13/d1e/d29/d49/d51/d61/d93/da7 1876 1 2024-09-11T00:07:21.837 INFO:tasks.workunit.client.1.smithi203.stdout:4/504: write db/d12/d15/d2a/d88/f89 [733695,61693] 0 2024-09-11T00:07:21.840 INFO:tasks.workunit.client.0.smithi111.stdout:3/574: creat d1c/d1d/d22/d23/d2f/d63/d7e/fc5 x:0 0 0 2024-09-11T00:07:21.843 INFO:tasks.workunit.client.0.smithi111.stdout:3/575: fsync d1c/d1d/d22/d31/fbd 0 2024-09-11T00:07:21.845 INFO:tasks.workunit.client.0.smithi111.stdout:1/567: write d2/f10 [2286489,123243] 0 2024-09-11T00:07:21.847 INFO:tasks.workunit.client.1.smithi203.stdout:6/551: mknod d0/d54/d9c/d35/d39/caa 0 2024-09-11T00:07:21.849 INFO:tasks.workunit.client.0.smithi111.stdout:7/580: rename dd/d1d/d2d/d2e/c88 to dd/d48/cb7 0 2024-09-11T00:07:21.850 INFO:tasks.workunit.client.0.smithi111.stdout:2/558: truncate d0/d3/d12/f5f 479993 0 2024-09-11T00:07:21.852 INFO:tasks.workunit.client.1.smithi203.stdout:1/627: mknod d8/d19/d60/d90/d3e/d4b/cde 0 2024-09-11T00:07:21.852 INFO:tasks.workunit.client.0.smithi111.stdout:8/608: creat d11/fc0 x:0 0 0 2024-09-11T00:07:21.854 INFO:tasks.workunit.client.0.smithi111.stdout:3/576: symlink d1c/d1d/d22/d23/lc6 0 2024-09-11T00:07:21.855 INFO:tasks.workunit.client.0.smithi111.stdout:1/568: mkdir d2/de/d93/d9f/dc0 0 2024-09-11T00:07:21.856 INFO:tasks.workunit.client.0.smithi111.stdout:0/632: dwrite d3/d26/d77/dd6/fda [0,4194304] 0 2024-09-11T00:07:21.856 INFO:tasks.workunit.client.0.smithi111.stdout:2/559: read d0/d3/f27 [2336326,58933] 0 2024-09-11T00:07:21.857 INFO:tasks.workunit.client.1.smithi203.stdout:6/552: chown d0/d54/d9c/d7b/d7e/c89 45255 1 2024-09-11T00:07:21.858 INFO:tasks.workunit.client.0.smithi111.stdout:8/609: chown d11/d23/d3d/d5f/d99 299042 1 2024-09-11T00:07:21.861 INFO:tasks.workunit.client.0.smithi111.stdout:5/612: mknod d10/d1e/d23/d2b/dad/cc3 0 2024-09-11T00:07:21.861 INFO:tasks.workunit.client.0.smithi111.stdout:8/610: chown d11/d23/d3d/d8d/ca8 12 1 2024-09-11T00:07:21.863 INFO:tasks.workunit.client.1.smithi203.stdout:1/628: creat d8/d19/d60/d90/d3e/d4b/d80/da2/fdf x:0 0 0 2024-09-11T00:07:21.864 INFO:tasks.workunit.client.0.smithi111.stdout:5/613: write d10/d1e/d23/d30/d3c/d60/da2/f58 [1397628,763] 0 2024-09-11T00:07:21.867 INFO:tasks.workunit.client.1.smithi203.stdout:4/505: dwrite db/d12/d15/d2a/f1b [4194304,4194304] 0 2024-09-11T00:07:21.868 INFO:tasks.workunit.client.0.smithi111.stdout:0/633: rmdir d3/da/d7b/d84 39 2024-09-11T00:07:21.868 INFO:tasks.workunit.client.0.smithi111.stdout:5/614: stat d10/d1e/d23/d2b/d2f/la6 0 2024-09-11T00:07:21.868 INFO:tasks.workunit.client.0.smithi111.stdout:3/577: mkdir d1c/d1d/d22/d31/d62/dc7 0 2024-09-11T00:07:21.871 INFO:tasks.workunit.client.0.smithi111.stdout:3/578: dread - d1c/d1d/d86/f93 zero size 2024-09-11T00:07:21.873 INFO:tasks.workunit.client.1.smithi203.stdout:6/553: creat d0/d54/d9c/d35/d39/fab x:0 0 0 2024-09-11T00:07:21.873 INFO:tasks.workunit.client.1.smithi203.stdout:1/629: chown d8/d19/d31/d36/c9c 7571 1 2024-09-11T00:07:21.874 INFO:tasks.workunit.client.1.smithi203.stdout:4/506: mkdir db/dd/d16/d9d 0 2024-09-11T00:07:21.874 INFO:tasks.workunit.client.0.smithi111.stdout:1/569: dwrite d2/de/d93/d9c/fa2 [0,4194304] 0 2024-09-11T00:07:21.877 INFO:tasks.workunit.client.0.smithi111.stdout:4/555: rename c13 to d18/d20/d4a/ca7 0 2024-09-11T00:07:21.877 INFO:tasks.workunit.client.1.smithi203.stdout:1/630: read d8/d19/d60/d90/d3e/f8c [2957065,14845] 0 2024-09-11T00:07:21.878 INFO:tasks.workunit.client.1.smithi203.stdout:1/631: stat d8/d28/l69 0 2024-09-11T00:07:21.879 INFO:tasks.workunit.client.1.smithi203.stdout:8/557: dread d1/d13/f19 [0,4194304] 0 2024-09-11T00:07:21.879 INFO:tasks.workunit.client.0.smithi111.stdout:2/560: creat d0/d3/de/d3b/d92/fc2 x:0 0 0 2024-09-11T00:07:21.883 INFO:tasks.workunit.client.1.smithi203.stdout:6/554: unlink d0/d54/d9c/d7b/d7e/c89 0 2024-09-11T00:07:21.891 INFO:tasks.workunit.client.1.smithi203.stdout:4/507: symlink db/d12/d15/l9e 0 2024-09-11T00:07:21.895 INFO:tasks.workunit.client.1.smithi203.stdout:4/508: read - db/d12/d15/d2a/d71/f83 zero size 2024-09-11T00:07:21.897 INFO:tasks.workunit.client.0.smithi111.stdout:8/611: link d11/f13 d11/d21/d6f/dab/fc1 0 2024-09-11T00:07:21.898 INFO:tasks.workunit.client.0.smithi111.stdout:8/612: truncate ff 2545130 0 2024-09-11T00:07:21.901 INFO:tasks.workunit.client.1.smithi203.stdout:8/558: dwrite d1/fc [4194304,4194304] 0 2024-09-11T00:07:21.902 INFO:tasks.workunit.client.0.smithi111.stdout:1/570: rename d2/de/d12/d3c/l8c to d2/de/d12/d88/lc1 0 2024-09-11T00:07:21.904 INFO:tasks.workunit.client.1.smithi203.stdout:8/559: stat d1/d13/d3a/d4c/c51 0 2024-09-11T00:07:21.906 INFO:tasks.workunit.client.1.smithi203.stdout:6/555: rmdir d0/d54/d9c/d35/d38 39 2024-09-11T00:07:21.909 INFO:tasks.workunit.client.1.smithi203.stdout:1/632: rename d8/d19/c4e to d8/d28/d64/ce0 0 2024-09-11T00:07:21.910 INFO:tasks.workunit.client.0.smithi111.stdout:7/581: write dd/da6/fab [1788028,83243] 0 2024-09-11T00:07:21.917 INFO:tasks.workunit.client.1.smithi203.stdout:2/606: dread d13/d22/f4e [0,4194304] 0 2024-09-11T00:07:21.921 INFO:tasks.workunit.client.1.smithi203.stdout:1/633: mkdir d8/d11/de1 0 2024-09-11T00:07:21.925 INFO:tasks.workunit.client.1.smithi203.stdout:8/560: dread d1/d13/d22/d6f/f8a [0,4194304] 0 2024-09-11T00:07:21.925 INFO:tasks.workunit.client.1.smithi203.stdout:6/556: unlink d0/d54/d9c/d35/d38/l4d 0 2024-09-11T00:07:21.928 INFO:tasks.workunit.client.1.smithi203.stdout:2/607: rename d13/d56/l82 to d13/d15/d30/d59/lc5 0 2024-09-11T00:07:21.929 INFO:tasks.workunit.client.0.smithi111.stdout:9/622: dread d6/db/d34/f65 [0,4194304] 0 2024-09-11T00:07:21.930 INFO:tasks.workunit.client.0.smithi111.stdout:2/561: link d0/f7b d0/d3/de/d3b/d92/fc3 0 2024-09-11T00:07:21.930 INFO:tasks.workunit.client.0.smithi111.stdout:0/634: dwrite d3/da/f3a [0,4194304] 0 2024-09-11T00:07:21.935 INFO:tasks.workunit.client.1.smithi203.stdout:8/561: creat d1/d13/d22/d6f/fbc x:0 0 0 2024-09-11T00:07:21.936 INFO:tasks.workunit.client.0.smithi111.stdout:3/579: creat d1c/d1d/d22/d31/fc8 x:0 0 0 2024-09-11T00:07:21.936 INFO:tasks.workunit.client.0.smithi111.stdout:5/615: write d10/d1e/d23/d30/d59/d52/f95 [2000389,5513] 0 2024-09-11T00:07:21.939 INFO:tasks.workunit.client.0.smithi111.stdout:1/571: write d2/de/d12/f1c [473378,116922] 0 2024-09-11T00:07:21.939 INFO:tasks.workunit.client.0.smithi111.stdout:5/616: readlink d10/d1e/d23/d30/d3c/d60/d63/l9f 0 2024-09-11T00:07:21.941 INFO:tasks.workunit.client.0.smithi111.stdout:8/613: mknod d11/d23/d3d/d5f/d99/cc2 0 2024-09-11T00:07:21.943 INFO:tasks.workunit.client.1.smithi203.stdout:6/557: rename d0/d54/d9c/d35/d39/d3c/f77 to d0/d5b/d5c/fac 0 2024-09-11T00:07:21.945 INFO:tasks.workunit.client.1.smithi203.stdout:1/634: mkdir d8/d9/d15/d35/de2 0 2024-09-11T00:07:21.948 INFO:tasks.workunit.client.0.smithi111.stdout:0/635: dwrite d3/d26/d77/dd6/fda [0,4194304] 0 2024-09-11T00:07:21.949 INFO:tasks.workunit.client.1.smithi203.stdout:4/509: dwrite db/dd/d16/f6e [0,4194304] 0 2024-09-11T00:07:21.952 INFO:tasks.workunit.client.0.smithi111.stdout:3/580: mknod d1c/d21/cc9 0 2024-09-11T00:07:21.953 INFO:tasks.workunit.client.0.smithi111.stdout:4/556: getdents d18/d3b 0 2024-09-11T00:07:21.954 INFO:tasks.workunit.client.0.smithi111.stdout:3/581: fsync d1c/d1d/d22/d23/d2f/f8e 0 2024-09-11T00:07:21.958 INFO:tasks.workunit.client.0.smithi111.stdout:5/617: rename d10/d1e/d23/d2b/d5c/d61/l96 to d10/d1e/d23/d2b/d2f/lc4 0 2024-09-11T00:07:21.966 INFO:tasks.workunit.client.1.smithi203.stdout:4/510: truncate db/dd/d16/f24 1736383 0 2024-09-11T00:07:21.968 INFO:tasks.workunit.client.0.smithi111.stdout:7/582: link dd/c20 dd/d1d/d76/db6/cb8 0 2024-09-11T00:07:21.969 INFO:tasks.workunit.client.0.smithi111.stdout:7/583: write dd/f97 [908964,46888] 0 2024-09-11T00:07:21.971 INFO:tasks.workunit.client.0.smithi111.stdout:0/636: mknod d3/d13/d66/cea 0 2024-09-11T00:07:21.972 INFO:tasks.workunit.client.1.smithi203.stdout:6/558: dwrite d0/d54/d9c/f98 [0,4194304] 0 2024-09-11T00:07:21.974 INFO:tasks.workunit.client.1.smithi203.stdout:4/511: mknod db/dd/d16/c9f 0 2024-09-11T00:07:21.976 INFO:tasks.workunit.client.0.smithi111.stdout:8/614: mkdir d11/d21/d38/d54/dc3 0 2024-09-11T00:07:21.980 INFO:tasks.workunit.client.0.smithi111.stdout:1/572: link d2/de/d93/d9c/fa2 d2/de/d12/d3c/d4b/d6a/d63/d73/da1/fc2 0 2024-09-11T00:07:21.983 INFO:tasks.workunit.client.1.smithi203.stdout:2/608: dwrite f8 [0,4194304] 0 2024-09-11T00:07:21.985 INFO:tasks.workunit.client.1.smithi203.stdout:8/562: dwrite d1/f11 [0,4194304] 0 2024-09-11T00:07:21.988 INFO:tasks.workunit.client.1.smithi203.stdout:6/559: fdatasync d0/d5b/d5c/fa8 0 2024-09-11T00:07:21.989 INFO:tasks.workunit.client.0.smithi111.stdout:9/623: creat d6/db/d34/fca x:0 0 0 2024-09-11T00:07:21.990 INFO:tasks.workunit.client.1.smithi203.stdout:8/563: chown d1/d13/d17/d81/d97/fb1 8829291 1 2024-09-11T00:07:21.991 INFO:tasks.workunit.client.0.smithi111.stdout:6/533: sync 2024-09-11T00:07:21.991 INFO:tasks.workunit.client.0.smithi111.stdout:9/624: fdatasync d6/d52/d8a/d92/faa 0 2024-09-11T00:07:21.995 INFO:tasks.workunit.client.1.smithi203.stdout:8/564: stat d1/d13/c9a 0 2024-09-11T00:07:21.996 INFO:tasks.workunit.client.0.smithi111.stdout:0/637: fsync d3/dc/fc3 0 2024-09-11T00:07:21.996 INFO:tasks.workunit.client.0.smithi111.stdout:8/615: mkdir d11/d21/dc4 0 2024-09-11T00:07:22.003 INFO:tasks.workunit.client.1.smithi203.stdout:6/560: creat d0/d32/d5a/fad x:0 0 0 2024-09-11T00:07:22.003 INFO:tasks.workunit.client.0.smithi111.stdout:1/573: mkdir d2/de/d12/d3c/d4b/dc3 0 2024-09-11T00:07:22.004 INFO:tasks.workunit.client.0.smithi111.stdout:7/584: write dd/d1d/d1f/f9b [971,22141] 0 2024-09-11T00:07:22.005 INFO:tasks.workunit.client.0.smithi111.stdout:3/582: truncate d1c/d1d/d22/d31/d33/d5f/fa7 1876419 0 2024-09-11T00:07:22.006 INFO:tasks.workunit.client.0.smithi111.stdout:9/625: creat d6/d52/fcb x:0 0 0 2024-09-11T00:07:22.007 INFO:tasks.workunit.client.0.smithi111.stdout:7/585: truncate dd/f97 1649119 0 2024-09-11T00:07:22.009 INFO:tasks.workunit.client.1.smithi203.stdout:8/565: creat d1/d13/d43/dab/fbd x:0 0 0 2024-09-11T00:07:22.009 INFO:tasks.workunit.client.0.smithi111.stdout:4/557: dread d18/d20/d40/d78/d79/f89 [0,4194304] 0 2024-09-11T00:07:22.010 INFO:tasks.workunit.client.0.smithi111.stdout:3/583: write d1c/d1d/d22/d44/d5a/f69 [1678177,109736] 0 2024-09-11T00:07:22.010 INFO:tasks.workunit.client.0.smithi111.stdout:0/638: unlink d3/da/f3a 0 2024-09-11T00:07:22.010 INFO:tasks.workunit.client.0.smithi111.stdout:8/616: write ff [1422106,94912] 0 2024-09-11T00:07:22.011 INFO:tasks.workunit.client.0.smithi111.stdout:7/586: dread - dd/d1d/d76/fa3 zero size 2024-09-11T00:07:22.011 INFO:tasks.workunit.client.0.smithi111.stdout:2/562: getdents d0/d3/de/d68 0 2024-09-11T00:07:22.013 INFO:tasks.workunit.client.1.smithi203.stdout:8/566: fsync d1/d13/d3a/fb3 0 2024-09-11T00:07:22.014 INFO:tasks.workunit.client.1.smithi203.stdout:2/609: dwrite d13/d15/d19/f26 [0,4194304] 0 2024-09-11T00:07:22.015 INFO:tasks.workunit.client.0.smithi111.stdout:7/587: dread dd/f1b [4194304,4194304] 0 2024-09-11T00:07:22.021 INFO:tasks.workunit.client.0.smithi111.stdout:6/534: dread d7/d22/d2c/f37 [0,4194304] 0 2024-09-11T00:07:22.023 INFO:tasks.workunit.client.0.smithi111.stdout:6/535: chown d7/d22/d3f/d74/d7f/d79/da4 9 1 2024-09-11T00:07:22.023 INFO:tasks.workunit.client.0.smithi111.stdout:9/626: creat d6/db/d34/d37/fcc x:0 0 0 2024-09-11T00:07:22.024 INFO:tasks.workunit.client.1.smithi203.stdout:8/567: mknod d1/d13/d3a/d75/cbe 0 2024-09-11T00:07:22.025 INFO:tasks.workunit.client.1.smithi203.stdout:2/610: mknod d13/d15/cc6 0 2024-09-11T00:07:22.028 INFO:tasks.workunit.client.1.smithi203.stdout:6/561: read d0/d54/d9c/d35/d39/f51 [87875,112563] 0 2024-09-11T00:07:22.029 INFO:tasks.workunit.client.1.smithi203.stdout:8/568: dread - d1/d13/d43/d46/d76/f98 zero size 2024-09-11T00:07:22.030 INFO:tasks.workunit.client.1.smithi203.stdout:0/551: sync 2024-09-11T00:07:22.030 INFO:tasks.workunit.client.1.smithi203.stdout:1/635: truncate d8/d19/d60/d90/d3e/d4b/d3a/fa4 3215750 0 2024-09-11T00:07:22.032 INFO:tasks.workunit.client.1.smithi203.stdout:5/654: sync 2024-09-11T00:07:22.034 INFO:tasks.workunit.client.0.smithi111.stdout:1/574: truncate d2/de/d12/d3c/d4b/d6a/d63/d73/da1/f2d 1134177 0 2024-09-11T00:07:22.035 INFO:tasks.workunit.client.0.smithi111.stdout:7/588: creat dd/d1d/d4d/fb9 x:0 0 0 2024-09-11T00:07:22.038 INFO:tasks.workunit.client.0.smithi111.stdout:3/584: symlink d1c/d1d/d22/d44/d5a/dba/lca 0 2024-09-11T00:07:22.038 INFO:tasks.workunit.client.1.smithi203.stdout:4/512: write db/dd/f13 [1414417,11829] 0 2024-09-11T00:07:22.039 INFO:tasks.workunit.client.1.smithi203.stdout:8/569: dread - d1/d13/d22/f88 zero size 2024-09-11T00:07:22.039 INFO:tasks.workunit.client.0.smithi111.stdout:5/618: write d10/d1e/d23/d2b/d5c/fb7 [771037,66797] 0 2024-09-11T00:07:22.041 INFO:tasks.workunit.client.1.smithi203.stdout:1/636: readlink d8/d9/d15/d35/l7a 0 2024-09-11T00:07:22.042 INFO:tasks.workunit.client.0.smithi111.stdout:3/585: write d1c/d1d/d22/d44/d5a/d74/fa8 [496490,44266] 0 2024-09-11T00:07:22.042 INFO:tasks.workunit.client.1.smithi203.stdout:8/570: read - d1/d13/fb5 zero size 2024-09-11T00:07:22.046 INFO:tasks.workunit.client.1.smithi203.stdout:0/552: rename d0/d2/d67/d8d to d0/d2/d37/d5b/d73/db6 0 2024-09-11T00:07:22.048 INFO:tasks.workunit.client.0.smithi111.stdout:9/627: chown d6/db/d1b/l36 29030716 1 2024-09-11T00:07:22.049 INFO:tasks.workunit.client.1.smithi203.stdout:1/637: readlink d8/d19/d60/d90/d3e/d4b/d80/d8d/da3/lb8 0 2024-09-11T00:07:22.051 INFO:tasks.workunit.client.1.smithi203.stdout:5/655: truncate dc/dd/d1e/fa1 404986 0 2024-09-11T00:07:22.051 INFO:tasks.workunit.client.1.smithi203.stdout:2/611: dwrite d13/d15/fa8 [0,4194304] 0 2024-09-11T00:07:22.052 INFO:tasks.workunit.client.0.smithi111.stdout:9/628: read d6/dc/f17 [2965798,95972] 0 2024-09-11T00:07:22.054 INFO:tasks.workunit.client.0.smithi111.stdout:0/639: dwrite d3/d13/d1e/d29/d49/f92 [0,4194304] 0 2024-09-11T00:07:22.058 INFO:tasks.workunit.client.0.smithi111.stdout:6/536: creat d7/d22/d3f/d74/d7f/d79/da4/fb9 x:0 0 0 2024-09-11T00:07:22.058 INFO:tasks.workunit.client.0.smithi111.stdout:4/558: creat d18/d20/d3c/d5e/d75/fa8 x:0 0 0 2024-09-11T00:07:22.060 INFO:tasks.workunit.client.1.smithi203.stdout:8/571: symlink d1/d13/d17/d81/lbf 0 2024-09-11T00:07:22.061 INFO:tasks.workunit.client.1.smithi203.stdout:6/562: dwrite d0/d54/d9c/f98 [0,4194304] 0 2024-09-11T00:07:22.072 INFO:tasks.workunit.client.0.smithi111.stdout:2/563: dwrite d0/d3/f1c [0,4194304] 0 2024-09-11T00:07:22.073 INFO:tasks.workunit.client.0.smithi111.stdout:5/619: dread d10/f1a [0,4194304] 0 2024-09-11T00:07:22.077 INFO:tasks.workunit.client.1.smithi203.stdout:0/553: dread d0/d2/f1a [4194304,4194304] 0 2024-09-11T00:07:22.080 INFO:tasks.workunit.client.1.smithi203.stdout:8/572: write d1/d13/d43/d46/d76/f7d [4514749,97983] 0 2024-09-11T00:07:22.080 INFO:tasks.workunit.client.1.smithi203.stdout:2/612: dwrite d13/d22/f4a [0,4194304] 0 2024-09-11T00:07:22.082 INFO:tasks.workunit.client.1.smithi203.stdout:8/573: chown d1/d13/d17/d2f/d52/d59/c87 163424 1 2024-09-11T00:07:22.086 INFO:tasks.workunit.client.1.smithi203.stdout:1/638: mknod d8/d9/d15/d35/d81/ce3 0 2024-09-11T00:07:22.088 INFO:tasks.workunit.client.1.smithi203.stdout:6/563: rename d0/d54/d9c/d35/d39/caa to d0/d32/cae 0 2024-09-11T00:07:22.101 INFO:tasks.workunit.client.1.smithi203.stdout:8/574: dwrite d1/d13/d43/fa5 [0,4194304] 0 2024-09-11T00:07:22.103 INFO:tasks.workunit.client.1.smithi203.stdout:2/613: dwrite d13/d15/f55 [0,4194304] 0 2024-09-11T00:07:22.110 INFO:tasks.workunit.client.1.smithi203.stdout:6/564: mknod d0/d54/d9c/d35/d38/d73/caf 0 2024-09-11T00:07:22.111 INFO:tasks.workunit.client.1.smithi203.stdout:1/639: creat d8/d19/d60/d90/d3e/d4b/d80/d91/dac/fe4 x:0 0 0 2024-09-11T00:07:22.116 INFO:tasks.workunit.client.1.smithi203.stdout:7/579: sync 2024-09-11T00:07:22.116 INFO:tasks.workunit.client.1.smithi203.stdout:9/587: sync 2024-09-11T00:07:22.116 INFO:tasks.workunit.client.1.smithi203.stdout:3/599: sync 2024-09-11T00:07:22.117 INFO:tasks.workunit.client.1.smithi203.stdout:0/554: mknod d0/cb7 0 2024-09-11T00:07:22.117 INFO:tasks.workunit.client.1.smithi203.stdout:4/513: link db/dd/d26/d42/c51 db/ca0 0 2024-09-11T00:07:22.118 INFO:tasks.workunit.client.1.smithi203.stdout:5/656: dwrite dc/dd/d15/f19 [0,4194304] 0 2024-09-11T00:07:22.121 INFO:tasks.workunit.client.1.smithi203.stdout:8/575: rename d1/d13/d17/d2f/d52/f95 to d1/d13/d17/d48/fc0 0 2024-09-11T00:07:22.121 INFO:tasks.workunit.client.1.smithi203.stdout:2/614: dread - d13/fb2 zero size 2024-09-11T00:07:22.129 INFO:tasks.workunit.client.1.smithi203.stdout:8/576: readlink d1/d13/d17/d2f/lb4 0 2024-09-11T00:07:22.129 INFO:tasks.workunit.client.1.smithi203.stdout:9/588: write d6/de/d19/d24/d54/f9d [446989,66808] 0 2024-09-11T00:07:22.134 INFO:tasks.workunit.client.0.smithi111.stdout:1/575: rename d2/f1f to d2/de/d93/d9f/fc4 0 2024-09-11T00:07:22.137 INFO:tasks.workunit.client.0.smithi111.stdout:3/586: creat d1c/d21/dae/fcb x:0 0 0 2024-09-11T00:07:22.143 INFO:tasks.workunit.client.0.smithi111.stdout:8/617: getdents d11/d21 0 2024-09-11T00:07:22.144 INFO:tasks.workunit.client.0.smithi111.stdout:8/618: readlink d11/l17 0 2024-09-11T00:07:22.144 INFO:tasks.workunit.client.1.smithi203.stdout:2/615: creat d13/d47/fc7 x:0 0 0 2024-09-11T00:07:22.145 INFO:tasks.workunit.client.1.smithi203.stdout:7/580: creat dd/d1c/d52/d8f/d31/d58/d93/d98/fd4 x:0 0 0 2024-09-11T00:07:22.146 INFO:tasks.workunit.client.0.smithi111.stdout:9/629: symlink d6/d52/d8a/d92/lcd 0 2024-09-11T00:07:22.149 INFO:tasks.workunit.client.1.smithi203.stdout:6/565: dread d0/d54/d9c/d35/d38/d73/d74/f80 [0,4194304] 0 2024-09-11T00:07:22.150 INFO:tasks.workunit.client.1.smithi203.stdout:7/581: stat dd/d1c/d52/d8f/c40 0 2024-09-11T00:07:22.150 INFO:tasks.workunit.client.1.smithi203.stdout:9/589: dread d6/de/d32/d52/f4b [0,4194304] 0 2024-09-11T00:07:22.156 INFO:tasks.workunit.client.1.smithi203.stdout:9/590: chown d6/de/d19/d21/f7b 232001 1 2024-09-11T00:07:22.158 INFO:tasks.workunit.client.1.smithi203.stdout:0/555: dwrite d0/d2/d37/f3e [0,4194304] 0 2024-09-11T00:07:22.161 INFO:tasks.workunit.client.1.smithi203.stdout:5/657: rename dc/l8e to dc/d9f/ldd 0 2024-09-11T00:07:22.162 INFO:tasks.workunit.client.0.smithi111.stdout:2/564: fsync d0/d3/de/d3b/d63/f75 0 2024-09-11T00:07:22.163 INFO:tasks.workunit.client.1.smithi203.stdout:4/514: symlink db/d12/d15/d2a/d88/d95/la1 0 2024-09-11T00:07:22.167 INFO:tasks.workunit.client.1.smithi203.stdout:1/640: dread d8/d19/f26 [0,4194304] 0 2024-09-11T00:07:22.167 INFO:tasks.workunit.client.1.smithi203.stdout:2/616: mkdir d13/d15/d19/d1c/d73/dc8 0 2024-09-11T00:07:22.169 INFO:tasks.workunit.client.1.smithi203.stdout:2/617: fdatasync d13/d15/f32 0 2024-09-11T00:07:22.169 INFO:tasks.workunit.client.0.smithi111.stdout:6/537: rename d7/d2b/d7c to d7/d22/d3f/d74/d7f/d61/d6a/dba 0 2024-09-11T00:07:22.172 INFO:tasks.workunit.client.0.smithi111.stdout:4/559: dread d18/d20/d3c/f58 [0,4194304] 0 2024-09-11T00:07:22.173 INFO:tasks.workunit.client.0.smithi111.stdout:6/538: dread - d7/d22/d2c/d38/d56/faf zero size 2024-09-11T00:07:22.173 INFO:tasks.workunit.client.1.smithi203.stdout:9/591: dread d6/de/d32/f37 [0,4194304] 0 2024-09-11T00:07:22.173 INFO:tasks.workunit.client.1.smithi203.stdout:6/566: creat d0/d54/d9c/d7b/d7e/d94/fb0 x:0 0 0 2024-09-11T00:07:22.175 INFO:tasks.workunit.client.0.smithi111.stdout:4/560: read d18/d20/d3c/f58 [1560178,120035] 0 2024-09-11T00:07:22.176 INFO:tasks.workunit.client.0.smithi111.stdout:4/561: readlink d18/d3b/l5a 0 2024-09-11T00:07:22.180 INFO:tasks.workunit.client.1.smithi203.stdout:7/582: mkdir dd/d1c/d52/d8f/d31/d58/d93/d98/db2/dd5 0 2024-09-11T00:07:22.184 INFO:tasks.workunit.client.0.smithi111.stdout:9/630: mkdir d6/db/db8/dce 0 2024-09-11T00:07:22.185 INFO:tasks.workunit.client.0.smithi111.stdout:9/631: readlink d6/db/d1b/d41/l8d 0 2024-09-11T00:07:22.185 INFO:tasks.workunit.client.1.smithi203.stdout:0/556: mkdir d0/d2/d92/db8 0 2024-09-11T00:07:22.186 INFO:tasks.workunit.client.0.smithi111.stdout:9/632: read - d6/db/d1b/d74/f84 zero size 2024-09-11T00:07:22.187 INFO:tasks.workunit.client.1.smithi203.stdout:4/515: fsync db/dd/d16/f7b 0 2024-09-11T00:07:22.188 INFO:tasks.workunit.client.1.smithi203.stdout:0/557: fsync d0/d2/d37/d5b/d73/f99 0 2024-09-11T00:07:22.191 INFO:tasks.workunit.client.1.smithi203.stdout:2/618: dwrite d13/d15/d19/f26 [0,4194304] 0 2024-09-11T00:07:22.197 INFO:tasks.workunit.client.1.smithi203.stdout:1/641: mknod d8/d19/d60/d90/d3e/d4b/d80/da2/ce5 0 2024-09-11T00:07:22.201 INFO:tasks.workunit.client.1.smithi203.stdout:3/600: dwrite d8/da/f97 [0,4194304] 0 2024-09-11T00:07:22.206 INFO:tasks.workunit.client.1.smithi203.stdout:6/567: creat d0/d5b/d9f/fb1 x:0 0 0 2024-09-11T00:07:22.210 INFO:tasks.workunit.client.1.smithi203.stdout:9/592: symlink d6/de/d19/d21/lc5 0 2024-09-11T00:07:22.211 INFO:tasks.workunit.client.1.smithi203.stdout:8/577: write d1/d13/f19 [825881,45173] 0 2024-09-11T00:07:22.217 INFO:tasks.workunit.client.1.smithi203.stdout:8/578: read - d1/d13/fb5 zero size 2024-09-11T00:07:22.222 INFO:tasks.workunit.client.1.smithi203.stdout:8/579: read d1/d13/d17/d2f/f32 [4236828,34003] 0 2024-09-11T00:07:22.223 INFO:tasks.workunit.client.1.smithi203.stdout:1/642: dwrite d8/d19/d60/d90/d3e/d4b/d3a/fd1 [0,4194304] 0 2024-09-11T00:07:22.227 INFO:tasks.workunit.client.1.smithi203.stdout:7/583: dread dd/d1c/d52/d8f/d31/d4a/f68 [0,4194304] 0 2024-09-11T00:07:22.228 INFO:tasks.workunit.client.0.smithi111.stdout:9/633: write d6/db/d1b/f1e [159486,48224] 0 2024-09-11T00:07:22.229 INFO:tasks.workunit.client.1.smithi203.stdout:2/619: creat d13/d15/d30/d59/fc9 x:0 0 0 2024-09-11T00:07:22.230 INFO:tasks.workunit.client.0.smithi111.stdout:0/640: rmdir d3/d13/daa 0 2024-09-11T00:07:22.231 INFO:tasks.workunit.client.1.smithi203.stdout:2/620: fsync d13/d15/f29 0 2024-09-11T00:07:22.233 INFO:tasks.workunit.client.1.smithi203.stdout:3/601: dread - d8/da/d37/d83/fc2 zero size 2024-09-11T00:07:22.235 INFO:tasks.workunit.client.0.smithi111.stdout:1/576: dwrite d2/de/d12/f28 [4194304,4194304] 0 2024-09-11T00:07:22.235 INFO:tasks.workunit.client.0.smithi111.stdout:2/565: unlink d0/d3/de/d3b/cae 0 2024-09-11T00:07:22.237 INFO:tasks.workunit.client.1.smithi203.stdout:6/568: write d0/d54/d9c/d35/d38/d7d/d82/f91 [410683,116422] 0 2024-09-11T00:07:22.237 INFO:tasks.workunit.client.0.smithi111.stdout:2/566: fdatasync d0/d3/d12/d52/fbd 0 2024-09-11T00:07:22.237 INFO:tasks.workunit.client.0.smithi111.stdout:1/577: write d2/fb5 [250863,101016] 0 2024-09-11T00:07:22.238 INFO:tasks.workunit.client.0.smithi111.stdout:8/619: dwrite d11/d23/d2c/f91 [0,4194304] 0 2024-09-11T00:07:22.240 INFO:tasks.workunit.client.0.smithi111.stdout:8/620: readlink d11/d21/d38/d54/l7d 0 2024-09-11T00:07:22.241 INFO:tasks.workunit.client.0.smithi111.stdout:6/539: symlink d7/d22/d2c/d38/d39/db3/lbb 0 2024-09-11T00:07:22.243 INFO:tasks.workunit.client.1.smithi203.stdout:9/593: creat d6/de/d19/d24/d54/fc6 x:0 0 0 2024-09-11T00:07:22.246 INFO:tasks.workunit.client.0.smithi111.stdout:6/540: write d7/f12 [3690068,62837] 0 2024-09-11T00:07:22.250 INFO:tasks.workunit.client.0.smithi111.stdout:4/562: mknod d18/ca9 0 2024-09-11T00:07:22.252 INFO:tasks.workunit.client.0.smithi111.stdout:9/634: fsync d6/db/d1b/d56/fa7 0 2024-09-11T00:07:22.252 INFO:tasks.workunit.client.1.smithi203.stdout:5/658: dwrite dc/dd/d56/dad/f60 [0,4194304] 0 2024-09-11T00:07:22.254 INFO:tasks.workunit.client.0.smithi111.stdout:9/635: chown d6 1 1 2024-09-11T00:07:22.254 INFO:tasks.workunit.client.1.smithi203.stdout:0/558: mkdir d0/d87/db9 0 2024-09-11T00:07:22.255 INFO:tasks.workunit.client.0.smithi111.stdout:5/620: getdents d10/d1e/d23/d26/d3a/d98/d6d 0 2024-09-11T00:07:22.256 INFO:tasks.workunit.client.0.smithi111.stdout:6/541: readlink d7/d2b/l3e 0 2024-09-11T00:07:22.257 INFO:tasks.workunit.client.1.smithi203.stdout:1/643: write d8/d19/d60/d90/f98 [4088706,103040] 0 2024-09-11T00:07:22.257 INFO:tasks.workunit.client.1.smithi203.stdout:0/559: chown d0/l36 1112199 1 2024-09-11T00:07:22.259 INFO:tasks.workunit.client.0.smithi111.stdout:7/589: rename dd/d1d/d2d/d2e/d4e/l46 to dd/d1d/d4d/d82/lba 0 2024-09-11T00:07:22.261 INFO:tasks.workunit.client.1.smithi203.stdout:3/602: truncate d8/da/d37/f82 848641 0 2024-09-11T00:07:22.262 INFO:tasks.workunit.client.0.smithi111.stdout:8/621: creat d11/d23/d2c/fc5 x:0 0 0 2024-09-11T00:07:22.262 INFO:tasks.workunit.client.1.smithi203.stdout:0/560: truncate d0/d2/f8a 58364 0 2024-09-11T00:07:22.262 INFO:tasks.workunit.client.0.smithi111.stdout:0/641: dwrite d3/d74/fde [0,4194304] 0 2024-09-11T00:07:22.263 INFO:tasks.workunit.client.0.smithi111.stdout:4/563: mkdir d18/d20/d3c/d5e/daa 0 2024-09-11T00:07:22.268 INFO:tasks.workunit.client.1.smithi203.stdout:5/659: mknod dc/d4f/d5c/d76/cde 0 2024-09-11T00:07:22.269 INFO:tasks.workunit.client.0.smithi111.stdout:0/642: write d3/d74/fde [1147338,103782] 0 2024-09-11T00:07:22.272 INFO:tasks.workunit.client.1.smithi203.stdout:5/660: write dc/dd/d9b/fb0 [325143,55547] 0 2024-09-11T00:07:22.273 INFO:tasks.workunit.client.0.smithi111.stdout:2/567: creat d0/d3/d12/fc4 x:0 0 0 2024-09-11T00:07:22.273 INFO:tasks.workunit.client.1.smithi203.stdout:8/580: write d1/d13/d3a/d4c/f5c [1673209,13824] 0 2024-09-11T00:07:22.276 INFO:tasks.workunit.client.0.smithi111.stdout:1/578: dwrite d2/de/d93/fa7 [0,4194304] 0 2024-09-11T00:07:22.279 INFO:tasks.workunit.client.1.smithi203.stdout:7/584: truncate dd/d4d/f73 719962 0 2024-09-11T00:07:22.281 INFO:tasks.workunit.client.0.smithi111.stdout:7/590: creat dd/d48/d69/fbb x:0 0 0 2024-09-11T00:07:22.285 INFO:tasks.workunit.client.1.smithi203.stdout:6/569: mkdir d0/d54/d9c/d35/d39/db2 0 2024-09-11T00:07:22.288 INFO:tasks.workunit.client.0.smithi111.stdout:3/587: dwrite d1c/d1d/d22/d31/d33/d5f/fa7 [0,4194304] 0 2024-09-11T00:07:22.288 INFO:tasks.workunit.client.0.smithi111.stdout:9/636: truncate d6/db/d1b/d41/f57 487435 0 2024-09-11T00:07:22.292 INFO:tasks.workunit.client.1.smithi203.stdout:4/516: dwrite db/dd/d16/f4f [0,4194304] 0 2024-09-11T00:07:22.305 INFO:tasks.workunit.client.1.smithi203.stdout:1/644: mkdir d8/d19/d60/d90/de6 0 2024-09-11T00:07:22.305 INFO:tasks.workunit.client.1.smithi203.stdout:8/581: dwrite d1/d13/d17/d2f/d52/d49/f93 [0,4194304] 0 2024-09-11T00:07:22.308 INFO:tasks.workunit.client.0.smithi111.stdout:1/579: unlink d2/de/d12/d3c/fa8 0 2024-09-11T00:07:22.314 INFO:tasks.workunit.client.1.smithi203.stdout:7/585: creat dd/d3b/fd6 x:0 0 0 2024-09-11T00:07:22.325 INFO:tasks.workunit.client.0.smithi111.stdout:7/591: unlink dd/d1d/d1f/d24/c41 0 2024-09-11T00:07:22.326 INFO:tasks.workunit.client.1.smithi203.stdout:6/570: chown d0/l20 416 1 2024-09-11T00:07:22.326 INFO:tasks.workunit.client.1.smithi203.stdout:9/594: creat d6/de/d19/d24/d40/d45/fc7 x:0 0 0 2024-09-11T00:07:22.327 INFO:tasks.workunit.client.1.smithi203.stdout:3/603: write d8/f16 [2895868,60122] 0 2024-09-11T00:07:22.331 INFO:tasks.workunit.client.1.smithi203.stdout:9/595: write d6/de/d19/f3e [716125,128834] 0 2024-09-11T00:07:22.332 INFO:tasks.workunit.client.0.smithi111.stdout:9/637: unlink d6/db/d1b/d56/l85 0 2024-09-11T00:07:22.336 INFO:tasks.workunit.client.0.smithi111.stdout:6/542: truncate d7/f30 1713651 0 2024-09-11T00:07:22.337 INFO:tasks.workunit.client.1.smithi203.stdout:2/621: rename d13/d15/d19/d1c/f2a to d13/fca 0 2024-09-11T00:07:22.340 INFO:tasks.workunit.client.0.smithi111.stdout:8/622: mkdir d11/d21/d38/d54/dc3/dc6 0 2024-09-11T00:07:22.340 INFO:tasks.workunit.client.1.smithi203.stdout:2/622: write d13/d15/d19/d1c/d76/f8e [3556024,492] 0 2024-09-11T00:07:22.340 INFO:tasks.workunit.client.0.smithi111.stdout:7/592: dwrite dd/d48/d69/fbb [0,4194304] 0 2024-09-11T00:07:22.342 INFO:tasks.workunit.client.1.smithi203.stdout:8/582: write d1/d13/d17/d48/fc0 [306987,116329] 0 2024-09-11T00:07:22.343 INFO:tasks.workunit.client.0.smithi111.stdout:5/621: truncate d10/d1e/d23/d26/d3a/f87 2346800 0 2024-09-11T00:07:22.345 INFO:tasks.workunit.client.1.smithi203.stdout:8/583: fsync d1/d13/d17/f62 0 2024-09-11T00:07:22.347 INFO:tasks.workunit.client.0.smithi111.stdout:5/622: chown d10/d1e/d23/d30/d3c/d60/da2/d66/l69 161441 1 2024-09-11T00:07:22.349 INFO:tasks.workunit.client.1.smithi203.stdout:0/561: dwrite d0/d1d/d5d/f71 [0,4194304] 0 2024-09-11T00:07:22.349 INFO:tasks.workunit.client.1.smithi203.stdout:8/584: stat d1/d13/d3a/d4c/f5c 0 2024-09-11T00:07:22.349 INFO:tasks.workunit.client.0.smithi111.stdout:2/568: mkdir d0/d3/de/d3b/d63/dc5 0 2024-09-11T00:07:22.351 INFO:tasks.workunit.client.0.smithi111.stdout:5/623: write d10/d1e/d23/d2b/fa0 [944786,116505] 0 2024-09-11T00:07:22.351 INFO:tasks.workunit.client.0.smithi111.stdout:3/588: symlink d1c/d1d/dac/lcc 0 2024-09-11T00:07:22.352 INFO:tasks.workunit.client.0.smithi111.stdout:6/543: dwrite d7/d22/d3f/f65 [0,4194304] 0 2024-09-11T00:07:22.355 INFO:tasks.workunit.client.0.smithi111.stdout:6/544: stat d7/f12 0 2024-09-11T00:07:22.355 INFO:tasks.workunit.client.0.smithi111.stdout:3/589: chown d1c/d1d/d22/d23/lc6 13 1 2024-09-11T00:07:22.364 INFO:tasks.workunit.client.0.smithi111.stdout:7/593: dwrite dd/d1d/d4d/fb3 [0,4194304] 0 2024-09-11T00:07:22.365 INFO:tasks.workunit.client.0.smithi111.stdout:5/624: read d10/d1e/d25/f75 [451783,73138] 0 2024-09-11T00:07:22.367 INFO:tasks.workunit.client.0.smithi111.stdout:9/638: rename d6/db/d34/d37/d4c/d99/da4 to d6/db/db8/dce/dcf 0 2024-09-11T00:07:22.374 INFO:tasks.workunit.client.1.smithi203.stdout:6/571: fdatasync d0/d54/d9c/d35/d38/f49 0 2024-09-11T00:07:22.374 INFO:tasks.workunit.client.1.smithi203.stdout:8/585: dwrite d1/d13/d17/d2f/d52/fa0 [0,4194304] 0 2024-09-11T00:07:22.383 INFO:tasks.workunit.client.1.smithi203.stdout:4/517: getdents db/d12/d15/d2a/d71 0 2024-09-11T00:07:22.387 INFO:tasks.workunit.client.0.smithi111.stdout:2/569: chown d0/d3/de/d3b/d92/fc2 986 1 2024-09-11T00:07:22.389 INFO:tasks.workunit.client.1.smithi203.stdout:2/623: mkdir d13/d56/d69/dcb 0 2024-09-11T00:07:22.390 INFO:tasks.workunit.client.1.smithi203.stdout:2/624: chown d13/d56 25693304 1 2024-09-11T00:07:22.391 INFO:tasks.workunit.client.1.smithi203.stdout:6/572: dread d0/d54/f61 [0,4194304] 0 2024-09-11T00:07:22.392 INFO:tasks.workunit.client.0.smithi111.stdout:6/545: mknod d7/d22/d2c/d38/d56/cbc 0 2024-09-11T00:07:22.392 INFO:tasks.workunit.client.1.smithi203.stdout:7/586: write dd/d1c/d52/d8f/d31/f50 [1110687,63165] 0 2024-09-11T00:07:22.393 INFO:tasks.workunit.client.0.smithi111.stdout:8/623: dread d11/d23/f4e [0,4194304] 0 2024-09-11T00:07:22.394 INFO:tasks.workunit.client.0.smithi111.stdout:1/580: dwrite d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/f8b [0,4194304] 0 2024-09-11T00:07:22.394 INFO:tasks.workunit.client.0.smithi111.stdout:6/546: readlink d7/d22/l48 0 2024-09-11T00:07:22.395 INFO:tasks.workunit.client.1.smithi203.stdout:5/661: rmdir dc/dd/d9b/dae/dd5 0 2024-09-11T00:07:22.396 INFO:tasks.workunit.client.0.smithi111.stdout:8/624: stat d11/d21/d38/d54/l7a 0 2024-09-11T00:07:22.399 INFO:tasks.workunit.client.1.smithi203.stdout:0/562: rename d0/d2/d92/db8 to d0/d1d/d5d/dba 0 2024-09-11T00:07:22.400 INFO:tasks.workunit.client.1.smithi203.stdout:7/587: dread - dd/d1c/d52/d8f/d31/d58/d93/d98/fd4 zero size 2024-09-11T00:07:22.401 INFO:tasks.workunit.client.0.smithi111.stdout:9/639: chown d6/db/d1b/f4e 325027 1 2024-09-11T00:07:22.403 INFO:tasks.workunit.client.0.smithi111.stdout:6/547: truncate d7/d22/d3f/d74/d7f/d79/da4/fb9 454091 0 2024-09-11T00:07:22.403 INFO:tasks.workunit.client.0.smithi111.stdout:5/625: rename d10/d1e/l2e to d10/d1e/d23/d30/d59/d52/d85/lc5 0 2024-09-11T00:07:22.405 INFO:tasks.workunit.client.0.smithi111.stdout:4/564: rename d18/d20/d40/c7e to d18/d20/d40/cab 0 2024-09-11T00:07:22.410 INFO:tasks.workunit.client.0.smithi111.stdout:2/570: fdatasync d0/f1a 0 2024-09-11T00:07:22.415 INFO:tasks.workunit.client.0.smithi111.stdout:3/590: mkdir d1c/d1d/d22/d44/d5a/dcd 0 2024-09-11T00:07:22.416 INFO:tasks.workunit.client.1.smithi203.stdout:3/604: dwrite d8/f3d [0,4194304] 0 2024-09-11T00:07:22.419 INFO:tasks.workunit.client.0.smithi111.stdout:7/594: dread dd/f63 [0,4194304] 0 2024-09-11T00:07:22.420 INFO:tasks.workunit.client.0.smithi111.stdout:7/595: chown dd/f63 39574 1 2024-09-11T00:07:22.422 INFO:tasks.workunit.client.0.smithi111.stdout:2/571: dread d0/d3/de/f1e [0,4194304] 0 2024-09-11T00:07:22.439 INFO:tasks.workunit.client.0.smithi111.stdout:0/643: getdents d3/da/d7b/d84 0 2024-09-11T00:07:22.445 INFO:tasks.workunit.client.0.smithi111.stdout:0/644: dread - d3/d13/d1e/d29/d49/d51/d61/d93/da7/fc6 zero size 2024-09-11T00:07:22.445 INFO:tasks.workunit.client.0.smithi111.stdout:1/581: creat d2/de/d12/d3c/d4b/d6a/d63/d73/da1/db9/fc5 x:0 0 0 2024-09-11T00:07:22.446 INFO:tasks.workunit.client.0.smithi111.stdout:8/625: dwrite f8 [0,4194304] 0 2024-09-11T00:07:22.448 INFO:tasks.workunit.client.0.smithi111.stdout:7/596: dread dd/d1d/d4d/f60 [0,4194304] 0 2024-09-11T00:07:22.449 INFO:tasks.workunit.client.0.smithi111.stdout:8/626: fsync d11/d23/d2c/d46/f63 0 2024-09-11T00:07:22.449 INFO:tasks.workunit.client.0.smithi111.stdout:9/640: rename d6/db/d34/f66 to d6/db/d1b/d56/dc8/fd0 0 2024-09-11T00:07:22.450 INFO:tasks.workunit.client.0.smithi111.stdout:9/641: chown d6/d52/d8a/d92 6 1 2024-09-11T00:07:22.451 INFO:tasks.workunit.client.0.smithi111.stdout:5/626: getdents d10/d1e/d23/d2b/d92/db8 0 2024-09-11T00:07:22.468 INFO:tasks.workunit.client.0.smithi111.stdout:3/591: write d1c/d1d/d22/d23/d2f/d63/f6b [2506172,93847] 0 2024-09-11T00:07:22.468 INFO:tasks.workunit.client.0.smithi111.stdout:1/582: rmdir d2/d77 39 2024-09-11T00:07:22.468 INFO:tasks.workunit.client.0.smithi111.stdout:4/565: dwrite d18/d20/f85 [0,4194304] 0 2024-09-11T00:07:22.470 INFO:tasks.workunit.client.0.smithi111.stdout:4/566: write d18/d20/f30 [1596549,14732] 0 2024-09-11T00:07:22.472 INFO:tasks.workunit.client.0.smithi111.stdout:4/567: chown d18/d20/d3c/d5e/d75/f9b 0 1 2024-09-11T00:07:22.475 INFO:tasks.workunit.client.0.smithi111.stdout:6/548: write d7/d22/d3f/d74/d7f/d61/d6a/d9f/fb1 [2360426,113041] 0 2024-09-11T00:07:22.478 INFO:tasks.workunit.client.0.smithi111.stdout:8/627: chown ca 414574 1 2024-09-11T00:07:22.479 INFO:tasks.workunit.client.0.smithi111.stdout:9/642: chown d6/dc/d73/fb9 140 1 2024-09-11T00:07:22.484 INFO:tasks.workunit.client.0.smithi111.stdout:2/572: truncate d0/d3/de/d3b/d63/f75 75635 0 2024-09-11T00:07:22.489 INFO:tasks.workunit.client.1.smithi203.stdout:1/645: creat d8/d19/d60/d90/d3e/d4b/d80/fe7 x:0 0 0 2024-09-11T00:07:22.491 INFO:tasks.workunit.client.0.smithi111.stdout:1/583: creat d2/de/d12/d3c/d4b/d6a/d63/d73/da1/fc6 x:0 0 0 2024-09-11T00:07:22.492 INFO:tasks.workunit.client.0.smithi111.stdout:1/584: dread - d2/de/f53 zero size 2024-09-11T00:07:22.493 INFO:tasks.workunit.client.0.smithi111.stdout:4/568: creat d18/d20/d40/d78/d79/fac x:0 0 0 2024-09-11T00:07:22.493 INFO:tasks.workunit.client.0.smithi111.stdout:4/569: fdatasync d18/f71 0 2024-09-11T00:07:22.496 INFO:tasks.workunit.client.0.smithi111.stdout:4/570: chown d18/f32 43946206 1 2024-09-11T00:07:22.496 INFO:tasks.workunit.client.0.smithi111.stdout:7/597: dwrite dd/d1d/d7e/f9e [0,4194304] 0 2024-09-11T00:07:22.496 INFO:tasks.workunit.client.0.smithi111.stdout:5/627: mkdir d10/d1e/d23/d30/d3c/d60/dc6 0 2024-09-11T00:07:22.498 INFO:tasks.workunit.client.0.smithi111.stdout:1/585: write d2/de/d12/d3c/d4b/d6a/f3d [1714744,112802] 0 2024-09-11T00:07:22.499 INFO:tasks.workunit.client.1.smithi203.stdout:5/662: fsync dc/dd/d1e/d7b/fb1 0 2024-09-11T00:07:22.499 INFO:tasks.workunit.client.0.smithi111.stdout:9/643: mkdir d6/d52/d8a/dd1 0 2024-09-11T00:07:22.502 INFO:tasks.workunit.client.0.smithi111.stdout:2/573: unlink d0/d3/d12/d52/fbc 0 2024-09-11T00:07:22.505 INFO:tasks.workunit.client.0.smithi111.stdout:5/628: chown d10/d1e/d23/d26/d78/lb0 85933 1 2024-09-11T00:07:22.507 INFO:tasks.workunit.client.0.smithi111.stdout:4/571: symlink d18/d39/lad 0 2024-09-11T00:07:22.511 INFO:tasks.workunit.client.1.smithi203.stdout:3/605: rename d8/d17/cae to d8/da/d37/d83/d65/cdf 0 2024-09-11T00:07:22.511 INFO:tasks.workunit.client.0.smithi111.stdout:4/572: dread - d18/d1f/f93 zero size 2024-09-11T00:07:22.513 INFO:tasks.workunit.client.0.smithi111.stdout:3/592: dwrite d1c/d1d/d22/f5b [0,4194304] 0 2024-09-11T00:07:22.516 INFO:tasks.workunit.client.1.smithi203.stdout:9/596: link d6/de/d19/f31 d6/de/d32/d9e/fc8 0 2024-09-11T00:07:22.517 INFO:tasks.workunit.client.0.smithi111.stdout:4/573: readlink d18/d20/d4a/l48 0 2024-09-11T00:07:22.517 INFO:tasks.workunit.client.1.smithi203.stdout:9/597: stat d6/de/dc4/f77 0 2024-09-11T00:07:22.517 INFO:tasks.workunit.client.0.smithi111.stdout:3/593: fsync d1c/d1d/d22/d23/d2f/f8e 0 2024-09-11T00:07:22.521 INFO:tasks.workunit.client.0.smithi111.stdout:7/598: dwrite dd/da6/faa [0,4194304] 0 2024-09-11T00:07:22.523 INFO:tasks.workunit.client.0.smithi111.stdout:6/549: dwrite d7/d22/d3f/f42 [0,4194304] 0 2024-09-11T00:07:22.525 INFO:tasks.workunit.client.1.smithi203.stdout:7/588: dread dd/d1c/d52/d8f/d31/d4a/d6e/fa5 [0,4194304] 0 2024-09-11T00:07:22.525 INFO:tasks.workunit.client.0.smithi111.stdout:7/599: truncate dd/d1d/d4b/d8f/dac/faf 2536224 0 2024-09-11T00:07:22.525 INFO:tasks.workunit.client.0.smithi111.stdout:6/550: write d7/d22/d26/f73 [691714,39855] 0 2024-09-11T00:07:22.528 INFO:tasks.workunit.client.0.smithi111.stdout:7/600: chown dd/d1d/d4b/d8f/d9f/d79 883857 1 2024-09-11T00:07:22.528 INFO:tasks.workunit.client.0.smithi111.stdout:6/551: chown d7/d22/d3f/d74/d7f/c63 603 1 2024-09-11T00:07:22.529 INFO:tasks.workunit.client.1.smithi203.stdout:2/625: symlink d13/d56/lcc 0 2024-09-11T00:07:22.529 INFO:tasks.workunit.client.1.smithi203.stdout:7/589: write dd/d1c/f57 [1247096,91983] 0 2024-09-11T00:07:22.530 INFO:tasks.workunit.client.0.smithi111.stdout:9/644: unlink d6/db/d34/f3d 0 2024-09-11T00:07:22.534 INFO:tasks.workunit.client.1.smithi203.stdout:2/626: fdatasync d13/d15/d19/d1c/f3d 0 2024-09-11T00:07:22.539 INFO:tasks.workunit.client.1.smithi203.stdout:0/563: dwrite d0/d2/f65 [0,4194304] 0 2024-09-11T00:07:22.539 INFO:tasks.workunit.client.1.smithi203.stdout:6/573: link d0/d54/d9c/f18 d0/d54/d9c/d35/d39/db2/fb3 0 2024-09-11T00:07:22.542 INFO:tasks.workunit.client.0.smithi111.stdout:5/629: creat d10/d1e/d23/d26/d3a/d98/d6d/fc7 x:0 0 0 2024-09-11T00:07:22.549 INFO:tasks.workunit.client.1.smithi203.stdout:6/574: chown d0/d54/d9c/f18 122071859 1 2024-09-11T00:07:22.551 INFO:tasks.workunit.client.1.smithi203.stdout:8/586: rmdir d1/d13/d3a/daa 0 2024-09-11T00:07:22.553 INFO:tasks.workunit.client.0.smithi111.stdout:4/574: mkdir d18/d3b/dae 0 2024-09-11T00:07:22.554 INFO:tasks.workunit.client.1.smithi203.stdout:8/587: write d1/d13/d17/f38 [987745,104828] 0 2024-09-11T00:07:22.554 INFO:tasks.workunit.client.1.smithi203.stdout:3/606: truncate d8/da/d37/d83/d6a/f87 929517 0 2024-09-11T00:07:22.555 INFO:tasks.workunit.client.0.smithi111.stdout:3/594: creat d1c/d1d/d22/d31/d33/fce x:0 0 0 2024-09-11T00:07:22.555 INFO:tasks.workunit.client.1.smithi203.stdout:4/518: link db/cf db/dd/d16/d38/ca2 0 2024-09-11T00:07:22.556 INFO:tasks.workunit.client.1.smithi203.stdout:8/588: stat d1/d13/d17/d48/f53 0 2024-09-11T00:07:22.558 INFO:tasks.workunit.client.0.smithi111.stdout:1/586: mkdir d2/de/d12/dc7 0 2024-09-11T00:07:22.558 INFO:tasks.workunit.client.0.smithi111.stdout:4/575: write d18/d20/d4a/f64 [1154220,39993] 0 2024-09-11T00:07:22.558 INFO:tasks.workunit.client.1.smithi203.stdout:3/607: chown d8/da/d11/cda 26426 1 2024-09-11T00:07:22.559 INFO:tasks.workunit.client.1.smithi203.stdout:1/646: mknod d8/d19/d60/d90/d3e/d4b/d80/ce8 0 2024-09-11T00:07:22.560 INFO:tasks.workunit.client.0.smithi111.stdout:2/574: mknod d0/d3/de/db4/cc6 0 2024-09-11T00:07:22.561 INFO:tasks.workunit.client.0.smithi111.stdout:2/575: chown d0/d3/de/d3b 17422 1 2024-09-11T00:07:22.561 INFO:tasks.workunit.client.1.smithi203.stdout:3/608: chown d8/da/d37/d53/d63/fbf 12 1 2024-09-11T00:07:22.565 INFO:tasks.workunit.client.0.smithi111.stdout:9/645: creat d6/d52/d8a/fd2 x:0 0 0 2024-09-11T00:07:22.567 INFO:tasks.workunit.client.1.smithi203.stdout:1/647: truncate d8/d19/d60/d90/d3e/d4b/d80/d91/dac/fe4 154618 0 2024-09-11T00:07:22.567 INFO:tasks.workunit.client.1.smithi203.stdout:2/627: creat d13/d56/d69/d99/fcd x:0 0 0 2024-09-11T00:07:22.568 INFO:tasks.workunit.client.0.smithi111.stdout:6/552: truncate d7/d22/d2c/f62 931812 0 2024-09-11T00:07:22.570 INFO:tasks.workunit.client.0.smithi111.stdout:6/553: write d7/d22/d3f/d74/f9e [784675,91847] 0 2024-09-11T00:07:22.573 INFO:tasks.workunit.client.1.smithi203.stdout:5/663: mkdir dc/ddf 0 2024-09-11T00:07:22.574 INFO:tasks.workunit.client.1.smithi203.stdout:6/575: mkdir d0/d5b/d5c/d6f/db4 0 2024-09-11T00:07:22.575 INFO:tasks.workunit.client.0.smithi111.stdout:2/576: fsync d0/f1a 0 2024-09-11T00:07:22.576 INFO:tasks.workunit.client.1.smithi203.stdout:5/664: stat dc/dd/d15/d3b/d73 0 2024-09-11T00:07:22.577 INFO:tasks.workunit.client.0.smithi111.stdout:4/576: dread d18/f81 [0,4194304] 0 2024-09-11T00:07:22.578 INFO:tasks.workunit.client.1.smithi203.stdout:4/519: readlink db/d12/d15/d2a/l85 0 2024-09-11T00:07:22.580 INFO:tasks.workunit.client.0.smithi111.stdout:5/630: unlink d10/d1e/d23/d26/f4c 0 2024-09-11T00:07:22.580 INFO:tasks.workunit.client.1.smithi203.stdout:6/576: chown d0/d54/d9c/d7b/f8a 0 1 2024-09-11T00:07:22.583 INFO:tasks.workunit.client.1.smithi203.stdout:7/590: link dd/d1c/d52/d8f/d31/d67/dc8/fb6 dd/d3b/fd7 0 2024-09-11T00:07:22.585 INFO:tasks.workunit.client.0.smithi111.stdout:6/554: unlink d7/d22/d26/d87/d41/f66 0 2024-09-11T00:07:22.586 INFO:tasks.workunit.client.1.smithi203.stdout:1/648: dwrite d8/d9/d15/d35/d81/da1/fdc [0,4194304] 0 2024-09-11T00:07:22.587 INFO:tasks.workunit.client.1.smithi203.stdout:2/628: creat d13/d15/d19/d1c/d76/d94/fce x:0 0 0 2024-09-11T00:07:22.589 INFO:tasks.workunit.client.1.smithi203.stdout:2/629: dread - d13/d22/f6f zero size 2024-09-11T00:07:22.591 INFO:tasks.workunit.client.0.smithi111.stdout:3/595: creat d1c/d1d/d22/d23/d58/d5c/fcf x:0 0 0 2024-09-11T00:07:22.600 INFO:tasks.workunit.client.0.smithi111.stdout:9/646: mknod d6/db/d34/cd3 0 2024-09-11T00:07:22.602 INFO:tasks.workunit.client.1.smithi203.stdout:4/520: creat db/dd/d26/fa3 x:0 0 0 2024-09-11T00:07:22.604 INFO:tasks.workunit.client.1.smithi203.stdout:6/577: symlink d0/d71/lb5 0 2024-09-11T00:07:22.605 INFO:tasks.workunit.client.1.smithi203.stdout:3/609: dread d8/da/d5c/d99/fd3 [0,4194304] 0 2024-09-11T00:07:22.608 INFO:tasks.workunit.client.1.smithi203.stdout:7/591: rmdir dd/d1c/d7c/d8c 39 2024-09-11T00:07:22.609 INFO:tasks.workunit.client.1.smithi203.stdout:2/630: dwrite d13/d47/f8c [0,4194304] 0 2024-09-11T00:07:22.613 INFO:tasks.workunit.client.0.smithi111.stdout:2/577: dread d0/d3/de/f21 [0,4194304] 0 2024-09-11T00:07:22.615 INFO:tasks.workunit.client.0.smithi111.stdout:3/596: fdatasync d1c/d1d/d22/d31/d33/d5f/d98/fc3 0 2024-09-11T00:07:22.615 INFO:tasks.workunit.client.1.smithi203.stdout:1/649: readlink d8/d19/d60/d90/d3e/l48 0 2024-09-11T00:07:22.615 INFO:tasks.workunit.client.1.smithi203.stdout:1/650: chown d8/d19/d60/d90 19382 1 2024-09-11T00:07:22.625 INFO:tasks.workunit.client.0.smithi111.stdout:6/555: mknod d7/d22/cbd 0 2024-09-11T00:07:22.628 INFO:tasks.workunit.client.1.smithi203.stdout:6/578: symlink d0/d54/d9c/d35/d38/d7d/d82/lb6 0 2024-09-11T00:07:22.629 INFO:tasks.workunit.client.0.smithi111.stdout:7/601: dwrite dd/f1b [4194304,4194304] 0 2024-09-11T00:07:22.630 INFO:tasks.workunit.client.1.smithi203.stdout:6/579: chown d0/d5b/l7c 45237112 1 2024-09-11T00:07:22.631 INFO:tasks.workunit.client.1.smithi203.stdout:7/592: unlink dd/d3b/d5b/f80 0 2024-09-11T00:07:22.632 INFO:tasks.workunit.client.0.smithi111.stdout:3/597: truncate d1c/d1d/f1e 3719989 0 2024-09-11T00:07:22.636 INFO:tasks.workunit.client.1.smithi203.stdout:7/593: read dd/d1c/d52/d8f/d31/d58/d93/d98/fb4 [44189,21128] 0 2024-09-11T00:07:22.636 INFO:tasks.workunit.client.1.smithi203.stdout:0/564: link d0/d1d/l2d d0/lbb 0 2024-09-11T00:07:22.639 INFO:tasks.workunit.client.0.smithi111.stdout:7/602: dread dd/f1b [4194304,4194304] 0 2024-09-11T00:07:22.641 INFO:tasks.workunit.client.1.smithi203.stdout:7/594: dread - dd/d1c/d52/d8f/d31/d58/d93/d98/fbd zero size 2024-09-11T00:07:22.646 INFO:tasks.workunit.client.0.smithi111.stdout:6/556: symlink d7/d22/d1d/d8c/lbe 0 2024-09-11T00:07:22.649 INFO:tasks.workunit.client.1.smithi203.stdout:6/580: unlink d0/d54/d9c/d35/d39/fab 0 2024-09-11T00:07:22.651 INFO:tasks.workunit.client.1.smithi203.stdout:2/631: unlink d13/fca 0 2024-09-11T00:07:22.652 INFO:tasks.workunit.client.0.smithi111.stdout:5/631: truncate d10/d1e/d23/d26/f3e 691420 0 2024-09-11T00:07:22.655 INFO:tasks.workunit.client.1.smithi203.stdout:3/610: write d8/da/d37/d53/da2/fbd [896252,45502] 0 2024-09-11T00:07:22.662 INFO:tasks.workunit.client.1.smithi203.stdout:4/521: creat db/d12/fa4 x:0 0 0 2024-09-11T00:07:22.663 INFO:tasks.workunit.client.1.smithi203.stdout:5/665: dwrite dc/dd/d15/f37 [0,4194304] 0 2024-09-11T00:07:22.664 INFO:tasks.workunit.client.1.smithi203.stdout:1/651: write d8/f49 [3424582,4048] 0 2024-09-11T00:07:22.666 INFO:tasks.workunit.client.1.smithi203.stdout:7/595: creat dd/d4d/fd8 x:0 0 0 2024-09-11T00:07:22.669 INFO:tasks.workunit.client.1.smithi203.stdout:6/581: creat d0/d32/d5a/fb7 x:0 0 0 2024-09-11T00:07:22.671 INFO:tasks.workunit.client.1.smithi203.stdout:2/632: mkdir d13/d15/d30/d5a/dcf 0 2024-09-11T00:07:22.675 INFO:tasks.workunit.client.1.smithi203.stdout:0/565: dread d0/f5 [0,4194304] 0 2024-09-11T00:07:22.677 INFO:tasks.workunit.client.1.smithi203.stdout:3/611: creat d8/da/d37/d83/d65/d8b/fe0 x:0 0 0 2024-09-11T00:07:22.679 INFO:tasks.workunit.client.1.smithi203.stdout:1/652: chown d8/d28/c45 40090 1 2024-09-11T00:07:22.687 INFO:tasks.workunit.client.1.smithi203.stdout:2/633: creat d13/d47/fd0 x:0 0 0 2024-09-11T00:07:22.687 INFO:tasks.workunit.client.1.smithi203.stdout:0/566: mknod d0/d2/d37/d5b/d73/db6/cbc 0 2024-09-11T00:07:22.695 INFO:tasks.workunit.client.1.smithi203.stdout:5/666: creat dc/dd/d15/dbd/d59/dbb/fe0 x:0 0 0 2024-09-11T00:07:22.695 INFO:tasks.workunit.client.1.smithi203.stdout:6/582: mkdir d0/d54/d9c/d35/db8 0 2024-09-11T00:07:22.695 INFO:tasks.workunit.client.1.smithi203.stdout:3/612: dread d8/da/d11/f55 [0,4194304] 0 2024-09-11T00:07:22.695 INFO:tasks.workunit.client.1.smithi203.stdout:1/653: stat d8/d19/d60/d90/d3e/d66/l72 0 2024-09-11T00:07:22.696 INFO:tasks.workunit.client.1.smithi203.stdout:0/567: rmdir d0/d87 39 2024-09-11T00:07:22.697 INFO:tasks.workunit.client.1.smithi203.stdout:0/568: chown d0/f18 34247 1 2024-09-11T00:07:22.700 INFO:tasks.workunit.client.1.smithi203.stdout:3/613: rmdir d8/da/d37/d83/da3 39 2024-09-11T00:07:22.701 INFO:tasks.workunit.client.1.smithi203.stdout:7/596: write dd/d1c/d52/f94 [176180,93567] 0 2024-09-11T00:07:22.703 INFO:tasks.workunit.client.1.smithi203.stdout:0/569: unlink d0/d1d/f3c 0 2024-09-11T00:07:22.705 INFO:tasks.workunit.client.1.smithi203.stdout:2/634: dwrite d13/d22/f4a [0,4194304] 0 2024-09-11T00:07:22.705 INFO:tasks.workunit.client.1.smithi203.stdout:5/667: truncate dc/dd/d1e/fbc 4163594 0 2024-09-11T00:07:22.708 INFO:tasks.workunit.client.1.smithi203.stdout:0/570: write d0/d2/d3d/d5a/d77/f95 [613005,31284] 0 2024-09-11T00:07:22.708 INFO:tasks.workunit.client.0.smithi111.stdout:4/577: write d18/d3b/d61/f7c [5499987,27678] 0 2024-09-11T00:07:22.708 INFO:tasks.workunit.client.0.smithi111.stdout:7/603: symlink dd/d1d/d1f/lbc 0 2024-09-11T00:07:22.709 INFO:tasks.workunit.client.0.smithi111.stdout:6/557: truncate f3 2373567 0 2024-09-11T00:07:22.709 INFO:tasks.workunit.client.1.smithi203.stdout:0/571: chown d0/d2/d7e/da1 1036565771 1 2024-09-11T00:07:22.711 INFO:tasks.workunit.client.1.smithi203.stdout:3/614: mkdir d8/da/d37/d53/da2/de1 0 2024-09-11T00:07:22.715 INFO:tasks.workunit.client.1.smithi203.stdout:2/635: rename d13/d15/f48 to d13/d95/daf/fd1 0 2024-09-11T00:07:22.716 INFO:tasks.workunit.client.0.smithi111.stdout:3/598: write d1c/d1d/f1e [2760896,1443] 0 2024-09-11T00:07:22.717 INFO:tasks.workunit.client.0.smithi111.stdout:7/604: chown dd/d48/l67 820440 1 2024-09-11T00:07:22.718 INFO:tasks.workunit.client.1.smithi203.stdout:2/636: chown d13/d15/d30/d5a/dac/cb7 3905 1 2024-09-11T00:07:22.719 INFO:tasks.workunit.client.0.smithi111.stdout:4/578: symlink d18/d1f/d36/laf 0 2024-09-11T00:07:22.719 INFO:tasks.workunit.client.1.smithi203.stdout:0/572: fsync d0/d2/fb 0 2024-09-11T00:07:22.723 INFO:tasks.workunit.client.0.smithi111.stdout:2/578: dwrite d0/d3/d12/f3d [0,4194304] 0 2024-09-11T00:07:22.724 INFO:tasks.workunit.client.0.smithi111.stdout:5/632: creat d10/d1e/d23/d30/d59/d7b/fc8 x:0 0 0 2024-09-11T00:07:22.727 INFO:tasks.workunit.client.0.smithi111.stdout:9/647: dwrite d6/f88 [0,4194304] 0 2024-09-11T00:07:22.727 INFO:tasks.workunit.client.1.smithi203.stdout:5/668: link dc/d91/fd6 dc/dd/d15/dbd/d59/dbb/fe1 0 2024-09-11T00:07:22.729 INFO:tasks.workunit.client.1.smithi203.stdout:6/583: dwrite d0/f23 [0,4194304] 0 2024-09-11T00:07:22.732 INFO:tasks.workunit.client.0.smithi111.stdout:3/599: chown d1c/d1d/d22/d31/d33/d5f/d98/cb9 318767 1 2024-09-11T00:07:22.735 INFO:tasks.workunit.client.0.smithi111.stdout:6/558: dwrite d7/d22/d3f/d74/f9e [0,4194304] 0 2024-09-11T00:07:22.735 INFO:tasks.workunit.client.1.smithi203.stdout:7/597: write dd/d1c/d52/d8f/d31/f36 [537113,84186] 0 2024-09-11T00:07:22.736 INFO:tasks.workunit.client.1.smithi203.stdout:2/637: dread - d13/d15/d19/f66 zero size 2024-09-11T00:07:22.737 INFO:tasks.workunit.client.1.smithi203.stdout:7/598: stat dd/d1c/d7c 0 2024-09-11T00:07:22.740 INFO:tasks.workunit.client.0.smithi111.stdout:4/579: mkdir d18/d20/d40/d78/d79/db0 0 2024-09-11T00:07:22.740 INFO:tasks.workunit.client.0.smithi111.stdout:3/600: stat fb 0 2024-09-11T00:07:22.741 INFO:tasks.workunit.client.0.smithi111.stdout:2/579: mkdir d0/d3/de/d3b/d92/dc7 0 2024-09-11T00:07:22.745 INFO:tasks.workunit.client.1.smithi203.stdout:3/615: creat d8/da/d37/d83/fe2 x:0 0 0 2024-09-11T00:07:22.745 INFO:tasks.workunit.client.1.smithi203.stdout:6/584: mkdir d0/d71/db9 0 2024-09-11T00:07:22.747 INFO:tasks.workunit.client.1.smithi203.stdout:3/616: chown d8/da/d37/f9f 38 1 2024-09-11T00:07:22.747 INFO:tasks.workunit.client.0.smithi111.stdout:3/601: dread - d1c/d1d/d22/d23/d2f/f8e zero size 2024-09-11T00:07:22.749 INFO:tasks.workunit.client.0.smithi111.stdout:6/559: mkdir d7/d22/d2c/d38/d56/dbf 0 2024-09-11T00:07:22.752 INFO:tasks.workunit.client.0.smithi111.stdout:2/580: rmdir d0/d3/de/d50/d9d 39 2024-09-11T00:07:22.754 INFO:tasks.workunit.client.1.smithi203.stdout:5/669: creat dc/d4f/d5c/dc9/fe2 x:0 0 0 2024-09-11T00:07:22.758 INFO:tasks.workunit.client.1.smithi203.stdout:6/585: fsync d0/d54/d9c/d35/d38/f2e 0 2024-09-11T00:07:22.760 INFO:tasks.workunit.client.1.smithi203.stdout:0/573: link d0/d2/c48 d0/d2/d7e/da1/cbd 0 2024-09-11T00:07:22.761 INFO:tasks.workunit.client.1.smithi203.stdout:0/574: stat d0/d1d/l5f 0 2024-09-11T00:07:22.762 INFO:tasks.workunit.client.0.smithi111.stdout:9/648: getdents d6/db/d1b/d74 0 2024-09-11T00:07:22.764 INFO:tasks.workunit.client.0.smithi111.stdout:7/605: dwrite dd/d1d/d2d/f86 [0,4194304] 0 2024-09-11T00:07:22.767 INFO:tasks.workunit.client.0.smithi111.stdout:7/606: write dd/da6/fab [2684451,58304] 0 2024-09-11T00:07:22.768 INFO:tasks.workunit.client.0.smithi111.stdout:9/649: stat d6/db/d34/d37/f29 0 2024-09-11T00:07:22.769 INFO:tasks.workunit.client.1.smithi203.stdout:5/670: dread dc/dd/f28 [0,4194304] 0 2024-09-11T00:07:22.772 INFO:tasks.workunit.client.0.smithi111.stdout:4/580: link d18/d20/d40/d78/d79/f8a d18/d20/d3c/d5e/d75/fb1 0 2024-09-11T00:07:22.775 INFO:tasks.workunit.client.1.smithi203.stdout:3/617: mknod d8/da/d5c/ce3 0 2024-09-11T00:07:22.776 INFO:tasks.workunit.client.0.smithi111.stdout:2/581: mknod d0/d3/de/d3b/d62/d6d/cc8 0 2024-09-11T00:07:22.777 INFO:tasks.workunit.client.1.smithi203.stdout:6/586: creat d0/d32/d5a/fba x:0 0 0 2024-09-11T00:07:22.781 INFO:tasks.workunit.client.1.smithi203.stdout:0/575: stat d0/d2/f41 0 2024-09-11T00:07:22.781 INFO:tasks.workunit.client.1.smithi203.stdout:7/599: write dd/d3b/f72 [140234,71432] 0 2024-09-11T00:07:22.789 INFO:tasks.workunit.client.0.smithi111.stdout:3/602: truncate d1c/d1d/d22/f5b 341166 0 2024-09-11T00:07:22.790 INFO:tasks.workunit.client.0.smithi111.stdout:9/650: truncate d6/db/d1b/d56/f72 171168 0 2024-09-11T00:07:22.792 INFO:tasks.workunit.client.1.smithi203.stdout:2/638: getdents d13 0 2024-09-11T00:07:22.793 INFO:tasks.workunit.client.0.smithi111.stdout:2/582: rename d0/d3/d12/d38/c77 to d0/d3/de/d3b/d92/dc7/cc9 0 2024-09-11T00:07:22.796 INFO:tasks.workunit.client.0.smithi111.stdout:6/560: link d7/d22/d3f/d74/d7f/d61/c7b d7/d22/d1d/d8c/d4a/cc0 0 2024-09-11T00:07:22.797 INFO:tasks.workunit.client.1.smithi203.stdout:0/576: dwrite d0/d9f/fb0 [0,4194304] 0 2024-09-11T00:07:22.797 INFO:tasks.workunit.client.1.smithi203.stdout:7/600: fdatasync dd/d4d/f5a 0 2024-09-11T00:07:22.800 INFO:tasks.workunit.client.0.smithi111.stdout:7/607: symlink dd/d1d/d76/db6/lbd 0 2024-09-11T00:07:22.800 INFO:tasks.workunit.client.1.smithi203.stdout:0/577: dread - d0/d2/d37/d5b/d73/fa7 zero size 2024-09-11T00:07:22.802 INFO:tasks.workunit.client.1.smithi203.stdout:5/671: write dc/d4f/d5c/d76/f78 [884199,82152] 0 2024-09-11T00:07:22.804 INFO:tasks.workunit.client.1.smithi203.stdout:0/578: write d0/d2/d7e/f8f [1553490,76297] 0 2024-09-11T00:07:22.806 INFO:tasks.workunit.client.1.smithi203.stdout:0/579: stat d0/d2/d7e/f8f 0 2024-09-11T00:07:22.812 INFO:tasks.workunit.client.1.smithi203.stdout:6/587: link d0/d54/d9c/d35/d39/f51 d0/d5b/d9f/fbb 0 2024-09-11T00:07:22.813 INFO:tasks.workunit.client.0.smithi111.stdout:2/583: dwrite d0/d3/fb8 [0,4194304] 0 2024-09-11T00:07:22.816 INFO:tasks.workunit.client.0.smithi111.stdout:7/608: mkdir dd/d48/d69/dbe 0 2024-09-11T00:07:22.816 INFO:tasks.workunit.client.1.smithi203.stdout:7/601: mkdir dd/d3b/d5b/dd9 0 2024-09-11T00:07:22.818 INFO:tasks.workunit.client.0.smithi111.stdout:2/584: chown d0/d3/f4e 14209 1 2024-09-11T00:07:22.820 INFO:tasks.workunit.client.1.smithi203.stdout:2/639: mknod d13/d56/cd2 0 2024-09-11T00:07:22.820 INFO:tasks.workunit.client.1.smithi203.stdout:7/602: write dd/d1c/d52/d8f/d31/d67/dc3/fd1 [203941,118302] 0 2024-09-11T00:07:22.821 INFO:tasks.workunit.client.0.smithi111.stdout:4/581: dwrite f8 [0,4194304] 0 2024-09-11T00:07:22.823 INFO:tasks.workunit.client.1.smithi203.stdout:5/672: fdatasync dc/d4f/d5c/f66 0 2024-09-11T00:07:22.824 INFO:tasks.workunit.client.1.smithi203.stdout:0/580: creat d0/d2/d37/d80/fbe x:0 0 0 2024-09-11T00:07:22.824 INFO:tasks.workunit.client.0.smithi111.stdout:3/603: link ld d1c/d1d/d22/d31/d62/ld0 0 2024-09-11T00:07:22.826 INFO:tasks.workunit.client.1.smithi203.stdout:5/673: dread - dc/dd/d15/d3b/d7a/f90 zero size 2024-09-11T00:07:22.827 INFO:tasks.workunit.client.0.smithi111.stdout:2/585: rmdir d0/d3/de/d3b/d63 39 2024-09-11T00:07:22.827 INFO:tasks.workunit.client.1.smithi203.stdout:0/581: truncate d0/faa 870814 0 2024-09-11T00:07:22.827 INFO:tasks.workunit.client.1.smithi203.stdout:3/618: getdents d8/da/d37/d83/dc0 0 2024-09-11T00:07:22.830 INFO:tasks.workunit.client.0.smithi111.stdout:4/582: read d18/d3b/d51/f5b [6469,117142] 0 2024-09-11T00:07:22.836 INFO:tasks.workunit.client.0.smithi111.stdout:3/604: fsync d1c/d1d/d22/d44/f56 0 2024-09-11T00:07:22.839 INFO:tasks.workunit.client.0.smithi111.stdout:3/605: dread - d1c/d1d/d22/d31/d33/d5f/f9d zero size 2024-09-11T00:07:22.839 INFO:tasks.workunit.client.0.smithi111.stdout:7/609: dwrite dd/d1d/d7e/f94 [0,4194304] 0 2024-09-11T00:07:22.840 INFO:tasks.workunit.client.0.smithi111.stdout:7/610: stat dd/d1d/d1f/d24/fb5 0 2024-09-11T00:07:22.842 INFO:tasks.workunit.client.0.smithi111.stdout:7/611: stat dd/l13 0 2024-09-11T00:07:22.843 INFO:tasks.workunit.client.1.smithi203.stdout:0/582: stat d0/c9 0 2024-09-11T00:07:22.846 INFO:tasks.workunit.client.0.smithi111.stdout:9/651: rename d6/c11 to d6/db/d1b/cd4 0 2024-09-11T00:07:22.850 INFO:tasks.workunit.client.1.smithi203.stdout:5/674: mkdir dc/dd/d1e/dc6/de3 0 2024-09-11T00:07:22.850 INFO:tasks.workunit.client.1.smithi203.stdout:3/619: dwrite d8/da/d5c/fd6 [0,4194304] 0 2024-09-11T00:07:22.851 INFO:tasks.workunit.client.0.smithi111.stdout:4/583: fsync f7 0 2024-09-11T00:07:22.854 INFO:tasks.workunit.client.1.smithi203.stdout:7/603: mknod dd/d1c/d52/d8f/d31/d58/d93/d98/db2/dd5/cda 0 2024-09-11T00:07:22.859 INFO:tasks.workunit.client.1.smithi203.stdout:7/604: fsync dd/d1c/d52/d8f/d31/d58/d93/d98/fbd 0 2024-09-11T00:07:22.862 INFO:tasks.workunit.client.1.smithi203.stdout:2/640: write d13/d22/f3f [447360,34372] 0 2024-09-11T00:07:22.863 INFO:tasks.workunit.client.0.smithi111.stdout:3/606: creat d1c/d1d/fd1 x:0 0 0 2024-09-11T00:07:22.866 INFO:tasks.workunit.client.0.smithi111.stdout:7/612: rmdir dd/da6 39 2024-09-11T00:07:22.869 INFO:tasks.workunit.client.1.smithi203.stdout:3/620: rename d8/da/d5c/d6b/d6c/f7b to d8/d17/ddd/fe4 0 2024-09-11T00:07:22.870 INFO:tasks.workunit.client.1.smithi203.stdout:6/588: dread d0/d54/d9c/d35/f99 [0,4194304] 0 2024-09-11T00:07:22.870 INFO:tasks.workunit.client.1.smithi203.stdout:3/621: chown d8/d17/c1d 717205795 1 2024-09-11T00:07:22.873 INFO:tasks.workunit.client.1.smithi203.stdout:5/675: mknod dc/ce4 0 2024-09-11T00:07:22.875 INFO:tasks.workunit.client.1.smithi203.stdout:5/676: readlink dc/dd/d9b/lcd 0 2024-09-11T00:07:22.876 INFO:tasks.workunit.client.1.smithi203.stdout:2/641: fdatasync d13/d95/daf/fd1 0 2024-09-11T00:07:22.876 INFO:tasks.workunit.client.0.smithi111.stdout:2/586: write d0/d3/de/d3b/f58 [4022526,120457] 0 2024-09-11T00:07:22.876 INFO:tasks.workunit.client.0.smithi111.stdout:8/628: sync 2024-09-11T00:07:22.877 INFO:tasks.workunit.client.0.smithi111.stdout:0/645: sync 2024-09-11T00:07:22.877 INFO:tasks.workunit.client.1.smithi203.stdout:5/677: truncate dc/d91/fd6 183878 0 2024-09-11T00:07:22.877 INFO:tasks.workunit.client.1.smithi203.stdout:2/642: truncate d13/d47/f54 4197021 0 2024-09-11T00:07:22.878 INFO:tasks.workunit.client.1.smithi203.stdout:7/605: mkdir dd/d1c/d52/d8f/d31/d67/dc3/ddb 0 2024-09-11T00:07:22.879 INFO:tasks.workunit.client.1.smithi203.stdout:0/583: write d0/d2/d37/f47 [1125453,100886] 0 2024-09-11T00:07:22.879 INFO:tasks.workunit.client.0.smithi111.stdout:3/607: mkdir d1c/d1d/d22/d44/d5a/dcd/dd2 0 2024-09-11T00:07:22.883 INFO:tasks.workunit.client.1.smithi203.stdout:6/589: creat d0/d5b/d5c/d6f/fbc x:0 0 0 2024-09-11T00:07:22.886 INFO:tasks.workunit.client.0.smithi111.stdout:8/629: dread - d11/d21/d38/f9e zero size 2024-09-11T00:07:22.886 INFO:tasks.workunit.client.1.smithi203.stdout:2/643: rmdir d13/d56/d69 39 2024-09-11T00:07:22.890 INFO:tasks.workunit.client.0.smithi111.stdout:0/646: write d3/f7 [1498655,69630] 0 2024-09-11T00:07:22.894 INFO:tasks.workunit.client.0.smithi111.stdout:7/613: link dd/d1d/d4b/d8f/d9f/l7f dd/d1d/d1f/d24/lbf 0 2024-09-11T00:07:22.894 INFO:tasks.workunit.client.0.smithi111.stdout:8/630: symlink d11/d21/lc7 0 2024-09-11T00:07:22.896 INFO:tasks.workunit.client.0.smithi111.stdout:2/587: dread d0/d3/de/f1e [0,4194304] 0 2024-09-11T00:07:22.896 INFO:tasks.workunit.client.1.smithi203.stdout:5/678: mkdir dc/dd/d15/dbd/de5 0 2024-09-11T00:07:22.896 INFO:tasks.workunit.client.0.smithi111.stdout:7/614: chown dd/d1d/d4d/f60 56121 1 2024-09-11T00:07:22.897 INFO:tasks.workunit.client.0.smithi111.stdout:8/631: fdatasync d11/d23/d2c/d46/f63 0 2024-09-11T00:07:22.899 INFO:tasks.workunit.client.1.smithi203.stdout:3/622: write d8/da/d11/f5d [1704223,108762] 0 2024-09-11T00:07:22.899 INFO:tasks.workunit.client.0.smithi111.stdout:9/652: getdents d6/d52 0 2024-09-11T00:07:22.901 INFO:tasks.workunit.client.1.smithi203.stdout:2/644: unlink d13/d15/d19/d1c/f3d 0 2024-09-11T00:07:22.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:22 smithi111 ceph-mon[27539]: pgmap v9: 65 pgs: 65 active+clean; 2.4 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 64 MiB/s rd, 184 MiB/s wr, 374 op/s 2024-09-11T00:07:22.910 INFO:tasks.workunit.client.1.smithi203.stdout:3/623: write d8/d3c/fa8 [2368268,71796] 0 2024-09-11T00:07:22.911 INFO:tasks.workunit.client.1.smithi203.stdout:6/590: dread d0/d54/d9c/d35/d39/db2/fb3 [4194304,4194304] 0 2024-09-11T00:07:22.912 INFO:tasks.workunit.client.1.smithi203.stdout:3/624: dread - d8/da/d37/d83/fc2 zero size 2024-09-11T00:07:22.914 INFO:tasks.workunit.client.1.smithi203.stdout:2/645: unlink d13/d22/f4e 0 2024-09-11T00:07:22.914 INFO:tasks.workunit.client.1.smithi203.stdout:6/591: write d0/d32/f43 [1002105,21104] 0 2024-09-11T00:07:22.914 INFO:tasks.workunit.client.0.smithi111.stdout:3/608: truncate d1c/d1d/f1f 840842 0 2024-09-11T00:07:22.915 INFO:tasks.workunit.client.1.smithi203.stdout:2/646: chown d13/d15/d30 374516 1 2024-09-11T00:07:22.916 INFO:tasks.workunit.client.0.smithi111.stdout:3/609: dread - d1c/d21/dae/fcb zero size 2024-09-11T00:07:22.916 INFO:tasks.workunit.client.1.smithi203.stdout:0/584: truncate d0/faa 23284 0 2024-09-11T00:07:22.917 INFO:tasks.workunit.client.1.smithi203.stdout:5/679: symlink dc/dd/d15/dbd/de5/le6 0 2024-09-11T00:07:22.918 INFO:tasks.workunit.client.0.smithi111.stdout:8/632: truncate d11/d23/d2c/d46/f8c 984729 0 2024-09-11T00:07:22.919 INFO:tasks.workunit.client.1.smithi203.stdout:7/606: truncate dd/d1c/d52/d8f/d31/d67/f79 272964 0 2024-09-11T00:07:22.921 INFO:tasks.workunit.client.0.smithi111.stdout:9/653: truncate d6/db/d1b/d41/f57 1467374 0 2024-09-11T00:07:22.924 INFO:tasks.workunit.client.0.smithi111.stdout:0/647: rename d3/d13/d1e/d29/d49/d51 to d3/d13/d1e/deb 0 2024-09-11T00:07:22.924 INFO:tasks.workunit.client.1.smithi203.stdout:6/592: mknod d0/d54/d9c/d7b/cbd 0 2024-09-11T00:07:22.925 INFO:tasks.workunit.client.0.smithi111.stdout:2/588: dwrite d0/d3/de/f21 [0,4194304] 0 2024-09-11T00:07:22.926 INFO:tasks.workunit.client.0.smithi111.stdout:0/648: chown d3/d13/d1e/deb/d61/d93/da7/fc6 2 1 2024-09-11T00:07:22.928 INFO:tasks.workunit.client.1.smithi203.stdout:0/585: unlink d0/d1d/c9d 0 2024-09-11T00:07:22.933 INFO:tasks.workunit.client.1.smithi203.stdout:2/647: dwrite d13/d95/daf/fd1 [0,4194304] 0 2024-09-11T00:07:22.936 INFO:tasks.workunit.client.1.smithi203.stdout:5/680: rename dc/d4f/fa0 to dc/dd/d15/dbd/de5/fe7 0 2024-09-11T00:07:22.937 INFO:tasks.workunit.client.1.smithi203.stdout:2/648: read f8 [3669274,54024] 0 2024-09-11T00:07:22.938 INFO:tasks.workunit.client.0.smithi111.stdout:8/633: creat d11/d23/d2c/d46/fc8 x:0 0 0 2024-09-11T00:07:22.940 INFO:tasks.workunit.client.1.smithi203.stdout:6/593: mkdir d0/d5b/d9f/dbe 0 2024-09-11T00:07:22.948 INFO:tasks.workunit.client.0.smithi111.stdout:2/589: unlink d0/d3/c5e 0 2024-09-11T00:07:22.950 INFO:tasks.workunit.client.1.smithi203.stdout:0/586: dwrite d0/d2/d3d/d5a/d77/f95 [0,4194304] 0 2024-09-11T00:07:22.953 INFO:tasks.workunit.client.0.smithi111.stdout:0/649: mkdir d3/d1c/d50/dec 0 2024-09-11T00:07:22.956 INFO:tasks.workunit.client.0.smithi111.stdout:7/615: getdents dd/d1d/d76/db6 0 2024-09-11T00:07:22.957 INFO:tasks.workunit.client.1.smithi203.stdout:5/681: mkdir dc/dd/d15/d3b/d73/de8 0 2024-09-11T00:07:22.960 INFO:tasks.workunit.client.1.smithi203.stdout:5/682: chown dc/dd/d56/lc4 425068154 1 2024-09-11T00:07:22.961 INFO:tasks.workunit.client.0.smithi111.stdout:1/587: sync 2024-09-11T00:07:22.961 INFO:tasks.workunit.client.0.smithi111.stdout:3/610: truncate d1c/d1d/d22/d31/d33/f53 4250701 0 2024-09-11T00:07:22.962 INFO:tasks.workunit.client.1.smithi203.stdout:3/625: write d8/da/f2f [1761510,123620] 0 2024-09-11T00:07:22.962 INFO:tasks.workunit.client.0.smithi111.stdout:3/611: stat d1c/d21/dae 0 2024-09-11T00:07:22.965 INFO:tasks.workunit.client.1.smithi203.stdout:6/594: truncate d0/d54/d9c/d35/d38/f2e 848549 0 2024-09-11T00:07:22.965 INFO:tasks.workunit.client.0.smithi111.stdout:8/634: symlink d11/d23/d3d/d5f/d99/lc9 0 2024-09-11T00:07:22.967 INFO:tasks.workunit.client.0.smithi111.stdout:9/654: truncate d6/db/d1b/d41/d80/fbb 4655205 0 2024-09-11T00:07:22.972 INFO:tasks.workunit.client.1.smithi203.stdout:5/683: mknod dc/dd/d1e/d7b/ce9 0 2024-09-11T00:07:22.976 INFO:tasks.workunit.client.1.smithi203.stdout:6/595: creat d0/d5b/fbf x:0 0 0 2024-09-11T00:07:22.978 INFO:tasks.workunit.client.0.smithi111.stdout:8/635: dread ff [0,4194304] 0 2024-09-11T00:07:22.978 INFO:tasks.workunit.client.1.smithi203.stdout:0/587: fdatasync d0/d2/d37/f4b 0 2024-09-11T00:07:22.982 INFO:tasks.workunit.client.1.smithi203.stdout:5/684: symlink dc/dd/d1e/d7b/lea 0 2024-09-11T00:07:22.983 INFO:tasks.workunit.client.1.smithi203.stdout:0/588: truncate d0/d2/d3d/d5a/d77/f95 5123589 0 2024-09-11T00:07:22.983 INFO:tasks.workunit.client.1.smithi203.stdout:5/685: chown dc/dd/d9b/fb0 7 1 2024-09-11T00:07:22.987 INFO:tasks.workunit.client.0.smithi111.stdout:5/633: sync 2024-09-11T00:07:22.987 INFO:tasks.workunit.client.0.smithi111.stdout:4/584: sync 2024-09-11T00:07:22.987 INFO:tasks.workunit.client.0.smithi111.stdout:6/561: sync 2024-09-11T00:07:22.990 INFO:tasks.workunit.client.1.smithi203.stdout:6/596: read d0/f63 [1930071,111337] 0 2024-09-11T00:07:22.991 INFO:tasks.workunit.client.1.smithi203.stdout:3/626: write d8/da/d37/d83/fc2 [861006,96930] 0 2024-09-11T00:07:22.991 INFO:tasks.workunit.client.0.smithi111.stdout:6/562: write d7/d22/d26/f8a [4064225,128376] 0 2024-09-11T00:07:22.993 INFO:tasks.workunit.client.0.smithi111.stdout:6/563: stat d7/d22/d1d 0 2024-09-11T00:07:22.993 INFO:tasks.workunit.client.1.smithi203.stdout:6/597: write d0/d54/d9c/f66 [4815405,41376] 0 2024-09-11T00:07:22.994 INFO:tasks.workunit.client.1.smithi203.stdout:2/649: dread d13/d56/d69/d99/fa0 [0,4194304] 0 2024-09-11T00:07:22.995 INFO:tasks.workunit.client.1.smithi203.stdout:5/686: chown dc/dd/d15/dbd/de5/fe7 3 1 2024-09-11T00:07:22.996 INFO:tasks.workunit.client.1.smithi203.stdout:0/589: creat d0/d2/d37/d5b/d73/fbf x:0 0 0 2024-09-11T00:07:22.997 INFO:tasks.workunit.client.1.smithi203.stdout:2/650: chown d13/l87 61 1 2024-09-11T00:07:22.998 INFO:tasks.workunit.client.0.smithi111.stdout:9/655: dread d6/dc/f1f [0,4194304] 0 2024-09-11T00:07:23.002 INFO:tasks.workunit.client.0.smithi111.stdout:7/616: dwrite dd/d1d/f39 [0,4194304] 0 2024-09-11T00:07:23.002 INFO:tasks.workunit.client.1.smithi203.stdout:0/590: fdatasync d0/f89 0 2024-09-11T00:07:23.005 INFO:tasks.workunit.client.0.smithi111.stdout:0/650: link d3/da/d7b/d84/da8/cc8 d3/da/d7b/db3/ced 0 2024-09-11T00:07:23.005 INFO:tasks.workunit.client.1.smithi203.stdout:6/598: write d0/d54/d9c/d35/f70 [1047360,90809] 0 2024-09-11T00:07:23.008 INFO:tasks.workunit.client.0.smithi111.stdout:7/617: stat dd/d1d/d2d/f89 0 2024-09-11T00:07:23.009 INFO:tasks.workunit.client.1.smithi203.stdout:0/591: creat d0/d2/d37/d5b/fc0 x:0 0 0 2024-09-11T00:07:23.009 INFO:tasks.workunit.client.0.smithi111.stdout:4/585: dwrite d18/d20/d3c/f9a [0,4194304] 0 2024-09-11T00:07:23.016 INFO:tasks.workunit.client.1.smithi203.stdout:2/651: link d13/d15/fa8 d13/d15/d19/fd3 0 2024-09-11T00:07:23.017 INFO:tasks.workunit.client.0.smithi111.stdout:7/618: truncate dd/d1d/d1f/f23 5568889 0 2024-09-11T00:07:23.018 INFO:tasks.workunit.client.0.smithi111.stdout:7/619: chown dd/d48 8457504 1 2024-09-11T00:07:23.019 INFO:tasks.workunit.client.1.smithi203.stdout:6/599: dread d0/d32/f46 [0,4194304] 0 2024-09-11T00:07:23.020 INFO:tasks.workunit.client.0.smithi111.stdout:8/636: mkdir d11/d23/d3d/dca 0 2024-09-11T00:07:23.021 INFO:tasks.workunit.client.1.smithi203.stdout:2/652: creat d13/d56/d69/fd4 x:0 0 0 2024-09-11T00:07:23.021 INFO:tasks.workunit.client.0.smithi111.stdout:3/612: dwrite d1c/d1d/d22/d31/d33/d5f/fa7 [0,4194304] 0 2024-09-11T00:07:23.024 INFO:tasks.workunit.client.0.smithi111.stdout:6/564: dwrite d7/d22/d3f/f42 [0,4194304] 0 2024-09-11T00:07:23.025 INFO:tasks.workunit.client.0.smithi111.stdout:2/590: rmdir d0/d3/de/d3b/d63/dc5 0 2024-09-11T00:07:23.025 INFO:tasks.workunit.client.0.smithi111.stdout:5/634: truncate d10/d1e/d23/d30/d3c/d60/d7e/fab 4596078 0 2024-09-11T00:07:23.026 INFO:tasks.workunit.client.1.smithi203.stdout:6/600: read d0/d32/f3a [1696599,59243] 0 2024-09-11T00:07:23.027 INFO:tasks.workunit.client.0.smithi111.stdout:6/565: write d7/d22/d1d/f31 [8143905,88461] 0 2024-09-11T00:07:23.028 INFO:tasks.workunit.client.1.smithi203.stdout:2/653: creat d13/d15/d19/d1c/fd5 x:0 0 0 2024-09-11T00:07:23.033 INFO:tasks.workunit.client.0.smithi111.stdout:1/588: getdents d2/de/d12/d3c/d4b 0 2024-09-11T00:07:23.036 INFO:tasks.workunit.client.1.smithi203.stdout:3/627: dwrite d8/da/d5c/f61 [0,4194304] 0 2024-09-11T00:07:23.037 INFO:tasks.workunit.client.0.smithi111.stdout:1/589: write d2/de/d12/f28 [9230502,62016] 0 2024-09-11T00:07:23.041 INFO:tasks.workunit.client.1.smithi203.stdout:6/601: mkdir d0/d54/d9c/d35/d38/dc0 0 2024-09-11T00:07:23.043 INFO:tasks.workunit.client.0.smithi111.stdout:9/656: getdents d6/dc/dc1 0 2024-09-11T00:07:23.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:22 smithi203 ceph-mon[33225]: pgmap v9: 65 pgs: 65 active+clean; 2.4 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 64 MiB/s rd, 184 MiB/s wr, 374 op/s 2024-09-11T00:07:23.046 INFO:tasks.workunit.client.1.smithi203.stdout:0/592: link d0/d2/d37/f53 d0/d2/d37/d5b/fc1 0 2024-09-11T00:07:23.050 INFO:tasks.workunit.client.1.smithi203.stdout:3/628: mkdir d8/da/d5c/d99/de5 0 2024-09-11T00:07:23.055 INFO:tasks.workunit.client.1.smithi203.stdout:6/602: rmdir d0/d54/d9c/d7b/d7e 39 2024-09-11T00:07:23.055 INFO:tasks.workunit.client.0.smithi111.stdout:8/637: read d11/d23/d2c/d53/f5a [699238,64423] 0 2024-09-11T00:07:23.056 INFO:tasks.workunit.client.1.smithi203.stdout:2/654: dwrite d13/d47/fc7 [0,4194304] 0 2024-09-11T00:07:23.057 INFO:tasks.workunit.client.0.smithi111.stdout:8/638: write d11/d23/d7e/f97 [248054,92123] 0 2024-09-11T00:07:23.060 INFO:tasks.workunit.client.0.smithi111.stdout:8/639: readlink d11/d23/d3d/d5f/d99/lc9 0 2024-09-11T00:07:23.060 INFO:tasks.workunit.client.0.smithi111.stdout:6/566: chown d7/l8 35017 1 2024-09-11T00:07:23.062 INFO:tasks.workunit.client.0.smithi111.stdout:6/567: write d7/fd [1242845,14681] 0 2024-09-11T00:07:23.065 INFO:tasks.workunit.client.0.smithi111.stdout:0/651: link d3/f54 d3/d13/d1e/d29/db0/fee 0 2024-09-11T00:07:23.066 INFO:tasks.workunit.client.1.smithi203.stdout:6/603: creat d0/d5b/d5c/d6f/fc1 x:0 0 0 2024-09-11T00:07:23.067 INFO:tasks.workunit.client.0.smithi111.stdout:3/613: truncate d1c/d1d/d22/d31/d33/d5f/fb2 2525912 0 2024-09-11T00:07:23.072 INFO:tasks.workunit.client.1.smithi203.stdout:2/655: dread d13/d15/f29 [0,4194304] 0 2024-09-11T00:07:23.075 INFO:tasks.workunit.client.0.smithi111.stdout:4/586: dread d18/f32 [0,4194304] 0 2024-09-11T00:07:23.077 INFO:tasks.workunit.client.1.smithi203.stdout:0/593: creat d0/fc2 x:0 0 0 2024-09-11T00:07:23.078 INFO:tasks.workunit.client.1.smithi203.stdout:0/594: chown d0/d2 102837 1 2024-09-11T00:07:23.079 INFO:tasks.workunit.client.0.smithi111.stdout:5/635: write d10/d1e/d25/f29 [2678801,102677] 0 2024-09-11T00:07:23.080 INFO:tasks.workunit.client.1.smithi203.stdout:5/687: dread dc/dd/d15/dbd/f6a [0,4194304] 0 2024-09-11T00:07:23.081 INFO:tasks.workunit.client.1.smithi203.stdout:6/604: truncate d0/d5b/d5c/fac 419967 0 2024-09-11T00:07:23.083 INFO:tasks.workunit.client.1.smithi203.stdout:2/656: mkdir d13/d22/dd6 0 2024-09-11T00:07:23.083 INFO:tasks.workunit.client.1.smithi203.stdout:5/688: truncate dc/fd4 579970 0 2024-09-11T00:07:23.088 INFO:tasks.workunit.client.1.smithi203.stdout:5/689: stat dc/dd/d13/f48 0 2024-09-11T00:07:23.089 INFO:tasks.workunit.client.1.smithi203.stdout:6/605: symlink d0/d54/d9c/d35/d38/d73/d74/lc2 0 2024-09-11T00:07:23.091 INFO:tasks.workunit.client.1.smithi203.stdout:5/690: write dc/dd/d15/d3b/fc1 [935635,58663] 0 2024-09-11T00:07:23.093 INFO:tasks.workunit.client.1.smithi203.stdout:2/657: truncate d13/d15/d19/f6c 565661 0 2024-09-11T00:07:23.102 INFO:tasks.workunit.client.1.smithi203.stdout:2/658: creat d13/d15/d19/d1c/fd7 x:0 0 0 2024-09-11T00:07:23.104 INFO:tasks.workunit.client.1.smithi203.stdout:2/659: dread - d13/d15/d19/d1c/f3c zero size 2024-09-11T00:07:23.104 INFO:tasks.workunit.client.1.smithi203.stdout:2/660: readlink d13/l84 0 2024-09-11T00:07:23.106 INFO:tasks.workunit.client.1.smithi203.stdout:2/661: dread - d13/d47/fd0 zero size 2024-09-11T00:07:23.106 INFO:tasks.workunit.client.1.smithi203.stdout:3/629: dread d8/f58 [0,4194304] 0 2024-09-11T00:07:23.107 INFO:tasks.workunit.client.0.smithi111.stdout:5/636: dread d10/d1e/d25/f4a [4194304,4194304] 0 2024-09-11T00:07:23.107 INFO:tasks.workunit.client.1.smithi203.stdout:2/662: chown d13/d15/f65 33008149 1 2024-09-11T00:07:23.108 INFO:tasks.workunit.client.1.smithi203.stdout:0/595: write d0/d2/f40 [471369,118834] 0 2024-09-11T00:07:23.109 INFO:tasks.workunit.client.0.smithi111.stdout:5/637: dread - d10/d1e/d23/d30/d3c/d60/da2/d66/fbe zero size 2024-09-11T00:07:23.111 INFO:tasks.workunit.client.1.smithi203.stdout:6/606: rmdir d0/d5b/d5c/d6f/db4 0 2024-09-11T00:07:23.111 INFO:tasks.workunit.client.0.smithi111.stdout:5/638: fsync d10/d1e/d23/fa1 0 2024-09-11T00:07:23.115 INFO:tasks.workunit.client.1.smithi203.stdout:3/630: read - d8/da/d37/d83/da3/fca zero size 2024-09-11T00:07:23.120 INFO:tasks.workunit.client.1.smithi203.stdout:0/596: symlink d0/d1d/d5d/d70/lc3 0 2024-09-11T00:07:23.123 INFO:tasks.workunit.client.1.smithi203.stdout:5/691: link dc/dd/d1e/fbc dc/dd/d9b/dae/feb 0 2024-09-11T00:07:23.124 INFO:tasks.workunit.client.1.smithi203.stdout:5/692: fsync dc/dd/d15/d3b/f63 0 2024-09-11T00:07:23.125 INFO:tasks.workunit.client.0.smithi111.stdout:5/639: dwrite d10/d1e/d23/d26/d3a/d98/d6d/fc7 [0,4194304] 0 2024-09-11T00:07:23.130 INFO:tasks.workunit.client.1.smithi203.stdout:0/597: creat d0/d2/fc4 x:0 0 0 2024-09-11T00:07:23.132 INFO:tasks.workunit.client.1.smithi203.stdout:2/663: dread d13/d15/d19/d1c/f2d [0,4194304] 0 2024-09-11T00:07:23.139 INFO:tasks.workunit.client.0.smithi111.stdout:1/590: creat d2/de/d12/d3c/d4b/fc8 x:0 0 0 2024-09-11T00:07:23.142 INFO:tasks.workunit.client.1.smithi203.stdout:2/664: rename d13/d15/f1f to d13/d15/d19/d1c/fd8 0 2024-09-11T00:07:23.143 INFO:tasks.workunit.client.0.smithi111.stdout:1/591: read d2/de/d12/d3c/d4b/d6a/d63/d73/da1/fc2 [1263098,12368] 0 2024-09-11T00:07:23.143 INFO:tasks.workunit.client.1.smithi203.stdout:6/607: write d0/f63 [2345062,1571] 0 2024-09-11T00:07:23.145 INFO:tasks.workunit.client.0.smithi111.stdout:1/592: write d2/de/d12/d3c/d4b/d6a/fab [760563,75952] 0 2024-09-11T00:07:23.148 INFO:tasks.workunit.client.0.smithi111.stdout:9/657: sync 2024-09-11T00:07:23.151 INFO:tasks.workunit.client.0.smithi111.stdout:6/568: readlink d7/d22/l28 0 2024-09-11T00:07:23.152 INFO:tasks.workunit.client.0.smithi111.stdout:6/569: dread - d7/d2b/fae zero size 2024-09-11T00:07:23.153 INFO:tasks.workunit.client.0.smithi111.stdout:3/614: rename d1c/d1d/c6e to d1c/d1d/d22/d31/d33/d5f/d98/cd3 0 2024-09-11T00:07:23.154 INFO:tasks.workunit.client.0.smithi111.stdout:4/587: stat d18/d20/d3c/d5e/d75/d8d/f96 0 2024-09-11T00:07:23.157 INFO:tasks.workunit.client.0.smithi111.stdout:8/640: symlink d11/d23/d2c/d53/dbd/lcb 0 2024-09-11T00:07:23.160 INFO:tasks.workunit.client.0.smithi111.stdout:1/593: rename d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/d7b/db4 to d2/d2b/dc9 0 2024-09-11T00:07:23.161 INFO:tasks.workunit.client.0.smithi111.stdout:8/641: read d11/d21/f22 [1866754,100730] 0 2024-09-11T00:07:23.163 INFO:tasks.workunit.client.0.smithi111.stdout:4/588: creat d18/d20/d40/d78/fb2 x:0 0 0 2024-09-11T00:07:23.164 INFO:tasks.workunit.client.0.smithi111.stdout:7/620: creat dd/d1d/d4d/d82/fc0 x:0 0 0 2024-09-11T00:07:23.165 INFO:tasks.workunit.client.0.smithi111.stdout:2/591: getdents d0/d3/d12/d52/d6c 0 2024-09-11T00:07:23.167 INFO:tasks.workunit.client.0.smithi111.stdout:6/570: symlink d7/d22/d3f/d74/d7f/d61/lc1 0 2024-09-11T00:07:23.167 INFO:tasks.workunit.client.0.smithi111.stdout:5/640: link d10/d1e/d23/d30/c9a d10/d1e/d23/d2b/dad/cc9 0 2024-09-11T00:07:23.172 INFO:tasks.workunit.client.0.smithi111.stdout:0/652: getdents d3/d1c/dd0 0 2024-09-11T00:07:23.172 INFO:tasks.workunit.client.0.smithi111.stdout:6/571: read d7/d22/d3f/f54 [1334476,127525] 0 2024-09-11T00:07:23.173 INFO:tasks.workunit.client.0.smithi111.stdout:9/658: link d6/dc/f62 d6/d52/fd5 0 2024-09-11T00:07:23.175 INFO:tasks.workunit.client.0.smithi111.stdout:7/621: unlink dd/d1d/d4b/d8f/dac/faf 0 2024-09-11T00:07:23.177 INFO:tasks.workunit.client.0.smithi111.stdout:2/592: symlink d0/d3/de/db4/lca 0 2024-09-11T00:07:23.180 INFO:tasks.workunit.client.0.smithi111.stdout:6/572: write d7/d22/d26/f73 [1560861,66746] 0 2024-09-11T00:07:23.194 INFO:tasks.workunit.client.0.smithi111.stdout:7/622: truncate dd/d1d/d2d/d2e/f40 3879593 0 2024-09-11T00:07:23.194 INFO:tasks.workunit.client.0.smithi111.stdout:4/589: dwrite d18/d20/d3c/f9a [0,4194304] 0 2024-09-11T00:07:23.195 INFO:tasks.workunit.client.0.smithi111.stdout:5/641: dwrite d10/d1e/d23/d30/f37 [0,4194304] 0 2024-09-11T00:07:23.197 INFO:tasks.workunit.client.0.smithi111.stdout:2/593: creat d0/d3/d12/d52/fcb x:0 0 0 2024-09-11T00:07:23.197 INFO:tasks.workunit.client.0.smithi111.stdout:1/594: dwrite d2/de/d12/f1c [0,4194304] 0 2024-09-11T00:07:23.198 INFO:tasks.workunit.client.0.smithi111.stdout:7/623: chown dd/d1d/d1f 0 1 2024-09-11T00:07:23.207 INFO:tasks.workunit.client.0.smithi111.stdout:5/642: write d10/d1e/d23/d30/d59/d7b/fa3 [170438,113064] 0 2024-09-11T00:07:23.207 INFO:tasks.workunit.client.0.smithi111.stdout:2/594: fsync d0/d3/de/f11 0 2024-09-11T00:07:23.210 INFO:tasks.workunit.client.0.smithi111.stdout:4/590: creat d18/fb3 x:0 0 0 2024-09-11T00:07:23.220 INFO:tasks.workunit.client.0.smithi111.stdout:8/642: dread d11/d23/d3d/d8d/f61 [0,4194304] 0 2024-09-11T00:07:23.223 INFO:tasks.workunit.client.0.smithi111.stdout:4/591: write d18/d20/d3c/d5e/f92 [529442,44947] 0 2024-09-11T00:07:23.226 INFO:tasks.workunit.client.0.smithi111.stdout:0/653: dwrite d3/d13/d1e/d29/d49/fcc [0,4194304] 0 2024-09-11T00:07:23.235 INFO:tasks.workunit.client.0.smithi111.stdout:7/624: truncate dd/d1d/d2d/f89 2693735 0 2024-09-11T00:07:23.235 INFO:tasks.workunit.client.0.smithi111.stdout:6/573: dwrite d7/d22/d26/d87/d41/f82 [0,4194304] 0 2024-09-11T00:07:23.238 INFO:tasks.workunit.client.0.smithi111.stdout:9/659: dread d6/db/f49 [0,4194304] 0 2024-09-11T00:07:23.242 INFO:tasks.workunit.client.0.smithi111.stdout:0/654: creat d3/da/d7b/d84/fef x:0 0 0 2024-09-11T00:07:23.242 INFO:tasks.workunit.client.0.smithi111.stdout:2/595: link d0/d3/d12/f96 d0/d3/d98/fcc 0 2024-09-11T00:07:23.243 INFO:tasks.workunit.client.0.smithi111.stdout:1/595: dwrite d2/d2b/f75 [0,4194304] 0 2024-09-11T00:07:23.246 INFO:tasks.workunit.client.0.smithi111.stdout:7/625: creat dd/d1d/d2d/d2e/d4e/fc1 x:0 0 0 2024-09-11T00:07:23.251 INFO:tasks.workunit.client.0.smithi111.stdout:8/643: write d11/d23/d2c/d46/f69 [4929526,108337] 0 2024-09-11T00:07:23.251 INFO:tasks.workunit.client.0.smithi111.stdout:7/626: readlink dd/d1d/d1f/l27 0 2024-09-11T00:07:23.253 INFO:tasks.workunit.client.0.smithi111.stdout:9/660: readlink d6/db/d34/l8b 0 2024-09-11T00:07:23.256 INFO:tasks.workunit.client.0.smithi111.stdout:2/596: creat d0/d83/fcd x:0 0 0 2024-09-11T00:07:23.258 INFO:tasks.workunit.client.0.smithi111.stdout:6/574: rename d7/d22/d1d/d83/fa9 to d7/d22/d26/d95/fc2 0 2024-09-11T00:07:23.259 INFO:tasks.workunit.client.0.smithi111.stdout:1/596: chown d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/f5b 308642 1 2024-09-11T00:07:23.261 INFO:tasks.workunit.client.0.smithi111.stdout:7/627: creat dd/d1d/d4b/d8f/fc2 x:0 0 0 2024-09-11T00:07:23.262 INFO:tasks.workunit.client.0.smithi111.stdout:8/644: creat d11/fcc x:0 0 0 2024-09-11T00:07:23.262 INFO:tasks.workunit.client.0.smithi111.stdout:9/661: read - d6/d52/d8a/fd2 zero size 2024-09-11T00:07:23.264 INFO:tasks.workunit.client.0.smithi111.stdout:3/615: sync 2024-09-11T00:07:23.265 INFO:tasks.workunit.client.0.smithi111.stdout:7/628: stat dd/d1d/d76/db6/lbd 0 2024-09-11T00:07:23.267 INFO:tasks.workunit.client.0.smithi111.stdout:5/643: dwrite d10/d1e/d23/d26/d3a/d98/f77 [0,4194304] 0 2024-09-11T00:07:23.269 INFO:tasks.workunit.client.0.smithi111.stdout:2/597: fdatasync d0/d3/d12/d52/f87 0 2024-09-11T00:07:23.273 INFO:tasks.workunit.client.0.smithi111.stdout:6/575: fsync d7/d22/d3f/d74/d7f/d61/d6a/dba/f93 0 2024-09-11T00:07:23.273 INFO:tasks.workunit.client.0.smithi111.stdout:3/616: rmdir d1c/d1d/d22/d44/d5a 39 2024-09-11T00:07:23.275 INFO:tasks.workunit.client.0.smithi111.stdout:0/655: write d3/da/f6e [176065,91178] 0 2024-09-11T00:07:23.277 INFO:tasks.workunit.client.0.smithi111.stdout:8/645: truncate d11/d23/d2c/d46/fc8 477966 0 2024-09-11T00:07:23.277 INFO:tasks.workunit.client.0.smithi111.stdout:2/598: creat d0/d3/de/d50/d9d/fce x:0 0 0 2024-09-11T00:07:23.278 INFO:tasks.workunit.client.0.smithi111.stdout:2/599: chown d0 180 1 2024-09-11T00:07:23.280 INFO:tasks.workunit.client.0.smithi111.stdout:1/597: creat d2/de/d12/d3c/d4b/d6a/d63/d73/db8/fca x:0 0 0 2024-09-11T00:07:23.284 INFO:tasks.workunit.client.0.smithi111.stdout:5/644: creat d10/d1e/d23/d2b/dad/fca x:0 0 0 2024-09-11T00:07:23.284 INFO:tasks.workunit.client.0.smithi111.stdout:3/617: dread - d1c/d1d/d22/d31/d33/fce zero size 2024-09-11T00:07:23.292 INFO:tasks.workunit.client.0.smithi111.stdout:6/576: creat d7/d22/d2c/d38/d56/dbf/fc3 x:0 0 0 2024-09-11T00:07:23.295 INFO:tasks.workunit.client.0.smithi111.stdout:1/598: creat d2/d2b/dc9/dba/fcb x:0 0 0 2024-09-11T00:07:23.298 INFO:tasks.workunit.client.0.smithi111.stdout:4/592: dread d18/d20/f23 [0,4194304] 0 2024-09-11T00:07:23.299 INFO:tasks.workunit.client.0.smithi111.stdout:9/662: dwrite d6/db/f79 [0,4194304] 0 2024-09-11T00:07:23.300 INFO:tasks.workunit.client.0.smithi111.stdout:7/629: dwrite dd/d1d/d1f/f50 [4194304,4194304] 0 2024-09-11T00:07:23.306 INFO:tasks.workunit.client.0.smithi111.stdout:1/599: stat d2/de/d12/d3c/d4b/d6a/f64 0 2024-09-11T00:07:23.312 INFO:tasks.workunit.client.0.smithi111.stdout:4/593: chown d18/d20/d40/d78/d79/d90/d91 0 1 2024-09-11T00:07:23.312 INFO:tasks.workunit.client.0.smithi111.stdout:6/577: write d7/d22/d3f/d74/d7f/d61/d6a/d9f/fb1 [1652302,101271] 0 2024-09-11T00:07:23.314 INFO:tasks.workunit.client.0.smithi111.stdout:7/630: creat dd/d1d/d4b/fc3 x:0 0 0 2024-09-11T00:07:23.314 INFO:tasks.workunit.client.0.smithi111.stdout:5/645: rename d10/d1e/d23/d30/d59/d7b/l90 to d10/d1e/d23/lcb 0 2024-09-11T00:07:23.321 INFO:tasks.workunit.client.0.smithi111.stdout:7/631: chown dd/d1d/d4b/d8f/d9f/c84 32319 1 2024-09-11T00:07:23.329 INFO:tasks.workunit.client.0.smithi111.stdout:3/618: rename d1c/d1d/d22/d31/d33/d5f/c6a to d1c/d1d/d22/d31/d62/dc7/cd4 0 2024-09-11T00:07:23.333 INFO:tasks.workunit.client.0.smithi111.stdout:4/594: link d18/d20/d40/d78/f86 d18/d1f/d36/fb4 0 2024-09-11T00:07:23.335 INFO:tasks.workunit.client.0.smithi111.stdout:0/656: dwrite d3/d13/f6f [0,4194304] 0 2024-09-11T00:07:23.335 INFO:tasks.workunit.client.0.smithi111.stdout:2/600: dwrite d0/d3/de/d3b/d92/fc3 [0,4194304] 0 2024-09-11T00:07:23.338 INFO:tasks.workunit.client.0.smithi111.stdout:5/646: rmdir d10/d1e/d23/d30/d3c/d60/dc6 0 2024-09-11T00:07:23.339 INFO:tasks.workunit.client.0.smithi111.stdout:3/619: write d1c/d1d/d22/d23/d2f/d63/f81 [3328080,88276] 0 2024-09-11T00:07:23.343 INFO:tasks.workunit.client.0.smithi111.stdout:7/632: mkdir dd/d48/d69/dbe/dc4 0 2024-09-11T00:07:23.349 INFO:tasks.workunit.client.1.smithi203.stdout:0/598: mkdir d0/dc5 0 2024-09-11T00:07:23.350 INFO:tasks.workunit.client.0.smithi111.stdout:9/663: dread d6/db/d34/d37/f1d [0,4194304] 0 2024-09-11T00:07:23.351 INFO:tasks.workunit.client.0.smithi111.stdout:3/620: write d1c/d1d/d22/d44/f7c [1785678,129496] 0 2024-09-11T00:07:23.352 INFO:tasks.workunit.client.1.smithi203.stdout:2/665: write d13/d15/f65 [63458,116050] 0 2024-09-11T00:07:23.356 INFO:tasks.workunit.client.1.smithi203.stdout:0/599: creat d0/fc6 x:0 0 0 2024-09-11T00:07:23.357 INFO:tasks.workunit.client.0.smithi111.stdout:2/601: read d0/f72 [788916,123138] 0 2024-09-11T00:07:23.358 INFO:tasks.workunit.client.1.smithi203.stdout:2/666: read d13/d47/fc7 [843711,111034] 0 2024-09-11T00:07:23.361 INFO:tasks.workunit.client.0.smithi111.stdout:8/646: dread d11/d21/d38/f47 [0,4194304] 0 2024-09-11T00:07:23.362 INFO:tasks.workunit.client.1.smithi203.stdout:2/667: chown d13/d15/f1a 0 1 2024-09-11T00:07:23.363 INFO:tasks.workunit.client.1.smithi203.stdout:0/600: read d0/f15 [1576188,111968] 0 2024-09-11T00:07:23.363 INFO:tasks.workunit.client.1.smithi203.stdout:6/608: getdents d0/d5b/d9f 0 2024-09-11T00:07:23.364 INFO:tasks.workunit.client.0.smithi111.stdout:6/578: dwrite d7/d22/d3f/f54 [0,4194304] 0 2024-09-11T00:07:23.365 INFO:tasks.workunit.client.0.smithi111.stdout:5/647: creat d10/d1e/d23/d30/d59/d53/fcc x:0 0 0 2024-09-11T00:07:23.366 INFO:tasks.workunit.client.1.smithi203.stdout:6/609: stat d0/d32/f46 0 2024-09-11T00:07:23.367 INFO:tasks.workunit.client.1.smithi203.stdout:3/631: dwrite d8/f59 [4194304,4194304] 0 2024-09-11T00:07:23.367 INFO:tasks.workunit.client.0.smithi111.stdout:2/602: write d0/d83/f85 [919619,101832] 0 2024-09-11T00:07:23.368 INFO:tasks.workunit.client.1.smithi203.stdout:5/693: dwrite dc/d4f/d5c/fb8 [0,4194304] 0 2024-09-11T00:07:23.369 INFO:tasks.workunit.client.0.smithi111.stdout:1/600: dread d2/de/f5e [0,4194304] 0 2024-09-11T00:07:23.369 INFO:tasks.workunit.client.0.smithi111.stdout:3/621: creat d1c/d1d/d22/d31/d62/fd5 x:0 0 0 2024-09-11T00:07:23.370 INFO:tasks.workunit.client.0.smithi111.stdout:4/595: dwrite f7 [0,4194304] 0 2024-09-11T00:07:23.373 INFO:tasks.workunit.client.0.smithi111.stdout:9/664: creat d6/db/d1b/d56/fd6 x:0 0 0 2024-09-11T00:07:23.374 INFO:tasks.workunit.client.0.smithi111.stdout:7/633: rename dd/d1d/d2d/d2e/d4e/c8e to dd/d1d/d4b/d8f/d9f/cc5 0 2024-09-11T00:07:23.374 INFO:tasks.workunit.client.0.smithi111.stdout:3/622: truncate d1c/d1d/d86/f93 369461 0 2024-09-11T00:07:23.377 INFO:tasks.workunit.client.1.smithi203.stdout:2/668: mkdir d13/d15/d30/d5a/dd9 0 2024-09-11T00:07:23.388 INFO:tasks.workunit.client.0.smithi111.stdout:3/623: stat d1c/d1d/d22/d31/f54 0 2024-09-11T00:07:23.389 INFO:tasks.workunit.client.0.smithi111.stdout:0/657: mknod d3/d13/d1e/d29/db0/dce/ddb/de6/cf0 0 2024-09-11T00:07:23.389 INFO:tasks.workunit.client.0.smithi111.stdout:5/648: mknod d10/d1e/d23/d2b/d2f/ccd 0 2024-09-11T00:07:23.392 INFO:tasks.workunit.client.1.smithi203.stdout:5/694: mknod dc/cec 0 2024-09-11T00:07:23.393 INFO:tasks.workunit.client.0.smithi111.stdout:3/624: rename d1c/d1d to d1c/d1d/d86/dbc/dd6 22 2024-09-11T00:07:23.393 INFO:tasks.workunit.client.1.smithi203.stdout:0/601: write d0/d2/f7a [342703,63078] 0 2024-09-11T00:07:23.399 INFO:tasks.workunit.client.0.smithi111.stdout:1/601: symlink d2/de/d12/dc7/lcc 0 2024-09-11T00:07:23.399 INFO:tasks.workunit.client.0.smithi111.stdout:5/649: symlink d10/d1e/d25/d6e/lce 0 2024-09-11T00:07:23.404 INFO:tasks.workunit.client.0.smithi111.stdout:4/596: mknod d18/d1f/cb5 0 2024-09-11T00:07:23.407 INFO:tasks.workunit.client.0.smithi111.stdout:4/597: write d18/d20/f30 [1959463,63901] 0 2024-09-11T00:07:23.409 INFO:tasks.workunit.client.0.smithi111.stdout:3/625: chown d1c/d1d/d22/d23/d2f/d63/ca1 14 1 2024-09-11T00:07:23.410 INFO:tasks.workunit.client.0.smithi111.stdout:9/665: creat d6/db/d1b/fd7 x:0 0 0 2024-09-11T00:07:23.413 INFO:tasks.workunit.client.0.smithi111.stdout:3/626: read - d1c/d1d/d22/d31/d62/fa9 zero size 2024-09-11T00:07:23.413 INFO:tasks.workunit.client.0.smithi111.stdout:1/602: creat d2/de/d12/d6c/fcd x:0 0 0 2024-09-11T00:07:23.414 INFO:tasks.workunit.client.0.smithi111.stdout:6/579: dwrite d7/d2b/f5b [0,4194304] 0 2024-09-11T00:07:23.414 INFO:tasks.workunit.client.0.smithi111.stdout:5/650: creat d10/d1e/d23/d30/d3c/d60/da2/fcf x:0 0 0 2024-09-11T00:07:23.418 INFO:tasks.workunit.client.0.smithi111.stdout:0/658: rename d3/d13/d1e/d29/f4e to d3/daf/ff1 0 2024-09-11T00:07:23.425 INFO:tasks.workunit.client.0.smithi111.stdout:3/627: creat d1c/d1d/d86/fd7 x:0 0 0 2024-09-11T00:07:23.425 INFO:tasks.workunit.client.0.smithi111.stdout:6/580: truncate d7/d22/d1d/f88 628516 0 2024-09-11T00:07:23.426 INFO:tasks.workunit.client.0.smithi111.stdout:6/581: chown d7/d2b/f8b 14324 1 2024-09-11T00:07:23.427 INFO:tasks.workunit.client.0.smithi111.stdout:4/598: symlink d18/d20/d3c/d5e/d75/lb6 0 2024-09-11T00:07:23.430 INFO:tasks.workunit.client.0.smithi111.stdout:8/647: dwrite d11/d21/d38/f5e [0,4194304] 0 2024-09-11T00:07:23.432 INFO:tasks.workunit.client.0.smithi111.stdout:9/666: fsync d6/db/d1b/d41/f57 0 2024-09-11T00:07:23.435 INFO:tasks.workunit.client.0.smithi111.stdout:9/667: stat d6/db/d34/d37/f28 0 2024-09-11T00:07:23.437 INFO:tasks.workunit.client.0.smithi111.stdout:3/628: rmdir d1c/d21/db4 39 2024-09-11T00:07:23.439 INFO:tasks.workunit.client.0.smithi111.stdout:3/629: write d1c/d1d/fd1 [1020529,116289] 0 2024-09-11T00:07:23.440 INFO:tasks.workunit.client.0.smithi111.stdout:4/599: mkdir d18/d3b/d9f/db7 0 2024-09-11T00:07:23.440 INFO:tasks.workunit.client.0.smithi111.stdout:7/634: truncate dd/da6/fab 1962667 0 2024-09-11T00:07:23.443 INFO:tasks.workunit.client.0.smithi111.stdout:5/651: symlink d10/d1e/d23/d30/ld0 0 2024-09-11T00:07:23.445 INFO:tasks.workunit.client.0.smithi111.stdout:5/652: read - d10/d1e/d23/d2b/dad/fca zero size 2024-09-11T00:07:23.446 INFO:tasks.workunit.client.0.smithi111.stdout:6/582: rmdir d7/d22/d3f/d74/d7f/d61/d6a/d9f 39 2024-09-11T00:07:23.447 INFO:tasks.workunit.client.0.smithi111.stdout:5/653: chown d10/f13 18 1 2024-09-11T00:07:23.447 INFO:tasks.workunit.client.0.smithi111.stdout:0/659: dwrite d3/fd [0,4194304] 0 2024-09-11T00:07:23.449 INFO:tasks.workunit.client.0.smithi111.stdout:8/648: unlink d11/d23/d2c/d46/d64/c77 0 2024-09-11T00:07:23.449 INFO:tasks.workunit.client.0.smithi111.stdout:1/603: write d2/de/d82/f86 [78649,28393] 0 2024-09-11T00:07:23.465 INFO:tasks.workunit.client.1.smithi203.stdout:2/669: mkdir d13/d56/dda 0 2024-09-11T00:07:23.466 INFO:tasks.workunit.client.1.smithi203.stdout:6/610: truncate d0/d5b/d5c/fac 855889 0 2024-09-11T00:07:23.468 INFO:tasks.workunit.client.1.smithi203.stdout:2/670: mkdir d13/ddb 0 2024-09-11T00:07:23.471 INFO:tasks.workunit.client.1.smithi203.stdout:0/602: creat d0/d87/fc7 x:0 0 0 2024-09-11T00:07:23.474 INFO:tasks.workunit.client.1.smithi203.stdout:5/695: truncate dc/dd/d15/d3b/f63 4780711 0 2024-09-11T00:07:23.475 INFO:tasks.workunit.client.0.smithi111.stdout:9/668: stat d6/db/d34/la8 0 2024-09-11T00:07:23.475 INFO:tasks.workunit.client.0.smithi111.stdout:3/630: creat d1c/d1d/d86/fd8 x:0 0 0 2024-09-11T00:07:23.476 INFO:tasks.workunit.client.1.smithi203.stdout:6/611: rename d0/d54/d9c/d35/d39/l45 to d0/d54/d9c/d35/d38/d73/d74/lc3 0 2024-09-11T00:07:23.477 INFO:tasks.workunit.client.0.smithi111.stdout:9/669: dread - d6/db/db8/fc4 zero size 2024-09-11T00:07:23.479 INFO:tasks.workunit.client.0.smithi111.stdout:8/649: unlink d11/d23/f65 0 2024-09-11T00:07:23.484 INFO:tasks.workunit.client.1.smithi203.stdout:6/612: unlink d0/d54/d9c/d35/d39/db2/fb3 0 2024-09-11T00:07:23.489 INFO:tasks.workunit.client.0.smithi111.stdout:5/654: mkdir d10/d1e/d23/d30/d59/dd1 0 2024-09-11T00:07:23.489 INFO:tasks.workunit.client.0.smithi111.stdout:0/660: dwrite d3/da/f21 [4194304,4194304] 0 2024-09-11T00:07:23.490 INFO:tasks.workunit.client.0.smithi111.stdout:1/604: mknod d2/de/d12/d3c/d4b/d6a/d63/d73/cce 0 2024-09-11T00:07:23.493 INFO:tasks.workunit.client.0.smithi111.stdout:9/670: creat d6/dc/d73/fd8 x:0 0 0 2024-09-11T00:07:23.494 INFO:tasks.workunit.client.0.smithi111.stdout:9/671: chown d6/d52/d8a/dd1 54376522 1 2024-09-11T00:07:23.495 INFO:tasks.workunit.client.0.smithi111.stdout:7/635: link dd/d48/f5f dd/d1d/d4b/d8f/d9f/fc6 0 2024-09-11T00:07:23.497 INFO:tasks.workunit.client.0.smithi111.stdout:7/636: read - dd/d1d/d76/fa3 zero size 2024-09-11T00:07:23.497 INFO:tasks.workunit.client.1.smithi203.stdout:3/632: write d8/da/db3/f35 [1263051,22268] 0 2024-09-11T00:07:23.500 INFO:tasks.workunit.client.0.smithi111.stdout:7/637: write dd/d1d/d2d/d2e/d4e/fc1 [99930,32264] 0 2024-09-11T00:07:23.504 INFO:tasks.workunit.client.0.smithi111.stdout:1/605: creat d2/dad/fcf x:0 0 0 2024-09-11T00:07:23.506 INFO:tasks.workunit.client.1.smithi203.stdout:3/633: rename d8/l31 to d8/da/d11/le6 0 2024-09-11T00:07:23.506 INFO:tasks.workunit.client.0.smithi111.stdout:1/606: write d2/de/d12/d3c/f69 [1355374,116616] 0 2024-09-11T00:07:23.510 INFO:tasks.workunit.client.0.smithi111.stdout:9/672: creat d6/db/d1b/d56/dc8/fd9 x:0 0 0 2024-09-11T00:07:23.510 INFO:tasks.workunit.client.1.smithi203.stdout:0/603: write d0/d1d/f69 [1871802,1457] 0 2024-09-11T00:07:23.512 INFO:tasks.workunit.client.1.smithi203.stdout:2/671: chown d13/d22/c3b 4 1 2024-09-11T00:07:23.513 INFO:tasks.workunit.client.0.smithi111.stdout:6/583: getdents d7/d22/d3f/d74/d7f/d61/d6a 0 2024-09-11T00:07:23.516 INFO:tasks.workunit.client.0.smithi111.stdout:3/631: creat d1c/fd9 x:0 0 0 2024-09-11T00:07:23.517 INFO:tasks.workunit.client.1.smithi203.stdout:3/634: symlink d8/da/d37/d83/d6a/dad/le7 0 2024-09-11T00:07:23.518 INFO:tasks.workunit.client.0.smithi111.stdout:0/661: mkdir d3/d13/d1e/d29/d49/df2 0 2024-09-11T00:07:23.519 INFO:tasks.workunit.client.0.smithi111.stdout:5/655: dwrite d10/d1e/d23/d30/d3c/d60/da2/d66/d76/fae [0,4194304] 0 2024-09-11T00:07:23.520 INFO:tasks.workunit.client.0.smithi111.stdout:0/662: stat d3/d26/d77 0 2024-09-11T00:07:23.521 INFO:tasks.workunit.client.0.smithi111.stdout:7/638: creat dd/d1d/d4b/d8f/d9f/fc7 x:0 0 0 2024-09-11T00:07:23.521 INFO:tasks.workunit.client.0.smithi111.stdout:0/663: chown d3/d13/d1e/d29/db0/fee 741895 1 2024-09-11T00:07:23.524 INFO:tasks.workunit.client.1.smithi203.stdout:0/604: mknod d0/d1d/d4c/cc8 0 2024-09-11T00:07:23.524 INFO:tasks.workunit.client.1.smithi203.stdout:6/613: truncate d0/f23 846415 0 2024-09-11T00:07:23.526 INFO:tasks.workunit.client.1.smithi203.stdout:5/696: dwrite dc/dd/d9b/dae/feb [0,4194304] 0 2024-09-11T00:07:23.530 INFO:tasks.workunit.client.1.smithi203.stdout:6/614: write d0/d54/d9c/d35/f70 [579179,39787] 0 2024-09-11T00:07:23.530 INFO:tasks.workunit.client.0.smithi111.stdout:6/584: truncate d7/d22/d2c/f37 1023045 0 2024-09-11T00:07:23.532 INFO:tasks.workunit.client.1.smithi203.stdout:3/635: truncate d8/d3c/fc9 440774 0 2024-09-11T00:07:23.533 INFO:tasks.workunit.client.0.smithi111.stdout:5/656: read d10/d1e/d23/d2b/d92/fbc [469499,19904] 0 2024-09-11T00:07:23.535 INFO:tasks.workunit.client.1.smithi203.stdout:0/605: mkdir d0/d2/d7e/da1/dc9 0 2024-09-11T00:07:23.537 INFO:tasks.workunit.client.1.smithi203.stdout:5/697: dread - dc/dd/d15/dbd/f92 zero size 2024-09-11T00:07:23.537 INFO:tasks.workunit.client.1.smithi203.stdout:2/672: creat d13/d22/fdc x:0 0 0 2024-09-11T00:07:23.541 INFO:tasks.workunit.client.1.smithi203.stdout:0/606: unlink d0/d2/f3 0 2024-09-11T00:07:23.544 INFO:tasks.workunit.client.1.smithi203.stdout:3/636: truncate d8/da/d37/d83/d65/f66 4794919 0 2024-09-11T00:07:23.545 INFO:tasks.workunit.client.1.smithi203.stdout:2/673: write d13/d15/f55 [5101535,64169] 0 2024-09-11T00:07:23.547 INFO:tasks.workunit.client.0.smithi111.stdout:2/603: sync 2024-09-11T00:07:23.551 INFO:tasks.workunit.client.0.smithi111.stdout:7/639: fsync dd/da6/fab 0 2024-09-11T00:07:23.552 INFO:tasks.workunit.client.0.smithi111.stdout:7/640: fsync dd/d1d/d4d/fb3 0 2024-09-11T00:07:23.553 INFO:tasks.workunit.client.1.smithi203.stdout:6/615: creat d0/d54/d9c/d7b/fc4 x:0 0 0 2024-09-11T00:07:23.555 INFO:tasks.workunit.client.0.smithi111.stdout:0/664: mkdir d3/d13/d1e/d29/d49/df3 0 2024-09-11T00:07:23.556 INFO:tasks.workunit.client.0.smithi111.stdout:0/665: write d3/d13/f6f [1042959,95952] 0 2024-09-11T00:07:23.558 INFO:tasks.workunit.client.0.smithi111.stdout:0/666: chown d3/d13/fdd 27521616 1 2024-09-11T00:07:23.562 INFO:tasks.workunit.client.0.smithi111.stdout:0/667: write d3/d13/d1e/deb/d61/fca [680945,82084] 0 2024-09-11T00:07:23.563 INFO:tasks.workunit.client.1.smithi203.stdout:3/637: unlink d8/da/d37/d83/d65/d8b/f9e 0 2024-09-11T00:07:23.565 INFO:tasks.workunit.client.1.smithi203.stdout:6/616: creat d0/d54/d9c/d35/d38/fc5 x:0 0 0 2024-09-11T00:07:23.565 INFO:tasks.workunit.client.0.smithi111.stdout:0/668: chown d3/d13/d1e/d29/db0/dce/ddb 41624649 1 2024-09-11T00:07:23.566 INFO:tasks.workunit.client.0.smithi111.stdout:5/657: dread d10/d1e/d25/f29 [0,4194304] 0 2024-09-11T00:07:23.566 INFO:tasks.workunit.client.0.smithi111.stdout:3/632: write d1c/f24 [2454389,107883] 0 2024-09-11T00:07:23.567 INFO:tasks.workunit.client.1.smithi203.stdout:2/674: creat d13/d56/d69/d99/fdd x:0 0 0 2024-09-11T00:07:23.568 INFO:tasks.workunit.client.0.smithi111.stdout:0/669: truncate d3/daf/db2/fcd 514860 0 2024-09-11T00:07:23.571 INFO:tasks.workunit.client.0.smithi111.stdout:6/585: write d7/f52 [4091222,47837] 0 2024-09-11T00:07:23.574 INFO:tasks.workunit.client.0.smithi111.stdout:6/586: readlink d7/d22/d1d/d8c/l4b 0 2024-09-11T00:07:23.576 INFO:tasks.workunit.client.0.smithi111.stdout:9/673: dwrite d6/dc/f62 [0,4194304] 0 2024-09-11T00:07:23.577 INFO:tasks.workunit.client.0.smithi111.stdout:7/641: write dd/da6/fab [534582,70368] 0 2024-09-11T00:07:23.578 INFO:tasks.workunit.client.0.smithi111.stdout:9/674: write d6/d52/fb1 [917324,119218] 0 2024-09-11T00:07:23.578 INFO:tasks.workunit.client.1.smithi203.stdout:3/638: mkdir d8/da/d5c/d99/de8 0 2024-09-11T00:07:23.580 INFO:tasks.workunit.client.1.smithi203.stdout:6/617: symlink d0/d5b/d5c/lc6 0 2024-09-11T00:07:23.583 INFO:tasks.workunit.client.1.smithi203.stdout:5/698: truncate dc/dd/d56/dad/f60 3932559 0 2024-09-11T00:07:23.585 INFO:tasks.workunit.client.0.smithi111.stdout:1/607: rename d2/de/d12/d88/lc1 to d2/de/d12/d3c/ld0 0 2024-09-11T00:07:23.587 INFO:tasks.workunit.client.1.smithi203.stdout:0/607: dwrite d0/d2/d37/f3b [0,4194304] 0 2024-09-11T00:07:23.588 INFO:tasks.workunit.client.0.smithi111.stdout:8/650: link d11/d21/d6f/dab/fc1 d11/d23/d7e/d93/fcd 0 2024-09-11T00:07:23.588 INFO:tasks.workunit.client.1.smithi203.stdout:2/675: dwrite d13/d56/d69/f6d [0,4194304] 0 2024-09-11T00:07:23.592 INFO:tasks.workunit.client.1.smithi203.stdout:2/676: write d13/d56/f78 [1027133,63150] 0 2024-09-11T00:07:23.593 INFO:tasks.workunit.client.1.smithi203.stdout:2/677: read - d13/d22/fdc zero size 2024-09-11T00:07:23.595 INFO:tasks.workunit.client.1.smithi203.stdout:9/598: sync 2024-09-11T00:07:23.599 INFO:tasks.workunit.client.1.smithi203.stdout:2/678: fsync d13/d15/d30/f63 0 2024-09-11T00:07:23.608 INFO:tasks.workunit.client.0.smithi111.stdout:0/670: read - d3/d13/d1e/deb/fb7 zero size 2024-09-11T00:07:23.608 INFO:tasks.workunit.client.0.smithi111.stdout:4/600: sync 2024-09-11T00:07:23.610 INFO:tasks.workunit.client.1.smithi203.stdout:5/699: truncate dc/fc3 778389 0 2024-09-11T00:07:23.610 INFO:tasks.workunit.client.0.smithi111.stdout:6/587: rmdir d7 39 2024-09-11T00:07:23.611 INFO:tasks.workunit.client.1.smithi203.stdout:3/639: dwrite d8/da/d5c/d6b/fcf [0,4194304] 0 2024-09-11T00:07:23.613 INFO:tasks.workunit.client.0.smithi111.stdout:7/642: rmdir dd/d1d/d4b/d8f 39 2024-09-11T00:07:23.613 INFO:tasks.workunit.client.1.smithi203.stdout:3/640: readlink d8/d3c/l52 0 2024-09-11T00:07:23.614 INFO:tasks.workunit.client.1.smithi203.stdout:3/641: dread - d8/da/d37/fd5 zero size 2024-09-11T00:07:23.618 INFO:tasks.workunit.client.0.smithi111.stdout:5/658: rename d10/d1e/d23/d30/d3c/d60/da2/d66/d76/dba to d10/d1e/d23/d30/d59/d52/d85/dd2 0 2024-09-11T00:07:23.619 INFO:tasks.workunit.client.0.smithi111.stdout:1/608: symlink d2/d2b/dc9/dba/ld1 0 2024-09-11T00:07:23.620 INFO:tasks.workunit.client.1.smithi203.stdout:2/679: fsync d13/d22/f6f 0 2024-09-11T00:07:23.623 INFO:tasks.workunit.client.1.smithi203.stdout:2/680: readlink d13/d56/d69/d99/lbf 0 2024-09-11T00:07:23.632 INFO:tasks.workunit.client.0.smithi111.stdout:2/604: truncate d0/d3/de/d50/fa0 4175445 0 2024-09-11T00:07:23.633 INFO:tasks.workunit.client.1.smithi203.stdout:6/618: write d0/d54/d9c/f18 [1644081,75409] 0 2024-09-11T00:07:23.633 INFO:tasks.workunit.client.1.smithi203.stdout:5/700: creat dc/dd/d15/dbd/d59/da8/fed x:0 0 0 2024-09-11T00:07:23.635 INFO:tasks.workunit.client.1.smithi203.stdout:5/701: write dc/d4f/d5c/fda [287733,66330] 0 2024-09-11T00:07:23.636 INFO:tasks.workunit.client.0.smithi111.stdout:8/651: dwrite d11/d23/d3d/fb2 [0,4194304] 0 2024-09-11T00:07:23.636 INFO:tasks.workunit.client.1.smithi203.stdout:3/642: mknod d8/da/d37/d83/d65/d8b/ce9 0 2024-09-11T00:07:23.636 INFO:tasks.workunit.client.1.smithi203.stdout:6/619: write d0/d54/d9c/d35/f70 [117306,102769] 0 2024-09-11T00:07:23.640 INFO:tasks.workunit.client.0.smithi111.stdout:0/671: rename d3/d13/d1e/d29/d49/fcc to d3/daf/db2/ff4 0 2024-09-11T00:07:23.647 INFO:tasks.workunit.client.0.smithi111.stdout:3/633: write d1c/d1d/d22/d31/d33/f53 [961442,83129] 0 2024-09-11T00:07:23.651 INFO:tasks.workunit.client.0.smithi111.stdout:9/675: dread d6/db/d34/d37/f2d [0,4194304] 0 2024-09-11T00:07:23.653 INFO:tasks.workunit.client.0.smithi111.stdout:1/609: write d2/de/d12/d3c/d4b/d6a/d63/d73/da1/fc2 [3659741,75059] 0 2024-09-11T00:07:23.655 INFO:tasks.workunit.client.1.smithi203.stdout:8/589: sync 2024-09-11T00:07:23.655 INFO:tasks.workunit.client.1.smithi203.stdout:7/607: sync 2024-09-11T00:07:23.655 INFO:tasks.workunit.client.1.smithi203.stdout:1/654: sync 2024-09-11T00:07:23.655 INFO:tasks.workunit.client.1.smithi203.stdout:4/522: sync 2024-09-11T00:07:23.656 INFO:tasks.workunit.client.1.smithi203.stdout:2/681: unlink d13/l33 0 2024-09-11T00:07:23.657 INFO:tasks.workunit.client.1.smithi203.stdout:7/608: fdatasync dd/d1c/f57 0 2024-09-11T00:07:23.659 INFO:tasks.workunit.client.1.smithi203.stdout:7/609: readlink dd/d1c/l42 0 2024-09-11T00:07:23.661 INFO:tasks.workunit.client.1.smithi203.stdout:7/610: stat dd/d1c/d52/d8f/d31/f49 0 2024-09-11T00:07:23.666 INFO:tasks.workunit.client.1.smithi203.stdout:5/702: write dc/dd/d15/f4b [3381905,61064] 0 2024-09-11T00:07:23.673 INFO:tasks.workunit.client.1.smithi203.stdout:1/655: unlink d8/d28/l69 0 2024-09-11T00:07:23.676 INFO:tasks.workunit.client.1.smithi203.stdout:4/523: creat db/dd/d16/d38/d3c/fa5 x:0 0 0 2024-09-11T00:07:23.680 INFO:tasks.workunit.client.1.smithi203.stdout:9/599: link d6/de/d19/d21/f7b d6/de/d19/fc9 0 2024-09-11T00:07:23.680 INFO:tasks.workunit.client.1.smithi203.stdout:7/611: truncate dd/d1c/f66 737942 0 2024-09-11T00:07:23.682 INFO:tasks.workunit.client.1.smithi203.stdout:7/612: fdatasync dd/f22 0 2024-09-11T00:07:23.682 INFO:tasks.workunit.client.0.smithi111.stdout:5/659: mknod d10/d1e/d23/cd3 0 2024-09-11T00:07:23.682 INFO:tasks.workunit.client.0.smithi111.stdout:7/643: truncate dd/d1d/d4d/f60 2663113 0 2024-09-11T00:07:23.684 INFO:tasks.workunit.client.0.smithi111.stdout:0/672: write d3/d1c/f6d [499308,28853] 0 2024-09-11T00:07:23.684 INFO:tasks.workunit.client.0.smithi111.stdout:3/634: creat d1c/d1d/d22/d31/d62/fda x:0 0 0 2024-09-11T00:07:23.685 INFO:tasks.workunit.client.0.smithi111.stdout:4/601: getdents d18/d20/d4a/d6b 0 2024-09-11T00:07:23.686 INFO:tasks.workunit.client.1.smithi203.stdout:5/703: mknod dc/d4f/d5c/dc9/cee 0 2024-09-11T00:07:23.686 INFO:tasks.workunit.client.0.smithi111.stdout:9/676: creat d6/db/d1b/d41/fda x:0 0 0 2024-09-11T00:07:23.687 INFO:tasks.workunit.client.1.smithi203.stdout:1/656: chown d8/d28/d64/ce0 12485 1 2024-09-11T00:07:23.687 INFO:tasks.workunit.client.0.smithi111.stdout:8/652: mknod d11/d23/d2c/d53/cce 0 2024-09-11T00:07:23.687 INFO:tasks.workunit.client.0.smithi111.stdout:0/673: chown d3/daf/db2 547523 1 2024-09-11T00:07:23.691 INFO:tasks.workunit.client.0.smithi111.stdout:9/677: chown d6/db/fd 10112424 1 2024-09-11T00:07:23.691 INFO:tasks.workunit.client.0.smithi111.stdout:6/588: dread d7/d22/d3f/f65 [0,4194304] 0 2024-09-11T00:07:23.691 INFO:tasks.workunit.client.1.smithi203.stdout:6/620: rename d0/d5b/f64 to d0/fc7 0 2024-09-11T00:07:23.692 INFO:tasks.workunit.client.0.smithi111.stdout:1/610: rmdir d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/d7b 39 2024-09-11T00:07:23.694 INFO:tasks.workunit.client.0.smithi111.stdout:3/635: dread d1c/d1d/fd1 [0,4194304] 0 2024-09-11T00:07:23.696 INFO:tasks.workunit.client.1.smithi203.stdout:4/524: write db/d12/f9a [1855274,64223] 0 2024-09-11T00:07:23.698 INFO:tasks.workunit.client.0.smithi111.stdout:7/644: rename dd/d1d/d2d/d2e/d4e to dd/d1d/d7e/dc8 0 2024-09-11T00:07:23.702 INFO:tasks.workunit.client.0.smithi111.stdout:4/602: mkdir d18/d20/d3c/d5e/d75/d8d/db8 0 2024-09-11T00:07:23.708 INFO:tasks.workunit.client.1.smithi203.stdout:5/704: write dc/dd/d15/f2c [3412013,110088] 0 2024-09-11T00:07:23.710 INFO:tasks.workunit.client.0.smithi111.stdout:3/636: symlink d1c/d1d/dac/ldb 0 2024-09-11T00:07:23.711 INFO:tasks.workunit.client.1.smithi203.stdout:0/608: getdents d0/d2/d7e 0 2024-09-11T00:07:23.713 INFO:tasks.workunit.client.0.smithi111.stdout:8/653: rename d11/d21/d38/d54 to d11/d23/d3d/dca/dcf 0 2024-09-11T00:07:23.713 INFO:tasks.workunit.client.1.smithi203.stdout:4/525: mkdir db/dd/d16/d38/d3c/da6 0 2024-09-11T00:07:23.714 INFO:tasks.workunit.client.0.smithi111.stdout:7/645: symlink dd/d49/lc9 0 2024-09-11T00:07:23.715 INFO:tasks.workunit.client.0.smithi111.stdout:9/678: dread d6/db/d34/d37/f35 [0,4194304] 0 2024-09-11T00:07:23.716 INFO:tasks.workunit.client.0.smithi111.stdout:5/660: link d10/d1e/d23/d2b/dad/fca d10/d1e/d23/d26/fd4 0 2024-09-11T00:07:23.717 INFO:tasks.workunit.client.0.smithi111.stdout:8/654: dread d11/d23/d2c/d46/fc8 [0,4194304] 0 2024-09-11T00:07:23.717 INFO:tasks.workunit.client.0.smithi111.stdout:7/646: chown dd/d1d/d76/db6/lbd 786202965 1 2024-09-11T00:07:23.717 INFO:tasks.workunit.client.0.smithi111.stdout:6/589: dwrite d7/d22/d1d/f75 [0,4194304] 0 2024-09-11T00:07:23.718 INFO:tasks.workunit.client.0.smithi111.stdout:4/603: mknod d18/d3b/d61/cb9 0 2024-09-11T00:07:23.719 INFO:tasks.workunit.client.1.smithi203.stdout:1/657: mknod d8/d19/d60/d90/dd9/ce9 0 2024-09-11T00:07:23.720 INFO:tasks.workunit.client.1.smithi203.stdout:6/621: mknod d0/d54/d9c/d7b/cc8 0 2024-09-11T00:07:23.723 INFO:tasks.workunit.client.1.smithi203.stdout:9/600: link d6/f8c d6/de/d19/d21/d87/dc0/fca 0 2024-09-11T00:07:23.727 INFO:tasks.workunit.client.1.smithi203.stdout:3/643: rename d8/da/d5c/d99 to d8/da/d37/d53/dea 0 2024-09-11T00:07:23.727 INFO:tasks.workunit.client.0.smithi111.stdout:0/674: link d3/dc/fa5 d3/d13/d66/ff5 0 2024-09-11T00:07:23.733 INFO:tasks.workunit.client.0.smithi111.stdout:0/675: read - d3/d13/d1e/deb/d61/d93/da7/fc6 zero size 2024-09-11T00:07:23.733 INFO:tasks.workunit.client.0.smithi111.stdout:5/661: symlink d10/d1e/d23/d30/d3c/ld5 0 2024-09-11T00:07:23.733 INFO:tasks.workunit.client.0.smithi111.stdout:4/604: unlink d18/c21 0 2024-09-11T00:07:23.737 INFO:tasks.workunit.client.0.smithi111.stdout:6/590: dwrite d7/d22/d3f/d74/d7f/d79/da4/fab [0,4194304] 0 2024-09-11T00:07:23.739 INFO:tasks.workunit.client.1.smithi203.stdout:8/590: rename d1/d13/d17/f50 to d1/d13/d17/d81/fc1 0 2024-09-11T00:07:23.742 INFO:tasks.workunit.client.0.smithi111.stdout:7/647: creat dd/d1d/d7e/dc8/fca x:0 0 0 2024-09-11T00:07:23.743 INFO:tasks.workunit.client.0.smithi111.stdout:3/637: creat d1c/d1d/d22/d44/d5a/d74/fdc x:0 0 0 2024-09-11T00:07:23.744 INFO:tasks.workunit.client.1.smithi203.stdout:9/601: dwrite d6/de/dc4/f51 [0,4194304] 0 2024-09-11T00:07:23.745 INFO:tasks.workunit.client.0.smithi111.stdout:7/648: fdatasync dd/d1d/d1f/f9b 0 2024-09-11T00:07:23.746 INFO:tasks.workunit.client.0.smithi111.stdout:7/649: readlink dd/d1d/d4b/l6a 0 2024-09-11T00:07:23.747 INFO:tasks.workunit.client.1.smithi203.stdout:3/644: mknod d8/da/d5c/d6b/d6c/ceb 0 2024-09-11T00:07:23.749 INFO:tasks.workunit.client.1.smithi203.stdout:3/645: chown d8/d2a/l48 65 1 2024-09-11T00:07:23.751 INFO:tasks.workunit.client.1.smithi203.stdout:3/646: stat d8/d17/f1c 0 2024-09-11T00:07:23.753 INFO:tasks.workunit.client.1.smithi203.stdout:3/647: readlink d8/d2a/l48 0 2024-09-11T00:07:23.760 INFO:tasks.workunit.client.1.smithi203.stdout:4/526: dread db/d12/d15/d2a/f8b [0,4194304] 0 2024-09-11T00:07:23.762 INFO:tasks.workunit.client.1.smithi203.stdout:8/591: readlink d1/l54 0 2024-09-11T00:07:23.764 INFO:tasks.workunit.client.1.smithi203.stdout:8/592: stat d1/d13/d3a/l45 0 2024-09-11T00:07:23.765 INFO:tasks.workunit.client.1.smithi203.stdout:1/658: write d8/d19/d60/d90/f53 [4014247,57650] 0 2024-09-11T00:07:23.767 INFO:tasks.workunit.client.1.smithi203.stdout:8/593: chown d1/d13/d17/d2f/c36 0 1 2024-09-11T00:07:23.767 INFO:tasks.workunit.client.1.smithi203.stdout:1/659: chown d8/d9/d15/ld4 15334 1 2024-09-11T00:07:23.769 INFO:tasks.workunit.client.1.smithi203.stdout:7/613: rename dd/d1c/d52/d8f/d31/d4a/d6e/fa5 to dd/d4d/d7f/fdc 0 2024-09-11T00:07:23.769 INFO:tasks.workunit.client.0.smithi111.stdout:8/655: write d11/fa1 [643656,125289] 0 2024-09-11T00:07:23.771 INFO:tasks.workunit.client.0.smithi111.stdout:1/611: getdents d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56 0 2024-09-11T00:07:23.771 INFO:tasks.workunit.client.0.smithi111.stdout:9/679: dwrite d6/d52/f61 [0,4194304] 0 2024-09-11T00:07:23.772 INFO:tasks.workunit.client.1.smithi203.stdout:6/622: link d0/d54/d9c/c4a d0/d54/d9c/d35/d38/d73/da1/cc9 0 2024-09-11T00:07:23.773 INFO:tasks.workunit.client.1.smithi203.stdout:5/705: write dc/dd/f3d [725587,121414] 0 2024-09-11T00:07:23.773 INFO:tasks.workunit.client.0.smithi111.stdout:0/676: symlink d3/d26/d77/lf6 0 2024-09-11T00:07:23.775 INFO:tasks.workunit.client.0.smithi111.stdout:0/677: fsync f1 0 2024-09-11T00:07:23.776 INFO:tasks.workunit.client.0.smithi111.stdout:9/680: readlink d6/db/d34/d37/d4c/d7f/lc3 0 2024-09-11T00:07:23.777 INFO:tasks.workunit.client.1.smithi203.stdout:4/527: unlink f9 0 2024-09-11T00:07:23.778 INFO:tasks.workunit.client.0.smithi111.stdout:9/681: stat d6/dc 0 2024-09-11T00:07:23.782 INFO:tasks.workunit.client.1.smithi203.stdout:7/614: dread - dd/d1c/d4b/dbb/fc7 zero size 2024-09-11T00:07:23.786 INFO:tasks.workunit.client.1.smithi203.stdout:2/682: rename d13/d56/l64 to d13/d15/d30/d5a/dac/lde 0 2024-09-11T00:07:23.788 INFO:tasks.workunit.client.0.smithi111.stdout:7/650: dread dd/d1d/d1f/f23 [0,4194304] 0 2024-09-11T00:07:23.788 INFO:tasks.workunit.client.0.smithi111.stdout:3/638: creat d1c/d1d/d22/d23/d2f/d63/d7e/fdd x:0 0 0 2024-09-11T00:07:23.788 INFO:tasks.workunit.client.1.smithi203.stdout:9/602: dread d6/f4a [0,4194304] 0 2024-09-11T00:07:23.789 INFO:tasks.workunit.client.0.smithi111.stdout:2/605: sync 2024-09-11T00:07:23.790 INFO:tasks.workunit.client.1.smithi203.stdout:8/594: mknod d1/d13/d43/d46/cc2 0 2024-09-11T00:07:23.791 INFO:tasks.workunit.client.1.smithi203.stdout:3/648: getdents d8/dce 0 2024-09-11T00:07:23.795 INFO:tasks.workunit.client.0.smithi111.stdout:5/662: unlink d10/d1e/d25/cc0 0 2024-09-11T00:07:23.796 INFO:tasks.workunit.client.1.smithi203.stdout:5/706: dwrite dc/dd/d56/fd0 [0,4194304] 0 2024-09-11T00:07:23.797 INFO:tasks.workunit.client.0.smithi111.stdout:8/656: creat d11/d23/d7e/d93/dba/fd0 x:0 0 0 2024-09-11T00:07:23.798 INFO:tasks.workunit.client.1.smithi203.stdout:6/623: rmdir d0/d54/d9c/d35/d39/d3c 39 2024-09-11T00:07:23.804 INFO:tasks.workunit.client.0.smithi111.stdout:7/651: dwrite dd/d49/fa5 [0,4194304] 0 2024-09-11T00:07:23.804 INFO:tasks.workunit.client.0.smithi111.stdout:1/612: symlink d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/d7b/ld2 0 2024-09-11T00:07:23.808 INFO:tasks.workunit.client.0.smithi111.stdout:6/591: symlink d7/d22/d26/lc4 0 2024-09-11T00:07:23.808 INFO:tasks.workunit.client.1.smithi203.stdout:7/615: rmdir dd/d1c/d52/d8f/d31 39 2024-09-11T00:07:23.809 INFO:tasks.workunit.client.0.smithi111.stdout:1/613: write d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/f5b [151396,8348] 0 2024-09-11T00:07:23.810 INFO:tasks.workunit.client.1.smithi203.stdout:9/603: symlink d6/de/d19/d24/lcb 0 2024-09-11T00:07:23.813 INFO:tasks.workunit.client.1.smithi203.stdout:8/595: mknod d1/d13/d17/d2f/d52/d49/cc3 0 2024-09-11T00:07:23.819 INFO:tasks.workunit.client.1.smithi203.stdout:1/660: getdents d8/d19/d60/d90/d3e/d4b/d80/d8d/da3/dd2 0 2024-09-11T00:07:23.823 INFO:tasks.workunit.client.0.smithi111.stdout:3/639: dread d1c/d1d/d22/d31/d33/f59 [0,4194304] 0 2024-09-11T00:07:23.823 INFO:tasks.workunit.client.0.smithi111.stdout:6/592: dwrite d7/d22/d1d/f75 [0,4194304] 0 2024-09-11T00:07:23.823 INFO:tasks.workunit.client.1.smithi203.stdout:2/683: mknod d13/d56/d69/dcb/cdf 0 2024-09-11T00:07:23.825 INFO:tasks.workunit.client.0.smithi111.stdout:8/657: symlink d11/d23/d3d/dca/dcf/dc3/ld1 0 2024-09-11T00:07:23.827 INFO:tasks.workunit.client.0.smithi111.stdout:6/593: write d7/d22/d1d/f88 [1196522,69289] 0 2024-09-11T00:07:23.831 INFO:tasks.workunit.client.1.smithi203.stdout:0/609: rename d0/d2/f40 to d0/d2/d3d/d5a/fca 0 2024-09-11T00:07:23.834 INFO:tasks.workunit.client.0.smithi111.stdout:7/652: mkdir dd/d48/d69/dbe/dcb 0 2024-09-11T00:07:23.836 INFO:tasks.workunit.client.1.smithi203.stdout:9/604: symlink d6/de/d19/d24/lcc 0 2024-09-11T00:07:23.837 INFO:tasks.workunit.client.1.smithi203.stdout:3/649: write d8/da/d37/d53/f62 [877761,5899] 0 2024-09-11T00:07:23.839 INFO:tasks.workunit.client.1.smithi203.stdout:8/596: rmdir d1/d13/d17/d48 39 2024-09-11T00:07:23.840 INFO:tasks.workunit.client.1.smithi203.stdout:9/605: write d6/de/d19/d24/d54/f9d [1508108,110074] 0 2024-09-11T00:07:23.844 INFO:tasks.workunit.client.0.smithi111.stdout:3/640: dwrite d1c/d1d/d22/d31/fc8 [0,4194304] 0 2024-09-11T00:07:23.856 INFO:tasks.workunit.client.1.smithi203.stdout:6/624: dwrite d0/d54/d9c/d35/d39/f6a [0,4194304] 0 2024-09-11T00:07:23.857 INFO:tasks.workunit.client.1.smithi203.stdout:4/528: rename db/dd/d16/d38/f5f to db/dd/d26/d42/d5e/fa7 0 2024-09-11T00:07:23.858 INFO:tasks.workunit.client.0.smithi111.stdout:8/658: mkdir d11/d23/d2c/d46/d81/dd2 0 2024-09-11T00:07:23.859 INFO:tasks.workunit.client.0.smithi111.stdout:2/606: write d0/d3/de/d3b/d97/f7e [781586,117708] 0 2024-09-11T00:07:23.861 INFO:tasks.workunit.client.0.smithi111.stdout:6/594: mkdir d7/d22/d26/d87/d7a/dc5 0 2024-09-11T00:07:23.862 INFO:tasks.workunit.client.0.smithi111.stdout:5/663: write d10/d1e/d23/d30/d3c/d60/d7e/f5b [1948994,120627] 0 2024-09-11T00:07:23.864 INFO:tasks.workunit.client.1.smithi203.stdout:7/616: dwrite dd/d1c/d52/fac [0,4194304] 0 2024-09-11T00:07:23.865 INFO:tasks.workunit.client.1.smithi203.stdout:9/606: dwrite d6/f96 [0,4194304] 0 2024-09-11T00:07:23.867 INFO:tasks.workunit.client.0.smithi111.stdout:4/605: link d18/d20/d4a/c69 d18/cba 0 2024-09-11T00:07:23.867 INFO:tasks.workunit.client.0.smithi111.stdout:2/607: read d0/d3/f4e [1887266,100661] 0 2024-09-11T00:07:23.868 INFO:tasks.workunit.client.1.smithi203.stdout:4/529: write db/d12/d15/d2a/f34 [976855,70542] 0 2024-09-11T00:07:23.868 INFO:tasks.workunit.client.1.smithi203.stdout:3/650: creat d8/d17/fec x:0 0 0 2024-09-11T00:07:23.871 INFO:tasks.workunit.client.0.smithi111.stdout:0/678: creat d3/d13/d1e/d29/d49/ff7 x:0 0 0 2024-09-11T00:07:23.873 INFO:tasks.workunit.client.0.smithi111.stdout:7/653: write dd/d1d/d1f/f5e [2369865,31401] 0 2024-09-11T00:07:23.874 INFO:tasks.workunit.client.0.smithi111.stdout:2/608: chown d0/d3/de/d4b 6533 1 2024-09-11T00:07:23.875 INFO:tasks.workunit.client.0.smithi111.stdout:1/614: truncate d2/de/d12/d3c/d4b/d6a/d3a/f70 396663 0 2024-09-11T00:07:23.879 INFO:tasks.workunit.client.0.smithi111.stdout:2/609: truncate d0/d3/fb9 802391 0 2024-09-11T00:07:23.880 INFO:tasks.workunit.client.0.smithi111.stdout:2/610: chown d0/d3/d98/dbe 10738 1 2024-09-11T00:07:23.881 INFO:tasks.workunit.client.1.smithi203.stdout:8/597: readlink d1/d13/d17/d48/d61/l8e 0 2024-09-11T00:07:23.882 INFO:tasks.workunit.client.1.smithi203.stdout:6/625: creat d0/d54/d9c/d35/d38/d73/fca x:0 0 0 2024-09-11T00:07:23.883 INFO:tasks.workunit.client.0.smithi111.stdout:6/595: rmdir d7/d22/d1d/d69/db4 39 2024-09-11T00:07:23.883 INFO:tasks.workunit.client.0.smithi111.stdout:3/641: creat d1c/d1d/fde x:0 0 0 2024-09-11T00:07:23.886 INFO:tasks.workunit.client.1.smithi203.stdout:6/626: chown d0/d32/d5a/fad 1932737163 1 2024-09-11T00:07:23.886 INFO:tasks.workunit.client.0.smithi111.stdout:5/664: dwrite d10/d1e/d23/d26/d3a/d98/f77 [0,4194304] 0 2024-09-11T00:07:23.890 INFO:tasks.workunit.client.1.smithi203.stdout:7/617: mkdir dd/d3b/d5b/ddd 0 2024-09-11T00:07:23.891 INFO:tasks.workunit.client.1.smithi203.stdout:9/607: rmdir d6/de/d32/d52/d55 39 2024-09-11T00:07:23.899 INFO:tasks.workunit.client.1.smithi203.stdout:4/530: dwrite db/d12/d15/d2a/d71/f96 [0,4194304] 0 2024-09-11T00:07:23.899 INFO:tasks.workunit.client.1.smithi203.stdout:8/598: dread d1/d13/d17/d48/f53 [0,4194304] 0 2024-09-11T00:07:23.903 INFO:tasks.workunit.client.1.smithi203.stdout:1/661: dread d8/d11/f51 [4194304,4194304] 0 2024-09-11T00:07:23.906 INFO:tasks.workunit.client.1.smithi203.stdout:1/662: chown d8/d19/d60/d90/d3e/d4b/d80/d91/dac 8047 1 2024-09-11T00:07:23.907 INFO:tasks.workunit.client.1.smithi203.stdout:1/663: stat d8/d11/f20 0 2024-09-11T00:07:23.908 INFO:tasks.workunit.client.0.smithi111.stdout:0/679: dwrite d3/d13/d1e/deb/d61/f7e [0,4194304] 0 2024-09-11T00:07:23.915 INFO:tasks.workunit.client.0.smithi111.stdout:2/611: symlink d0/d3/de/d3b/d63/lcf 0 2024-09-11T00:07:23.923 INFO:tasks.workunit.client.0.smithi111.stdout:3/642: mknod d1c/d1d/d22/d31/d62/cdf 0 2024-09-11T00:07:23.924 INFO:tasks.workunit.client.0.smithi111.stdout:3/643: chown d1c/d21/dae/cb8 532401064 1 2024-09-11T00:07:23.925 INFO:tasks.workunit.client.1.smithi203.stdout:6/627: mknod d0/d54/d9c/d35/d38/ccb 0 2024-09-11T00:07:23.926 INFO:tasks.workunit.client.0.smithi111.stdout:5/665: mkdir d10/d1e/d23/d30/d59/d52/dd6 0 2024-09-11T00:07:23.928 INFO:tasks.workunit.client.0.smithi111.stdout:8/659: dread d11/d23/d2c/f45 [4194304,4194304] 0 2024-09-11T00:07:23.929 INFO:tasks.workunit.client.0.smithi111.stdout:5/666: fsync d10/d1e/d25/d6e/f7d 0 2024-09-11T00:07:23.929 INFO:tasks.workunit.client.0.smithi111.stdout:4/606: mkdir d18/d20/d3c/d5e/daa/dbb 0 2024-09-11T00:07:23.933 INFO:tasks.workunit.client.0.smithi111.stdout:7/654: truncate dd/d1d/f39 1928479 0 2024-09-11T00:07:23.933 INFO:tasks.workunit.client.0.smithi111.stdout:4/607: truncate d18/d20/d40/d78/d79/f8a 903670 0 2024-09-11T00:07:23.934 INFO:tasks.workunit.client.1.smithi203.stdout:1/664: dwrite d8/d9/d15/d35/d81/db9/fca [0,4194304] 0 2024-09-11T00:07:23.935 INFO:tasks.workunit.client.1.smithi203.stdout:5/707: link dc/dd/d13/c39 dc/d4f/cef 0 2024-09-11T00:07:23.935 INFO:tasks.workunit.client.0.smithi111.stdout:7/655: truncate dd/d1d/d1f/f9d 771289 0 2024-09-11T00:07:23.936 INFO:tasks.workunit.client.0.smithi111.stdout:7/656: readlink dd/d1d/l6c 0 2024-09-11T00:07:23.938 INFO:tasks.workunit.client.0.smithi111.stdout:7/657: write dd/d48/f61 [6708630,65685] 0 2024-09-11T00:07:23.938 INFO:tasks.workunit.client.1.smithi203.stdout:4/531: creat db/d12/d15/d2a/d88/d95/fa8 x:0 0 0 2024-09-11T00:07:23.940 INFO:tasks.workunit.client.0.smithi111.stdout:7/658: readlink dd/d1d/d4b/l6a 0 2024-09-11T00:07:23.941 INFO:tasks.workunit.client.0.smithi111.stdout:6/596: dread d7/f15 [0,4194304] 0 2024-09-11T00:07:23.942 INFO:tasks.workunit.client.1.smithi203.stdout:8/599: symlink d1/d13/d17/d2f/d52/d49/lc4 0 2024-09-11T00:07:23.944 INFO:tasks.workunit.client.1.smithi203.stdout:2/684: getdents d13/d15/d19/d1c/d73/dc4 0 2024-09-11T00:07:23.948 INFO:tasks.workunit.client.0.smithi111.stdout:8/660: mknod d11/d21/d6f/dab/cd3 0 2024-09-11T00:07:23.948 INFO:tasks.workunit.client.1.smithi203.stdout:2/685: fdatasync d13/d15/d19/d1c/d76/d94/fce 0 2024-09-11T00:07:23.952 INFO:tasks.workunit.client.1.smithi203.stdout:0/610: rename d0/d1d/d5d/d70/lc3 to d0/d2/lcb 0 2024-09-11T00:07:23.953 INFO:tasks.workunit.client.0.smithi111.stdout:4/608: dread d18/d20/d40/f42 [0,4194304] 0 2024-09-11T00:07:23.955 INFO:tasks.workunit.client.0.smithi111.stdout:2/612: dwrite d0/d3/de/d3b/fb0 [0,4194304] 0 2024-09-11T00:07:23.957 INFO:tasks.workunit.client.0.smithi111.stdout:5/667: mknod d10/d1e/d23/d2b/d92/cd7 0 2024-09-11T00:07:23.957 INFO:tasks.workunit.client.0.smithi111.stdout:9/682: sync 2024-09-11T00:07:23.957 INFO:tasks.workunit.client.0.smithi111.stdout:1/615: write d2/de/d12/d3c/d4b/d6a/d3a/f70 [976807,2317] 0 2024-09-11T00:07:23.959 INFO:tasks.workunit.client.0.smithi111.stdout:0/680: symlink d3/d13/d1e/deb/d61/d93/lf8 0 2024-09-11T00:07:23.959 INFO:tasks.workunit.client.1.smithi203.stdout:9/608: dwrite d6/de/d19/f7a [0,4194304] 0 2024-09-11T00:07:23.959 INFO:tasks.workunit.client.0.smithi111.stdout:5/668: write d10/d1e/d25/f93 [2285706,13759] 0 2024-09-11T00:07:23.961 INFO:tasks.workunit.client.1.smithi203.stdout:5/708: fsync dc/dd/d1e/d7b/fb7 0 2024-09-11T00:07:23.963 INFO:tasks.workunit.client.1.smithi203.stdout:8/600: dread d1/d13/d17/d2f/d9e/f66 [0,4194304] 0 2024-09-11T00:07:23.963 INFO:tasks.workunit.client.0.smithi111.stdout:1/616: chown d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/f61 2328 1 2024-09-11T00:07:23.964 INFO:tasks.workunit.client.1.smithi203.stdout:1/665: unlink d8/d19/d60/d90/d3e/d4b/d80/d8d/db0/fc7 0 2024-09-11T00:07:23.965 INFO:tasks.workunit.client.0.smithi111.stdout:7/659: read dd/d48/f5f [3327488,93584] 0 2024-09-11T00:07:23.965 INFO:tasks.workunit.client.1.smithi203.stdout:9/609: chown d6/de/d19/d24/d40/d45 149731 1 2024-09-11T00:07:23.965 INFO:tasks.workunit.client.0.smithi111.stdout:1/617: chown d2/de/d12/d3c/d4b/d6a/d3a/f68 7336535 1 2024-09-11T00:07:23.974 INFO:tasks.workunit.client.0.smithi111.stdout:8/661: rename d11/d21/dc4 to d11/d8e/dd4 0 2024-09-11T00:07:23.976 INFO:tasks.workunit.client.0.smithi111.stdout:8/662: stat d11/d21/d38 0 2024-09-11T00:07:23.981 INFO:tasks.workunit.client.1.smithi203.stdout:2/686: rename d13/d15/d30/d59/l5c to d13/d15/d19/d1c/le0 0 2024-09-11T00:07:23.982 INFO:tasks.workunit.client.0.smithi111.stdout:4/609: mknod d18/d20/d3c/d5e/cbc 0 2024-09-11T00:07:23.984 INFO:tasks.workunit.client.0.smithi111.stdout:7/660: dwrite dd/d1d/d7e/f94 [4194304,4194304] 0 2024-09-11T00:07:23.985 INFO:tasks.workunit.client.0.smithi111.stdout:2/613: unlink d0/d3/l53 0 2024-09-11T00:07:23.986 INFO:tasks.workunit.client.0.smithi111.stdout:6/597: dwrite d7/f11 [0,4194304] 0 2024-09-11T00:07:23.986 INFO:tasks.workunit.client.1.smithi203.stdout:3/651: write d8/da/d37/d83/d6a/f7d [8386,75593] 0 2024-09-11T00:07:23.986 INFO:tasks.workunit.client.1.smithi203.stdout:0/611: readlink d0/d2/d37/l57 0 2024-09-11T00:07:23.988 INFO:tasks.workunit.client.0.smithi111.stdout:2/614: chown d0/d3/de/d3b/d62/l91 3181 1 2024-09-11T00:07:23.988 INFO:tasks.workunit.client.0.smithi111.stdout:6/598: write f6 [2897585,68036] 0 2024-09-11T00:07:23.996 INFO:tasks.workunit.client.0.smithi111.stdout:3/644: truncate d1c/d1d/d22/d23/d2f/d63/f6b 2735020 0 2024-09-11T00:07:23.998 INFO:tasks.workunit.client.0.smithi111.stdout:5/669: dread - d10/d1e/d23/d26/d78/f94 zero size 2024-09-11T00:07:23.999 INFO:tasks.workunit.client.0.smithi111.stdout:3/645: readlink d1c/d1d/d22/d31/d33/d5f/l8b 0 2024-09-11T00:07:24.005 INFO:tasks.workunit.client.0.smithi111.stdout:5/670: write d10/d1e/d23/d30/d3c/d60/d7e/fb1 [3391910,116466] 0 2024-09-11T00:07:24.008 INFO:tasks.workunit.client.1.smithi203.stdout:8/601: creat d1/d13/d17/d48/d61/fc5 x:0 0 0 2024-09-11T00:07:24.009 INFO:tasks.workunit.client.0.smithi111.stdout:2/615: dwrite d0/d3/fb9 [0,4194304] 0 2024-09-11T00:07:24.009 INFO:tasks.workunit.client.0.smithi111.stdout:4/610: dwrite d18/d20/f46 [0,4194304] 0 2024-09-11T00:07:24.009 INFO:tasks.workunit.client.0.smithi111.stdout:9/683: rename l1 to d6/db/d34/d37/d4c/d7f/d97/ldb 0 2024-09-11T00:07:24.011 INFO:tasks.workunit.client.0.smithi111.stdout:8/663: symlink d11/d23/d2c/ld5 0 2024-09-11T00:07:24.012 INFO:tasks.workunit.client.1.smithi203.stdout:1/666: readlink d8/d19/d60/d90/d3e/d4b/l79 0 2024-09-11T00:07:24.019 INFO:tasks.workunit.client.1.smithi203.stdout:2/687: creat d13/d56/d69/dcb/fe1 x:0 0 0 2024-09-11T00:07:24.026 INFO:tasks.workunit.client.1.smithi203.stdout:0/612: mknod d0/d2/d37/ccc 0 2024-09-11T00:07:24.032 INFO:tasks.workunit.client.1.smithi203.stdout:8/602: rmdir d1/d13/d43 39 2024-09-11T00:07:24.034 INFO:tasks.workunit.client.0.smithi111.stdout:0/681: creat d3/d13/d1e/d29/d49/df2/ff9 x:0 0 0 2024-09-11T00:07:24.037 INFO:tasks.workunit.client.1.smithi203.stdout:9/610: mknod d6/de/d19/d24/d54/db2/ccd 0 2024-09-11T00:07:24.040 INFO:tasks.workunit.client.1.smithi203.stdout:5/709: rename dc/d4f/cb4 to dc/dd/d15/d3b/d73/cf0 0 2024-09-11T00:07:24.041 INFO:tasks.workunit.client.1.smithi203.stdout:4/532: dwrite db/d12/d15/d2a/f82 [0,4194304] 0 2024-09-11T00:07:24.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:23 smithi203 ceph-mon[33225]: Standby manager daemon smithi111.ypucji started 2024-09-11T00:07:24.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:23 smithi203 ceph-mon[33225]: from='mgr.? 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.ypucji/crt"}]: dispatch 2024-09-11T00:07:24.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:23 smithi203 ceph-mon[33225]: from='mgr.? 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T00:07:24.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:23 smithi203 ceph-mon[33225]: from='mgr.? 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.ypucji/key"}]: dispatch 2024-09-11T00:07:24.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:23 smithi203 ceph-mon[33225]: from='mgr.? 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T00:07:24.049 INFO:tasks.workunit.client.0.smithi111.stdout:2/616: rmdir d0/d3/d12/d52 39 2024-09-11T00:07:24.050 INFO:tasks.workunit.client.0.smithi111.stdout:2/617: fsync d0/d3/de/d3b/fbf 0 2024-09-11T00:07:24.052 INFO:tasks.workunit.client.0.smithi111.stdout:0/682: dwrite d3/d13/d1e/d29/f9a [0,4194304] 0 2024-09-11T00:07:24.054 INFO:tasks.workunit.client.0.smithi111.stdout:4/611: truncate d18/d20/d40/f8c 720394 0 2024-09-11T00:07:24.054 INFO:tasks.workunit.client.1.smithi203.stdout:6/628: getdents d0/d5b/d5c/d6f 0 2024-09-11T00:07:24.057 INFO:tasks.workunit.client.1.smithi203.stdout:2/688: write d13/d95/daf/fd1 [771964,59724] 0 2024-09-11T00:07:24.059 INFO:tasks.workunit.client.1.smithi203.stdout:0/613: creat d0/d2/d37/d7f/fcd x:0 0 0 2024-09-11T00:07:24.060 INFO:tasks.workunit.client.1.smithi203.stdout:3/652: write d8/da/d37/d53/f9b [764834,72470] 0 2024-09-11T00:07:24.062 INFO:tasks.workunit.client.1.smithi203.stdout:8/603: mknod d1/d13/d17/d2f/d9e/cc6 0 2024-09-11T00:07:24.067 INFO:tasks.workunit.client.1.smithi203.stdout:5/710: creat dc/d4f/d5c/ff1 x:0 0 0 2024-09-11T00:07:24.071 INFO:tasks.workunit.client.0.smithi111.stdout:1/618: write d2/d2b/f3e [1604900,47065] 0 2024-09-11T00:07:24.072 INFO:tasks.workunit.client.1.smithi203.stdout:5/711: write dc/dd/d15/d3b/d7a/f90 [87703,77212] 0 2024-09-11T00:07:24.072 INFO:tasks.workunit.client.1.smithi203.stdout:1/667: write d8/d19/d60/d90/d3e/d4b/d3a/fd1 [4643315,26166] 0 2024-09-11T00:07:24.073 INFO:tasks.workunit.client.0.smithi111.stdout:9/684: write d6/db/d1b/d41/f5e [161140,26924] 0 2024-09-11T00:07:24.075 INFO:tasks.workunit.client.1.smithi203.stdout:4/533: creat db/dd/d16/d38/fa9 x:0 0 0 2024-09-11T00:07:24.076 INFO:tasks.workunit.client.1.smithi203.stdout:5/712: write dc/dd/f3d [1746398,8591] 0 2024-09-11T00:07:24.077 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:23 smithi111 ceph-mon[27539]: Standby manager daemon smithi111.ypucji started 2024-09-11T00:07:24.077 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:23 smithi111 ceph-mon[27539]: from='mgr.? 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.ypucji/crt"}]: dispatch 2024-09-11T00:07:24.077 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:23 smithi111 ceph-mon[27539]: from='mgr.? 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T00:07:24.077 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:23 smithi111 ceph-mon[27539]: from='mgr.? 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.ypucji/key"}]: dispatch 2024-09-11T00:07:24.077 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:23 smithi111 ceph-mon[27539]: from='mgr.? 172.21.15.111:0/2' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T00:07:24.078 INFO:tasks.workunit.client.0.smithi111.stdout:9/685: truncate d6/db/d1b/d56/dc8/fd9 641421 0 2024-09-11T00:07:24.079 INFO:tasks.workunit.client.0.smithi111.stdout:6/599: truncate d7/f12 65089 0 2024-09-11T00:07:24.081 INFO:tasks.workunit.client.0.smithi111.stdout:9/686: truncate d6/db/d34/d37/f28 5201636 0 2024-09-11T00:07:24.081 INFO:tasks.workunit.client.1.smithi203.stdout:6/629: stat d0/d54/d9c/d35/f65 0 2024-09-11T00:07:24.081 INFO:tasks.workunit.client.1.smithi203.stdout:1/668: truncate d8/d19/d60/d90/d3e/d4b/d41/f70 1813576 0 2024-09-11T00:07:24.085 INFO:tasks.workunit.client.1.smithi203.stdout:3/653: fdatasync d8/d17/f78 0 2024-09-11T00:07:24.088 INFO:tasks.workunit.client.1.smithi203.stdout:0/614: symlink d0/d2/d3d/d5a/lce 0 2024-09-11T00:07:24.088 INFO:tasks.workunit.client.1.smithi203.stdout:6/630: truncate d0/d32/d5a/fad 253497 0 2024-09-11T00:07:24.089 INFO:tasks.workunit.client.1.smithi203.stdout:6/631: fsync d0/d54/d9c/d35/f3f 0 2024-09-11T00:07:24.089 INFO:tasks.workunit.client.1.smithi203.stdout:0/615: fdatasync d0/d2/d37/f3b 0 2024-09-11T00:07:24.090 INFO:tasks.workunit.client.1.smithi203.stdout:6/632: readlink d0/d5b/l7c 0 2024-09-11T00:07:24.092 INFO:tasks.workunit.client.1.smithi203.stdout:9/611: write d6/de/d19/d24/f36 [796472,86292] 0 2024-09-11T00:07:24.104 INFO:tasks.workunit.client.1.smithi203.stdout:2/689: creat d13/d15/d19/d1c/d73/dc8/fe2 x:0 0 0 2024-09-11T00:07:24.104 INFO:tasks.workunit.client.1.smithi203.stdout:5/713: write dc/dd/f28 [518513,77534] 0 2024-09-11T00:07:24.116 INFO:tasks.workunit.client.1.smithi203.stdout:4/534: rename db/dd/f79 to db/d12/d15/d2a/d88/faa 0 2024-09-11T00:07:24.121 INFO:tasks.workunit.client.1.smithi203.stdout:2/690: dwrite d13/d15/d30/fc0 [0,4194304] 0 2024-09-11T00:07:24.134 INFO:tasks.workunit.client.1.smithi203.stdout:0/616: dwrite d0/f19 [0,4194304] 0 2024-09-11T00:07:24.134 INFO:tasks.workunit.client.1.smithi203.stdout:9/612: creat d6/de/d32/d52/d55/da2/fce x:0 0 0 2024-09-11T00:07:24.138 INFO:tasks.workunit.client.1.smithi203.stdout:1/669: creat d8/d9/d15/d35/fea x:0 0 0 2024-09-11T00:07:24.151 INFO:tasks.workunit.client.1.smithi203.stdout:0/617: creat d0/d2/d7e/da1/fcf x:0 0 0 2024-09-11T00:07:24.153 INFO:tasks.workunit.client.1.smithi203.stdout:8/604: link d1/d13/d43/d46/d76/c83 d1/d13/d17/d2f/d52/d49/d68/dba/cc7 0 2024-09-11T00:07:24.154 INFO:tasks.workunit.client.1.smithi203.stdout:9/613: dwrite d6/de/d19/f3e [0,4194304] 0 2024-09-11T00:07:24.157 INFO:tasks.workunit.client.1.smithi203.stdout:3/654: truncate d8/d17/f78 7276663 0 2024-09-11T00:07:24.159 INFO:tasks.workunit.client.1.smithi203.stdout:3/655: stat d8/da/d11/c27 0 2024-09-11T00:07:24.161 INFO:tasks.workunit.client.1.smithi203.stdout:4/535: write db/f49 [995912,87324] 0 2024-09-11T00:07:24.163 INFO:tasks.workunit.client.1.smithi203.stdout:6/633: rename d0/d54/d9c/d35/ca2 to d0/d54/d9c/d35/d39/ccc 0 2024-09-11T00:07:24.173 INFO:tasks.workunit.client.1.smithi203.stdout:1/670: link d8/d28/d64/f65 d8/d9/d15/d35/d81/db9/dce/feb 0 2024-09-11T00:07:24.180 INFO:tasks.workunit.client.1.smithi203.stdout:5/714: rename dc/dd/d15/d3b/d73/ca4 to dc/d91/cf2 0 2024-09-11T00:07:24.180 INFO:tasks.workunit.client.1.smithi203.stdout:0/618: dwrite d0/fc6 [0,4194304] 0 2024-09-11T00:07:24.180 INFO:tasks.workunit.client.1.smithi203.stdout:1/671: readlink d8/d19/d60/d90/d3e/d4b/l79 0 2024-09-11T00:07:24.183 INFO:tasks.workunit.client.1.smithi203.stdout:3/656: mknod d8/da/d37/d83/d6a/ced 0 2024-09-11T00:07:24.185 INFO:tasks.workunit.client.1.smithi203.stdout:1/672: write d8/d11/f20 [1793725,63898] 0 2024-09-11T00:07:24.191 INFO:tasks.workunit.client.1.smithi203.stdout:0/619: chown d0/d2/d7e/da1/cb5 0 1 2024-09-11T00:07:24.191 INFO:tasks.workunit.client.1.smithi203.stdout:1/673: write d8/d19/fa6 [1965190,36226] 0 2024-09-11T00:07:24.193 INFO:tasks.workunit.client.0.smithi111.stdout:2/618: unlink d0/d3/de/d3b/fbf 0 2024-09-11T00:07:24.194 INFO:tasks.workunit.client.1.smithi203.stdout:4/536: creat db/d12/fab x:0 0 0 2024-09-11T00:07:24.195 INFO:tasks.workunit.client.0.smithi111.stdout:0/683: rmdir d3/da/d7b 39 2024-09-11T00:07:24.196 INFO:tasks.workunit.client.0.smithi111.stdout:4/612: mkdir d18/d3b/d51/dbd 0 2024-09-11T00:07:24.200 INFO:tasks.workunit.client.0.smithi111.stdout:8/664: creat d11/d23/d3d/d8d/db9/fd6 x:0 0 0 2024-09-11T00:07:24.203 INFO:tasks.workunit.client.0.smithi111.stdout:7/661: creat dd/fcc x:0 0 0 2024-09-11T00:07:24.206 INFO:tasks.workunit.client.0.smithi111.stdout:3/646: creat d1c/d1d/d22/d23/d58/fe0 x:0 0 0 2024-09-11T00:07:24.207 INFO:tasks.workunit.client.0.smithi111.stdout:3/647: dread - d1c/d21/f4f zero size 2024-09-11T00:07:24.208 INFO:tasks.workunit.client.0.smithi111.stdout:3/648: dread - d1c/d1d/d22/fc1 zero size 2024-09-11T00:07:24.208 INFO:tasks.workunit.client.0.smithi111.stdout:6/600: write d7/d22/d26/d95/fc2 [9120805,81925] 0 2024-09-11T00:07:24.213 INFO:tasks.workunit.client.1.smithi203.stdout:5/715: getdents dc/dd/d15/dbd/dce 0 2024-09-11T00:07:24.213 INFO:tasks.workunit.client.1.smithi203.stdout:1/674: symlink d8/d19/d60/d90/d3e/d4b/d80/d8d/lec 0 2024-09-11T00:07:24.215 INFO:tasks.workunit.client.1.smithi203.stdout:4/537: rename db/dd/d16/c33 to db/dd/d16/cac 0 2024-09-11T00:07:24.218 INFO:tasks.workunit.client.1.smithi203.stdout:6/634: dwrite d0/d32/f43 [0,4194304] 0 2024-09-11T00:07:24.221 INFO:tasks.workunit.client.1.smithi203.stdout:9/614: dwrite d6/de/fa9 [0,4194304] 0 2024-09-11T00:07:24.228 INFO:tasks.workunit.client.1.smithi203.stdout:8/605: dwrite d1/d13/d17/d2f/d9e/f70 [0,4194304] 0 2024-09-11T00:07:24.229 INFO:tasks.workunit.client.1.smithi203.stdout:1/675: creat d8/d19/d60/d90/d3e/d4b/d80/da2/fed x:0 0 0 2024-09-11T00:07:24.233 INFO:tasks.workunit.client.0.smithi111.stdout:5/671: truncate d10/d1e/d23/d26/d3a/d98/d6d/fc7 1270868 0 2024-09-11T00:07:24.234 INFO:tasks.workunit.client.0.smithi111.stdout:5/672: fdatasync d10/f1b 0 2024-09-11T00:07:24.235 INFO:tasks.workunit.client.1.smithi203.stdout:5/716: truncate dc/dd/d15/d3b/f72 652862 0 2024-09-11T00:07:24.238 INFO:tasks.workunit.client.1.smithi203.stdout:6/635: rename d0/d5b/l6d to d0/d32/d5a/lcd 0 2024-09-11T00:07:24.240 INFO:tasks.workunit.client.0.smithi111.stdout:9/687: write d6/db/d34/d37/f32 [983393,80257] 0 2024-09-11T00:07:24.240 INFO:tasks.workunit.client.1.smithi203.stdout:1/676: chown d8/d19/d60/d90/d3e/d4b/d80/da2/fed 3 1 2024-09-11T00:07:24.242 INFO:tasks.workunit.client.0.smithi111.stdout:2/619: rename d0/d3/de/d3b/f58 to d0/d3/d12/d52/d6c/fd0 0 2024-09-11T00:07:24.246 INFO:tasks.workunit.client.1.smithi203.stdout:9/615: mknod d6/de/d47/ccf 0 2024-09-11T00:07:24.246 INFO:tasks.workunit.client.1.smithi203.stdout:3/657: dwrite d8/da/d37/d53/d63/fbf [0,4194304] 0 2024-09-11T00:07:24.250 INFO:tasks.workunit.client.1.smithi203.stdout:3/658: write d8/da/d37/d83/fc2 [91120,107652] 0 2024-09-11T00:07:24.252 INFO:tasks.workunit.client.1.smithi203.stdout:9/616: readlink d6/de/d19/d24/lcb 0 2024-09-11T00:07:24.257 INFO:tasks.workunit.client.0.smithi111.stdout:8/665: write d11/d23/d2c/d46/fc8 [1179947,56178] 0 2024-09-11T00:07:24.258 INFO:tasks.workunit.client.1.smithi203.stdout:5/717: chown dc/dd/f9d 858502295 1 2024-09-11T00:07:24.259 INFO:tasks.workunit.client.0.smithi111.stdout:8/666: chown d11/d23/d2c/d46/l50 2089637447 1 2024-09-11T00:07:24.261 INFO:tasks.workunit.client.1.smithi203.stdout:6/636: truncate d0/f4f 429986 0 2024-09-11T00:07:24.263 INFO:tasks.workunit.client.0.smithi111.stdout:6/601: creat d7/d22/d26/d87/d7a/dc5/fc6 x:0 0 0 2024-09-11T00:07:24.266 INFO:tasks.workunit.client.1.smithi203.stdout:3/659: rmdir d8/da/d5c 39 2024-09-11T00:07:24.270 INFO:tasks.workunit.client.1.smithi203.stdout:4/538: creat db/d12/fad x:0 0 0 2024-09-11T00:07:24.270 INFO:tasks.workunit.client.0.smithi111.stdout:2/620: dread - d0/d3/de/d3b/d62/d6d/faa zero size 2024-09-11T00:07:24.271 INFO:tasks.workunit.client.1.smithi203.stdout:5/718: creat dc/dd/d1e/dc6/ff3 x:0 0 0 2024-09-11T00:07:24.272 INFO:tasks.workunit.client.0.smithi111.stdout:4/613: creat d18/d1f/fbe x:0 0 0 2024-09-11T00:07:24.273 INFO:tasks.workunit.client.0.smithi111.stdout:4/614: dread - d18/fa5 zero size 2024-09-11T00:07:24.274 INFO:tasks.workunit.client.0.smithi111.stdout:0/684: rename d3/d13/c47 to d3/d13/cfa 0 2024-09-11T00:07:24.278 INFO:tasks.workunit.client.0.smithi111.stdout:6/602: dread d7/d22/d3f/d74/d7f/d79/da4/fab [0,4194304] 0 2024-09-11T00:07:24.278 INFO:tasks.workunit.client.0.smithi111.stdout:3/649: creat d1c/d21/fe1 x:0 0 0 2024-09-11T00:07:24.278 INFO:tasks.workunit.client.1.smithi203.stdout:5/719: write dc/dd/d56/fd0 [4192357,29378] 0 2024-09-11T00:07:24.280 INFO:tasks.workunit.client.1.smithi203.stdout:5/720: stat dc/d2b/dba 0 2024-09-11T00:07:24.280 INFO:tasks.workunit.client.0.smithi111.stdout:8/667: mknod d11/d23/d3d/dca/cd7 0 2024-09-11T00:07:24.285 INFO:tasks.workunit.client.1.smithi203.stdout:8/606: link d1/d13/d17/d48/d61/c7e d1/d13/d17/d2f/d52/cc8 0 2024-09-11T00:07:24.287 INFO:tasks.workunit.client.0.smithi111.stdout:7/662: truncate dd/d1d/d1f/f9d 183679 0 2024-09-11T00:07:24.289 INFO:tasks.workunit.client.0.smithi111.stdout:9/688: dread d6/db/d1b/f33 [0,4194304] 0 2024-09-11T00:07:24.290 INFO:tasks.workunit.client.1.smithi203.stdout:9/617: dread d6/de/d19/f1b [0,4194304] 0 2024-09-11T00:07:24.290 INFO:tasks.workunit.client.0.smithi111.stdout:1/619: truncate d2/d77/faf 206273 0 2024-09-11T00:07:24.291 INFO:tasks.workunit.client.0.smithi111.stdout:0/685: dwrite d3/dc/fcb [0,4194304] 0 2024-09-11T00:07:24.292 INFO:tasks.workunit.client.0.smithi111.stdout:1/620: chown d2/d77/l83 205612 1 2024-09-11T00:07:24.293 INFO:tasks.workunit.client.1.smithi203.stdout:6/637: dwrite d0/d32/f43 [0,4194304] 0 2024-09-11T00:07:24.293 INFO:tasks.workunit.client.0.smithi111.stdout:2/621: creat d0/d3/de/d3b/d62/d6d/da1/fd1 x:0 0 0 2024-09-11T00:07:24.296 INFO:tasks.workunit.client.1.smithi203.stdout:4/539: truncate db/dd/d16/d38/d3c/f68 2510681 0 2024-09-11T00:07:24.298 INFO:tasks.workunit.client.1.smithi203.stdout:6/638: chown d0/f16 139 1 2024-09-11T00:07:24.301 INFO:tasks.workunit.client.0.smithi111.stdout:4/615: dread - d18/d20/d3c/d5e/d75/f76 zero size 2024-09-11T00:07:24.302 INFO:tasks.workunit.client.1.smithi203.stdout:4/540: chown db/f8a 0 1 2024-09-11T00:07:24.305 INFO:tasks.workunit.client.1.smithi203.stdout:3/660: dread d8/da/d5c/d6b/fcf [0,4194304] 0 2024-09-11T00:07:24.306 INFO:tasks.workunit.client.0.smithi111.stdout:6/603: mknod d7/d22/d2c/d38/d56/cc7 0 2024-09-11T00:07:24.308 INFO:tasks.workunit.client.1.smithi203.stdout:4/541: chown db/dd/d26/f30 16149 1 2024-09-11T00:07:24.309 INFO:tasks.workunit.client.1.smithi203.stdout:8/607: symlink d1/d13/d43/lc9 0 2024-09-11T00:07:24.310 INFO:tasks.workunit.client.0.smithi111.stdout:3/650: symlink d1c/d1d/d22/d23/d58/d5c/le2 0 2024-09-11T00:07:24.311 INFO:tasks.workunit.client.1.smithi203.stdout:4/542: truncate db/dd/d26/d42/d5e/fa7 1874796 0 2024-09-11T00:07:24.313 INFO:tasks.workunit.client.1.smithi203.stdout:1/677: truncate d8/d19/d60/d90/d3e/d4b/d41/f70 736052 0 2024-09-11T00:07:24.317 INFO:tasks.workunit.client.1.smithi203.stdout:9/618: rmdir d6/de/d19/d21 39 2024-09-11T00:07:24.317 INFO:tasks.workunit.client.1.smithi203.stdout:4/543: write db/d12/d15/d2a/d88/d95/fa8 [1029720,101849] 0 2024-09-11T00:07:24.320 INFO:tasks.workunit.client.1.smithi203.stdout:1/678: readlink d8/d19/d60/d90/d3e/d4b/d80/d8d/lbc 0 2024-09-11T00:07:24.320 INFO:tasks.workunit.client.1.smithi203.stdout:9/619: chown d6/de/d19/d24/c49 11 1 2024-09-11T00:07:24.322 INFO:tasks.workunit.client.1.smithi203.stdout:5/721: mkdir dc/dd/df4 0 2024-09-11T00:07:24.332 INFO:tasks.workunit.client.0.smithi111.stdout:5/673: rename d10/d1e/d23/d30/d3c/d60 to d10/d1e/d23/d30/dd8 0 2024-09-11T00:07:24.335 INFO:tasks.workunit.client.1.smithi203.stdout:6/639: dread d0/d32/f34 [0,4194304] 0 2024-09-11T00:07:24.336 INFO:tasks.workunit.client.0.smithi111.stdout:9/689: mkdir d6/d52/ddc 0 2024-09-11T00:07:24.339 INFO:tasks.workunit.client.1.smithi203.stdout:6/640: write d0/f93 [756608,67870] 0 2024-09-11T00:07:24.340 INFO:tasks.workunit.client.0.smithi111.stdout:1/621: dread d2/de/d12/f28 [0,4194304] 0 2024-09-11T00:07:24.340 INFO:tasks.workunit.client.0.smithi111.stdout:9/690: write d6/dc/d7c/fba [62606,28561] 0 2024-09-11T00:07:24.342 INFO:tasks.workunit.client.0.smithi111.stdout:9/691: stat d6/d52/d8a/d92/faa 0 2024-09-11T00:07:24.344 INFO:tasks.workunit.client.0.smithi111.stdout:1/622: write d2/de/d12/d3c/d4b/fc8 [150159,52265] 0 2024-09-11T00:07:24.348 INFO:tasks.workunit.client.0.smithi111.stdout:2/622: read d0/d3/de/f5d [183009,41042] 0 2024-09-11T00:07:24.349 INFO:tasks.workunit.client.0.smithi111.stdout:4/616: creat d18/d1f/d33/fbf x:0 0 0 2024-09-11T00:07:24.349 INFO:tasks.workunit.client.0.smithi111.stdout:1/623: read - d2/de/d12/d3c/d4b/f51 zero size 2024-09-11T00:07:24.352 INFO:tasks.workunit.client.1.smithi203.stdout:9/620: mkdir d6/de/d19/d21/dd0 0 2024-09-11T00:07:24.354 INFO:tasks.workunit.client.0.smithi111.stdout:3/651: dread - d1c/d1d/d22/f9b zero size 2024-09-11T00:07:24.355 INFO:tasks.workunit.client.1.smithi203.stdout:5/722: symlink dc/dd/d15/dac/lf5 0 2024-09-11T00:07:24.359 INFO:tasks.workunit.client.0.smithi111.stdout:5/674: read d10/d1e/d23/d26/d78/d7a/f83 [158569,43053] 0 2024-09-11T00:07:24.359 INFO:tasks.workunit.client.1.smithi203.stdout:4/544: write db/dd/d26/d42/f45 [4709254,127992] 0 2024-09-11T00:07:24.361 INFO:tasks.workunit.client.1.smithi203.stdout:4/545: chown db/dd/d26/d42/d5e/l8d 57945 1 2024-09-11T00:07:24.362 INFO:tasks.workunit.client.1.smithi203.stdout:9/621: symlink d6/de/ld1 0 2024-09-11T00:07:24.364 INFO:tasks.workunit.client.0.smithi111.stdout:0/686: dwrite d3/da/d7b/d84/fef [0,4194304] 0 2024-09-11T00:07:24.365 INFO:tasks.workunit.client.0.smithi111.stdout:8/668: dwrite d11/d23/d7e/d93/fcd [0,4194304] 0 2024-09-11T00:07:24.366 INFO:tasks.workunit.client.1.smithi203.stdout:5/723: symlink dc/dd/d1e/lf6 0 2024-09-11T00:07:24.367 INFO:tasks.workunit.client.1.smithi203.stdout:1/679: write d8/d19/d60/d90/d3e/d4b/d41/f9a [1844142,34065] 0 2024-09-11T00:07:24.371 INFO:tasks.workunit.client.1.smithi203.stdout:6/641: getdents d0/d5b/d5c 0 2024-09-11T00:07:24.373 INFO:tasks.workunit.client.0.smithi111.stdout:8/669: write d11/d23/d2c/d46/fc8 [584865,59569] 0 2024-09-11T00:07:24.376 INFO:tasks.workunit.client.0.smithi111.stdout:3/652: rename d1c/d1d/c50 to d1c/d1d/d22/d31/d33/ce3 0 2024-09-11T00:07:24.376 INFO:tasks.workunit.client.1.smithi203.stdout:6/642: dread d0/d32/d5a/fad [0,4194304] 0 2024-09-11T00:07:24.376 INFO:tasks.workunit.client.1.smithi203.stdout:4/546: creat db/dd/d16/d38/d3c/d41/fae x:0 0 0 2024-09-11T00:07:24.377 INFO:tasks.workunit.client.0.smithi111.stdout:9/692: mkdir d6/ddd 0 2024-09-11T00:07:24.378 INFO:tasks.workunit.client.1.smithi203.stdout:3/661: write d8/d17/f74 [5412980,77638] 0 2024-09-11T00:07:24.379 INFO:tasks.workunit.client.0.smithi111.stdout:9/693: write d6/dc/d7c/fba [1025364,21412] 0 2024-09-11T00:07:24.380 INFO:tasks.workunit.client.1.smithi203.stdout:5/724: read - dc/dd/d56/dad/f97 zero size 2024-09-11T00:07:24.381 INFO:tasks.workunit.client.0.smithi111.stdout:2/623: symlink d0/ld2 0 2024-09-11T00:07:24.386 INFO:tasks.workunit.client.0.smithi111.stdout:6/604: creat d7/d22/d26/d87/fc8 x:0 0 0 2024-09-11T00:07:24.388 INFO:tasks.workunit.client.1.smithi203.stdout:1/680: symlink d8/d19/lee 0 2024-09-11T00:07:24.388 INFO:tasks.workunit.client.0.smithi111.stdout:4/617: getdents d18/d20/d40/d78/d79/db0 0 2024-09-11T00:07:24.389 INFO:tasks.workunit.client.0.smithi111.stdout:4/618: fsync d18/fa5 0 2024-09-11T00:07:24.389 INFO:tasks.workunit.client.1.smithi203.stdout:3/662: symlink d8/da/d37/d83/d65/lee 0 2024-09-11T00:07:24.394 INFO:tasks.workunit.client.0.smithi111.stdout:8/670: mknod d11/d23/d2c/d46/d64/cd8 0 2024-09-11T00:07:24.397 INFO:tasks.workunit.client.1.smithi203.stdout:4/547: symlink db/dd/d16/d38/d3c/laf 0 2024-09-11T00:07:24.398 INFO:tasks.workunit.client.0.smithi111.stdout:7/663: link dd/d1d/d2d/d2e/f40 dd/d1d/d2d/fcd 0 2024-09-11T00:07:24.398 INFO:tasks.workunit.client.0.smithi111.stdout:6/605: dwrite d7/d22/fa8 [0,4194304] 0 2024-09-11T00:07:24.400 INFO:tasks.workunit.client.0.smithi111.stdout:7/664: write dd/d1d/d1f/f50 [8819964,31101] 0 2024-09-11T00:07:24.410 INFO:tasks.workunit.client.0.smithi111.stdout:5/675: symlink d10/d1e/d23/d30/d59/dd1/ld9 0 2024-09-11T00:07:24.414 INFO:tasks.workunit.client.0.smithi111.stdout:2/624: creat d0/d3/de/d3b/d92/fd3 x:0 0 0 2024-09-11T00:07:24.417 INFO:tasks.workunit.client.1.smithi203.stdout:9/622: dwrite d6/de/d47/f61 [0,4194304] 0 2024-09-11T00:07:24.417 INFO:tasks.workunit.client.0.smithi111.stdout:6/606: dwrite d7/d22/d26/d87/fad [0,4194304] 0 2024-09-11T00:07:24.417 INFO:tasks.workunit.client.0.smithi111.stdout:3/653: write d1c/d1d/d22/d31/d33/f36 [8346507,100310] 0 2024-09-11T00:07:24.421 INFO:tasks.workunit.client.0.smithi111.stdout:9/694: write d6/dc/d7c/f9c [469853,39748] 0 2024-09-11T00:07:24.425 INFO:tasks.workunit.client.0.smithi111.stdout:1/624: getdents d2/de 0 2024-09-11T00:07:24.432 INFO:tasks.workunit.client.1.smithi203.stdout:1/681: dread d8/d9/f1c [0,4194304] 0 2024-09-11T00:07:24.435 INFO:tasks.workunit.client.0.smithi111.stdout:6/607: dread d7/d22/d2c/f62 [0,4194304] 0 2024-09-11T00:07:24.436 INFO:tasks.workunit.client.1.smithi203.stdout:1/682: readlink d8/d9/d15/d35/d81/db9/dce/ld3 0 2024-09-11T00:07:24.437 INFO:tasks.workunit.client.0.smithi111.stdout:3/654: rmdir d1c 39 2024-09-11T00:07:24.439 INFO:tasks.workunit.client.0.smithi111.stdout:5/676: dwrite d10/d1e/d23/d30/d59/d53/fcc [0,4194304] 0 2024-09-11T00:07:24.440 INFO:tasks.workunit.client.0.smithi111.stdout:4/619: dwrite d18/d20/f7b [0,4194304] 0 2024-09-11T00:07:24.441 INFO:tasks.workunit.client.0.smithi111.stdout:0/687: rename d3/da/d7b/d84/fe2 to d3/d13/d1e/ffb 0 2024-09-11T00:07:24.442 INFO:tasks.workunit.client.1.smithi203.stdout:1/683: chown d8/d28/d64/da0/lb5 2794 1 2024-09-11T00:07:24.443 INFO:tasks.workunit.client.0.smithi111.stdout:4/620: read - d18/d1f/d36/d95/fa3 zero size 2024-09-11T00:07:24.446 INFO:tasks.workunit.client.1.smithi203.stdout:1/684: write d8/d19/d60/d90/d3e/d4b/d80/d91/dac/fe4 [399179,118466] 0 2024-09-11T00:07:24.454 INFO:tasks.workunit.client.0.smithi111.stdout:3/655: readlink d1c/d1d/d22/d31/d33/l65 0 2024-09-11T00:07:24.457 INFO:tasks.workunit.client.0.smithi111.stdout:3/656: write d1c/d1d/d22/d31/d33/d5f/f9d [955644,75940] 0 2024-09-11T00:07:24.457 INFO:tasks.workunit.client.0.smithi111.stdout:6/608: unlink d7/d22/d3f/d74/d7f/d61/d6a/d9f/fb1 0 2024-09-11T00:07:24.460 INFO:tasks.workunit.client.0.smithi111.stdout:5/677: creat d10/d1e/d23/d2b/d2f/fda x:0 0 0 2024-09-11T00:07:24.462 INFO:tasks.workunit.client.0.smithi111.stdout:5/678: chown d10/d1e/d23/d2b/d5c/fb3 108949 1 2024-09-11T00:07:24.466 INFO:tasks.workunit.client.0.smithi111.stdout:1/625: mkdir d2/de/d12/d3c/dd3 0 2024-09-11T00:07:24.466 INFO:tasks.workunit.client.0.smithi111.stdout:2/625: dwrite d0/d3/de/f5d [0,4194304] 0 2024-09-11T00:07:24.468 INFO:tasks.workunit.client.0.smithi111.stdout:6/609: rmdir d7/d22/d26/d87/d41/d77 39 2024-09-11T00:07:24.470 INFO:tasks.workunit.client.0.smithi111.stdout:3/657: fdatasync d1c/d1d/d22/d31/d33/f59 0 2024-09-11T00:07:24.472 INFO:tasks.workunit.client.0.smithi111.stdout:7/665: rename dd/d1d/d4b/l93 to dd/d48/d69/dbe/dc4/lce 0 2024-09-11T00:07:24.475 INFO:tasks.workunit.client.0.smithi111.stdout:9/695: creat d6/db/d34/fde x:0 0 0 2024-09-11T00:07:24.476 INFO:tasks.workunit.client.1.smithi203.stdout:3/663: creat d8/d17/fef x:0 0 0 2024-09-11T00:07:24.478 INFO:tasks.workunit.client.1.smithi203.stdout:6/643: creat d0/d54/d9c/d35/fce x:0 0 0 2024-09-11T00:07:24.481 INFO:tasks.workunit.client.1.smithi203.stdout:9/623: symlink d6/de/d32/d52/d55/d66/ld2 0 2024-09-11T00:07:24.483 INFO:tasks.workunit.client.0.smithi111.stdout:1/626: dwrite d2/de/d12/d3c/d4b/d6a/d3a/f70 [0,4194304] 0 2024-09-11T00:07:24.486 INFO:tasks.workunit.client.0.smithi111.stdout:9/696: dread d6/dc/f62 [0,4194304] 0 2024-09-11T00:07:24.487 INFO:tasks.workunit.client.0.smithi111.stdout:6/610: creat d7/d22/d2c/d38/d39/fc9 x:0 0 0 2024-09-11T00:07:24.488 INFO:tasks.workunit.client.0.smithi111.stdout:3/658: chown d1c/c38 26242 1 2024-09-11T00:07:24.490 INFO:tasks.workunit.client.1.smithi203.stdout:5/725: creat dc/d4f/ff7 x:0 0 0 2024-09-11T00:07:24.491 INFO:tasks.workunit.client.0.smithi111.stdout:3/659: write d1c/d1d/d22/d23/d2f/d63/f81 [2017537,65540] 0 2024-09-11T00:07:24.494 INFO:tasks.workunit.client.1.smithi203.stdout:3/664: fsync d8/f58 0 2024-09-11T00:07:24.497 INFO:tasks.workunit.client.1.smithi203.stdout:3/665: chown d8/da/d37/d83/d65 1135991 1 2024-09-11T00:07:24.497 INFO:tasks.workunit.client.1.smithi203.stdout:6/644: symlink d0/d54/lcf 0 2024-09-11T00:07:24.500 INFO:tasks.workunit.client.1.smithi203.stdout:4/548: symlink db/dd/d16/d38/d3c/da6/lb0 0 2024-09-11T00:07:24.502 INFO:tasks.workunit.client.0.smithi111.stdout:2/626: mkdir d0/d3/de/dd4 0 2024-09-11T00:07:24.506 INFO:tasks.workunit.client.1.smithi203.stdout:1/685: mknod d8/d28/cef 0 2024-09-11T00:07:24.509 INFO:tasks.workunit.client.1.smithi203.stdout:5/726: fdatasync dc/dd/d9b/dae/fb3 0 2024-09-11T00:07:24.512 INFO:tasks.workunit.client.1.smithi203.stdout:6/645: creat d0/d5b/d5c/fd0 x:0 0 0 2024-09-11T00:07:24.512 INFO:tasks.workunit.client.0.smithi111.stdout:7/666: symlink dd/d1d/d4b/d8f/d9f/d79/lcf 0 2024-09-11T00:07:24.513 INFO:tasks.workunit.client.0.smithi111.stdout:7/667: fsync dd/f97 0 2024-09-11T00:07:24.514 INFO:tasks.workunit.client.1.smithi203.stdout:9/624: dread d6/de/d32/d9e/fc8 [0,4194304] 0 2024-09-11T00:07:24.515 INFO:tasks.workunit.client.1.smithi203.stdout:4/549: rename db/f49 to db/dd/d16/fb1 0 2024-09-11T00:07:24.518 INFO:tasks.workunit.client.1.smithi203.stdout:9/625: write d6/de/dc4/f51 [2079272,61057] 0 2024-09-11T00:07:24.518 INFO:tasks.workunit.client.1.smithi203.stdout:3/666: dwrite d8/da/d5c/d6b/d6c/fd9 [0,4194304] 0 2024-09-11T00:07:24.521 INFO:tasks.workunit.client.0.smithi111.stdout:5/679: creat d10/d1e/d25/fdb x:0 0 0 2024-09-11T00:07:24.524 INFO:tasks.workunit.client.0.smithi111.stdout:2/627: dread d0/d3/d2e/f4f [0,4194304] 0 2024-09-11T00:07:24.526 INFO:tasks.workunit.client.1.smithi203.stdout:5/727: rmdir dc/dd/d15/dbd/d59/dbb 39 2024-09-11T00:07:24.528 INFO:tasks.workunit.client.0.smithi111.stdout:7/668: dwrite dd/d1d/d1f/f9b [0,4194304] 0 2024-09-11T00:07:24.528 INFO:tasks.workunit.client.1.smithi203.stdout:5/728: chown lb 662577436 1 2024-09-11T00:07:24.532 INFO:tasks.workunit.client.0.smithi111.stdout:6/611: dread d7/d22/d26/d95/fc2 [4194304,4194304] 0 2024-09-11T00:07:24.532 INFO:tasks.workunit.client.0.smithi111.stdout:9/697: creat d6/dc/dc1/fdf x:0 0 0 2024-09-11T00:07:24.533 INFO:tasks.workunit.client.0.smithi111.stdout:9/698: stat d6/dc/f62 0 2024-09-11T00:07:24.535 INFO:tasks.workunit.client.0.smithi111.stdout:9/699: read - d6/db/db8/dce/dcf/fbd zero size 2024-09-11T00:07:24.537 INFO:tasks.workunit.client.0.smithi111.stdout:3/660: fdatasync d1c/d1d/d22/d31/d33/d5f/fb2 0 2024-09-11T00:07:24.542 INFO:tasks.workunit.client.1.smithi203.stdout:4/550: symlink db/d12/d15/d2a/d88/lb2 0 2024-09-11T00:07:24.544 INFO:tasks.workunit.client.1.smithi203.stdout:4/551: chown db/dd/d16/c5c 127 1 2024-09-11T00:07:24.548 INFO:tasks.workunit.client.1.smithi203.stdout:1/686: link d8/d28/fc0 d8/d19/ff0 0 2024-09-11T00:07:24.550 INFO:tasks.workunit.client.1.smithi203.stdout:6/646: dwrite d0/d32/f58 [0,4194304] 0 2024-09-11T00:07:24.551 INFO:tasks.workunit.client.0.smithi111.stdout:1/627: link d2/d2b/l41 d2/de/d93/d9f/dc0/ld4 0 2024-09-11T00:07:24.552 INFO:tasks.workunit.client.0.smithi111.stdout:1/628: dread - d2/de/d12/d6c/fcd zero size 2024-09-11T00:07:24.554 INFO:tasks.workunit.client.1.smithi203.stdout:3/667: mknod d8/da/d37/d53/dea/de8/cf0 0 2024-09-11T00:07:24.555 INFO:tasks.workunit.client.0.smithi111.stdout:6/612: fsync d7/d22/d2c/d38/f71 0 2024-09-11T00:07:24.557 INFO:tasks.workunit.client.1.smithi203.stdout:7/618: sync 2024-09-11T00:07:24.558 INFO:tasks.workunit.client.1.smithi203.stdout:5/729: symlink dc/dd/d56/dad/da5/lf8 0 2024-09-11T00:07:24.564 INFO:tasks.workunit.client.1.smithi203.stdout:4/552: rename db/dd/d16/d38/d3c/d41/f5a to db/dd/d16/d38/d3c/d41/fb3 0 2024-09-11T00:07:24.567 INFO:tasks.workunit.client.0.smithi111.stdout:7/669: write dd/d1d/d2d/d2e/f70 [3662831,64143] 0 2024-09-11T00:07:24.570 INFO:tasks.workunit.client.0.smithi111.stdout:5/680: dwrite d10/d1e/d23/d30/d59/d53/f5e [0,4194304] 0 2024-09-11T00:07:24.574 INFO:tasks.workunit.client.1.smithi203.stdout:3/668: symlink d8/dce/lf1 0 2024-09-11T00:07:24.576 INFO:tasks.workunit.client.1.smithi203.stdout:1/687: creat d8/d19/d31/ff1 x:0 0 0 2024-09-11T00:07:24.578 INFO:tasks.workunit.client.0.smithi111.stdout:2/628: dwrite d0/d3/de/d3b/d62/d6d/faa [0,4194304] 0 2024-09-11T00:07:24.580 INFO:tasks.workunit.client.1.smithi203.stdout:6/647: creat d0/d54/d9c/d7b/fd1 x:0 0 0 2024-09-11T00:07:24.581 INFO:tasks.workunit.client.0.smithi111.stdout:9/700: dwrite d6/db/db8/dce/dcf/fbd [0,4194304] 0 2024-09-11T00:07:24.582 INFO:tasks.workunit.client.0.smithi111.stdout:2/629: readlink d0/d3/de/d3b/d63/l67 0 2024-09-11T00:07:24.583 INFO:tasks.workunit.client.0.smithi111.stdout:6/613: dread d7/d22/d1d/d83/fa1 [4194304,4194304] 0 2024-09-11T00:07:24.583 INFO:tasks.workunit.client.1.smithi203.stdout:5/730: dwrite dc/dd/d9b/fb0 [0,4194304] 0 2024-09-11T00:07:24.583 INFO:tasks.workunit.client.0.smithi111.stdout:3/661: dread d1c/d1d/f42 [0,4194304] 0 2024-09-11T00:07:24.586 INFO:tasks.workunit.client.0.smithi111.stdout:1/629: write d2/de/d12/d3c/d4b/d6a/d3a/f68 [747953,107713] 0 2024-09-11T00:07:24.588 INFO:tasks.workunit.client.1.smithi203.stdout:1/688: symlink d8/d19/d60/d90/d3e/d4b/d41/lf2 0 2024-09-11T00:07:24.594 INFO:tasks.workunit.client.0.smithi111.stdout:9/701: creat d6/db/db8/dce/dcf/fe0 x:0 0 0 2024-09-11T00:07:24.595 INFO:tasks.workunit.client.0.smithi111.stdout:7/670: creat dd/d48/fd0 x:0 0 0 2024-09-11T00:07:24.596 INFO:tasks.workunit.client.1.smithi203.stdout:5/731: symlink dc/dd/d15/d3b/lf9 0 2024-09-11T00:07:24.597 INFO:tasks.workunit.client.0.smithi111.stdout:9/702: fsync d6/db/d1b/d56/dc8/fd9 0 2024-09-11T00:07:24.597 INFO:tasks.workunit.client.0.smithi111.stdout:6/614: chown d7/d22/d1d/d69/db4 135729 1 2024-09-11T00:07:24.598 INFO:tasks.workunit.client.0.smithi111.stdout:6/615: stat d7/d22/c20 0 2024-09-11T00:07:24.598 INFO:tasks.workunit.client.1.smithi203.stdout:4/553: dwrite db/f8a [0,4194304] 0 2024-09-11T00:07:24.599 INFO:tasks.workunit.client.1.smithi203.stdout:1/689: dread - d8/d28/fa9 zero size 2024-09-11T00:07:24.601 INFO:tasks.workunit.client.0.smithi111.stdout:2/630: mknod d0/d3/cd5 0 2024-09-11T00:07:24.604 INFO:tasks.workunit.client.1.smithi203.stdout:1/690: chown d8/d19/d60/d90/d3e/d66/l72 0 1 2024-09-11T00:07:24.605 INFO:tasks.workunit.client.0.smithi111.stdout:2/631: write d0/d3/d12/f3d [3654441,29688] 0 2024-09-11T00:07:24.607 INFO:tasks.workunit.client.1.smithi203.stdout:6/648: creat d0/d54/d9c/d35/d39/d3c/fd2 x:0 0 0 2024-09-11T00:07:24.613 INFO:tasks.workunit.client.0.smithi111.stdout:1/630: dwrite d2/fb5 [0,4194304] 0 2024-09-11T00:07:24.613 INFO:tasks.workunit.client.1.smithi203.stdout:6/649: chown d0/d54/f61 186570727 1 2024-09-11T00:07:24.621 INFO:tasks.workunit.client.0.smithi111.stdout:9/703: truncate d6/dc/f62 590405 0 2024-09-11T00:07:24.621 INFO:tasks.workunit.client.0.smithi111.stdout:1/631: read d2/f10 [3365350,13528] 0 2024-09-11T00:07:24.621 INFO:tasks.workunit.client.0.smithi111.stdout:7/671: dwrite dd/d49/f99 [0,4194304] 0 2024-09-11T00:07:24.622 INFO:tasks.workunit.client.1.smithi203.stdout:1/691: unlink d8/d19/d60/d90/d3e/d4b/d80/d8d/cab 0 2024-09-11T00:07:24.622 INFO:tasks.workunit.client.1.smithi203.stdout:7/619: write dd/d1c/d52/d8f/d31/d58/d93/d98/fb4 [1115870,25362] 0 2024-09-11T00:07:24.623 INFO:tasks.workunit.client.1.smithi203.stdout:5/732: dwrite dc/dd/d15/dbd/d59/fd7 [0,4194304] 0 2024-09-11T00:07:24.623 INFO:tasks.workunit.client.0.smithi111.stdout:1/632: write d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/f8b [2586700,110785] 0 2024-09-11T00:07:24.624 INFO:tasks.workunit.client.0.smithi111.stdout:7/672: chown dd/d1d/d1f/f5e 7 1 2024-09-11T00:07:24.629 INFO:tasks.workunit.client.1.smithi203.stdout:6/650: mknod d0/d32/cd3 0 2024-09-11T00:07:24.629 INFO:tasks.workunit.client.0.smithi111.stdout:3/662: creat d1c/d1d/d22/d44/d5a/fe4 x:0 0 0 2024-09-11T00:07:24.631 INFO:tasks.workunit.client.0.smithi111.stdout:6/616: dread d7/d22/d1d/d8c/d4a/f85 [0,4194304] 0 2024-09-11T00:07:24.632 INFO:tasks.workunit.client.1.smithi203.stdout:5/733: write dc/d4f/ff7 [782871,19314] 0 2024-09-11T00:07:24.635 INFO:tasks.workunit.client.1.smithi203.stdout:3/669: write d8/da/d37/f82 [161359,119204] 0 2024-09-11T00:07:24.635 INFO:tasks.workunit.client.1.smithi203.stdout:1/692: fdatasync d8/d19/d60/d90/d3e/d4b/d80/d8d/db0/fb7 0 2024-09-11T00:07:24.639 INFO:tasks.workunit.client.0.smithi111.stdout:3/663: read d1c/f24 [2486728,117159] 0 2024-09-11T00:07:24.640 INFO:tasks.workunit.client.1.smithi203.stdout:1/693: write d8/d19/d60/d90/f53 [1986446,129289] 0 2024-09-11T00:07:24.642 INFO:tasks.workunit.client.0.smithi111.stdout:3/664: write d1c/d1d/d22/d44/d5a/fe4 [216673,90133] 0 2024-09-11T00:07:24.643 INFO:tasks.workunit.client.0.smithi111.stdout:5/681: dread d10/f19 [0,4194304] 0 2024-09-11T00:07:24.644 INFO:tasks.workunit.client.0.smithi111.stdout:9/704: creat d6/dc/d7c/fe1 x:0 0 0 2024-09-11T00:07:24.646 INFO:tasks.workunit.client.1.smithi203.stdout:7/620: rename dd/lc5 to dd/d1c/d52/lde 0 2024-09-11T00:07:24.653 INFO:tasks.workunit.client.0.smithi111.stdout:1/633: truncate d2/de/f5e 103205 0 2024-09-11T00:07:24.654 INFO:tasks.workunit.client.0.smithi111.stdout:4/621: sync 2024-09-11T00:07:24.654 INFO:tasks.workunit.client.0.smithi111.stdout:0/688: sync 2024-09-11T00:07:24.654 INFO:tasks.workunit.client.0.smithi111.stdout:8/671: sync 2024-09-11T00:07:24.655 INFO:tasks.workunit.client.0.smithi111.stdout:0/689: stat d3/d13/d1e/c6c 0 2024-09-11T00:07:24.656 INFO:tasks.workunit.client.0.smithi111.stdout:4/622: chown d18/d20/d40/f8c 1030194 1 2024-09-11T00:07:24.657 INFO:tasks.workunit.client.0.smithi111.stdout:7/673: creat dd/d1d/d76/db6/fd1 x:0 0 0 2024-09-11T00:07:24.657 INFO:tasks.workunit.client.0.smithi111.stdout:0/690: chown d3/dc/c52 729283704 1 2024-09-11T00:07:24.659 INFO:tasks.workunit.client.0.smithi111.stdout:0/691: dread - d3/d13/d1e/f72 zero size 2024-09-11T00:07:24.660 INFO:tasks.workunit.client.1.smithi203.stdout:1/694: dwrite d8/f1a [0,4194304] 0 2024-09-11T00:07:24.661 INFO:tasks.workunit.client.0.smithi111.stdout:0/692: write d3/da/f6e [1012382,42919] 0 2024-09-11T00:07:24.663 INFO:tasks.workunit.client.1.smithi203.stdout:5/734: unlink dc/dd/d1e/f53 0 2024-09-11T00:07:24.670 INFO:tasks.workunit.client.0.smithi111.stdout:6/617: mkdir d7/d22/d2c/d38/d56/dbf/dca 0 2024-09-11T00:07:24.672 INFO:tasks.workunit.client.0.smithi111.stdout:3/665: mkdir d1c/d1d/d22/d23/d2f/de5 0 2024-09-11T00:07:24.673 INFO:tasks.workunit.client.0.smithi111.stdout:6/618: truncate d7/d22/d26/f73 2420205 0 2024-09-11T00:07:24.674 INFO:tasks.workunit.client.0.smithi111.stdout:3/666: stat d1c/d1d/d86/fd7 0 2024-09-11T00:07:24.675 INFO:tasks.workunit.client.1.smithi203.stdout:7/621: chown dd/d1c/d52/d8f/d31/la9 37540493 1 2024-09-11T00:07:24.677 INFO:tasks.workunit.client.0.smithi111.stdout:5/682: dread d10/d1e/d23/d2b/d5c/f8e [0,4194304] 0 2024-09-11T00:07:24.678 INFO:tasks.workunit.client.0.smithi111.stdout:5/683: fsync d10/d1e/d23/d30/dd8/da2/fcf 0 2024-09-11T00:07:24.679 INFO:tasks.workunit.client.1.smithi203.stdout:6/651: write d0/f2d [4884593,79242] 0 2024-09-11T00:07:24.679 INFO:tasks.workunit.client.0.smithi111.stdout:1/634: fdatasync d2/de/d12/f28 0 2024-09-11T00:07:24.685 INFO:tasks.workunit.client.1.smithi203.stdout:7/622: mknod dd/d3b/d9f/cdf 0 2024-09-11T00:07:24.693 INFO:tasks.workunit.client.1.smithi203.stdout:7/623: mknod dd/d1c/d52/ce0 0 2024-09-11T00:07:24.693 INFO:tasks.workunit.client.1.smithi203.stdout:3/670: write d8/da/d5c/f8d [49146,109910] 0 2024-09-11T00:07:24.694 INFO:tasks.workunit.client.1.smithi203.stdout:7/624: chown dd/d1c/d7c/d7e 3 1 2024-09-11T00:07:24.699 INFO:tasks.workunit.client.0.smithi111.stdout:2/632: rename d0/d3/de/d3b/d97/f7e to d0/d3/de/fd6 0 2024-09-11T00:07:24.700 INFO:tasks.workunit.client.0.smithi111.stdout:9/705: symlink d6/d52/d8a/d8e/le2 0 2024-09-11T00:07:24.701 INFO:tasks.workunit.client.1.smithi203.stdout:5/735: getdents dc/d4f/d5c/d76 0 2024-09-11T00:07:24.702 INFO:tasks.workunit.client.0.smithi111.stdout:7/674: dread dd/f31 [0,4194304] 0 2024-09-11T00:07:24.703 INFO:tasks.workunit.client.0.smithi111.stdout:6/619: symlink d7/d22/d2c/d38/lcb 0 2024-09-11T00:07:24.703 INFO:tasks.workunit.client.0.smithi111.stdout:9/706: truncate d6/dc/d7c/fe1 917499 0 2024-09-11T00:07:24.706 INFO:tasks.workunit.client.0.smithi111.stdout:3/667: mkdir d1c/d1d/d22/d44/d5a/d74/d7b/de6 0 2024-09-11T00:07:24.707 INFO:tasks.workunit.client.0.smithi111.stdout:5/684: dread d10/d1e/d23/d26/d3a/f5d [0,4194304] 0 2024-09-11T00:07:24.709 INFO:tasks.workunit.client.1.smithi203.stdout:6/652: creat d0/d54/d9c/d7b/fd4 x:0 0 0 2024-09-11T00:07:24.709 INFO:tasks.workunit.client.0.smithi111.stdout:0/693: write d3/d26/fbf [755866,99772] 0 2024-09-11T00:07:24.710 INFO:tasks.workunit.client.0.smithi111.stdout:0/694: readlink d3/d26/d77/le9 0 2024-09-11T00:07:24.711 INFO:tasks.workunit.client.0.smithi111.stdout:4/623: dwrite d18/d20/d3c/f58 [0,4194304] 0 2024-09-11T00:07:24.712 INFO:tasks.workunit.client.1.smithi203.stdout:3/671: dread d8/da/d37/d53/d63/f91 [0,4194304] 0 2024-09-11T00:07:24.712 INFO:tasks.workunit.client.1.smithi203.stdout:1/695: dwrite d8/d19/ff0 [0,4194304] 0 2024-09-11T00:07:24.713 INFO:tasks.workunit.client.1.smithi203.stdout:5/736: chown dc/dd/d15/c2d 49273 1 2024-09-11T00:07:24.714 INFO:tasks.workunit.client.0.smithi111.stdout:1/635: write d2/de/d12/fa3 [3241840,100375] 0 2024-09-11T00:07:24.714 INFO:tasks.workunit.client.0.smithi111.stdout:0/695: write d3/da/f21 [9129290,6489] 0 2024-09-11T00:07:24.715 INFO:tasks.workunit.client.1.smithi203.stdout:7/625: write dd/f14 [3408680,96067] 0 2024-09-11T00:07:24.717 INFO:tasks.workunit.client.1.smithi203.stdout:1/696: write d8/d9/d15/fc1 [2685158,27625] 0 2024-09-11T00:07:24.720 INFO:tasks.workunit.client.0.smithi111.stdout:4/624: dread d18/d39/f66 [0,4194304] 0 2024-09-11T00:07:24.725 INFO:tasks.workunit.client.1.smithi203.stdout:1/697: readlink d8/d9/d15/lba 0 2024-09-11T00:07:24.725 INFO:tasks.workunit.client.1.smithi203.stdout:6/653: mknod d0/d54/d9c/d7b/d7e/cd5 0 2024-09-11T00:07:24.726 INFO:tasks.workunit.client.0.smithi111.stdout:2/633: symlink d0/d3/de/d3b/d62/d6d/ld7 0 2024-09-11T00:07:24.726 INFO:tasks.workunit.client.0.smithi111.stdout:7/675: mkdir dd/d1d/d1f/d24/dd2 0 2024-09-11T00:07:24.728 INFO:tasks.workunit.client.0.smithi111.stdout:9/707: creat d6/db/d7a/d9a/fe3 x:0 0 0 2024-09-11T00:07:24.729 INFO:tasks.workunit.client.1.smithi203.stdout:7/626: rmdir dd/d1c/d52/d8f/d31/d4a 39 2024-09-11T00:07:24.730 INFO:tasks.workunit.client.0.smithi111.stdout:9/708: fdatasync d6/db/d1b/d56/fa7 0 2024-09-11T00:07:24.744 INFO:tasks.workunit.client.0.smithi111.stdout:1/636: mknod d2/d2b/dc9/cd5 0 2024-09-11T00:07:24.746 INFO:tasks.workunit.client.0.smithi111.stdout:8/672: link d11/d23/d2c/d46/d64/fa6 d11/d23/d3d/d5f/fd9 0 2024-09-11T00:07:24.748 INFO:tasks.workunit.client.1.smithi203.stdout:6/654: link d0/d32/f46 d0/d54/d9c/d35/d39/fd6 0 2024-09-11T00:07:24.749 INFO:tasks.workunit.client.1.smithi203.stdout:3/672: dread d8/da/db3/f4d [0,4194304] 0 2024-09-11T00:07:24.749 INFO:tasks.workunit.client.1.smithi203.stdout:5/737: dread dc/d2b/fc2 [0,4194304] 0 2024-09-11T00:07:24.750 INFO:tasks.workunit.client.0.smithi111.stdout:0/696: fdatasync d3/d13/d1e/deb/d61/f8f 0 2024-09-11T00:07:24.751 INFO:tasks.workunit.client.1.smithi203.stdout:3/673: fdatasync d8/da/d5c/f61 0 2024-09-11T00:07:24.751 INFO:tasks.workunit.client.1.smithi203.stdout:1/698: link d8/d9/d15/d27/fb6 d8/d9/d15/ff3 0 2024-09-11T00:07:24.756 INFO:tasks.workunit.client.0.smithi111.stdout:2/634: mkdir d0/d3/de/d3b/d92/dc7/dd8 0 2024-09-11T00:07:24.756 INFO:tasks.workunit.client.0.smithi111.stdout:3/668: write d1c/d1d/d22/d31/d33/fbf [586609,13251] 0 2024-09-11T00:07:24.756 INFO:tasks.workunit.client.0.smithi111.stdout:4/625: dread d18/d3b/f60 [0,4194304] 0 2024-09-11T00:07:24.758 INFO:tasks.workunit.client.0.smithi111.stdout:3/669: chown d1c/d1d/d22/d31/d62/f9c 0 1 2024-09-11T00:07:24.758 INFO:tasks.workunit.client.1.smithi203.stdout:1/699: unlink d8/d19/c58 0 2024-09-11T00:07:24.761 INFO:tasks.workunit.client.0.smithi111.stdout:8/673: dwrite d11/fcc [0,4194304] 0 2024-09-11T00:07:24.763 INFO:tasks.workunit.client.1.smithi203.stdout:3/674: read d8/da/d37/f47 [3231910,47827] 0 2024-09-11T00:07:24.764 INFO:tasks.workunit.client.1.smithi203.stdout:3/675: chown d8/d17/fdb 47917132 1 2024-09-11T00:07:24.765 INFO:tasks.workunit.client.0.smithi111.stdout:9/709: rmdir d6/db/d1b/d56 39 2024-09-11T00:07:24.769 INFO:tasks.workunit.client.1.smithi203.stdout:3/676: creat d8/d17/ff2 x:0 0 0 2024-09-11T00:07:24.773 INFO:tasks.workunit.client.1.smithi203.stdout:3/677: write d8/da/d5c/f61 [1299813,5969] 0 2024-09-11T00:07:24.774 INFO:tasks.workunit.client.1.smithi203.stdout:1/700: write d8/d19/d60/d90/d3e/d66/fc6 [743366,94248] 0 2024-09-11T00:07:24.776 INFO:tasks.workunit.client.0.smithi111.stdout:6/620: truncate d7/d22/d1d/d83/fa1 2405001 0 2024-09-11T00:07:24.777 INFO:tasks.workunit.client.0.smithi111.stdout:0/697: mknod d3/d13/d66/cfc 0 2024-09-11T00:07:24.777 INFO:tasks.workunit.client.0.smithi111.stdout:2/635: mkdir d0/d3/de/d4b/dd9 0 2024-09-11T00:07:24.781 INFO:tasks.workunit.client.0.smithi111.stdout:8/674: dread - d11/d23/d3d/d5f/fb0 zero size 2024-09-11T00:07:24.783 INFO:tasks.workunit.client.1.smithi203.stdout:3/678: creat d8/da/d37/d53/da2/de1/ff3 x:0 0 0 2024-09-11T00:07:24.784 INFO:tasks.workunit.client.1.smithi203.stdout:5/738: dread dc/dd/d56/dad/f60 [0,4194304] 0 2024-09-11T00:07:24.784 INFO:tasks.workunit.client.0.smithi111.stdout:9/710: dwrite d6/d52/d8a/fd2 [0,4194304] 0 2024-09-11T00:07:24.789 INFO:tasks.workunit.client.0.smithi111.stdout:2/636: unlink d0/f22 0 2024-09-11T00:07:24.790 INFO:tasks.workunit.client.1.smithi203.stdout:3/679: creat d8/d2a/ff4 x:0 0 0 2024-09-11T00:07:24.790 INFO:tasks.workunit.client.0.smithi111.stdout:2/637: chown d0/d3/d12/d52/fbd 7232 1 2024-09-11T00:07:24.791 INFO:tasks.workunit.client.0.smithi111.stdout:7/676: truncate dd/da6/faa 788701 0 2024-09-11T00:07:24.791 INFO:tasks.workunit.client.0.smithi111.stdout:3/670: symlink d1c/d1d/d22/le7 0 2024-09-11T00:07:24.792 INFO:tasks.workunit.client.0.smithi111.stdout:1/637: getdents d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56 0 2024-09-11T00:07:24.795 INFO:tasks.workunit.client.0.smithi111.stdout:6/621: rename d7/la to d7/d22/d2c/d38/d39/lcc 0 2024-09-11T00:07:24.797 INFO:tasks.workunit.client.0.smithi111.stdout:8/675: dread - d11/f9d zero size 2024-09-11T00:07:24.798 INFO:tasks.workunit.client.0.smithi111.stdout:9/711: creat d6/dc/dc1/fe4 x:0 0 0 2024-09-11T00:07:24.798 INFO:tasks.workunit.client.0.smithi111.stdout:1/638: chown d2/de/d12/d3c/d4b/d6a/l57 2032438349 1 2024-09-11T00:07:24.802 INFO:tasks.workunit.client.0.smithi111.stdout:2/638: mkdir d0/d3/de/d50/dda 0 2024-09-11T00:07:24.805 INFO:tasks.workunit.client.0.smithi111.stdout:0/698: rename d3/d13/d1e/d29/d49/c8c to d3/d13/d66/cfd 0 2024-09-11T00:07:24.807 INFO:tasks.workunit.client.0.smithi111.stdout:4/626: dwrite d18/d3b/d51/f5b [0,4194304] 0 2024-09-11T00:07:24.809 INFO:tasks.workunit.client.0.smithi111.stdout:9/712: mknod d6/d52/d8a/d92/ce5 0 2024-09-11T00:07:24.809 INFO:tasks.workunit.client.1.smithi203.stdout:1/701: dwrite d8/d19/d60/d90/d3e/d66/f6e [0,4194304] 0 2024-09-11T00:07:24.811 INFO:tasks.workunit.client.1.smithi203.stdout:1/702: chown d8/c76 4432904 1 2024-09-11T00:07:24.811 INFO:tasks.workunit.client.0.smithi111.stdout:4/627: read - d18/d1f/d33/fbf zero size 2024-09-11T00:07:24.813 INFO:tasks.workunit.client.0.smithi111.stdout:6/622: creat d7/d22/d26/fcd x:0 0 0 2024-09-11T00:07:24.817 INFO:tasks.workunit.client.0.smithi111.stdout:0/699: rmdir d3/daf/db2 39 2024-09-11T00:07:24.821 INFO:tasks.workunit.client.0.smithi111.stdout:7/677: dread dd/da6/fab [0,4194304] 0 2024-09-11T00:07:24.826 INFO:tasks.workunit.client.1.smithi203.stdout:1/703: creat d8/d19/d60/d90/d3e/d9b/ff4 x:0 0 0 2024-09-11T00:07:24.826 INFO:tasks.workunit.client.0.smithi111.stdout:8/676: creat d11/d23/d2c/d46/d81/dd2/fda x:0 0 0 2024-09-11T00:07:24.826 INFO:tasks.workunit.client.0.smithi111.stdout:2/639: dwrite d0/d3/d12/fc4 [0,4194304] 0 2024-09-11T00:07:24.828 INFO:tasks.workunit.client.0.smithi111.stdout:4/628: rename cf to d18/d39/cc0 0 2024-09-11T00:07:24.832 INFO:tasks.workunit.client.1.smithi203.stdout:1/704: symlink d8/d19/d60/d90/dd9/lf5 0 2024-09-11T00:07:24.833 INFO:tasks.workunit.client.0.smithi111.stdout:1/639: write d2/de/f5e [484975,2168] 0 2024-09-11T00:07:24.834 INFO:tasks.workunit.client.1.smithi203.stdout:3/680: dwrite d8/da/d37/d83/d6a/f87 [0,4194304] 0 2024-09-11T00:07:24.836 INFO:tasks.workunit.client.1.smithi203.stdout:3/681: chown d8/c14 20363 1 2024-09-11T00:07:24.836 INFO:tasks.workunit.client.1.smithi203.stdout:1/705: stat d8/d19/d60/d90/d3e/d4b/d41/l78 0 2024-09-11T00:07:24.837 INFO:tasks.workunit.client.0.smithi111.stdout:3/671: dread d1c/d1d/d22/d31/d33/d5f/fa7 [0,4194304] 0 2024-09-11T00:07:24.839 INFO:tasks.workunit.client.1.smithi203.stdout:1/706: chown d8/d19/d60/d90/f5e 43 1 2024-09-11T00:07:24.842 INFO:tasks.workunit.client.1.smithi203.stdout:3/682: symlink d8/da/d11/lf5 0 2024-09-11T00:07:24.843 INFO:tasks.workunit.client.0.smithi111.stdout:8/677: truncate d11/d23/d2c/f45 8246008 0 2024-09-11T00:07:24.845 INFO:tasks.workunit.client.1.smithi203.stdout:3/683: chown d8/da/d5c/d6b/d6c/l9c 571 1 2024-09-11T00:07:24.845 INFO:tasks.workunit.client.0.smithi111.stdout:7/678: dread dd/d1d/d2d/d2e/f7a [0,4194304] 0 2024-09-11T00:07:24.848 INFO:tasks.workunit.client.1.smithi203.stdout:3/684: fsync d8/d17/f74 0 2024-09-11T00:07:24.848 INFO:tasks.workunit.client.0.smithi111.stdout:3/672: rename d1c/d1d/d22/d31/d33 to d1c/d1d/d22/d23/d2f/de8 0 2024-09-11T00:07:24.850 INFO:tasks.workunit.client.1.smithi203.stdout:3/685: stat d8/da/d5c/d6b/d6c/fd9 0 2024-09-11T00:07:24.854 INFO:tasks.workunit.client.0.smithi111.stdout:9/713: dwrite d6/dc/d73/f77 [0,4194304] 0 2024-09-11T00:07:24.854 INFO:tasks.workunit.client.1.smithi203.stdout:3/686: truncate d8/da/d5c/f8d 1686363 0 2024-09-11T00:07:24.855 INFO:tasks.workunit.client.0.smithi111.stdout:8/678: creat d11/d23/d7e/d93/fdb x:0 0 0 2024-09-11T00:07:24.856 INFO:tasks.workunit.client.0.smithi111.stdout:7/679: symlink dd/d1d/d4b/dad/ld3 0 2024-09-11T00:07:24.857 INFO:tasks.workunit.client.0.smithi111.stdout:0/700: write d3/d1c/f4f [2705656,84253] 0 2024-09-11T00:07:24.857 INFO:tasks.workunit.client.0.smithi111.stdout:4/629: creat d18/d20/d4a/fc1 x:0 0 0 2024-09-11T00:07:24.858 INFO:tasks.workunit.client.0.smithi111.stdout:7/680: readlink dd/d48/l67 0 2024-09-11T00:07:24.858 INFO:tasks.workunit.client.0.smithi111.stdout:2/640: write d0/f1a [4400365,84154] 0 2024-09-11T00:07:24.861 INFO:tasks.workunit.client.0.smithi111.stdout:9/714: unlink d6/d52/f61 0 2024-09-11T00:07:24.864 INFO:tasks.workunit.client.0.smithi111.stdout:6/623: truncate d7/d22/d3f/f65 4128543 0 2024-09-11T00:07:24.867 INFO:tasks.workunit.client.1.smithi203.stdout:1/707: truncate d8/d9/d15/fc5 7318684 0 2024-09-11T00:07:24.867 INFO:tasks.workunit.client.0.smithi111.stdout:8/679: chown d11/d23/d3d/f86 470 1 2024-09-11T00:07:24.870 INFO:tasks.workunit.client.0.smithi111.stdout:4/630: mknod d18/d3b/cc2 0 2024-09-11T00:07:24.871 INFO:tasks.workunit.client.0.smithi111.stdout:1/640: dread d2/de/d12/d3c/d4b/d6a/f7a [0,4194304] 0 2024-09-11T00:07:24.871 INFO:tasks.workunit.client.1.smithi203.stdout:3/687: rmdir d8/da/d5c/d6b/dc5 0 2024-09-11T00:07:24.872 INFO:tasks.workunit.client.0.smithi111.stdout:3/673: dwrite d1c/fd9 [0,4194304] 0 2024-09-11T00:07:24.876 INFO:tasks.workunit.client.0.smithi111.stdout:5/685: sync 2024-09-11T00:07:24.878 INFO:tasks.workunit.client.0.smithi111.stdout:2/641: mkdir d0/d3/de/db4/ddb 0 2024-09-11T00:07:24.880 INFO:tasks.workunit.client.0.smithi111.stdout:9/715: chown d6/db/d34/lc7 23608 1 2024-09-11T00:07:24.881 INFO:tasks.workunit.client.0.smithi111.stdout:3/674: truncate d1c/d1d/d22/d23/d2f/d63/d7e/fc5 619321 0 2024-09-11T00:07:24.882 INFO:tasks.workunit.client.0.smithi111.stdout:4/631: symlink d18/d1f/d36/lc3 0 2024-09-11T00:07:24.884 INFO:tasks.workunit.client.0.smithi111.stdout:4/632: stat d18/d20/d40/f8c 0 2024-09-11T00:07:24.885 INFO:tasks.workunit.client.0.smithi111.stdout:8/680: dread d11/d21/f31 [0,4194304] 0 2024-09-11T00:07:24.887 INFO:tasks.workunit.client.0.smithi111.stdout:4/633: chown d18/d20/d4a/d6b 69 1 2024-09-11T00:07:24.889 INFO:tasks.workunit.client.0.smithi111.stdout:2/642: read d0/d3/f37 [2500638,30180] 0 2024-09-11T00:07:24.890 INFO:tasks.workunit.client.0.smithi111.stdout:9/716: truncate d6/db/d34/fde 571210 0 2024-09-11T00:07:24.892 INFO:tasks.workunit.client.0.smithi111.stdout:0/701: rename d3/da/d7b/fa4 to d3/d13/d1e/deb/d61/d93/ffe 0 2024-09-11T00:07:24.893 INFO:tasks.workunit.client.1.smithi203.stdout:3/688: dwrite d8/da/d37/d83/fe2 [0,4194304] 0 2024-09-11T00:07:24.895 INFO:tasks.workunit.client.0.smithi111.stdout:9/717: read d6/db/fd [4109602,46137] 0 2024-09-11T00:07:24.902 INFO:tasks.workunit.client.0.smithi111.stdout:1/641: dwrite d2/de/d12/d3c/d4b/d6a/d3a/f6b [0,4194304] 0 2024-09-11T00:07:24.909 INFO:tasks.workunit.client.0.smithi111.stdout:9/718: mkdir d6/db/d7a/d9a/de6 0 2024-09-11T00:07:24.909 INFO:tasks.workunit.client.0.smithi111.stdout:5/686: dread d10/d1e/d23/d30/dd8/d7e/fb1 [0,4194304] 0 2024-09-11T00:07:24.911 INFO:tasks.workunit.client.0.smithi111.stdout:6/624: dwrite d7/d22/d26/d87/f57 [0,4194304] 0 2024-09-11T00:07:24.911 INFO:tasks.workunit.client.0.smithi111.stdout:3/675: rename d1c/d1d/d22/d23/d2f/de8/ce3 to d1c/d21/dae/ce9 0 2024-09-11T00:07:24.912 INFO:tasks.workunit.client.1.smithi203.stdout:1/708: dread d8/faf [0,4194304] 0 2024-09-11T00:07:24.918 INFO:tasks.workunit.client.0.smithi111.stdout:8/681: link d11/d21/d38/f57 d11/d23/d2c/d46/d64/fdc 0 2024-09-11T00:07:24.918 INFO:tasks.workunit.client.0.smithi111.stdout:1/642: creat d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/d7b/fd6 x:0 0 0 2024-09-11T00:07:24.920 INFO:tasks.workunit.client.0.smithi111.stdout:9/719: fdatasync d6/dc/f20 0 2024-09-11T00:07:24.921 INFO:tasks.workunit.client.1.smithi203.stdout:1/709: creat d8/d19/d60/d90/d3e/d4b/d80/d8d/da3/ff6 x:0 0 0 2024-09-11T00:07:24.922 INFO:tasks.workunit.client.0.smithi111.stdout:9/720: stat d6/db/d1b/d41/f57 0 2024-09-11T00:07:24.924 INFO:tasks.workunit.client.1.smithi203.stdout:1/710: fdatasync d8/d19/d31/ff1 0 2024-09-11T00:07:24.927 INFO:tasks.workunit.client.0.smithi111.stdout:7/681: dread dd/d1d/d2d/d2e/f40 [0,4194304] 0 2024-09-11T00:07:24.927 INFO:tasks.workunit.client.0.smithi111.stdout:8/682: symlink d11/d23/d7e/ldd 0 2024-09-11T00:07:24.929 INFO:tasks.workunit.client.0.smithi111.stdout:3/676: unlink d1c/d1d/d22/d23/d2f/de8/d5f/f9d 0 2024-09-11T00:07:24.930 INFO:tasks.workunit.client.1.smithi203.stdout:1/711: creat d8/d9/d15/d35/d81/db9/ff7 x:0 0 0 2024-09-11T00:07:24.932 INFO:tasks.workunit.client.1.smithi203.stdout:3/689: write d8/f58 [4502465,18932] 0 2024-09-11T00:07:24.937 INFO:tasks.workunit.client.1.smithi203.stdout:1/712: creat d8/d19/ff8 x:0 0 0 2024-09-11T00:07:24.937 INFO:tasks.workunit.client.0.smithi111.stdout:0/702: write d3/dc/fa5 [939767,116082] 0 2024-09-11T00:07:24.938 INFO:tasks.workunit.client.0.smithi111.stdout:8/683: unlink d11/d21/c3a 0 2024-09-11T00:07:24.941 INFO:tasks.workunit.client.0.smithi111.stdout:7/682: mknod dd/d48/d69/cd4 0 2024-09-11T00:07:24.941 INFO:tasks.workunit.client.0.smithi111.stdout:7/683: chown dd 4 1 2024-09-11T00:07:24.942 INFO:tasks.workunit.client.0.smithi111.stdout:2/643: truncate d0/d3/de/f51 1090840 0 2024-09-11T00:07:24.943 INFO:tasks.workunit.client.1.smithi203.stdout:1/713: mknod d8/d19/d60/d90/d3e/d4b/d80/da2/cf9 0 2024-09-11T00:07:24.948 INFO:tasks.workunit.client.0.smithi111.stdout:8/684: mkdir d11/d23/d2c/d7f/dde 0 2024-09-11T00:07:24.948 INFO:tasks.workunit.client.0.smithi111.stdout:0/703: read d3/d26/d77/f86 [455255,100812] 0 2024-09-11T00:07:24.949 INFO:tasks.workunit.client.1.smithi203.stdout:1/714: symlink d8/d19/d60/d90/d3e/lfa 0 2024-09-11T00:07:24.951 INFO:tasks.workunit.client.0.smithi111.stdout:1/643: rmdir d2/de/d12/d3c/dd3 0 2024-09-11T00:07:24.951 INFO:tasks.workunit.client.0.smithi111.stdout:2/644: write d0/d3/f1c [636820,89213] 0 2024-09-11T00:07:24.953 INFO:tasks.workunit.client.1.smithi203.stdout:3/690: dwrite d8/da/d37/d83/d6a/f72 [4194304,4194304] 0 2024-09-11T00:07:24.955 INFO:tasks.workunit.client.0.smithi111.stdout:6/625: dread d7/d2b/f5b [0,4194304] 0 2024-09-11T00:07:24.955 INFO:tasks.workunit.client.0.smithi111.stdout:9/721: rename d6/c16 to d6/db/d34/d37/d4c/ce7 0 2024-09-11T00:07:24.957 INFO:tasks.workunit.client.1.smithi203.stdout:1/715: mknod d8/d9/d15/d35/cfb 0 2024-09-11T00:07:24.960 INFO:tasks.workunit.client.1.smithi203.stdout:3/691: dread - d8/da/d37/d83/db9/fcb zero size 2024-09-11T00:07:24.960 INFO:tasks.workunit.client.0.smithi111.stdout:2/645: unlink d0/d3/f4e 0 2024-09-11T00:07:24.962 INFO:tasks.workunit.client.0.smithi111.stdout:5/687: dwrite d10/d1e/d23/d30/dd8/da2/d66/f67 [4194304,4194304] 0 2024-09-11T00:07:24.962 INFO:tasks.workunit.client.1.smithi203.stdout:1/716: chown d8/d19/d60/d90/d3e/d4b/d41/fda 4 1 2024-09-11T00:07:24.963 INFO:tasks.workunit.client.0.smithi111.stdout:7/684: dwrite f8 [0,4194304] 0 2024-09-11T00:07:24.964 INFO:tasks.workunit.client.0.smithi111.stdout:3/677: rename d1c/l43 to d1c/d1d/d22/d23/d2f/de8/lea 0 2024-09-11T00:07:24.967 INFO:tasks.workunit.client.1.smithi203.stdout:3/692: mkdir d8/da/d37/d53/dea/df6 0 2024-09-11T00:07:24.968 INFO:tasks.workunit.client.0.smithi111.stdout:5/688: chown d10/d1e/d23/d2b/d2f/c99 2307013 1 2024-09-11T00:07:24.969 INFO:tasks.workunit.client.1.smithi203.stdout:1/717: creat d8/d9/d15/d35/d81/da1/ffc x:0 0 0 2024-09-11T00:07:24.973 INFO:tasks.workunit.client.1.smithi203.stdout:1/718: dread d8/d19/f57 [0,4194304] 0 2024-09-11T00:07:24.973 INFO:tasks.workunit.client.0.smithi111.stdout:8/685: dwrite d11/d23/d7e/d93/fcd [4194304,4194304] 0 2024-09-11T00:07:24.974 INFO:tasks.workunit.client.0.smithi111.stdout:6/626: creat d7/d22/d26/d87/d41/d77/fce x:0 0 0 2024-09-11T00:07:24.976 INFO:tasks.workunit.client.0.smithi111.stdout:6/627: stat d7/d22/d3f/d74 0 2024-09-11T00:07:24.989 INFO:tasks.workunit.client.1.smithi203.stdout:1/719: creat d8/d28/d64/da0/ffd x:0 0 0 2024-09-11T00:07:24.994 INFO:tasks.workunit.client.1.smithi203.stdout:1/720: write d8/d19/ff8 [612659,22373] 0 2024-09-11T00:07:24.994 INFO:tasks.workunit.client.0.smithi111.stdout:7/685: dread dd/d1d/d7e/dc8/f64 [0,4194304] 0 2024-09-11T00:07:25.000 INFO:tasks.workunit.client.1.smithi203.stdout:1/721: fsync d8/d19/d60/d90/d3e/d4b/d3a/f9f 0 2024-09-11T00:07:25.002 INFO:tasks.workunit.client.0.smithi111.stdout:9/722: dread d6/db/d1b/d41/fb0 [0,4194304] 0 2024-09-11T00:07:25.003 INFO:tasks.workunit.client.0.smithi111.stdout:3/678: rename d1c/c2c to d1c/d1d/d22/d44/d5a/d74/ceb 0 2024-09-11T00:07:25.004 INFO:tasks.workunit.client.0.smithi111.stdout:1/644: truncate d2/de/d12/d3c/d4b/d6a/d3a/f70 3135647 0 2024-09-11T00:07:25.007 INFO:tasks.workunit.client.0.smithi111.stdout:6/628: symlink d7/d22/d3f/d74/d7f/d61/lcf 0 2024-09-11T00:07:25.008 INFO:tasks.workunit.client.0.smithi111.stdout:0/704: dwrite d3/d13/d1e/deb/d61/d93/f97 [0,4194304] 0 2024-09-11T00:07:25.008 INFO:tasks.workunit.client.1.smithi203.stdout:1/722: truncate d8/d11/fae 1657402 0 2024-09-11T00:07:25.010 INFO:tasks.workunit.client.0.smithi111.stdout:2/646: truncate d0/d3/de/f44 4194033 0 2024-09-11T00:07:25.010 INFO:tasks.workunit.client.1.smithi203.stdout:3/693: dread d8/da/d5c/fd6 [0,4194304] 0 2024-09-11T00:07:25.012 INFO:tasks.workunit.client.0.smithi111.stdout:5/689: creat d10/d1e/d23/fdc x:0 0 0 2024-09-11T00:07:25.014 INFO:tasks.workunit.client.0.smithi111.stdout:9/723: mkdir d6/db/d34/d37/d4c/d7f/d97/de8 0 2024-09-11T00:07:25.017 INFO:tasks.workunit.client.1.smithi203.stdout:1/723: mkdir d8/d19/d60/d90/d3e/dfe 0 2024-09-11T00:07:25.020 INFO:tasks.workunit.client.0.smithi111.stdout:8/686: dwrite d11/d21/f22 [0,4194304] 0 2024-09-11T00:07:25.020 INFO:tasks.workunit.client.0.smithi111.stdout:6/629: symlink d7/d22/d3f/d74/ld0 0 2024-09-11T00:07:25.023 INFO:tasks.workunit.client.0.smithi111.stdout:0/705: rmdir d3/da/d7b/d84/da8 39 2024-09-11T00:07:25.023 INFO:tasks.workunit.client.0.smithi111.stdout:0/706: fsync d3/d74/fde 0 2024-09-11T00:07:25.023 INFO:tasks.workunit.client.0.smithi111.stdout:4/634: sync 2024-09-11T00:07:25.024 INFO:tasks.workunit.client.0.smithi111.stdout:4/635: fdatasync f7 0 2024-09-11T00:07:25.026 INFO:tasks.workunit.client.0.smithi111.stdout:7/686: rename dd/d1d/d1f/c80 to dd/d48/cd5 0 2024-09-11T00:07:25.039 INFO:tasks.workunit.client.0.smithi111.stdout:4/636: dread d18/d20/f46 [0,4194304] 0 2024-09-11T00:07:25.040 INFO:tasks.workunit.client.1.smithi203.stdout:1/724: getdents d8/d19/d60/d90/d3e/d4b/d80/d8d/db0 0 2024-09-11T00:07:25.043 INFO:tasks.workunit.client.0.smithi111.stdout:9/724: symlink d6/db/d1b/le9 0 2024-09-11T00:07:25.044 INFO:tasks.workunit.client.1.smithi203.stdout:3/694: dread d8/da/d37/d53/dea/fd3 [0,4194304] 0 2024-09-11T00:07:25.045 INFO:tasks.workunit.client.0.smithi111.stdout:1/645: dwrite d2/de/d12/d3c/d4b/d6a/f59 [0,4194304] 0 2024-09-11T00:07:25.047 INFO:tasks.workunit.client.1.smithi203.stdout:1/725: rename d8/d9/d15/d35/de2 to d8/d19/d60/dff 0 2024-09-11T00:07:25.048 INFO:tasks.workunit.client.1.smithi203.stdout:1/726: fsync d8/d19/ff8 0 2024-09-11T00:07:25.051 INFO:tasks.workunit.client.0.smithi111.stdout:8/687: write d11/d21/d6f/f7b [418135,28656] 0 2024-09-11T00:07:25.053 INFO:tasks.workunit.client.0.smithi111.stdout:3/679: getdents d1c/d1d/dac 0 2024-09-11T00:07:25.053 INFO:tasks.workunit.client.0.smithi111.stdout:6/630: rename d7/d22/d3f/d74/d7f/d61/lcf to d7/d22/d3f/ld1 0 2024-09-11T00:07:25.053 INFO:tasks.workunit.client.1.smithi203.stdout:3/695: rename d8/da/d37/d83/fc2 to d8/d2a/dd0/ff7 0 2024-09-11T00:07:25.056 INFO:tasks.workunit.client.0.smithi111.stdout:6/631: chown d7/d22/d3f/d74/d7f/d61/d6a/l9a 8805 1 2024-09-11T00:07:25.057 INFO:tasks.workunit.client.0.smithi111.stdout:2/647: rmdir d0/d3/d98/dbe 0 2024-09-11T00:07:25.058 INFO:tasks.workunit.client.0.smithi111.stdout:1/646: truncate d2/de/d12/d3c/d4b/d6a/d63/d73/da1/db9/fc5 564693 0 2024-09-11T00:07:25.059 INFO:tasks.workunit.client.0.smithi111.stdout:3/680: dread d1c/d1d/d22/d23/d2f/d63/d7e/fc5 [0,4194304] 0 2024-09-11T00:07:25.060 INFO:tasks.workunit.client.0.smithi111.stdout:9/725: creat d6/db/d34/d37/d4c/d99/fea x:0 0 0 2024-09-11T00:07:25.060 INFO:tasks.workunit.client.0.smithi111.stdout:9/726: readlink d6/dc/l55 0 2024-09-11T00:07:25.062 INFO:tasks.workunit.client.0.smithi111.stdout:9/727: write d6/db/f79 [4616678,101161] 0 2024-09-11T00:07:25.066 INFO:tasks.workunit.client.1.smithi203.stdout:3/696: dread d8/da/d5c/d6b/d6c/fd9 [0,4194304] 0 2024-09-11T00:07:25.068 INFO:tasks.workunit.client.1.smithi203.stdout:3/697: write d8/da/d5c/f61 [3477983,92312] 0 2024-09-11T00:07:25.080 INFO:tasks.workunit.client.1.smithi203.stdout:3/698: link d8/da/d37/d83/d65/c7f d8/cf8 0 2024-09-11T00:07:25.083 INFO:tasks.workunit.client.1.smithi203.stdout:3/699: write d8/da/d37/d83/dc0/fd7 [310903,105514] 0 2024-09-11T00:07:25.086 INFO:tasks.workunit.client.1.smithi203.stdout:1/727: dwrite d8/d9/d15/ff3 [0,4194304] 0 2024-09-11T00:07:25.093 INFO:tasks.workunit.client.1.smithi203.stdout:1/728: mknod d8/d19/d60/d90/d3e/d4b/d3a/c100 0 2024-09-11T00:07:25.095 INFO:tasks.workunit.client.1.smithi203.stdout:1/729: fsync d8/d19/d60/d90/d3e/fdb 0 2024-09-11T00:07:25.099 INFO:tasks.workunit.client.1.smithi203.stdout:1/730: write d8/d19/d60/d90/d3e/d4b/d3a/fd1 [2729735,76175] 0 2024-09-11T00:07:25.100 INFO:tasks.workunit.client.1.smithi203.stdout:3/700: rename d8/da/d37/d83/c8f to d8/da/cf9 0 2024-09-11T00:07:25.103 INFO:tasks.workunit.client.1.smithi203.stdout:1/731: mkdir d8/d19/d31/d36/d101 0 2024-09-11T00:07:25.104 INFO:tasks.workunit.client.0.smithi111.stdout:5/690: link d10/d1e/d23/d30/d59/d7b/d82/d86/lb9 d10/d1e/d23/d30/dd8/da2/d66/d76/ldd 0 2024-09-11T00:07:25.107 INFO:tasks.workunit.client.0.smithi111.stdout:7/687: mknod dd/d1d/d4b/cd6 0 2024-09-11T00:07:25.113 INFO:tasks.workunit.client.0.smithi111.stdout:6/632: rmdir d7/d22/d3f/d74/d7f 39 2024-09-11T00:07:25.116 INFO:tasks.workunit.client.0.smithi111.stdout:3/681: truncate d1c/d1d/d22/f9b 544500 0 2024-09-11T00:07:25.122 INFO:tasks.workunit.client.0.smithi111.stdout:4/637: link d18/d20/d40/d78/d79/f8a d18/d20/d40/fc4 0 2024-09-11T00:07:25.125 INFO:tasks.workunit.client.0.smithi111.stdout:2/648: mknod d0/cdc 0 2024-09-11T00:07:25.127 INFO:tasks.workunit.client.1.smithi203.stdout:1/732: dread d8/d19/d31/d36/f42 [0,4194304] 0 2024-09-11T00:07:25.130 INFO:tasks.workunit.client.0.smithi111.stdout:5/691: creat d10/d1e/d23/d26/d3a/dc2/fde x:0 0 0 2024-09-11T00:07:25.134 INFO:tasks.workunit.client.1.smithi203.stdout:1/733: truncate d8/d9/d15/d35/d81/f83 4920123 0 2024-09-11T00:07:25.137 INFO:tasks.workunit.client.0.smithi111.stdout:1/647: creat d2/de/d12/fd7 x:0 0 0 2024-09-11T00:07:25.138 INFO:tasks.workunit.client.0.smithi111.stdout:1/648: chown d2/de/d12/d3c/d4b/f51 24 1 2024-09-11T00:07:25.140 INFO:tasks.workunit.client.0.smithi111.stdout:9/728: rmdir d6/d52/d8a/dd1 0 2024-09-11T00:07:25.141 INFO:tasks.workunit.client.0.smithi111.stdout:9/729: chown d6/db/d34/cd3 11 1 2024-09-11T00:07:25.142 INFO:tasks.workunit.client.0.smithi111.stdout:5/692: symlink d10/d1e/d23/d30/d59/d52/d85/ldf 0 2024-09-11T00:07:25.144 INFO:tasks.workunit.client.1.smithi203.stdout:1/734: dread d8/d19/d60/d90/d3e/d4b/d3a/f9f [0,4194304] 0 2024-09-11T00:07:25.146 INFO:tasks.workunit.client.0.smithi111.stdout:1/649: fdatasync d2/f79 0 2024-09-11T00:07:25.146 INFO:tasks.workunit.client.1.smithi203.stdout:3/701: dwrite d8/d17/f57 [0,4194304] 0 2024-09-11T00:07:25.146 INFO:tasks.workunit.client.0.smithi111.stdout:8/688: write d11/d23/d2c/d46/f8c [1477332,88773] 0 2024-09-11T00:07:25.148 INFO:tasks.workunit.client.0.smithi111.stdout:6/633: creat d7/d22/d26/d87/fd2 x:0 0 0 2024-09-11T00:07:25.149 INFO:tasks.workunit.client.1.smithi203.stdout:1/735: chown d8/d19/d60/d90/d3e/d4b/d80/da2/cf9 249018941 1 2024-09-11T00:07:25.151 INFO:tasks.workunit.client.0.smithi111.stdout:9/730: creat d6/db/db8/feb x:0 0 0 2024-09-11T00:07:25.152 INFO:tasks.workunit.client.0.smithi111.stdout:2/649: dread d0/d3/de/f51 [0,4194304] 0 2024-09-11T00:07:25.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:24 smithi111 ceph-mon[27539]: pgmap v10: 65 pgs: 65 active+clean; 2.4 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 58 MiB/s rd, 168 MiB/s wr, 342 op/s 2024-09-11T00:07:25.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:24 smithi111 ceph-mon[27539]: mgrmap e26: smithi203.smuspl(active, since 14s), standbys: smithi111.ypucji 2024-09-11T00:07:25.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:24 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "mgr metadata", "who": "smithi111.ypucji", "id": "smithi111.ypucji"}]: dispatch 2024-09-11T00:07:25.152 INFO:tasks.workunit.client.1.smithi203.stdout:1/736: write d8/d28/fc0 [1944567,73476] 0 2024-09-11T00:07:25.153 INFO:tasks.workunit.client.0.smithi111.stdout:4/638: write f5 [1404234,12185] 0 2024-09-11T00:07:25.154 INFO:tasks.workunit.client.0.smithi111.stdout:7/688: write fa [359802,126484] 0 2024-09-11T00:07:25.154 INFO:tasks.workunit.client.0.smithi111.stdout:8/689: rmdir d11/d23/d7e 39 2024-09-11T00:07:25.155 INFO:tasks.workunit.client.1.smithi203.stdout:1/737: stat d8/d19/d31/d36/lcb 0 2024-09-11T00:07:25.157 INFO:tasks.workunit.client.1.smithi203.stdout:2/691: sync 2024-09-11T00:07:25.159 INFO:tasks.workunit.client.0.smithi111.stdout:3/682: dread d1c/d1d/d22/d31/d62/f9c [0,4194304] 0 2024-09-11T00:07:25.159 INFO:tasks.workunit.client.0.smithi111.stdout:5/693: symlink d10/d1e/d23/d30/dd8/d63/dbb/db5/le0 0 2024-09-11T00:07:25.166 INFO:tasks.workunit.client.1.smithi203.stdout:1/738: chown d8/d19/d60/d90/d3e/l48 420 1 2024-09-11T00:07:25.166 INFO:tasks.workunit.client.0.smithi111.stdout:2/650: creat d0/d3/de/d3b/d63/fdd x:0 0 0 2024-09-11T00:07:25.166 INFO:tasks.workunit.client.0.smithi111.stdout:7/689: dread dd/d1d/d1f/f9d [0,4194304] 0 2024-09-11T00:07:25.167 INFO:tasks.workunit.client.1.smithi203.stdout:1/739: stat d8/l55 0 2024-09-11T00:07:25.168 INFO:tasks.workunit.client.0.smithi111.stdout:2/651: chown d0/d3/f93 1 1 2024-09-11T00:07:25.169 INFO:tasks.workunit.client.0.smithi111.stdout:7/690: stat dd/d1d/d4b/cd6 0 2024-09-11T00:07:25.171 INFO:tasks.workunit.client.1.smithi203.stdout:1/740: mkdir d8/d9/d15/d27/d102 0 2024-09-11T00:07:25.176 INFO:tasks.workunit.client.0.smithi111.stdout:7/691: creat dd/d48/d69/fd7 x:0 0 0 2024-09-11T00:07:25.176 INFO:tasks.workunit.client.1.smithi203.stdout:2/692: dwrite d13/d15/d19/d1c/d76/d94/fce [0,4194304] 0 2024-09-11T00:07:25.179 INFO:tasks.workunit.client.0.smithi111.stdout:6/634: truncate d7/d22/d1d/f75 2587760 0 2024-09-11T00:07:25.180 INFO:tasks.workunit.client.1.smithi203.stdout:1/741: chown d8/d19/d60/d90/d3e/d66/fc6 24589 1 2024-09-11T00:07:25.180 INFO:tasks.workunit.client.0.smithi111.stdout:4/639: write d18/d1f/d36/fb4 [4291973,79967] 0 2024-09-11T00:07:25.185 INFO:tasks.workunit.client.0.smithi111.stdout:5/694: dwrite d10/d1e/d23/fa1 [0,4194304] 0 2024-09-11T00:07:25.187 INFO:tasks.workunit.client.1.smithi203.stdout:3/702: dread d8/d17/f78 [0,4194304] 0 2024-09-11T00:07:25.187 INFO:tasks.workunit.client.1.smithi203.stdout:2/693: rename d13/d56/d69/f6d to d13/d15/d30/d5a/dac/fe3 0 2024-09-11T00:07:25.188 INFO:tasks.workunit.client.0.smithi111.stdout:9/731: dwrite d6/db/d1b/d41/fb0 [4194304,4194304] 0 2024-09-11T00:07:25.189 INFO:tasks.workunit.client.1.smithi203.stdout:3/703: chown d8/f58 197863365 1 2024-09-11T00:07:25.192 INFO:tasks.workunit.client.0.smithi111.stdout:7/692: creat dd/d1d/d7e/dc8/fd8 x:0 0 0 2024-09-11T00:07:25.192 INFO:tasks.workunit.client.1.smithi203.stdout:2/694: truncate d13/d56/f8f 4466841 0 2024-09-11T00:07:25.193 INFO:tasks.workunit.client.0.smithi111.stdout:4/640: fdatasync d18/d20/d40/d78/d79/fac 0 2024-09-11T00:07:25.193 INFO:tasks.workunit.client.0.smithi111.stdout:6/635: fdatasync d7/d22/d26/d95/f9c 0 2024-09-11T00:07:25.194 INFO:tasks.workunit.client.0.smithi111.stdout:2/652: rename d0/d3/d2e/c64 to d0/d3/de/d50/cde 0 2024-09-11T00:07:25.195 INFO:tasks.workunit.client.0.smithi111.stdout:7/693: chown dd/d1d/d1f/l55 84716773 1 2024-09-11T00:07:25.198 INFO:tasks.workunit.client.0.smithi111.stdout:1/650: dread d2/de/d12/d3c/d4b/d6a/f46 [0,4194304] 0 2024-09-11T00:07:25.200 INFO:tasks.workunit.client.1.smithi203.stdout:2/695: creat d13/d15/d19/fe4 x:0 0 0 2024-09-11T00:07:25.203 INFO:tasks.workunit.client.0.smithi111.stdout:6/636: mknod d7/d22/d2c/cd3 0 2024-09-11T00:07:25.207 INFO:tasks.workunit.client.0.smithi111.stdout:7/694: unlink dd/d1d/d4b/d8f/d9f/c8b 0 2024-09-11T00:07:25.211 INFO:tasks.workunit.client.0.smithi111.stdout:8/690: dread f7 [0,4194304] 0 2024-09-11T00:07:25.213 INFO:tasks.workunit.client.0.smithi111.stdout:5/695: dread d10/d1e/d23/d30/d59/d53/f5e [0,4194304] 0 2024-09-11T00:07:25.213 INFO:tasks.workunit.client.0.smithi111.stdout:3/683: dread d1c/d1d/d22/d23/f91 [0,4194304] 0 2024-09-11T00:07:25.214 INFO:tasks.workunit.client.0.smithi111.stdout:6/637: mkdir d7/d2b/dd4 0 2024-09-11T00:07:25.216 INFO:tasks.workunit.client.0.smithi111.stdout:5/696: write d10/d1e/d23/d30/d59/d53/fcc [3667865,61342] 0 2024-09-11T00:07:25.218 INFO:tasks.workunit.client.0.smithi111.stdout:4/641: write d18/d39/f53 [1955307,42103] 0 2024-09-11T00:07:25.220 INFO:tasks.workunit.client.0.smithi111.stdout:8/691: chown d11/d23/d2c/d53/cce 5061345 1 2024-09-11T00:07:25.221 INFO:tasks.workunit.client.1.smithi203.stdout:3/704: dwrite d8/da/d11/f43 [8388608,4194304] 0 2024-09-11T00:07:25.222 INFO:tasks.workunit.client.0.smithi111.stdout:3/684: symlink d1c/d1d/d22/d31/lec 0 2024-09-11T00:07:25.223 INFO:tasks.workunit.client.0.smithi111.stdout:5/697: readlink d10/d1e/d23/d30/dd8/d63/l9f 0 2024-09-11T00:07:25.223 INFO:tasks.workunit.client.0.smithi111.stdout:4/642: write d18/d3b/d51/f5b [3397636,46694] 0 2024-09-11T00:07:25.223 INFO:tasks.workunit.client.1.smithi203.stdout:3/705: fdatasync d8/f3d 0 2024-09-11T00:07:25.226 INFO:tasks.workunit.client.0.smithi111.stdout:3/685: truncate f1a 938454 0 2024-09-11T00:07:25.228 INFO:tasks.workunit.client.0.smithi111.stdout:8/692: mknod d11/d23/d2c/d53/cdf 0 2024-09-11T00:07:25.228 INFO:tasks.workunit.client.0.smithi111.stdout:7/695: dwrite dd/d1d/f66 [4194304,4194304] 0 2024-09-11T00:07:25.230 INFO:tasks.workunit.client.0.smithi111.stdout:8/693: write d11/fa1 [803740,67427] 0 2024-09-11T00:07:25.231 INFO:tasks.workunit.client.0.smithi111.stdout:4/643: mkdir d18/d1f/dc5 0 2024-09-11T00:07:25.232 INFO:tasks.workunit.client.1.smithi203.stdout:3/706: rename d8/d17/f57 to d8/da/db3/ffa 0 2024-09-11T00:07:25.233 INFO:tasks.workunit.client.0.smithi111.stdout:5/698: symlink d10/d1e/d23/d2b/le1 0 2024-09-11T00:07:25.236 INFO:tasks.workunit.client.1.smithi203.stdout:3/707: fsync d8/da/d5c/d6b/d6c/fd9 0 2024-09-11T00:07:25.237 INFO:tasks.workunit.client.0.smithi111.stdout:3/686: creat d1c/d1d/d22/d23/d2f/de8/fed x:0 0 0 2024-09-11T00:07:25.237 INFO:tasks.workunit.client.0.smithi111.stdout:7/696: symlink dd/d1d/d1f/d24/ld9 0 2024-09-11T00:07:25.238 INFO:tasks.workunit.client.0.smithi111.stdout:3/687: chown d1c/d1d/d22/d23/lc6 6942328 1 2024-09-11T00:07:25.239 INFO:tasks.workunit.client.0.smithi111.stdout:3/688: readlink d1c/d1d/d22/d23/d2f/de8/l9f 0 2024-09-11T00:07:25.241 INFO:tasks.workunit.client.0.smithi111.stdout:8/694: creat d11/d23/d3d/d5f/fe0 x:0 0 0 2024-09-11T00:07:25.242 INFO:tasks.workunit.client.0.smithi111.stdout:8/695: read d11/f13 [7894657,112226] 0 2024-09-11T00:07:25.245 INFO:tasks.workunit.client.0.smithi111.stdout:8/696: chown d11/d23/d2c/c9f 218 1 2024-09-11T00:07:25.247 INFO:tasks.workunit.client.0.smithi111.stdout:3/689: mknod d1c/d1d/d22/d23/d2f/de8/d5f/cee 0 2024-09-11T00:07:25.247 INFO:tasks.workunit.client.1.smithi203.stdout:3/708: truncate d8/da/d5c/d6b/d6c/fd9 3477078 0 2024-09-11T00:07:25.248 INFO:tasks.workunit.client.0.smithi111.stdout:4/644: getdents d18/d3b/d61 0 2024-09-11T00:07:25.248 INFO:tasks.workunit.client.1.smithi203.stdout:2/696: dread d13/d15/d19/d1c/f9f [0,4194304] 0 2024-09-11T00:07:25.249 INFO:tasks.workunit.client.0.smithi111.stdout:4/645: read d18/d20/d3c/d5e/d75/fb1 [318407,110393] 0 2024-09-11T00:07:25.251 INFO:tasks.workunit.client.0.smithi111.stdout:8/697: rename d11/d21/d38/f57 to d11/d23/d2c/d46/d64/fe1 0 2024-09-11T00:07:25.252 INFO:tasks.workunit.client.1.smithi203.stdout:2/697: symlink d13/d56/d69/dcb/le5 0 2024-09-11T00:07:25.256 INFO:tasks.workunit.client.1.smithi203.stdout:2/698: readlink d13/d15/d30/d5a/dac/lde 0 2024-09-11T00:07:25.260 INFO:tasks.workunit.client.0.smithi111.stdout:3/690: dwrite d1c/d21/f7d [0,4194304] 0 2024-09-11T00:07:25.264 INFO:tasks.workunit.client.0.smithi111.stdout:8/698: creat d11/d21/d38/fe2 x:0 0 0 2024-09-11T00:07:25.265 INFO:tasks.workunit.client.0.smithi111.stdout:8/699: chown d11/d23/d2c/d7f/fad 864070 1 2024-09-11T00:07:25.266 INFO:tasks.workunit.client.0.smithi111.stdout:8/700: chown d11/d23/d2c/d7f/dde 2 1 2024-09-11T00:07:25.269 INFO:tasks.workunit.client.0.smithi111.stdout:0/707: sync 2024-09-11T00:07:25.270 INFO:tasks.workunit.client.0.smithi111.stdout:8/701: mknod d11/d23/d3d/dca/dcf/dc3/ce3 0 2024-09-11T00:07:25.273 INFO:tasks.workunit.client.1.smithi203.stdout:3/709: dread d8/d2a/fc6 [0,4194304] 0 2024-09-11T00:07:25.274 INFO:tasks.workunit.client.0.smithi111.stdout:1/651: dread d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/f61 [0,4194304] 0 2024-09-11T00:07:25.275 INFO:tasks.workunit.client.0.smithi111.stdout:8/702: write d11/d23/d2c/d46/fc8 [2268032,18158] 0 2024-09-11T00:07:25.279 INFO:tasks.workunit.client.0.smithi111.stdout:8/703: rmdir d11/d23/d3d/d5f/d99 39 2024-09-11T00:07:25.283 INFO:tasks.workunit.client.0.smithi111.stdout:3/691: dwrite d1c/d1d/f77 [0,4194304] 0 2024-09-11T00:07:25.285 INFO:tasks.workunit.client.0.smithi111.stdout:6/638: write d7/d22/d2c/f62 [369459,112182] 0 2024-09-11T00:07:25.285 INFO:tasks.workunit.client.0.smithi111.stdout:9/732: write d6/db/d1b/d56/dc8/fd0 [533189,48404] 0 2024-09-11T00:07:25.286 INFO:tasks.workunit.client.0.smithi111.stdout:8/704: write d11/d23/d2c/d46/f63 [708598,60140] 0 2024-09-11T00:07:25.290 INFO:tasks.workunit.client.0.smithi111.stdout:6/639: mknod d7/d2b/dd4/cd5 0 2024-09-11T00:07:25.291 INFO:tasks.workunit.client.0.smithi111.stdout:8/705: unlink d11/d23/d2c/f6b 0 2024-09-11T00:07:25.293 INFO:tasks.workunit.client.0.smithi111.stdout:1/652: dread d2/de/ff [0,4194304] 0 2024-09-11T00:07:25.294 INFO:tasks.workunit.client.0.smithi111.stdout:8/706: readlink d11/lb3 0 2024-09-11T00:07:25.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:24 smithi203 ceph-mon[33225]: pgmap v10: 65 pgs: 65 active+clean; 2.4 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 58 MiB/s rd, 168 MiB/s wr, 342 op/s 2024-09-11T00:07:25.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:24 smithi203 ceph-mon[33225]: mgrmap e26: smithi203.smuspl(active, since 14s), standbys: smithi111.ypucji 2024-09-11T00:07:25.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:24 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "mgr metadata", "who": "smithi111.ypucji", "id": "smithi111.ypucji"}]: dispatch 2024-09-11T00:07:25.295 INFO:tasks.workunit.client.0.smithi111.stdout:6/640: mkdir d7/d22/d26/d95/dd6 0 2024-09-11T00:07:25.298 INFO:tasks.workunit.client.0.smithi111.stdout:8/707: chown d11/d23/d7e/d93/dba/fd0 643731628 1 2024-09-11T00:07:25.298 INFO:tasks.workunit.client.0.smithi111.stdout:3/692: mkdir d1c/d1d/d22/d44/d5a/dcd/dd2/def 0 2024-09-11T00:07:25.301 INFO:tasks.workunit.client.0.smithi111.stdout:8/708: fdatasync d11/fc0 0 2024-09-11T00:07:25.305 INFO:tasks.workunit.client.0.smithi111.stdout:6/641: creat d7/d22/d3f/d74/d7f/d61/d6a/dba/fd7 x:0 0 0 2024-09-11T00:07:25.307 INFO:tasks.workunit.client.0.smithi111.stdout:3/693: fsync d1c/d1d/d22/d23/d2f/de8/fb0 0 2024-09-11T00:07:25.310 INFO:tasks.workunit.client.0.smithi111.stdout:9/733: dwrite d6/dc/dc1/fe4 [0,4194304] 0 2024-09-11T00:07:25.313 INFO:tasks.workunit.client.0.smithi111.stdout:5/699: write d10/d1e/d23/f48 [5079137,63654] 0 2024-09-11T00:07:25.313 INFO:tasks.workunit.client.0.smithi111.stdout:3/694: truncate d1c/d1d/d22/d44/d5a/d74/fdc 849283 0 2024-09-11T00:07:25.314 INFO:tasks.workunit.client.0.smithi111.stdout:1/653: getdents d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/d7b 0 2024-09-11T00:07:25.318 INFO:tasks.workunit.client.0.smithi111.stdout:5/700: chown d10/d1e/d23/d30/d59 0 1 2024-09-11T00:07:25.325 INFO:tasks.workunit.client.0.smithi111.stdout:1/654: creat d2/de/d12/d3c/d4b/d6a/d3a/fd8 x:0 0 0 2024-09-11T00:07:25.325 INFO:tasks.workunit.client.1.smithi203.stdout:2/699: write f8 [2104581,44796] 0 2024-09-11T00:07:25.326 INFO:tasks.workunit.client.0.smithi111.stdout:4/646: write d18/fa4 [1010321,92071] 0 2024-09-11T00:07:25.329 INFO:tasks.workunit.client.1.smithi203.stdout:3/710: truncate d8/d17/f74 1163008 0 2024-09-11T00:07:25.331 INFO:tasks.workunit.client.0.smithi111.stdout:1/655: fsync d2/d2b/f3e 0 2024-09-11T00:07:25.331 INFO:tasks.workunit.client.1.smithi203.stdout:3/711: chown d8/da/d37/d53/f9b 38183 1 2024-09-11T00:07:25.336 INFO:tasks.workunit.client.0.smithi111.stdout:7/697: dwrite dd/d1d/f39 [0,4194304] 0 2024-09-11T00:07:25.338 INFO:tasks.workunit.client.1.smithi203.stdout:3/712: symlink d8/da/d37/d83/d6a/dad/lfb 0 2024-09-11T00:07:25.341 INFO:tasks.workunit.client.0.smithi111.stdout:6/642: write d7/d22/d1d/d83/fa1 [3351360,128548] 0 2024-09-11T00:07:25.345 INFO:tasks.workunit.client.0.smithi111.stdout:7/698: creat dd/d48/d69/dbe/fda x:0 0 0 2024-09-11T00:07:25.346 INFO:tasks.workunit.client.0.smithi111.stdout:1/656: read d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/f5d [119608,73396] 0 2024-09-11T00:07:25.346 INFO:tasks.workunit.client.0.smithi111.stdout:9/734: dwrite d6/db/d34/fde [0,4194304] 0 2024-09-11T00:07:25.349 INFO:tasks.workunit.client.0.smithi111.stdout:5/701: dwrite d10/d1e/d23/d26/d3a/f5d [0,4194304] 0 2024-09-11T00:07:25.349 INFO:tasks.workunit.client.1.smithi203.stdout:3/713: unlink d8/da/d37/d83/d65/cdf 0 2024-09-11T00:07:25.355 INFO:tasks.workunit.client.0.smithi111.stdout:7/699: mknod dd/d1d/d4b/dad/cdb 0 2024-09-11T00:07:25.356 INFO:tasks.workunit.client.1.smithi203.stdout:2/700: write d13/f41 [1291655,14381] 0 2024-09-11T00:07:25.357 INFO:tasks.workunit.client.1.smithi203.stdout:5/739: sync 2024-09-11T00:07:25.357 INFO:tasks.workunit.client.1.smithi203.stdout:0/620: sync 2024-09-11T00:07:25.357 INFO:tasks.workunit.client.1.smithi203.stdout:6/655: sync 2024-09-11T00:07:25.357 INFO:tasks.workunit.client.1.smithi203.stdout:9/626: sync 2024-09-11T00:07:25.357 INFO:tasks.workunit.client.1.smithi203.stdout:4/554: sync 2024-09-11T00:07:25.357 INFO:tasks.workunit.client.1.smithi203.stdout:7/627: sync 2024-09-11T00:07:25.358 INFO:tasks.workunit.client.1.smithi203.stdout:3/714: symlink d8/da/d37/d83/d65/lfc 0 2024-09-11T00:07:25.360 INFO:tasks.workunit.client.1.smithi203.stdout:8/608: sync 2024-09-11T00:07:25.360 INFO:tasks.workunit.client.0.smithi111.stdout:3/695: dwrite f2 [0,4194304] 0 2024-09-11T00:07:25.360 INFO:tasks.workunit.client.0.smithi111.stdout:7/700: truncate dd/fcc 98436 0 2024-09-11T00:07:25.361 INFO:tasks.workunit.client.0.smithi111.stdout:5/702: symlink d10/d1e/d23/d26/d3a/d98/le2 0 2024-09-11T00:07:25.362 INFO:tasks.workunit.client.1.smithi203.stdout:6/656: chown d0/d32/d5a/fad 15697 1 2024-09-11T00:07:25.364 INFO:tasks.workunit.client.0.smithi111.stdout:5/703: truncate d10/f1b 4559935 0 2024-09-11T00:07:25.365 INFO:tasks.workunit.client.1.smithi203.stdout:6/657: stat d0/d5b/d5c/d6f/f92 0 2024-09-11T00:07:25.403 INFO:tasks.workunit.client.1.smithi203.stdout:2/701: dread d13/d15/d19/d1c/fd8 [0,4194304] 0 2024-09-11T00:07:25.408 INFO:tasks.workunit.client.1.smithi203.stdout:1/742: sync 2024-09-11T00:07:25.416 INFO:tasks.workunit.client.1.smithi203.stdout:1/743: dread d8/d19/d60/d90/d3e/d66/fc6 [0,4194304] 0 2024-09-11T00:07:25.419 INFO:tasks.workunit.client.1.smithi203.stdout:1/744: read d8/f49 [1140784,51623] 0 2024-09-11T00:07:25.469 INFO:tasks.workunit.client.0.smithi111.stdout:9/735: mknod d6/d52/ddc/cec 0 2024-09-11T00:07:25.472 INFO:tasks.workunit.client.1.smithi203.stdout:0/621: creat d0/d2/d37/d5b/d73/db6/fd0 x:0 0 0 2024-09-11T00:07:25.474 INFO:tasks.workunit.client.1.smithi203.stdout:3/715: symlink d8/dce/lfd 0 2024-09-11T00:07:25.483 INFO:tasks.workunit.client.0.smithi111.stdout:1/657: dwrite d2/f9 [0,4194304] 0 2024-09-11T00:07:25.484 INFO:tasks.workunit.client.0.smithi111.stdout:5/704: rename d10/l11 to d10/d1e/d25/d6e/le3 0 2024-09-11T00:07:25.485 INFO:tasks.workunit.client.0.smithi111.stdout:6/643: write d7/d22/d2c/f37 [1326102,12282] 0 2024-09-11T00:07:25.497 INFO:tasks.workunit.client.0.smithi111.stdout:1/658: write d2/de/f29 [1615525,71862] 0 2024-09-11T00:07:25.499 INFO:tasks.workunit.client.0.smithi111.stdout:1/659: dread - d2/dad/fcf zero size 2024-09-11T00:07:25.511 INFO:tasks.workunit.client.0.smithi111.stdout:5/705: dread d10/d1e/d23/d30/dd8/d7e/fab [0,4194304] 0 2024-09-11T00:07:25.516 INFO:tasks.workunit.client.0.smithi111.stdout:1/660: creat d2/de/d12/fd9 x:0 0 0 2024-09-11T00:07:25.519 INFO:tasks.workunit.client.0.smithi111.stdout:5/706: creat d10/d1e/d23/d30/d59/d52/fe4 x:0 0 0 2024-09-11T00:07:25.531 INFO:tasks.workunit.client.0.smithi111.stdout:1/661: creat d2/fda x:0 0 0 2024-09-11T00:07:25.534 INFO:tasks.workunit.client.0.smithi111.stdout:1/662: chown d2/de/d12/d3c/d4b/d6a/d3a/l8d 1 1 2024-09-11T00:07:25.536 INFO:tasks.workunit.client.0.smithi111.stdout:5/707: dwrite d10/d1e/d23/d30/dd8/da2/f58 [0,4194304] 0 2024-09-11T00:07:25.537 INFO:tasks.workunit.client.0.smithi111.stdout:2/653: sync 2024-09-11T00:07:25.539 INFO:tasks.workunit.client.0.smithi111.stdout:1/663: write d2/de/d12/d3c/d4b/d6a/d63/d73/da1/fc2 [2573851,14516] 0 2024-09-11T00:07:25.548 INFO:tasks.workunit.client.1.smithi203.stdout:2/702: mknod d13/d15/d30/d5a/dac/ce6 0 2024-09-11T00:07:25.554 INFO:tasks.workunit.client.1.smithi203.stdout:1/745: symlink d8/d9/d15/d27/l103 0 2024-09-11T00:07:25.560 INFO:tasks.workunit.client.1.smithi203.stdout:9/627: symlink d6/de/d47/dc3/ld3 0 2024-09-11T00:07:25.563 INFO:tasks.workunit.client.1.smithi203.stdout:6/658: symlink d0/d54/d9c/d35/db8/ld7 0 2024-09-11T00:07:25.564 INFO:tasks.workunit.client.1.smithi203.stdout:2/703: symlink d13/d15/d30/d59/le7 0 2024-09-11T00:07:25.566 INFO:tasks.workunit.client.1.smithi203.stdout:6/659: read d0/d54/d9c/d35/f70 [950246,34447] 0 2024-09-11T00:07:25.570 INFO:tasks.workunit.client.1.smithi203.stdout:1/746: fsync d8/d9/d15/d35/d81/db9/dce/feb 0 2024-09-11T00:07:25.571 INFO:tasks.workunit.client.1.smithi203.stdout:0/622: symlink d0/dc5/ld1 0 2024-09-11T00:07:25.573 INFO:tasks.workunit.client.1.smithi203.stdout:0/623: dread - d0/d2/d37/d5b/d73/fbf zero size 2024-09-11T00:07:25.587 INFO:tasks.workunit.client.0.smithi111.stdout:8/709: sync 2024-09-11T00:07:25.587 INFO:tasks.workunit.client.0.smithi111.stdout:0/708: sync 2024-09-11T00:07:25.589 INFO:tasks.workunit.client.1.smithi203.stdout:0/624: mkdir d0/d2/d7e/dd2 0 2024-09-11T00:07:25.590 INFO:tasks.workunit.client.1.smithi203.stdout:7/628: link dd/d1c/f35 dd/d1c/d52/d8f/d31/d58/d93/d98/fe1 0 2024-09-11T00:07:25.592 INFO:tasks.workunit.client.1.smithi203.stdout:7/629: chown dd/d1c/d52/d8f/d31/la9 2108648 1 2024-09-11T00:07:25.594 INFO:tasks.workunit.client.1.smithi203.stdout:7/630: chown dd/d1c/d52/d8f/f3f 8030432 1 2024-09-11T00:07:25.596 INFO:tasks.workunit.client.0.smithi111.stdout:0/709: dread - d3/d13/f73 zero size 2024-09-11T00:07:25.598 INFO:tasks.workunit.client.1.smithi203.stdout:3/716: link d8/da/caf d8/da/d37/d83/db9/cfe 0 2024-09-11T00:07:25.599 INFO:tasks.workunit.client.0.smithi111.stdout:8/710: dwrite f8 [0,4194304] 0 2024-09-11T00:07:25.600 INFO:tasks.workunit.client.1.smithi203.stdout:3/717: chown d8/da/d5c/d6b/c79 3 1 2024-09-11T00:07:25.606 INFO:tasks.workunit.client.1.smithi203.stdout:1/747: creat d8/d19/d60/d90/f104 x:0 0 0 2024-09-11T00:07:25.608 INFO:tasks.workunit.client.0.smithi111.stdout:8/711: mknod d11/d23/d2c/d46/ce4 0 2024-09-11T00:07:25.614 INFO:tasks.workunit.client.0.smithi111.stdout:8/712: creat d11/d23/d2c/d53/fe5 x:0 0 0 2024-09-11T00:07:25.618 INFO:tasks.workunit.client.1.smithi203.stdout:1/748: mknod d8/d9/d15/c105 0 2024-09-11T00:07:25.625 INFO:tasks.workunit.client.1.smithi203.stdout:7/631: getdents dd/d1c/d52 0 2024-09-11T00:07:25.627 INFO:tasks.workunit.client.1.smithi203.stdout:1/749: mkdir d8/d9/d15/d35/d81/db9/dce/d106 0 2024-09-11T00:07:25.628 INFO:tasks.workunit.client.1.smithi203.stdout:7/632: write dd/d1c/d52/d8f/d31/d58/fd0 [97467,6469] 0 2024-09-11T00:07:25.629 INFO:tasks.workunit.client.1.smithi203.stdout:3/718: link d8/da/d5c/d80/la4 d8/d3c/lff 0 2024-09-11T00:07:25.630 INFO:tasks.workunit.client.0.smithi111.stdout:4/647: sync 2024-09-11T00:07:25.630 INFO:tasks.workunit.client.1.smithi203.stdout:3/719: stat d8/da/d11 0 2024-09-11T00:07:25.637 INFO:tasks.workunit.client.1.smithi203.stdout:3/720: creat d8/da/d37/d83/d6a/dad/f100 x:0 0 0 2024-09-11T00:07:25.638 INFO:tasks.workunit.client.1.smithi203.stdout:7/633: creat dd/d1c/d7c/d8c/fe2 x:0 0 0 2024-09-11T00:07:25.639 INFO:tasks.workunit.client.1.smithi203.stdout:1/750: mkdir d8/d19/d60/d90/d3e/d107 0 2024-09-11T00:07:25.642 INFO:tasks.workunit.client.1.smithi203.stdout:3/721: creat d8/dce/f101 x:0 0 0 2024-09-11T00:07:25.648 INFO:tasks.workunit.client.0.smithi111.stdout:3/696: write d1c/d1d/d22/d31/f87 [1007350,86164] 0 2024-09-11T00:07:25.650 INFO:tasks.workunit.client.0.smithi111.stdout:3/697: stat d1c/d1d/d22/d23/f4a 0 2024-09-11T00:07:25.650 INFO:tasks.workunit.client.0.smithi111.stdout:7/701: write dd/d1d/d4b/d8f/d9f/d79/f7b [2502925,67985] 0 2024-09-11T00:07:25.651 INFO:tasks.workunit.client.1.smithi203.stdout:7/634: creat dd/d1c/d52/d8f/fe3 x:0 0 0 2024-09-11T00:07:25.653 INFO:tasks.workunit.client.1.smithi203.stdout:7/635: dread - dd/d4d/fd8 zero size 2024-09-11T00:07:25.655 INFO:tasks.workunit.client.0.smithi111.stdout:7/702: unlink dd/d1d/d7e/dc8/l95 0 2024-09-11T00:07:25.659 INFO:tasks.workunit.client.0.smithi111.stdout:3/698: mknod d1c/d1d/d22/d31/d62/cf0 0 2024-09-11T00:07:25.669 INFO:tasks.workunit.client.0.smithi111.stdout:7/703: dwrite dd/d1d/d76/fa2 [0,4194304] 0 2024-09-11T00:07:25.670 INFO:tasks.workunit.client.1.smithi203.stdout:7/636: mknod dd/d1c/d52/d8f/d31/d58/ce4 0 2024-09-11T00:07:25.675 INFO:tasks.workunit.client.1.smithi203.stdout:3/722: dread d8/da/d11/f43 [0,4194304] 0 2024-09-11T00:07:25.681 INFO:tasks.workunit.client.0.smithi111.stdout:7/704: rmdir dd/d48/d69/dbe/dcb 0 2024-09-11T00:07:25.682 INFO:tasks.workunit.client.0.smithi111.stdout:7/705: stat dd/d1d/d1f/f50 0 2024-09-11T00:07:25.683 INFO:tasks.workunit.client.1.smithi203.stdout:7/637: read dd/d1c/d52/d8f/d31/d67/f79 [95941,83632] 0 2024-09-11T00:07:25.688 INFO:tasks.workunit.client.1.smithi203.stdout:7/638: symlink dd/d1c/d52/d8f/d31/d67/dc8/le5 0 2024-09-11T00:07:25.691 INFO:tasks.workunit.client.0.smithi111.stdout:5/708: link d10/d1e/l6a d10/d1e/d23/d30/d59/le5 0 2024-09-11T00:07:25.693 INFO:tasks.workunit.client.1.smithi203.stdout:7/639: mkdir dd/d1c/d52/d8f/d31/d58/d93/d98/db2/de6 0 2024-09-11T00:07:25.696 INFO:tasks.workunit.client.0.smithi111.stdout:5/709: write d10/d1e/d23/d30/dd8/d63/f6f [2033562,53753] 0 2024-09-11T00:07:25.697 INFO:tasks.workunit.client.1.smithi203.stdout:7/640: symlink dd/d1c/d52/d8f/le7 0 2024-09-11T00:07:25.697 INFO:tasks.workunit.client.0.smithi111.stdout:7/706: dwrite dd/d1d/d7e/dc8/fca [0,4194304] 0 2024-09-11T00:07:25.700 INFO:tasks.workunit.client.1.smithi203.stdout:7/641: mkdir dd/d1c/d4b/dbb/de8 0 2024-09-11T00:07:25.702 INFO:tasks.workunit.client.0.smithi111.stdout:5/710: mknod d10/d1e/d23/d2b/dad/ce6 0 2024-09-11T00:07:25.703 INFO:tasks.workunit.client.0.smithi111.stdout:7/707: readlink dd/d1d/d1f/l3b 0 2024-09-11T00:07:25.705 INFO:tasks.workunit.client.0.smithi111.stdout:5/711: readlink d10/d1e/d23/d30/d59/dd1/ld9 0 2024-09-11T00:07:25.706 INFO:tasks.workunit.client.0.smithi111.stdout:5/712: chown d10/d1e/d23/d30/d59/d7b/f73 118 1 2024-09-11T00:07:25.708 INFO:tasks.workunit.client.1.smithi203.stdout:7/642: fdatasync dd/d4d/d7f/f92 0 2024-09-11T00:07:25.709 INFO:tasks.workunit.client.0.smithi111.stdout:1/664: dwrite d2/de/d12/d3c/d4b/d6a/d63/f9d [0,4194304] 0 2024-09-11T00:07:25.712 INFO:tasks.workunit.client.1.smithi203.stdout:5/740: dwrite dc/dd/d15/dbd/fab [0,4194304] 0 2024-09-11T00:07:25.722 INFO:tasks.workunit.client.0.smithi111.stdout:1/665: rmdir d2/de/d12/dc7 39 2024-09-11T00:07:25.723 INFO:tasks.workunit.client.1.smithi203.stdout:4/555: mkdir db/dd/d16/d38/db4 0 2024-09-11T00:07:25.726 INFO:tasks.workunit.client.0.smithi111.stdout:5/713: symlink d10/d1e/d23/d2b/d92/db8/le7 0 2024-09-11T00:07:25.731 INFO:tasks.workunit.client.1.smithi203.stdout:8/609: truncate d1/d13/f19 792454 0 2024-09-11T00:07:25.731 INFO:tasks.workunit.client.0.smithi111.stdout:5/714: write d10/d1e/d23/d30/dd8/d7e/f5b [866241,121302] 0 2024-09-11T00:07:25.732 INFO:tasks.workunit.client.1.smithi203.stdout:7/643: write dd/d1c/d52/d8f/d31/d4a/f68 [4394585,50181] 0 2024-09-11T00:07:25.732 INFO:tasks.workunit.client.0.smithi111.stdout:7/708: getdents dd/d1d/d4d 0 2024-09-11T00:07:25.735 INFO:tasks.workunit.client.1.smithi203.stdout:4/556: mkdir db/dd/d26/d42/d5e/db5 0 2024-09-11T00:07:25.737 INFO:tasks.workunit.client.1.smithi203.stdout:9/628: symlink d6/de/d19/ld4 0 2024-09-11T00:07:25.739 INFO:tasks.workunit.client.1.smithi203.stdout:4/557: chown db/d12/d15/d2a/d88/f90 15 1 2024-09-11T00:07:25.740 INFO:tasks.workunit.client.0.smithi111.stdout:1/666: dwrite d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/f5b [0,4194304] 0 2024-09-11T00:07:25.741 INFO:tasks.workunit.client.0.smithi111.stdout:4/648: rename d18/d1f/fbe to d18/d20/d3c/d5e/daa/fc6 0 2024-09-11T00:07:25.745 INFO:tasks.workunit.client.1.smithi203.stdout:8/610: dread d1/d13/d17/d48/fc0 [0,4194304] 0 2024-09-11T00:07:25.745 INFO:tasks.workunit.client.1.smithi203.stdout:7/644: truncate dd/d1c/f21 3270235 0 2024-09-11T00:07:25.751 INFO:tasks.workunit.client.0.smithi111.stdout:3/699: rename d1c/d21/db4/lc4 to d1c/d1d/d22/d23/lf1 0 2024-09-11T00:07:25.755 INFO:tasks.workunit.client.0.smithi111.stdout:4/649: symlink d18/d20/d40/d78/d79/d90/lc7 0 2024-09-11T00:07:25.756 INFO:tasks.workunit.client.1.smithi203.stdout:4/558: mkdir db/dd/d16/d38/db6 0 2024-09-11T00:07:25.759 INFO:tasks.workunit.client.0.smithi111.stdout:9/736: unlink d6/db/d34/d37/fcc 0 2024-09-11T00:07:25.760 INFO:tasks.workunit.client.0.smithi111.stdout:1/667: creat d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/fdb x:0 0 0 2024-09-11T00:07:25.764 INFO:tasks.workunit.client.1.smithi203.stdout:9/629: dwrite d6/de/d19/d21/d87/fbb [0,4194304] 0 2024-09-11T00:07:25.768 INFO:tasks.workunit.client.0.smithi111.stdout:4/650: readlink d18/d20/d40/l4f 0 2024-09-11T00:07:25.771 INFO:tasks.workunit.client.1.smithi203.stdout:7/645: creat dd/fe9 x:0 0 0 2024-09-11T00:07:25.771 INFO:tasks.workunit.client.1.smithi203.stdout:8/611: mknod d1/d13/d17/d2f/d52/cca 0 2024-09-11T00:07:25.774 INFO:tasks.workunit.client.0.smithi111.stdout:3/700: mkdir d1c/d1d/d22/d23/d58/df2 0 2024-09-11T00:07:25.775 INFO:tasks.workunit.client.0.smithi111.stdout:6/644: symlink d7/d22/d3f/ld8 0 2024-09-11T00:07:25.777 INFO:tasks.workunit.client.0.smithi111.stdout:3/701: fdatasync d1c/d1d/d22/d31/f87 0 2024-09-11T00:07:25.778 INFO:tasks.workunit.client.0.smithi111.stdout:1/668: rename d2/de/d12/d3c/d4b/d6a/d3a/f92 to d2/de/d12/d3c/d4b/fdc 0 2024-09-11T00:07:25.779 INFO:tasks.workunit.client.1.smithi203.stdout:9/630: symlink d6/de/d19/d24/d54/ld5 0 2024-09-11T00:07:25.780 INFO:tasks.workunit.client.0.smithi111.stdout:7/709: getdents dd/d1d/d4b 0 2024-09-11T00:07:25.781 INFO:tasks.workunit.client.0.smithi111.stdout:7/710: chown dd/f63 10384 1 2024-09-11T00:07:25.783 INFO:tasks.workunit.client.1.smithi203.stdout:0/625: write d0/f89 [956562,117348] 0 2024-09-11T00:07:25.783 INFO:tasks.workunit.client.0.smithi111.stdout:9/737: dread d6/db/f83 [0,4194304] 0 2024-09-11T00:07:25.784 INFO:tasks.workunit.client.0.smithi111.stdout:4/651: rename d18/d39/f53 to d18/d39/fc8 0 2024-09-11T00:07:25.785 INFO:tasks.workunit.client.0.smithi111.stdout:9/738: stat d6/db/d34/d37/f7e 0 2024-09-11T00:07:25.786 INFO:tasks.workunit.client.1.smithi203.stdout:7/646: chown dd/d1c/d52/d8f/d31/d58/fbe 238353825 1 2024-09-11T00:07:25.788 INFO:tasks.workunit.client.1.smithi203.stdout:4/559: rmdir db/dd/d16/d38/db4 0 2024-09-11T00:07:25.791 INFO:tasks.workunit.client.0.smithi111.stdout:0/710: dwrite d3/d13/d1e/d29/f53 [0,4194304] 0 2024-09-11T00:07:25.796 INFO:tasks.workunit.client.1.smithi203.stdout:8/612: dwrite d1/d13/f1f [4194304,4194304] 0 2024-09-11T00:07:25.800 INFO:tasks.workunit.client.0.smithi111.stdout:7/711: symlink dd/d1d/d4b/dad/ldc 0 2024-09-11T00:07:25.800 INFO:tasks.workunit.client.0.smithi111.stdout:4/652: unlink d18/d3b/d9f/f88 0 2024-09-11T00:07:25.802 INFO:tasks.workunit.client.1.smithi203.stdout:8/613: dread - d1/d13/d17/d8b/fa8 zero size 2024-09-11T00:07:25.807 INFO:tasks.workunit.client.0.smithi111.stdout:3/702: dread d1c/d1d/d22/d23/d2f/de8/f3f [0,4194304] 0 2024-09-11T00:07:25.808 INFO:tasks.workunit.client.0.smithi111.stdout:0/711: dread - d3/d13/d1e/d29/d70/f9d zero size 2024-09-11T00:07:25.812 INFO:tasks.workunit.client.1.smithi203.stdout:6/660: rename d0/d5b/d5c/fd0 to d0/d5b/d9f/fd8 0 2024-09-11T00:07:25.812 INFO:tasks.workunit.client.1.smithi203.stdout:2/704: mknod d13/d15/d19/d1c/d76/ce8 0 2024-09-11T00:07:25.812 INFO:tasks.workunit.client.0.smithi111.stdout:8/713: dwrite d11/d23/d2c/d53/f5a [0,4194304] 0 2024-09-11T00:07:25.812 INFO:tasks.workunit.client.1.smithi203.stdout:0/626: dwrite d0/d2/d37/d5b/d73/fbf [0,4194304] 0 2024-09-11T00:07:25.814 INFO:tasks.workunit.client.1.smithi203.stdout:8/614: dread d1/d13/d22/d6f/f8a [0,4194304] 0 2024-09-11T00:07:25.814 INFO:tasks.workunit.client.0.smithi111.stdout:4/653: mknod d18/d1f/d36/d95/cc9 0 2024-09-11T00:07:25.815 INFO:tasks.workunit.client.0.smithi111.stdout:7/712: symlink dd/da6/ldd 0 2024-09-11T00:07:25.815 INFO:tasks.workunit.client.0.smithi111.stdout:6/645: link d7/d22/l2a d7/d22/d26/d87/d7a/ld9 0 2024-09-11T00:07:25.817 INFO:tasks.workunit.client.0.smithi111.stdout:9/739: link d6/db/d1b/le9 d6/dc/d73/led 0 2024-09-11T00:07:25.818 INFO:tasks.workunit.client.0.smithi111.stdout:6/646: chown d7/d22/d2c/d38/f71 15 1 2024-09-11T00:07:25.821 INFO:tasks.workunit.client.0.smithi111.stdout:3/703: creat d1c/d1d/d22/d23/d2f/de8/d5f/d98/ff3 x:0 0 0 2024-09-11T00:07:25.824 INFO:tasks.workunit.client.1.smithi203.stdout:0/627: mknod d0/d1d/d4c/cd3 0 2024-09-11T00:07:25.826 INFO:tasks.workunit.client.0.smithi111.stdout:8/714: unlink d11/d23/d7e/f97 0 2024-09-11T00:07:25.828 INFO:tasks.workunit.client.1.smithi203.stdout:6/661: mknod d0/d54/d9c/d35/d39/db2/cd9 0 2024-09-11T00:07:25.836 INFO:tasks.workunit.client.1.smithi203.stdout:2/705: mknod d13/d56/d69/ce9 0 2024-09-11T00:07:25.838 INFO:tasks.workunit.client.1.smithi203.stdout:1/751: dwrite d8/d19/d60/d90/d3e/d4b/d3a/f84 [0,4194304] 0 2024-09-11T00:07:25.841 INFO:tasks.workunit.client.0.smithi111.stdout:8/715: dwrite d11/d23/d2c/d53/fe5 [0,4194304] 0 2024-09-11T00:07:25.843 INFO:tasks.workunit.client.0.smithi111.stdout:2/654: unlink d0/f72 0 2024-09-11T00:07:25.847 INFO:tasks.workunit.client.1.smithi203.stdout:6/662: rmdir d0/d54/d9c/d7b/d7e 39 2024-09-11T00:07:25.848 INFO:tasks.workunit.client.0.smithi111.stdout:3/704: mknod d1c/d1d/d22/d44/d5a/dcd/cf4 0 2024-09-11T00:07:25.852 INFO:tasks.workunit.client.1.smithi203.stdout:2/706: stat d13/l84 0 2024-09-11T00:07:25.852 INFO:tasks.workunit.client.1.smithi203.stdout:6/663: fdatasync d0/d32/f43 0 2024-09-11T00:07:25.853 INFO:tasks.workunit.client.0.smithi111.stdout:0/712: dread d3/dc/fcb [0,4194304] 0 2024-09-11T00:07:25.853 INFO:tasks.workunit.client.1.smithi203.stdout:2/707: fdatasync d13/d95/daf/fd1 0 2024-09-11T00:07:25.854 INFO:tasks.workunit.client.0.smithi111.stdout:4/654: symlink d18/d1f/dc5/lca 0 2024-09-11T00:07:25.857 INFO:tasks.workunit.client.1.smithi203.stdout:3/723: write d8/da/d37/d83/db9/fcb [167847,58319] 0 2024-09-11T00:07:25.858 INFO:tasks.workunit.client.0.smithi111.stdout:6/647: fdatasync d7/f12 0 2024-09-11T00:07:25.859 INFO:tasks.workunit.client.1.smithi203.stdout:0/628: creat d0/d2/d7e/dd2/fd4 x:0 0 0 2024-09-11T00:07:25.862 INFO:tasks.workunit.client.1.smithi203.stdout:7/647: rename dd/d1c/d52/d8f/d31/d58/d93/d98/db2 to dd/d1c/d52/d8f/d31/d4a/d6e/dcc/dea 0 2024-09-11T00:07:25.867 INFO:tasks.workunit.client.0.smithi111.stdout:9/740: symlink d6/db/d34/db5/lee 0 2024-09-11T00:07:25.870 INFO:tasks.workunit.client.0.smithi111.stdout:7/713: link dd/d48/d69/dbe/fda dd/d1d/d2d/fde 0 2024-09-11T00:07:25.872 INFO:tasks.workunit.client.0.smithi111.stdout:7/714: dread - dd/d1d/d4b/d8f/d9f/fc7 zero size 2024-09-11T00:07:25.872 INFO:tasks.workunit.client.1.smithi203.stdout:3/724: mkdir d8/dce/d102 0 2024-09-11T00:07:25.879 INFO:tasks.workunit.client.0.smithi111.stdout:3/705: unlink d1c/fd9 0 2024-09-11T00:07:25.880 INFO:tasks.workunit.client.1.smithi203.stdout:6/664: dread d0/f23 [0,4194304] 0 2024-09-11T00:07:25.881 INFO:tasks.workunit.client.1.smithi203.stdout:2/708: dwrite d13/d15/f32 [8388608,4194304] 0 2024-09-11T00:07:25.882 INFO:tasks.workunit.client.1.smithi203.stdout:7/648: rename dd/l44 to dd/d1c/d52/leb 0 2024-09-11T00:07:25.883 INFO:tasks.workunit.client.0.smithi111.stdout:0/713: creat d3/dc/fff x:0 0 0 2024-09-11T00:07:25.884 INFO:tasks.workunit.client.1.smithi203.stdout:8/615: dread d1/d13/d17/f42 [0,4194304] 0 2024-09-11T00:07:25.886 INFO:tasks.workunit.client.0.smithi111.stdout:5/715: write d10/d1e/f28 [1981182,71760] 0 2024-09-11T00:07:25.886 INFO:tasks.workunit.client.1.smithi203.stdout:0/629: write d0/d2/f9c [1892814,101661] 0 2024-09-11T00:07:25.893 INFO:tasks.workunit.client.0.smithi111.stdout:6/648: symlink d7/d22/d3f/d74/d7f/d61/d6a/dba/lda 0 2024-09-11T00:07:25.896 INFO:tasks.workunit.client.0.smithi111.stdout:6/649: chown d7/d22/d3f/d74/d7f/d79/c86 216 1 2024-09-11T00:07:25.896 INFO:tasks.workunit.client.0.smithi111.stdout:9/741: chown d6/db/d1b/c26 39524722 1 2024-09-11T00:07:25.897 INFO:tasks.workunit.client.0.smithi111.stdout:9/742: chown d6/dc/l23 16678 1 2024-09-11T00:07:25.898 INFO:tasks.workunit.client.0.smithi111.stdout:8/716: mknod d11/d23/d2c/d46/d81/da5/ce6 0 2024-09-11T00:07:25.900 INFO:tasks.workunit.client.1.smithi203.stdout:7/649: dread - dd/fa7 zero size 2024-09-11T00:07:25.901 INFO:tasks.workunit.client.1.smithi203.stdout:6/665: write d0/d54/d9c/d7b/d7e/d94/fb0 [578638,11113] 0 2024-09-11T00:07:25.901 INFO:tasks.workunit.client.0.smithi111.stdout:5/716: dread d10/d1e/d23/d2b/d5c/fb7 [0,4194304] 0 2024-09-11T00:07:25.901 INFO:tasks.workunit.client.0.smithi111.stdout:7/715: write dd/f63 [3956452,45961] 0 2024-09-11T00:07:25.902 INFO:tasks.workunit.client.1.smithi203.stdout:8/616: fdatasync d1/d13/d17/d48/f53 0 2024-09-11T00:07:25.903 INFO:tasks.workunit.client.0.smithi111.stdout:5/717: chown d10/d1e/d23/d26/d3a/dc2/fde 57836 1 2024-09-11T00:07:25.904 INFO:tasks.workunit.client.1.smithi203.stdout:7/650: chown dd/d1c/d52/d8f/d31/d58/d93/d98/fb4 13122394 1 2024-09-11T00:07:25.904 INFO:tasks.workunit.client.0.smithi111.stdout:2/655: symlink d0/d3/de/d3b/d92/dc7/dd8/ldf 0 2024-09-11T00:07:25.906 INFO:tasks.workunit.client.0.smithi111.stdout:1/669: sync 2024-09-11T00:07:25.908 INFO:tasks.workunit.client.1.smithi203.stdout:3/725: mkdir d8/da/d37/d53/dea/de5/d103 0 2024-09-11T00:07:25.909 INFO:tasks.workunit.client.0.smithi111.stdout:1/670: chown d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/f71 499337 1 2024-09-11T00:07:25.909 INFO:tasks.workunit.client.0.smithi111.stdout:3/706: chown d1c/d1d/d22/d23/lf1 27602 1 2024-09-11T00:07:25.914 INFO:tasks.workunit.client.1.smithi203.stdout:9/631: write d6/de/d19/d21/f7b [1652216,15356] 0 2024-09-11T00:07:25.917 INFO:tasks.workunit.client.1.smithi203.stdout:8/617: creat d1/d13/d17/d8b/fcb x:0 0 0 2024-09-11T00:07:25.923 INFO:tasks.workunit.client.0.smithi111.stdout:8/717: rmdir d11/d23/d3d/dca/dcf/dc3 39 2024-09-11T00:07:25.927 INFO:tasks.workunit.client.1.smithi203.stdout:4/560: dwrite db/d12/d15/d2a/d88/faa [0,4194304] 0 2024-09-11T00:07:25.928 INFO:tasks.workunit.client.0.smithi111.stdout:5/718: creat d10/d1e/d23/d2b/d92/db8/fe8 x:0 0 0 2024-09-11T00:07:25.929 INFO:tasks.workunit.client.0.smithi111.stdout:6/650: dwrite d7/d2b/fae [0,4194304] 0 2024-09-11T00:07:25.933 INFO:tasks.workunit.client.1.smithi203.stdout:8/618: mknod d1/d13/d17/d2f/d52/ccc 0 2024-09-11T00:07:25.936 INFO:tasks.workunit.client.0.smithi111.stdout:2/656: rename d0/d3/d12/d38/l70 to d0/d3/d2e/le0 0 2024-09-11T00:07:25.936 INFO:tasks.workunit.client.0.smithi111.stdout:1/671: creat d2/de/d82/fdd x:0 0 0 2024-09-11T00:07:25.936 INFO:tasks.workunit.client.0.smithi111.stdout:0/714: symlink d3/daf/db2/l100 0 2024-09-11T00:07:25.937 INFO:tasks.workunit.client.1.smithi203.stdout:7/651: creat dd/d1c/d52/d8f/d31/d67/dc3/ddb/fec x:0 0 0 2024-09-11T00:07:25.939 INFO:tasks.workunit.client.0.smithi111.stdout:5/719: dread d10/d1e/d23/d2b/d92/fbc [0,4194304] 0 2024-09-11T00:07:25.943 INFO:tasks.workunit.client.0.smithi111.stdout:9/743: link d6/f88 d6/db/d1b/d56/dc8/fef 0 2024-09-11T00:07:25.945 INFO:tasks.workunit.client.0.smithi111.stdout:8/718: fsync d11/f9b 0 2024-09-11T00:07:25.947 INFO:tasks.workunit.client.1.smithi203.stdout:2/709: rename ca to d13/cea 0 2024-09-11T00:07:25.948 INFO:tasks.workunit.client.0.smithi111.stdout:7/716: mkdir dd/ddf 0 2024-09-11T00:07:25.950 INFO:tasks.workunit.client.0.smithi111.stdout:7/717: chown dd/d1d/d7e 639317967 1 2024-09-11T00:07:25.952 INFO:tasks.workunit.client.1.smithi203.stdout:4/561: fsync db/dd/d16/d38/d3c/d41/f46 0 2024-09-11T00:07:25.952 INFO:tasks.workunit.client.1.smithi203.stdout:1/752: dwrite d8/d9/f1c [8388608,4194304] 0 2024-09-11T00:07:25.954 INFO:tasks.workunit.client.0.smithi111.stdout:7/718: dread dd/d1d/d2d/d2e/f7a [0,4194304] 0 2024-09-11T00:07:25.958 INFO:tasks.workunit.client.0.smithi111.stdout:8/719: dwrite d11/d21/f70 [0,4194304] 0 2024-09-11T00:07:25.960 INFO:tasks.workunit.client.0.smithi111.stdout:6/651: symlink d7/d22/d26/d87/d41/d77/ldb 0 2024-09-11T00:07:25.961 INFO:tasks.workunit.client.0.smithi111.stdout:8/720: read d11/d23/d3d/f86 [480195,32662] 0 2024-09-11T00:07:25.964 INFO:tasks.workunit.client.1.smithi203.stdout:3/726: creat d8/da/f104 x:0 0 0 2024-09-11T00:07:25.965 INFO:tasks.workunit.client.0.smithi111.stdout:3/707: mkdir d1c/d1d/d22/d44/d5a/dcd/dd2/def/df5 0 2024-09-11T00:07:25.967 INFO:tasks.workunit.client.1.smithi203.stdout:2/710: dwrite f8 [0,4194304] 0 2024-09-11T00:07:25.967 INFO:tasks.workunit.client.0.smithi111.stdout:3/708: write d1c/d1d/d86/fd7 [801524,63743] 0 2024-09-11T00:07:25.968 INFO:tasks.workunit.client.0.smithi111.stdout:3/709: stat d1c/c38 0 2024-09-11T00:07:25.968 INFO:tasks.workunit.client.1.smithi203.stdout:3/727: readlink d8/da/d11/l7a 0 2024-09-11T00:07:25.972 INFO:tasks.workunit.client.0.smithi111.stdout:0/715: rmdir d3/d13/d1e/d29 39 2024-09-11T00:07:25.972 INFO:tasks.workunit.client.1.smithi203.stdout:8/619: rename d1/d13/d17/d2f/d52/d49/d68/fa3 to d1/d13/d3a/d4c/da6/fcd 0 2024-09-11T00:07:25.973 INFO:tasks.workunit.client.0.smithi111.stdout:0/716: fdatasync d3/d13/d66/ff5 0 2024-09-11T00:07:25.973 INFO:tasks.workunit.client.1.smithi203.stdout:3/728: write d8/da/d37/d83/d6a/dad/f100 [28671,50343] 0 2024-09-11T00:07:25.979 INFO:tasks.workunit.client.1.smithi203.stdout:4/562: stat db/ca0 0 2024-09-11T00:07:25.979 INFO:tasks.workunit.client.0.smithi111.stdout:1/672: rename d2/d77/la4 to d2/de/d12/d3c/d4b/d6a/lde 0 2024-09-11T00:07:25.983 INFO:tasks.workunit.client.1.smithi203.stdout:7/652: symlink dd/d1c/d52/d8f/d31/d4a/led 0 2024-09-11T00:07:25.984 INFO:tasks.workunit.client.0.smithi111.stdout:4/655: dwrite d18/d20/f23 [0,4194304] 0 2024-09-11T00:07:25.990 INFO:tasks.workunit.client.0.smithi111.stdout:9/744: truncate d6/db/d34/d37/f19 3308646 0 2024-09-11T00:07:25.996 INFO:tasks.workunit.client.0.smithi111.stdout:1/673: dwrite d2/de/f43 [0,4194304] 0 2024-09-11T00:07:25.997 INFO:tasks.workunit.client.0.smithi111.stdout:2/657: symlink d0/d3/d12/d52/le1 0 2024-09-11T00:07:26.000 INFO:tasks.workunit.client.0.smithi111.stdout:1/674: write d2/d2b/dc9/dba/fcb [210914,109956] 0 2024-09-11T00:07:26.002 INFO:tasks.workunit.client.0.smithi111.stdout:1/675: chown d2/de/d12/d3c/d4b/d6a/d63/fb7 9645281 1 2024-09-11T00:07:26.003 INFO:tasks.workunit.client.1.smithi203.stdout:6/666: write d0/d5b/f8f [754317,3665] 0 2024-09-11T00:07:26.004 INFO:tasks.workunit.client.1.smithi203.stdout:3/729: symlink d8/da/d37/d53/da2/l105 0 2024-09-11T00:07:26.007 INFO:tasks.workunit.client.1.smithi203.stdout:3/730: write d8/d17/fef [1029234,19963] 0 2024-09-11T00:07:26.007 INFO:tasks.workunit.client.0.smithi111.stdout:3/710: fdatasync d1c/d21/fa2 0 2024-09-11T00:07:26.008 INFO:tasks.workunit.client.1.smithi203.stdout:7/653: truncate dd/d1c/d52/d8f/d31/f62 6617709 0 2024-09-11T00:07:26.009 INFO:tasks.workunit.client.1.smithi203.stdout:2/711: dread d13/d95/daf/fd1 [0,4194304] 0 2024-09-11T00:07:26.012 INFO:tasks.workunit.client.0.smithi111.stdout:3/711: chown d1c/d1d/d22/d23/d2f/de8/fce 40 1 2024-09-11T00:07:26.015 INFO:tasks.workunit.client.1.smithi203.stdout:8/620: creat d1/d13/d43/d46/db0/fce x:0 0 0 2024-09-11T00:07:26.016 INFO:tasks.workunit.client.0.smithi111.stdout:0/717: dread d3/fd [0,4194304] 0 2024-09-11T00:07:26.016 INFO:tasks.workunit.client.0.smithi111.stdout:6/652: rename d7/d22/d26/d87/fc8 to d7/d22/d26/d95/fdc 0 2024-09-11T00:07:26.018 INFO:tasks.workunit.client.0.smithi111.stdout:5/720: mknod d10/d1e/d23/d30/d59/d52/dd6/ce9 0 2024-09-11T00:07:26.020 INFO:tasks.workunit.client.0.smithi111.stdout:1/676: dwrite d2/fd [0,4194304] 0 2024-09-11T00:07:26.022 INFO:tasks.workunit.client.1.smithi203.stdout:4/563: dread db/f7e [0,4194304] 0 2024-09-11T00:07:26.023 INFO:tasks.workunit.client.1.smithi203.stdout:0/630: dwrite d0/d2/d3d/d5a/f7c [0,4194304] 0 2024-09-11T00:07:26.030 INFO:tasks.workunit.client.1.smithi203.stdout:1/753: rename d8/d19/d60/d90/d3e/d4b/d80/d8d/lec to d8/d19/d60/d90/d3e/l108 0 2024-09-11T00:07:26.036 INFO:tasks.workunit.client.0.smithi111.stdout:9/745: read d6/db/d1b/d41/d80/fbb [3801949,12198] 0 2024-09-11T00:07:26.037 INFO:tasks.workunit.client.1.smithi203.stdout:2/712: write d13/d15/d19/d1c/d76/f8e [734437,9120] 0 2024-09-11T00:07:26.038 INFO:tasks.workunit.client.1.smithi203.stdout:9/632: write d6/de/d19/d24/d40/fb9 [808344,67646] 0 2024-09-11T00:07:26.043 INFO:tasks.workunit.client.1.smithi203.stdout:6/667: symlink d0/lda 0 2024-09-11T00:07:26.045 INFO:tasks.workunit.client.0.smithi111.stdout:2/658: dread d0/d3/d12/f3a [0,4194304] 0 2024-09-11T00:07:26.048 INFO:tasks.workunit.client.0.smithi111.stdout:8/721: creat d11/d23/d2c/d7f/dde/fe7 x:0 0 0 2024-09-11T00:07:26.051 INFO:tasks.workunit.client.1.smithi203.stdout:0/631: dwrite d0/d2/d37/f3b [0,4194304] 0 2024-09-11T00:07:26.056 INFO:tasks.workunit.client.1.smithi203.stdout:4/564: dwrite db/dd/d16/d38/d3c/d41/fae [0,4194304] 0 2024-09-11T00:07:26.057 INFO:tasks.workunit.client.1.smithi203.stdout:4/565: write db/d12/fad [235716,89987] 0 2024-09-11T00:07:26.062 INFO:tasks.workunit.client.1.smithi203.stdout:4/566: chown db/c56 1809999590 1 2024-09-11T00:07:26.066 INFO:tasks.workunit.client.1.smithi203.stdout:4/567: chown db/d12/f7d 209386541 1 2024-09-11T00:07:26.068 INFO:tasks.workunit.client.0.smithi111.stdout:3/712: rename d1c/d1d/d22/d44/d5a/dcd/cf4 to d1c/d1d/d22/d23/d2f/de8/cf6 0 2024-09-11T00:07:26.075 INFO:tasks.workunit.client.1.smithi203.stdout:9/633: mknod d6/de/d47/dc3/cd6 0 2024-09-11T00:07:26.080 INFO:tasks.workunit.client.1.smithi203.stdout:9/634: write d6/de/d19/d24/fb0 [852357,95948] 0 2024-09-11T00:07:26.084 INFO:tasks.workunit.client.0.smithi111.stdout:2/659: mkdir d0/d3/de/d3b/d92/dc7/de2 0 2024-09-11T00:07:26.086 INFO:tasks.workunit.client.0.smithi111.stdout:4/656: dwrite f15 [4194304,4194304] 0 2024-09-11T00:07:26.086 INFO:tasks.workunit.client.0.smithi111.stdout:2/660: write d0/d3/f36 [4082462,83585] 0 2024-09-11T00:07:26.087 INFO:tasks.workunit.client.0.smithi111.stdout:7/719: dwrite dd/d1d/d2d/f89 [0,4194304] 0 2024-09-11T00:07:26.088 INFO:tasks.workunit.client.1.smithi203.stdout:7/654: dwrite dd/d4d/f5a [0,4194304] 0 2024-09-11T00:07:26.091 INFO:tasks.workunit.client.1.smithi203.stdout:8/621: dread d1/d13/d17/d2f/d52/d49/f93 [0,4194304] 0 2024-09-11T00:07:26.091 INFO:tasks.workunit.client.0.smithi111.stdout:8/722: fsync d11/d21/d6f/dab/fb1 0 2024-09-11T00:07:26.095 INFO:tasks.workunit.client.1.smithi203.stdout:2/713: fdatasync d13/d47/f86 0 2024-09-11T00:07:26.100 INFO:tasks.workunit.client.1.smithi203.stdout:1/754: write d8/d11/f51 [6294250,17703] 0 2024-09-11T00:07:26.103 INFO:tasks.workunit.client.1.smithi203.stdout:8/622: mkdir d1/d13/d43/d46/db0/dcf 0 2024-09-11T00:07:26.107 INFO:tasks.workunit.client.1.smithi203.stdout:0/632: write d0/d2/d37/d5b/f5e [344906,2586] 0 2024-09-11T00:07:26.108 INFO:tasks.workunit.client.0.smithi111.stdout:5/721: dwrite d10/d1e/d23/d2b/dad/fca [0,4194304] 0 2024-09-11T00:07:26.109 INFO:tasks.workunit.client.1.smithi203.stdout:6/668: dwrite d0/d54/d9c/d35/d38/d73/d74/fa7 [0,4194304] 0 2024-09-11T00:07:26.114 INFO:tasks.workunit.client.1.smithi203.stdout:5/741: sync 2024-09-11T00:07:26.121 INFO:tasks.workunit.client.1.smithi203.stdout:2/714: mknod d13/d56/ceb 0 2024-09-11T00:07:26.125 INFO:tasks.workunit.client.1.smithi203.stdout:3/731: dwrite d8/da/d5c/fa0 [0,4194304] 0 2024-09-11T00:07:26.126 INFO:tasks.workunit.client.1.smithi203.stdout:2/715: fsync d13/d15/f1b 0 2024-09-11T00:07:26.127 INFO:tasks.workunit.client.1.smithi203.stdout:1/755: rename d8/d19/d60/d90/d3e/d4b/d41/ld0 to d8/d9/d15/d35/d81/db9/dce/d106/l109 0 2024-09-11T00:07:26.130 INFO:tasks.workunit.client.1.smithi203.stdout:9/635: dwrite d6/de/d47/f61 [0,4194304] 0 2024-09-11T00:07:26.133 INFO:tasks.workunit.client.1.smithi203.stdout:6/669: unlink d0/d54/d9c/d7b/fd4 0 2024-09-11T00:07:26.136 INFO:tasks.workunit.client.1.smithi203.stdout:3/732: readlink d8/da/d37/d83/da3/lbb 0 2024-09-11T00:07:26.136 INFO:tasks.workunit.client.1.smithi203.stdout:4/568: getdents db/dd/d16/d38/d3c/da6 0 2024-09-11T00:07:26.137 INFO:tasks.workunit.client.1.smithi203.stdout:7/655: link dd/d1c/f2b dd/d1c/d52/d8f/d31/d67/dc3/ddb/fee 0 2024-09-11T00:07:26.140 INFO:tasks.workunit.client.0.smithi111.stdout:1/677: rename d2/fb5 to d2/de/d12/d3c/d4b/d6a/d63/d95/fdf 0 2024-09-11T00:07:26.141 INFO:tasks.workunit.client.1.smithi203.stdout:0/633: mkdir d0/d87/db9/dd5 0 2024-09-11T00:07:26.143 INFO:tasks.workunit.client.1.smithi203.stdout:8/623: dwrite d1/d13/d17/f42 [0,4194304] 0 2024-09-11T00:07:26.150 INFO:tasks.workunit.client.0.smithi111.stdout:0/718: creat d3/d13/d1e/d29/db0/f101 x:0 0 0 2024-09-11T00:07:26.152 INFO:tasks.workunit.client.0.smithi111.stdout:6/653: symlink d7/d22/d3f/d74/d7f/d61/d6a/d9f/db6/ldd 0 2024-09-11T00:07:26.156 INFO:tasks.workunit.client.0.smithi111.stdout:6/654: readlink d7/d22/d1d/l90 0 2024-09-11T00:07:26.157 INFO:tasks.workunit.client.1.smithi203.stdout:2/716: fdatasync d13/d95/f9a 0 2024-09-11T00:07:26.159 INFO:tasks.workunit.client.0.smithi111.stdout:4/657: fsync d18/d1f/d33/f59 0 2024-09-11T00:07:26.159 INFO:tasks.workunit.client.0.smithi111.stdout:6/655: fsync d7/d22/d3f/d74/f9e 0 2024-09-11T00:07:26.162 INFO:tasks.workunit.client.0.smithi111.stdout:4/658: write d18/fb3 [293768,83792] 0 2024-09-11T00:07:26.163 INFO:tasks.workunit.client.1.smithi203.stdout:7/656: rename dd/d3b/fd6 to dd/d4d/fef 0 2024-09-11T00:07:26.166 INFO:tasks.workunit.client.0.smithi111.stdout:4/659: chown d18/d20/d40/d78/d79/d90 813 1 2024-09-11T00:07:26.173 INFO:tasks.workunit.client.1.smithi203.stdout:9/636: dwrite d6/de/d32/d52/d55/d66/daa/fae [0,4194304] 0 2024-09-11T00:07:26.173 INFO:tasks.workunit.client.1.smithi203.stdout:6/670: dread d0/f63 [0,4194304] 0 2024-09-11T00:07:26.175 INFO:tasks.workunit.client.1.smithi203.stdout:4/569: dread db/d12/f37 [0,4194304] 0 2024-09-11T00:07:26.176 INFO:tasks.workunit.client.1.smithi203.stdout:6/671: dread - d0/d5b/d5c/fa8 zero size 2024-09-11T00:07:26.177 INFO:tasks.workunit.client.0.smithi111.stdout:5/722: mkdir d10/d1e/d23/d26/d3a/dea 0 2024-09-11T00:07:26.180 INFO:tasks.workunit.client.0.smithi111.stdout:4/660: dread d18/d39/f66 [0,4194304] 0 2024-09-11T00:07:26.184 INFO:tasks.workunit.client.0.smithi111.stdout:4/661: fsync d18/d20/d4a/f3f 0 2024-09-11T00:07:26.186 INFO:tasks.workunit.client.0.smithi111.stdout:4/662: stat d18/d20/d40/d78/d79/d90 0 2024-09-11T00:07:26.187 INFO:tasks.workunit.client.0.smithi111.stdout:3/713: write d1c/d1d/d22/d23/d58/d5c/f6d [284227,7097] 0 2024-09-11T00:07:26.188 INFO:tasks.workunit.client.0.smithi111.stdout:7/720: dread dd/da6/faa [0,4194304] 0 2024-09-11T00:07:26.190 INFO:tasks.workunit.client.0.smithi111.stdout:9/746: rename d6/d52/ddc to d6/d52/d8a/df0 0 2024-09-11T00:07:26.191 INFO:tasks.workunit.client.0.smithi111.stdout:7/721: write dd/f63 [299837,1376] 0 2024-09-11T00:07:26.191 INFO:tasks.workunit.client.0.smithi111.stdout:3/714: write d1c/d1d/d22/d44/d5a/f69 [1922829,46000] 0 2024-09-11T00:07:26.194 INFO:tasks.workunit.client.0.smithi111.stdout:7/722: dread - dd/d1d/d76/fa3 zero size 2024-09-11T00:07:26.199 INFO:tasks.workunit.client.0.smithi111.stdout:6/656: mknod d7/d22/d26/d87/d41/d77/cde 0 2024-09-11T00:07:26.199 INFO:tasks.workunit.client.1.smithi203.stdout:4/570: mknod db/dd/d16/d38/d3c/cb7 0 2024-09-11T00:07:26.201 INFO:tasks.workunit.client.0.smithi111.stdout:8/723: unlink d11/c16 0 2024-09-11T00:07:26.202 INFO:tasks.workunit.client.1.smithi203.stdout:3/733: creat d8/da/d5c/f106 x:0 0 0 2024-09-11T00:07:26.204 INFO:tasks.workunit.client.1.smithi203.stdout:1/756: creat d8/f10a x:0 0 0 2024-09-11T00:07:26.205 INFO:tasks.workunit.client.1.smithi203.stdout:1/757: stat d8/d9/d15/d35/d81/da1/cb1 0 2024-09-11T00:07:26.206 INFO:tasks.workunit.client.1.smithi203.stdout:0/634: rename d0/d2/la9 to d0/d1d/d5d/ld6 0 2024-09-11T00:07:26.206 INFO:tasks.workunit.client.0.smithi111.stdout:5/723: dwrite d10/d1e/d23/d2b/fa0 [0,4194304] 0 2024-09-11T00:07:26.207 INFO:tasks.workunit.client.1.smithi203.stdout:7/657: mknod dd/d1c/d52/d8f/cf0 0 2024-09-11T00:07:26.208 INFO:tasks.workunit.client.1.smithi203.stdout:0/635: write d0/d2/d3d/d5a/f7c [3412526,43766] 0 2024-09-11T00:07:26.209 INFO:tasks.workunit.client.0.smithi111.stdout:4/663: creat d18/d20/d40/d78/fcb x:0 0 0 2024-09-11T00:07:26.209 INFO:tasks.workunit.client.0.smithi111.stdout:2/661: dwrite d0/d3/de/f1f [0,4194304] 0 2024-09-11T00:07:26.210 INFO:tasks.workunit.client.1.smithi203.stdout:5/742: link dc/dd/d1e/dc6/ld2 dc/dd/df4/lfa 0 2024-09-11T00:07:26.211 INFO:tasks.workunit.client.1.smithi203.stdout:2/717: fsync d13/d22/fbd 0 2024-09-11T00:07:26.211 INFO:tasks.workunit.client.0.smithi111.stdout:2/662: stat d0/d3/f93 0 2024-09-11T00:07:26.214 INFO:tasks.workunit.client.1.smithi203.stdout:2/718: write d13/d22/f6f [229903,58321] 0 2024-09-11T00:07:26.215 INFO:tasks.workunit.client.0.smithi111.stdout:2/663: truncate d0/d83/fcd 83029 0 2024-09-11T00:07:26.219 INFO:tasks.workunit.client.0.smithi111.stdout:2/664: dread - d0/d3/de/d3b/d62/d6d/da1/fd1 zero size 2024-09-11T00:07:26.222 INFO:tasks.workunit.client.0.smithi111.stdout:2/665: write d0/d3/f36 [439423,96845] 0 2024-09-11T00:07:26.222 INFO:tasks.workunit.client.0.smithi111.stdout:0/719: mkdir d3/d13/d1e/deb/d61/d93/d102 0 2024-09-11T00:07:26.226 INFO:tasks.workunit.client.0.smithi111.stdout:1/678: rename d2/de/d82/f96 to d2/de/d12/d3c/d4b/d6a/d63/d73/fe0 0 2024-09-11T00:07:26.227 INFO:tasks.workunit.client.1.smithi203.stdout:6/672: rename d0/d54/d9c/d35/d38/d7d to d0/d54/d9c/d35/d38/dc0/ddb 0 2024-09-11T00:07:26.232 INFO:tasks.workunit.client.1.smithi203.stdout:6/673: chown d0/d54/d9c/d35/d39/d3c/c41 2613624 1 2024-09-11T00:07:26.234 INFO:tasks.workunit.client.1.smithi203.stdout:1/758: mknod d8/d9/d15/d35/d81/c10b 0 2024-09-11T00:07:26.236 INFO:tasks.workunit.client.0.smithi111.stdout:3/715: unlink d1c/d1d/d22/d23/d2f/d63/d7e/fdd 0 2024-09-11T00:07:26.239 INFO:tasks.workunit.client.0.smithi111.stdout:6/657: creat d7/d22/d1d/d69/db4/fdf x:0 0 0 2024-09-11T00:07:26.240 INFO:tasks.workunit.client.1.smithi203.stdout:0/636: write d0/d2/f51 [32054,11571] 0 2024-09-11T00:07:26.242 INFO:tasks.workunit.client.1.smithi203.stdout:5/743: mknod dc/d2b/cfb 0 2024-09-11T00:07:26.242 INFO:tasks.workunit.client.1.smithi203.stdout:0/637: chown d0/d2/d37/d5b/f79 831 1 2024-09-11T00:07:26.246 INFO:tasks.workunit.client.0.smithi111.stdout:9/747: fsync d6/f3b 0 2024-09-11T00:07:26.248 INFO:tasks.workunit.client.0.smithi111.stdout:5/724: dread d10/d1e/d23/d26/d3a/d98/f77 [0,4194304] 0 2024-09-11T00:07:26.251 INFO:tasks.workunit.client.1.smithi203.stdout:2/719: mkdir d13/d95/daf/dec 0 2024-09-11T00:07:26.251 INFO:tasks.workunit.client.1.smithi203.stdout:4/571: dwrite f1 [4194304,4194304] 0 2024-09-11T00:07:26.252 INFO:tasks.workunit.client.1.smithi203.stdout:1/759: dwrite d8/d19/d60/d90/f104 [0,4194304] 0 2024-09-11T00:07:26.256 INFO:tasks.workunit.client.1.smithi203.stdout:1/760: chown d8/d19/d31/c89 1767576 1 2024-09-11T00:07:26.256 INFO:tasks.workunit.client.1.smithi203.stdout:2/720: read d13/d15/d30/d5a/dac/fe3 [1951645,95443] 0 2024-09-11T00:07:26.259 INFO:tasks.workunit.client.1.smithi203.stdout:2/721: write d13/d22/f4a [4222878,90279] 0 2024-09-11T00:07:26.260 INFO:tasks.workunit.client.0.smithi111.stdout:2/666: dwrite d0/d3/de/f21 [0,4194304] 0 2024-09-11T00:07:26.261 INFO:tasks.workunit.client.1.smithi203.stdout:2/722: chown d13/d15/d30/c79 3 1 2024-09-11T00:07:26.264 INFO:tasks.workunit.client.0.smithi111.stdout:0/720: mkdir d3/d13/d1e/d29/db0/dce/d103 0 2024-09-11T00:07:26.265 INFO:tasks.workunit.client.0.smithi111.stdout:7/723: rename dd/d1d/d4d/d82/fc0 to dd/d1d/d4b/dad/fe0 0 2024-09-11T00:07:26.267 INFO:tasks.workunit.client.0.smithi111.stdout:6/658: dwrite f1 [4194304,4194304] 0 2024-09-11T00:07:26.274 INFO:tasks.workunit.client.1.smithi203.stdout:0/638: dread - d0/d2/d37/f53 zero size 2024-09-11T00:07:26.275 INFO:tasks.workunit.client.0.smithi111.stdout:4/664: mknod d18/d20/d40/d78/d79/db0/ccc 0 2024-09-11T00:07:26.277 INFO:tasks.workunit.client.1.smithi203.stdout:9/637: getdents d6/de/d32/d52/d55/da2 0 2024-09-11T00:07:26.278 INFO:tasks.workunit.client.0.smithi111.stdout:4/665: dread - d18/d1f/d36/d95/fa3 zero size 2024-09-11T00:07:26.278 INFO:tasks.workunit.client.1.smithi203.stdout:4/572: dread db/f10 [0,4194304] 0 2024-09-11T00:07:26.278 INFO:tasks.workunit.client.0.smithi111.stdout:3/716: dread d1c/d1d/d22/f5b [0,4194304] 0 2024-09-11T00:07:26.280 INFO:tasks.workunit.client.1.smithi203.stdout:4/573: chown db/l1f 128303280 1 2024-09-11T00:07:26.281 INFO:tasks.workunit.client.0.smithi111.stdout:4/666: fsync d18/d20/d3c/f9a 0 2024-09-11T00:07:26.283 INFO:tasks.workunit.client.1.smithi203.stdout:9/638: dread d6/de/d19/d24/d6c/f75 [0,4194304] 0 2024-09-11T00:07:26.284 INFO:tasks.workunit.client.1.smithi203.stdout:3/734: creat d8/da/d37/d83/f107 x:0 0 0 2024-09-11T00:07:26.284 INFO:tasks.workunit.client.0.smithi111.stdout:0/721: dread d3/fd [0,4194304] 0 2024-09-11T00:07:26.288 INFO:tasks.workunit.client.0.smithi111.stdout:7/724: creat dd/d48/d69/fe1 x:0 0 0 2024-09-11T00:07:26.290 INFO:tasks.workunit.client.1.smithi203.stdout:6/674: mkdir d0/d54/d9c/d7b/ddc 0 2024-09-11T00:07:26.290 INFO:tasks.workunit.client.1.smithi203.stdout:6/675: readlink d0/d71/lb5 0 2024-09-11T00:07:26.291 INFO:tasks.workunit.client.1.smithi203.stdout:7/658: creat dd/d1c/d7c/ff1 x:0 0 0 2024-09-11T00:07:26.292 INFO:tasks.workunit.client.0.smithi111.stdout:5/725: symlink d10/d1e/d23/leb 0 2024-09-11T00:07:26.293 INFO:tasks.workunit.client.1.smithi203.stdout:0/639: mknod d0/d2/d3d/d5a/cd7 0 2024-09-11T00:07:26.293 INFO:tasks.workunit.client.1.smithi203.stdout:5/744: dwrite dc/dd/d13/f48 [0,4194304] 0 2024-09-11T00:07:26.294 INFO:tasks.workunit.client.1.smithi203.stdout:7/659: chown dd/f14 493 1 2024-09-11T00:07:26.296 INFO:tasks.workunit.client.0.smithi111.stdout:5/726: dread d10/d1e/d23/d26/d78/d7a/f83 [0,4194304] 0 2024-09-11T00:07:26.297 INFO:tasks.workunit.client.0.smithi111.stdout:3/717: creat d1c/d1d/dac/ff7 x:0 0 0 2024-09-11T00:07:26.299 INFO:tasks.workunit.client.1.smithi203.stdout:4/574: creat db/dd/d26/d42/d5e/fb8 x:0 0 0 2024-09-11T00:07:26.299 INFO:tasks.workunit.client.0.smithi111.stdout:9/748: mknod d6/db/d34/d37/d4c/d7f/d97/de8/cf1 0 2024-09-11T00:07:26.302 INFO:tasks.workunit.client.0.smithi111.stdout:4/667: mknod d18/d20/d3c/d5e/daa/ccd 0 2024-09-11T00:07:26.305 INFO:tasks.workunit.client.1.smithi203.stdout:3/735: unlink d8/fd2 0 2024-09-11T00:07:26.308 INFO:tasks.workunit.client.0.smithi111.stdout:6/659: mkdir d7/d22/d26/d87/d41/de0 0 2024-09-11T00:07:26.308 INFO:tasks.workunit.client.0.smithi111.stdout:4/668: dread d18/d20/d40/fc4 [0,4194304] 0 2024-09-11T00:07:26.309 INFO:tasks.workunit.client.1.smithi203.stdout:2/723: creat d13/d15/d30/d5a/dcf/fed x:0 0 0 2024-09-11T00:07:26.310 INFO:tasks.workunit.client.1.smithi203.stdout:2/724: read d13/d15/f1b [1425270,61323] 0 2024-09-11T00:07:26.312 INFO:tasks.workunit.client.1.smithi203.stdout:6/676: mkdir d0/d32/d5a/ddd 0 2024-09-11T00:07:26.313 INFO:tasks.workunit.client.0.smithi111.stdout:1/679: getdents d2/de/d12 0 2024-09-11T00:07:26.313 INFO:tasks.workunit.client.1.smithi203.stdout:0/640: mknod d0/d2/d3d/d5a/cd8 0 2024-09-11T00:07:26.315 INFO:tasks.workunit.client.1.smithi203.stdout:0/641: fdatasync d0/fc6 0 2024-09-11T00:07:26.318 INFO:tasks.workunit.client.0.smithi111.stdout:3/718: mknod d1c/d1d/d86/cf8 0 2024-09-11T00:07:26.319 INFO:tasks.workunit.client.1.smithi203.stdout:7/660: rmdir dd/d1c/d52/d8f/d31/d58/d93/d98 39 2024-09-11T00:07:26.321 INFO:tasks.workunit.client.0.smithi111.stdout:9/749: fdatasync d6/db/d1b/d74/f98 0 2024-09-11T00:07:26.326 INFO:tasks.workunit.client.0.smithi111.stdout:9/750: write d6/db/d34/d37/d4c/d7f/d97/fb3 [283073,86757] 0 2024-09-11T00:07:26.327 INFO:tasks.workunit.client.1.smithi203.stdout:2/725: creat d13/d15/d19/d1c/d73/dc4/fee x:0 0 0 2024-09-11T00:07:26.328 INFO:tasks.workunit.client.0.smithi111.stdout:5/727: dread d10/d1e/d23/d30/d3c/f4e [0,4194304] 0 2024-09-11T00:07:26.333 INFO:tasks.workunit.client.1.smithi203.stdout:1/761: truncate d8/d19/d60/d90/f53 3848260 0 2024-09-11T00:07:26.334 INFO:tasks.workunit.client.0.smithi111.stdout:1/680: dwrite d2/de/d12/d3c/d4b/d6a/f59 [0,4194304] 0 2024-09-11T00:07:26.334 INFO:tasks.workunit.client.0.smithi111.stdout:6/660: rename d7/d22/d26/d87/l40 to d7/d22/d26/d87/d7a/le1 0 2024-09-11T00:07:26.335 INFO:tasks.workunit.client.1.smithi203.stdout:1/762: chown d8/d19/d31/l7c 25 1 2024-09-11T00:07:26.339 INFO:tasks.workunit.client.0.smithi111.stdout:6/661: chown d7/d22/d2c/f37 6985 1 2024-09-11T00:07:26.339 INFO:tasks.workunit.client.0.smithi111.stdout:0/722: write d3/d13/d1e/deb/d61/d93/fa1 [2425120,100713] 0 2024-09-11T00:07:26.339 INFO:tasks.workunit.client.1.smithi203.stdout:6/677: rename d0/d5b/d5c/d6f/fbc to d0/d5b/d9f/dbe/fde 0 2024-09-11T00:07:26.344 INFO:tasks.workunit.client.1.smithi203.stdout:7/661: fsync dd/d1c/d52/d8f/d31/d4a/f86 0 2024-09-11T00:07:26.345 INFO:tasks.workunit.client.0.smithi111.stdout:7/725: write dd/d1d/d7e/dc8/f64 [1865573,26609] 0 2024-09-11T00:07:26.347 INFO:tasks.workunit.client.1.smithi203.stdout:7/662: chown dd/d1c/d52/ce0 38 1 2024-09-11T00:07:26.348 INFO:tasks.workunit.client.1.smithi203.stdout:7/663: chown dd/d1c/d7c/d8c 654224 1 2024-09-11T00:07:26.348 INFO:tasks.workunit.client.0.smithi111.stdout:7/726: dread - dd/d1d/d4b/d8f/d9f/fc7 zero size 2024-09-11T00:07:26.349 INFO:tasks.workunit.client.1.smithi203.stdout:9/639: dwrite d6/de/d19/f1b [0,4194304] 0 2024-09-11T00:07:26.350 INFO:tasks.workunit.client.0.smithi111.stdout:9/751: unlink d6/db/db8/feb 0 2024-09-11T00:07:26.352 INFO:tasks.workunit.client.0.smithi111.stdout:7/727: write dd/d1d/f39 [1902635,84804] 0 2024-09-11T00:07:26.352 INFO:tasks.workunit.client.0.smithi111.stdout:9/752: stat d6/d52/d8a/d92/lcd 0 2024-09-11T00:07:26.361 INFO:tasks.workunit.client.0.smithi111.stdout:1/681: chown d2/de/d12/d3c/d4b/fdc 15077 1 2024-09-11T00:07:26.365 INFO:tasks.workunit.client.0.smithi111.stdout:6/662: mknod d7/d22/d3f/d74/d7f/d79/ce2 0 2024-09-11T00:07:26.367 INFO:tasks.workunit.client.1.smithi203.stdout:5/745: dwrite dc/dd/d13/f3e [0,4194304] 0 2024-09-11T00:07:26.369 INFO:tasks.workunit.client.0.smithi111.stdout:0/723: dread d3/daf/db2/ff4 [0,4194304] 0 2024-09-11T00:07:26.370 INFO:tasks.workunit.client.1.smithi203.stdout:2/726: rename d13/d15/d30/d59/f7b to d13/d15/d30/d5a/fef 0 2024-09-11T00:07:26.370 INFO:tasks.workunit.client.1.smithi203.stdout:4/575: dwrite db/d12/f1e [0,4194304] 0 2024-09-11T00:07:26.372 INFO:tasks.workunit.client.1.smithi203.stdout:0/642: creat d0/d2/d92/fd9 x:0 0 0 2024-09-11T00:07:26.373 INFO:tasks.workunit.client.0.smithi111.stdout:0/724: write d3/d1c/f42 [903313,128248] 0 2024-09-11T00:07:26.377 INFO:tasks.workunit.client.0.smithi111.stdout:3/719: dwrite d1c/d1d/d22/d23/d2f/de8/d5f/fb2 [0,4194304] 0 2024-09-11T00:07:26.381 INFO:tasks.workunit.client.1.smithi203.stdout:3/736: creat d8/da/d37/d53/f108 x:0 0 0 2024-09-11T00:07:26.383 INFO:tasks.workunit.client.1.smithi203.stdout:7/664: creat dd/d1c/d52/d8f/d31/d4a/d6e/ff2 x:0 0 0 2024-09-11T00:07:26.383 INFO:tasks.workunit.client.1.smithi203.stdout:9/640: truncate d6/de/d19/d24/d54/f9c 206685 0 2024-09-11T00:07:26.384 INFO:tasks.workunit.client.0.smithi111.stdout:1/682: dread d2/d2b/f3e [0,4194304] 0 2024-09-11T00:07:26.386 INFO:tasks.workunit.client.0.smithi111.stdout:1/683: read d2/de/f43 [2179407,16544] 0 2024-09-11T00:07:26.387 INFO:tasks.workunit.client.0.smithi111.stdout:4/669: getdents d18/d20/d40/d78/d79 0 2024-09-11T00:07:26.388 INFO:tasks.workunit.client.0.smithi111.stdout:3/720: symlink d1c/d1d/d86/lf9 0 2024-09-11T00:07:26.391 INFO:tasks.workunit.client.1.smithi203.stdout:2/727: creat d13/d15/d19/d1c/d76/d94/d97/ff0 x:0 0 0 2024-09-11T00:07:26.392 INFO:tasks.workunit.client.1.smithi203.stdout:1/763: dwrite d8/f49 [4194304,4194304] 0 2024-09-11T00:07:26.393 INFO:tasks.workunit.client.0.smithi111.stdout:4/670: truncate d18/d1f/d36/d95/f9c 1643399 0 2024-09-11T00:07:26.394 INFO:tasks.workunit.client.0.smithi111.stdout:9/753: dread d6/db/f6d [0,4194304] 0 2024-09-11T00:07:26.403 INFO:tasks.workunit.client.0.smithi111.stdout:6/663: symlink d7/d22/d3f/d74/le3 0 2024-09-11T00:07:26.407 INFO:tasks.workunit.client.0.smithi111.stdout:0/725: mknod d3/daf/c104 0 2024-09-11T00:07:26.408 INFO:tasks.workunit.client.0.smithi111.stdout:1/684: mknod d2/dad/ce1 0 2024-09-11T00:07:26.413 INFO:tasks.workunit.client.1.smithi203.stdout:1/764: dread - d8/d19/d60/d90/d3e/d4b/d80/da2/fdf zero size 2024-09-11T00:07:26.413 INFO:tasks.workunit.client.1.smithi203.stdout:9/641: creat d6/de/d32/d52/d55/d66/d80/fd7 x:0 0 0 2024-09-11T00:07:26.414 INFO:tasks.workunit.client.0.smithi111.stdout:3/721: symlink d1c/d21/dae/lfa 0 2024-09-11T00:07:26.415 INFO:tasks.workunit.client.1.smithi203.stdout:0/643: dwrite d0/d2/d37/d5b/d73/fbf [0,4194304] 0 2024-09-11T00:07:26.416 INFO:tasks.workunit.client.1.smithi203.stdout:1/765: dread - d8/d19/d31/ff1 zero size 2024-09-11T00:07:26.416 INFO:tasks.workunit.client.0.smithi111.stdout:5/728: link d10/d1e/d23/d30/d59/d7b/d82/d86/l9d d10/d1e/d23/d30/dd8/lec 0 2024-09-11T00:07:26.420 INFO:tasks.workunit.client.0.smithi111.stdout:4/671: mkdir d18/d20/d3c/d5e/d75/d8d/dce 0 2024-09-11T00:07:26.421 INFO:tasks.workunit.client.1.smithi203.stdout:3/737: dwrite d8/da/f2f [0,4194304] 0 2024-09-11T00:07:26.426 INFO:tasks.workunit.client.0.smithi111.stdout:9/754: rename d6/d52/f59 to d6/db/d1b/d41/d80/ff2 0 2024-09-11T00:07:26.429 INFO:tasks.workunit.client.1.smithi203.stdout:4/576: dwrite db/f4e [0,4194304] 0 2024-09-11T00:07:26.431 INFO:tasks.workunit.client.0.smithi111.stdout:5/729: dwrite d10/d1e/d23/d30/d59/d52/fe4 [0,4194304] 0 2024-09-11T00:07:26.434 INFO:tasks.workunit.client.0.smithi111.stdout:1/685: creat d2/d2b/fe2 x:0 0 0 2024-09-11T00:07:26.435 INFO:tasks.workunit.client.0.smithi111.stdout:7/728: creat dd/d1d/d4d/d82/fe2 x:0 0 0 2024-09-11T00:07:26.436 INFO:tasks.workunit.client.0.smithi111.stdout:3/722: creat d1c/d1d/d22/d23/d2f/de8/d5f/d98/ffb x:0 0 0 2024-09-11T00:07:26.440 INFO:tasks.workunit.client.0.smithi111.stdout:6/664: symlink d7/d22/d26/d95/dd6/le4 0 2024-09-11T00:07:26.440 INFO:tasks.workunit.client.0.smithi111.stdout:9/755: dread - d6/db/d1b/d41/d80/fad zero size 2024-09-11T00:07:26.445 INFO:tasks.workunit.client.0.smithi111.stdout:1/686: symlink d2/de/d12/d88/le3 0 2024-09-11T00:07:26.445 INFO:tasks.workunit.client.0.smithi111.stdout:4/672: getdents d18/d20/d3c/d5e/daa/dbb 0 2024-09-11T00:07:26.446 INFO:tasks.workunit.client.0.smithi111.stdout:7/729: creat dd/d1d/d76/db6/fe3 x:0 0 0 2024-09-11T00:07:26.447 INFO:tasks.workunit.client.0.smithi111.stdout:0/726: creat d3/d13/d1e/d29/f105 x:0 0 0 2024-09-11T00:07:26.450 INFO:tasks.workunit.client.0.smithi111.stdout:9/756: stat d6/l27 0 2024-09-11T00:07:26.451 INFO:tasks.workunit.client.0.smithi111.stdout:3/723: stat d1c/d1d/d22/d44/d5a/d74/ceb 0 2024-09-11T00:07:26.456 INFO:tasks.workunit.client.0.smithi111.stdout:5/730: truncate d10/f6b 16494 0 2024-09-11T00:07:26.461 INFO:tasks.workunit.client.0.smithi111.stdout:7/730: truncate dd/d49/f4c 1209426 0 2024-09-11T00:07:26.468 INFO:tasks.workunit.client.0.smithi111.stdout:1/687: creat d2/de/d12/d3c/d4b/d6a/d63/d95/fe4 x:0 0 0 2024-09-11T00:07:26.469 INFO:tasks.workunit.client.0.smithi111.stdout:8/724: sync 2024-09-11T00:07:26.469 INFO:tasks.workunit.client.0.smithi111.stdout:2/667: sync 2024-09-11T00:07:26.469 INFO:tasks.workunit.client.0.smithi111.stdout:5/731: symlink d10/d1e/d23/d30/dd8/d63/led 0 2024-09-11T00:07:26.472 INFO:tasks.workunit.client.0.smithi111.stdout:8/725: stat d11/d23/d3d/d8d/db9/fd6 0 2024-09-11T00:07:26.474 INFO:tasks.workunit.client.0.smithi111.stdout:1/688: read d2/de/f43 [706228,70760] 0 2024-09-11T00:07:26.475 INFO:tasks.workunit.client.0.smithi111.stdout:2/668: chown d0/d3/de/d3b/d62/d6d 1687 1 2024-09-11T00:07:26.479 INFO:tasks.workunit.client.0.smithi111.stdout:1/689: read d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/f61 [168714,92111] 0 2024-09-11T00:07:26.485 INFO:tasks.workunit.client.0.smithi111.stdout:1/690: write d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/f5b [4074943,50771] 0 2024-09-11T00:07:26.489 INFO:tasks.workunit.client.0.smithi111.stdout:6/665: dread d7/d22/d26/d87/fad [0,4194304] 0 2024-09-11T00:07:26.492 INFO:tasks.workunit.client.0.smithi111.stdout:8/726: dwrite d11/d23/d7e/d93/fdb [0,4194304] 0 2024-09-11T00:07:26.504 INFO:tasks.workunit.client.1.smithi203.stdout:7/665: mkdir dd/d3b/d5b/ddd/df3 0 2024-09-11T00:07:26.511 INFO:tasks.workunit.client.0.smithi111.stdout:6/666: creat d7/d22/d3f/d74/d7f/d79/da4/fe5 x:0 0 0 2024-09-11T00:07:26.513 INFO:tasks.workunit.client.0.smithi111.stdout:8/727: fsync d11/f1d 0 2024-09-11T00:07:26.516 INFO:tasks.workunit.client.0.smithi111.stdout:8/728: chown d11/d23/d2c/f91 94 1 2024-09-11T00:07:26.516 INFO:tasks.workunit.client.0.smithi111.stdout:7/731: creat dd/fe4 x:0 0 0 2024-09-11T00:07:26.518 INFO:tasks.workunit.client.0.smithi111.stdout:9/757: write d6/db/d1b/d41/d80/f9d [906300,125395] 0 2024-09-11T00:07:26.519 INFO:tasks.workunit.client.0.smithi111.stdout:0/727: dwrite d3/d13/d1e/f2e [4194304,4194304] 0 2024-09-11T00:07:26.520 INFO:tasks.workunit.client.0.smithi111.stdout:4/673: truncate f8 1384214 0 2024-09-11T00:07:26.521 INFO:tasks.workunit.client.0.smithi111.stdout:0/728: chown d3/d1c/d50/dec 30 1 2024-09-11T00:07:26.523 INFO:tasks.workunit.client.0.smithi111.stdout:4/674: truncate d18/d39/fc8 2377995 0 2024-09-11T00:07:26.525 INFO:tasks.workunit.client.1.smithi203.stdout:2/728: rmdir d13/d56/dda 0 2024-09-11T00:07:26.526 INFO:tasks.workunit.client.0.smithi111.stdout:0/729: chown d3/d13/d1e/d29/db0/dce/ddb/de6 536 1 2024-09-11T00:07:26.528 INFO:tasks.workunit.client.1.smithi203.stdout:9/642: mknod d6/de/d19/d24/d40/d45/cd8 0 2024-09-11T00:07:26.531 INFO:tasks.workunit.client.1.smithi203.stdout:1/766: mkdir d8/d9/d15/d27/d102/d10c 0 2024-09-11T00:07:26.532 INFO:tasks.workunit.client.0.smithi111.stdout:3/724: dwrite d1c/d21/f3b [0,4194304] 0 2024-09-11T00:07:26.534 INFO:tasks.workunit.client.0.smithi111.stdout:9/758: chown d6/c3e 566722 1 2024-09-11T00:07:26.534 INFO:tasks.workunit.client.0.smithi111.stdout:8/729: unlink d11/d21/d6f/dab/cd3 0 2024-09-11T00:07:26.537 INFO:tasks.workunit.client.0.smithi111.stdout:3/725: truncate d1c/d1d/d22/d44/f7c 4664514 0 2024-09-11T00:07:26.537 INFO:tasks.workunit.client.0.smithi111.stdout:5/732: getdents d10/d1e/d23/d26/d3a/dc2 0 2024-09-11T00:07:26.539 INFO:tasks.workunit.client.1.smithi203.stdout:0/644: write d0/f18 [157748,3517] 0 2024-09-11T00:07:26.543 INFO:tasks.workunit.client.0.smithi111.stdout:0/730: mknod d3/d13/d1e/d29/db0/dce/c106 0 2024-09-11T00:07:26.544 INFO:tasks.workunit.client.0.smithi111.stdout:0/731: fsync d3/d13/d1e/d29/f105 0 2024-09-11T00:07:26.545 INFO:tasks.workunit.client.0.smithi111.stdout:0/732: stat d3/da/d7b/db3/fe7 0 2024-09-11T00:07:26.546 INFO:tasks.workunit.client.0.smithi111.stdout:2/669: rename d0/d3/d12/d52/c81 to d0/ce3 0 2024-09-11T00:07:26.546 INFO:tasks.workunit.client.1.smithi203.stdout:2/729: dwrite d13/d22/fdc [0,4194304] 0 2024-09-11T00:07:26.550 INFO:tasks.workunit.client.1.smithi203.stdout:4/577: rmdir db/dd/d16/d9d 0 2024-09-11T00:07:26.559 INFO:tasks.workunit.client.1.smithi203.stdout:1/767: write d8/f68 [6805735,89225] 0 2024-09-11T00:07:26.560 INFO:tasks.workunit.client.0.smithi111.stdout:7/732: dread dd/d48/d69/fbb [0,4194304] 0 2024-09-11T00:07:26.560 INFO:tasks.workunit.client.0.smithi111.stdout:3/726: creat d1c/d21/db4/ffc x:0 0 0 2024-09-11T00:07:26.561 INFO:tasks.workunit.client.1.smithi203.stdout:1/768: write d8/f1a [315801,32942] 0 2024-09-11T00:07:26.562 INFO:tasks.workunit.client.0.smithi111.stdout:5/733: mkdir d10/d1e/d23/d30/d59/d52/dd6/dee 0 2024-09-11T00:07:26.569 INFO:tasks.workunit.client.1.smithi203.stdout:3/738: getdents d8/da/d5c/d6b 0 2024-09-11T00:07:26.569 INFO:tasks.workunit.client.1.smithi203.stdout:4/578: write db/dd/d16/d38/d3c/f72 [3519440,4938] 0 2024-09-11T00:07:26.569 INFO:tasks.workunit.client.0.smithi111.stdout:7/733: read dd/d1d/d7e/f94 [3768344,91177] 0 2024-09-11T00:07:26.569 INFO:tasks.workunit.client.0.smithi111.stdout:0/733: write d3/fd [553359,102662] 0 2024-09-11T00:07:26.571 INFO:tasks.workunit.client.0.smithi111.stdout:1/691: rename d2/de/d12/d3c/d4b/d6a/d63/d73/db8/fca to d2/de/fe5 0 2024-09-11T00:07:26.572 INFO:tasks.workunit.client.1.smithi203.stdout:7/666: getdents dd/d1c/d52/d8f/d31 0 2024-09-11T00:07:26.572 INFO:tasks.workunit.client.1.smithi203.stdout:4/579: write db/d12/d15/d2a/f1b [4009964,46133] 0 2024-09-11T00:07:26.574 INFO:tasks.workunit.client.0.smithi111.stdout:9/759: dwrite d6/f88 [4194304,4194304] 0 2024-09-11T00:07:26.574 INFO:tasks.workunit.client.0.smithi111.stdout:7/734: truncate dd/d1d/d4b/d8f/d9f/d79/f7b 4399162 0 2024-09-11T00:07:26.575 INFO:tasks.workunit.client.1.smithi203.stdout:7/667: readlink dd/d3b/la8 0 2024-09-11T00:07:26.575 INFO:tasks.workunit.client.1.smithi203.stdout:0/645: truncate d0/d2/f41 3456894 0 2024-09-11T00:07:26.576 INFO:tasks.workunit.client.0.smithi111.stdout:6/667: getdents d7/d22/d1d/d69/db4 0 2024-09-11T00:07:26.577 INFO:tasks.workunit.client.1.smithi203.stdout:2/730: write d13/d15/d19/f28 [9087356,80170] 0 2024-09-11T00:07:26.578 INFO:tasks.workunit.client.0.smithi111.stdout:7/735: read dd/d1d/d2d/d2e/f7a [697222,30620] 0 2024-09-11T00:07:26.584 INFO:tasks.workunit.client.0.smithi111.stdout:5/734: mkdir d10/d1e/d23/d26/d3a/d98/d6d/def 0 2024-09-11T00:07:26.585 INFO:tasks.workunit.client.1.smithi203.stdout:4/580: creat db/d12/d15/d2a/d71/fb9 x:0 0 0 2024-09-11T00:07:26.586 INFO:tasks.workunit.client.1.smithi203.stdout:7/668: creat dd/d1c/d52/d8f/d31/ff4 x:0 0 0 2024-09-11T00:07:26.588 INFO:tasks.workunit.client.1.smithi203.stdout:0/646: creat d0/d2/d37/d5b/fda x:0 0 0 2024-09-11T00:07:26.589 INFO:tasks.workunit.client.1.smithi203.stdout:4/581: chown db/dd/d16/d38/fa9 117427 1 2024-09-11T00:07:26.589 INFO:tasks.workunit.client.1.smithi203.stdout:7/669: chown dd/d4d/d7f/fdc 1631015927 1 2024-09-11T00:07:26.590 INFO:tasks.workunit.client.0.smithi111.stdout:4/675: rename c17 to d18/d20/d3c/d5e/daa/ccf 0 2024-09-11T00:07:26.591 INFO:tasks.workunit.client.1.smithi203.stdout:9/643: link d6/de/f74 d6/de/d47/dc3/fd9 0 2024-09-11T00:07:26.593 INFO:tasks.workunit.client.1.smithi203.stdout:4/582: read db/d12/f9a [1935607,52629] 0 2024-09-11T00:07:26.594 INFO:tasks.workunit.client.0.smithi111.stdout:2/670: mknod d0/d3/de/d4b/dd9/ce4 0 2024-09-11T00:07:26.594 INFO:tasks.workunit.client.0.smithi111.stdout:6/668: dwrite d7/d22/d1d/f31 [4194304,4194304] 0 2024-09-11T00:07:26.597 INFO:tasks.workunit.client.0.smithi111.stdout:9/760: mknod d6/db/d34/d37/d4c/d99/cf3 0 2024-09-11T00:07:26.606 INFO:tasks.workunit.client.1.smithi203.stdout:7/670: mknod dd/d3b/d5b/cf5 0 2024-09-11T00:07:26.608 INFO:tasks.workunit.client.0.smithi111.stdout:3/727: mkdir d1c/d1d/d22/dfd 0 2024-09-11T00:07:26.609 INFO:tasks.workunit.client.0.smithi111.stdout:3/728: stat d1c/d1d/c2e 0 2024-09-11T00:07:26.610 INFO:tasks.workunit.client.1.smithi203.stdout:4/583: symlink db/d12/d15/lba 0 2024-09-11T00:07:26.611 INFO:tasks.workunit.client.1.smithi203.stdout:9/644: truncate d6/de/d32/d52/d55/f2b 3166124 0 2024-09-11T00:07:26.612 INFO:tasks.workunit.client.0.smithi111.stdout:0/734: write d3/d1c/f6a [1319043,57083] 0 2024-09-11T00:07:26.613 INFO:tasks.workunit.client.0.smithi111.stdout:1/692: truncate d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/f5d 725487 0 2024-09-11T00:07:26.618 INFO:tasks.workunit.client.1.smithi203.stdout:1/769: truncate d8/d19/d60/d90/d3e/d4b/d41/f9a 2002803 0 2024-09-11T00:07:26.619 INFO:tasks.workunit.client.0.smithi111.stdout:4/676: mknod d18/d20/d40/d78/d79/d90/cd0 0 2024-09-11T00:07:26.621 INFO:tasks.workunit.client.1.smithi203.stdout:9/645: mkdir d6/de/d32/d52/d55/da2/dda 0 2024-09-11T00:07:26.622 INFO:tasks.workunit.client.0.smithi111.stdout:2/671: stat d0/c5 0 2024-09-11T00:07:26.623 INFO:tasks.workunit.client.0.smithi111.stdout:2/672: fsync d0/d3/fc0 0 2024-09-11T00:07:26.624 INFO:tasks.workunit.client.1.smithi203.stdout:0/647: mknod d0/d2/db3/cdb 0 2024-09-11T00:07:26.625 INFO:tasks.workunit.client.1.smithi203.stdout:2/731: dwrite d13/d15/d30/d5a/f7e [0,4194304] 0 2024-09-11T00:07:26.628 INFO:tasks.workunit.client.0.smithi111.stdout:7/736: link f8 dd/d1d/d4b/d8f/dac/fe5 0 2024-09-11T00:07:26.634 INFO:tasks.workunit.client.1.smithi203.stdout:9/646: symlink d6/de/d19/d24/d6c/da8/ldb 0 2024-09-11T00:07:26.635 INFO:tasks.workunit.client.0.smithi111.stdout:8/730: dwrite d11/d23/d2c/d46/f4d [8388608,4194304] 0 2024-09-11T00:07:26.636 INFO:tasks.workunit.client.0.smithi111.stdout:3/729: dread d1c/d1d/d22/d23/d58/fbb [0,4194304] 0 2024-09-11T00:07:26.636 INFO:tasks.workunit.client.1.smithi203.stdout:9/647: chown d6/de/d19/d21/d87 91310 1 2024-09-11T00:07:26.638 INFO:tasks.workunit.client.0.smithi111.stdout:3/730: stat d1c/d21/cc9 0 2024-09-11T00:07:26.639 INFO:tasks.workunit.client.1.smithi203.stdout:9/648: fdatasync d6/de/fa9 0 2024-09-11T00:07:26.642 INFO:tasks.workunit.client.0.smithi111.stdout:1/693: rename d2/de/d93/fbc to d2/de/d93/d9f/dc0/fe6 0 2024-09-11T00:07:26.643 INFO:tasks.workunit.client.0.smithi111.stdout:8/731: write d11/d23/d3d/d8d/db9/fd6 [960047,107517] 0 2024-09-11T00:07:26.643 INFO:tasks.workunit.client.1.smithi203.stdout:7/671: mkdir dd/d1c/d52/d8f/d31/d4a/d6e/df6 0 2024-09-11T00:07:26.649 INFO:tasks.workunit.client.1.smithi203.stdout:1/770: mkdir d8/d9/d15/d10d 0 2024-09-11T00:07:26.649 INFO:tasks.workunit.client.0.smithi111.stdout:2/673: dread d0/d3/f1c [0,4194304] 0 2024-09-11T00:07:26.649 INFO:tasks.workunit.client.0.smithi111.stdout:6/669: symlink d7/d2b/le6 0 2024-09-11T00:07:26.651 INFO:tasks.workunit.client.1.smithi203.stdout:2/732: mknod d13/d15/d19/d1c/d76/d94/d97/cf1 0 2024-09-11T00:07:26.657 INFO:tasks.workunit.client.0.smithi111.stdout:7/737: mknod dd/d1d/d4b/d8f/d9f/d79/ce6 0 2024-09-11T00:07:26.658 INFO:tasks.workunit.client.1.smithi203.stdout:9/649: dwrite d6/de/d19/f3e [0,4194304] 0 2024-09-11T00:07:26.658 INFO:tasks.workunit.client.0.smithi111.stdout:0/735: write d3/d13/d1e/deb/fb7 [410856,41129] 0 2024-09-11T00:07:26.660 INFO:tasks.workunit.client.0.smithi111.stdout:5/735: creat d10/d1e/d23/d30/ff0 x:0 0 0 2024-09-11T00:07:26.661 INFO:tasks.workunit.client.0.smithi111.stdout:7/738: truncate dd/fe4 408325 0 2024-09-11T00:07:26.668 INFO:tasks.workunit.client.0.smithi111.stdout:6/670: dwrite d7/d22/d3f/f42 [0,4194304] 0 2024-09-11T00:07:26.672 INFO:tasks.workunit.client.1.smithi203.stdout:1/771: creat d8/d19/d60/d90/d3e/d4b/d80/d8d/db0/f10e x:0 0 0 2024-09-11T00:07:26.672 INFO:tasks.workunit.client.1.smithi203.stdout:1/772: chown d8/l55 28356336 1 2024-09-11T00:07:26.673 INFO:tasks.workunit.client.1.smithi203.stdout:2/733: fsync d13/d15/d30/d59/f6a 0 2024-09-11T00:07:26.673 INFO:tasks.workunit.client.0.smithi111.stdout:3/731: mkdir d1c/d21/dae/dfe 0 2024-09-11T00:07:26.673 INFO:tasks.workunit.client.0.smithi111.stdout:8/732: dread - d11/f90 zero size 2024-09-11T00:07:26.674 INFO:tasks.workunit.client.0.smithi111.stdout:1/694: creat d2/de/d93/d9c/fe7 x:0 0 0 2024-09-11T00:07:26.675 INFO:tasks.workunit.client.1.smithi203.stdout:0/648: write d0/d2/f32 [3994010,64133] 0 2024-09-11T00:07:26.677 INFO:tasks.workunit.client.0.smithi111.stdout:4/677: fdatasync d18/d1f/f2e 0 2024-09-11T00:07:26.678 INFO:tasks.workunit.client.1.smithi203.stdout:7/672: rmdir dd/d1c/d52/d8f/d31/d58 39 2024-09-11T00:07:26.684 INFO:tasks.workunit.client.1.smithi203.stdout:2/734: creat d13/d15/d19/d1c/d73/d7a/ff2 x:0 0 0 2024-09-11T00:07:26.686 INFO:tasks.workunit.client.1.smithi203.stdout:2/735: write d13/d22/d53/fab [926547,98470] 0 2024-09-11T00:07:26.689 INFO:tasks.workunit.client.1.smithi203.stdout:0/649: chown d0/d2/d3d/c72 31 1 2024-09-11T00:07:26.692 INFO:tasks.workunit.client.0.smithi111.stdout:5/736: rename d10/d1e/d23/d26/d3a/dc2 to d10/d1e/d23/d30/d59/d52/d85/dd2/df1 0 2024-09-11T00:07:26.693 INFO:tasks.workunit.client.0.smithi111.stdout:5/737: write d10/d1e/f28 [1761430,56543] 0 2024-09-11T00:07:26.694 INFO:tasks.workunit.client.1.smithi203.stdout:9/650: creat d6/de/d32/fdc x:0 0 0 2024-09-11T00:07:26.694 INFO:tasks.workunit.client.0.smithi111.stdout:5/738: chown d10/c20 1110976173 1 2024-09-11T00:07:26.694 INFO:tasks.workunit.client.0.smithi111.stdout:3/732: truncate d1c/d1d/d22/d23/d58/f75 254419 0 2024-09-11T00:07:26.700 INFO:tasks.workunit.client.0.smithi111.stdout:4/678: creat d18/d20/d3c/d5e/d75/d8d/fd1 x:0 0 0 2024-09-11T00:07:26.701 INFO:tasks.workunit.client.0.smithi111.stdout:2/674: fsync d0/d3/f37 0 2024-09-11T00:07:26.702 INFO:tasks.workunit.client.1.smithi203.stdout:0/650: creat d0/d2/d3d/fdc x:0 0 0 2024-09-11T00:07:26.702 INFO:tasks.workunit.client.0.smithi111.stdout:7/739: mknod dd/ddf/ce7 0 2024-09-11T00:07:26.706 INFO:tasks.workunit.client.0.smithi111.stdout:0/736: truncate d3/da/d7b/d84/da8/fd2 704206 0 2024-09-11T00:07:26.708 INFO:tasks.workunit.client.1.smithi203.stdout:2/736: dread d13/d15/d19/d1c/d76/d94/fce [0,4194304] 0 2024-09-11T00:07:26.709 INFO:tasks.workunit.client.0.smithi111.stdout:6/671: getdents d7/d22/d2c/d38/d56/dbf/dca 0 2024-09-11T00:07:26.710 INFO:tasks.workunit.client.1.smithi203.stdout:1/773: dwrite d8/d9/fbb [0,4194304] 0 2024-09-11T00:07:26.711 INFO:tasks.workunit.client.0.smithi111.stdout:8/733: dread d11/d23/d3d/d5f/fd9 [0,4194304] 0 2024-09-11T00:07:26.716 INFO:tasks.workunit.client.1.smithi203.stdout:1/774: readlink d8/d19/d60/d90/d3e/d4b/l79 0 2024-09-11T00:07:26.717 INFO:tasks.workunit.client.0.smithi111.stdout:3/733: unlink d1c/d1d/d22/d23/d2f/de8/lab 0 2024-09-11T00:07:26.717 INFO:tasks.workunit.client.1.smithi203.stdout:9/651: dread d6/de/d19/d24/d40/fb9 [0,4194304] 0 2024-09-11T00:07:26.718 INFO:tasks.workunit.client.0.smithi111.stdout:4/679: dwrite d18/d20/d40/d78/fb2 [0,4194304] 0 2024-09-11T00:07:26.720 INFO:tasks.workunit.client.0.smithi111.stdout:2/675: dwrite d0/d3/d12/d52/fbd [0,4194304] 0 2024-09-11T00:07:26.721 INFO:tasks.workunit.client.1.smithi203.stdout:2/737: rename d13/d56/c85 to d13/d15/d19/d1c/d73/dc8/cf3 0 2024-09-11T00:07:26.721 INFO:tasks.workunit.client.0.smithi111.stdout:4/680: chown d18/d3b/d51/f67 11 1 2024-09-11T00:07:26.723 INFO:tasks.workunit.client.0.smithi111.stdout:5/739: creat d10/d1e/d23/d30/d59/d52/d85/dd2/df1/ff2 x:0 0 0 2024-09-11T00:07:26.725 INFO:tasks.workunit.client.1.smithi203.stdout:9/652: truncate d6/de/d19/d24/d54/fc6 408884 0 2024-09-11T00:07:26.725 INFO:tasks.workunit.client.0.smithi111.stdout:4/681: truncate d18/d20/d40/d78/fcb 598127 0 2024-09-11T00:07:26.725 INFO:tasks.workunit.client.0.smithi111.stdout:5/740: chown d10/d1e/d23/d30/d59/d7b/d82/d86/lb9 150796702 1 2024-09-11T00:07:26.727 INFO:tasks.workunit.client.1.smithi203.stdout:7/673: getdents dd/d1c/d52/d8f/d31/d4a 0 2024-09-11T00:07:26.727 INFO:tasks.workunit.client.0.smithi111.stdout:5/741: write d10/d1e/d25/f93 [2377373,8869] 0 2024-09-11T00:07:26.730 INFO:tasks.workunit.client.1.smithi203.stdout:1/775: creat d8/d19/d60/f10f x:0 0 0 2024-09-11T00:07:26.734 INFO:tasks.workunit.client.1.smithi203.stdout:2/738: mkdir d13/d15/d30/d5a/d8b/df4 0 2024-09-11T00:07:26.737 INFO:tasks.workunit.client.0.smithi111.stdout:6/672: unlink d7/d2b/c58 0 2024-09-11T00:07:26.737 INFO:tasks.workunit.client.0.smithi111.stdout:6/673: readlink d7/l1a 0 2024-09-11T00:07:26.738 INFO:tasks.workunit.client.0.smithi111.stdout:7/740: write dd/d1d/d1f/f5e [1511658,104325] 0 2024-09-11T00:07:26.739 INFO:tasks.workunit.client.1.smithi203.stdout:0/651: write d0/d1d/f2e [3964310,101738] 0 2024-09-11T00:07:26.739 INFO:tasks.workunit.client.1.smithi203.stdout:7/674: mkdir dd/d1c/d52/d8f/d31/d4a/d6e/df7 0 2024-09-11T00:07:26.741 INFO:tasks.workunit.client.0.smithi111.stdout:1/695: dwrite d2/d77/faf [0,4194304] 0 2024-09-11T00:07:26.742 INFO:tasks.workunit.client.0.smithi111.stdout:8/734: rename d11/l8b to d11/d23/d2c/d7f/dde/le8 0 2024-09-11T00:07:26.743 INFO:tasks.workunit.client.0.smithi111.stdout:5/742: rename d10/d1e/d23/d30/d3c to d10/d1e/d23/d30/d3c/df3 22 2024-09-11T00:07:26.744 INFO:tasks.workunit.client.1.smithi203.stdout:2/739: creat d13/d56/d69/ff5 x:0 0 0 2024-09-11T00:07:26.748 INFO:tasks.workunit.client.1.smithi203.stdout:7/675: write dd/d1c/d52/d8f/d31/f50 [4721343,129631] 0 2024-09-11T00:07:26.748 INFO:tasks.workunit.client.0.smithi111.stdout:3/734: mkdir d1c/d1d/d22/d23/dff 0 2024-09-11T00:07:26.749 INFO:tasks.workunit.client.0.smithi111.stdout:2/676: creat d0/d3/de/d50/d9d/fe5 x:0 0 0 2024-09-11T00:07:26.752 INFO:tasks.workunit.client.0.smithi111.stdout:2/677: chown d0/d3/f27 114690 1 2024-09-11T00:07:26.753 INFO:tasks.workunit.client.0.smithi111.stdout:3/735: rename d1c/d1d/d22/d23/d2f/de8/d5f to d1c/d1d/d22/d23/d2f/de8/d5f/d100 22 2024-09-11T00:07:26.781 INFO:tasks.workunit.client.1.smithi203.stdout:8/624: sync 2024-09-11T00:07:26.785 INFO:tasks.workunit.client.1.smithi203.stdout:8/625: stat d1/d13/d17/c80 0 2024-09-11T00:07:26.790 INFO:tasks.workunit.client.1.smithi203.stdout:9/653: creat d6/de/d19/d24/d54/db2/fdd x:0 0 0 2024-09-11T00:07:26.793 INFO:tasks.workunit.client.1.smithi203.stdout:2/740: mknod d13/d15/d19/d1c/d76/d94/d97/cf6 0 2024-09-11T00:07:26.797 INFO:tasks.workunit.client.1.smithi203.stdout:7/676: dread dd/d1c/d4b/f53 [0,4194304] 0 2024-09-11T00:07:26.800 INFO:tasks.workunit.client.1.smithi203.stdout:2/741: dread d13/d22/f3f [0,4194304] 0 2024-09-11T00:07:26.802 INFO:tasks.workunit.client.0.smithi111.stdout:6/674: rmdir d7/d22/d3f/d74/d7f/d61/d6a/dba 39 2024-09-11T00:07:26.804 INFO:tasks.workunit.client.0.smithi111.stdout:4/682: dread d18/d20/f46 [0,4194304] 0 2024-09-11T00:07:26.809 INFO:tasks.workunit.client.0.smithi111.stdout:1/696: creat d2/de/d12/d3c/d4b/d6a/d63/d73/da1/fe8 x:0 0 0 2024-09-11T00:07:26.809 INFO:tasks.workunit.client.0.smithi111.stdout:0/737: truncate d3/d1c/f42 2152284 0 2024-09-11T00:07:26.810 INFO:tasks.workunit.client.1.smithi203.stdout:1/776: dwrite d8/d9/d15/fc5 [0,4194304] 0 2024-09-11T00:07:26.812 INFO:tasks.workunit.client.0.smithi111.stdout:1/697: write d2/de/d12/d3c/d4b/fc8 [1162590,24835] 0 2024-09-11T00:07:26.814 INFO:tasks.workunit.client.1.smithi203.stdout:8/626: fsync d1/d13/d3a/d4c/da6/fcd 0 2024-09-11T00:07:26.815 INFO:tasks.workunit.client.0.smithi111.stdout:3/736: creat d1c/d1d/d22/d23/d2f/d63/d7e/f101 x:0 0 0 2024-09-11T00:07:26.815 INFO:tasks.workunit.client.1.smithi203.stdout:0/652: dwrite d0/d2/d37/d5b/fc1 [0,4194304] 0 2024-09-11T00:07:26.817 INFO:tasks.workunit.client.1.smithi203.stdout:2/742: mkdir d13/d15/d30/d5a/d8b/df7 0 2024-09-11T00:07:26.820 INFO:tasks.workunit.client.0.smithi111.stdout:6/675: dwrite d7/d22/d26/d87/f57 [0,4194304] 0 2024-09-11T00:07:26.820 INFO:tasks.workunit.client.0.smithi111.stdout:3/737: readlink d1c/d1d/d22/d23/d58/d5c/l7f 0 2024-09-11T00:07:26.821 INFO:tasks.workunit.client.1.smithi203.stdout:2/743: write d13/d15/d19/d1c/d73/dc4/fee [313823,25568] 0 2024-09-11T00:07:26.822 INFO:tasks.workunit.client.1.smithi203.stdout:2/744: readlink d13/d47/l9d 0 2024-09-11T00:07:26.825 INFO:tasks.workunit.client.0.smithi111.stdout:5/743: unlink d10/d1e/d23/d2b/d2f/lc4 0 2024-09-11T00:07:26.826 INFO:tasks.workunit.client.0.smithi111.stdout:6/676: chown d7/d22/d3f/d74/d7f/d61/lc1 6 1 2024-09-11T00:07:26.826 INFO:tasks.workunit.client.0.smithi111.stdout:3/738: write d1c/d1d/d22/d31/d62/fa9 [175368,46440] 0 2024-09-11T00:07:26.829 INFO:tasks.workunit.client.1.smithi203.stdout:7/677: link dd/f22 dd/d1c/d52/ff8 0 2024-09-11T00:07:26.833 INFO:tasks.workunit.client.0.smithi111.stdout:7/741: link dd/f18 dd/da6/fe8 0 2024-09-11T00:07:26.834 INFO:tasks.workunit.client.0.smithi111.stdout:7/742: chown dd 2011 1 2024-09-11T00:07:26.835 INFO:tasks.workunit.client.1.smithi203.stdout:8/627: chown d1/d13/d17/d2f/d52/d49/d68/dba/cc7 0 1 2024-09-11T00:07:26.836 INFO:tasks.workunit.client.0.smithi111.stdout:0/738: mknod d3/d1c/d50/dec/c107 0 2024-09-11T00:07:26.837 INFO:tasks.workunit.client.1.smithi203.stdout:2/745: mkdir d13/d15/d19/d1c/d76/d94/d97/df8 0 2024-09-11T00:07:26.837 INFO:tasks.workunit.client.1.smithi203.stdout:8/628: dread - d1/d13/d17/d48/d61/fc5 zero size 2024-09-11T00:07:26.839 INFO:tasks.workunit.client.0.smithi111.stdout:5/744: creat d10/d1e/d23/d26/d3a/d98/ff4 x:0 0 0 2024-09-11T00:07:26.844 INFO:tasks.workunit.client.1.smithi203.stdout:2/746: unlink c3 0 2024-09-11T00:07:26.848 INFO:tasks.workunit.client.0.smithi111.stdout:3/739: creat d1c/d1d/d22/d23/d58/df2/f102 x:0 0 0 2024-09-11T00:07:26.850 INFO:tasks.workunit.client.0.smithi111.stdout:6/677: dwrite d7/d22/d3f/d74/d7f/d79/da4/fe5 [0,4194304] 0 2024-09-11T00:07:26.853 INFO:tasks.workunit.client.0.smithi111.stdout:6/678: read d7/d22/d26/f8a [843675,35952] 0 2024-09-11T00:07:26.857 INFO:tasks.workunit.client.1.smithi203.stdout:9/654: truncate d6/de/d19/d24/d54/f9d 1414442 0 2024-09-11T00:07:26.859 INFO:tasks.workunit.client.0.smithi111.stdout:0/739: mknod d3/d1c/c108 0 2024-09-11T00:07:26.860 INFO:tasks.workunit.client.0.smithi111.stdout:4/683: write d18/d20/d3c/d5e/d75/f76 [2675,125080] 0 2024-09-11T00:07:26.863 INFO:tasks.workunit.client.1.smithi203.stdout:2/747: symlink d13/ddb/lf9 0 2024-09-11T00:07:26.865 INFO:tasks.workunit.client.0.smithi111.stdout:7/743: mknod dd/d1d/d4d/d82/ce9 0 2024-09-11T00:07:26.867 INFO:tasks.workunit.client.0.smithi111.stdout:7/744: chown dd/d1d/d4b/d8f/d9f 2460970 1 2024-09-11T00:07:26.871 INFO:tasks.workunit.client.0.smithi111.stdout:6/679: mknod d7/d2b/dd4/ce7 0 2024-09-11T00:07:26.872 INFO:tasks.workunit.client.0.smithi111.stdout:0/740: mknod d3/d1c/d50/c109 0 2024-09-11T00:07:26.876 INFO:tasks.workunit.client.0.smithi111.stdout:1/698: dwrite d2/de/d12/d3c/d4b/d6a/d3a/f40 [0,4194304] 0 2024-09-11T00:07:26.877 INFO:tasks.workunit.client.1.smithi203.stdout:2/748: rename d13/d95 to d13/d15/d30/dfa 0 2024-09-11T00:07:26.877 INFO:tasks.workunit.client.1.smithi203.stdout:1/777: write d8/d19/d60/d90/d3e/d4b/d80/d8d/db0/fd8 [656866,54874] 0 2024-09-11T00:07:26.880 INFO:tasks.workunit.client.0.smithi111.stdout:7/745: rmdir dd/d1d/d7e 39 2024-09-11T00:07:26.880 INFO:tasks.workunit.client.0.smithi111.stdout:3/740: link d1c/d1d/d22/d23/f52 d1c/d1d/d22/d31/d62/dc7/f103 0 2024-09-11T00:07:26.881 INFO:tasks.workunit.client.1.smithi203.stdout:8/629: write d1/d13/d17/d2f/f32 [1327646,90299] 0 2024-09-11T00:07:26.883 INFO:tasks.workunit.client.1.smithi203.stdout:9/655: mkdir d6/de/d19/d21/dd0/dde 0 2024-09-11T00:07:26.883 INFO:tasks.workunit.client.0.smithi111.stdout:6/680: dread d7/d2b/f68 [0,4194304] 0 2024-09-11T00:07:26.886 INFO:tasks.workunit.client.1.smithi203.stdout:2/749: truncate d13/d15/d19/d1c/d76/fb3 437876 0 2024-09-11T00:07:26.887 INFO:tasks.workunit.client.0.smithi111.stdout:7/746: mkdir dd/d48/d69/dea 0 2024-09-11T00:07:26.887 INFO:tasks.workunit.client.0.smithi111.stdout:6/681: write d7/d22/d1d/d69/db4/fdf [223488,92540] 0 2024-09-11T00:07:26.888 INFO:tasks.workunit.client.1.smithi203.stdout:0/653: dwrite d0/d2/f81 [4194304,4194304] 0 2024-09-11T00:07:26.890 INFO:tasks.workunit.client.0.smithi111.stdout:0/741: symlink d3/d13/d1e/deb/d61/d93/d102/l10a 0 2024-09-11T00:07:26.892 INFO:tasks.workunit.client.1.smithi203.stdout:0/654: readlink d0/d1d/l49 0 2024-09-11T00:07:26.894 INFO:tasks.workunit.client.0.smithi111.stdout:4/684: dread d18/d20/f34 [0,4194304] 0 2024-09-11T00:07:26.897 INFO:tasks.workunit.client.0.smithi111.stdout:3/741: creat d1c/d1d/d22/dfd/f104 x:0 0 0 2024-09-11T00:07:26.900 INFO:tasks.workunit.client.0.smithi111.stdout:9/761: sync 2024-09-11T00:07:26.900 INFO:tasks.workunit.client.0.smithi111.stdout:5/745: dwrite d10/d1e/d23/d26/f50 [0,4194304] 0 2024-09-11T00:07:26.901 INFO:tasks.workunit.client.1.smithi203.stdout:8/630: creat d1/d13/d22/d6f/fd0 x:0 0 0 2024-09-11T00:07:26.902 INFO:tasks.workunit.client.1.smithi203.stdout:8/631: chown d1/d13/f1b 2409399 1 2024-09-11T00:07:26.903 INFO:tasks.workunit.client.0.smithi111.stdout:1/699: dwrite d2/de/d12/fa3 [0,4194304] 0 2024-09-11T00:07:26.905 INFO:tasks.workunit.client.0.smithi111.stdout:0/742: dread - d3/d1c/fd5 zero size 2024-09-11T00:07:26.906 INFO:tasks.workunit.client.0.smithi111.stdout:5/746: write d10/d1e/d23/d2b/d2f/fda [468534,128214] 0 2024-09-11T00:07:26.909 INFO:tasks.workunit.client.1.smithi203.stdout:8/632: read d1/d13/d17/d48/d61/f71 [1990600,47898] 0 2024-09-11T00:07:26.909 INFO:tasks.workunit.client.1.smithi203.stdout:2/750: dwrite d13/d15/d30/dfa/daf/fd1 [4194304,4194304] 0 2024-09-11T00:07:26.910 INFO:tasks.workunit.client.1.smithi203.stdout:0/655: mknod d0/d2/cdd 0 2024-09-11T00:07:26.911 INFO:tasks.workunit.client.0.smithi111.stdout:7/747: symlink dd/d1d/d1f/d24/dd2/leb 0 2024-09-11T00:07:26.912 INFO:tasks.workunit.client.0.smithi111.stdout:2/678: sync 2024-09-11T00:07:26.913 INFO:tasks.workunit.client.0.smithi111.stdout:8/735: sync 2024-09-11T00:07:26.917 INFO:tasks.workunit.client.0.smithi111.stdout:3/742: creat d1c/d1d/d22/dfd/f105 x:0 0 0 2024-09-11T00:07:26.919 INFO:tasks.workunit.client.1.smithi203.stdout:9/656: getdents d6 0 2024-09-11T00:07:26.920 INFO:tasks.workunit.client.1.smithi203.stdout:2/751: mkdir d13/d47/dfb 0 2024-09-11T00:07:26.921 INFO:tasks.workunit.client.1.smithi203.stdout:2/752: chown d13/d56/l62 899612 1 2024-09-11T00:07:26.922 INFO:tasks.workunit.client.1.smithi203.stdout:0/656: rename d0/f52 to d0/d2/d7e/da1/fde 0 2024-09-11T00:07:26.922 INFO:tasks.workunit.client.0.smithi111.stdout:8/736: fdatasync f7 0 2024-09-11T00:07:26.927 INFO:tasks.workunit.client.0.smithi111.stdout:9/762: rename d6/db/d1b/d41/l9f to d6/db/d7a/lf4 0 2024-09-11T00:07:26.927 INFO:tasks.workunit.client.0.smithi111.stdout:1/700: symlink d2/de/d12/d3c/d4b/dc3/le9 0 2024-09-11T00:07:26.930 INFO:tasks.workunit.client.1.smithi203.stdout:0/657: truncate d0/d1d/d5d/f9b 4323619 0 2024-09-11T00:07:26.930 INFO:tasks.workunit.client.1.smithi203.stdout:2/753: fsync d13/d47/f86 0 2024-09-11T00:07:26.930 INFO:tasks.workunit.client.0.smithi111.stdout:7/748: read dd/da6/fab [987153,124658] 0 2024-09-11T00:07:26.931 INFO:tasks.workunit.client.0.smithi111.stdout:9/763: write d6/db/d1b/d74/f84 [694036,37114] 0 2024-09-11T00:07:26.937 INFO:tasks.workunit.client.0.smithi111.stdout:8/737: dread d11/d23/d2c/d53/fe5 [0,4194304] 0 2024-09-11T00:07:26.937 INFO:tasks.workunit.client.1.smithi203.stdout:9/657: link d6/de/d32/c72 d6/de/d19/d21/cdf 0 2024-09-11T00:07:26.938 INFO:tasks.workunit.client.1.smithi203.stdout:1/778: truncate d8/d19/d31/f59 3439759 0 2024-09-11T00:07:26.941 INFO:tasks.workunit.client.1.smithi203.stdout:9/658: read d6/de/fa9 [1133101,2146] 0 2024-09-11T00:07:26.941 INFO:tasks.workunit.client.1.smithi203.stdout:2/754: rename d13/d15/c2f to d13/d56/d69/cfc 0 2024-09-11T00:07:26.942 INFO:tasks.workunit.client.0.smithi111.stdout:6/682: write d7/d22/d1d/f75 [1949286,32882] 0 2024-09-11T00:07:26.943 INFO:tasks.workunit.client.1.smithi203.stdout:2/755: write d13/d15/f1b [4488325,55719] 0 2024-09-11T00:07:26.943 INFO:tasks.workunit.client.0.smithi111.stdout:5/747: rename d10/d1e/d25/d6e/f80 to d10/d1e/d23/d30/dd8/da2/ff5 0 2024-09-11T00:07:26.949 INFO:tasks.workunit.client.0.smithi111.stdout:3/743: mknod d1c/d1d/d22/d23/d58/c106 0 2024-09-11T00:07:26.949 INFO:tasks.workunit.client.0.smithi111.stdout:3/744: chown d1c 143324 1 2024-09-11T00:07:26.950 INFO:tasks.workunit.client.1.smithi203.stdout:9/659: mknod d6/de/d19/d21/ce0 0 2024-09-11T00:07:26.952 INFO:tasks.workunit.client.1.smithi203.stdout:2/756: fsync d13/fb2 0 2024-09-11T00:07:26.953 INFO:tasks.workunit.client.0.smithi111.stdout:9/764: readlink d6/d52/lbe 0 2024-09-11T00:07:26.954 INFO:tasks.workunit.client.1.smithi203.stdout:1/779: mknod d8/c110 0 2024-09-11T00:07:26.954 INFO:tasks.workunit.client.0.smithi111.stdout:4/685: dwrite d18/d1f/d33/f59 [0,4194304] 0 2024-09-11T00:07:26.956 INFO:tasks.workunit.client.1.smithi203.stdout:1/780: chown d8/d19/d31/l7c 110 1 2024-09-11T00:07:26.956 INFO:tasks.workunit.client.1.smithi203.stdout:9/660: rmdir d6/de/d19/d21 39 2024-09-11T00:07:26.956 INFO:tasks.workunit.client.0.smithi111.stdout:9/765: chown d6/db/d34/d37/d4c/d7f/d97/de8 169 1 2024-09-11T00:07:26.958 INFO:tasks.workunit.client.0.smithi111.stdout:7/749: dread dd/f10 [0,4194304] 0 2024-09-11T00:07:26.960 INFO:tasks.workunit.client.0.smithi111.stdout:8/738: creat d11/d21/d6f/fe9 x:0 0 0 2024-09-11T00:07:26.964 INFO:tasks.workunit.client.1.smithi203.stdout:9/661: read - d6/de/d47/f8d zero size 2024-09-11T00:07:26.966 INFO:tasks.workunit.client.0.smithi111.stdout:5/748: mkdir d10/d1e/d23/d30/d59/dd1/df6 0 2024-09-11T00:07:26.968 INFO:tasks.workunit.client.0.smithi111.stdout:5/749: fdatasync d10/d1e/d23/d30/d59/d52/d85/dd2/df1/ff2 0 2024-09-11T00:07:26.969 INFO:tasks.workunit.client.1.smithi203.stdout:6/678: sync 2024-09-11T00:07:26.970 INFO:tasks.workunit.client.1.smithi203.stdout:0/658: truncate d0/f5 309436 0 2024-09-11T00:07:26.971 INFO:tasks.workunit.client.1.smithi203.stdout:9/662: read - d6/de/d19/d24/f6f zero size 2024-09-11T00:07:26.973 INFO:tasks.workunit.client.0.smithi111.stdout:2/679: truncate d0/d3/d12/d52/fbd 1856288 0 2024-09-11T00:07:26.973 INFO:tasks.workunit.client.1.smithi203.stdout:0/659: chown d0/d1d/f69 3439286 1 2024-09-11T00:07:26.975 INFO:tasks.workunit.client.1.smithi203.stdout:6/679: creat d0/d54/fdf x:0 0 0 2024-09-11T00:07:26.976 INFO:tasks.workunit.client.1.smithi203.stdout:1/781: dwrite d8/d19/d60/d90/f5e [0,4194304] 0 2024-09-11T00:07:26.987 INFO:tasks.workunit.client.0.smithi111.stdout:6/683: dread d7/f6b [0,4194304] 0 2024-09-11T00:07:27.000 INFO:tasks.workunit.client.0.smithi111.stdout:0/743: getdents d3/d13/d1e/d29/db0 0 2024-09-11T00:07:27.003 INFO:tasks.workunit.client.1.smithi203.stdout:9/663: mkdir d6/de/d47/de1 0 2024-09-11T00:07:27.005 INFO:tasks.workunit.client.0.smithi111.stdout:4/686: rename d18/d20/d3c/d5e/c7d to d18/d3b/dae/cd2 0 2024-09-11T00:07:27.007 INFO:tasks.workunit.client.1.smithi203.stdout:0/660: creat d0/d1d/d5d/dba/fdf x:0 0 0 2024-09-11T00:07:27.011 INFO:tasks.workunit.client.1.smithi203.stdout:0/661: chown d0/d2/d37/d5b/fda 91 1 2024-09-11T00:07:27.011 INFO:tasks.workunit.client.1.smithi203.stdout:6/680: write d0/f63 [1607855,122934] 0 2024-09-11T00:07:27.014 INFO:tasks.workunit.client.0.smithi111.stdout:5/750: dread d10/d1e/d23/d30/dd8/d7e/f5b [0,4194304] 0 2024-09-11T00:07:27.015 INFO:tasks.workunit.client.0.smithi111.stdout:3/745: fdatasync d1c/d1d/d22/d23/fb7 0 2024-09-11T00:07:27.017 INFO:tasks.workunit.client.0.smithi111.stdout:1/701: truncate d2/de/d12/d3c/d4b/d6a/d63/f9d 3082924 0 2024-09-11T00:07:27.018 INFO:tasks.workunit.client.1.smithi203.stdout:6/681: dread d0/fc7 [0,4194304] 0 2024-09-11T00:07:27.019 INFO:tasks.workunit.client.1.smithi203.stdout:1/782: dread d8/d19/ff0 [0,4194304] 0 2024-09-11T00:07:27.021 INFO:tasks.workunit.client.1.smithi203.stdout:6/682: chown d0/d54/c96 499955 1 2024-09-11T00:07:27.022 INFO:tasks.workunit.client.0.smithi111.stdout:6/684: creat d7/d22/d26/d95/fe8 x:0 0 0 2024-09-11T00:07:27.022 INFO:tasks.workunit.client.1.smithi203.stdout:1/783: stat d8/d9/d15/d27/l103 0 2024-09-11T00:07:27.024 INFO:tasks.workunit.client.1.smithi203.stdout:1/784: fdatasync d8/d19/ff8 0 2024-09-11T00:07:27.025 INFO:tasks.workunit.client.1.smithi203.stdout:1/785: readlink d8/d9/l1d 0 2024-09-11T00:07:27.026 INFO:tasks.workunit.client.1.smithi203.stdout:9/664: rename d6/de/d32/d52/d55/d66/d80 to d6/de/d19/d24/d54/db2/de2 0 2024-09-11T00:07:27.029 INFO:tasks.workunit.client.1.smithi203.stdout:6/683: readlink d0/d32/l44 0 2024-09-11T00:07:27.029 INFO:tasks.workunit.client.1.smithi203.stdout:0/662: dwrite d0/d2/d7e/dd2/fd4 [0,4194304] 0 2024-09-11T00:07:27.033 INFO:tasks.workunit.client.1.smithi203.stdout:0/663: dread - d0/d2/d37/d5b/fc0 zero size 2024-09-11T00:07:27.035 INFO:tasks.workunit.client.0.smithi111.stdout:7/750: mknod dd/d1d/cec 0 2024-09-11T00:07:27.036 INFO:tasks.workunit.client.0.smithi111.stdout:2/680: write d0/d3/de/f1e [1928054,51292] 0 2024-09-11T00:07:27.038 INFO:tasks.workunit.client.0.smithi111.stdout:2/681: dread d0/d83/fcd [0,4194304] 0 2024-09-11T00:07:27.039 INFO:tasks.workunit.client.1.smithi203.stdout:1/786: mknod d8/d19/d60/d90/d3e/d4b/d80/d8d/db0/c111 0 2024-09-11T00:07:27.043 INFO:tasks.workunit.client.0.smithi111.stdout:5/751: symlink d10/d1e/d23/d30/d59/d52/lf7 0 2024-09-11T00:07:27.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:26 smithi203 ceph-mon[33225]: pgmap v11: 65 pgs: 65 active+clean; 2.4 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 58 MiB/s rd, 168 MiB/s wr, 342 op/s 2024-09-11T00:07:27.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:26 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:07:27.045 INFO:tasks.workunit.client.0.smithi111.stdout:5/752: readlink d10/d1e/d25/d6e/lce 0 2024-09-11T00:07:27.047 INFO:tasks.workunit.client.0.smithi111.stdout:0/744: dwrite f2 [0,4194304] 0 2024-09-11T00:07:27.047 INFO:tasks.workunit.client.1.smithi203.stdout:0/664: fdatasync d0/d2/d37/f4b 0 2024-09-11T00:07:27.049 INFO:tasks.workunit.client.1.smithi203.stdout:1/787: creat d8/d19/d60/d90/d3e/d4b/d80/d91/dac/f112 x:0 0 0 2024-09-11T00:07:27.050 INFO:tasks.workunit.client.1.smithi203.stdout:0/665: dread - d0/d2/d37/d5b/fda zero size 2024-09-11T00:07:27.051 INFO:tasks.workunit.client.0.smithi111.stdout:1/702: truncate d2/de/d12/d3c/d4b/d6a/d63/d73/da1/f50 1960156 0 2024-09-11T00:07:27.051 INFO:tasks.workunit.client.0.smithi111.stdout:1/703: stat d2/f79 0 2024-09-11T00:07:27.052 INFO:tasks.workunit.client.0.smithi111.stdout:6/685: symlink d7/d22/d3f/d74/d7f/le9 0 2024-09-11T00:07:27.053 INFO:tasks.workunit.client.1.smithi203.stdout:9/665: getdents d6/de/d47/dc3 0 2024-09-11T00:07:27.056 INFO:tasks.workunit.client.1.smithi203.stdout:0/666: creat d0/d2/d37/d5b/fe0 x:0 0 0 2024-09-11T00:07:27.057 INFO:tasks.workunit.client.1.smithi203.stdout:1/788: symlink d8/d19/d60/d90/d3e/d4b/d80/d91/l113 0 2024-09-11T00:07:27.061 INFO:tasks.workunit.client.0.smithi111.stdout:3/746: dread d1c/d1d/d22/d31/d62/dc7/f103 [0,4194304] 0 2024-09-11T00:07:27.062 INFO:tasks.workunit.client.0.smithi111.stdout:7/751: creat dd/da6/fed x:0 0 0 2024-09-11T00:07:27.069 INFO:tasks.workunit.client.0.smithi111.stdout:1/704: dwrite d2/fda [0,4194304] 0 2024-09-11T00:07:27.070 INFO:tasks.workunit.client.0.smithi111.stdout:2/682: truncate d0/d3/fb1 178637 0 2024-09-11T00:07:27.072 INFO:tasks.workunit.client.1.smithi203.stdout:0/667: rename d0/faa to d0/d2/d7e/da1/fe1 0 2024-09-11T00:07:27.073 INFO:tasks.workunit.client.0.smithi111.stdout:7/752: dread dd/da6/fab [0,4194304] 0 2024-09-11T00:07:27.074 INFO:tasks.workunit.client.0.smithi111.stdout:5/753: rmdir d10/d1e/d23/d30/dd8/d7e 39 2024-09-11T00:07:27.076 INFO:tasks.workunit.client.0.smithi111.stdout:4/687: fsync d18/d39/fc8 0 2024-09-11T00:07:27.076 INFO:tasks.workunit.client.1.smithi203.stdout:6/684: dwrite d0/f23 [0,4194304] 0 2024-09-11T00:07:27.080 INFO:tasks.workunit.client.0.smithi111.stdout:5/754: write d10/d1e/d23/d30/dd8/d63/f6f [2713208,80552] 0 2024-09-11T00:07:27.083 INFO:tasks.workunit.client.1.smithi203.stdout:0/668: dread - d0/d1d/f90 zero size 2024-09-11T00:07:27.092 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:26 smithi111 ceph-mon[27539]: pgmap v11: 65 pgs: 65 active+clean; 2.4 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 58 MiB/s rd, 168 MiB/s wr, 342 op/s 2024-09-11T00:07:27.092 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:26 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:07:27.092 INFO:tasks.workunit.client.0.smithi111.stdout:8/739: sync 2024-09-11T00:07:27.093 INFO:tasks.workunit.client.1.smithi203.stdout:0/669: creat d0/d2/d7e/da1/fe2 x:0 0 0 2024-09-11T00:07:27.097 INFO:tasks.workunit.client.1.smithi203.stdout:6/685: dwrite d0/d5b/d9f/fb1 [0,4194304] 0 2024-09-11T00:07:27.098 INFO:tasks.workunit.client.0.smithi111.stdout:5/755: dwrite d10/d1e/d25/d6e/f7d [0,4194304] 0 2024-09-11T00:07:27.098 INFO:tasks.workunit.client.1.smithi203.stdout:1/789: write d8/d19/d31/f88 [2143282,75866] 0 2024-09-11T00:07:27.100 INFO:tasks.workunit.client.1.smithi203.stdout:6/686: readlink d0/d32/d5a/l8e 0 2024-09-11T00:07:27.105 INFO:tasks.workunit.client.0.smithi111.stdout:5/756: dread d10/d1e/d23/d2b/d2f/fda [0,4194304] 0 2024-09-11T00:07:27.115 INFO:tasks.workunit.client.1.smithi203.stdout:9/666: dwrite d6/de/d19/d21/d87/dc0/fca [0,4194304] 0 2024-09-11T00:07:27.123 INFO:tasks.workunit.client.1.smithi203.stdout:1/790: getdents d8/d19/d60/d90/d3e/d4b/d80 0 2024-09-11T00:07:27.128 INFO:tasks.workunit.client.1.smithi203.stdout:6/687: dwrite d0/d54/fdf [0,4194304] 0 2024-09-11T00:07:27.133 INFO:tasks.workunit.client.1.smithi203.stdout:9/667: creat d6/de/fe3 x:0 0 0 2024-09-11T00:07:27.133 INFO:tasks.workunit.client.1.smithi203.stdout:1/791: creat d8/d19/d60/d90/d3e/d4b/db2/f114 x:0 0 0 2024-09-11T00:07:27.134 INFO:tasks.workunit.client.0.smithi111.stdout:9/766: getdents d6/d52/d8a/d8e 0 2024-09-11T00:07:27.135 INFO:tasks.workunit.client.1.smithi203.stdout:1/792: dread - d8/f6d zero size 2024-09-11T00:07:27.136 INFO:tasks.workunit.client.1.smithi203.stdout:6/688: fdatasync d0/d54/d9c/d35/d38/f84 0 2024-09-11T00:07:27.144 INFO:tasks.workunit.client.0.smithi111.stdout:2/683: dread - d0/d3/d12/f96 zero size 2024-09-11T00:07:27.145 INFO:tasks.workunit.client.1.smithi203.stdout:6/689: symlink d0/d54/d9c/d35/d38/dc0/ddb/le0 0 2024-09-11T00:07:27.147 INFO:tasks.workunit.client.1.smithi203.stdout:6/690: stat d0/d54/d9c/d35/d39/d3c/c8b 0 2024-09-11T00:07:27.150 INFO:tasks.workunit.client.0.smithi111.stdout:7/753: write dd/d1d/d4b/dad/fe0 [828753,129677] 0 2024-09-11T00:07:27.151 INFO:tasks.workunit.client.1.smithi203.stdout:1/793: rmdir d8/d19/d31/d36/d101 0 2024-09-11T00:07:27.153 INFO:tasks.workunit.client.0.smithi111.stdout:4/688: creat d18/d20/d40/d78/fd3 x:0 0 0 2024-09-11T00:07:27.156 INFO:tasks.workunit.client.0.smithi111.stdout:4/689: fsync d18/d3b/d51/f5b 0 2024-09-11T00:07:27.156 INFO:tasks.workunit.client.0.smithi111.stdout:6/686: mkdir d7/d22/d2c/dea 0 2024-09-11T00:07:27.162 INFO:tasks.workunit.client.0.smithi111.stdout:5/757: mkdir d10/d1e/d23/d2b/dad/df8 0 2024-09-11T00:07:27.167 INFO:tasks.workunit.client.0.smithi111.stdout:1/705: dwrite d2/de/d12/d3c/d4b/d6a/f64 [0,4194304] 0 2024-09-11T00:07:27.167 INFO:tasks.workunit.client.0.smithi111.stdout:7/754: truncate dd/f26 1435527 0 2024-09-11T00:07:27.168 INFO:tasks.workunit.client.1.smithi203.stdout:9/668: dread d6/de/d19/f31 [0,4194304] 0 2024-09-11T00:07:27.170 INFO:tasks.workunit.client.0.smithi111.stdout:6/687: mknod d7/d22/d26/d87/d7a/dc5/ceb 0 2024-09-11T00:07:27.174 INFO:tasks.workunit.client.1.smithi203.stdout:9/669: symlink d6/de/d19/d24/d54/db2/de2/le4 0 2024-09-11T00:07:27.174 INFO:tasks.workunit.client.1.smithi203.stdout:1/794: dwrite d8/d9/d15/f47 [0,4194304] 0 2024-09-11T00:07:27.175 INFO:tasks.workunit.client.0.smithi111.stdout:0/745: dwrite d3/d13/d1e/deb/d61/d93/ffe [0,4194304] 0 2024-09-11T00:07:27.176 INFO:tasks.workunit.client.1.smithi203.stdout:9/670: fdatasync d6/de/d19/f1b 0 2024-09-11T00:07:27.178 INFO:tasks.workunit.client.1.smithi203.stdout:1/795: chown d8/d28/d64/f65 1 1 2024-09-11T00:07:27.178 INFO:tasks.workunit.client.0.smithi111.stdout:2/684: rename d0/d3/de/c48 to d0/d3/de/db4/ce6 0 2024-09-11T00:07:27.182 INFO:tasks.workunit.client.1.smithi203.stdout:9/671: stat d6/de/l1d 0 2024-09-11T00:07:27.186 INFO:tasks.workunit.client.1.smithi203.stdout:1/796: rename d8/d19/d60/d90/d3e/d4b/db2/ccf to d8/d19/d60/d90/d3e/d4b/d80/d91/dac/c115 0 2024-09-11T00:07:27.188 INFO:tasks.workunit.client.0.smithi111.stdout:3/747: dwrite d1c/d1d/d22/d23/d2f/d63/f6b [0,4194304] 0 2024-09-11T00:07:27.188 INFO:tasks.workunit.client.0.smithi111.stdout:6/688: mknod d7/d22/d3f/d74/d7f/cec 0 2024-09-11T00:07:27.188 INFO:tasks.workunit.client.1.smithi203.stdout:9/672: symlink d6/de/d19/d24/d6c/le5 0 2024-09-11T00:07:27.194 INFO:tasks.workunit.client.0.smithi111.stdout:4/690: rename d18/d20/f46 to d18/d1f/d33/fd4 0 2024-09-11T00:07:27.198 INFO:tasks.workunit.client.1.smithi203.stdout:1/797: mkdir d8/d19/d60/d90/d3e/d4b/d80/da2/d116 0 2024-09-11T00:07:27.200 INFO:tasks.workunit.client.0.smithi111.stdout:9/767: getdents d6/db/d34/d37/d4c/d7f/d97 0 2024-09-11T00:07:27.202 INFO:tasks.workunit.client.0.smithi111.stdout:8/740: dwrite d11/d8e/fbf [0,4194304] 0 2024-09-11T00:07:27.205 INFO:tasks.workunit.client.0.smithi111.stdout:8/741: chown d11/d21/d6f/dab/fbe 746 1 2024-09-11T00:07:27.207 INFO:tasks.workunit.client.0.smithi111.stdout:7/755: link dd/d49/l72 dd/d1d/d1f/lee 0 2024-09-11T00:07:27.208 INFO:tasks.workunit.client.1.smithi203.stdout:1/798: mknod d8/d19/d60/d90/d3e/d4b/d80/d8d/da3/c117 0 2024-09-11T00:07:27.209 INFO:tasks.workunit.client.0.smithi111.stdout:4/691: symlink d18/d1f/d36/ld5 0 2024-09-11T00:07:27.210 INFO:tasks.workunit.client.1.smithi203.stdout:9/673: dwrite d6/de/d19/fc9 [0,4194304] 0 2024-09-11T00:07:27.214 INFO:tasks.workunit.client.0.smithi111.stdout:9/768: mknod d6/dc/cf5 0 2024-09-11T00:07:27.215 INFO:tasks.workunit.client.1.smithi203.stdout:9/674: fsync d6/de/d19/f31 0 2024-09-11T00:07:27.217 INFO:tasks.workunit.client.0.smithi111.stdout:6/689: link d7/d22/d2c/d38/d56/c6c d7/d22/d26/d95/dd6/ced 0 2024-09-11T00:07:27.219 INFO:tasks.workunit.client.0.smithi111.stdout:6/690: chown d7/d22/d3f/d74/d7f/c63 15386 1 2024-09-11T00:07:27.219 INFO:tasks.workunit.client.0.smithi111.stdout:4/692: symlink d18/d20/d40/d78/d79/d90/ld6 0 2024-09-11T00:07:27.219 INFO:tasks.workunit.client.1.smithi203.stdout:1/799: creat d8/d19/d60/d90/d3e/d107/f118 x:0 0 0 2024-09-11T00:07:27.220 INFO:tasks.workunit.client.0.smithi111.stdout:1/706: dread d2/de/d12/d3c/d4b/d6a/d63/d73/da1/f50 [0,4194304] 0 2024-09-11T00:07:27.224 INFO:tasks.workunit.client.0.smithi111.stdout:9/769: unlink d6/db/d1b/d41/d80/fbb 0 2024-09-11T00:07:27.227 INFO:tasks.workunit.client.0.smithi111.stdout:0/746: write d3/f65 [1086073,30398] 0 2024-09-11T00:07:27.230 INFO:tasks.workunit.client.1.smithi203.stdout:1/800: rename d8/d9/d15/d35/d81/da1 to d8/d119 0 2024-09-11T00:07:27.232 INFO:tasks.workunit.client.0.smithi111.stdout:1/707: creat d2/de/d93/fea x:0 0 0 2024-09-11T00:07:27.233 INFO:tasks.workunit.client.0.smithi111.stdout:6/691: mknod d7/d22/d2c/cee 0 2024-09-11T00:07:27.234 INFO:tasks.workunit.client.0.smithi111.stdout:3/748: write d1c/d1d/d22/f5b [1196681,78761] 0 2024-09-11T00:07:27.234 INFO:tasks.workunit.client.0.smithi111.stdout:0/747: truncate d3/d13/d1e/deb/fb7 1267033 0 2024-09-11T00:07:27.234 INFO:tasks.workunit.client.0.smithi111.stdout:4/693: truncate d18/d20/d40/f42 3780776 0 2024-09-11T00:07:27.236 INFO:tasks.workunit.client.0.smithi111.stdout:6/692: read d7/d22/d3f/f42 [153695,55067] 0 2024-09-11T00:07:27.237 INFO:tasks.workunit.client.1.smithi203.stdout:1/801: unlink d8/d19/d60/d90/d3e/d4b/d80/d8d/db0/f10e 0 2024-09-11T00:07:27.240 INFO:tasks.workunit.client.0.smithi111.stdout:5/758: dread d10/d1e/d23/d30/dd8/d7e/fb1 [0,4194304] 0 2024-09-11T00:07:27.242 INFO:tasks.workunit.client.0.smithi111.stdout:4/694: truncate d18/d20/d3c/d5e/daa/fc6 873785 0 2024-09-11T00:07:27.242 INFO:tasks.workunit.client.1.smithi203.stdout:1/802: chown d8/d11/fae 98300663 1 2024-09-11T00:07:27.243 INFO:tasks.workunit.client.1.smithi203.stdout:1/803: chown d8/d19/c6f 6 1 2024-09-11T00:07:27.244 INFO:tasks.workunit.client.0.smithi111.stdout:4/695: chown d18/d3b/dae 14814 1 2024-09-11T00:07:27.246 INFO:tasks.workunit.client.0.smithi111.stdout:7/756: chown dd/d48/f5f 5663437 1 2024-09-11T00:07:27.248 INFO:tasks.workunit.client.0.smithi111.stdout:7/757: read dd/d1d/f39 [3350599,47897] 0 2024-09-11T00:07:27.249 INFO:tasks.workunit.client.1.smithi203.stdout:1/804: mkdir d8/d9/d15/d27/d11a 0 2024-09-11T00:07:27.250 INFO:tasks.workunit.client.0.smithi111.stdout:8/742: dwrite d11/d21/d6f/dab/fbe [0,4194304] 0 2024-09-11T00:07:27.257 INFO:tasks.workunit.client.0.smithi111.stdout:8/743: chown d11/d21/d6f/f7b 417760 1 2024-09-11T00:07:27.259 INFO:tasks.workunit.client.1.smithi203.stdout:1/805: rename d8/d9/d15/d27/l44 to d8/d9/d15/d27/d102/d10c/l11b 0 2024-09-11T00:07:27.260 INFO:tasks.workunit.client.1.smithi203.stdout:9/675: dread d6/de/d19/d24/f6d [0,4194304] 0 2024-09-11T00:07:27.261 INFO:tasks.workunit.client.0.smithi111.stdout:4/696: creat d18/d20/d40/d78/fd7 x:0 0 0 2024-09-11T00:07:27.262 INFO:tasks.workunit.client.0.smithi111.stdout:1/708: write d2/de/f53 [359811,74887] 0 2024-09-11T00:07:27.262 INFO:tasks.workunit.client.0.smithi111.stdout:3/749: link d1c/d1d/d22/d23/c4b d1c/d1d/c107 0 2024-09-11T00:07:27.263 INFO:tasks.workunit.client.1.smithi203.stdout:1/806: rmdir d8/d28 39 2024-09-11T00:07:27.268 INFO:tasks.workunit.client.0.smithi111.stdout:6/693: dwrite d7/d2b/f5b [0,4194304] 0 2024-09-11T00:07:27.268 INFO:tasks.workunit.client.1.smithi203.stdout:9/676: read d6/de/d19/d24/d54/f9d [825825,70829] 0 2024-09-11T00:07:27.273 INFO:tasks.workunit.client.1.smithi203.stdout:5/746: sync 2024-09-11T00:07:27.273 INFO:tasks.workunit.client.1.smithi203.stdout:4/584: sync 2024-09-11T00:07:27.273 INFO:tasks.workunit.client.1.smithi203.stdout:3/739: sync 2024-09-11T00:07:27.273 INFO:tasks.workunit.client.0.smithi111.stdout:8/744: mknod d11/d23/cea 0 2024-09-11T00:07:27.274 INFO:tasks.workunit.client.0.smithi111.stdout:4/697: mknod d18/d3b/d61/cd8 0 2024-09-11T00:07:27.276 INFO:tasks.workunit.client.1.smithi203.stdout:4/585: symlink db/d12/d15/lbb 0 2024-09-11T00:07:27.276 INFO:tasks.workunit.client.0.smithi111.stdout:0/748: dwrite d3/d13/d1e/d29/db0/fb8 [0,4194304] 0 2024-09-11T00:07:27.277 INFO:tasks.workunit.client.1.smithi203.stdout:3/740: mkdir d8/da/d11/d109 0 2024-09-11T00:07:27.280 INFO:tasks.workunit.client.1.smithi203.stdout:1/807: rename d8/d19/d60/d90/d3e/c7d to d8/d28/c11c 0 2024-09-11T00:07:27.284 INFO:tasks.workunit.client.0.smithi111.stdout:3/750: truncate d1c/d1d/d22/d23/d58/fbb 4419938 0 2024-09-11T00:07:27.285 INFO:tasks.workunit.client.0.smithi111.stdout:8/745: creat d11/d23/d2c/feb x:0 0 0 2024-09-11T00:07:27.286 INFO:tasks.workunit.client.0.smithi111.stdout:7/758: dwrite dd/d1d/d4b/dad/fe0 [0,4194304] 0 2024-09-11T00:07:27.287 INFO:tasks.workunit.client.0.smithi111.stdout:0/749: dread - d3/d13/d1e/d29/d49/df2/ff9 zero size 2024-09-11T00:07:27.290 INFO:tasks.workunit.client.1.smithi203.stdout:3/741: mknod d8/da/d37/d53/dea/de5/d103/c10a 0 2024-09-11T00:07:27.294 INFO:tasks.workunit.client.0.smithi111.stdout:7/759: write dd/d1d/d2d/f89 [1276685,35351] 0 2024-09-11T00:07:27.294 INFO:tasks.workunit.client.0.smithi111.stdout:5/759: dwrite d10/d1e/d23/d26/f3e [0,4194304] 0 2024-09-11T00:07:27.295 INFO:tasks.workunit.client.1.smithi203.stdout:9/677: rename d6/de/d32/d52/f73 to d6/de/fe6 0 2024-09-11T00:07:27.295 INFO:tasks.workunit.client.0.smithi111.stdout:3/751: write d1c/d1d/d86/f93 [641306,97903] 0 2024-09-11T00:07:27.295 INFO:tasks.workunit.client.0.smithi111.stdout:4/698: creat d18/d20/d3c/d5e/d75/d8d/dce/fd9 x:0 0 0 2024-09-11T00:07:27.297 INFO:tasks.workunit.client.1.smithi203.stdout:3/742: rmdir d8/da/d37/d53/da2 39 2024-09-11T00:07:27.298 INFO:tasks.workunit.client.1.smithi203.stdout:4/586: getdents db/dd/d16/d38/d3c 0 2024-09-11T00:07:27.299 INFO:tasks.workunit.client.1.smithi203.stdout:4/587: readlink db/l70 0 2024-09-11T00:07:27.301 INFO:tasks.workunit.client.1.smithi203.stdout:5/747: rename dc/dd/d15/dbd/f6a to dc/dd/d56/ffc 0 2024-09-11T00:07:27.302 INFO:tasks.workunit.client.1.smithi203.stdout:9/678: mknod d6/de/dc4/ce7 0 2024-09-11T00:07:27.303 INFO:tasks.workunit.client.1.smithi203.stdout:5/748: write dc/dd/d1e/dc6/ff3 [341866,24393] 0 2024-09-11T00:07:27.305 INFO:tasks.workunit.client.0.smithi111.stdout:4/699: chown d18/d20/d3c/d5e/d75/d8d/f96 40444475 1 2024-09-11T00:07:27.310 INFO:tasks.workunit.client.0.smithi111.stdout:3/752: dread - d1c/d21/f6c zero size 2024-09-11T00:07:27.310 INFO:tasks.workunit.client.1.smithi203.stdout:3/743: symlink d8/da/d37/d83/d65/d8b/l10b 0 2024-09-11T00:07:27.311 INFO:tasks.workunit.client.1.smithi203.stdout:4/588: read - db/d12/d15/f64 zero size 2024-09-11T00:07:27.312 INFO:tasks.workunit.client.0.smithi111.stdout:4/700: fdatasync d18/d1f/d36/fb4 0 2024-09-11T00:07:27.312 INFO:tasks.workunit.client.1.smithi203.stdout:1/808: rename d8/d9/d15/d35/d81/db9/ff7 to d8/d28/d64/da0/f11d 0 2024-09-11T00:07:27.319 INFO:tasks.workunit.client.1.smithi203.stdout:4/589: creat db/dd/d16/d38/fbc x:0 0 0 2024-09-11T00:07:27.319 INFO:tasks.workunit.client.0.smithi111.stdout:0/750: dwrite f2 [0,4194304] 0 2024-09-11T00:07:27.321 INFO:tasks.workunit.client.0.smithi111.stdout:1/709: dwrite d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/f61 [0,4194304] 0 2024-09-11T00:07:27.323 INFO:tasks.workunit.client.0.smithi111.stdout:4/701: mkdir d18/d1f/d36/d95/dda 0 2024-09-11T00:07:27.323 INFO:tasks.workunit.client.0.smithi111.stdout:6/694: dread d7/d22/d3f/d74/d7f/d61/f8f [0,4194304] 0 2024-09-11T00:07:27.327 INFO:tasks.workunit.client.1.smithi203.stdout:5/749: dwrite dc/d4f/d5c/dc9/fe2 [0,4194304] 0 2024-09-11T00:07:27.328 INFO:tasks.workunit.client.1.smithi203.stdout:3/744: getdents d8/da/d5c/d80 0 2024-09-11T00:07:27.329 INFO:tasks.workunit.client.0.smithi111.stdout:6/695: symlink d7/d22/d26/d87/d7a/lef 0 2024-09-11T00:07:27.329 INFO:tasks.workunit.client.0.smithi111.stdout:7/760: dread dd/d1d/d7e/dc8/f64 [0,4194304] 0 2024-09-11T00:07:27.330 INFO:tasks.workunit.client.1.smithi203.stdout:5/750: chown dc/dd/d15/faf 10688 1 2024-09-11T00:07:27.334 INFO:tasks.workunit.client.0.smithi111.stdout:1/710: symlink d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/leb 0 2024-09-11T00:07:27.343 INFO:tasks.workunit.client.1.smithi203.stdout:5/751: fdatasync dc/d4f/d5c/f69 0 2024-09-11T00:07:27.347 INFO:tasks.workunit.client.0.smithi111.stdout:1/711: creat d2/de/d12/d3c/fec x:0 0 0 2024-09-11T00:07:27.352 INFO:tasks.workunit.client.0.smithi111.stdout:1/712: symlink d2/d77/led 0 2024-09-11T00:07:27.354 INFO:tasks.workunit.client.1.smithi203.stdout:3/745: dwrite d8/d17/ff2 [0,4194304] 0 2024-09-11T00:07:27.355 INFO:tasks.workunit.client.0.smithi111.stdout:0/751: dread d3/d1c/f6a [0,4194304] 0 2024-09-11T00:07:27.359 INFO:tasks.workunit.client.0.smithi111.stdout:6/696: dwrite d7/d22/d3f/d74/d7f/d61/d6a/dba/f93 [4194304,4194304] 0 2024-09-11T00:07:27.361 INFO:tasks.workunit.client.1.smithi203.stdout:5/752: getdents dc/d2b 0 2024-09-11T00:07:27.366 INFO:tasks.workunit.client.0.smithi111.stdout:0/752: rename d3/dc/f3f to d3/d13/d1e/d29/db0/dce/f10b 0 2024-09-11T00:07:27.369 INFO:tasks.workunit.client.0.smithi111.stdout:4/702: dread d18/d20/f85 [0,4194304] 0 2024-09-11T00:07:27.370 INFO:tasks.workunit.client.0.smithi111.stdout:0/753: read d3/d74/fae [558327,5971] 0 2024-09-11T00:07:27.376 INFO:tasks.workunit.client.0.smithi111.stdout:4/703: link f5 d18/d1f/fdb 0 2024-09-11T00:07:27.380 INFO:tasks.workunit.client.0.smithi111.stdout:6/697: dwrite d7/d22/d26/d87/d41/d77/fce [0,4194304] 0 2024-09-11T00:07:27.383 INFO:tasks.workunit.client.0.smithi111.stdout:0/754: creat d3/d13/d1e/deb/d61/d93/f10c x:0 0 0 2024-09-11T00:07:27.384 INFO:tasks.workunit.client.0.smithi111.stdout:4/704: dread - d18/d1f/d36/d95/fa3 zero size 2024-09-11T00:07:27.387 INFO:tasks.workunit.client.0.smithi111.stdout:5/760: truncate d10/d1e/d23/d2b/dad/fca 2395196 0 2024-09-11T00:07:27.394 INFO:tasks.workunit.client.0.smithi111.stdout:4/705: mkdir d18/d20/d3c/d5e/daa/dbb/ddc 0 2024-09-11T00:07:27.397 INFO:tasks.workunit.client.0.smithi111.stdout:5/761: symlink d10/d1e/d23/d30/d59/d52/d85/dd2/df1/lf9 0 2024-09-11T00:07:27.398 INFO:tasks.workunit.client.0.smithi111.stdout:1/713: dread d2/de/d12/d3c/d4b/d6a/d63/f9d [0,4194304] 0 2024-09-11T00:07:27.399 INFO:tasks.workunit.client.1.smithi203.stdout:9/679: dwrite d6/de/dc4/f42 [0,4194304] 0 2024-09-11T00:07:27.400 INFO:tasks.workunit.client.0.smithi111.stdout:0/755: rename d3/d13/d1e/fe0 to d3/d13/d1e/d29/db0/f10d 0 2024-09-11T00:07:27.401 INFO:tasks.workunit.client.0.smithi111.stdout:0/756: chown d3/daf/db2 111861067 1 2024-09-11T00:07:27.402 INFO:tasks.workunit.client.1.smithi203.stdout:9/680: dread - d6/de/d19/d24/d54/db2/fdd zero size 2024-09-11T00:07:27.403 INFO:tasks.workunit.client.0.smithi111.stdout:4/706: truncate d18/d1f/f5f 2150002 0 2024-09-11T00:07:27.406 INFO:tasks.workunit.client.1.smithi203.stdout:4/590: write db/dd/d16/d38/f3b [4200019,116373] 0 2024-09-11T00:07:27.410 INFO:tasks.workunit.client.1.smithi203.stdout:1/809: truncate d8/d9/d15/d35/d81/db9/fca 4134145 0 2024-09-11T00:07:27.410 INFO:tasks.workunit.client.0.smithi111.stdout:0/757: rmdir d3/d13/d1e 39 2024-09-11T00:07:27.413 INFO:tasks.workunit.client.0.smithi111.stdout:4/707: fdatasync d18/f1b 0 2024-09-11T00:07:27.414 INFO:tasks.workunit.client.0.smithi111.stdout:7/761: write dd/d48/d69/f6b [65673,105150] 0 2024-09-11T00:07:27.415 INFO:tasks.workunit.client.0.smithi111.stdout:0/758: rmdir d3/d26 39 2024-09-11T00:07:27.416 INFO:tasks.workunit.client.1.smithi203.stdout:4/591: write db/dd/f13 [5862110,5978] 0 2024-09-11T00:07:27.421 INFO:tasks.workunit.client.0.smithi111.stdout:6/698: rename d7/d22/d3f/d74/d7f/d61/d6a/l9a to d7/d22/d26/lf0 0 2024-09-11T00:07:27.426 INFO:tasks.workunit.client.1.smithi203.stdout:7/678: sync 2024-09-11T00:07:27.427 INFO:tasks.workunit.client.0.smithi111.stdout:0/759: mknod d3/d13/d1e/c10e 0 2024-09-11T00:07:27.428 INFO:tasks.workunit.client.0.smithi111.stdout:6/699: dread d7/d22/d1d/d69/db4/fdf [0,4194304] 0 2024-09-11T00:07:27.429 INFO:tasks.workunit.client.0.smithi111.stdout:4/708: dread d18/d1f/d33/f59 [0,4194304] 0 2024-09-11T00:07:27.431 INFO:tasks.workunit.client.1.smithi203.stdout:3/746: dwrite d8/da/d11/fb6 [0,4194304] 0 2024-09-11T00:07:27.436 INFO:tasks.workunit.client.0.smithi111.stdout:1/714: dread d2/de/f25 [0,4194304] 0 2024-09-11T00:07:27.440 INFO:tasks.workunit.client.0.smithi111.stdout:5/762: dread d10/d1e/d23/d30/f37 [0,4194304] 0 2024-09-11T00:07:27.441 INFO:tasks.workunit.client.0.smithi111.stdout:7/762: getdents dd/d1d/d7e 0 2024-09-11T00:07:27.445 INFO:tasks.workunit.client.0.smithi111.stdout:0/760: creat d3/d13/f10f x:0 0 0 2024-09-11T00:07:27.445 INFO:tasks.workunit.client.0.smithi111.stdout:6/700: dwrite d7/d22/fa8 [0,4194304] 0 2024-09-11T00:07:27.446 INFO:tasks.workunit.client.0.smithi111.stdout:4/709: dwrite d18/d20/f23 [4194304,4194304] 0 2024-09-11T00:07:27.452 INFO:tasks.workunit.client.0.smithi111.stdout:6/701: dread - d7/d22/d3f/d74/d7f/d79/fb2 zero size 2024-09-11T00:07:27.463 INFO:tasks.workunit.client.1.smithi203.stdout:9/681: creat d6/de/d32/d52/fe8 x:0 0 0 2024-09-11T00:07:27.465 INFO:tasks.workunit.client.1.smithi203.stdout:4/592: fsync db/d12/d15/f64 0 2024-09-11T00:07:27.466 INFO:tasks.workunit.client.1.smithi203.stdout:7/679: fsync dd/d1c/d52/d8f/f3f 0 2024-09-11T00:07:27.468 INFO:tasks.workunit.client.1.smithi203.stdout:9/682: chown d6/de/d32 250 1 2024-09-11T00:07:27.475 INFO:tasks.workunit.client.1.smithi203.stdout:3/747: rename d8/da/db3/f4d to d8/da/d37/d53/da2/de1/f10c 0 2024-09-11T00:07:27.476 INFO:tasks.workunit.client.1.smithi203.stdout:7/680: rmdir dd/d1c/d52/d8f/d31/d4a/d6e 39 2024-09-11T00:07:27.476 INFO:tasks.workunit.client.1.smithi203.stdout:4/593: creat db/dd/d16/d38/d3c/d41/fbd x:0 0 0 2024-09-11T00:07:27.480 INFO:tasks.workunit.client.1.smithi203.stdout:7/681: creat dd/ff9 x:0 0 0 2024-09-11T00:07:27.483 INFO:tasks.workunit.client.1.smithi203.stdout:4/594: link db/f8a db/d12/d15/d2a/d71/fbe 0 2024-09-11T00:07:27.484 INFO:tasks.workunit.client.1.smithi203.stdout:1/810: dwrite d8/d19/d60/d90/f98 [0,4194304] 0 2024-09-11T00:07:27.485 INFO:tasks.workunit.client.1.smithi203.stdout:7/682: mknod dd/d1c/d7c/cfa 0 2024-09-11T00:07:27.485 INFO:tasks.workunit.client.1.smithi203.stdout:4/595: chown db/dd/d16/f6e 235 1 2024-09-11T00:07:27.488 INFO:tasks.workunit.client.1.smithi203.stdout:7/683: creat dd/d1c/d7c/d8c/ffb x:0 0 0 2024-09-11T00:07:27.494 INFO:tasks.workunit.client.1.smithi203.stdout:1/811: rename d8/d19/d60/d90/d3e/d4b/d80/d8d/db0/c111 to d8/d19/d60/d90/d3e/d96/c11e 0 2024-09-11T00:07:27.495 INFO:tasks.workunit.client.1.smithi203.stdout:3/748: dwrite d8/da/d37/d83/d6a/dad/f100 [0,4194304] 0 2024-09-11T00:07:27.498 INFO:tasks.workunit.client.1.smithi203.stdout:7/684: mkdir dd/d1c/d52/d8f/d31/d58/d93/d98/dfc 0 2024-09-11T00:07:27.500 INFO:tasks.workunit.client.0.smithi111.stdout:2/685: sync 2024-09-11T00:07:27.500 INFO:tasks.workunit.client.1.smithi203.stdout:3/749: mkdir d8/da/d5c/d6b/d10d 0 2024-09-11T00:07:27.502 INFO:tasks.workunit.client.1.smithi203.stdout:7/685: symlink dd/d4d/d7f/lfd 0 2024-09-11T00:07:27.504 INFO:tasks.workunit.client.1.smithi203.stdout:1/812: creat d8/d9/f11f x:0 0 0 2024-09-11T00:07:27.504 INFO:tasks.workunit.client.0.smithi111.stdout:0/761: symlink d3/d13/l110 0 2024-09-11T00:07:27.507 INFO:tasks.workunit.client.0.smithi111.stdout:6/702: write d7/d22/fa8 [1787851,118074] 0 2024-09-11T00:07:27.507 INFO:tasks.workunit.client.1.smithi203.stdout:3/750: chown d8/da/d37/d83/d65/c7f 3572369 1 2024-09-11T00:07:27.510 INFO:tasks.workunit.client.1.smithi203.stdout:1/813: mknod d8/d19/d60/c120 0 2024-09-11T00:07:27.514 INFO:tasks.workunit.client.1.smithi203.stdout:3/751: mknod d8/d17/c10e 0 2024-09-11T00:07:27.514 INFO:tasks.workunit.client.1.smithi203.stdout:4/596: dread db/dd/d16/d38/d3c/f68 [0,4194304] 0 2024-09-11T00:07:27.514 INFO:tasks.workunit.client.1.smithi203.stdout:1/814: read d8/d19/ff8 [622209,125716] 0 2024-09-11T00:07:27.516 INFO:tasks.workunit.client.0.smithi111.stdout:5/763: getdents d10/d1e/d23/d26 0 2024-09-11T00:07:27.516 INFO:tasks.workunit.client.0.smithi111.stdout:7/763: dread dd/f18 [0,4194304] 0 2024-09-11T00:07:27.516 INFO:tasks.workunit.client.0.smithi111.stdout:0/762: creat d3/d13/d1e/d29/d49/df2/f111 x:0 0 0 2024-09-11T00:07:27.522 INFO:tasks.workunit.client.0.smithi111.stdout:6/703: write d7/d22/d26/d95/fdc [313554,5021] 0 2024-09-11T00:07:27.524 INFO:tasks.workunit.client.0.smithi111.stdout:5/764: creat d10/d1e/d23/d30/d59/d52/dd6/ffa x:0 0 0 2024-09-11T00:07:27.526 INFO:tasks.workunit.client.1.smithi203.stdout:3/752: unlink d8/da/d5c/fa0 0 2024-09-11T00:07:27.529 INFO:tasks.workunit.client.1.smithi203.stdout:4/597: creat db/d12/d15/d2a/d88/fbf x:0 0 0 2024-09-11T00:07:27.530 INFO:tasks.workunit.client.0.smithi111.stdout:7/764: symlink dd/d48/d69/dbe/dc4/lef 0 2024-09-11T00:07:27.531 INFO:tasks.workunit.client.0.smithi111.stdout:4/710: dread d18/d20/f30 [0,4194304] 0 2024-09-11T00:07:27.535 INFO:tasks.workunit.client.1.smithi203.stdout:3/753: fsync d8/da/d5c/d6b/d6c/fac 0 2024-09-11T00:07:27.536 INFO:tasks.workunit.client.0.smithi111.stdout:7/765: mknod dd/d1d/d2d/cf0 0 2024-09-11T00:07:27.539 INFO:tasks.workunit.client.1.smithi203.stdout:1/815: link d8/f68 d8/d19/d60/d90/d3e/d4b/d80/d91/dac/f121 0 2024-09-11T00:07:27.540 INFO:tasks.workunit.client.0.smithi111.stdout:4/711: dread d18/d20/d40/f8f [0,4194304] 0 2024-09-11T00:07:27.541 INFO:tasks.workunit.client.0.smithi111.stdout:5/765: mknod d10/d1e/d23/cfb 0 2024-09-11T00:07:27.545 INFO:tasks.workunit.client.0.smithi111.stdout:6/704: dwrite d7/d22/d26/d87/fa6 [0,4194304] 0 2024-09-11T00:07:27.546 INFO:tasks.workunit.client.1.smithi203.stdout:4/598: dwrite db/dd/d16/d38/f3b [0,4194304] 0 2024-09-11T00:07:27.547 INFO:tasks.workunit.client.0.smithi111.stdout:4/712: creat d18/d20/d40/d78/d79/fdd x:0 0 0 2024-09-11T00:07:27.549 INFO:tasks.workunit.client.0.smithi111.stdout:4/713: write d18/f1b [7860686,13873] 0 2024-09-11T00:07:27.552 INFO:tasks.workunit.client.1.smithi203.stdout:2/757: sync 2024-09-11T00:07:27.552 INFO:tasks.workunit.client.1.smithi203.stdout:8/633: sync 2024-09-11T00:07:27.552 INFO:tasks.workunit.client.1.smithi203.stdout:0/670: sync 2024-09-11T00:07:27.552 INFO:tasks.workunit.client.1.smithi203.stdout:6/691: sync 2024-09-11T00:07:27.554 INFO:tasks.workunit.client.1.smithi203.stdout:1/816: creat d8/d19/d60/d90/f122 x:0 0 0 2024-09-11T00:07:27.557 INFO:tasks.workunit.client.1.smithi203.stdout:6/692: write d0/f93 [112361,123230] 0 2024-09-11T00:07:27.557 INFO:tasks.workunit.client.0.smithi111.stdout:7/766: link dd/d1d/d1f/f81 dd/da6/ff1 0 2024-09-11T00:07:27.559 INFO:tasks.workunit.client.0.smithi111.stdout:9/770: sync 2024-09-11T00:07:27.562 INFO:tasks.workunit.client.1.smithi203.stdout:4/599: mknod db/dd/d16/d38/d3c/cc0 0 2024-09-11T00:07:27.564 INFO:tasks.workunit.client.0.smithi111.stdout:4/714: mkdir d18/d1f/d36/d95/dde 0 2024-09-11T00:07:27.568 INFO:tasks.workunit.client.0.smithi111.stdout:7/767: truncate dd/d48/fae 84401 0 2024-09-11T00:07:27.570 INFO:tasks.workunit.client.1.smithi203.stdout:8/634: creat d1/d13/d17/d2f/d52/d49/fd1 x:0 0 0 2024-09-11T00:07:27.571 INFO:tasks.workunit.client.0.smithi111.stdout:9/771: rename d6/db/d1b/f4e to d6/db/d7a/d9a/ff6 0 2024-09-11T00:07:27.573 INFO:tasks.workunit.client.1.smithi203.stdout:0/671: dread d0/d2/f9c [0,4194304] 0 2024-09-11T00:07:27.576 INFO:tasks.workunit.client.0.smithi111.stdout:4/715: symlink d18/d20/d4a/d6b/ldf 0 2024-09-11T00:07:27.578 INFO:tasks.workunit.client.1.smithi203.stdout:4/600: creat db/d12/d15/d2a/d88/fc1 x:0 0 0 2024-09-11T00:07:27.578 INFO:tasks.workunit.client.0.smithi111.stdout:7/768: creat dd/d1d/d4b/dad/ff2 x:0 0 0 2024-09-11T00:07:27.582 INFO:tasks.workunit.client.1.smithi203.stdout:1/817: mknod d8/d19/d60/d90/c123 0 2024-09-11T00:07:27.582 INFO:tasks.workunit.client.0.smithi111.stdout:6/705: link d7/d22/d1d/f5f d7/d22/d1d/d69/ff1 0 2024-09-11T00:07:27.585 INFO:tasks.workunit.client.1.smithi203.stdout:1/818: write d8/d9/d15/ff3 [2699349,110317] 0 2024-09-11T00:07:27.585 INFO:tasks.workunit.client.0.smithi111.stdout:4/716: fsync d18/d20/d40/f8f 0 2024-09-11T00:07:27.590 INFO:tasks.workunit.client.0.smithi111.stdout:1/715: sync 2024-09-11T00:07:27.590 INFO:tasks.workunit.client.0.smithi111.stdout:8/746: sync 2024-09-11T00:07:27.590 INFO:tasks.workunit.client.0.smithi111.stdout:3/753: sync 2024-09-11T00:07:27.592 INFO:tasks.workunit.client.0.smithi111.stdout:1/716: dread - d2/de/d12/d3c/d4b/d6a/d3a/fd8 zero size 2024-09-11T00:07:27.596 INFO:tasks.workunit.client.1.smithi203.stdout:0/672: dwrite d0/d2/d37/d5b/fc0 [0,4194304] 0 2024-09-11T00:07:27.597 INFO:tasks.workunit.client.1.smithi203.stdout:5/753: sync 2024-09-11T00:07:27.597 INFO:tasks.workunit.client.1.smithi203.stdout:6/693: dread d0/d54/d9c/d35/d39/f56 [0,4194304] 0 2024-09-11T00:07:27.598 INFO:tasks.workunit.client.0.smithi111.stdout:7/769: creat dd/d48/d69/dea/ff3 x:0 0 0 2024-09-11T00:07:27.599 INFO:tasks.workunit.client.1.smithi203.stdout:9/683: write d6/de/d19/d24/f6f [745872,18854] 0 2024-09-11T00:07:27.600 INFO:tasks.workunit.client.1.smithi203.stdout:6/694: stat d0/d32/d5a/fba 0 2024-09-11T00:07:27.602 INFO:tasks.workunit.client.0.smithi111.stdout:4/717: mkdir d18/d20/de0 0 2024-09-11T00:07:27.603 INFO:tasks.workunit.client.0.smithi111.stdout:8/747: symlink d11/d21/d6f/lec 0 2024-09-11T00:07:27.607 INFO:tasks.workunit.client.0.smithi111.stdout:3/754: mknod d1c/d1d/d86/c108 0 2024-09-11T00:07:27.608 INFO:tasks.workunit.client.0.smithi111.stdout:6/706: mknod d7/d22/d2c/dea/cf2 0 2024-09-11T00:07:27.609 INFO:tasks.workunit.client.1.smithi203.stdout:8/635: link d1/d13/d43/d46/c72 d1/d13/d43/d46/cd2 0 2024-09-11T00:07:27.609 INFO:tasks.workunit.client.1.smithi203.stdout:2/758: getdents d13/d15/d19/d1c/d73/d7a 0 2024-09-11T00:07:27.610 INFO:tasks.workunit.client.1.smithi203.stdout:2/759: readlink d13/ddb/lf9 0 2024-09-11T00:07:27.611 INFO:tasks.workunit.client.1.smithi203.stdout:2/760: dread - d13/fb2 zero size 2024-09-11T00:07:27.612 INFO:tasks.workunit.client.0.smithi111.stdout:1/717: rename d2/de/d93/d9f/c5c to d2/de/d12/dc7/cee 0 2024-09-11T00:07:27.615 INFO:tasks.workunit.client.1.smithi203.stdout:0/673: creat d0/d2/d37/d5b/fe3 x:0 0 0 2024-09-11T00:07:27.616 INFO:tasks.workunit.client.1.smithi203.stdout:5/754: fdatasync dc/d2b/f93 0 2024-09-11T00:07:27.617 INFO:tasks.workunit.client.0.smithi111.stdout:8/748: unlink d11/d8e/lb8 0 2024-09-11T00:07:27.619 INFO:tasks.workunit.client.1.smithi203.stdout:9/684: creat d6/de/d32/d52/d55/d66/fe9 x:0 0 0 2024-09-11T00:07:27.621 INFO:tasks.workunit.client.0.smithi111.stdout:4/718: dwrite d18/d20/d40/d78/fd7 [0,4194304] 0 2024-09-11T00:07:27.622 INFO:tasks.workunit.client.1.smithi203.stdout:7/686: write dd/d1c/f78 [2826656,6161] 0 2024-09-11T00:07:27.624 INFO:tasks.workunit.client.1.smithi203.stdout:7/687: readlink dd/d1c/d52/l77 0 2024-09-11T00:07:27.625 INFO:tasks.workunit.client.0.smithi111.stdout:6/707: mknod d7/d22/d3f/d74/d7f/d79/cf3 0 2024-09-11T00:07:27.625 INFO:tasks.workunit.client.0.smithi111.stdout:2/686: dwrite d0/d3/d2e/f47 [0,4194304] 0 2024-09-11T00:07:27.626 INFO:tasks.workunit.client.1.smithi203.stdout:7/688: truncate dd/d1c/d52/d8f/fe3 1003592 0 2024-09-11T00:07:27.628 INFO:tasks.workunit.client.0.smithi111.stdout:1/718: creat d2/de/d93/fef x:0 0 0 2024-09-11T00:07:27.628 INFO:tasks.workunit.client.0.smithi111.stdout:0/763: write d3/d1c/f4a [667732,41455] 0 2024-09-11T00:07:27.629 INFO:tasks.workunit.client.1.smithi203.stdout:8/636: read d1/d13/f33 [1197758,38124] 0 2024-09-11T00:07:27.630 INFO:tasks.workunit.client.0.smithi111.stdout:2/687: chown d0/d3/d2e/f66 14791012 1 2024-09-11T00:07:27.631 INFO:tasks.workunit.client.1.smithi203.stdout:2/761: mkdir d13/d15/d19/d1c/dfd 0 2024-09-11T00:07:27.636 INFO:tasks.workunit.client.0.smithi111.stdout:8/749: mknod d11/d23/d2c/d7f/dde/ced 0 2024-09-11T00:07:27.637 INFO:tasks.workunit.client.1.smithi203.stdout:0/674: mkdir d0/d1d/d4c/de4 0 2024-09-11T00:07:27.639 INFO:tasks.workunit.client.1.smithi203.stdout:9/685: dwrite d6/de/d19/fc9 [0,4194304] 0 2024-09-11T00:07:27.642 INFO:tasks.workunit.client.1.smithi203.stdout:5/755: chown dc/d91/cf2 978330 1 2024-09-11T00:07:27.646 INFO:tasks.workunit.client.1.smithi203.stdout:5/756: fsync dc/dd/d13/f48 0 2024-09-11T00:07:27.647 INFO:tasks.workunit.client.1.smithi203.stdout:6/695: link d0/d54/d9c/d35/d39/f56 d0/d54/d9c/d35/d38/dc0/ddb/fe1 0 2024-09-11T00:07:27.651 INFO:tasks.workunit.client.0.smithi111.stdout:7/770: creat dd/d48/ff4 x:0 0 0 2024-09-11T00:07:27.652 INFO:tasks.workunit.client.1.smithi203.stdout:1/819: rename d8/d19/d60/d90/d3e/d4b/d80/da2/cf9 to d8/d19/d60/d90/c124 0 2024-09-11T00:07:27.654 INFO:tasks.workunit.client.0.smithi111.stdout:6/708: rmdir d7/d22/d3f/d74/d7f/d79/da4 39 2024-09-11T00:07:27.656 INFO:tasks.workunit.client.1.smithi203.stdout:7/689: fdatasync dd/d1c/d52/f8d 0 2024-09-11T00:07:27.657 INFO:tasks.workunit.client.1.smithi203.stdout:3/754: dwrite d8/d17/f1c [0,4194304] 0 2024-09-11T00:07:27.660 INFO:tasks.workunit.client.0.smithi111.stdout:5/766: dwrite d10/d1e/d23/d2b/d5c/fb7 [0,4194304] 0 2024-09-11T00:07:27.663 INFO:tasks.workunit.client.0.smithi111.stdout:5/767: write d10/d1e/d23/d30/d59/d52/fe4 [2207645,97283] 0 2024-09-11T00:07:27.667 INFO:tasks.workunit.client.0.smithi111.stdout:1/719: unlink d2/de/f5e 0 2024-09-11T00:07:27.676 INFO:tasks.workunit.client.0.smithi111.stdout:9/772: write d6/db/f83 [1849985,97946] 0 2024-09-11T00:07:27.676 INFO:tasks.workunit.client.1.smithi203.stdout:4/601: write db/dd/d16/d38/f99 [605642,111946] 0 2024-09-11T00:07:27.680 INFO:tasks.workunit.client.0.smithi111.stdout:7/771: rename dd/d1d/d1f/f9d to dd/d1d/d76/db6/ff5 0 2024-09-11T00:07:27.680 INFO:tasks.workunit.client.0.smithi111.stdout:9/773: chown d6/db/d1b/d41/d80/fad 667598303 1 2024-09-11T00:07:27.683 INFO:tasks.workunit.client.0.smithi111.stdout:6/709: unlink d7/d22/d2c/d38/d39/db3/lbb 0 2024-09-11T00:07:27.686 INFO:tasks.workunit.client.0.smithi111.stdout:1/720: truncate d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/d7b/fd6 163115 0 2024-09-11T00:07:27.687 INFO:tasks.workunit.client.1.smithi203.stdout:7/690: mkdir dd/d3b/d5b/ddd/dfe 0 2024-09-11T00:07:27.688 INFO:tasks.workunit.client.1.smithi203.stdout:7/691: chown dd/d3b/c54 17947 1 2024-09-11T00:07:27.689 INFO:tasks.workunit.client.1.smithi203.stdout:3/755: creat d8/da/d37/d53/dea/f10f x:0 0 0 2024-09-11T00:07:27.690 INFO:tasks.workunit.client.0.smithi111.stdout:0/764: dread d3/d13/d1e/deb/d61/d93/fa1 [0,4194304] 0 2024-09-11T00:07:27.691 INFO:tasks.workunit.client.0.smithi111.stdout:9/774: truncate d6/db/d1b/fd7 326075 0 2024-09-11T00:07:27.693 INFO:tasks.workunit.client.1.smithi203.stdout:2/762: truncate d13/d15/d19/f6c 831444 0 2024-09-11T00:07:27.694 INFO:tasks.workunit.client.0.smithi111.stdout:1/721: write d2/de/d12/f1c [4705476,127623] 0 2024-09-11T00:07:27.694 INFO:tasks.workunit.client.0.smithi111.stdout:8/750: dwrite ff [0,4194304] 0 2024-09-11T00:07:27.701 INFO:tasks.workunit.client.0.smithi111.stdout:5/768: getdents d10/d1e/d23/d30/d59/dd1/df6 0 2024-09-11T00:07:27.702 INFO:tasks.workunit.client.1.smithi203.stdout:4/602: mkdir db/d12/d15/d2a/d88/d95/dc2 0 2024-09-11T00:07:27.708 INFO:tasks.workunit.client.1.smithi203.stdout:1/820: mkdir d8/d9/d125 0 2024-09-11T00:07:27.713 INFO:tasks.workunit.client.0.smithi111.stdout:9/775: creat d6/db/db8/dce/ff7 x:0 0 0 2024-09-11T00:07:27.715 INFO:tasks.workunit.client.1.smithi203.stdout:2/763: dwrite d13/d15/d30/fc0 [0,4194304] 0 2024-09-11T00:07:27.716 INFO:tasks.workunit.client.1.smithi203.stdout:8/637: link d1/f3d d1/d13/d17/d2f/d52/d49/d68/dba/fd3 0 2024-09-11T00:07:27.716 INFO:tasks.workunit.client.0.smithi111.stdout:3/755: dwrite d1c/d21/f4f [0,4194304] 0 2024-09-11T00:07:27.719 INFO:tasks.workunit.client.0.smithi111.stdout:0/765: mknod d3/d13/d1e/d29/d70/c112 0 2024-09-11T00:07:27.719 INFO:tasks.workunit.client.0.smithi111.stdout:0/766: write d3/f65 [1773772,40002] 0 2024-09-11T00:07:27.722 INFO:tasks.workunit.client.0.smithi111.stdout:0/767: chown d3 1873 1 2024-09-11T00:07:27.722 INFO:tasks.workunit.client.0.smithi111.stdout:4/719: write d18/d20/d40/f42 [1567069,31048] 0 2024-09-11T00:07:27.722 INFO:tasks.workunit.client.1.smithi203.stdout:9/686: truncate d6/de/d32/d9e/fc8 3022773 0 2024-09-11T00:07:27.724 INFO:tasks.workunit.client.1.smithi203.stdout:9/687: readlink d6/de/d47/l8a 0 2024-09-11T00:07:27.727 INFO:tasks.workunit.client.0.smithi111.stdout:1/722: dwrite d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/f5b [4194304,4194304] 0 2024-09-11T00:07:27.727 INFO:tasks.workunit.client.1.smithi203.stdout:6/696: creat d0/d54/d9c/d35/d39/fe2 x:0 0 0 2024-09-11T00:07:27.729 INFO:tasks.workunit.client.0.smithi111.stdout:8/751: truncate d11/d23/d2c/d46/f8f 256313 0 2024-09-11T00:07:27.730 INFO:tasks.workunit.client.1.smithi203.stdout:6/697: truncate d0/d54/d9c/d35/fce 625612 0 2024-09-11T00:07:27.737 INFO:tasks.workunit.client.1.smithi203.stdout:1/821: creat d8/d19/d60/d90/d3e/d4b/d3a/f126 x:0 0 0 2024-09-11T00:07:27.739 INFO:tasks.workunit.client.0.smithi111.stdout:2/688: getdents d0/d3/de/d3b/d62/d6d 0 2024-09-11T00:07:27.740 INFO:tasks.workunit.client.0.smithi111.stdout:7/772: write dd/d1d/d2d/fcd [3252626,23482] 0 2024-09-11T00:07:27.743 INFO:tasks.workunit.client.0.smithi111.stdout:3/756: creat d1c/d1d/d86/f109 x:0 0 0 2024-09-11T00:07:27.748 INFO:tasks.workunit.client.1.smithi203.stdout:7/692: write dd/d1c/d52/d8f/f3f [2118747,7939] 0 2024-09-11T00:07:27.749 INFO:tasks.workunit.client.1.smithi203.stdout:2/764: write d13/d56/f8f [4020939,126694] 0 2024-09-11T00:07:27.750 INFO:tasks.workunit.client.0.smithi111.stdout:6/710: creat d7/d22/d3f/d74/d7f/d61/d6a/ff4 x:0 0 0 2024-09-11T00:07:27.751 INFO:tasks.workunit.client.1.smithi203.stdout:2/765: chown d13/d22/f38 1592513679 1 2024-09-11T00:07:27.753 INFO:tasks.workunit.client.1.smithi203.stdout:0/675: getdents d0/d87 0 2024-09-11T00:07:27.755 INFO:tasks.workunit.client.1.smithi203.stdout:2/766: dread - d13/d56/d69/d99/fcd zero size 2024-09-11T00:07:27.756 INFO:tasks.workunit.client.1.smithi203.stdout:9/688: creat d6/de/d19/d24/d6c/fea x:0 0 0 2024-09-11T00:07:27.761 INFO:tasks.workunit.client.0.smithi111.stdout:1/723: mkdir d2/d2b/dc9/df0 0 2024-09-11T00:07:27.766 INFO:tasks.workunit.client.1.smithi203.stdout:1/822: mkdir d8/d9/d15/d35/d81/db9/d127 0 2024-09-11T00:07:27.767 INFO:tasks.workunit.client.0.smithi111.stdout:7/773: symlink dd/d48/d69/dea/lf6 0 2024-09-11T00:07:27.768 INFO:tasks.workunit.client.1.smithi203.stdout:2/767: stat d13/l89 0 2024-09-11T00:07:27.769 INFO:tasks.workunit.client.1.smithi203.stdout:0/676: symlink d0/d2/d37/d5b/d73/le5 0 2024-09-11T00:07:27.771 INFO:tasks.workunit.client.1.smithi203.stdout:2/768: chown d13/d15/d30/d5a/d8b 354337 1 2024-09-11T00:07:27.773 INFO:tasks.workunit.client.0.smithi111.stdout:2/689: rename d0/d3/d12/fc4 to d0/d3/de/d3b/d62/d6d/da1/fe7 0 2024-09-11T00:07:27.775 INFO:tasks.workunit.client.1.smithi203.stdout:4/603: dwrite db/d12/d15/d2a/f87 [0,4194304] 0 2024-09-11T00:07:27.776 INFO:tasks.workunit.client.0.smithi111.stdout:2/690: write d0/d3/f56 [3449775,59665] 0 2024-09-11T00:07:27.777 INFO:tasks.workunit.client.1.smithi203.stdout:3/756: dwrite d8/da/d37/d83/d6a/f8c [0,4194304] 0 2024-09-11T00:07:27.780 INFO:tasks.workunit.client.0.smithi111.stdout:9/776: dread d6/db/d34/d37/f32 [0,4194304] 0 2024-09-11T00:07:27.781 INFO:tasks.workunit.client.1.smithi203.stdout:6/698: dread d0/d32/f58 [0,4194304] 0 2024-09-11T00:07:27.783 INFO:tasks.workunit.client.0.smithi111.stdout:8/752: write d11/d23/d3d/f94 [6894835,99248] 0 2024-09-11T00:07:27.784 INFO:tasks.workunit.client.0.smithi111.stdout:4/720: mknod d18/d1f/d36/d95/dde/ce1 0 2024-09-11T00:07:27.784 INFO:tasks.workunit.client.1.smithi203.stdout:7/693: rename dd/d3b/d5b/ddd/dfe to dd/d1c/d52/dff 0 2024-09-11T00:07:27.787 INFO:tasks.workunit.client.1.smithi203.stdout:8/638: dwrite d1/d13/d17/f31 [0,4194304] 0 2024-09-11T00:07:27.787 INFO:tasks.workunit.client.0.smithi111.stdout:4/721: dread - d18/d1f/d33/fbf zero size 2024-09-11T00:07:27.792 INFO:tasks.workunit.client.0.smithi111.stdout:3/757: symlink d1c/l10a 0 2024-09-11T00:07:27.798 INFO:tasks.workunit.client.0.smithi111.stdout:7/774: rename dd/d1d/d76/cb1 to dd/d1d/d2d/cf7 0 2024-09-11T00:07:27.798 INFO:tasks.workunit.client.1.smithi203.stdout:9/689: fsync d6/de/d19/f31 0 2024-09-11T00:07:27.800 INFO:tasks.workunit.client.0.smithi111.stdout:3/758: chown d1c/d1d/d22/d23/d58/ca0 55747 1 2024-09-11T00:07:27.801 INFO:tasks.workunit.client.0.smithi111.stdout:6/711: link d7/d22/d26/d95/f9c d7/d22/d3f/d74/d7f/ff5 0 2024-09-11T00:07:27.801 INFO:tasks.workunit.client.0.smithi111.stdout:9/777: rmdir d6/db/d34/d37/d4c/d7f/d97 39 2024-09-11T00:07:27.802 INFO:tasks.workunit.client.1.smithi203.stdout:7/694: fsync dd/fa7 0 2024-09-11T00:07:27.808 INFO:tasks.workunit.client.1.smithi203.stdout:1/823: fdatasync d8/d19/d31/f9d 0 2024-09-11T00:07:27.809 INFO:tasks.workunit.client.0.smithi111.stdout:5/769: getdents d10/d1e/d23/d26/d3a/d98/d6d 0 2024-09-11T00:07:27.810 INFO:tasks.workunit.client.0.smithi111.stdout:4/722: unlink d18/d20/d4a/l48 0 2024-09-11T00:07:27.813 INFO:tasks.workunit.client.0.smithi111.stdout:0/768: getdents d3/d13/d1e/d29/db0/dce/ddb 0 2024-09-11T00:07:27.814 INFO:tasks.workunit.client.0.smithi111.stdout:8/753: symlink d11/d23/lee 0 2024-09-11T00:07:27.817 INFO:tasks.workunit.client.1.smithi203.stdout:4/604: getdents db/d12/d15/d2a/d88/d95/dc2 0 2024-09-11T00:07:27.817 INFO:tasks.workunit.client.0.smithi111.stdout:2/691: rename d0/d3/de/db4/ddb to d0/d3/de/d50/dda/de8 0 2024-09-11T00:07:27.820 INFO:tasks.workunit.client.0.smithi111.stdout:8/754: dread - d11/f90 zero size 2024-09-11T00:07:27.821 INFO:tasks.workunit.client.0.smithi111.stdout:7/775: fdatasync dd/da6/ff1 0 2024-09-11T00:07:27.822 INFO:tasks.workunit.client.0.smithi111.stdout:1/724: dread d2/de/d93/d9f/f1a [0,4194304] 0 2024-09-11T00:07:27.824 INFO:tasks.workunit.client.0.smithi111.stdout:1/725: truncate d2/fd 4773520 0 2024-09-11T00:07:27.825 INFO:tasks.workunit.client.1.smithi203.stdout:6/699: mknod d0/d54/d9c/d35/d38/d73/da1/ce3 0 2024-09-11T00:07:27.826 INFO:tasks.workunit.client.0.smithi111.stdout:7/776: truncate dd/d1d/d4b/d8f/d9f/fc7 390851 0 2024-09-11T00:07:27.827 INFO:tasks.workunit.client.1.smithi203.stdout:9/690: dwrite d6/de/d19/f3e [4194304,4194304] 0 2024-09-11T00:07:27.827 INFO:tasks.workunit.client.1.smithi203.stdout:7/695: rmdir dd/d1c/d4b 39 2024-09-11T00:07:27.828 INFO:tasks.workunit.client.0.smithi111.stdout:1/726: write d2/de/d12/d3c/d4b/d6a/d63/d95/fe4 [52643,105823] 0 2024-09-11T00:07:27.831 INFO:tasks.workunit.client.1.smithi203.stdout:0/677: dwrite d0/d1d/d5d/f71 [0,4194304] 0 2024-09-11T00:07:27.832 INFO:tasks.workunit.client.1.smithi203.stdout:2/769: dwrite d13/d15/fa8 [4194304,4194304] 0 2024-09-11T00:07:27.835 INFO:tasks.workunit.client.0.smithi111.stdout:9/778: write d6/db/d34/d37/f1d [323195,27834] 0 2024-09-11T00:07:27.835 INFO:tasks.workunit.client.0.smithi111.stdout:6/712: dread d7/d22/d3f/d74/d7f/d79/da4/fb9 [0,4194304] 0 2024-09-11T00:07:27.835 INFO:tasks.workunit.client.0.smithi111.stdout:1/727: readlink d2/de/d12/d3c/d4b/d6a/l57 0 2024-09-11T00:07:27.837 INFO:tasks.workunit.client.1.smithi203.stdout:2/770: write d13/d47/f54 [4592699,18740] 0 2024-09-11T00:07:27.838 INFO:tasks.workunit.client.1.smithi203.stdout:3/757: rmdir d8/da/d5c/d6b/d10d 0 2024-09-11T00:07:27.840 INFO:tasks.workunit.client.0.smithi111.stdout:4/723: mkdir d18/d20/d40/d78/d79/db0/de2 0 2024-09-11T00:07:27.845 INFO:tasks.workunit.client.0.smithi111.stdout:2/692: readlink d0/d3/de/d3b/d97/lc1 0 2024-09-11T00:07:27.855 INFO:tasks.workunit.client.0.smithi111.stdout:9/779: symlink d6/db/d34/db5/lf8 0 2024-09-11T00:07:27.858 INFO:tasks.workunit.client.1.smithi203.stdout:6/700: truncate d0/d54/d9c/d35/d38/dc0/ddb/d82/f91 2127667 0 2024-09-11T00:07:27.859 INFO:tasks.workunit.client.1.smithi203.stdout:0/678: dwrite d0/fc2 [0,4194304] 0 2024-09-11T00:07:27.862 INFO:tasks.workunit.client.0.smithi111.stdout:4/724: creat d18/d20/d4a/d6b/fe3 x:0 0 0 2024-09-11T00:07:27.864 INFO:tasks.workunit.client.1.smithi203.stdout:4/605: mkdir db/d12/d15/d2a/dc3 0 2024-09-11T00:07:27.866 INFO:tasks.workunit.client.0.smithi111.stdout:9/780: truncate d6/dc/dc1/fdf 761943 0 2024-09-11T00:07:27.868 INFO:tasks.workunit.client.1.smithi203.stdout:8/639: write d1/f3d [419732,74695] 0 2024-09-11T00:07:27.869 INFO:tasks.workunit.client.0.smithi111.stdout:3/759: rename d1c/l82 to d1c/d1d/d22/d44/l10b 0 2024-09-11T00:07:27.872 INFO:tasks.workunit.client.0.smithi111.stdout:9/781: rename d6/db/d34/d37/d4c to d6/db/d34/d37/d4c/d99/df9 22 2024-09-11T00:07:27.874 INFO:tasks.workunit.client.1.smithi203.stdout:6/701: mknod d0/ce4 0 2024-09-11T00:07:27.874 INFO:tasks.workunit.client.0.smithi111.stdout:1/728: truncate d2/de/d12/d3c/d4b/d6a/d63/d73/fe0 2500783 0 2024-09-11T00:07:27.875 INFO:tasks.workunit.client.0.smithi111.stdout:5/770: write d10/d1e/d23/d30/d59/d52/d85/dd2/fbd [528910,1776] 0 2024-09-11T00:07:27.877 INFO:tasks.workunit.client.1.smithi203.stdout:7/696: dwrite dd/d1c/d52/d8f/d31/f36 [0,4194304] 0 2024-09-11T00:07:27.882 INFO:tasks.workunit.client.0.smithi111.stdout:3/760: creat d1c/d1d/dac/f10c x:0 0 0 2024-09-11T00:07:27.883 INFO:tasks.workunit.client.1.smithi203.stdout:8/640: creat d1/d13/d43/d46/db0/fd4 x:0 0 0 2024-09-11T00:07:27.883 INFO:tasks.workunit.client.1.smithi203.stdout:1/824: link d8/d28/d64/f65 d8/f128 0 2024-09-11T00:07:27.888 INFO:tasks.workunit.client.0.smithi111.stdout:5/771: write d10/d1e/d23/d30/d59/d52/fe4 [3514639,57813] 0 2024-09-11T00:07:27.889 INFO:tasks.workunit.client.0.smithi111.stdout:8/755: getdents d11/d23/d3d 0 2024-09-11T00:07:27.892 INFO:tasks.workunit.client.1.smithi203.stdout:8/641: unlink d1/d13/d22/c89 0 2024-09-11T00:07:27.894 INFO:tasks.workunit.client.1.smithi203.stdout:0/679: creat d0/d2/fe6 x:0 0 0 2024-09-11T00:07:27.894 INFO:tasks.workunit.client.0.smithi111.stdout:0/769: dread d3/d13/d1e/deb/f59 [0,4194304] 0 2024-09-11T00:07:27.900 INFO:tasks.workunit.client.0.smithi111.stdout:2/693: dwrite d0/d3/de/d3b/d63/fa5 [0,4194304] 0 2024-09-11T00:07:27.900 INFO:tasks.workunit.client.1.smithi203.stdout:1/825: creat d8/d19/d60/d90/d3e/d107/f129 x:0 0 0 2024-09-11T00:07:27.902 INFO:tasks.workunit.client.1.smithi203.stdout:9/691: dread d6/de/d32/d52/d55/d66/fb1 [0,4194304] 0 2024-09-11T00:07:27.904 INFO:tasks.workunit.client.1.smithi203.stdout:8/642: fsync d1/d13/d17/d2f/d52/f92 0 2024-09-11T00:07:27.904 INFO:tasks.workunit.client.0.smithi111.stdout:3/761: fsync d1c/d21/d92/f9a 0 2024-09-11T00:07:27.905 INFO:tasks.workunit.client.0.smithi111.stdout:6/713: dwrite d7/f12 [0,4194304] 0 2024-09-11T00:07:27.914 INFO:tasks.workunit.client.0.smithi111.stdout:1/729: rename d2/de/d93/d9f/c54 to d2/de/d12/d3c/d4b/d6a/d3a/cf1 0 2024-09-11T00:07:27.921 INFO:tasks.workunit.client.1.smithi203.stdout:2/771: dread d13/d22/f38 [0,4194304] 0 2024-09-11T00:07:27.921 INFO:tasks.workunit.client.1.smithi203.stdout:9/692: truncate d6/de/d32/d52/d44/f81 960653 0 2024-09-11T00:07:27.925 INFO:tasks.workunit.client.1.smithi203.stdout:8/643: rename d1/d13/d17/d2f/d52/ccc to d1/d13/d3a/d4c/cd5 0 2024-09-11T00:07:27.926 INFO:tasks.workunit.client.0.smithi111.stdout:5/772: dwrite d10/d1e/d25/f4a [4194304,4194304] 0 2024-09-11T00:07:27.930 INFO:tasks.workunit.client.0.smithi111.stdout:1/730: creat d2/de/d82/ff2 x:0 0 0 2024-09-11T00:07:27.931 INFO:tasks.workunit.client.0.smithi111.stdout:6/714: rmdir d7/d22/d3f/d74/d7f/d79/da4 39 2024-09-11T00:07:27.933 INFO:tasks.workunit.client.1.smithi203.stdout:7/697: dread dd/f30 [0,4194304] 0 2024-09-11T00:07:27.934 INFO:tasks.workunit.client.0.smithi111.stdout:8/756: creat d11/d23/d3d/dca/dcf/fef x:0 0 0 2024-09-11T00:07:27.935 INFO:tasks.workunit.client.0.smithi111.stdout:4/725: dread d18/d20/d3c/d5e/d75/d8d/f96 [0,4194304] 0 2024-09-11T00:07:27.940 INFO:tasks.workunit.client.0.smithi111.stdout:0/770: dwrite d3/d13/d1e/ffb [0,4194304] 0 2024-09-11T00:07:27.943 INFO:tasks.workunit.client.1.smithi203.stdout:0/680: dread d0/d2/d37/f47 [0,4194304] 0 2024-09-11T00:07:27.943 INFO:tasks.workunit.client.1.smithi203.stdout:7/698: readlink dd/d1c/d52/lca 0 2024-09-11T00:07:27.946 INFO:tasks.workunit.client.1.smithi203.stdout:2/772: dread d13/d22/fbd [0,4194304] 0 2024-09-11T00:07:27.947 INFO:tasks.workunit.client.0.smithi111.stdout:1/731: unlink d2/c24 0 2024-09-11T00:07:27.950 INFO:tasks.workunit.client.1.smithi203.stdout:4/606: dread db/d12/f9a [0,4194304] 0 2024-09-11T00:07:27.951 INFO:tasks.workunit.client.0.smithi111.stdout:5/773: mknod d10/d1e/d23/d30/d59/d52/d85/cfc 0 2024-09-11T00:07:27.953 INFO:tasks.workunit.client.0.smithi111.stdout:2/694: creat d0/d3/de/d3b/fe9 x:0 0 0 2024-09-11T00:07:27.958 INFO:tasks.workunit.client.1.smithi203.stdout:2/773: chown d13/d15/d30/d59/lc5 0 1 2024-09-11T00:07:27.958 INFO:tasks.workunit.client.1.smithi203.stdout:8/644: dread d1/d13/f33 [0,4194304] 0 2024-09-11T00:07:27.958 INFO:tasks.workunit.client.1.smithi203.stdout:7/699: truncate dd/d3b/d5b/f7b 9115324 0 2024-09-11T00:07:27.959 INFO:tasks.workunit.client.0.smithi111.stdout:5/774: read d10/d1e/d23/d2b/d92/fbc [23900,38417] 0 2024-09-11T00:07:27.960 INFO:tasks.workunit.client.1.smithi203.stdout:7/700: chown dd/d4d/d7f 1259 1 2024-09-11T00:07:27.962 INFO:tasks.workunit.client.1.smithi203.stdout:8/645: dread - d1/d13/d17/d2f/d52/f92 zero size 2024-09-11T00:07:27.963 INFO:tasks.workunit.client.1.smithi203.stdout:7/701: chown dd/d4d/d7f/f96 0 1 2024-09-11T00:07:27.965 INFO:tasks.workunit.client.1.smithi203.stdout:7/702: dread - dd/fe9 zero size 2024-09-11T00:07:27.966 INFO:tasks.workunit.client.0.smithi111.stdout:3/762: dread d1c/d1d/f77 [0,4194304] 0 2024-09-11T00:07:27.966 INFO:tasks.workunit.client.1.smithi203.stdout:4/607: unlink db/dd/d16/d38/f99 0 2024-09-11T00:07:27.968 INFO:tasks.workunit.client.1.smithi203.stdout:9/693: write d6/de/d19/d24/d40/d45/f15 [5190171,130060] 0 2024-09-11T00:07:27.969 INFO:tasks.workunit.client.0.smithi111.stdout:0/771: dread d3/d13/f17 [0,4194304] 0 2024-09-11T00:07:27.970 INFO:tasks.workunit.client.1.smithi203.stdout:1/826: dwrite d8/d19/d60/d90/d3e/d4b/d3a/f4f [0,4194304] 0 2024-09-11T00:07:27.971 INFO:tasks.workunit.client.1.smithi203.stdout:2/774: rmdir d13/d22 39 2024-09-11T00:07:27.973 INFO:tasks.workunit.client.1.smithi203.stdout:9/694: write d6/de/d19/d24/d54/db2/fdd [270192,78800] 0 2024-09-11T00:07:27.979 INFO:tasks.workunit.client.1.smithi203.stdout:9/695: dread d6/de/d19/d24/d40/fb9 [0,4194304] 0 2024-09-11T00:07:27.982 INFO:tasks.workunit.client.1.smithi203.stdout:0/681: write d0/d2/fe [1316026,26323] 0 2024-09-11T00:07:27.982 INFO:tasks.workunit.client.0.smithi111.stdout:2/695: rename d0/d3/de/d3b/d92/la8 to d0/d3/de/d3b/d63/lea 0 2024-09-11T00:07:27.985 INFO:tasks.workunit.client.0.smithi111.stdout:1/732: write d2/de/d12/d3c/d4b/f51 [185507,18786] 0 2024-09-11T00:07:27.989 INFO:tasks.workunit.client.1.smithi203.stdout:8/646: unlink d1/d13/d17/d2f/f84 0 2024-09-11T00:07:27.993 INFO:tasks.workunit.client.1.smithi203.stdout:2/775: symlink d13/d15/d30/dfa/daf/lfe 0 2024-09-11T00:07:27.995 INFO:tasks.workunit.client.0.smithi111.stdout:0/772: symlink d3/d13/d1e/d29/db0/l113 0 2024-09-11T00:07:27.996 INFO:tasks.workunit.client.0.smithi111.stdout:6/715: dwrite d7/f6b [0,4194304] 0 2024-09-11T00:07:27.997 INFO:tasks.workunit.client.1.smithi203.stdout:1/827: rename d8/d19/d60/d90/d3e/d4b/d3a to d8/d19/d60/d90/d3e/d4b/d80/d8d/da3/d12a 0 2024-09-11T00:07:27.998 INFO:tasks.workunit.client.0.smithi111.stdout:5/775: dread d10/d1e/d23/d30/d59/d52/fe4 [0,4194304] 0 2024-09-11T00:07:28.000 INFO:tasks.workunit.client.1.smithi203.stdout:9/696: readlink d6/de/d19/d24/d6c/da8/lac 0 2024-09-11T00:07:28.003 INFO:tasks.workunit.client.1.smithi203.stdout:9/697: write d6/de/d19/d24/fb0 [1419728,32399] 0 2024-09-11T00:07:28.005 INFO:tasks.workunit.client.0.smithi111.stdout:3/763: rename d1c/d1d/d22/d23/d2f/de8/c64 to d1c/d1d/d22/d23/d58/df2/c10d 0 2024-09-11T00:07:28.008 INFO:tasks.workunit.client.1.smithi203.stdout:9/698: truncate d6/de/d19/d24/d6c/fea 248076 0 2024-09-11T00:07:28.009 INFO:tasks.workunit.client.0.smithi111.stdout:4/726: truncate d18/d3b/d51/f5b 2394213 0 2024-09-11T00:07:28.010 INFO:tasks.workunit.client.1.smithi203.stdout:1/828: dread d8/d19/d60/d90/d3e/d4b/d80/d91/dac/fe4 [0,4194304] 0 2024-09-11T00:07:28.011 INFO:tasks.workunit.client.1.smithi203.stdout:0/682: rename d0/d2/d3d/d5a to d0/d2/d7e/da1/dc9/de7 0 2024-09-11T00:07:28.012 INFO:tasks.workunit.client.1.smithi203.stdout:7/703: rename dd/d1c to dd/d1c/d52/d8f/d31/d4a/d6e/d100 22 2024-09-11T00:07:28.014 INFO:tasks.workunit.client.1.smithi203.stdout:0/683: chown d0/d1d/d4c/cc8 1623 1 2024-09-11T00:07:28.015 INFO:tasks.workunit.client.0.smithi111.stdout:8/757: link d11/d23/d3d/dca/dcf/dc3/ce3 d11/d23/d2c/d53/cf0 0 2024-09-11T00:07:28.017 INFO:tasks.workunit.client.0.smithi111.stdout:7/777: sync 2024-09-11T00:07:28.017 INFO:tasks.workunit.client.1.smithi203.stdout:0/684: truncate d0/d2/fe6 781486 0 2024-09-11T00:07:28.017 INFO:tasks.workunit.client.1.smithi203.stdout:8/647: creat d1/d13/d43/d46/d76/dac/fd6 x:0 0 0 2024-09-11T00:07:28.019 INFO:tasks.workunit.client.1.smithi203.stdout:2/776: mkdir d13/d15/dff 0 2024-09-11T00:07:28.020 INFO:tasks.workunit.client.0.smithi111.stdout:8/758: write d11/fc0 [560597,84960] 0 2024-09-11T00:07:28.023 INFO:tasks.workunit.client.1.smithi203.stdout:5/757: sync 2024-09-11T00:07:28.027 INFO:tasks.workunit.client.1.smithi203.stdout:9/699: chown d6/de/d32/d52/d55/f2b 447976310 1 2024-09-11T00:07:28.029 INFO:tasks.workunit.client.0.smithi111.stdout:3/764: dread d1c/d1d/fd1 [0,4194304] 0 2024-09-11T00:07:28.029 INFO:tasks.workunit.client.0.smithi111.stdout:2/696: creat d0/d3/de/d3b/d62/feb x:0 0 0 2024-09-11T00:07:28.029 INFO:tasks.workunit.client.1.smithi203.stdout:9/700: stat d6/de/d19/d24/l5c 0 2024-09-11T00:07:28.030 INFO:tasks.workunit.client.1.smithi203.stdout:2/777: dread d13/f41 [0,4194304] 0 2024-09-11T00:07:28.033 INFO:tasks.workunit.client.0.smithi111.stdout:7/778: rename dd/d1d/d4b to dd/d1d/d7e/df8 0 2024-09-11T00:07:28.034 INFO:tasks.workunit.client.1.smithi203.stdout:7/704: chown dd/d1c/f66 2 1 2024-09-11T00:07:28.035 INFO:tasks.workunit.client.1.smithi203.stdout:4/608: getdents db/dd/d26/d42 0 2024-09-11T00:07:28.036 INFO:tasks.workunit.client.0.smithi111.stdout:3/765: chown d1c/d1d/d22/d23/d2f/de8/d5f/lb1 0 1 2024-09-11T00:07:28.037 INFO:tasks.workunit.client.1.smithi203.stdout:8/648: mknod d1/d13/d17/d81/d97/cd7 0 2024-09-11T00:07:28.037 INFO:tasks.workunit.client.1.smithi203.stdout:7/705: read dd/f14 [3346076,127040] 0 2024-09-11T00:07:28.040 INFO:tasks.workunit.client.0.smithi111.stdout:8/759: chown d11/d23/d3d/d5f/d99/cc2 24 1 2024-09-11T00:07:28.041 INFO:tasks.workunit.client.0.smithi111.stdout:0/773: dwrite d3/d13/f89 [4194304,4194304] 0 2024-09-11T00:07:28.044 INFO:tasks.workunit.client.0.smithi111.stdout:6/716: dwrite d7/d22/d26/d95/f9c [0,4194304] 0 2024-09-11T00:07:28.046 INFO:tasks.workunit.client.0.smithi111.stdout:1/733: getdents d2/de/d12/d3c/d4b/d6a/d63/d73 0 2024-09-11T00:07:28.051 INFO:tasks.workunit.client.0.smithi111.stdout:8/760: write d11/d23/d2c/feb [906073,28576] 0 2024-09-11T00:07:28.059 INFO:tasks.workunit.client.0.smithi111.stdout:7/779: link dd/d1d/d7e/df8/d8f/d9f/d79/lcf dd/d1d/d2d/d2e/lf9 0 2024-09-11T00:07:28.069 INFO:tasks.workunit.client.0.smithi111.stdout:8/761: rmdir d11/d23/d3d 39 2024-09-11T00:07:28.070 INFO:tasks.workunit.client.0.smithi111.stdout:1/734: creat d2/de/d12/d88/ff3 x:0 0 0 2024-09-11T00:07:28.081 INFO:tasks.workunit.client.0.smithi111.stdout:7/780: symlink dd/d1d/d7e/df8/d8f/lfa 0 2024-09-11T00:07:28.082 INFO:tasks.workunit.client.0.smithi111.stdout:8/762: write d11/d21/d38/f9e [492222,55334] 0 2024-09-11T00:07:28.084 INFO:tasks.workunit.client.0.smithi111.stdout:1/735: creat d2/d2b/ff4 x:0 0 0 2024-09-11T00:07:28.093 INFO:tasks.workunit.client.0.smithi111.stdout:6/717: link d7/d2b/l3c d7/d22/d26/d95/dd6/lf6 0 2024-09-11T00:07:28.093 INFO:tasks.workunit.client.0.smithi111.stdout:0/774: dwrite d3/d13/d1e/d29/d49/f76 [0,4194304] 0 2024-09-11T00:07:28.093 INFO:tasks.workunit.client.0.smithi111.stdout:3/766: dwrite d1c/d1d/d22/d44/d5a/f76 [0,4194304] 0 2024-09-11T00:07:28.093 INFO:tasks.workunit.client.0.smithi111.stdout:7/781: creat dd/d1d/d7e/df8/dad/ffb x:0 0 0 2024-09-11T00:07:28.093 INFO:tasks.workunit.client.0.smithi111.stdout:4/727: dwrite d18/d1f/fdb [0,4194304] 0 2024-09-11T00:07:28.094 INFO:tasks.workunit.client.0.smithi111.stdout:8/763: readlink d11/d23/d3d/d5f/d99/lc9 0 2024-09-11T00:07:28.096 INFO:tasks.workunit.client.0.smithi111.stdout:2/697: dread d0/d3/d12/d52/d6c/fd0 [0,4194304] 0 2024-09-11T00:07:28.101 INFO:tasks.workunit.client.0.smithi111.stdout:1/736: fsync d2/d77/faf 0 2024-09-11T00:07:28.104 INFO:tasks.workunit.client.0.smithi111.stdout:8/764: mknod d11/d23/d2c/d7f/dde/cf1 0 2024-09-11T00:07:28.106 INFO:tasks.workunit.client.0.smithi111.stdout:7/782: fsync dd/d1d/d1f/f9b 0 2024-09-11T00:07:28.109 INFO:tasks.workunit.client.0.smithi111.stdout:4/728: write d18/d20/d3c/d5e/d75/d8d/dce/fd9 [914416,122764] 0 2024-09-11T00:07:28.110 INFO:tasks.workunit.client.1.smithi203.stdout:1/829: mknod d8/d19/d60/d90/c12b 0 2024-09-11T00:07:28.114 INFO:tasks.workunit.client.0.smithi111.stdout:1/737: mkdir d2/de/d12/d6c/df5 0 2024-09-11T00:07:28.117 INFO:tasks.workunit.client.1.smithi203.stdout:7/706: dread - dd/d1c/d52/d8f/d31/d67/dc3/ddb/fec zero size 2024-09-11T00:07:28.119 INFO:tasks.workunit.client.0.smithi111.stdout:8/765: truncate d11/f9d 109815 0 2024-09-11T00:07:28.120 INFO:tasks.workunit.client.1.smithi203.stdout:2/778: symlink d13/d15/d30/d5a/d8b/df4/l100 0 2024-09-11T00:07:28.123 INFO:tasks.workunit.client.0.smithi111.stdout:2/698: write d0/d3/f3e [759265,85217] 0 2024-09-11T00:07:28.123 INFO:tasks.workunit.client.1.smithi203.stdout:4/609: rename db/d12/d15/d2a/d71/fb9 to db/dd/d16/d38/d3c/fc4 0 2024-09-11T00:07:28.125 INFO:tasks.workunit.client.0.smithi111.stdout:7/783: symlink dd/d1d/d2d/d2e/lfc 0 2024-09-11T00:07:28.127 INFO:tasks.workunit.client.1.smithi203.stdout:9/701: truncate d6/de/d47/dc3/fd9 2975362 0 2024-09-11T00:07:28.127 INFO:tasks.workunit.client.0.smithi111.stdout:9/782: sync 2024-09-11T00:07:28.128 INFO:tasks.workunit.client.1.smithi203.stdout:7/707: creat dd/d4d/f101 x:0 0 0 2024-09-11T00:07:28.130 INFO:tasks.workunit.client.0.smithi111.stdout:8/766: fdatasync d11/d23/d2c/d53/f55 0 2024-09-11T00:07:28.135 INFO:tasks.workunit.client.0.smithi111.stdout:0/775: dwrite d3/d13/d66/fa0 [0,4194304] 0 2024-09-11T00:07:28.137 INFO:tasks.workunit.client.0.smithi111.stdout:8/767: write d11/d23/d3d/f44 [2025067,117500] 0 2024-09-11T00:07:28.138 INFO:tasks.workunit.client.1.smithi203.stdout:2/779: getdents d13/d15/d30 0 2024-09-11T00:07:28.139 INFO:tasks.workunit.client.0.smithi111.stdout:3/767: dwrite d1c/d1d/d22/d23/d2f/d63/f81 [0,4194304] 0 2024-09-11T00:07:28.140 INFO:tasks.workunit.client.0.smithi111.stdout:3/768: fsync d1c/d1d/dac/ff7 0 2024-09-11T00:07:28.142 INFO:tasks.workunit.client.0.smithi111.stdout:9/783: rmdir d6/dc/d73 39 2024-09-11T00:07:28.146 INFO:tasks.workunit.client.0.smithi111.stdout:2/699: creat d0/d3/de/d3b/d63/fec x:0 0 0 2024-09-11T00:07:28.147 INFO:tasks.workunit.client.0.smithi111.stdout:3/769: truncate d1c/d1d/d22/d31/d62/f78 1043638 0 2024-09-11T00:07:28.148 INFO:tasks.workunit.client.1.smithi203.stdout:4/610: dread db/dd/d16/f55 [0,4194304] 0 2024-09-11T00:07:28.151 INFO:tasks.workunit.client.0.smithi111.stdout:3/770: dread - d1c/d1d/d22/d23/d2f/f8e zero size 2024-09-11T00:07:28.158 INFO:tasks.workunit.client.1.smithi203.stdout:7/708: dread dd/d1c/d52/fac [0,4194304] 0 2024-09-11T00:07:28.161 INFO:tasks.workunit.client.1.smithi203.stdout:7/709: symlink dd/d1c/l102 0 2024-09-11T00:07:28.161 INFO:tasks.workunit.client.0.smithi111.stdout:9/784: mknod d6/d52/d8a/d92/cfa 0 2024-09-11T00:07:28.161 INFO:tasks.workunit.client.0.smithi111.stdout:0/776: symlink d3/d13/d1e/d29/d49/l114 0 2024-09-11T00:07:28.162 INFO:tasks.workunit.client.0.smithi111.stdout:1/738: link d2/de/d12/l33 d2/de/d12/d3c/d4b/d6a/d63/d73/lf6 0 2024-09-11T00:07:28.169 INFO:tasks.workunit.client.0.smithi111.stdout:1/739: creat d2/d77/ff7 x:0 0 0 2024-09-11T00:07:28.169 INFO:tasks.workunit.client.0.smithi111.stdout:9/785: mknod d6/db/d7a/cfb 0 2024-09-11T00:07:28.169 INFO:tasks.workunit.client.0.smithi111.stdout:0/777: symlink d3/d13/d1e/deb/d61/l115 0 2024-09-11T00:07:28.173 INFO:tasks.workunit.client.0.smithi111.stdout:0/778: stat d3/d26/d77/f45 0 2024-09-11T00:07:28.174 INFO:tasks.workunit.client.0.smithi111.stdout:1/740: symlink d2/de/d12/d3c/d4b/d6a/d3a/lf8 0 2024-09-11T00:07:28.176 INFO:tasks.workunit.client.0.smithi111.stdout:9/786: link d6/d52/d8a/d92/ce5 d6/d52/d8a/cfc 0 2024-09-11T00:07:28.180 INFO:tasks.workunit.client.0.smithi111.stdout:1/741: write d2/de/d93/d9f/f20 [9577549,119869] 0 2024-09-11T00:07:28.182 INFO:tasks.workunit.client.0.smithi111.stdout:9/787: getdents d6/d52/d8a/d8e 0 2024-09-11T00:07:28.185 INFO:tasks.workunit.client.0.smithi111.stdout:2/700: dread d0/d3/de/d3b/d62/d6d/faa [0,4194304] 0 2024-09-11T00:07:28.187 INFO:tasks.workunit.client.1.smithi203.stdout:7/710: dread dd/f3e [4194304,4194304] 0 2024-09-11T00:07:28.188 INFO:tasks.workunit.client.0.smithi111.stdout:9/788: rename d6/db/d1b/d56/dc8/fd0 to d6/dc/d73/ffd 0 2024-09-11T00:07:28.190 INFO:tasks.workunit.client.0.smithi111.stdout:2/701: rename d0/d3/de/d3b/d92/dc7 to d0/d3/d2e/ded 0 2024-09-11T00:07:28.191 INFO:tasks.workunit.client.0.smithi111.stdout:9/789: mknod d6/db/db8/cfe 0 2024-09-11T00:07:28.193 INFO:tasks.workunit.client.0.smithi111.stdout:2/702: chown d0/d3/d12/f5f 1 1 2024-09-11T00:07:28.193 INFO:tasks.workunit.client.1.smithi203.stdout:7/711: getdents dd/d1c/d52/d8f/d31/d58 0 2024-09-11T00:07:28.196 INFO:tasks.workunit.client.1.smithi203.stdout:7/712: mknod dd/d1c/d52/d8f/d31/d58/d93/d98/c103 0 2024-09-11T00:07:28.206 INFO:tasks.workunit.client.0.smithi111.stdout:9/790: dwrite d6/db/d34/d37/d4c/d99/fea [0,4194304] 0 2024-09-11T00:07:28.214 INFO:tasks.workunit.client.0.smithi111.stdout:7/784: read dd/d1d/d1f/d24/f32 [268402,13918] 0 2024-09-11T00:07:28.217 INFO:tasks.workunit.client.0.smithi111.stdout:5/776: sync 2024-09-11T00:07:28.218 INFO:tasks.workunit.client.0.smithi111.stdout:6/718: truncate d7/d22/d26/d87/d41/f82 896053 0 2024-09-11T00:07:28.222 INFO:tasks.workunit.client.1.smithi203.stdout:8/649: write d1/d13/d17/d8b/f9c [202694,6732] 0 2024-09-11T00:07:28.223 INFO:tasks.workunit.client.0.smithi111.stdout:7/785: rmdir dd/d1d/d76 39 2024-09-11T00:07:28.225 INFO:tasks.workunit.client.1.smithi203.stdout:8/650: write d1/d13/d17/f42 [670404,100072] 0 2024-09-11T00:07:28.232 INFO:tasks.workunit.client.0.smithi111.stdout:9/791: rename d6/db/d7a/d9a/lb7 to d6/db/d34/d37/d4c/d7f/lff 0 2024-09-11T00:07:28.235 INFO:tasks.workunit.client.1.smithi203.stdout:5/758: dwrite dc/fc3 [0,4194304] 0 2024-09-11T00:07:28.242 INFO:tasks.workunit.client.1.smithi203.stdout:9/702: write d6/de/d19/f31 [1314781,53652] 0 2024-09-11T00:07:28.242 INFO:tasks.workunit.client.0.smithi111.stdout:6/719: dwrite d7/d22/d3f/d74/d7f/d79/da4/fe5 [0,4194304] 0 2024-09-11T00:07:28.243 INFO:tasks.workunit.client.1.smithi203.stdout:5/759: creat dc/dd/d9b/ffd x:0 0 0 2024-09-11T00:07:28.244 INFO:tasks.workunit.client.1.smithi203.stdout:5/760: stat dc/d2b/f93 0 2024-09-11T00:07:28.246 INFO:tasks.workunit.client.0.smithi111.stdout:4/729: truncate d18/d3b/d61/f7c 1794545 0 2024-09-11T00:07:28.247 INFO:tasks.workunit.client.1.smithi203.stdout:9/703: truncate d6/de/d32/fdc 72427 0 2024-09-11T00:07:28.248 INFO:tasks.workunit.client.0.smithi111.stdout:4/730: chown d18/d20/d3c/f54 3 1 2024-09-11T00:07:28.250 INFO:tasks.workunit.client.1.smithi203.stdout:8/651: getdents d1/d13/d17/d8b 0 2024-09-11T00:07:28.251 INFO:tasks.workunit.client.0.smithi111.stdout:6/720: unlink d7/d2b/f68 0 2024-09-11T00:07:28.255 INFO:tasks.workunit.client.1.smithi203.stdout:4/611: truncate db/d12/d15/d2a/d88/d95/fa8 1122437 0 2024-09-11T00:07:28.259 INFO:tasks.workunit.client.0.smithi111.stdout:6/721: mknod d7/d22/d1d/d83/cf7 0 2024-09-11T00:07:28.260 INFO:tasks.workunit.client.0.smithi111.stdout:3/771: write d1c/d1d/d22/f9b [713782,15045] 0 2024-09-11T00:07:28.263 INFO:tasks.workunit.client.0.smithi111.stdout:3/772: chown d1c/d1d/d22/d44/d5a/dcd/dd2/def/df5 3098593 1 2024-09-11T00:07:28.264 INFO:tasks.workunit.client.0.smithi111.stdout:8/768: sync 2024-09-11T00:07:28.265 INFO:tasks.workunit.client.1.smithi203.stdout:8/652: symlink d1/ld8 0 2024-09-11T00:07:28.267 INFO:tasks.workunit.client.1.smithi203.stdout:8/653: fdatasync d1/d13/d17/d2f/d9e/f70 0 2024-09-11T00:07:28.268 INFO:tasks.workunit.client.1.smithi203.stdout:5/761: link dc/l8a dc/dd/d56/lfe 0 2024-09-11T00:07:28.271 INFO:tasks.workunit.client.0.smithi111.stdout:3/773: rmdir d1c/d1d/d22/d23/d58/df2 39 2024-09-11T00:07:28.273 INFO:tasks.workunit.client.1.smithi203.stdout:4/612: creat db/dd/d16/d38/db6/fc5 x:0 0 0 2024-09-11T00:07:28.274 INFO:tasks.workunit.client.1.smithi203.stdout:4/613: chown db/d12/d15/d2a/c53 23536 1 2024-09-11T00:07:28.275 INFO:tasks.workunit.client.0.smithi111.stdout:0/779: dwrite d3/d74/f7d [0,4194304] 0 2024-09-11T00:07:28.276 INFO:tasks.workunit.client.0.smithi111.stdout:3/774: write d1c/d1d/d22/d23/d2f/de8/f53 [3641340,29220] 0 2024-09-11T00:07:28.276 INFO:tasks.workunit.client.0.smithi111.stdout:8/769: unlink d11/d21/d6f/f7b 0 2024-09-11T00:07:28.278 INFO:tasks.workunit.client.0.smithi111.stdout:2/703: write d0/d3/f84 [698700,26832] 0 2024-09-11T00:07:28.280 INFO:tasks.workunit.client.1.smithi203.stdout:7/713: write dd/d4d/f90 [1610143,8838] 0 2024-09-11T00:07:28.287 INFO:tasks.workunit.client.1.smithi203.stdout:5/762: dwrite dc/d4f/d5c/dc9/fe2 [4194304,4194304] 0 2024-09-11T00:07:28.288 INFO:tasks.workunit.client.1.smithi203.stdout:4/614: mknod db/d12/d15/d2a/d88/d95/cc6 0 2024-09-11T00:07:28.289 INFO:tasks.workunit.client.1.smithi203.stdout:4/615: stat db/d12/f93 0 2024-09-11T00:07:28.296 INFO:tasks.workunit.client.0.smithi111.stdout:5/777: write d10/d1e/d23/d30/dd8/da2/ff5 [156363,85469] 0 2024-09-11T00:07:28.296 INFO:tasks.workunit.client.1.smithi203.stdout:5/763: fdatasync dc/dd/d1e/f21 0 2024-09-11T00:07:28.300 INFO:tasks.workunit.client.1.smithi203.stdout:7/714: creat dd/d1c/d52/d8f/d31/d58/d93/d98/dfc/f104 x:0 0 0 2024-09-11T00:07:28.301 INFO:tasks.workunit.client.1.smithi203.stdout:5/764: write dc/dd/d56/fd0 [2717526,86826] 0 2024-09-11T00:07:28.301 INFO:tasks.workunit.client.0.smithi111.stdout:7/786: truncate dd/d48/d69/f6b 688448 0 2024-09-11T00:07:28.304 INFO:tasks.workunit.client.1.smithi203.stdout:5/765: write dc/d4f/d5c/fb8 [4004969,31] 0 2024-09-11T00:07:28.305 INFO:tasks.workunit.client.0.smithi111.stdout:9/792: write d6/db/d34/fca [564056,67473] 0 2024-09-11T00:07:28.308 INFO:tasks.workunit.client.0.smithi111.stdout:7/787: chown dd/d1d/d2d/fcd 874519964 1 2024-09-11T00:07:28.313 INFO:tasks.workunit.client.0.smithi111.stdout:4/731: write d18/d20/d40/f8f [1399542,88169] 0 2024-09-11T00:07:28.313 INFO:tasks.workunit.client.0.smithi111.stdout:8/770: dwrite f8 [0,4194304] 0 2024-09-11T00:07:28.313 INFO:tasks.workunit.client.0.smithi111.stdout:5/778: unlink d10/d1e/d23/d26/d3a/d98/ff4 0 2024-09-11T00:07:28.314 INFO:tasks.workunit.client.1.smithi203.stdout:9/704: truncate d6/de/d47/f61 3767228 0 2024-09-11T00:07:28.317 INFO:tasks.workunit.client.0.smithi111.stdout:4/732: chown d18/d20/d3c/f58 0 1 2024-09-11T00:07:28.317 INFO:tasks.workunit.client.0.smithi111.stdout:8/771: write d11/d23/d3d/f44 [1010924,47271] 0 2024-09-11T00:07:28.318 INFO:tasks.workunit.client.0.smithi111.stdout:6/722: dread d7/d22/d26/d87/d41/f82 [0,4194304] 0 2024-09-11T00:07:28.320 INFO:tasks.workunit.client.0.smithi111.stdout:9/793: mknod d6/db/d1b/d56/dc8/c100 0 2024-09-11T00:07:28.321 INFO:tasks.workunit.client.0.smithi111.stdout:5/779: stat d10/d1e/d23/d30/d59/d7b/f73 0 2024-09-11T00:07:28.322 INFO:tasks.workunit.client.0.smithi111.stdout:6/723: stat d7/d22/d1d/d8c/d4a 0 2024-09-11T00:07:28.323 INFO:tasks.workunit.client.0.smithi111.stdout:8/772: readlink d11/d23/d3d/dca/dcf/l6e 0 2024-09-11T00:07:28.324 INFO:tasks.workunit.client.1.smithi203.stdout:8/654: write d1/fe [5604129,84145] 0 2024-09-11T00:07:28.325 INFO:tasks.workunit.client.1.smithi203.stdout:5/766: read dc/dd/d1e/f54 [2390349,105968] 0 2024-09-11T00:07:28.327 INFO:tasks.workunit.client.0.smithi111.stdout:8/773: readlink d11/d23/d2c/d53/dbd/lcb 0 2024-09-11T00:07:28.328 INFO:tasks.workunit.client.1.smithi203.stdout:9/705: dread d6/de/d19/d24/f36 [0,4194304] 0 2024-09-11T00:07:28.328 INFO:tasks.workunit.client.0.smithi111.stdout:7/788: rename dd/d1d/d7e/df8/dad/cdb to dd/d1d/d2d/cfd 0 2024-09-11T00:07:28.330 INFO:tasks.workunit.client.0.smithi111.stdout:2/704: dread d0/d3/d12/f3d [0,4194304] 0 2024-09-11T00:07:28.335 INFO:tasks.workunit.client.1.smithi203.stdout:8/655: truncate d1/f16 2596338 0 2024-09-11T00:07:28.340 INFO:tasks.workunit.client.1.smithi203.stdout:8/656: read d1/d13/d17/d48/f53 [715647,7396] 0 2024-09-11T00:07:28.340 INFO:tasks.workunit.client.0.smithi111.stdout:5/780: mkdir d10/d1e/d23/d30/dd8/d7e/dfd 0 2024-09-11T00:07:28.341 INFO:tasks.workunit.client.1.smithi203.stdout:3/758: sync 2024-09-11T00:07:28.343 INFO:tasks.workunit.client.0.smithi111.stdout:6/724: dread d7/d22/d2c/f37 [0,4194304] 0 2024-09-11T00:07:28.343 INFO:tasks.workunit.client.0.smithi111.stdout:0/780: write d3/da/d7b/d84/f8b [736720,79916] 0 2024-09-11T00:07:28.344 INFO:tasks.workunit.client.0.smithi111.stdout:5/781: read d10/d1e/d23/d26/f3e [621370,87506] 0 2024-09-11T00:07:28.344 INFO:tasks.workunit.client.0.smithi111.stdout:8/774: write d11/d23/d2c/d46/f69 [3331594,66127] 0 2024-09-11T00:07:28.344 INFO:tasks.workunit.client.1.smithi203.stdout:3/759: truncate d8/da/f104 128163 0 2024-09-11T00:07:28.345 INFO:tasks.workunit.client.0.smithi111.stdout:7/789: creat dd/d1d/d7e/ffe x:0 0 0 2024-09-11T00:07:28.346 INFO:tasks.workunit.client.1.smithi203.stdout:4/616: dread db/dd/d16/fb1 [0,4194304] 0 2024-09-11T00:07:28.349 INFO:tasks.workunit.client.1.smithi203.stdout:7/715: rename dd/d1c/d4b to dd/d1c/d52/d8f/d31/d4a/d105 0 2024-09-11T00:07:28.350 INFO:tasks.workunit.client.0.smithi111.stdout:6/725: write d7/d22/d3f/d74/d7f/ff5 [1260239,93279] 0 2024-09-11T00:07:28.352 INFO:tasks.workunit.client.0.smithi111.stdout:1/742: sync 2024-09-11T00:07:28.354 INFO:tasks.workunit.client.0.smithi111.stdout:2/705: creat d0/d3/d2e/ded/dd8/fee x:0 0 0 2024-09-11T00:07:28.355 INFO:tasks.workunit.client.1.smithi203.stdout:7/716: write dd/d1c/d52/d8f/d31/d58/d93/d98/fbd [726285,106206] 0 2024-09-11T00:07:28.357 INFO:tasks.workunit.client.0.smithi111.stdout:2/706: readlink d0/d3/de/d3b/d63/l8d 0 2024-09-11T00:07:28.360 INFO:tasks.workunit.client.0.smithi111.stdout:1/743: dread d2/de/d12/d3c/d4b/d6a/d63/d73/da1/db9/fc5 [0,4194304] 0 2024-09-11T00:07:28.365 INFO:tasks.workunit.client.0.smithi111.stdout:8/775: dwrite d11/d23/d3d/fb2 [0,4194304] 0 2024-09-11T00:07:28.367 INFO:tasks.workunit.client.1.smithi203.stdout:8/657: rename d1/d13/d3a/d4c/c69 to d1/d13/d43/dab/cd9 0 2024-09-11T00:07:28.367 INFO:tasks.workunit.client.1.smithi203.stdout:3/760: dwrite d8/da/d37/d83/d6a/f8c [4194304,4194304] 0 2024-09-11T00:07:28.369 INFO:tasks.workunit.client.1.smithi203.stdout:8/658: chown d1/d13/f33 125648 1 2024-09-11T00:07:28.371 INFO:tasks.workunit.client.1.smithi203.stdout:7/717: mknod dd/d1c/d7c/d8c/c106 0 2024-09-11T00:07:28.373 INFO:tasks.workunit.client.1.smithi203.stdout:9/706: getdents d6 0 2024-09-11T00:07:28.373 INFO:tasks.workunit.client.0.smithi111.stdout:0/781: truncate d3/da/d7b/f83 189593 0 2024-09-11T00:07:28.376 INFO:tasks.workunit.client.1.smithi203.stdout:3/761: rmdir d8/da/d37/d53/dea/de5 39 2024-09-11T00:07:28.377 INFO:tasks.workunit.client.0.smithi111.stdout:4/733: truncate d18/d20/d4a/f3f 1671398 0 2024-09-11T00:07:28.378 INFO:tasks.workunit.client.0.smithi111.stdout:3/775: sync 2024-09-11T00:07:28.378 INFO:tasks.workunit.client.0.smithi111.stdout:0/782: stat d3/d26/d77/l46 0 2024-09-11T00:07:28.379 INFO:tasks.workunit.client.0.smithi111.stdout:5/782: creat d10/d1e/d23/d30/dd8/da2/ffe x:0 0 0 2024-09-11T00:07:28.380 INFO:tasks.workunit.client.1.smithi203.stdout:3/762: write d8/da/d37/d83/d6a/f87 [190060,122874] 0 2024-09-11T00:07:28.381 INFO:tasks.workunit.client.1.smithi203.stdout:3/763: readlink d8/d17/l4e 0 2024-09-11T00:07:28.385 INFO:tasks.workunit.client.0.smithi111.stdout:6/726: dread - d7/d22/d1d/d69/ff1 zero size 2024-09-11T00:07:28.387 INFO:tasks.workunit.client.1.smithi203.stdout:8/659: symlink d1/lda 0 2024-09-11T00:07:28.389 INFO:tasks.workunit.client.1.smithi203.stdout:8/660: write d1/d13/d17/f31 [3416476,70204] 0 2024-09-11T00:07:28.392 INFO:tasks.workunit.client.0.smithi111.stdout:1/744: unlink d2/de/f43 0 2024-09-11T00:07:28.393 INFO:tasks.workunit.client.1.smithi203.stdout:4/617: getdents db/dd/d16 0 2024-09-11T00:07:28.394 INFO:tasks.workunit.client.0.smithi111.stdout:7/790: dwrite dd/d1d/f39 [0,4194304] 0 2024-09-11T00:07:28.398 INFO:tasks.workunit.client.1.smithi203.stdout:8/661: chown d1/d13/d17/d2f/d52/d49/d68/cb2 11544059 1 2024-09-11T00:07:28.398 INFO:tasks.workunit.client.0.smithi111.stdout:7/791: chown dd/d48/c9c 1 1 2024-09-11T00:07:28.398 INFO:tasks.workunit.client.1.smithi203.stdout:4/618: read db/dd/d16/fb1 [178032,54677] 0 2024-09-11T00:07:28.403 INFO:tasks.workunit.client.1.smithi203.stdout:5/767: dread dc/dd/f3d [0,4194304] 0 2024-09-11T00:07:28.406 INFO:tasks.workunit.client.1.smithi203.stdout:3/764: dwrite d8/da/d37/d83/db9/fcb [0,4194304] 0 2024-09-11T00:07:28.406 INFO:tasks.workunit.client.1.smithi203.stdout:4/619: fdatasync db/dd/d16/d38/fbc 0 2024-09-11T00:07:28.407 INFO:tasks.workunit.client.0.smithi111.stdout:0/783: symlink d3/d13/d1e/d29/db0/dce/l116 0 2024-09-11T00:07:28.410 INFO:tasks.workunit.client.0.smithi111.stdout:5/783: rename f5 to d10/d1e/d23/d30/dd8/d63/fff 0 2024-09-11T00:07:28.414 INFO:tasks.workunit.client.1.smithi203.stdout:6/702: sync 2024-09-11T00:07:28.416 INFO:tasks.workunit.client.1.smithi203.stdout:9/707: creat d6/de/d32/feb x:0 0 0 2024-09-11T00:07:28.416 INFO:tasks.workunit.client.0.smithi111.stdout:9/794: link d6/db/d1b/c26 d6/dc/c101 0 2024-09-11T00:07:28.421 INFO:tasks.workunit.client.0.smithi111.stdout:6/727: mknod d7/d22/d1d/d83/cf8 0 2024-09-11T00:07:28.423 INFO:tasks.workunit.client.0.smithi111.stdout:6/728: chown d7/d22/d1d/d8c/d4a/c6e 265735 1 2024-09-11T00:07:28.423 INFO:tasks.workunit.client.1.smithi203.stdout:5/768: mkdir dc/dd/d9b/dff 0 2024-09-11T00:07:28.425 INFO:tasks.workunit.client.1.smithi203.stdout:6/703: write d0/d54/d9c/d35/d39/d3c/fd2 [643147,26227] 0 2024-09-11T00:07:28.425 INFO:tasks.workunit.client.0.smithi111.stdout:6/729: write d7/d22/d2c/d38/d39/fc9 [621517,120443] 0 2024-09-11T00:07:28.428 INFO:tasks.workunit.client.0.smithi111.stdout:8/776: mkdir d11/d23/df2 0 2024-09-11T00:07:28.434 INFO:tasks.workunit.client.1.smithi203.stdout:7/718: getdents dd/d1c/d52/d8f/d31/d67/dc8 0 2024-09-11T00:07:28.434 INFO:tasks.workunit.client.0.smithi111.stdout:2/707: write d0/d3/f37 [1062470,86983] 0 2024-09-11T00:07:28.437 INFO:tasks.workunit.client.1.smithi203.stdout:7/719: chown dd/d1c/d52/d8f/d31/d58/d93/f9b 441307280 1 2024-09-11T00:07:28.438 INFO:tasks.workunit.client.0.smithi111.stdout:0/784: mkdir d3/d1c/dd0/d117 0 2024-09-11T00:07:28.440 INFO:tasks.workunit.client.0.smithi111.stdout:5/784: write d10/d1e/d23/d30/d59/d52/fe4 [4077328,64738] 0 2024-09-11T00:07:28.442 INFO:tasks.workunit.client.0.smithi111.stdout:3/776: link d1c/d1d/d22/d23/d2f/d63/f6b d1c/d1d/d22/d23/d2f/de8/d5f/f10e 0 2024-09-11T00:07:28.445 INFO:tasks.workunit.client.0.smithi111.stdout:9/795: fdatasync d6/fa5 0 2024-09-11T00:07:28.449 INFO:tasks.workunit.client.0.smithi111.stdout:9/796: write d6/db/db8/dce/dcf/fbd [654302,61596] 0 2024-09-11T00:07:28.452 INFO:tasks.workunit.client.0.smithi111.stdout:6/730: creat d7/d22/d2c/d38/d39/ff9 x:0 0 0 2024-09-11T00:07:28.453 INFO:tasks.workunit.client.0.smithi111.stdout:7/792: write dd/da6/fe8 [1526455,30303] 0 2024-09-11T00:07:28.457 INFO:tasks.workunit.client.1.smithi203.stdout:4/620: dwrite db/dd/d16/f7b [0,4194304] 0 2024-09-11T00:07:28.459 INFO:tasks.workunit.client.0.smithi111.stdout:2/708: read d0/d3/de/d3b/f49 [998280,83415] 0 2024-09-11T00:07:28.463 INFO:tasks.workunit.client.0.smithi111.stdout:4/734: symlink d18/d1f/d36/d95/dda/le4 0 2024-09-11T00:07:28.464 INFO:tasks.workunit.client.0.smithi111.stdout:4/735: chown d18/d39/lad 55683711 1 2024-09-11T00:07:28.465 INFO:tasks.workunit.client.0.smithi111.stdout:0/785: truncate d3/daf/fba 83315 0 2024-09-11T00:07:28.465 INFO:tasks.workunit.client.0.smithi111.stdout:5/785: dread d10/d1e/d23/d30/dd8/d7e/fb1 [0,4194304] 0 2024-09-11T00:07:28.467 INFO:tasks.workunit.client.0.smithi111.stdout:0/786: chown d3/d13/d1e/deb/l96 3161793 1 2024-09-11T00:07:28.468 INFO:tasks.workunit.client.0.smithi111.stdout:0/787: readlink d3/d26/d77/l46 0 2024-09-11T00:07:28.471 INFO:tasks.workunit.client.0.smithi111.stdout:3/777: creat d1c/d1d/d22/d44/d5a/d74/d7b/f10f x:0 0 0 2024-09-11T00:07:28.477 INFO:tasks.workunit.client.1.smithi203.stdout:0/685: sync 2024-09-11T00:07:28.477 INFO:tasks.workunit.client.1.smithi203.stdout:1/830: sync 2024-09-11T00:07:28.477 INFO:tasks.workunit.client.1.smithi203.stdout:2/780: sync 2024-09-11T00:07:28.478 INFO:tasks.workunit.client.1.smithi203.stdout:1/831: chown d8/d9/d15/d27/d102 0 1 2024-09-11T00:07:28.479 INFO:tasks.workunit.client.0.smithi111.stdout:8/777: creat d11/d23/d2c/d46/d81/dd2/ff3 x:0 0 0 2024-09-11T00:07:28.489 INFO:tasks.workunit.client.0.smithi111.stdout:2/709: read d0/d3/d12/f41 [514794,16787] 0 2024-09-11T00:07:28.493 INFO:tasks.workunit.client.0.smithi111.stdout:0/788: mkdir d3/d1c/d50/dec/d118 0 2024-09-11T00:07:28.496 INFO:tasks.workunit.client.0.smithi111.stdout:7/793: dread f7 [0,4194304] 0 2024-09-11T00:07:28.497 INFO:tasks.workunit.client.0.smithi111.stdout:3/778: creat d1c/d1d/d22/d44/d5a/d74/f110 x:0 0 0 2024-09-11T00:07:28.498 INFO:tasks.workunit.client.0.smithi111.stdout:6/731: mknod d7/d22/d26/d87/d41/de0/cfa 0 2024-09-11T00:07:28.501 INFO:tasks.workunit.client.0.smithi111.stdout:1/745: getdents d2/de/d93/d9c 0 2024-09-11T00:07:28.505 INFO:tasks.workunit.client.1.smithi203.stdout:8/662: creat d1/d13/d17/d48/d9d/da9/fdb x:0 0 0 2024-09-11T00:07:28.509 INFO:tasks.workunit.client.0.smithi111.stdout:2/710: unlink d0/d3/de/fd6 0 2024-09-11T00:07:28.510 INFO:tasks.workunit.client.0.smithi111.stdout:3/779: creat d1c/d1d/d22/d44/d5a/d74/f111 x:0 0 0 2024-09-11T00:07:28.510 INFO:tasks.workunit.client.0.smithi111.stdout:1/746: chown d2/de/d12/d3c/d4b/d6a/f3d 650 1 2024-09-11T00:07:28.511 INFO:tasks.workunit.client.0.smithi111.stdout:8/778: mkdir d11/d21/d38/df4 0 2024-09-11T00:07:28.512 INFO:tasks.workunit.client.0.smithi111.stdout:6/732: mknod d7/d22/d2c/d38/d39/db3/cfb 0 2024-09-11T00:07:28.512 INFO:tasks.workunit.client.0.smithi111.stdout:5/786: dwrite f2 [4194304,4194304] 0 2024-09-11T00:07:28.517 INFO:tasks.workunit.client.1.smithi203.stdout:6/704: creat d0/d54/d9c/d35/d38/dc0/fe5 x:0 0 0 2024-09-11T00:07:28.517 INFO:tasks.workunit.client.0.smithi111.stdout:7/794: link dd/d49/f99 dd/d1d/d7e/df8/d8f/dac/fff 0 2024-09-11T00:07:28.518 INFO:tasks.workunit.client.0.smithi111.stdout:9/797: link d6/db/d1b/l4d d6/db/d7a/d9a/l102 0 2024-09-11T00:07:28.524 INFO:tasks.workunit.client.1.smithi203.stdout:0/686: creat d0/d2/d37/d5b/d73/fe8 x:0 0 0 2024-09-11T00:07:28.526 INFO:tasks.workunit.client.0.smithi111.stdout:8/779: unlink d11/d23/d2c/d46/f69 0 2024-09-11T00:07:28.529 INFO:tasks.workunit.client.1.smithi203.stdout:2/781: creat d13/d15/d19/d1c/d76/d94/d97/f101 x:0 0 0 2024-09-11T00:07:28.529 INFO:tasks.workunit.client.0.smithi111.stdout:4/736: dwrite d18/d3b/d61/f7c [0,4194304] 0 2024-09-11T00:07:28.529 INFO:tasks.workunit.client.0.smithi111.stdout:8/780: chown d11/d23/d7e/ldd 1121474 1 2024-09-11T00:07:28.530 INFO:tasks.workunit.client.0.smithi111.stdout:6/733: dread d7/f6b [0,4194304] 0 2024-09-11T00:07:28.532 INFO:tasks.workunit.client.1.smithi203.stdout:9/708: mkdir d6/de/d47/de1/dec 0 2024-09-11T00:07:28.535 INFO:tasks.workunit.client.1.smithi203.stdout:8/663: symlink d1/d13/d17/d48/d9d/da9/ldc 0 2024-09-11T00:07:28.537 INFO:tasks.workunit.client.1.smithi203.stdout:5/769: mkdir dc/dd/d56/dad/d100 0 2024-09-11T00:07:28.539 INFO:tasks.workunit.client.0.smithi111.stdout:5/787: truncate d10/d1e/d23/d30/d3c/f4e 1318239 0 2024-09-11T00:07:28.543 INFO:tasks.workunit.client.1.smithi203.stdout:3/765: rmdir d8/dce/d102 0 2024-09-11T00:07:28.543 INFO:tasks.workunit.client.1.smithi203.stdout:4/621: write db/dd/d16/d38/d3c/f68 [1867667,104937] 0 2024-09-11T00:07:28.543 INFO:tasks.workunit.client.0.smithi111.stdout:3/780: write d1c/d21/d92/f9a [3356522,55520] 0 2024-09-11T00:07:28.544 INFO:tasks.workunit.client.1.smithi203.stdout:6/705: mknod d0/d5b/ce6 0 2024-09-11T00:07:28.547 INFO:tasks.workunit.client.0.smithi111.stdout:8/781: creat d11/d23/d2c/d7f/dde/ff5 x:0 0 0 2024-09-11T00:07:28.550 INFO:tasks.workunit.client.0.smithi111.stdout:4/737: rmdir d18/d20/d4a 39 2024-09-11T00:07:28.553 INFO:tasks.workunit.client.1.smithi203.stdout:7/720: dwrite dd/d1c/f29 [0,4194304] 0 2024-09-11T00:07:28.554 INFO:tasks.workunit.client.1.smithi203.stdout:9/709: rmdir d6/de/d32/d52/d55/d66 39 2024-09-11T00:07:28.555 INFO:tasks.workunit.client.0.smithi111.stdout:6/734: creat d7/d22/d26/d87/d41/d77/ffc x:0 0 0 2024-09-11T00:07:28.557 INFO:tasks.workunit.client.1.smithi203.stdout:8/664: creat d1/d13/d3a/d75/fdd x:0 0 0 2024-09-11T00:07:28.559 INFO:tasks.workunit.client.0.smithi111.stdout:2/711: creat d0/d3/d12/fef x:0 0 0 2024-09-11T00:07:28.562 INFO:tasks.workunit.client.0.smithi111.stdout:7/795: mkdir dd/d1d/d4d/d82/d100 0 2024-09-11T00:07:28.564 INFO:tasks.workunit.client.0.smithi111.stdout:7/796: dread - dd/d1d/d7e/dc8/fd8 zero size 2024-09-11T00:07:28.570 INFO:tasks.workunit.client.1.smithi203.stdout:9/710: dread d6/de/d19/fc9 [0,4194304] 0 2024-09-11T00:07:28.570 INFO:tasks.workunit.client.1.smithi203.stdout:2/782: mkdir d13/d102 0 2024-09-11T00:07:28.571 INFO:tasks.workunit.client.1.smithi203.stdout:2/783: chown d13/d56/d69/f9b 1 1 2024-09-11T00:07:28.575 INFO:tasks.workunit.client.1.smithi203.stdout:6/706: fdatasync d0/d32/f58 0 2024-09-11T00:07:28.576 INFO:tasks.workunit.client.1.smithi203.stdout:2/784: read d13/d15/d19/d1c/d73/f81 [3373495,59770] 0 2024-09-11T00:07:28.579 INFO:tasks.workunit.client.1.smithi203.stdout:4/622: rename db/d12/d15/d2a/f34 to db/d12/d15/fc7 0 2024-09-11T00:07:28.581 INFO:tasks.workunit.client.1.smithi203.stdout:1/832: creat d8/d19/d60/d90/d3e/f12c x:0 0 0 2024-09-11T00:07:28.582 INFO:tasks.workunit.client.1.smithi203.stdout:4/623: write db/d12/d15/d2a/d71/f94 [3789500,14214] 0 2024-09-11T00:07:28.583 INFO:tasks.workunit.client.0.smithi111.stdout:1/747: dwrite d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/f5d [0,4194304] 0 2024-09-11T00:07:28.583 INFO:tasks.workunit.client.1.smithi203.stdout:1/833: dread - d8/d9/f11f zero size 2024-09-11T00:07:28.583 INFO:tasks.workunit.client.1.smithi203.stdout:7/721: creat dd/d3b/f107 x:0 0 0 2024-09-11T00:07:28.590 INFO:tasks.workunit.client.1.smithi203.stdout:5/770: mknod dc/d2b/dba/c101 0 2024-09-11T00:07:28.590 INFO:tasks.workunit.client.1.smithi203.stdout:8/665: mknod d1/d13/d17/d2f/d9e/cde 0 2024-09-11T00:07:28.592 INFO:tasks.workunit.client.0.smithi111.stdout:3/781: fdatasync d1c/d1d/d22/d23/d58/f75 0 2024-09-11T00:07:28.594 INFO:tasks.workunit.client.0.smithi111.stdout:3/782: fsync d1c/d1d/d22/d31/d62/fda 0 2024-09-11T00:07:28.596 INFO:tasks.workunit.client.1.smithi203.stdout:3/766: dwrite d8/da/d5c/d6b/d6c/fac [0,4194304] 0 2024-09-11T00:07:28.596 INFO:tasks.workunit.client.0.smithi111.stdout:3/783: write f17 [4646924,13487] 0 2024-09-11T00:07:28.602 INFO:tasks.workunit.client.1.smithi203.stdout:6/707: mkdir d0/d5b/d5c/d6f/de7 0 2024-09-11T00:07:28.604 INFO:tasks.workunit.client.1.smithi203.stdout:0/687: dwrite d0/d2/f1a [0,4194304] 0 2024-09-11T00:07:28.606 INFO:tasks.workunit.client.0.smithi111.stdout:7/797: dwrite f7 [0,4194304] 0 2024-09-11T00:07:28.616 INFO:tasks.workunit.client.0.smithi111.stdout:7/798: stat dd/d48/d69/dea/lf6 0 2024-09-11T00:07:28.618 INFO:tasks.workunit.client.1.smithi203.stdout:7/722: mkdir dd/d1c/d52/d8f/d31/d58/d93/d98/dfc/d108 0 2024-09-11T00:07:28.620 INFO:tasks.workunit.client.0.smithi111.stdout:4/738: dwrite d18/d20/d4a/f64 [4194304,4194304] 0 2024-09-11T00:07:28.620 INFO:tasks.workunit.client.0.smithi111.stdout:6/735: rename d7/d22/d26/d87/d41/d77/ldb to d7/d22/d1d/d69/lfd 0 2024-09-11T00:07:28.622 INFO:tasks.workunit.client.0.smithi111.stdout:6/736: stat d7/d22/d1d/d83/cf8 0 2024-09-11T00:07:28.623 INFO:tasks.workunit.client.0.smithi111.stdout:3/784: mkdir d1c/d1d/d22/d44/d5a/dcd/dd2/d112 0 2024-09-11T00:07:28.624 INFO:tasks.workunit.client.0.smithi111.stdout:3/785: read - d1c/d1d/dac/ff7 zero size 2024-09-11T00:07:28.627 INFO:tasks.workunit.client.0.smithi111.stdout:2/712: truncate d0/d3/fb9 1384716 0 2024-09-11T00:07:28.627 INFO:tasks.workunit.client.1.smithi203.stdout:8/666: creat d1/d13/d17/d2f/d52/d49/fdf x:0 0 0 2024-09-11T00:07:28.628 INFO:tasks.workunit.client.0.smithi111.stdout:3/786: chown d1c/d1d/d22/d23/d58/d5c/le2 15475025 1 2024-09-11T00:07:28.629 INFO:tasks.workunit.client.0.smithi111.stdout:1/748: link d2/de/d12/d3c/f69 d2/de/d12/ff9 0 2024-09-11T00:07:28.632 INFO:tasks.workunit.client.1.smithi203.stdout:4/624: write db/f6c [1865013,115932] 0 2024-09-11T00:07:28.633 INFO:tasks.workunit.client.1.smithi203.stdout:2/785: symlink d13/d15/l103 0 2024-09-11T00:07:28.634 INFO:tasks.workunit.client.0.smithi111.stdout:5/788: getdents d10/d1e 0 2024-09-11T00:07:28.636 INFO:tasks.workunit.client.1.smithi203.stdout:9/711: truncate d6/de/d47/dc3/fd9 2046557 0 2024-09-11T00:07:28.637 INFO:tasks.workunit.client.0.smithi111.stdout:8/782: getdents d11 0 2024-09-11T00:07:28.638 INFO:tasks.workunit.client.0.smithi111.stdout:0/789: sync 2024-09-11T00:07:28.638 INFO:tasks.workunit.client.1.smithi203.stdout:2/786: readlink d13/ddb/lf9 0 2024-09-11T00:07:28.639 INFO:tasks.workunit.client.1.smithi203.stdout:4/625: read db/dd/d16/f7b [1164175,105770] 0 2024-09-11T00:07:28.640 INFO:tasks.workunit.client.0.smithi111.stdout:6/737: creat d7/d22/d26/d95/dd6/ffe x:0 0 0 2024-09-11T00:07:28.642 INFO:tasks.workunit.client.0.smithi111.stdout:6/738: fsync d7/d22/d3f/d74/f9e 0 2024-09-11T00:07:28.642 INFO:tasks.workunit.client.1.smithi203.stdout:6/708: read - d0/d5b/fbf zero size 2024-09-11T00:07:28.644 INFO:tasks.workunit.client.0.smithi111.stdout:3/787: unlink d1c/d21/f3b 0 2024-09-11T00:07:28.645 INFO:tasks.workunit.client.1.smithi203.stdout:0/688: dwrite d0/d1d/d5d/dba/fdf [0,4194304] 0 2024-09-11T00:07:28.646 INFO:tasks.workunit.client.0.smithi111.stdout:2/713: symlink d0/d3/de/db4/lf0 0 2024-09-11T00:07:28.646 INFO:tasks.workunit.client.1.smithi203.stdout:7/723: creat dd/d1c/d52/d8f/d31/d67/f109 x:0 0 0 2024-09-11T00:07:28.648 INFO:tasks.workunit.client.0.smithi111.stdout:5/789: symlink d10/d1e/d23/d30/d59/dd1/l100 0 2024-09-11T00:07:28.652 INFO:tasks.workunit.client.0.smithi111.stdout:8/783: mkdir d11/d21/d6f/df6 0 2024-09-11T00:07:28.653 INFO:tasks.workunit.client.0.smithi111.stdout:4/739: mkdir d18/d3b/d9f/db7/de5 0 2024-09-11T00:07:28.654 INFO:tasks.workunit.client.1.smithi203.stdout:8/667: truncate d1/d13/d43/dab/fbd 1024526 0 2024-09-11T00:07:28.661 INFO:tasks.workunit.client.1.smithi203.stdout:6/709: read d0/d54/d9c/d35/f99 [1172743,40726] 0 2024-09-11T00:07:28.663 INFO:tasks.workunit.client.0.smithi111.stdout:4/740: dread d18/f81 [0,4194304] 0 2024-09-11T00:07:28.665 INFO:tasks.workunit.client.0.smithi111.stdout:3/788: dwrite d1c/d1d/d22/f9b [0,4194304] 0 2024-09-11T00:07:28.667 INFO:tasks.workunit.client.0.smithi111.stdout:6/739: fdatasync d7/d22/d2c/f37 0 2024-09-11T00:07:28.667 INFO:tasks.workunit.client.0.smithi111.stdout:0/790: dread d3/dc/fcb [0,4194304] 0 2024-09-11T00:07:28.668 INFO:tasks.workunit.client.0.smithi111.stdout:0/791: chown d3/d26/d77/c39 995 1 2024-09-11T00:07:28.673 INFO:tasks.workunit.client.1.smithi203.stdout:2/787: dwrite d13/d15/d30/dfa/daf/fd1 [0,4194304] 0 2024-09-11T00:07:28.673 INFO:tasks.workunit.client.0.smithi111.stdout:2/714: mkdir d0/d3/de/d68/df1 0 2024-09-11T00:07:28.674 INFO:tasks.workunit.client.1.smithi203.stdout:9/712: creat d6/de/d47/fed x:0 0 0 2024-09-11T00:07:28.678 INFO:tasks.workunit.client.1.smithi203.stdout:5/771: dwrite dc/dd/d15/dbd/d59/da8/fbe [0,4194304] 0 2024-09-11T00:07:28.681 INFO:tasks.workunit.client.1.smithi203.stdout:0/689: mknod d0/d2/d37/d5b/d73/ce9 0 2024-09-11T00:07:28.683 INFO:tasks.workunit.client.0.smithi111.stdout:0/792: dwrite d3/d13/d1e/d29/d49/f76 [0,4194304] 0 2024-09-11T00:07:28.696 INFO:tasks.workunit.client.0.smithi111.stdout:7/799: rename dd/d1d/d7e/dc8/l52 to dd/d1d/d76/l101 0 2024-09-11T00:07:28.696 INFO:tasks.workunit.client.1.smithi203.stdout:7/724: fdatasync dd/d1c/d52/d8f/d31/d67/dc8/fb6 0 2024-09-11T00:07:28.698 INFO:tasks.workunit.client.0.smithi111.stdout:7/800: fdatasync dd/d1d/d7e/df8/fc3 0 2024-09-11T00:07:28.698 INFO:tasks.workunit.client.0.smithi111.stdout:8/784: dread d11/d23/d2c/d46/f8c [0,4194304] 0 2024-09-11T00:07:28.700 INFO:tasks.workunit.client.1.smithi203.stdout:1/834: write d8/d9/d15/d35/d81/f83 [522869,100848] 0 2024-09-11T00:07:28.703 INFO:tasks.workunit.client.0.smithi111.stdout:3/789: mkdir d1c/d21/dae/d113 0 2024-09-11T00:07:28.705 INFO:tasks.workunit.client.1.smithi203.stdout:3/767: getdents d8/d3c 0 2024-09-11T00:07:28.705 INFO:tasks.workunit.client.1.smithi203.stdout:6/710: rmdir d0/d54/d9c/d35/d39/db2 39 2024-09-11T00:07:28.706 INFO:tasks.workunit.client.1.smithi203.stdout:2/788: rename d13/d15/fa8 to d13/d15/d30/f104 0 2024-09-11T00:07:28.710 INFO:tasks.workunit.client.1.smithi203.stdout:4/626: write db/dd/d16/d38/f74 [1665689,21770] 0 2024-09-11T00:07:28.712 INFO:tasks.workunit.client.0.smithi111.stdout:9/798: sync 2024-09-11T00:07:28.715 INFO:tasks.workunit.client.1.smithi203.stdout:9/713: rmdir d6/de/d19/d24/d6c 39 2024-09-11T00:07:28.720 INFO:tasks.workunit.client.1.smithi203.stdout:9/714: read - d6/de/d32/d52/fe8 zero size 2024-09-11T00:07:28.722 INFO:tasks.workunit.client.0.smithi111.stdout:2/715: mkdir d0/d3/de/d3b/d92/df2 0 2024-09-11T00:07:28.723 INFO:tasks.workunit.client.1.smithi203.stdout:4/627: chown db/dd/d16/f55 0 1 2024-09-11T00:07:28.725 INFO:tasks.workunit.client.1.smithi203.stdout:0/690: creat d0/d2/d37/fea x:0 0 0 2024-09-11T00:07:28.726 INFO:tasks.workunit.client.0.smithi111.stdout:1/749: write d2/de/d12/fd7 [61314,38381] 0 2024-09-11T00:07:28.728 INFO:tasks.workunit.client.1.smithi203.stdout:0/691: truncate d0/d2/d37/d7f/fcd 488988 0 2024-09-11T00:07:28.731 INFO:tasks.workunit.client.1.smithi203.stdout:4/628: chown db/dd/d16/d38/d3c/d41/f8e 164 1 2024-09-11T00:07:28.733 INFO:tasks.workunit.client.0.smithi111.stdout:5/790: dwrite d10/d1e/d23/d26/d78/f7f [0,4194304] 0 2024-09-11T00:07:28.735 INFO:tasks.workunit.client.0.smithi111.stdout:7/801: creat dd/ddf/f102 x:0 0 0 2024-09-11T00:07:28.736 INFO:tasks.workunit.client.0.smithi111.stdout:5/791: readlink d10/d1e/d23/d30/dd8/da2/d66/l69 0 2024-09-11T00:07:28.737 INFO:tasks.workunit.client.1.smithi203.stdout:0/692: dread - d0/d2/d37/d5b/fda zero size 2024-09-11T00:07:28.737 INFO:tasks.workunit.client.0.smithi111.stdout:7/802: chown dd/d1d/d1f/c22 90352 1 2024-09-11T00:07:28.739 INFO:tasks.workunit.client.1.smithi203.stdout:6/711: chown d0/d32/d5a/c8c 331934 1 2024-09-11T00:07:28.741 INFO:tasks.workunit.client.0.smithi111.stdout:8/785: unlink d11/d21/d38/f47 0 2024-09-11T00:07:28.743 INFO:tasks.workunit.client.0.smithi111.stdout:6/740: mkdir d7/d22/d2c/dff 0 2024-09-11T00:07:28.743 INFO:tasks.workunit.client.0.smithi111.stdout:3/790: creat d1c/d1d/d22/d44/d5a/dcd/f114 x:0 0 0 2024-09-11T00:07:28.744 INFO:tasks.workunit.client.0.smithi111.stdout:8/786: read - d11/f9b zero size 2024-09-11T00:07:28.744 INFO:tasks.workunit.client.0.smithi111.stdout:1/750: dread d2/de/d12/ff9 [0,4194304] 0 2024-09-11T00:07:28.748 INFO:tasks.workunit.client.0.smithi111.stdout:2/716: creat d0/d3/de/db4/ff3 x:0 0 0 2024-09-11T00:07:28.748 INFO:tasks.workunit.client.0.smithi111.stdout:9/799: dread d6/db/d34/d37/f28 [0,4194304] 0 2024-09-11T00:07:28.749 INFO:tasks.workunit.client.0.smithi111.stdout:8/787: truncate d11/d23/d2c/d7f/dde/ff5 759523 0 2024-09-11T00:07:28.755 INFO:tasks.workunit.client.1.smithi203.stdout:3/768: mknod d8/da/d37/d53/dea/de5/d103/c110 0 2024-09-11T00:07:28.756 INFO:tasks.workunit.client.1.smithi203.stdout:1/835: mkdir d8/d11/de1/d12d 0 2024-09-11T00:07:28.757 INFO:tasks.workunit.client.0.smithi111.stdout:3/791: dwrite d1c/d21/f4f [0,4194304] 0 2024-09-11T00:07:28.758 INFO:tasks.workunit.client.1.smithi203.stdout:6/712: chown d0/c75 115027 1 2024-09-11T00:07:28.759 INFO:tasks.workunit.client.1.smithi203.stdout:9/715: creat d6/de/d47/de1/dec/fee x:0 0 0 2024-09-11T00:07:28.764 INFO:tasks.workunit.client.0.smithi111.stdout:2/717: readlink d0/l2f 0 2024-09-11T00:07:28.768 INFO:tasks.workunit.client.1.smithi203.stdout:8/668: dread d1/f2 [4194304,4194304] 0 2024-09-11T00:07:28.769 INFO:tasks.workunit.client.0.smithi111.stdout:8/788: mknod d11/d23/d3d/cf7 0 2024-09-11T00:07:28.776 INFO:tasks.workunit.client.1.smithi203.stdout:4/629: creat db/d12/fc8 x:0 0 0 2024-09-11T00:07:28.778 INFO:tasks.workunit.client.0.smithi111.stdout:4/741: getdents d18/d20/d3c/d5e/daa/dbb 0 2024-09-11T00:07:28.780 INFO:tasks.workunit.client.0.smithi111.stdout:5/792: mkdir d10/d1e/d23/d26/d3a/d98/d6d/def/d101 0 2024-09-11T00:07:28.783 INFO:tasks.workunit.client.0.smithi111.stdout:2/718: dread d0/d3/de/f11 [0,4194304] 0 2024-09-11T00:07:28.784 INFO:tasks.workunit.client.0.smithi111.stdout:3/792: rmdir d1c/d1d/d22/d23/d2f/de8/d5f 39 2024-09-11T00:07:28.789 INFO:tasks.workunit.client.0.smithi111.stdout:1/751: mknod d2/de/d12/d6c/cfa 0 2024-09-11T00:07:28.791 INFO:tasks.workunit.client.1.smithi203.stdout:8/669: fdatasync d1/d13/d22/f58 0 2024-09-11T00:07:28.791 INFO:tasks.workunit.client.0.smithi111.stdout:0/793: dread d3/d26/d77/f82 [0,4194304] 0 2024-09-11T00:07:28.793 INFO:tasks.workunit.client.0.smithi111.stdout:0/794: chown d3/d13/d1e/deb/d61/d93/f97 750899674 1 2024-09-11T00:07:28.794 INFO:tasks.workunit.client.0.smithi111.stdout:8/789: unlink d11/d21/d38/l56 0 2024-09-11T00:07:28.798 INFO:tasks.workunit.client.0.smithi111.stdout:9/800: link d6/dc/d7c/f9c d6/d52/d8a/f103 0 2024-09-11T00:07:28.799 INFO:tasks.workunit.client.1.smithi203.stdout:6/713: mkdir d0/d54/d9c/d35/de8 0 2024-09-11T00:07:28.800 INFO:tasks.workunit.client.1.smithi203.stdout:4/630: creat db/dd/d16/d38/fc9 x:0 0 0 2024-09-11T00:07:28.802 INFO:tasks.workunit.client.1.smithi203.stdout:2/789: dread d13/d15/f55 [0,4194304] 0 2024-09-11T00:07:28.803 INFO:tasks.workunit.client.0.smithi111.stdout:4/742: chown d18/d20/d3c/d5e/daa/ccf 3565 1 2024-09-11T00:07:28.805 INFO:tasks.workunit.client.0.smithi111.stdout:0/795: dwrite f1 [0,4194304] 0 2024-09-11T00:07:28.805 INFO:tasks.workunit.client.1.smithi203.stdout:5/772: dwrite dc/dd/d15/d3b/f63 [4194304,4194304] 0 2024-09-11T00:07:28.807 INFO:tasks.workunit.client.0.smithi111.stdout:0/796: fsync d3/d13/d1e/d29/db0/f10d 0 2024-09-11T00:07:28.810 INFO:tasks.workunit.client.0.smithi111.stdout:3/793: mkdir d1c/d21/d92/d115 0 2024-09-11T00:07:28.813 INFO:tasks.workunit.client.0.smithi111.stdout:3/794: dread - d1c/d1d/d22/d44/d5a/dcd/f114 zero size 2024-09-11T00:07:28.813 INFO:tasks.workunit.client.0.smithi111.stdout:1/752: creat d2/d2b/dc9/dba/ffb x:0 0 0 2024-09-11T00:07:28.815 INFO:tasks.workunit.client.0.smithi111.stdout:6/741: write d7/d22/d1d/d69/ff1 [123769,128440] 0 2024-09-11T00:07:28.819 INFO:tasks.workunit.client.1.smithi203.stdout:4/631: dwrite db/d12/d15/d2a/d88/faa [0,4194304] 0 2024-09-11T00:07:28.822 INFO:tasks.workunit.client.0.smithi111.stdout:9/801: mknod d6/dc/d73/c104 0 2024-09-11T00:07:28.825 INFO:tasks.workunit.client.1.smithi203.stdout:1/836: write d8/d9/d15/d35/d81/f9e [400111,341] 0 2024-09-11T00:07:28.826 INFO:tasks.workunit.client.0.smithi111.stdout:5/793: link d10/f1b d10/d1e/f102 0 2024-09-11T00:07:28.830 INFO:tasks.workunit.client.0.smithi111.stdout:1/753: fdatasync d2/de/f17 0 2024-09-11T00:07:28.832 INFO:tasks.workunit.client.1.smithi203.stdout:9/716: write d6/de/d19/f97 [3630936,12602] 0 2024-09-11T00:07:28.833 INFO:tasks.workunit.client.1.smithi203.stdout:2/790: chown d13/d22/c93 1 1 2024-09-11T00:07:28.833 INFO:tasks.workunit.client.1.smithi203.stdout:1/837: chown d8/d28 0 1 2024-09-11T00:07:28.837 INFO:tasks.workunit.client.0.smithi111.stdout:9/802: creat d6/d52/d8a/f105 x:0 0 0 2024-09-11T00:07:28.839 INFO:tasks.workunit.client.1.smithi203.stdout:3/769: dwrite d8/da/d37/f47 [0,4194304] 0 2024-09-11T00:07:28.847 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:28 smithi111 ceph-mon[27539]: pgmap v12: 65 pgs: 65 active+clean; 3.0 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 89 MiB/s rd, 245 MiB/s wr, 495 op/s 2024-09-11T00:07:28.847 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:28 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:28.847 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:28 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:28.848 INFO:tasks.workunit.client.0.smithi111.stdout:7/803: sync 2024-09-11T00:07:28.848 INFO:tasks.workunit.client.1.smithi203.stdout:3/770: chown d8/da/d5c/d80 4 1 2024-09-11T00:07:28.848 INFO:tasks.workunit.client.1.smithi203.stdout:9/717: mkdir d6/de/d32/d52/d44/def 0 2024-09-11T00:07:28.855 INFO:tasks.workunit.client.0.smithi111.stdout:2/719: dwrite d0/d3/de/d3b/d92/fc2 [0,4194304] 0 2024-09-11T00:07:28.859 INFO:tasks.workunit.client.0.smithi111.stdout:6/742: mknod d7/d22/d1d/d69/c100 0 2024-09-11T00:07:28.861 INFO:tasks.workunit.client.1.smithi203.stdout:5/773: dread dc/dd/d1e/f54 [0,4194304] 0 2024-09-11T00:07:28.861 INFO:tasks.workunit.client.1.smithi203.stdout:6/714: write d0/d5b/fa3 [1008063,110320] 0 2024-09-11T00:07:28.861 INFO:tasks.workunit.client.0.smithi111.stdout:6/743: read - d7/d22/d26/d87/d7a/dc5/fc6 zero size 2024-09-11T00:07:28.864 INFO:tasks.workunit.client.1.smithi203.stdout:5/774: chown dc/dd/d9b/ffd 776 1 2024-09-11T00:07:28.864 INFO:tasks.workunit.client.0.smithi111.stdout:1/754: mknod d2/de/d82/cfc 0 2024-09-11T00:07:28.871 INFO:tasks.workunit.client.1.smithi203.stdout:9/718: symlink d6/de/d47/de1/dec/lf0 0 2024-09-11T00:07:28.872 INFO:tasks.workunit.client.1.smithi203.stdout:8/670: dwrite d1/d13/d3a/d4c/f5e [0,4194304] 0 2024-09-11T00:07:28.876 INFO:tasks.workunit.client.1.smithi203.stdout:3/771: dwrite d8/da/d5c/f106 [0,4194304] 0 2024-09-11T00:07:28.880 INFO:tasks.workunit.client.1.smithi203.stdout:8/671: readlink d1/d13/d17/d48/l5a 0 2024-09-11T00:07:28.880 INFO:tasks.workunit.client.0.smithi111.stdout:8/790: getdents d11/d8e 0 2024-09-11T00:07:28.881 INFO:tasks.workunit.client.0.smithi111.stdout:0/797: dwrite d3/d1c/fad [0,4194304] 0 2024-09-11T00:07:28.881 INFO:tasks.workunit.client.1.smithi203.stdout:8/672: chown d1/f2 2893 1 2024-09-11T00:07:28.882 INFO:tasks.workunit.client.0.smithi111.stdout:3/795: dwrite d1c/d1d/d22/d44/f97 [0,4194304] 0 2024-09-11T00:07:28.896 INFO:tasks.workunit.client.0.smithi111.stdout:2/720: truncate d0/d3/f1c 3388413 0 2024-09-11T00:07:28.897 INFO:tasks.workunit.client.1.smithi203.stdout:4/632: truncate db/d12/d15/d2a/f82 3616431 0 2024-09-11T00:07:28.900 INFO:tasks.workunit.client.1.smithi203.stdout:4/633: chown db/d12/f7d 104232542 1 2024-09-11T00:07:28.904 INFO:tasks.workunit.client.1.smithi203.stdout:3/772: fdatasync d8/da/d37/d83/fd4 0 2024-09-11T00:07:28.904 INFO:tasks.workunit.client.1.smithi203.stdout:5/775: symlink dc/dd/d1e/l102 0 2024-09-11T00:07:28.906 INFO:tasks.workunit.client.0.smithi111.stdout:4/743: getdents d18/d1f/d36/d95 0 2024-09-11T00:07:28.910 INFO:tasks.workunit.client.1.smithi203.stdout:2/791: link d13/d15/d30/l3a d13/d56/d69/d99/l105 0 2024-09-11T00:07:28.911 INFO:tasks.workunit.client.0.smithi111.stdout:5/794: fsync d10/d1e/d23/d30/d59/d52/d85/dd2/df1/fde 0 2024-09-11T00:07:28.914 INFO:tasks.workunit.client.1.smithi203.stdout:1/838: dwrite d8/d11/fc9 [0,4194304] 0 2024-09-11T00:07:28.914 INFO:tasks.workunit.client.0.smithi111.stdout:7/804: write dd/d1d/d2d/f86 [438865,3969] 0 2024-09-11T00:07:28.918 INFO:tasks.workunit.client.1.smithi203.stdout:8/673: mkdir d1/d13/d3a/da4/de0 0 2024-09-11T00:07:28.926 INFO:tasks.workunit.client.1.smithi203.stdout:5/776: dread dc/fc3 [0,4194304] 0 2024-09-11T00:07:28.928 INFO:tasks.workunit.client.1.smithi203.stdout:6/715: dwrite d0/d32/d5a/fba [0,4194304] 0 2024-09-11T00:07:28.932 INFO:tasks.workunit.client.1.smithi203.stdout:3/773: creat d8/da/d37/d83/db9/f111 x:0 0 0 2024-09-11T00:07:28.940 INFO:tasks.workunit.client.0.smithi111.stdout:2/721: mknod d0/d3/d12/d38/cf4 0 2024-09-11T00:07:28.946 INFO:tasks.workunit.client.0.smithi111.stdout:1/755: symlink d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/d7b/lfd 0 2024-09-11T00:07:28.948 INFO:tasks.workunit.client.0.smithi111.stdout:1/756: chown d2/de/d12/fd7 79384085 1 2024-09-11T00:07:28.950 INFO:tasks.workunit.client.1.smithi203.stdout:8/674: creat d1/d13/d3a/da4/fe1 x:0 0 0 2024-09-11T00:07:28.951 INFO:tasks.workunit.client.0.smithi111.stdout:1/757: chown d2/d77/faf 401782 1 2024-09-11T00:07:28.951 INFO:tasks.workunit.client.0.smithi111.stdout:3/796: dwrite d1c/d1d/d22/d23/d58/df2/f102 [0,4194304] 0 2024-09-11T00:07:28.955 INFO:tasks.workunit.client.0.smithi111.stdout:5/795: read d10/f6b [765,123139] 0 2024-09-11T00:07:28.956 INFO:tasks.workunit.client.0.smithi111.stdout:7/805: unlink dd/d1d/d1f/f81 0 2024-09-11T00:07:28.956 INFO:tasks.workunit.client.1.smithi203.stdout:5/777: mkdir dc/dd/d1e/dc6/d103 0 2024-09-11T00:07:28.957 INFO:tasks.workunit.client.0.smithi111.stdout:6/744: dwrite d7/d22/d1d/d69/db4/fdf [0,4194304] 0 2024-09-11T00:07:28.960 INFO:tasks.workunit.client.0.smithi111.stdout:5/796: chown d10/d1e/d23/d2b/d2f/c70 512245 1 2024-09-11T00:07:28.961 INFO:tasks.workunit.client.1.smithi203.stdout:5/778: dread - dc/d4f/d5c/f69 zero size 2024-09-11T00:07:28.961 INFO:tasks.workunit.client.1.smithi203.stdout:1/839: dread d8/d19/d60/d90/d3e/d4b/d41/f70 [0,4194304] 0 2024-09-11T00:07:28.963 INFO:tasks.workunit.client.0.smithi111.stdout:9/803: rmdir d6/db/d7a/d9a/de6 0 2024-09-11T00:07:28.966 INFO:tasks.workunit.client.0.smithi111.stdout:8/791: mkdir d11/d23/d2c/d46/d64/df8 0 2024-09-11T00:07:28.967 INFO:tasks.workunit.client.0.smithi111.stdout:0/798: mknod d3/da/d7b/c119 0 2024-09-11T00:07:28.971 INFO:tasks.workunit.client.1.smithi203.stdout:9/719: dwrite d6/de/d19/d24/f36 [0,4194304] 0 2024-09-11T00:07:28.972 INFO:tasks.workunit.client.1.smithi203.stdout:2/792: getdents d13/d22/dd6 0 2024-09-11T00:07:28.974 INFO:tasks.workunit.client.1.smithi203.stdout:5/779: chown dc/d2b/dba 95056254 1 2024-09-11T00:07:28.977 INFO:tasks.workunit.client.1.smithi203.stdout:4/634: getdents db/dd/d26/d42 0 2024-09-11T00:07:28.979 INFO:tasks.workunit.client.0.smithi111.stdout:8/792: dwrite d11/d23/d7e/d93/fdb [0,4194304] 0 2024-09-11T00:07:28.980 INFO:tasks.workunit.client.0.smithi111.stdout:1/758: rename d2/de/d93/d9f/l15 to d2/de/d12/d3c/d4b/d6a/d63/d73/da1/lfe 0 2024-09-11T00:07:28.983 INFO:tasks.workunit.client.0.smithi111.stdout:1/759: write d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/f5b [8267408,66235] 0 2024-09-11T00:07:28.987 INFO:tasks.workunit.client.1.smithi203.stdout:9/720: write d6/de/d19/d24/f36 [2834427,90797] 0 2024-09-11T00:07:28.990 INFO:tasks.workunit.client.0.smithi111.stdout:0/799: unlink d3/d26/d77/f86 0 2024-09-11T00:07:28.991 INFO:tasks.workunit.client.1.smithi203.stdout:3/774: dwrite d8/d3c/fa8 [0,4194304] 0 2024-09-11T00:07:28.993 INFO:tasks.workunit.client.1.smithi203.stdout:5/780: dread - dc/d9f/fbf zero size 2024-09-11T00:07:28.998 INFO:tasks.workunit.client.1.smithi203.stdout:5/781: dread - dc/dd/d15/dbd/f92 zero size 2024-09-11T00:07:29.004 INFO:tasks.workunit.client.0.smithi111.stdout:4/744: link d18/d20/d3c/d5e/daa/fc6 d18/d20/fe6 0 2024-09-11T00:07:29.006 INFO:tasks.workunit.client.0.smithi111.stdout:7/806: mknod dd/d1d/d4d/d82/d100/c103 0 2024-09-11T00:07:29.014 INFO:tasks.workunit.client.1.smithi203.stdout:9/721: dwrite d6/de/d32/d52/d55/da2/fce [0,4194304] 0 2024-09-11T00:07:29.014 INFO:tasks.workunit.client.0.smithi111.stdout:9/804: rename d6/db/d1b/d56/dc8/c100 to d6/ddd/c106 0 2024-09-11T00:07:29.016 INFO:tasks.workunit.client.1.smithi203.stdout:1/840: symlink d8/d19/d60/d90/d3e/d4b/l12e 0 2024-09-11T00:07:29.017 INFO:tasks.workunit.client.1.smithi203.stdout:3/775: mknod d8/da/d5c/d80/c112 0 2024-09-11T00:07:29.018 INFO:tasks.workunit.client.1.smithi203.stdout:9/722: fdatasync d6/de/d32/d52/fe8 0 2024-09-11T00:07:29.019 INFO:tasks.workunit.client.0.smithi111.stdout:1/760: dread d2/de/d12/d3c/d4b/d6a/d63/d73/da1/fc2 [0,4194304] 0 2024-09-11T00:07:29.021 INFO:tasks.workunit.client.0.smithi111.stdout:3/797: link d1c/d1d/d22/d44/d5a/d74/d7b/f10f d1c/d1d/d22/d44/d5a/dcd/f116 0 2024-09-11T00:07:29.023 INFO:tasks.workunit.client.1.smithi203.stdout:5/782: symlink dc/d4f/d5c/d76/l104 0 2024-09-11T00:07:29.025 INFO:tasks.workunit.client.0.smithi111.stdout:3/798: read d1c/d1d/d22/d31/d62/f9c [4954502,45819] 0 2024-09-11T00:07:29.030 INFO:tasks.workunit.client.1.smithi203.stdout:2/793: write d13/d15/d19/f26 [4735370,20917] 0 2024-09-11T00:07:29.031 INFO:tasks.workunit.client.1.smithi203.stdout:6/716: dread d0/d32/f7a [0,4194304] 0 2024-09-11T00:07:29.032 INFO:tasks.workunit.client.1.smithi203.stdout:8/675: dwrite d1/f2 [8388608,4194304] 0 2024-09-11T00:07:29.032 INFO:tasks.workunit.client.0.smithi111.stdout:9/805: dwrite d6/db/d1b/fd7 [0,4194304] 0 2024-09-11T00:07:29.033 INFO:tasks.workunit.client.1.smithi203.stdout:2/794: stat d13/d47/l9d 0 2024-09-11T00:07:29.034 INFO:tasks.workunit.client.0.smithi111.stdout:5/797: dwrite d10/d1e/d23/d26/d78/f94 [0,4194304] 0 2024-09-11T00:07:29.035 INFO:tasks.workunit.client.1.smithi203.stdout:7/725: sync 2024-09-11T00:07:29.046 INFO:tasks.workunit.client.0.smithi111.stdout:8/793: write f7 [4700092,100391] 0 2024-09-11T00:07:29.051 INFO:tasks.workunit.client.1.smithi203.stdout:1/841: chown d8/d28/d64/ce0 521692 1 2024-09-11T00:07:29.053 INFO:tasks.workunit.client.1.smithi203.stdout:5/783: unlink dc/dd/d15/dbd/d59/da8/fed 0 2024-09-11T00:07:29.054 INFO:tasks.workunit.client.1.smithi203.stdout:4/635: dwrite db/d12/d15/d2a/f8f [0,4194304] 0 2024-09-11T00:07:29.062 INFO:tasks.workunit.client.1.smithi203.stdout:2/795: creat d13/d15/d30/dfa/daf/f106 x:0 0 0 2024-09-11T00:07:29.069 INFO:tasks.workunit.client.1.smithi203.stdout:6/717: dread d0/d54/d9c/d7b/d7e/d94/fb0 [0,4194304] 0 2024-09-11T00:07:29.078 INFO:tasks.workunit.client.0.smithi111.stdout:6/745: creat d7/d22/d26/f101 x:0 0 0 2024-09-11T00:07:29.080 INFO:tasks.workunit.client.1.smithi203.stdout:8/676: dread d1/d13/d17/d77/f79 [0,4194304] 0 2024-09-11T00:07:29.082 INFO:tasks.workunit.client.0.smithi111.stdout:5/798: dread d10/d1e/d23/d30/dd8/d63/f6f [0,4194304] 0 2024-09-11T00:07:29.086 INFO:tasks.workunit.client.1.smithi203.stdout:1/842: readlink d8/d19/d60/d90/d3e/l108 0 2024-09-11T00:07:29.087 INFO:tasks.workunit.client.1.smithi203.stdout:4/636: dread - db/d12/f7d zero size 2024-09-11T00:07:29.088 INFO:tasks.workunit.client.0.smithi111.stdout:2/722: link d0/d3/de/d50/f59 d0/d3/d12/d52/ff5 0 2024-09-11T00:07:29.089 INFO:tasks.workunit.client.0.smithi111.stdout:7/807: dread dd/f35 [0,4194304] 0 2024-09-11T00:07:29.089 INFO:tasks.workunit.client.0.smithi111.stdout:5/799: write d10/d1e/d23/d30/dd8/da2/fcf [805885,20520] 0 2024-09-11T00:07:29.089 INFO:tasks.workunit.client.1.smithi203.stdout:5/784: mknod dc/dd/d15/d3b/d73/c105 0 2024-09-11T00:07:29.091 INFO:tasks.workunit.client.0.smithi111.stdout:2/723: dread - d0/d3/de/d50/d9d/fe5 zero size 2024-09-11T00:07:29.093 INFO:tasks.workunit.client.1.smithi203.stdout:5/785: chown dc/d2b/dba/c101 3 1 2024-09-11T00:07:29.094 INFO:tasks.workunit.client.0.smithi111.stdout:7/808: write dd/d1d/d7e/df8/d8f/d9f/d79/f7b [3005301,123770] 0 2024-09-11T00:07:29.095 INFO:tasks.workunit.client.1.smithi203.stdout:1/843: chown d8/d19/d60/d90/d3e/d4b/d80/da2/d116 287 1 2024-09-11T00:07:29.097 INFO:tasks.workunit.client.0.smithi111.stdout:4/745: truncate d18/d20/fe6 31936 0 2024-09-11T00:07:29.099 INFO:tasks.workunit.client.1.smithi203.stdout:6/718: chown d0/d54/d9c/d35/d39/db2/cd9 51 1 2024-09-11T00:07:29.103 INFO:tasks.workunit.client.1.smithi203.stdout:7/726: creat dd/d1c/d52/d8f/d31/d4a/d6e/dcc/dea/de6/f10a x:0 0 0 2024-09-11T00:07:29.103 INFO:tasks.workunit.client.1.smithi203.stdout:0/693: sync 2024-09-11T00:07:29.103 INFO:tasks.workunit.client.0.smithi111.stdout:0/800: rename d3/c4 to d3/d13/d66/c11a 0 2024-09-11T00:07:29.105 INFO:tasks.workunit.client.0.smithi111.stdout:1/761: dwrite d2/f6f [0,4194304] 0 2024-09-11T00:07:29.106 INFO:tasks.workunit.client.1.smithi203.stdout:9/723: rename d6/lc to d6/de/lf1 0 2024-09-11T00:07:29.110 INFO:tasks.workunit.client.1.smithi203.stdout:3/776: dread d8/da/db3/f94 [0,4194304] 0 2024-09-11T00:07:29.114 INFO:tasks.workunit.client.1.smithi203.stdout:4/637: dwrite db/f6c [0,4194304] 0 2024-09-11T00:07:29.116 INFO:tasks.workunit.client.0.smithi111.stdout:9/806: dwrite d6/db/d34/d37/f7e [0,4194304] 0 2024-09-11T00:07:29.119 INFO:tasks.workunit.client.1.smithi203.stdout:2/796: creat d13/d15/d30/d5a/dd9/f107 x:0 0 0 2024-09-11T00:07:29.122 INFO:tasks.workunit.client.0.smithi111.stdout:8/794: write d11/d23/d2c/d46/d64/f88 [3501387,23711] 0 2024-09-11T00:07:29.128 INFO:tasks.workunit.client.1.smithi203.stdout:0/694: creat d0/d1d/d5d/dba/feb x:0 0 0 2024-09-11T00:07:29.129 INFO:tasks.workunit.client.1.smithi203.stdout:1/844: dread d8/d19/ff0 [0,4194304] 0 2024-09-11T00:07:29.135 INFO:tasks.workunit.client.1.smithi203.stdout:9/724: mknod d6/de/d32/d52/d55/da2/cf2 0 2024-09-11T00:07:29.137 INFO:tasks.workunit.client.1.smithi203.stdout:9/725: read d6/f76 [44062,92470] 0 2024-09-11T00:07:29.140 INFO:tasks.workunit.client.1.smithi203.stdout:3/777: mkdir d8/d17/d113 0 2024-09-11T00:07:29.146 INFO:tasks.workunit.client.1.smithi203.stdout:4/638: unlink db/dd/d16/d38/fa9 0 2024-09-11T00:07:29.151 INFO:tasks.workunit.client.1.smithi203.stdout:6/719: write d0/d54/d9c/d35/f3f [3733778,128298] 0 2024-09-11T00:07:29.155 INFO:tasks.workunit.client.1.smithi203.stdout:8/677: link d1/d13/d17/d2f/lb4 d1/d13/d17/d48/d9d/da9/le2 0 2024-09-11T00:07:29.158 INFO:tasks.workunit.client.1.smithi203.stdout:8/678: truncate d1/d13/d17/f42 4342414 0 2024-09-11T00:07:29.158 INFO:tasks.workunit.client.1.smithi203.stdout:0/695: mkdir d0/d1d/d5d/dec 0 2024-09-11T00:07:29.161 INFO:tasks.workunit.client.1.smithi203.stdout:1/845: mkdir d8/d19/d60/d90/d3e/d66/d12f 0 2024-09-11T00:07:29.163 INFO:tasks.workunit.client.1.smithi203.stdout:9/726: rmdir d6/de/d47/dc3 39 2024-09-11T00:07:29.166 INFO:tasks.workunit.client.1.smithi203.stdout:5/786: write dc/dd/d1e/fa1 [579206,30454] 0 2024-09-11T00:07:29.167 INFO:tasks.workunit.client.1.smithi203.stdout:2/797: write d13/d22/d53/f98 [44024,13358] 0 2024-09-11T00:07:29.168 INFO:tasks.workunit.client.1.smithi203.stdout:4/639: truncate db/dd/d26/f3f 2798135 0 2024-09-11T00:07:29.179 INFO:tasks.workunit.client.1.smithi203.stdout:9/727: dread - d6/de/d19/d24/f57 zero size 2024-09-11T00:07:29.182 INFO:tasks.workunit.client.1.smithi203.stdout:9/728: truncate d6/de/fe3 738242 0 2024-09-11T00:07:29.182 INFO:tasks.workunit.client.1.smithi203.stdout:7/727: rename dd/d3b/c6c to dd/c10b 0 2024-09-11T00:07:29.183 INFO:tasks.workunit.client.1.smithi203.stdout:2/798: fsync d13/d15/d19/f66 0 2024-09-11T00:07:29.184 INFO:tasks.workunit.client.1.smithi203.stdout:9/729: stat d6/de/d19/d21/c34 0 2024-09-11T00:07:29.184 INFO:tasks.workunit.client.1.smithi203.stdout:1/846: dread d8/d19/f26 [0,4194304] 0 2024-09-11T00:07:29.186 INFO:tasks.workunit.client.1.smithi203.stdout:4/640: creat db/dd/d16/fca x:0 0 0 2024-09-11T00:07:29.188 INFO:tasks.workunit.client.1.smithi203.stdout:6/720: truncate d0/d5b/d9f/fbb 13140 0 2024-09-11T00:07:29.189 INFO:tasks.workunit.client.1.smithi203.stdout:6/721: fdatasync d0/f23 0 2024-09-11T00:07:29.201 INFO:tasks.workunit.client.1.smithi203.stdout:7/728: mknod dd/d1c/d52/d8f/d31/d67/c10c 0 2024-09-11T00:07:29.204 INFO:tasks.workunit.client.1.smithi203.stdout:7/729: dread dd/d1c/f66 [0,4194304] 0 2024-09-11T00:07:29.205 INFO:tasks.workunit.client.1.smithi203.stdout:2/799: write d13/d15/d19/d1c/d76/d94/fce [111550,25141] 0 2024-09-11T00:07:29.207 INFO:tasks.workunit.client.1.smithi203.stdout:9/730: symlink d6/de/d19/d21/da0/lf3 0 2024-09-11T00:07:29.208 INFO:tasks.workunit.client.1.smithi203.stdout:2/800: chown d13/d56/d69/d99/fdd 133099157 1 2024-09-11T00:07:29.209 INFO:tasks.workunit.client.1.smithi203.stdout:4/641: dread - db/d12/fa4 zero size 2024-09-11T00:07:29.211 INFO:tasks.workunit.client.1.smithi203.stdout:4/642: readlink db/dd/d26/d42/d5e/l62 0 2024-09-11T00:07:29.212 INFO:tasks.workunit.client.1.smithi203.stdout:1/847: rmdir d8/d19/d60/d90/d3e/d107 39 2024-09-11T00:07:29.216 INFO:tasks.workunit.client.0.smithi111.stdout:6/746: creat d7/d22/d2c/d38/d56/dbf/f102 x:0 0 0 2024-09-11T00:07:29.217 INFO:tasks.workunit.client.0.smithi111.stdout:6/747: stat d7/d22/d1d/d83/fa1 0 2024-09-11T00:07:29.224 INFO:tasks.workunit.client.0.smithi111.stdout:5/800: mkdir d10/d1e/d23/d2b/d5c/d61/d103 0 2024-09-11T00:07:29.224 INFO:tasks.workunit.client.1.smithi203.stdout:6/722: dread d0/d54/d9c/d7b/d7e/d94/fb0 [0,4194304] 0 2024-09-11T00:07:29.225 INFO:tasks.workunit.client.1.smithi203.stdout:9/731: dread d6/de/d32/d52/d55/f3f [0,4194304] 0 2024-09-11T00:07:29.227 INFO:tasks.workunit.client.1.smithi203.stdout:7/730: symlink dd/d1c/d52/dff/l10d 0 2024-09-11T00:07:29.227 INFO:tasks.workunit.client.1.smithi203.stdout:1/848: dread d8/d28/fc0 [0,4194304] 0 2024-09-11T00:07:29.230 INFO:tasks.workunit.client.1.smithi203.stdout:2/801: creat d13/d15/d19/d1c/d76/f108 x:0 0 0 2024-09-11T00:07:29.230 INFO:tasks.workunit.client.1.smithi203.stdout:0/696: write d0/d2/d7e/da1/dc9/de7/f6e [1118268,46730] 0 2024-09-11T00:07:29.233 INFO:tasks.workunit.client.1.smithi203.stdout:5/787: write dc/dd/d56/ffc [1397020,41778] 0 2024-09-11T00:07:29.235 INFO:tasks.workunit.client.1.smithi203.stdout:8/679: getdents d1/d13/d43 0 2024-09-11T00:07:29.235 INFO:tasks.workunit.client.1.smithi203.stdout:5/788: dread - dc/dd/d56/dad/f97 zero size 2024-09-11T00:07:29.236 INFO:tasks.workunit.client.0.smithi111.stdout:4/746: mkdir d18/d20/d3c/d5e/daa/de7 0 2024-09-11T00:07:29.239 INFO:tasks.workunit.client.0.smithi111.stdout:4/747: truncate d18/d20/d4a/d6b/fe3 425520 0 2024-09-11T00:07:29.244 INFO:tasks.workunit.client.0.smithi111.stdout:1/762: dread - d2/de/d12/faa zero size 2024-09-11T00:07:29.246 INFO:tasks.workunit.client.0.smithi111.stdout:1/763: dread - d2/de/d12/d6c/fcd zero size 2024-09-11T00:07:29.248 INFO:tasks.workunit.client.0.smithi111.stdout:3/799: truncate d1c/d1d/d86/fd7 376096 0 2024-09-11T00:07:29.251 INFO:tasks.workunit.client.0.smithi111.stdout:6/748: dread - d7/d22/d2c/d38/d56/dbf/fc3 zero size 2024-09-11T00:07:29.253 INFO:tasks.workunit.client.0.smithi111.stdout:5/801: mkdir d10/d1e/d23/d26/d3a/d104 0 2024-09-11T00:07:29.256 INFO:tasks.workunit.client.0.smithi111.stdout:7/809: dread - dd/da6/ff1 zero size 2024-09-11T00:07:29.258 INFO:tasks.workunit.client.0.smithi111.stdout:7/810: dread - dd/d48/fd0 zero size 2024-09-11T00:07:29.260 INFO:tasks.workunit.client.0.smithi111.stdout:3/800: creat d1c/d1d/f117 x:0 0 0 2024-09-11T00:07:29.264 INFO:tasks.workunit.client.0.smithi111.stdout:5/802: mknod d10/d1e/d23/d26/d78/d7a/c105 0 2024-09-11T00:07:29.266 INFO:tasks.workunit.client.0.smithi111.stdout:4/748: mknod d18/d1f/d33/ce8 0 2024-09-11T00:07:29.267 INFO:tasks.workunit.client.0.smithi111.stdout:1/764: creat d2/de/d12/d6c/dbd/fff x:0 0 0 2024-09-11T00:07:29.268 INFO:tasks.workunit.client.0.smithi111.stdout:0/801: dwrite d3/d13/f5a [0,4194304] 0 2024-09-11T00:07:29.268 INFO:tasks.workunit.client.0.smithi111.stdout:8/795: rmdir d11/d21/d6f/df6 0 2024-09-11T00:07:29.270 INFO:tasks.workunit.client.0.smithi111.stdout:1/765: chown d2/de/d93/fea 1932655 1 2024-09-11T00:07:29.270 INFO:tasks.workunit.client.0.smithi111.stdout:0/802: readlink d3/d13/d1e/deb/l96 0 2024-09-11T00:07:29.271 INFO:tasks.workunit.client.0.smithi111.stdout:7/811: creat dd/ddf/f104 x:0 0 0 2024-09-11T00:07:29.271 INFO:tasks.workunit.client.0.smithi111.stdout:3/801: truncate fb 4804124 0 2024-09-11T00:07:29.272 INFO:tasks.workunit.client.0.smithi111.stdout:9/807: truncate d6/db/d34/d37/f28 5050930 0 2024-09-11T00:07:29.273 INFO:tasks.workunit.client.0.smithi111.stdout:6/749: write d7/d22/d2c/d38/f71 [210917,17873] 0 2024-09-11T00:07:29.275 INFO:tasks.workunit.client.0.smithi111.stdout:7/812: readlink dd/d1d/d1f/d24/dd2/leb 0 2024-09-11T00:07:29.276 INFO:tasks.workunit.client.0.smithi111.stdout:5/803: link d10/d1e/d23/d26/f34 d10/d1e/d23/d30/dd8/da2/d66/d76/f106 0 2024-09-11T00:07:29.278 INFO:tasks.workunit.client.0.smithi111.stdout:3/802: chown d1c/d1d/d22/d23/c55 55 1 2024-09-11T00:07:29.278 INFO:tasks.workunit.client.0.smithi111.stdout:9/808: readlink d6/db/d7a/d9a/lae 0 2024-09-11T00:07:29.279 INFO:tasks.workunit.client.0.smithi111.stdout:4/749: symlink d18/d20/d3c/d5e/d75/le9 0 2024-09-11T00:07:29.280 INFO:tasks.workunit.client.0.smithi111.stdout:0/803: symlink d3/d13/d1e/deb/d61/l11b 0 2024-09-11T00:07:29.280 INFO:tasks.workunit.client.0.smithi111.stdout:1/766: chown d2/de/d12/d3c/d4b/d6a/d63/fb7 200 1 2024-09-11T00:07:29.283 INFO:tasks.workunit.client.0.smithi111.stdout:9/809: stat d6/db/d7a/d9a 0 2024-09-11T00:07:29.283 INFO:tasks.workunit.client.0.smithi111.stdout:7/813: symlink dd/d1d/d4d/d82/d100/l105 0 2024-09-11T00:07:29.285 INFO:tasks.workunit.client.0.smithi111.stdout:5/804: mknod d10/d1e/d23/c107 0 2024-09-11T00:07:29.288 INFO:tasks.workunit.client.0.smithi111.stdout:4/750: rmdir d18/d20/d4a/d6b 39 2024-09-11T00:07:29.288 INFO:tasks.workunit.client.0.smithi111.stdout:7/814: rename dd/d1d to dd/d1d/d1f/d24/d106 22 2024-09-11T00:07:29.289 INFO:tasks.workunit.client.0.smithi111.stdout:1/767: unlink d2/de/d82/c90 0 2024-09-11T00:07:29.291 INFO:tasks.workunit.client.0.smithi111.stdout:0/804: write d3/d13/d1e/d29/f2d [198861,71536] 0 2024-09-11T00:07:29.293 INFO:tasks.workunit.client.0.smithi111.stdout:5/805: write d10/d1e/d23/fdc [173420,104568] 0 2024-09-11T00:07:29.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:28 smithi203 ceph-mon[33225]: pgmap v12: 65 pgs: 65 active+clean; 3.0 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 89 MiB/s rd, 245 MiB/s wr, 495 op/s 2024-09-11T00:07:29.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:28 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:29.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:28 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:29.297 INFO:tasks.workunit.client.0.smithi111.stdout:2/724: dwrite d0/d3/de/d3b/d63/f75 [0,4194304] 0 2024-09-11T00:07:29.299 INFO:tasks.workunit.client.0.smithi111.stdout:8/796: dwrite d11/fc0 [0,4194304] 0 2024-09-11T00:07:29.303 INFO:tasks.workunit.client.0.smithi111.stdout:4/751: dread d18/d20/fe6 [0,4194304] 0 2024-09-11T00:07:29.307 INFO:tasks.workunit.client.0.smithi111.stdout:7/815: symlink dd/d1d/d7e/df8/d8f/dac/l107 0 2024-09-11T00:07:29.309 INFO:tasks.workunit.client.1.smithi203.stdout:5/789: chown dc/d91/fdb 202 1 2024-09-11T00:07:29.309 INFO:tasks.workunit.client.0.smithi111.stdout:5/806: chown d10/d1e/d23/d30/d59/dd1/l100 7424 1 2024-09-11T00:07:29.310 INFO:tasks.workunit.client.1.smithi203.stdout:9/732: truncate d6/de/d32/f59 2904779 0 2024-09-11T00:07:29.311 INFO:tasks.workunit.client.0.smithi111.stdout:9/810: dread d6/d52/fd5 [0,4194304] 0 2024-09-11T00:07:29.311 INFO:tasks.workunit.client.0.smithi111.stdout:0/805: truncate d3/d1c/fd5 374052 0 2024-09-11T00:07:29.312 INFO:tasks.workunit.client.1.smithi203.stdout:2/802: rmdir d13/d15/d30/d5a/dcf 39 2024-09-11T00:07:29.313 INFO:tasks.workunit.client.1.smithi203.stdout:0/697: rmdir d0/d2/d92 39 2024-09-11T00:07:29.313 INFO:tasks.workunit.client.1.smithi203.stdout:4/643: mkdir db/d12/d15/d2a/dcb 0 2024-09-11T00:07:29.313 INFO:tasks.workunit.client.0.smithi111.stdout:8/797: symlink d11/d23/d2c/lf9 0 2024-09-11T00:07:29.313 INFO:tasks.workunit.client.0.smithi111.stdout:0/806: chown d3/dc 592 1 2024-09-11T00:07:29.313 INFO:tasks.workunit.client.0.smithi111.stdout:7/816: rename dd/d1d/d7e to dd/d1d/d7e/df8/d8f/d9f/d108 22 2024-09-11T00:07:29.315 INFO:tasks.workunit.client.1.smithi203.stdout:2/803: chown d13/d15/d19/d1c/d76/f8e 470792 1 2024-09-11T00:07:29.320 INFO:tasks.workunit.client.1.smithi203.stdout:5/790: fsync dc/dd/d56/dad/f60 0 2024-09-11T00:07:29.321 INFO:tasks.workunit.client.1.smithi203.stdout:0/698: creat d0/d2/d7e/da1/dc9/de7/d77/fed x:0 0 0 2024-09-11T00:07:29.323 INFO:tasks.workunit.client.1.smithi203.stdout:2/804: truncate d13/d15/d19/d1c/d76/d94/d97/f101 934250 0 2024-09-11T00:07:29.323 INFO:tasks.workunit.client.1.smithi203.stdout:9/733: fsync d6/de/d32/d52/d55/f2b 0 2024-09-11T00:07:29.325 INFO:tasks.workunit.client.1.smithi203.stdout:7/731: rmdir dd/d1c/d52/d8f/d31/d4a/d6e/df7 0 2024-09-11T00:07:29.329 INFO:tasks.workunit.client.1.smithi203.stdout:4/644: truncate db/d12/d15/d2a/d88/fbf 393074 0 2024-09-11T00:07:29.329 INFO:tasks.workunit.client.1.smithi203.stdout:0/699: rmdir d0/d1d/d4c 39 2024-09-11T00:07:29.330 INFO:tasks.workunit.client.1.smithi203.stdout:7/732: mkdir dd/d3b/d9f/d10e 0 2024-09-11T00:07:29.333 INFO:tasks.workunit.client.1.smithi203.stdout:2/805: mknod d13/d22/c109 0 2024-09-11T00:07:29.333 INFO:tasks.workunit.client.1.smithi203.stdout:5/791: fsync dc/dd/d15/dbd/dce/fdc 0 2024-09-11T00:07:29.335 INFO:tasks.workunit.client.1.smithi203.stdout:9/734: symlink d6/de/lf4 0 2024-09-11T00:07:29.338 INFO:tasks.workunit.client.1.smithi203.stdout:0/700: creat d0/d2/d7e/da1/dc9/fee x:0 0 0 2024-09-11T00:07:29.341 INFO:tasks.workunit.client.1.smithi203.stdout:2/806: readlink d13/d15/d19/d1c/l50 0 2024-09-11T00:07:29.342 INFO:tasks.workunit.client.1.smithi203.stdout:5/792: chown dc/dd/d1e/dc6/d103 84 1 2024-09-11T00:07:29.343 INFO:tasks.workunit.client.1.smithi203.stdout:9/735: chown d6/de/d32/ca4 271561 1 2024-09-11T00:07:29.343 INFO:tasks.workunit.client.1.smithi203.stdout:0/701: write d0/f18 [3444715,92505] 0 2024-09-11T00:07:29.348 INFO:tasks.workunit.client.1.smithi203.stdout:4/645: dread db/f7e [0,4194304] 0 2024-09-11T00:07:29.348 INFO:tasks.workunit.client.1.smithi203.stdout:8/680: dwrite d1/d13/d3a/d75/fdd [0,4194304] 0 2024-09-11T00:07:29.352 INFO:tasks.workunit.client.0.smithi111.stdout:3/803: dwrite d1c/d1d/d22/d23/d2f/d63/d7e/f101 [0,4194304] 0 2024-09-11T00:07:29.356 INFO:tasks.workunit.client.0.smithi111.stdout:9/811: symlink d6/db/d7a/d9a/l107 0 2024-09-11T00:07:29.357 INFO:tasks.workunit.client.1.smithi203.stdout:9/736: fdatasync d6/de/d19/d24/f57 0 2024-09-11T00:07:29.357 INFO:tasks.workunit.client.1.smithi203.stdout:5/793: chown dc/dd/d15/dbd/d59/f46 54 1 2024-09-11T00:07:29.360 INFO:tasks.workunit.client.0.smithi111.stdout:6/750: dread d7/d22/d26/f8a [0,4194304] 0 2024-09-11T00:07:29.360 INFO:tasks.workunit.client.0.smithi111.stdout:5/807: mkdir d10/d108 0 2024-09-11T00:07:29.360 INFO:tasks.workunit.client.0.smithi111.stdout:5/808: chown d10/d108 215548 1 2024-09-11T00:07:29.369 INFO:tasks.workunit.client.0.smithi111.stdout:4/752: dwrite d18/d20/f34 [0,4194304] 0 2024-09-11T00:07:29.372 INFO:tasks.workunit.client.1.smithi203.stdout:4/646: fdatasync db/d12/f93 0 2024-09-11T00:07:29.374 INFO:tasks.workunit.client.1.smithi203.stdout:9/737: creat d6/de/dc4/ff5 x:0 0 0 2024-09-11T00:07:29.377 INFO:tasks.workunit.client.0.smithi111.stdout:3/804: read d1c/d1d/d86/fd7 [271773,105604] 0 2024-09-11T00:07:29.377 INFO:tasks.workunit.client.1.smithi203.stdout:7/733: dwrite dd/d1c/d7c/d8c/ffb [0,4194304] 0 2024-09-11T00:07:29.378 INFO:tasks.workunit.client.1.smithi203.stdout:3/778: sync 2024-09-11T00:07:29.378 INFO:tasks.workunit.client.0.smithi111.stdout:1/768: getdents d2/de/d12/d3c/d4b/dc3 0 2024-09-11T00:07:29.380 INFO:tasks.workunit.client.0.smithi111.stdout:7/817: write dd/d1d/d7e/f9e [3223657,27804] 0 2024-09-11T00:07:29.380 INFO:tasks.workunit.client.1.smithi203.stdout:4/647: write db/d12/fc8 [928876,37425] 0 2024-09-11T00:07:29.381 INFO:tasks.workunit.client.0.smithi111.stdout:3/805: write d1c/d1d/d22/d23/d2f/de8/f53 [1718163,74382] 0 2024-09-11T00:07:29.382 INFO:tasks.workunit.client.0.smithi111.stdout:6/751: mkdir d7/d22/d2c/d103 0 2024-09-11T00:07:29.386 INFO:tasks.workunit.client.0.smithi111.stdout:3/806: read d1c/d1d/d22/d44/f7c [2427737,76057] 0 2024-09-11T00:07:29.386 INFO:tasks.workunit.client.0.smithi111.stdout:5/809: mkdir d10/d1e/d23/d30/d59/d52/dd6/dee/d109 0 2024-09-11T00:07:29.387 INFO:tasks.workunit.client.1.smithi203.stdout:9/738: write d6/de/d32/d9e/fc8 [1460713,16449] 0 2024-09-11T00:07:29.391 INFO:tasks.workunit.client.0.smithi111.stdout:1/769: creat d2/de/d12/d6c/f100 x:0 0 0 2024-09-11T00:07:29.393 INFO:tasks.workunit.client.1.smithi203.stdout:0/702: dwrite d0/d2/d92/fd9 [0,4194304] 0 2024-09-11T00:07:29.394 INFO:tasks.workunit.client.0.smithi111.stdout:9/812: link d6/dc/dc1/fdf d6/dc/f108 0 2024-09-11T00:07:29.398 INFO:tasks.workunit.client.1.smithi203.stdout:7/734: creat dd/d1c/d52/d8f/d31/d67/dc8/f10f x:0 0 0 2024-09-11T00:07:29.399 INFO:tasks.workunit.client.0.smithi111.stdout:4/753: creat d18/d20/d3c/d5e/daa/dbb/ddc/fea x:0 0 0 2024-09-11T00:07:29.400 INFO:tasks.workunit.client.0.smithi111.stdout:7/818: creat dd/d1d/d7e/f109 x:0 0 0 2024-09-11T00:07:29.400 INFO:tasks.workunit.client.0.smithi111.stdout:8/798: dwrite d11/d23/d2c/d53/f83 [0,4194304] 0 2024-09-11T00:07:29.402 INFO:tasks.workunit.client.1.smithi203.stdout:5/794: link dc/dd/d1e/d7b/l88 dc/dd/d15/dbd/d59/l106 0 2024-09-11T00:07:29.403 INFO:tasks.workunit.client.0.smithi111.stdout:9/813: fdatasync d6/db/d34/d37/f3f 0 2024-09-11T00:07:29.410 INFO:tasks.workunit.client.0.smithi111.stdout:3/807: rename d1c/d1d/d22/d23/d2f/de8/f59 to d1c/d1d/d22/d44/d5a/dcd/dd2/def/df5/f118 0 2024-09-11T00:07:29.412 INFO:tasks.workunit.client.0.smithi111.stdout:3/808: dread - d1c/d21/f6c zero size 2024-09-11T00:07:29.415 INFO:tasks.workunit.client.0.smithi111.stdout:6/752: mknod d7/d22/d3f/d74/d7f/d79/c104 0 2024-09-11T00:07:29.416 INFO:tasks.workunit.client.0.smithi111.stdout:7/819: fsync dd/d1d/d1f/f65 0 2024-09-11T00:07:29.418 INFO:tasks.workunit.client.0.smithi111.stdout:0/807: dread d3/d13/d1e/d29/d49/f92 [0,4194304] 0 2024-09-11T00:07:29.418 INFO:tasks.workunit.client.0.smithi111.stdout:6/753: read d7/d22/d1d/f5f [152853,88288] 0 2024-09-11T00:07:29.421 INFO:tasks.workunit.client.1.smithi203.stdout:9/739: truncate d6/de/f74 27342 0 2024-09-11T00:07:29.426 INFO:tasks.workunit.client.0.smithi111.stdout:1/770: rename d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/f8b to d2/de/d12/d3c/d4b/d6a/d63/d95/f101 0 2024-09-11T00:07:29.432 INFO:tasks.workunit.client.1.smithi203.stdout:3/779: dread d8/d17/f74 [0,4194304] 0 2024-09-11T00:07:29.434 INFO:tasks.workunit.client.1.smithi203.stdout:8/681: dread d1/f2 [0,4194304] 0 2024-09-11T00:07:29.435 INFO:tasks.workunit.client.1.smithi203.stdout:3/780: truncate d8/da/d11/fb6 5177542 0 2024-09-11T00:07:29.436 INFO:tasks.workunit.client.0.smithi111.stdout:7/820: fsync dd/f1c 0 2024-09-11T00:07:29.438 INFO:tasks.workunit.client.0.smithi111.stdout:7/821: write dd/ddf/f104 [18876,9620] 0 2024-09-11T00:07:29.438 INFO:tasks.workunit.client.1.smithi203.stdout:2/807: dread d13/d15/f65 [0,4194304] 0 2024-09-11T00:07:29.444 INFO:tasks.workunit.client.0.smithi111.stdout:4/754: mknod d18/d3b/d9f/db7/de5/ceb 0 2024-09-11T00:07:29.447 INFO:tasks.workunit.client.0.smithi111.stdout:0/808: mkdir d3/da/d7b/db3/d11c 0 2024-09-11T00:07:29.448 INFO:tasks.workunit.client.1.smithi203.stdout:4/648: dwrite db/dd/d26/f3f [0,4194304] 0 2024-09-11T00:07:29.449 INFO:tasks.workunit.client.0.smithi111.stdout:9/814: write d6/db/d1b/d74/f98 [848661,106578] 0 2024-09-11T00:07:29.455 INFO:tasks.workunit.client.0.smithi111.stdout:3/809: mknod d1c/d1d/d86/dbc/c119 0 2024-09-11T00:07:29.460 INFO:tasks.workunit.client.0.smithi111.stdout:5/810: getdents d10/d1e/d23/d26/d3a/d98 0 2024-09-11T00:07:29.464 INFO:tasks.workunit.client.0.smithi111.stdout:2/725: sync 2024-09-11T00:07:29.466 INFO:tasks.workunit.client.0.smithi111.stdout:8/799: mkdir d11/d23/d3d/dfa 0 2024-09-11T00:07:29.467 INFO:tasks.workunit.client.1.smithi203.stdout:0/703: dread d0/d2/d37/f53 [0,4194304] 0 2024-09-11T00:07:29.467 INFO:tasks.workunit.client.0.smithi111.stdout:7/822: mknod dd/d1d/d76/db6/c10a 0 2024-09-11T00:07:29.470 INFO:tasks.workunit.client.0.smithi111.stdout:4/755: symlink d18/d20/d3c/d5e/daa/dbb/lec 0 2024-09-11T00:07:29.471 INFO:tasks.workunit.client.0.smithi111.stdout:0/809: creat d3/daf/db2/f11d x:0 0 0 2024-09-11T00:07:29.473 INFO:tasks.workunit.client.0.smithi111.stdout:0/810: fsync d3/da/d7b/d84/fef 0 2024-09-11T00:07:29.473 INFO:tasks.workunit.client.0.smithi111.stdout:3/810: creat d1c/d1d/d22/d23/d2f/f11a x:0 0 0 2024-09-11T00:07:29.475 INFO:tasks.workunit.client.0.smithi111.stdout:1/771: link d2/de/d93/d9f/dc0/fe6 d2/de/d12/d3c/d4b/dc3/f102 0 2024-09-11T00:07:29.476 INFO:tasks.workunit.client.0.smithi111.stdout:5/811: mknod d10/d1e/d23/d26/d78/d7a/c10a 0 2024-09-11T00:07:29.480 INFO:tasks.workunit.client.0.smithi111.stdout:6/754: creat d7/f105 x:0 0 0 2024-09-11T00:07:29.481 INFO:tasks.workunit.client.0.smithi111.stdout:6/755: chown d7/d22/d26/c59 995518 1 2024-09-11T00:07:29.482 INFO:tasks.workunit.client.0.smithi111.stdout:6/756: chown d7/d22/d3f/d74/d7f/d79 9 1 2024-09-11T00:07:29.483 INFO:tasks.workunit.client.0.smithi111.stdout:4/756: dread - d18/d1f/f93 zero size 2024-09-11T00:07:29.487 INFO:tasks.workunit.client.0.smithi111.stdout:3/811: chown d1c/c35 79086965 1 2024-09-11T00:07:29.489 INFO:tasks.workunit.client.0.smithi111.stdout:3/812: stat d1c/d1d/d22/d44/d5a/d74/d7b 0 2024-09-11T00:07:29.489 INFO:tasks.workunit.client.0.smithi111.stdout:0/811: truncate d3/dc/f1f 1156241 0 2024-09-11T00:07:29.491 INFO:tasks.workunit.client.0.smithi111.stdout:0/812: dread - d3/d13/d1e/d29/f105 zero size 2024-09-11T00:07:29.492 INFO:tasks.workunit.client.0.smithi111.stdout:0/813: chown d3/d1c/c9b 291357 1 2024-09-11T00:07:29.493 INFO:tasks.workunit.client.0.smithi111.stdout:7/823: dwrite dd/d48/d69/fbb [0,4194304] 0 2024-09-11T00:07:29.493 INFO:tasks.workunit.client.1.smithi203.stdout:6/723: sync 2024-09-11T00:07:29.494 INFO:tasks.workunit.client.0.smithi111.stdout:2/726: symlink d0/d3/d12/d52/lf6 0 2024-09-11T00:07:29.500 INFO:tasks.workunit.client.0.smithi111.stdout:1/772: truncate d2/de/d12/d3c/d4b/d6a/f65 11559 0 2024-09-11T00:07:29.510 INFO:tasks.workunit.client.0.smithi111.stdout:3/813: creat d1c/d21/db4/f11b x:0 0 0 2024-09-11T00:07:29.512 INFO:tasks.workunit.client.0.smithi111.stdout:5/812: getdents d10/d108 0 2024-09-11T00:07:29.514 INFO:tasks.workunit.client.0.smithi111.stdout:5/813: write d10/d1e/d23/d30/dd8/da2/ffe [515597,14626] 0 2024-09-11T00:07:29.518 INFO:tasks.workunit.client.0.smithi111.stdout:7/824: chown dd/d49/f4c 1 1 2024-09-11T00:07:29.519 INFO:tasks.workunit.client.0.smithi111.stdout:2/727: chown d0/d3/de/d3b/c80 1173886 1 2024-09-11T00:07:29.522 INFO:tasks.workunit.client.1.smithi203.stdout:8/682: rename d1/d13/d17/d2f/d52/d49/c4b to d1/d13/d3a/d4c/da6/ce3 0 2024-09-11T00:07:29.524 INFO:tasks.workunit.client.1.smithi203.stdout:8/683: chown d1/d13/d17/d8b 4365833 1 2024-09-11T00:07:29.524 INFO:tasks.workunit.client.1.smithi203.stdout:4/649: symlink db/dd/d16/d38/lcc 0 2024-09-11T00:07:29.526 INFO:tasks.workunit.client.0.smithi111.stdout:6/757: mkdir d7/d106 0 2024-09-11T00:07:29.528 INFO:tasks.workunit.client.0.smithi111.stdout:6/758: read d7/d22/d2c/f62 [19664,22853] 0 2024-09-11T00:07:29.528 INFO:tasks.workunit.client.0.smithi111.stdout:9/815: getdents d6/db/db8/dce 0 2024-09-11T00:07:29.532 INFO:tasks.workunit.client.0.smithi111.stdout:4/757: mkdir d18/d20/d4a/d6b/ded 0 2024-09-11T00:07:29.533 INFO:tasks.workunit.client.0.smithi111.stdout:4/758: fsync d18/d20/d4a/f64 0 2024-09-11T00:07:29.536 INFO:tasks.workunit.client.0.smithi111.stdout:3/814: symlink d1c/d1d/d22/d44/d5a/dcd/dd2/def/df5/l11c 0 2024-09-11T00:07:29.537 INFO:tasks.workunit.client.1.smithi203.stdout:7/735: link dd/d1c/d52/d8f/d31/d67/lb8 dd/d1c/d52/d8f/d31/d58/d93/d98/l110 0 2024-09-11T00:07:29.538 INFO:tasks.workunit.client.1.smithi203.stdout:7/736: chown dd/d1c/d52/d8f/d31/d58/f64 1963729 1 2024-09-11T00:07:29.541 INFO:tasks.workunit.client.0.smithi111.stdout:7/825: creat dd/d1d/d1f/d24/f10b x:0 0 0 2024-09-11T00:07:29.542 INFO:tasks.workunit.client.1.smithi203.stdout:2/808: symlink d13/d15/d19/d1c/dfd/l10a 0 2024-09-11T00:07:29.546 INFO:tasks.workunit.client.0.smithi111.stdout:2/728: mknod d0/d3/de/d3b/d62/d6d/da1/cf7 0 2024-09-11T00:07:29.551 INFO:tasks.workunit.client.1.smithi203.stdout:5/795: dwrite dc/dd/f89 [0,4194304] 0 2024-09-11T00:07:29.552 INFO:tasks.workunit.client.0.smithi111.stdout:1/773: truncate d2/de/d12/d3c/d4b/d6a/d3a/fd8 56337 0 2024-09-11T00:07:29.558 INFO:tasks.workunit.client.1.smithi203.stdout:4/650: rename db/dd/d16/d38/db6 to db/dd/d26/dcd 0 2024-09-11T00:07:29.564 INFO:tasks.workunit.client.0.smithi111.stdout:6/759: mknod d7/d22/d26/d87/d7a/dc5/c107 0 2024-09-11T00:07:29.567 INFO:tasks.workunit.client.0.smithi111.stdout:4/759: symlink d18/d20/d3c/d5e/daa/dbb/lee 0 2024-09-11T00:07:29.570 INFO:tasks.workunit.client.1.smithi203.stdout:7/737: read dd/d3b/d5b/f83 [292054,97249] 0 2024-09-11T00:07:29.571 INFO:tasks.workunit.client.1.smithi203.stdout:0/704: dwrite d0/d2/d7e/da1/fcf [0,4194304] 0 2024-09-11T00:07:29.572 INFO:tasks.workunit.client.0.smithi111.stdout:0/814: creat d3/d13/f11e x:0 0 0 2024-09-11T00:07:29.574 INFO:tasks.workunit.client.1.smithi203.stdout:7/738: chown dd/d1c/d52/d8f/f4f 30632729 1 2024-09-11T00:07:29.584 INFO:tasks.workunit.client.0.smithi111.stdout:7/826: unlink dd/fa7 0 2024-09-11T00:07:29.588 INFO:tasks.workunit.client.0.smithi111.stdout:2/729: creat d0/d3/de/d50/d9d/ff8 x:0 0 0 2024-09-11T00:07:29.589 INFO:tasks.workunit.client.0.smithi111.stdout:1/774: truncate d2/de/d12/d3c/d4b/d6a/f3d 4998807 0 2024-09-11T00:07:29.589 INFO:tasks.workunit.client.1.smithi203.stdout:8/684: dwrite d1/d13/d17/d2f/fb7 [0,4194304] 0 2024-09-11T00:07:29.590 INFO:tasks.workunit.client.0.smithi111.stdout:2/730: chown d0/d3/de/d50 23420936 1 2024-09-11T00:07:29.590 INFO:tasks.workunit.client.0.smithi111.stdout:9/816: dwrite d6/d52/fb1 [0,4194304] 0 2024-09-11T00:07:29.593 INFO:tasks.workunit.client.0.smithi111.stdout:3/815: write d1c/d1d/d22/d31/d62/f9c [2134282,320] 0 2024-09-11T00:07:29.594 INFO:tasks.workunit.client.1.smithi203.stdout:1/849: sync 2024-09-11T00:07:29.594 INFO:tasks.workunit.client.1.smithi203.stdout:8/685: readlink d1/d13/d3a/d4c/l4d 0 2024-09-11T00:07:29.596 INFO:tasks.workunit.client.1.smithi203.stdout:9/740: dread d6/de/f74 [0,4194304] 0 2024-09-11T00:07:29.597 INFO:tasks.workunit.client.1.smithi203.stdout:3/781: getdents d8/d2a 0 2024-09-11T00:07:29.599 INFO:tasks.workunit.client.0.smithi111.stdout:6/760: symlink d7/d22/d2c/d38/d56/dbf/l108 0 2024-09-11T00:07:29.605 INFO:tasks.workunit.client.0.smithi111.stdout:6/761: chown d7/d22/d26/d87/d7a/dc5/ceb 462 1 2024-09-11T00:07:29.607 INFO:tasks.workunit.client.1.smithi203.stdout:0/705: rename d0/d2/d3d/l50 to d0/d1d/d5d/dec/lef 0 2024-09-11T00:07:29.607 INFO:tasks.workunit.client.1.smithi203.stdout:5/796: symlink dc/dd/d15/dbd/d59/dbb/l107 0 2024-09-11T00:07:29.608 INFO:tasks.workunit.client.0.smithi111.stdout:5/814: dwrite d10/d1e/d25/f75 [0,4194304] 0 2024-09-11T00:07:29.609 INFO:tasks.workunit.client.0.smithi111.stdout:2/731: dwrite d0/d3/de/db4/ff3 [0,4194304] 0 2024-09-11T00:07:29.611 INFO:tasks.workunit.client.1.smithi203.stdout:6/724: getdents d0/d5b/d5c/d6f 0 2024-09-11T00:07:29.612 INFO:tasks.workunit.client.0.smithi111.stdout:5/815: stat d10/d1e/d23/d2b/d5c/f8e 0 2024-09-11T00:07:29.617 INFO:tasks.workunit.client.1.smithi203.stdout:5/797: write dc/dd/d15/dbd/d59/fd7 [1024315,84775] 0 2024-09-11T00:07:29.617 INFO:tasks.workunit.client.1.smithi203.stdout:2/809: creat d13/d15/d30/d5a/f10b x:0 0 0 2024-09-11T00:07:29.618 INFO:tasks.workunit.client.0.smithi111.stdout:0/815: symlink d3/da/d7b/db3/l11f 0 2024-09-11T00:07:29.619 INFO:tasks.workunit.client.0.smithi111.stdout:8/800: creat d11/d23/d3d/dca/dcf/ffb x:0 0 0 2024-09-11T00:07:29.621 INFO:tasks.workunit.client.1.smithi203.stdout:3/782: mknod d8/da/d5c/d6b/d6c/c114 0 2024-09-11T00:07:29.623 INFO:tasks.workunit.client.0.smithi111.stdout:6/762: mkdir d7/d22/d1d/d109 0 2024-09-11T00:07:29.625 INFO:tasks.workunit.client.0.smithi111.stdout:2/732: fdatasync d0/d3/de/d3b/d97/f8b 0 2024-09-11T00:07:29.626 INFO:tasks.workunit.client.1.smithi203.stdout:1/850: truncate d8/d19/d60/d90/d3e/d4b/d80/d91/dac/fc8 3490194 0 2024-09-11T00:07:29.630 INFO:tasks.workunit.client.1.smithi203.stdout:0/706: creat d0/d1d/d5d/d70/ff0 x:0 0 0 2024-09-11T00:07:29.630 INFO:tasks.workunit.client.1.smithi203.stdout:4/651: dwrite db/d12/f9a [4194304,4194304] 0 2024-09-11T00:07:29.631 INFO:tasks.workunit.client.0.smithi111.stdout:5/816: mkdir d10/d1e/d23/d30/d59/d7b/d10b 0 2024-09-11T00:07:29.639 INFO:tasks.workunit.client.1.smithi203.stdout:2/810: symlink d13/d56/d69/dcb/l10c 0 2024-09-11T00:07:29.640 INFO:tasks.workunit.client.0.smithi111.stdout:2/733: dread d0/d3/de/d3b/f49 [0,4194304] 0 2024-09-11T00:07:29.649 INFO:tasks.workunit.client.0.smithi111.stdout:6/763: dwrite d7/d22/d26/d87/d7a/dc5/fc6 [0,4194304] 0 2024-09-11T00:07:29.649 INFO:tasks.workunit.client.1.smithi203.stdout:5/798: dread dc/dd/d1e/d7b/fb7 [0,4194304] 0 2024-09-11T00:07:29.655 INFO:tasks.workunit.client.0.smithi111.stdout:4/760: dread d18/d3b/d51/f63 [0,4194304] 0 2024-09-11T00:07:29.657 INFO:tasks.workunit.client.0.smithi111.stdout:1/775: link d2/de/d12/d3c/d4b/d6a/d63/d73/da1/f42 d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/d7b/f103 0 2024-09-11T00:07:29.657 INFO:tasks.workunit.client.0.smithi111.stdout:4/761: fdatasync d18/d20/d40/d78/fd3 0 2024-09-11T00:07:29.659 INFO:tasks.workunit.client.0.smithi111.stdout:1/776: dread - d2/de/d82/fdd zero size 2024-09-11T00:07:29.662 INFO:tasks.workunit.client.0.smithi111.stdout:9/817: dread d6/db/d1b/d56/f6b [0,4194304] 0 2024-09-11T00:07:29.663 INFO:tasks.workunit.client.0.smithi111.stdout:9/818: chown d6/fa5 0 1 2024-09-11T00:07:29.664 INFO:tasks.workunit.client.1.smithi203.stdout:2/811: dwrite d13/d15/d19/d1c/d76/f8e [0,4194304] 0 2024-09-11T00:07:29.669 INFO:tasks.workunit.client.0.smithi111.stdout:3/816: rename d1c/d1d/d22/d23/d2f/d63/d7e/f101 to d1c/d1d/d22/d23/d58/f11d 0 2024-09-11T00:07:29.675 INFO:tasks.workunit.client.1.smithi203.stdout:9/741: dread d6/de/d32/d52/d55/d66/fb1 [0,4194304] 0 2024-09-11T00:07:29.678 INFO:tasks.workunit.client.0.smithi111.stdout:2/734: write d0/d3/de/d3b/d97/f8b [2191473,22163] 0 2024-09-11T00:07:29.678 INFO:tasks.workunit.client.1.smithi203.stdout:8/686: dread d1/f3b [0,4194304] 0 2024-09-11T00:07:29.686 INFO:tasks.workunit.client.1.smithi203.stdout:7/739: rename dd/d1c/d52/d8f/d31/d4a/d6e/dcc/dea/dd5 to dd/d1c/d52/d8f/d111 0 2024-09-11T00:07:29.691 INFO:tasks.workunit.client.1.smithi203.stdout:0/707: dread d0/d2/d7e/da1/dc9/de7/fca [0,4194304] 0 2024-09-11T00:07:29.691 INFO:tasks.workunit.client.1.smithi203.stdout:1/851: mknod d8/d19/d60/d90/d3e/c130 0 2024-09-11T00:07:29.693 INFO:tasks.workunit.client.0.smithi111.stdout:6/764: rmdir d7/d22/d26/d95/dd6 39 2024-09-11T00:07:29.698 INFO:tasks.workunit.client.1.smithi203.stdout:4/652: symlink db/d12/d15/d2a/lce 0 2024-09-11T00:07:29.703 INFO:tasks.workunit.client.1.smithi203.stdout:6/725: dwrite d0/d54/d9c/d35/d39/d3c/f79 [0,4194304] 0 2024-09-11T00:07:29.710 INFO:tasks.workunit.client.0.smithi111.stdout:1/777: rmdir d2/de/d12/d3c/d4b/d6a/d63/d73/da1 39 2024-09-11T00:07:29.711 INFO:tasks.workunit.client.0.smithi111.stdout:1/778: chown d2/d2b 89797 1 2024-09-11T00:07:29.714 INFO:tasks.workunit.client.1.smithi203.stdout:9/742: mkdir d6/de/d19/d21/d87/df6 0 2024-09-11T00:07:29.722 INFO:tasks.workunit.client.0.smithi111.stdout:8/801: rename d11/d23/d3d/d8d/db9 to d11/d23/d2c/d53/dfc 0 2024-09-11T00:07:29.723 INFO:tasks.workunit.client.1.smithi203.stdout:7/740: readlink dd/d1c/d52/d8f/d31/d58/d93/d98/l110 0 2024-09-11T00:07:29.724 INFO:tasks.workunit.client.0.smithi111.stdout:7/827: sync 2024-09-11T00:07:29.725 INFO:tasks.workunit.client.1.smithi203.stdout:7/741: chown dd/d4d/d7f 145958242 1 2024-09-11T00:07:29.725 INFO:tasks.workunit.client.0.smithi111.stdout:3/817: creat d1c/d1d/d22/d23/d2f/d63/d7e/f11e x:0 0 0 2024-09-11T00:07:29.727 INFO:tasks.workunit.client.0.smithi111.stdout:7/828: write dd/d1d/d1f/f5e [4283428,129650] 0 2024-09-11T00:07:29.729 INFO:tasks.workunit.client.1.smithi203.stdout:1/852: creat d8/d119/f131 x:0 0 0 2024-09-11T00:07:29.729 INFO:tasks.workunit.client.1.smithi203.stdout:4/653: rmdir db/dd 39 2024-09-11T00:07:29.730 INFO:tasks.workunit.client.0.smithi111.stdout:0/816: creat d3/d13/d1e/d29/d49/f120 x:0 0 0 2024-09-11T00:07:29.731 INFO:tasks.workunit.client.0.smithi111.stdout:0/817: chown d3/d13/d1e/d29/db0/dce 179384 1 2024-09-11T00:07:29.734 INFO:tasks.workunit.client.0.smithi111.stdout:0/818: readlink d3/d13/d1e/d29/db0/dce/l116 0 2024-09-11T00:07:29.735 INFO:tasks.workunit.client.0.smithi111.stdout:4/762: mkdir d18/d20/d40/def 0 2024-09-11T00:07:29.735 INFO:tasks.workunit.client.0.smithi111.stdout:0/819: write d3/d13/f11e [822892,12934] 0 2024-09-11T00:07:29.743 INFO:tasks.workunit.client.1.smithi203.stdout:5/799: rename dc/dd/d15/d3b/f72 to dc/d91/f108 0 2024-09-11T00:07:29.745 INFO:tasks.workunit.client.1.smithi203.stdout:9/743: dread d6/de/d19/d24/d54/db2/de2/f9b [0,4194304] 0 2024-09-11T00:07:29.747 INFO:tasks.workunit.client.0.smithi111.stdout:3/818: creat d1c/d1d/d22/d31/d62/f11f x:0 0 0 2024-09-11T00:07:29.748 INFO:tasks.workunit.client.1.smithi203.stdout:4/654: chown db/dd/d16/d38/d3c/d41 1151577 1 2024-09-11T00:07:29.748 INFO:tasks.workunit.client.1.smithi203.stdout:7/742: truncate dd/d1c/d52/d8f/d31/d58/d93/d98/fd4 784777 0 2024-09-11T00:07:29.752 INFO:tasks.workunit.client.1.smithi203.stdout:6/726: dwrite d0/d54/d9c/d35/f99 [0,4194304] 0 2024-09-11T00:07:29.753 INFO:tasks.workunit.client.0.smithi111.stdout:9/819: dwrite d6/f38 [0,4194304] 0 2024-09-11T00:07:29.756 INFO:tasks.workunit.client.1.smithi203.stdout:3/783: getdents d8/da/d37/d53/dea 0 2024-09-11T00:07:29.758 INFO:tasks.workunit.client.0.smithi111.stdout:9/820: truncate d6/db/d1b/d56/fa7 736501 0 2024-09-11T00:07:29.759 INFO:tasks.workunit.client.1.smithi203.stdout:5/800: fdatasync dc/fd4 0 2024-09-11T00:07:29.761 INFO:tasks.workunit.client.0.smithi111.stdout:2/735: creat d0/d3/de/d3b/d62/ff9 x:0 0 0 2024-09-11T00:07:29.762 INFO:tasks.workunit.client.1.smithi203.stdout:1/853: mkdir d8/d19/d60/d90/d3e/d66/d12f/d132 0 2024-09-11T00:07:29.762 INFO:tasks.workunit.client.1.smithi203.stdout:9/744: readlink d6/de/d19/d24/d6c/da8/lac 0 2024-09-11T00:07:29.764 INFO:tasks.workunit.client.1.smithi203.stdout:2/812: getdents d13/d15/d30/d5a 0 2024-09-11T00:07:29.776 INFO:tasks.workunit.client.1.smithi203.stdout:3/784: mkdir d8/da/d37/d83/d65/d115 0 2024-09-11T00:07:29.778 INFO:tasks.workunit.client.1.smithi203.stdout:3/785: stat d8/d17/f78 0 2024-09-11T00:07:29.781 INFO:tasks.workunit.client.0.smithi111.stdout:0/820: dwrite d3/dc/f43 [0,4194304] 0 2024-09-11T00:07:29.784 INFO:tasks.workunit.client.0.smithi111.stdout:8/802: link d11/d23/d7e/ldd d11/d23/d2c/d46/d81/da5/lfd 0 2024-09-11T00:07:29.788 INFO:tasks.workunit.client.1.smithi203.stdout:5/801: mknod dc/dd/d56/dad/da5/c109 0 2024-09-11T00:07:29.795 INFO:tasks.workunit.client.0.smithi111.stdout:5/817: sync 2024-09-11T00:07:29.802 INFO:tasks.workunit.client.1.smithi203.stdout:9/745: unlink d6/de/d19/d24/d54/fc6 0 2024-09-11T00:07:29.803 INFO:tasks.workunit.client.0.smithi111.stdout:2/736: creat d0/d3/de/d50/d9d/ffa x:0 0 0 2024-09-11T00:07:29.803 INFO:tasks.workunit.client.1.smithi203.stdout:4/655: dwrite db/dd/d16/f6e [0,4194304] 0 2024-09-11T00:07:29.808 INFO:tasks.workunit.client.1.smithi203.stdout:7/743: dwrite dd/d1c/d52/d8f/d31/d67/f79 [0,4194304] 0 2024-09-11T00:07:29.809 INFO:tasks.workunit.client.1.smithi203.stdout:2/813: dread d13/d15/d19/f28 [0,4194304] 0 2024-09-11T00:07:29.809 INFO:tasks.workunit.client.0.smithi111.stdout:9/821: write d6/db/d34/d37/f48 [57961,114655] 0 2024-09-11T00:07:29.813 INFO:tasks.workunit.client.1.smithi203.stdout:7/744: dread - dd/fa7 zero size 2024-09-11T00:07:29.814 INFO:tasks.workunit.client.1.smithi203.stdout:6/727: mknod d0/d54/d9c/d35/de8/ce9 0 2024-09-11T00:07:29.816 INFO:tasks.workunit.client.1.smithi203.stdout:3/786: truncate d8/da/d37/d53/da2/fbd 787444 0 2024-09-11T00:07:29.817 INFO:tasks.workunit.client.0.smithi111.stdout:8/803: symlink d11/d23/d2c/d7f/dde/lfe 0 2024-09-11T00:07:29.818 INFO:tasks.workunit.client.0.smithi111.stdout:8/804: read - d11/f90 zero size 2024-09-11T00:07:29.819 INFO:tasks.workunit.client.1.smithi203.stdout:6/728: dread - d0/d5b/d5c/fa8 zero size 2024-09-11T00:07:29.820 INFO:tasks.workunit.client.0.smithi111.stdout:1/779: rename d2/de/d12/d3c/d4b/d6a/d3a/f70 to d2/f104 0 2024-09-11T00:07:29.820 INFO:tasks.workunit.client.1.smithi203.stdout:5/802: mknod dc/dd/d1e/dc6/c10a 0 2024-09-11T00:07:29.822 INFO:tasks.workunit.client.0.smithi111.stdout:5/818: chown d10/f13 0 1 2024-09-11T00:07:29.828 INFO:tasks.workunit.client.0.smithi111.stdout:3/819: creat d1c/d1d/d22/f120 x:0 0 0 2024-09-11T00:07:29.828 INFO:tasks.workunit.client.1.smithi203.stdout:1/854: rename d8/d28/d64/f65 to d8/d19/d60/d90/d3e/d4b/d80/d8d/da3/dd2/f133 0 2024-09-11T00:07:29.830 INFO:tasks.workunit.client.0.smithi111.stdout:7/829: getdents dd/d1d/d7e/dc8 0 2024-09-11T00:07:29.830 INFO:tasks.workunit.client.1.smithi203.stdout:9/746: mkdir d6/de/d32/d52/d55/d66/daa/df7 0 2024-09-11T00:07:29.830 INFO:tasks.workunit.client.1.smithi203.stdout:4/656: creat db/dd/d16/d38/d3c/d41/fcf x:0 0 0 2024-09-11T00:07:29.831 INFO:tasks.workunit.client.0.smithi111.stdout:3/820: fsync d1c/d1d/d22/d44/d5a/d74/f111 0 2024-09-11T00:07:29.831 INFO:tasks.workunit.client.0.smithi111.stdout:7/830: readlink dd/d48/l54 0 2024-09-11T00:07:29.833 INFO:tasks.workunit.client.0.smithi111.stdout:9/822: mkdir d6/db/d34/d37/d109 0 2024-09-11T00:07:29.833 INFO:tasks.workunit.client.0.smithi111.stdout:6/765: link d7/d22/d3f/f65 d7/d22/d26/f10a 0 2024-09-11T00:07:29.834 INFO:tasks.workunit.client.1.smithi203.stdout:2/814: creat d13/d15/d30/d5a/dcf/f10d x:0 0 0 2024-09-11T00:07:29.835 INFO:tasks.workunit.client.0.smithi111.stdout:9/823: truncate d6/dc/d7c/fe1 1227197 0 2024-09-11T00:07:29.836 INFO:tasks.workunit.client.0.smithi111.stdout:4/763: getdents d18/d20/d3c/d5e/daa 0 2024-09-11T00:07:29.838 INFO:tasks.workunit.client.0.smithi111.stdout:0/821: symlink d3/d13/d1e/d29/l121 0 2024-09-11T00:07:29.840 INFO:tasks.workunit.client.0.smithi111.stdout:8/805: mknod d11/d23/d2c/cff 0 2024-09-11T00:07:29.840 INFO:tasks.workunit.client.0.smithi111.stdout:0/822: chown d3/dc/fa5 373 1 2024-09-11T00:07:29.840 INFO:tasks.workunit.client.0.smithi111.stdout:5/819: read d10/d1e/d23/d30/d59/d53/fcc [1505726,46599] 0 2024-09-11T00:07:29.843 INFO:tasks.workunit.client.1.smithi203.stdout:5/803: dread dc/dd/d13/f14 [0,4194304] 0 2024-09-11T00:07:29.843 INFO:tasks.workunit.client.1.smithi203.stdout:7/745: dwrite dd/d1c/d52/d8f/d31/f50 [0,4194304] 0 2024-09-11T00:07:29.844 INFO:tasks.workunit.client.0.smithi111.stdout:1/780: mkdir d2/de/d105 0 2024-09-11T00:07:29.845 INFO:tasks.workunit.client.1.smithi203.stdout:5/804: stat dc/d91 0 2024-09-11T00:07:29.845 INFO:tasks.workunit.client.0.smithi111.stdout:2/737: symlink d0/d3/d12/d52/lfb 0 2024-09-11T00:07:29.846 INFO:tasks.workunit.client.0.smithi111.stdout:0/823: write d3/d13/f10f [36653,45156] 0 2024-09-11T00:07:29.847 INFO:tasks.workunit.client.0.smithi111.stdout:1/781: truncate d2/de/f53 632131 0 2024-09-11T00:07:29.848 INFO:tasks.workunit.client.1.smithi203.stdout:1/855: rename d8/d19/d60/d90/c12b to d8/d9/d15/d27/d102/c134 0 2024-09-11T00:07:29.850 INFO:tasks.workunit.client.1.smithi203.stdout:1/856: readlink d8/d9/d15/d35/lcd 0 2024-09-11T00:07:29.853 INFO:tasks.workunit.client.0.smithi111.stdout:7/831: creat dd/d1d/d1f/d24/f10c x:0 0 0 2024-09-11T00:07:29.857 INFO:tasks.workunit.client.1.smithi203.stdout:2/815: creat d13/d15/d30/d59/f10e x:0 0 0 2024-09-11T00:07:29.858 INFO:tasks.workunit.client.0.smithi111.stdout:8/806: dwrite d11/d23/d7e/d93/fcd [4194304,4194304] 0 2024-09-11T00:07:29.868 INFO:tasks.workunit.client.0.smithi111.stdout:2/738: dwrite d0/d3/de/db4/ff3 [0,4194304] 0 2024-09-11T00:07:29.869 INFO:tasks.workunit.client.1.smithi203.stdout:4/657: dread db/dd/d16/d38/d3c/f68 [0,4194304] 0 2024-09-11T00:07:29.870 INFO:tasks.workunit.client.1.smithi203.stdout:9/747: dread d6/de/d19/f97 [0,4194304] 0 2024-09-11T00:07:29.873 INFO:tasks.workunit.client.1.smithi203.stdout:4/658: chown db/d12/d15/c31 617 1 2024-09-11T00:07:29.874 INFO:tasks.workunit.client.0.smithi111.stdout:2/739: chown d0/d3/de/d3b/d62/d6d/l88 49267245 1 2024-09-11T00:07:29.875 INFO:tasks.workunit.client.1.smithi203.stdout:5/805: mkdir dc/dd/d15/dbd/de5/d10b 0 2024-09-11T00:07:29.877 INFO:tasks.workunit.client.0.smithi111.stdout:5/820: fdatasync d10/d1e/d23/d30/d3c/f40 0 2024-09-11T00:07:29.878 INFO:tasks.workunit.client.0.smithi111.stdout:2/740: chown d0/d3/de/d3b/d63/fa5 216461722 1 2024-09-11T00:07:29.885 INFO:tasks.workunit.client.0.smithi111.stdout:9/824: dwrite d6/dc/d73/ffd [0,4194304] 0 2024-09-11T00:07:29.886 INFO:tasks.workunit.client.1.smithi203.stdout:1/857: read d8/d19/d60/d90/d3e/d4b/d80/d91/dac/fc8 [797062,40553] 0 2024-09-11T00:07:29.888 INFO:tasks.workunit.client.1.smithi203.stdout:6/729: link d0/d5b/d5c/lc6 d0/d54/d9c/d35/d39/db2/lea 0 2024-09-11T00:07:29.889 INFO:tasks.workunit.client.1.smithi203.stdout:1/858: chown d8/d19/d31/c73 63 1 2024-09-11T00:07:29.892 INFO:tasks.workunit.client.1.smithi203.stdout:9/748: dread d6/de/d32/d52/f4b [0,4194304] 0 2024-09-11T00:07:29.893 INFO:tasks.workunit.client.0.smithi111.stdout:7/832: unlink dd/d1d/d1f/l5b 0 2024-09-11T00:07:29.895 INFO:tasks.workunit.client.0.smithi111.stdout:7/833: chown dd/d1d/d7e/dc8/fca 1118269 1 2024-09-11T00:07:29.897 INFO:tasks.workunit.client.0.smithi111.stdout:6/766: rmdir d7/d22/d3f/d74/d7f/d61/d6a/d9f 39 2024-09-11T00:07:29.900 INFO:tasks.workunit.client.0.smithi111.stdout:8/807: creat d11/d23/d3d/dca/dcf/dc3/f100 x:0 0 0 2024-09-11T00:07:29.901 INFO:tasks.workunit.client.1.smithi203.stdout:7/746: mknod dd/d1c/d52/d8f/c112 0 2024-09-11T00:07:29.903 INFO:tasks.workunit.client.1.smithi203.stdout:3/787: write d8/da/d37/d53/f62 [1660384,99274] 0 2024-09-11T00:07:29.907 INFO:tasks.workunit.client.1.smithi203.stdout:4/659: rename db/dd/d16/d38/d3c/fa5 to db/dd/d26/fd0 0 2024-09-11T00:07:29.910 INFO:tasks.workunit.client.0.smithi111.stdout:5/821: dread d10/d1e/d23/f48 [0,4194304] 0 2024-09-11T00:07:29.912 INFO:tasks.workunit.client.0.smithi111.stdout:0/824: mknod d3/d1c/dd0/d117/c122 0 2024-09-11T00:07:29.915 INFO:tasks.workunit.client.0.smithi111.stdout:0/825: dread d3/d13/f17 [0,4194304] 0 2024-09-11T00:07:29.917 INFO:tasks.workunit.client.1.smithi203.stdout:1/859: rmdir d8/d19/d60/d90/dd9 39 2024-09-11T00:07:29.922 INFO:tasks.workunit.client.0.smithi111.stdout:9/825: fdatasync d6/f3b 0 2024-09-11T00:07:29.923 INFO:tasks.workunit.client.1.smithi203.stdout:9/749: rmdir d6/de/d19/d24/d54/db2/de2 39 2024-09-11T00:07:29.925 INFO:tasks.workunit.client.1.smithi203.stdout:7/747: dread dd/d1c/d52/f8d [0,4194304] 0 2024-09-11T00:07:29.926 INFO:tasks.workunit.client.1.smithi203.stdout:5/806: write dc/dd/d1e/fbc [32265,102204] 0 2024-09-11T00:07:29.928 INFO:tasks.workunit.client.1.smithi203.stdout:3/788: symlink d8/da/d37/l116 0 2024-09-11T00:07:29.929 INFO:tasks.workunit.client.1.smithi203.stdout:7/748: read dd/d3b/d5b/f83 [297227,5967] 0 2024-09-11T00:07:29.929 INFO:tasks.workunit.client.0.smithi111.stdout:6/767: symlink d7/d22/d2c/d38/l10b 0 2024-09-11T00:07:29.930 INFO:tasks.workunit.client.1.smithi203.stdout:0/708: sync 2024-09-11T00:07:29.930 INFO:tasks.workunit.client.1.smithi203.stdout:8/687: sync 2024-09-11T00:07:29.934 INFO:tasks.workunit.client.1.smithi203.stdout:4/660: rmdir db/dd/d16 39 2024-09-11T00:07:29.939 INFO:tasks.workunit.client.1.smithi203.stdout:2/816: dwrite d13/d15/d30/d5a/d8b/fb5 [0,4194304] 0 2024-09-11T00:07:29.939 INFO:tasks.workunit.client.1.smithi203.stdout:6/730: mkdir d0/d71/db9/deb 0 2024-09-11T00:07:29.942 INFO:tasks.workunit.client.0.smithi111.stdout:5/822: mknod d10/d1e/d23/d2b/dad/c10c 0 2024-09-11T00:07:29.943 INFO:tasks.workunit.client.1.smithi203.stdout:2/817: readlink d13/d15/d30/d5a/dac/lde 0 2024-09-11T00:07:29.944 INFO:tasks.workunit.client.0.smithi111.stdout:5/823: write d10/d1e/d23/d30/dd8/da2/f58 [809668,71391] 0 2024-09-11T00:07:29.945 INFO:tasks.workunit.client.1.smithi203.stdout:1/860: mkdir d8/d19/d60/dff/d135 0 2024-09-11T00:07:29.948 INFO:tasks.workunit.client.0.smithi111.stdout:2/741: creat d0/d3/de/d68/df1/ffc x:0 0 0 2024-09-11T00:07:29.949 INFO:tasks.workunit.client.0.smithi111.stdout:2/742: stat d0/d3/d2e/c4d 0 2024-09-11T00:07:29.955 INFO:tasks.workunit.client.1.smithi203.stdout:5/807: rmdir dc/d4f/d5c/d76 39 2024-09-11T00:07:29.956 INFO:tasks.workunit.client.1.smithi203.stdout:8/688: dwrite d1/d13/d43/d46/db0/fce [0,4194304] 0 2024-09-11T00:07:29.958 INFO:tasks.workunit.client.1.smithi203.stdout:0/709: creat d0/dc5/ff1 x:0 0 0 2024-09-11T00:07:29.965 INFO:tasks.workunit.client.0.smithi111.stdout:4/764: link d18/d20/d40/fc4 d18/d1f/dc5/ff0 0 2024-09-11T00:07:29.967 INFO:tasks.workunit.client.1.smithi203.stdout:4/661: fdatasync db/dd/d16/fca 0 2024-09-11T00:07:29.973 INFO:tasks.workunit.client.0.smithi111.stdout:5/824: creat d10/d1e/d23/d30/dd8/d63/f10d x:0 0 0 2024-09-11T00:07:29.973 INFO:tasks.workunit.client.0.smithi111.stdout:3/821: sync 2024-09-11T00:07:29.974 INFO:tasks.workunit.client.0.smithi111.stdout:1/782: sync 2024-09-11T00:07:29.976 INFO:tasks.workunit.client.1.smithi203.stdout:6/731: rename d0/d54/f61 to d0/d54/d9c/d35/d38/d73/d74/fec 0 2024-09-11T00:07:29.978 INFO:tasks.workunit.client.0.smithi111.stdout:2/743: fdatasync d0/d3/fb8 0 2024-09-11T00:07:29.980 INFO:tasks.workunit.client.1.smithi203.stdout:2/818: chown d13/d15/d19/d1c/c72 396758 1 2024-09-11T00:07:29.981 INFO:tasks.workunit.client.1.smithi203.stdout:2/819: chown d13/d15/d19/d1c/f3c 1422085 1 2024-09-11T00:07:29.984 INFO:tasks.workunit.client.1.smithi203.stdout:1/861: fsync d8/f6d 0 2024-09-11T00:07:29.984 INFO:tasks.workunit.client.1.smithi203.stdout:3/789: write d8/da/d11/f55 [5242704,63358] 0 2024-09-11T00:07:29.987 INFO:tasks.workunit.client.0.smithi111.stdout:6/768: dwrite d7/f23 [0,4194304] 0 2024-09-11T00:07:29.988 INFO:tasks.workunit.client.0.smithi111.stdout:7/834: link dd/d1d/d1f/c22 dd/d1d/d2d/c10d 0 2024-09-11T00:07:29.990 INFO:tasks.workunit.client.1.smithi203.stdout:8/689: symlink d1/d13/d43/le4 0 2024-09-11T00:07:29.992 INFO:tasks.workunit.client.0.smithi111.stdout:8/808: link d11/d23/d3d/dca/dcf/c66 d11/d23/d7e/c101 0 2024-09-11T00:07:29.994 INFO:tasks.workunit.client.0.smithi111.stdout:4/765: dread f7 [4194304,4194304] 0 2024-09-11T00:07:29.995 INFO:tasks.workunit.client.0.smithi111.stdout:1/783: write d2/de/d12/d3c/d4b/d6a/f46 [3043567,9299] 0 2024-09-11T00:07:29.997 INFO:tasks.workunit.client.1.smithi203.stdout:7/749: fsync dd/d1c/d52/d8f/d31/d58/d93/d98/fd4 0 2024-09-11T00:07:29.999 INFO:tasks.workunit.client.0.smithi111.stdout:0/826: dwrite d3/daf/fba [0,4194304] 0 2024-09-11T00:07:30.001 INFO:tasks.workunit.client.1.smithi203.stdout:4/662: unlink db/dd/d16/c52 0 2024-09-11T00:07:30.004 INFO:tasks.workunit.client.1.smithi203.stdout:4/663: write db/dd/d16/f6e [3526416,58669] 0 2024-09-11T00:07:30.004 INFO:tasks.workunit.client.0.smithi111.stdout:0/827: write d3/d13/d1e/d29/f2d [7372017,115506] 0 2024-09-11T00:07:30.004 INFO:tasks.workunit.client.0.smithi111.stdout:9/826: write d6/db/d34/f47 [441778,71962] 0 2024-09-11T00:07:30.008 INFO:tasks.workunit.client.0.smithi111.stdout:2/744: creat d0/d3/de/d3b/d92/ffd x:0 0 0 2024-09-11T00:07:30.011 INFO:tasks.workunit.client.1.smithi203.stdout:1/862: mkdir d8/d11/d136 0 2024-09-11T00:07:30.012 INFO:tasks.workunit.client.1.smithi203.stdout:4/664: write db/d12/f1e [551135,126764] 0 2024-09-11T00:07:30.015 INFO:tasks.workunit.client.1.smithi203.stdout:3/790: symlink d8/da/d37/d83/d65/l117 0 2024-09-11T00:07:30.017 INFO:tasks.workunit.client.1.smithi203.stdout:1/863: write d8/d19/d60/d90/d3e/fdb [506835,4576] 0 2024-09-11T00:07:30.017 INFO:tasks.workunit.client.0.smithi111.stdout:3/822: dwrite d1c/d1d/d22/d23/d2f/de8/d5f/f8c [0,4194304] 0 2024-09-11T00:07:30.020 INFO:tasks.workunit.client.1.smithi203.stdout:1/864: write d8/d9/d15/d35/d81/f83 [2992470,52044] 0 2024-09-11T00:07:30.031 INFO:tasks.workunit.client.0.smithi111.stdout:6/769: write d7/d22/d1d/f5f [256213,56801] 0 2024-09-11T00:07:30.032 INFO:tasks.workunit.client.1.smithi203.stdout:4/665: dread db/f6c [0,4194304] 0 2024-09-11T00:07:30.036 INFO:tasks.workunit.client.1.smithi203.stdout:8/690: dread d1/d13/d43/dab/fbd [0,4194304] 0 2024-09-11T00:07:30.038 INFO:tasks.workunit.client.0.smithi111.stdout:1/784: fsync d2/de/d93/fa7 0 2024-09-11T00:07:30.040 INFO:tasks.workunit.client.1.smithi203.stdout:2/820: dwrite d13/d15/f55 [0,4194304] 0 2024-09-11T00:07:30.040 INFO:tasks.workunit.client.1.smithi203.stdout:7/750: rmdir dd/d1c/d52/d8f/d31/d4a 39 2024-09-11T00:07:30.045 INFO:tasks.workunit.client.0.smithi111.stdout:0/828: chown d3/d13/d1e/d29/d49/c32 7749 1 2024-09-11T00:07:30.046 INFO:tasks.workunit.client.1.smithi203.stdout:9/750: getdents d6/de/d19/d21/da0 0 2024-09-11T00:07:30.053 INFO:tasks.workunit.client.0.smithi111.stdout:2/745: rmdir d0 39 2024-09-11T00:07:30.060 INFO:tasks.workunit.client.0.smithi111.stdout:4/766: write d18/d20/d40/f8c [1742842,10637] 0 2024-09-11T00:07:30.061 INFO:tasks.workunit.client.0.smithi111.stdout:8/809: chown d11/d23/d3d/d5f/c60 634 1 2024-09-11T00:07:30.062 INFO:tasks.workunit.client.0.smithi111.stdout:8/810: fdatasync d11/fc0 0 2024-09-11T00:07:30.065 INFO:tasks.workunit.client.1.smithi203.stdout:6/732: truncate d0/d54/d9c/d35/d38/dc0/ddb/fe1 3156452 0 2024-09-11T00:07:30.068 INFO:tasks.workunit.client.0.smithi111.stdout:3/823: dread d1c/d1d/d22/d23/d2f/f7a [0,4194304] 0 2024-09-11T00:07:30.072 INFO:tasks.workunit.client.0.smithi111.stdout:3/824: read f17 [6555298,120192] 0 2024-09-11T00:07:30.075 INFO:tasks.workunit.client.1.smithi203.stdout:8/691: symlink d1/d13/d43/d46/le5 0 2024-09-11T00:07:30.077 INFO:tasks.workunit.client.1.smithi203.stdout:8/692: readlink d1/d13/l30 0 2024-09-11T00:07:30.084 INFO:tasks.workunit.client.1.smithi203.stdout:9/751: read d6/de/d19/d24/f27 [1704972,9220] 0 2024-09-11T00:07:30.084 INFO:tasks.workunit.client.0.smithi111.stdout:9/827: dwrite d6/db/d34/d37/f3f [0,4194304] 0 2024-09-11T00:07:30.085 INFO:tasks.workunit.client.1.smithi203.stdout:3/791: dread d8/d17/ff2 [0,4194304] 0 2024-09-11T00:07:30.085 INFO:tasks.workunit.client.0.smithi111.stdout:9/828: readlink d6/db/d34/d37/lbf 0 2024-09-11T00:07:30.085 INFO:tasks.workunit.client.0.smithi111.stdout:6/770: dread d7/d22/d26/d87/d41/d77/fce [0,4194304] 0 2024-09-11T00:07:30.087 INFO:tasks.workunit.client.0.smithi111.stdout:7/835: truncate dd/d1d/d7e/df8/d8f/dac/fe5 3807682 0 2024-09-11T00:07:30.089 INFO:tasks.workunit.client.1.smithi203.stdout:0/710: getdents d0/d2/d92 0 2024-09-11T00:07:30.090 INFO:tasks.workunit.client.1.smithi203.stdout:5/808: link dc/dd/d15/dac/lf5 dc/dd/d15/l10c 0 2024-09-11T00:07:30.099 INFO:tasks.workunit.client.0.smithi111.stdout:5/825: rename d10/d1e/d23/d30/dd8/d63/fff to d10/d1e/d23/f10e 0 2024-09-11T00:07:30.103 INFO:tasks.workunit.client.1.smithi203.stdout:3/792: dread d8/da/d5c/f8d [0,4194304] 0 2024-09-11T00:07:30.112 INFO:tasks.workunit.client.0.smithi111.stdout:1/785: dwrite d2/de/f17 [0,4194304] 0 2024-09-11T00:07:30.118 INFO:tasks.workunit.client.1.smithi203.stdout:1/865: dread d8/d19/d60/d90/d3e/d4b/d80/d8d/da3/dd2/f133 [0,4194304] 0 2024-09-11T00:07:30.118 INFO:tasks.workunit.client.1.smithi203.stdout:5/809: rmdir dc/dd/d13 39 2024-09-11T00:07:30.120 INFO:tasks.workunit.client.1.smithi203.stdout:9/752: truncate d6/de/d19/d24/d54/f9d 1276836 0 2024-09-11T00:07:30.122 INFO:tasks.workunit.client.1.smithi203.stdout:7/751: creat dd/f113 x:0 0 0 2024-09-11T00:07:30.127 INFO:tasks.workunit.client.1.smithi203.stdout:2/821: rename d13/d15/d30/d59/lc5 to d13/d56/l10f 0 2024-09-11T00:07:30.131 INFO:tasks.workunit.client.1.smithi203.stdout:2/822: write d13/d56/d69/ff5 [468702,124020] 0 2024-09-11T00:07:30.139 INFO:tasks.workunit.client.0.smithi111.stdout:8/811: write d11/d23/d2c/fc5 [380509,113884] 0 2024-09-11T00:07:30.140 INFO:tasks.workunit.client.1.smithi203.stdout:4/666: getdents db/d12 0 2024-09-11T00:07:30.141 INFO:tasks.workunit.client.1.smithi203.stdout:2/823: readlink d13/d15/d19/d1c/d73/dc4/lbc 0 2024-09-11T00:07:30.143 INFO:tasks.workunit.client.1.smithi203.stdout:9/753: dwrite d6/de/d32/d52/d55/d66/daa/fae [0,4194304] 0 2024-09-11T00:07:30.147 INFO:tasks.workunit.client.1.smithi203.stdout:1/866: mknod d8/d19/c137 0 2024-09-11T00:07:30.163 INFO:tasks.workunit.client.1.smithi203.stdout:8/693: rename d1/d13/d43/d46/f4e to d1/d13/d43/d46/d76/fe6 0 2024-09-11T00:07:30.166 INFO:tasks.workunit.client.1.smithi203.stdout:0/711: write d0/f15 [1895178,121168] 0 2024-09-11T00:07:30.169 INFO:tasks.workunit.client.0.smithi111.stdout:3/825: dwrite d1c/d1d/d22/f61 [4194304,4194304] 0 2024-09-11T00:07:30.175 INFO:tasks.workunit.client.1.smithi203.stdout:2/824: symlink d13/d15/d30/d59/l110 0 2024-09-11T00:07:30.181 INFO:tasks.workunit.client.1.smithi203.stdout:7/752: dread dd/d1c/d52/d8f/d31/f36 [0,4194304] 0 2024-09-11T00:07:30.183 INFO:tasks.workunit.client.1.smithi203.stdout:9/754: unlink d6/de/d32/d52/d55/f3f 0 2024-09-11T00:07:30.185 INFO:tasks.workunit.client.1.smithi203.stdout:7/753: write dd/d1c/d7c/ff1 [953729,9698] 0 2024-09-11T00:07:30.188 INFO:tasks.workunit.client.1.smithi203.stdout:7/754: dread - dd/d1c/d52/d8f/d31/ff4 zero size 2024-09-11T00:07:30.190 INFO:tasks.workunit.client.1.smithi203.stdout:1/867: symlink d8/d19/d60/d90/d3e/d4b/d80/d8d/l138 0 2024-09-11T00:07:30.193 INFO:tasks.workunit.client.1.smithi203.stdout:1/868: write d8/d9/d15/d35/d81/f9e [1434686,122467] 0 2024-09-11T00:07:30.196 INFO:tasks.workunit.client.1.smithi203.stdout:3/793: dwrite d8/da/d37/d53/f9b [0,4194304] 0 2024-09-11T00:07:30.208 INFO:tasks.workunit.client.1.smithi203.stdout:8/694: rename d1/d13/f1f to d1/d13/d43/d46/fe7 0 2024-09-11T00:07:30.210 INFO:tasks.workunit.client.1.smithi203.stdout:5/810: dwrite dc/dd/d15/f4b [0,4194304] 0 2024-09-11T00:07:30.215 INFO:tasks.workunit.client.1.smithi203.stdout:8/695: read d1/fe [8015091,121125] 0 2024-09-11T00:07:30.219 INFO:tasks.workunit.client.1.smithi203.stdout:2/825: mknod d13/d15/d19/d1c/d73/dc8/c111 0 2024-09-11T00:07:30.224 INFO:tasks.workunit.client.1.smithi203.stdout:4/667: symlink db/d12/d15/d2a/dcb/ld1 0 2024-09-11T00:07:30.228 INFO:tasks.workunit.client.1.smithi203.stdout:7/755: rmdir dd/d1c/d52/d8f/d31/d58 39 2024-09-11T00:07:30.236 INFO:tasks.workunit.client.1.smithi203.stdout:3/794: creat d8/da/d5c/d6b/f118 x:0 0 0 2024-09-11T00:07:30.241 INFO:tasks.workunit.client.1.smithi203.stdout:1/869: rmdir d8/d19/d60 39 2024-09-11T00:07:30.243 INFO:tasks.workunit.client.1.smithi203.stdout:5/811: mknod dc/dd/d15/dbd/d59/dbb/c10d 0 2024-09-11T00:07:30.270 INFO:tasks.workunit.client.1.smithi203.stdout:8/696: creat d1/d13/d17/d81/fe8 x:0 0 0 2024-09-11T00:07:30.277 INFO:tasks.workunit.client.1.smithi203.stdout:4/668: unlink db/dd/d16/c5c 0 2024-09-11T00:07:30.288 INFO:tasks.workunit.client.1.smithi203.stdout:0/712: dwrite d0/f8c [0,4194304] 0 2024-09-11T00:07:30.289 INFO:tasks.workunit.client.0.smithi111.stdout:0/829: mknod d3/daf/c123 0 2024-09-11T00:07:30.297 INFO:tasks.workunit.client.1.smithi203.stdout:5/812: unlink dc/dd/d15/l16 0 2024-09-11T00:07:30.298 INFO:tasks.workunit.client.1.smithi203.stdout:9/755: dwrite d6/de/d19/d21/d87/f90 [0,4194304] 0 2024-09-11T00:07:30.298 INFO:tasks.workunit.client.0.smithi111.stdout:9/829: fsync d6/db/db8/fc4 0 2024-09-11T00:07:30.302 INFO:tasks.workunit.client.0.smithi111.stdout:6/771: rmdir d7/d22/d3f/d74/d7f/d79/da4 39 2024-09-11T00:07:30.303 INFO:tasks.workunit.client.0.smithi111.stdout:6/772: read d7/f23 [3266535,42477] 0 2024-09-11T00:07:30.308 INFO:tasks.workunit.client.1.smithi203.stdout:4/669: dread db/dd/d16/f6e [0,4194304] 0 2024-09-11T00:07:30.308 INFO:tasks.workunit.client.0.smithi111.stdout:7/836: creat dd/d1d/d76/db6/f10e x:0 0 0 2024-09-11T00:07:30.323 INFO:tasks.workunit.client.1.smithi203.stdout:0/713: symlink d0/d2/d37/lf2 0 2024-09-11T00:07:30.329 INFO:tasks.workunit.client.1.smithi203.stdout:1/870: creat d8/d19/d60/d90/d3e/d4b/db2/f139 x:0 0 0 2024-09-11T00:07:30.330 INFO:tasks.workunit.client.0.smithi111.stdout:4/767: truncate f15 7743040 0 2024-09-11T00:07:30.330 INFO:tasks.workunit.client.0.smithi111.stdout:1/786: fdatasync d2/de/d12/d3c/d4b/dc3/f102 0 2024-09-11T00:07:30.334 INFO:tasks.workunit.client.1.smithi203.stdout:1/871: dread - d8/d19/d60/d90/d3e/d4b/db2/f139 zero size 2024-09-11T00:07:30.334 INFO:tasks.workunit.client.1.smithi203.stdout:2/826: dwrite d13/d22/f38 [4194304,4194304] 0 2024-09-11T00:07:30.335 INFO:tasks.workunit.client.0.smithi111.stdout:8/812: mknod d11/d23/d3d/dca/c102 0 2024-09-11T00:07:30.335 INFO:tasks.workunit.client.0.smithi111.stdout:8/813: stat d11/d21/d6f/dab/fc1 0 2024-09-11T00:07:30.341 INFO:tasks.workunit.client.1.smithi203.stdout:4/670: dread db/dd/d16/fb1 [0,4194304] 0 2024-09-11T00:07:30.344 INFO:tasks.workunit.client.0.smithi111.stdout:2/746: dwrite d0/d3/de/d3b/d92/fc3 [0,4194304] 0 2024-09-11T00:07:30.346 INFO:tasks.workunit.client.1.smithi203.stdout:7/756: getdents dd/d1c/d52/d8f/d31/d58/d93/d98/dfc/d108 0 2024-09-11T00:07:30.351 INFO:tasks.workunit.client.1.smithi203.stdout:0/714: rmdir d0/d2/d7e/da1/dc9 39 2024-09-11T00:07:30.351 INFO:tasks.workunit.client.1.smithi203.stdout:6/733: sync 2024-09-11T00:07:30.361 INFO:tasks.workunit.client.1.smithi203.stdout:2/827: creat d13/d56/d69/f112 x:0 0 0 2024-09-11T00:07:30.363 INFO:tasks.workunit.client.0.smithi111.stdout:5/826: dwrite d10/d1e/d23/d30/dd8/da2/d66/fbe [0,4194304] 0 2024-09-11T00:07:30.364 INFO:tasks.workunit.client.1.smithi203.stdout:1/872: creat d8/d19/d60/d90/d3e/d66/f13a x:0 0 0 2024-09-11T00:07:30.365 INFO:tasks.workunit.client.1.smithi203.stdout:8/697: dwrite d1/d13/d17/d2f/d9e/f66 [0,4194304] 0 2024-09-11T00:07:30.375 INFO:tasks.workunit.client.1.smithi203.stdout:6/734: dread d0/d54/d9c/d35/d39/fd6 [0,4194304] 0 2024-09-11T00:07:30.420 INFO:tasks.workunit.client.0.smithi111.stdout:6/773: truncate d7/d22/d3f/f54 2432029 0 2024-09-11T00:07:30.422 INFO:tasks.workunit.client.0.smithi111.stdout:6/774: chown d7/d22/d2c/f62 47 1 2024-09-11T00:07:30.424 INFO:tasks.workunit.client.0.smithi111.stdout:6/775: stat d7/d22/d26/d87/d7a/dc5/ceb 0 2024-09-11T00:07:30.425 INFO:tasks.workunit.client.0.smithi111.stdout:6/776: fdatasync d7/f52 0 2024-09-11T00:07:30.450 INFO:tasks.workunit.client.0.smithi111.stdout:1/787: sync 2024-09-11T00:07:30.454 INFO:tasks.workunit.client.1.smithi203.stdout:3/795: sync 2024-09-11T00:07:30.484 INFO:tasks.workunit.client.0.smithi111.stdout:7/837: unlink dd/d1d/d2d/f89 0 2024-09-11T00:07:30.493 INFO:tasks.workunit.client.0.smithi111.stdout:4/768: creat d18/d20/d3c/d5e/d75/d8d/dce/ff1 x:0 0 0 2024-09-11T00:07:30.495 INFO:tasks.workunit.client.0.smithi111.stdout:8/814: creat d11/d23/d2c/f103 x:0 0 0 2024-09-11T00:07:30.501 INFO:tasks.workunit.client.1.smithi203.stdout:9/756: truncate d6/de/d19/d24/d6c/fea 152618 0 2024-09-11T00:07:30.503 INFO:tasks.workunit.client.0.smithi111.stdout:3/826: dwrite d1c/d1d/d22/d31/fc8 [0,4194304] 0 2024-09-11T00:07:30.505 INFO:tasks.workunit.client.1.smithi203.stdout:7/757: dwrite dd/d1c/d52/fac [0,4194304] 0 2024-09-11T00:07:30.533 INFO:tasks.workunit.client.0.smithi111.stdout:6/777: fsync d7/d22/d2c/d38/f45 0 2024-09-11T00:07:30.534 INFO:tasks.workunit.client.0.smithi111.stdout:6/778: chown d7/f12 1178 1 2024-09-11T00:07:30.536 INFO:tasks.workunit.client.0.smithi111.stdout:6/779: write f1 [1047841,95291] 0 2024-09-11T00:07:30.537 INFO:tasks.workunit.client.1.smithi203.stdout:5/813: sync 2024-09-11T00:07:30.538 INFO:tasks.workunit.client.0.smithi111.stdout:6/780: fdatasync d7/d22/d2c/d38/d39/ff9 0 2024-09-11T00:07:30.550 INFO:tasks.workunit.client.0.smithi111.stdout:5/827: dread d10/d1e/d23/d2b/d5c/f8e [0,4194304] 0 2024-09-11T00:07:30.559 INFO:tasks.workunit.client.0.smithi111.stdout:4/769: symlink d18/d1f/d36/d95/lf2 0 2024-09-11T00:07:30.582 INFO:tasks.workunit.client.0.smithi111.stdout:3/827: dread f1a [0,4194304] 0 2024-09-11T00:07:30.587 INFO:tasks.workunit.client.0.smithi111.stdout:1/788: mkdir d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/d106 0 2024-09-11T00:07:30.601 INFO:tasks.workunit.client.0.smithi111.stdout:5/828: dread d10/d1e/d23/d30/d59/d7b/fa3 [0,4194304] 0 2024-09-11T00:07:30.601 INFO:tasks.workunit.client.0.smithi111.stdout:4/770: unlink d18/d20/d3c/d5e/d75/d8d/f96 0 2024-09-11T00:07:30.607 INFO:tasks.workunit.client.0.smithi111.stdout:9/830: link d6/c12 d6/dc/d7c/c10a 0 2024-09-11T00:07:30.610 INFO:tasks.workunit.client.0.smithi111.stdout:3/828: truncate d1c/d1d/d22/fc1 531470 0 2024-09-11T00:07:30.611 INFO:tasks.workunit.client.0.smithi111.stdout:3/829: stat d1c/d1d/d22/d23/dff 0 2024-09-11T00:07:30.613 INFO:tasks.workunit.client.0.smithi111.stdout:3/830: chown d1c/d1d/d22/d23/d2f/c3d 3 1 2024-09-11T00:07:30.618 INFO:tasks.workunit.client.1.smithi203.stdout:0/715: dread - d0/d2/d67/f93 zero size 2024-09-11T00:07:30.623 INFO:tasks.workunit.client.1.smithi203.stdout:2/828: symlink d13/d15/dff/l113 0 2024-09-11T00:07:30.626 INFO:tasks.workunit.client.1.smithi203.stdout:2/829: write d13/d15/f1b [3124788,126574] 0 2024-09-11T00:07:30.627 INFO:tasks.workunit.client.0.smithi111.stdout:4/771: dread d18/d20/d3c/f9a [0,4194304] 0 2024-09-11T00:07:30.628 INFO:tasks.workunit.client.0.smithi111.stdout:5/829: rmdir d10/d1e/d23/d30/dd8/d7e 39 2024-09-11T00:07:30.633 INFO:tasks.workunit.client.1.smithi203.stdout:9/757: read d6/de/d19/d24/d54/db2/de2/f9b [109819,115881] 0 2024-09-11T00:07:30.637 INFO:tasks.workunit.client.1.smithi203.stdout:9/758: dread d6/de/fe3 [0,4194304] 0 2024-09-11T00:07:30.638 INFO:tasks.workunit.client.1.smithi203.stdout:9/759: chown d6/de/l8e 505049226 1 2024-09-11T00:07:30.640 INFO:tasks.workunit.client.0.smithi111.stdout:5/830: unlink d10/d1e/d23/d30/c36 0 2024-09-11T00:07:30.644 INFO:tasks.workunit.client.1.smithi203.stdout:4/671: rename db/dd/d26/d42/c51 to db/d12/d15/d2a/dcb/cd2 0 2024-09-11T00:07:30.658 INFO:tasks.workunit.client.1.smithi203.stdout:4/672: creat db/dd/d16/d38/d3c/d41/fd3 x:0 0 0 2024-09-11T00:07:30.662 INFO:tasks.workunit.client.0.smithi111.stdout:5/831: dread d10/d1e/d23/d30/dd8/da2/d66/d76/f106 [0,4194304] 0 2024-09-11T00:07:30.666 INFO:tasks.workunit.client.1.smithi203.stdout:4/673: symlink db/d12/d15/ld4 0 2024-09-11T00:07:30.668 INFO:tasks.workunit.client.0.smithi111.stdout:5/832: creat d10/d1e/d23/d26/d3a/d98/d6d/def/f10f x:0 0 0 2024-09-11T00:07:30.673 INFO:tasks.workunit.client.1.smithi203.stdout:9/760: dread d6/f14 [0,4194304] 0 2024-09-11T00:07:30.674 INFO:tasks.workunit.client.1.smithi203.stdout:4/674: unlink db/dd/d16/d38/d3c/cb7 0 2024-09-11T00:07:30.678 INFO:tasks.workunit.client.1.smithi203.stdout:9/761: fdatasync d6/de/fbd 0 2024-09-11T00:07:30.680 INFO:tasks.workunit.client.0.smithi111.stdout:5/833: creat d10/d1e/d23/d30/dd8/f110 x:0 0 0 2024-09-11T00:07:30.681 INFO:tasks.workunit.client.1.smithi203.stdout:0/716: mknod d0/d2/d3d/cf3 0 2024-09-11T00:07:30.682 INFO:tasks.workunit.client.0.smithi111.stdout:5/834: write d10/d1e/d23/d2b/d92/db8/fe8 [667541,95315] 0 2024-09-11T00:07:30.687 INFO:tasks.workunit.client.1.smithi203.stdout:1/873: rename d8/d28/fa9 to d8/d19/d31/f13b 0 2024-09-11T00:07:30.692 INFO:tasks.workunit.client.1.smithi203.stdout:4/675: link db/l20 db/dd/d16/d38/d3c/d41/ld5 0 2024-09-11T00:07:30.694 INFO:tasks.workunit.client.0.smithi111.stdout:5/835: mkdir d10/d1e/d23/d30/d59/dd1/df6/d111 0 2024-09-11T00:07:30.695 INFO:tasks.workunit.client.1.smithi203.stdout:5/814: sync 2024-09-11T00:07:30.696 INFO:tasks.workunit.client.0.smithi111.stdout:5/836: write d10/d1e/d23/d2b/d5c/fb7 [5231924,39335] 0 2024-09-11T00:07:30.697 INFO:tasks.workunit.client.1.smithi203.stdout:4/676: mknod db/dd/d16/cd6 0 2024-09-11T00:07:30.704 INFO:tasks.workunit.client.1.smithi203.stdout:0/717: dwrite d0/f15 [0,4194304] 0 2024-09-11T00:07:30.706 INFO:tasks.workunit.client.0.smithi111.stdout:5/837: symlink d10/d1e/d23/d30/d59/dd1/df6/d111/l112 0 2024-09-11T00:07:30.706 INFO:tasks.workunit.client.0.smithi111.stdout:4/772: sync 2024-09-11T00:07:30.709 INFO:tasks.workunit.client.1.smithi203.stdout:0/718: truncate d0/d2/d3d/fdc 1023894 0 2024-09-11T00:07:30.710 INFO:tasks.workunit.client.1.smithi203.stdout:5/815: link dc/d4f/ff7 dc/d91/f10e 0 2024-09-11T00:07:30.710 INFO:tasks.workunit.client.1.smithi203.stdout:4/677: truncate db/dd/d16/d38/d3c/d41/f8e 3553130 0 2024-09-11T00:07:30.715 INFO:tasks.workunit.client.0.smithi111.stdout:5/838: rmdir d10/d1e/d23/d30/dd8/da2 39 2024-09-11T00:07:30.725 INFO:tasks.workunit.client.0.smithi111.stdout:4/773: dread d18/d20/d4a/f3f [0,4194304] 0 2024-09-11T00:07:30.727 INFO:tasks.workunit.client.0.smithi111.stdout:5/839: creat d10/d1e/d23/d30/dd8/da2/d66/d76/f113 x:0 0 0 2024-09-11T00:07:30.728 INFO:tasks.workunit.client.0.smithi111.stdout:6/781: mkdir d7/d22/d26/d87/d41/d10c 0 2024-09-11T00:07:30.729 INFO:tasks.workunit.client.0.smithi111.stdout:4/774: creat d18/d1f/d36/d95/dde/ff3 x:0 0 0 2024-09-11T00:07:30.730 INFO:tasks.workunit.client.0.smithi111.stdout:4/775: chown d18/f71 7619 1 2024-09-11T00:07:30.731 INFO:tasks.workunit.client.0.smithi111.stdout:5/840: symlink d10/d1e/d23/d2b/d2f/l114 0 2024-09-11T00:07:30.735 INFO:tasks.workunit.client.0.smithi111.stdout:6/782: mknod d7/d22/d2c/d38/d56/dbf/dca/c10d 0 2024-09-11T00:07:30.736 INFO:tasks.workunit.client.0.smithi111.stdout:5/841: rmdir d10/d1e/d23/d30/dd8/d63/dbb 39 2024-09-11T00:07:30.738 INFO:tasks.workunit.client.0.smithi111.stdout:5/842: fdatasync d10/d1e/d23/d30/dd8/da2/fcf 0 2024-09-11T00:07:30.741 INFO:tasks.workunit.client.0.smithi111.stdout:0/830: write d3/d1c/fd5 [10336,33418] 0 2024-09-11T00:07:30.745 INFO:tasks.workunit.client.0.smithi111.stdout:5/843: mkdir d10/d1e/d23/d26/d3a/dea/d115 0 2024-09-11T00:07:30.746 INFO:tasks.workunit.client.0.smithi111.stdout:0/831: creat d3/d1c/dd0/d117/f124 x:0 0 0 2024-09-11T00:07:30.747 INFO:tasks.workunit.client.0.smithi111.stdout:5/844: chown d10/d1e/d23/d2b/d92/cac 1462275 1 2024-09-11T00:07:30.749 INFO:tasks.workunit.client.1.smithi203.stdout:0/719: dread d0/d2/d37/d5b/fc0 [0,4194304] 0 2024-09-11T00:07:30.750 INFO:tasks.workunit.client.0.smithi111.stdout:6/783: dwrite d7/d22/d26/f101 [0,4194304] 0 2024-09-11T00:07:30.755 INFO:tasks.workunit.client.0.smithi111.stdout:5/845: unlink d10/d1e/d23/d30/dd8/d63/lb2 0 2024-09-11T00:07:30.759 INFO:tasks.workunit.client.0.smithi111.stdout:5/846: rmdir d10/d1e/d23/d2b/d5c/d61 39 2024-09-11T00:07:30.767 INFO:tasks.workunit.client.1.smithi203.stdout:9/762: rename d6/de/d32/d52/d44 to d6/de/d47/de1/dec/df8 0 2024-09-11T00:07:30.768 INFO:tasks.workunit.client.0.smithi111.stdout:7/838: write dd/d49/f99 [1220520,115963] 0 2024-09-11T00:07:30.774 INFO:tasks.workunit.client.0.smithi111.stdout:6/784: dread d7/f6b [0,4194304] 0 2024-09-11T00:07:30.774 INFO:tasks.workunit.client.0.smithi111.stdout:7/839: mkdir dd/d1d/d4d/d82/d10f 0 2024-09-11T00:07:30.778 INFO:tasks.workunit.client.0.smithi111.stdout:6/785: write d7/d22/d3f/d74/d7f/ff5 [3658958,1011] 0 2024-09-11T00:07:30.779 INFO:tasks.workunit.client.0.smithi111.stdout:7/840: mkdir dd/d49/d110 0 2024-09-11T00:07:30.781 INFO:tasks.workunit.client.1.smithi203.stdout:5/816: rename dc/dd/d56/lc4 to dc/dd/d15/l10f 0 2024-09-11T00:07:30.788 INFO:tasks.workunit.client.0.smithi111.stdout:5/847: dread d10/d1e/d23/d26/d3a/f87 [0,4194304] 0 2024-09-11T00:07:30.789 INFO:tasks.workunit.client.1.smithi203.stdout:4/678: rename db/dd/d16/d38/d3c/d41/c69 to db/dd/d26/dcd/cd7 0 2024-09-11T00:07:30.791 INFO:tasks.workunit.client.1.smithi203.stdout:5/817: mknod dc/dd/d1e/dc6/de3/c110 0 2024-09-11T00:07:30.792 INFO:tasks.workunit.client.0.smithi111.stdout:6/786: dwrite d7/f11 [8388608,4194304] 0 2024-09-11T00:07:30.798 INFO:tasks.workunit.client.0.smithi111.stdout:7/841: getdents dd/d1d/d2d/d2e 0 2024-09-11T00:07:30.799 INFO:tasks.workunit.client.0.smithi111.stdout:5/848: read d10/d1e/d23/d30/dd8/da2/d66/d76/fae [8714817,6259] 0 2024-09-11T00:07:30.805 INFO:tasks.workunit.client.0.smithi111.stdout:7/842: creat dd/d1d/d1f/d24/f111 x:0 0 0 2024-09-11T00:07:30.806 INFO:tasks.workunit.client.0.smithi111.stdout:5/849: fdatasync d10/d1e/f28 0 2024-09-11T00:07:30.809 INFO:tasks.workunit.client.1.smithi203.stdout:4/679: dwrite db/dd/d16/f6e [0,4194304] 0 2024-09-11T00:07:30.811 INFO:tasks.workunit.client.1.smithi203.stdout:4/680: readlink db/l27 0 2024-09-11T00:07:30.811 INFO:tasks.workunit.client.0.smithi111.stdout:7/843: read dd/d1d/d7e/df8/d8f/dac/fff [2385618,6181] 0 2024-09-11T00:07:30.815 INFO:tasks.workunit.client.0.smithi111.stdout:2/747: rename d0/d3/fb1 to d0/d3/de/d68/ffe 0 2024-09-11T00:07:30.818 INFO:tasks.workunit.client.0.smithi111.stdout:2/748: chown d0/d3/de/db4/cc6 4954 1 2024-09-11T00:07:30.820 INFO:tasks.workunit.client.0.smithi111.stdout:7/844: mkdir dd/d1d/d7e/df8/d8f/dac/d112 0 2024-09-11T00:07:30.821 INFO:tasks.workunit.client.0.smithi111.stdout:9/831: mknod d6/db/c10b 0 2024-09-11T00:07:30.824 INFO:tasks.workunit.client.0.smithi111.stdout:1/789: rename d2/de/d93/fea to d2/de/d12/d88/f107 0 2024-09-11T00:07:30.829 INFO:tasks.workunit.client.0.smithi111.stdout:7/845: mknod dd/d1d/d76/c113 0 2024-09-11T00:07:30.831 INFO:tasks.workunit.client.1.smithi203.stdout:4/681: dwrite db/d12/d15/d2a/d88/fc1 [0,4194304] 0 2024-09-11T00:07:30.831 INFO:tasks.workunit.client.0.smithi111.stdout:0/832: creat d3/d26/f125 x:0 0 0 2024-09-11T00:07:30.832 INFO:tasks.workunit.client.0.smithi111.stdout:9/832: mknod d6/d52/d8a/c10c 0 2024-09-11T00:07:30.833 INFO:tasks.workunit.client.0.smithi111.stdout:0/833: write d3/d13/d66/ff5 [131981,47431] 0 2024-09-11T00:07:30.841 INFO:tasks.workunit.client.1.smithi203.stdout:8/698: write d1/d13/d3a/f44 [1092290,68571] 0 2024-09-11T00:07:30.848 INFO:tasks.workunit.client.0.smithi111.stdout:4/776: rename d18/d3b/d9f/db7/de5/ceb to d18/d20/d3c/d5e/cf4 0 2024-09-11T00:07:30.849 INFO:tasks.workunit.client.0.smithi111.stdout:8/815: dwrite d11/d23/d2c/d46/d64/fdc [0,4194304] 0 2024-09-11T00:07:30.851 INFO:tasks.workunit.client.0.smithi111.stdout:4/777: chown d18/d20/d3c/d5e/daa/dbb 1020 1 2024-09-11T00:07:30.852 INFO:tasks.workunit.client.0.smithi111.stdout:2/749: dread d0/d3/de/d50/fa0 [0,4194304] 0 2024-09-11T00:07:30.855 INFO:tasks.workunit.client.1.smithi203.stdout:4/682: dwrite db/f10 [0,4194304] 0 2024-09-11T00:07:30.858 INFO:tasks.workunit.client.0.smithi111.stdout:3/831: dwrite f17 [0,4194304] 0 2024-09-11T00:07:30.858 INFO:tasks.workunit.client.0.smithi111.stdout:0/834: creat d3/d1c/d50/dec/d118/f126 x:0 0 0 2024-09-11T00:07:30.860 INFO:tasks.workunit.client.0.smithi111.stdout:0/835: readlink d3/da/d7b/db3/l11f 0 2024-09-11T00:07:30.860 INFO:tasks.workunit.client.1.smithi203.stdout:3/796: creat d8/d2a/f119 x:0 0 0 2024-09-11T00:07:30.863 INFO:tasks.workunit.client.0.smithi111.stdout:3/832: truncate d1c/d1d/d22/d23/d2f/de8/d5f/d98/ffb 518341 0 2024-09-11T00:07:30.864 INFO:tasks.workunit.client.1.smithi203.stdout:4/683: creat db/dd/d26/d42/fd8 x:0 0 0 2024-09-11T00:07:30.865 INFO:tasks.workunit.client.1.smithi203.stdout:0/720: rmdir d0/d2/d67 39 2024-09-11T00:07:30.866 INFO:tasks.workunit.client.0.smithi111.stdout:3/833: readlink d1c/d1d/d22/d31/d62/l8d 0 2024-09-11T00:07:30.869 INFO:tasks.workunit.client.0.smithi111.stdout:9/833: rename d6/db/d34/d37/d4c/d7f/d97/de8/cf1 to d6/dc/dc1/c10d 0 2024-09-11T00:07:30.873 INFO:tasks.workunit.client.1.smithi203.stdout:2/830: creat d13/d15/d19/f114 x:0 0 0 2024-09-11T00:07:30.878 INFO:tasks.workunit.client.1.smithi203.stdout:7/758: dwrite dd/d1c/f35 [0,4194304] 0 2024-09-11T00:07:30.881 INFO:tasks.workunit.client.1.smithi203.stdout:2/831: dread - d13/d15/d19/d1c/f3c zero size 2024-09-11T00:07:30.881 INFO:tasks.workunit.client.1.smithi203.stdout:8/699: creat d1/fe9 x:0 0 0 2024-09-11T00:07:30.888 INFO:tasks.workunit.client.1.smithi203.stdout:4/684: read db/f23 [81975,42426] 0 2024-09-11T00:07:30.891 INFO:tasks.workunit.client.0.smithi111.stdout:2/750: mkdir d0/d3/d98/dff 0 2024-09-11T00:07:30.894 INFO:tasks.workunit.client.1.smithi203.stdout:3/797: dread d8/da/d5c/f8d [0,4194304] 0 2024-09-11T00:07:30.895 INFO:tasks.workunit.client.0.smithi111.stdout:1/790: link d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/d7b/ld2 d2/de/d12/d6c/df5/l108 0 2024-09-11T00:07:30.899 INFO:tasks.workunit.client.0.smithi111.stdout:1/791: dread - d2/de/d12/d88/f107 zero size 2024-09-11T00:07:30.900 INFO:tasks.workunit.client.0.smithi111.stdout:0/836: fdatasync d3/d13/f6f 0 2024-09-11T00:07:30.902 INFO:tasks.workunit.client.1.smithi203.stdout:0/721: fsync d0/d2/d37/fac 0 2024-09-11T00:07:30.902 INFO:tasks.workunit.client.1.smithi203.stdout:2/832: mkdir d13/d15/dff/d115 0 2024-09-11T00:07:30.903 INFO:tasks.workunit.client.1.smithi203.stdout:7/759: symlink dd/d1c/d52/d8f/d31/d58/d93/d98/l114 0 2024-09-11T00:07:30.907 INFO:tasks.workunit.client.0.smithi111.stdout:3/834: truncate d1c/d21/f6c 1012165 0 2024-09-11T00:07:30.911 INFO:tasks.workunit.client.0.smithi111.stdout:9/834: symlink d6/db/d34/d37/l10e 0 2024-09-11T00:07:30.915 INFO:tasks.workunit.client.0.smithi111.stdout:7/846: sync 2024-09-11T00:07:30.915 INFO:tasks.workunit.client.0.smithi111.stdout:4/778: symlink d18/lf5 0 2024-09-11T00:07:30.917 INFO:tasks.workunit.client.1.smithi203.stdout:3/798: stat d8/da/d37/d83/d6a/cc8 0 2024-09-11T00:07:30.921 INFO:tasks.workunit.client.1.smithi203.stdout:6/735: rmdir d0/d54/d9c/d35/d38/dc0 39 2024-09-11T00:07:30.925 INFO:tasks.workunit.client.1.smithi203.stdout:6/736: read d0/d5b/d5c/fac [789338,129581] 0 2024-09-11T00:07:30.925 INFO:tasks.workunit.client.1.smithi203.stdout:2/833: mknod d13/d22/d53/c116 0 2024-09-11T00:07:30.929 INFO:tasks.workunit.client.0.smithi111.stdout:7/847: dwrite dd/d1d/d7e/df8/d8f/d9f/fc7 [0,4194304] 0 2024-09-11T00:07:30.930 INFO:tasks.workunit.client.1.smithi203.stdout:8/700: dwrite d1/d13/d17/d2f/d52/d49/f93 [0,4194304] 0 2024-09-11T00:07:30.931 INFO:tasks.workunit.client.1.smithi203.stdout:0/722: mknod d0/d2/d3d/cf4 0 2024-09-11T00:07:30.931 INFO:tasks.workunit.client.0.smithi111.stdout:7/848: chown dd/d1d/d2d/fcd 2025709247 1 2024-09-11T00:07:30.935 INFO:tasks.workunit.client.1.smithi203.stdout:1/874: mknod d8/d28/d64/c13c 0 2024-09-11T00:07:30.937 INFO:tasks.workunit.client.0.smithi111.stdout:3/835: creat d1c/d1d/d22/d23/d2f/d63/f121 x:0 0 0 2024-09-11T00:07:30.939 INFO:tasks.workunit.client.0.smithi111.stdout:3/836: chown d1c/d1d/d22/d31 30503 1 2024-09-11T00:07:30.941 INFO:tasks.workunit.client.0.smithi111.stdout:3/837: chown d1c/d1d/d22/d23/d2f/f8e 250287 1 2024-09-11T00:07:30.942 INFO:tasks.workunit.client.0.smithi111.stdout:9/835: unlink d6/db/db8/dce/ff7 0 2024-09-11T00:07:30.944 INFO:tasks.workunit.client.0.smithi111.stdout:9/836: write d6/db/d34/fde [5142202,13084] 0 2024-09-11T00:07:30.947 INFO:tasks.workunit.client.1.smithi203.stdout:3/799: rename d8/d17/l30 to d8/da/d37/d83/dc0/l11a 0 2024-09-11T00:07:30.951 INFO:tasks.workunit.client.1.smithi203.stdout:3/800: read d8/da/d37/d83/d6a/f72 [261006,57487] 0 2024-09-11T00:07:30.955 INFO:tasks.workunit.client.1.smithi203.stdout:3/801: write d8/da/f2f [3617936,23915] 0 2024-09-11T00:07:30.960 INFO:tasks.workunit.client.1.smithi203.stdout:2/834: symlink d13/d15/d19/d1c/d76/d94/d97/l117 0 2024-09-11T00:07:30.962 INFO:tasks.workunit.client.1.smithi203.stdout:2/835: dread - d13/d56/d69/f112 zero size 2024-09-11T00:07:30.962 INFO:tasks.workunit.client.0.smithi111.stdout:2/751: creat d0/d3/d98/dff/f100 x:0 0 0 2024-09-11T00:07:30.965 INFO:tasks.workunit.client.1.smithi203.stdout:2/836: read d13/d15/d30/d5a/d8b/fb5 [2536523,40226] 0 2024-09-11T00:07:30.969 INFO:tasks.workunit.client.1.smithi203.stdout:2/837: read d13/d22/f38 [1381598,88217] 0 2024-09-11T00:07:30.970 INFO:tasks.workunit.client.1.smithi203.stdout:7/760: unlink dd/d1c/d52/d8f/d31/f39 0 2024-09-11T00:07:30.979 INFO:tasks.workunit.client.0.smithi111.stdout:1/792: rename d2/de/d12/l22 to d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/l109 0 2024-09-11T00:07:30.980 INFO:tasks.workunit.client.1.smithi203.stdout:4/685: link db/d12/d15/d2a/lce db/d12/d15/d2a/d88/d95/ld9 0 2024-09-11T00:07:30.985 INFO:tasks.workunit.client.1.smithi203.stdout:8/701: rename d1/d13/d3a/d4c to d1/d13/d17/d77/dea 0 2024-09-11T00:07:30.992 INFO:tasks.workunit.client.1.smithi203.stdout:8/702: dread d1/d13/d17/d77/f79 [0,4194304] 0 2024-09-11T00:07:30.995 INFO:tasks.workunit.client.0.smithi111.stdout:9/837: dread - d6/dc/f87 zero size 2024-09-11T00:07:30.996 INFO:tasks.workunit.client.1.smithi203.stdout:9/763: truncate d6/de/d19/d21/d87/fbb 2038358 0 2024-09-11T00:07:30.996 INFO:tasks.workunit.client.0.smithi111.stdout:9/838: chown d6/db/d34/d37/d4c/d7f/d97/de8 265 1 2024-09-11T00:07:30.997 INFO:tasks.workunit.client.0.smithi111.stdout:4/779: mkdir d18/d20/d4a/d6b/ded/df6 0 2024-09-11T00:07:31.000 INFO:tasks.workunit.client.0.smithi111.stdout:2/752: unlink d0/d3/de/d3b/d62/d6d/da1/cf7 0 2024-09-11T00:07:31.002 INFO:tasks.workunit.client.1.smithi203.stdout:5/818: write f8 [1448773,89701] 0 2024-09-11T00:07:31.004 INFO:tasks.workunit.client.1.smithi203.stdout:5/819: read - dc/dd/d56/dad/f97 zero size 2024-09-11T00:07:31.008 INFO:tasks.workunit.client.0.smithi111.stdout:3/838: creat d1c/d1d/d22/d23/dff/f122 x:0 0 0 2024-09-11T00:07:31.008 INFO:tasks.workunit.client.0.smithi111.stdout:6/787: write d7/d22/d26/f10a [1936487,119738] 0 2024-09-11T00:07:31.010 INFO:tasks.workunit.client.0.smithi111.stdout:9/839: dwrite d6/db/d1b/d74/f98 [0,4194304] 0 2024-09-11T00:07:31.012 INFO:tasks.workunit.client.0.smithi111.stdout:6/788: write d7/d22/d1d/d69/ff1 [96938,113644] 0 2024-09-11T00:07:31.012 INFO:tasks.workunit.client.1.smithi203.stdout:4/686: unlink db/d12/d15/d2a/d88/fbf 0 2024-09-11T00:07:31.015 INFO:tasks.workunit.client.1.smithi203.stdout:3/802: rename d8/d17/c28 to d8/da/d37/d53/da2/c11b 0 2024-09-11T00:07:31.015 INFO:tasks.workunit.client.1.smithi203.stdout:4/687: write db/d12/f1e [4690008,101189] 0 2024-09-11T00:07:31.017 INFO:tasks.workunit.client.1.smithi203.stdout:3/803: dread - d8/da/d37/d53/f108 zero size 2024-09-11T00:07:31.022 INFO:tasks.workunit.client.0.smithi111.stdout:5/850: truncate d10/d1e/d25/f93 4192000 0 2024-09-11T00:07:31.030 INFO:tasks.workunit.client.0.smithi111.stdout:4/780: symlink d18/d20/d40/def/lf7 0 2024-09-11T00:07:31.033 INFO:tasks.workunit.client.0.smithi111.stdout:3/839: mkdir d1c/d1d/d22/d23/d2f/de5/d123 0 2024-09-11T00:07:31.036 INFO:tasks.workunit.client.0.smithi111.stdout:6/789: mkdir d7/d22/d1d/d69/d10e 0 2024-09-11T00:07:31.039 INFO:tasks.workunit.client.1.smithi203.stdout:7/761: unlink dd/d1c/d52/d8f/d31/f9a 0 2024-09-11T00:07:31.041 INFO:tasks.workunit.client.0.smithi111.stdout:9/840: link d6/dc/dc1/fe4 d6/db/d34/d37/d4c/d99/f10f 0 2024-09-11T00:07:31.042 INFO:tasks.workunit.client.1.smithi203.stdout:7/762: write dd/d1c/d52/d8f/fe3 [1708976,14161] 0 2024-09-11T00:07:31.045 INFO:tasks.workunit.client.0.smithi111.stdout:4/781: creat d18/d20/d3c/d5e/d75/d8d/dce/ff8 x:0 0 0 2024-09-11T00:07:31.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:30 smithi203 ceph-mon[33225]: pgmap v13: 65 pgs: 65 active+clean; 3.0 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 65 MiB/s rd, 172 MiB/s wr, 365 op/s 2024-09-11T00:07:31.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:30 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:31.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:30 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:31.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:30 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:31.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:30 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:31.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:30 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:07:31.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:30 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:07:31.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:30 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:07:31.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:30 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:07:31.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:30 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:07:31.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:30 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:07:31.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:30 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:31.047 INFO:tasks.workunit.client.0.smithi111.stdout:3/840: unlink d1c/d1d/d22/d23/d2f/de8/f36 0 2024-09-11T00:07:31.051 INFO:tasks.workunit.client.0.smithi111.stdout:6/790: unlink d7/d22/d26/d95/fdc 0 2024-09-11T00:07:31.051 INFO:tasks.workunit.client.0.smithi111.stdout:8/816: write d11/d23/d2c/d53/fe5 [5046789,122299] 0 2024-09-11T00:07:31.052 INFO:tasks.workunit.client.0.smithi111.stdout:6/791: chown f6 457541 1 2024-09-11T00:07:31.052 INFO:tasks.workunit.client.1.smithi203.stdout:9/764: dread d6/de/d19/f4c [0,4194304] 0 2024-09-11T00:07:31.053 INFO:tasks.workunit.client.0.smithi111.stdout:9/841: stat d6/dc/dc1/c10d 0 2024-09-11T00:07:31.055 INFO:tasks.workunit.client.0.smithi111.stdout:9/842: chown d6/db/d1b/d41/f42 1975732 1 2024-09-11T00:07:31.056 INFO:tasks.workunit.client.0.smithi111.stdout:4/782: dread - d18/d3b/d51/f67 zero size 2024-09-11T00:07:31.063 INFO:tasks.workunit.client.0.smithi111.stdout:6/792: symlink d7/d22/d26/d87/d7a/dc5/l10f 0 2024-09-11T00:07:31.064 INFO:tasks.workunit.client.0.smithi111.stdout:6/793: stat d7/d22/d2c/cee 0 2024-09-11T00:07:31.069 INFO:tasks.workunit.client.1.smithi203.stdout:4/688: symlink db/d12/d15/d2a/d88/d95/dc2/lda 0 2024-09-11T00:07:31.069 INFO:tasks.workunit.client.0.smithi111.stdout:8/817: dread f7 [0,4194304] 0 2024-09-11T00:07:31.071 INFO:tasks.workunit.client.0.smithi111.stdout:8/818: readlink d11/d23/d7e/ldd 0 2024-09-11T00:07:31.072 INFO:tasks.workunit.client.1.smithi203.stdout:3/804: symlink d8/da/d37/d83/d6a/l11c 0 2024-09-11T00:07:31.073 INFO:tasks.workunit.client.0.smithi111.stdout:2/753: sync 2024-09-11T00:07:31.073 INFO:tasks.workunit.client.0.smithi111.stdout:0/837: dwrite d3/d13/d1e/deb/f59 [0,4194304] 0 2024-09-11T00:07:31.074 INFO:tasks.workunit.client.0.smithi111.stdout:8/819: write d11/d23/d2c/d53/dfc/fd6 [265961,98347] 0 2024-09-11T00:07:31.076 INFO:tasks.workunit.client.1.smithi203.stdout:8/703: creat d1/d13/feb x:0 0 0 2024-09-11T00:07:31.078 INFO:tasks.workunit.client.0.smithi111.stdout:0/838: dread d3/d13/f10f [0,4194304] 0 2024-09-11T00:07:31.080 INFO:tasks.workunit.client.1.smithi203.stdout:9/765: truncate d6/de/d19/d24/f57 13197 0 2024-09-11T00:07:31.084 INFO:tasks.workunit.client.1.smithi203.stdout:0/723: write d0/d2/d37/d5b/d73/fa7 [372922,17887] 0 2024-09-11T00:07:31.087 INFO:tasks.workunit.client.0.smithi111.stdout:0/839: truncate d3/d13/d1e/d29/d49/f120 291825 0 2024-09-11T00:07:31.089 INFO:tasks.workunit.client.0.smithi111.stdout:4/783: mkdir d18/d20/d4a/df9 0 2024-09-11T00:07:31.091 INFO:tasks.workunit.client.1.smithi203.stdout:0/724: chown d0/d2/d37/d5b/d73/l7d 305 1 2024-09-11T00:07:31.092 INFO:tasks.workunit.client.0.smithi111.stdout:2/754: dwrite d0/d3/d2e/f47 [0,4194304] 0 2024-09-11T00:07:31.093 INFO:tasks.workunit.client.1.smithi203.stdout:7/763: mkdir dd/d1c/d52/d8f/d31/d4a/d105/d115 0 2024-09-11T00:07:31.095 INFO:tasks.workunit.client.0.smithi111.stdout:7/849: dwrite dd/d1d/d7e/df8/d8f/fc2 [0,4194304] 0 2024-09-11T00:07:31.096 INFO:tasks.workunit.client.1.smithi203.stdout:6/737: dwrite d0/d5b/d5c/f90 [0,4194304] 0 2024-09-11T00:07:31.107 INFO:tasks.workunit.client.0.smithi111.stdout:5/851: sync 2024-09-11T00:07:31.107 INFO:tasks.workunit.client.1.smithi203.stdout:3/805: symlink d8/da/d37/d83/d65/d8b/l11d 0 2024-09-11T00:07:31.113 INFO:tasks.workunit.client.1.smithi203.stdout:1/875: write d8/d9/d15/d35/d81/db9/fca [5127337,60052] 0 2024-09-11T00:07:31.117 INFO:tasks.workunit.client.1.smithi203.stdout:1/876: stat d8/d9/d15/d35/d81/db9/dce 0 2024-09-11T00:07:31.120 INFO:tasks.workunit.client.0.smithi111.stdout:8/820: symlink d11/d23/d2c/d53/dfc/l104 0 2024-09-11T00:07:31.121 INFO:tasks.workunit.client.1.smithi203.stdout:5/820: link dc/dd/d1e/f54 dc/d4f/d5c/d76/f111 0 2024-09-11T00:07:31.124 INFO:tasks.workunit.client.1.smithi203.stdout:0/725: truncate d0/d1d/d5d/f82 912741 0 2024-09-11T00:07:31.128 INFO:tasks.workunit.client.1.smithi203.stdout:6/738: symlink d0/d54/d9c/d35/d39/d3c/led 0 2024-09-11T00:07:31.132 INFO:tasks.workunit.client.1.smithi203.stdout:2/838: write d13/d15/d19/f6c [32174,84781] 0 2024-09-11T00:07:31.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:30 smithi111 ceph-mon[27539]: pgmap v13: 65 pgs: 65 active+clean; 3.0 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 65 MiB/s rd, 172 MiB/s wr, 365 op/s 2024-09-11T00:07:31.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:30 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:31.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:30 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:31.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:30 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:31.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:30 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:31.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:30 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:07:31.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:30 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:07:31.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:30 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:07:31.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:30 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:07:31.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:30 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:07:31.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:30 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:07:31.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:30 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:31.158 INFO:tasks.workunit.client.1.smithi203.stdout:1/877: symlink d8/l13d 0 2024-09-11T00:07:31.159 INFO:tasks.workunit.client.0.smithi111.stdout:3/841: truncate d1c/d1d/d22/d31/fc8 3925055 0 2024-09-11T00:07:31.164 INFO:tasks.workunit.client.1.smithi203.stdout:2/839: dread d13/d15/d30/fa9 [0,4194304] 0 2024-09-11T00:07:31.169 INFO:tasks.workunit.client.1.smithi203.stdout:0/726: rename d0/d2/d3d to d0/d2/d7e/da1/df5 0 2024-09-11T00:07:31.172 INFO:tasks.workunit.client.1.smithi203.stdout:1/878: mknod d8/d19/d60/d90/d3e/d9b/c13e 0 2024-09-11T00:07:31.176 INFO:tasks.workunit.client.1.smithi203.stdout:9/766: write d6/de/dc4/f77 [3335057,105380] 0 2024-09-11T00:07:31.185 INFO:tasks.workunit.client.1.smithi203.stdout:0/727: dread d0/d2/f8a [0,4194304] 0 2024-09-11T00:07:31.192 INFO:tasks.workunit.client.1.smithi203.stdout:3/806: write d8/da/d37/d53/da2/de1/ff3 [493023,58085] 0 2024-09-11T00:07:31.194 INFO:tasks.workunit.client.1.smithi203.stdout:3/807: stat d8/d2a/l48 0 2024-09-11T00:07:31.197 INFO:tasks.workunit.client.1.smithi203.stdout:6/739: write d0/d54/d9c/f98 [3808198,75503] 0 2024-09-11T00:07:31.200 INFO:tasks.workunit.client.1.smithi203.stdout:7/764: write dd/d1c/d52/d8f/d31/f49 [924602,20984] 0 2024-09-11T00:07:31.207 INFO:tasks.workunit.client.1.smithi203.stdout:3/808: truncate d8/da/d37/f82 1691831 0 2024-09-11T00:07:31.207 INFO:tasks.workunit.client.0.smithi111.stdout:5/852: sync 2024-09-11T00:07:31.209 INFO:tasks.workunit.client.1.smithi203.stdout:3/809: write d8/da/d11/fb6 [1561192,53279] 0 2024-09-11T00:07:31.214 INFO:tasks.workunit.client.1.smithi203.stdout:2/840: write d13/d15/d30/d59/f6a [1350492,75986] 0 2024-09-11T00:07:31.219 INFO:tasks.workunit.client.1.smithi203.stdout:4/689: write db/dd/d16/d38/d3c/d41/f8e [2607554,123733] 0 2024-09-11T00:07:31.220 INFO:tasks.workunit.client.1.smithi203.stdout:7/765: rename dd/d1c/d52/d8f/l48 to dd/d1c/d52/d8f/d31/d58/d93/d98/l116 0 2024-09-11T00:07:31.220 INFO:tasks.workunit.client.1.smithi203.stdout:6/740: dread d0/d54/d9c/d35/d38/d73/d74/f80 [0,4194304] 0 2024-09-11T00:07:31.225 INFO:tasks.workunit.client.1.smithi203.stdout:4/690: dread - db/dd/d26/d42/fd8 zero size 2024-09-11T00:07:31.226 INFO:tasks.workunit.client.1.smithi203.stdout:3/810: mkdir d8/da/d37/d11e 0 2024-09-11T00:07:31.232 INFO:tasks.workunit.client.0.smithi111.stdout:6/794: mkdir d7/d22/d2c/dff/d110 0 2024-09-11T00:07:31.232 INFO:tasks.workunit.client.0.smithi111.stdout:0/840: rmdir d3/d1c/dd0 39 2024-09-11T00:07:31.234 INFO:tasks.workunit.client.1.smithi203.stdout:0/728: link d0/d2/d67/c74 d0/d1d/d5d/dba/cf6 0 2024-09-11T00:07:31.234 INFO:tasks.workunit.client.1.smithi203.stdout:9/767: dwrite d6/de/fbd [0,4194304] 0 2024-09-11T00:07:31.234 INFO:tasks.workunit.client.1.smithi203.stdout:6/741: creat d0/d54/fee x:0 0 0 2024-09-11T00:07:31.238 INFO:tasks.workunit.client.0.smithi111.stdout:1/793: dread - d2/de/d12/d88/f107 zero size 2024-09-11T00:07:31.239 INFO:tasks.workunit.client.1.smithi203.stdout:7/766: read dd/d1c/d52/d8f/d31/d4a/d105/f4c [868660,93664] 0 2024-09-11T00:07:31.243 INFO:tasks.workunit.client.0.smithi111.stdout:2/755: mknod d0/d3/d12/d38/c101 0 2024-09-11T00:07:31.243 INFO:tasks.workunit.client.0.smithi111.stdout:7/850: mknod dd/d1d/d4d/c114 0 2024-09-11T00:07:31.245 INFO:tasks.workunit.client.1.smithi203.stdout:1/879: dwrite d8/d19/d60/d90/d3e/d4b/d80/d8d/db0/fb7 [4194304,4194304] 0 2024-09-11T00:07:31.245 INFO:tasks.workunit.client.0.smithi111.stdout:2/756: chown d0/d3/c32 10504093 1 2024-09-11T00:07:31.248 INFO:tasks.workunit.client.1.smithi203.stdout:4/691: symlink db/d12/d15/ldb 0 2024-09-11T00:07:31.252 INFO:tasks.workunit.client.0.smithi111.stdout:3/842: mknod d1c/d1d/d22/dfd/c124 0 2024-09-11T00:07:31.253 INFO:tasks.workunit.client.1.smithi203.stdout:6/742: mkdir d0/d71/def 0 2024-09-11T00:07:31.254 INFO:tasks.workunit.client.1.smithi203.stdout:9/768: mkdir d6/de/df9 0 2024-09-11T00:07:31.264 INFO:tasks.workunit.client.0.smithi111.stdout:9/843: getdents d6/db/d34/d37 0 2024-09-11T00:07:31.266 INFO:tasks.workunit.client.1.smithi203.stdout:1/880: symlink d8/d19/d60/d90/d3e/d4b/d80/d8d/l13f 0 2024-09-11T00:07:31.268 INFO:tasks.workunit.client.0.smithi111.stdout:0/841: fsync d3/daf/db2/ff4 0 2024-09-11T00:07:31.268 INFO:tasks.workunit.client.1.smithi203.stdout:0/729: dwrite d0/d2/d7e/da1/dc9/de7/f6e [0,4194304] 0 2024-09-11T00:07:31.272 INFO:tasks.workunit.client.1.smithi203.stdout:4/692: unlink db/d12/d15/d2a/d88/d95/la1 0 2024-09-11T00:07:31.276 INFO:tasks.workunit.client.1.smithi203.stdout:2/841: getdents d13/d15/d30 0 2024-09-11T00:07:31.277 INFO:tasks.workunit.client.0.smithi111.stdout:1/794: creat d2/d2b/f10a x:0 0 0 2024-09-11T00:07:31.283 INFO:tasks.workunit.client.0.smithi111.stdout:7/851: mkdir dd/d1d/d4d/d115 0 2024-09-11T00:07:31.285 INFO:tasks.workunit.client.1.smithi203.stdout:6/743: creat d0/d5b/d9f/ff0 x:0 0 0 2024-09-11T00:07:31.288 INFO:tasks.workunit.client.0.smithi111.stdout:2/757: truncate d0/d3/de/d3b/f49 1266042 0 2024-09-11T00:07:31.290 INFO:tasks.workunit.client.0.smithi111.stdout:2/758: chown d0/d3/de/d3b/d62/d6d 50 1 2024-09-11T00:07:31.290 INFO:tasks.workunit.client.0.smithi111.stdout:3/843: symlink d1c/d1d/d22/d44/d5a/dcd/dd2/def/df5/l125 0 2024-09-11T00:07:31.291 INFO:tasks.workunit.client.1.smithi203.stdout:0/730: fsync d0/f19 0 2024-09-11T00:07:31.293 INFO:tasks.workunit.client.0.smithi111.stdout:5/853: mkdir d10/d108/d116 0 2024-09-11T00:07:31.294 INFO:tasks.workunit.client.0.smithi111.stdout:3/844: fdatasync d1c/d1d/d22/d44/d5a/f69 0 2024-09-11T00:07:31.294 INFO:tasks.workunit.client.0.smithi111.stdout:4/784: dwrite d18/f71 [0,4194304] 0 2024-09-11T00:07:31.296 INFO:tasks.workunit.client.1.smithi203.stdout:4/693: rmdir db/dd 39 2024-09-11T00:07:31.296 INFO:tasks.workunit.client.0.smithi111.stdout:4/785: chown d18/d1f/d33 0 1 2024-09-11T00:07:31.298 INFO:tasks.workunit.client.0.smithi111.stdout:6/795: mkdir d7/d22/d3f/d74/d7f/d79/d111 0 2024-09-11T00:07:31.300 INFO:tasks.workunit.client.0.smithi111.stdout:7/852: dwrite dd/d1d/d1f/d24/f10b [0,4194304] 0 2024-09-11T00:07:31.301 INFO:tasks.workunit.client.1.smithi203.stdout:3/811: getdents d8/da/d37/d53 0 2024-09-11T00:07:31.302 INFO:tasks.workunit.client.0.smithi111.stdout:1/795: truncate d2/de/f25 2499512 0 2024-09-11T00:07:31.302 INFO:tasks.workunit.client.1.smithi203.stdout:7/767: write dd/d1c/d52/d8f/d31/d67/dc3/fd1 [107662,91030] 0 2024-09-11T00:07:31.317 INFO:tasks.workunit.client.1.smithi203.stdout:1/881: write d8/d19/d60/d90/d3e/d4b/d80/da2/fed [99146,115134] 0 2024-09-11T00:07:31.318 INFO:tasks.workunit.client.0.smithi111.stdout:8/821: dwrite d11/d23/f4e [0,4194304] 0 2024-09-11T00:07:31.322 INFO:tasks.workunit.client.1.smithi203.stdout:2/842: creat d13/d15/d19/d1c/d76/d94/d97/df8/f118 x:0 0 0 2024-09-11T00:07:31.324 INFO:tasks.workunit.client.1.smithi203.stdout:1/882: truncate d8/d9/d15/d35/d81/f9e 1725536 0 2024-09-11T00:07:31.325 INFO:tasks.workunit.client.1.smithi203.stdout:7/768: mknod dd/d3b/d5b/c117 0 2024-09-11T00:07:31.331 INFO:tasks.workunit.client.1.smithi203.stdout:7/769: chown dd/d1c/d52/d8f/d31/d67/dc3/ddb 239419 1 2024-09-11T00:07:31.333 INFO:tasks.workunit.client.1.smithi203.stdout:9/769: rename d6/de/d19/d24/d40/d45/fc7 to d6/de/d47/ffa 0 2024-09-11T00:07:31.337 INFO:tasks.workunit.client.1.smithi203.stdout:9/770: chown d6/de/d32/d9e 7383 1 2024-09-11T00:07:31.338 INFO:tasks.workunit.client.1.smithi203.stdout:4/694: creat db/dd/d16/d38/d3c/fdc x:0 0 0 2024-09-11T00:07:31.339 INFO:tasks.workunit.client.0.smithi111.stdout:8/822: dwrite d11/d21/d38/f9e [0,4194304] 0 2024-09-11T00:07:31.340 INFO:tasks.workunit.client.1.smithi203.stdout:4/695: chown db/d12 7969 1 2024-09-11T00:07:31.342 INFO:tasks.workunit.client.0.smithi111.stdout:2/759: mknod d0/d3/de/dd4/c102 0 2024-09-11T00:07:31.343 INFO:tasks.workunit.client.0.smithi111.stdout:8/823: fdatasync d11/d23/d2c/d53/f83 0 2024-09-11T00:07:31.343 INFO:tasks.workunit.client.0.smithi111.stdout:0/842: sync 2024-09-11T00:07:31.348 INFO:tasks.workunit.client.0.smithi111.stdout:9/844: truncate d6/db/db8/dce/dcf/fbd 2691863 0 2024-09-11T00:07:31.348 INFO:tasks.workunit.client.0.smithi111.stdout:9/845: chown d6/d52/l7b 388164248 1 2024-09-11T00:07:31.348 INFO:tasks.workunit.client.0.smithi111.stdout:8/824: chown d11/d23/d7e/d93/fcd 1492495 1 2024-09-11T00:07:31.348 INFO:tasks.workunit.client.0.smithi111.stdout:2/760: truncate d0/d3/de/d50/d9d/fe5 183537 0 2024-09-11T00:07:31.352 INFO:tasks.workunit.client.1.smithi203.stdout:7/770: unlink dd/d1c/d52/d8f/d31/d67/dc3/ddb/fec 0 2024-09-11T00:07:31.354 INFO:tasks.workunit.client.0.smithi111.stdout:3/845: mkdir d1c/d126 0 2024-09-11T00:07:31.357 INFO:tasks.workunit.client.1.smithi203.stdout:3/812: dread d8/da/d37/d83/d6a/f87 [0,4194304] 0 2024-09-11T00:07:31.359 INFO:tasks.workunit.client.0.smithi111.stdout:0/843: dread d3/d1c/f4a [0,4194304] 0 2024-09-11T00:07:31.361 INFO:tasks.workunit.client.1.smithi203.stdout:4/696: fdatasync db/f73 0 2024-09-11T00:07:31.364 INFO:tasks.workunit.client.1.smithi203.stdout:0/731: write d0/d1d/d5d/f82 [257159,14987] 0 2024-09-11T00:07:31.367 INFO:tasks.workunit.client.0.smithi111.stdout:1/796: creat d2/de/d12/d3c/d4b/d6a/d63/d73/da1/f10b x:0 0 0 2024-09-11T00:07:31.368 INFO:tasks.workunit.client.0.smithi111.stdout:4/786: dwrite d18/d20/d40/d78/d79/fac [0,4194304] 0 2024-09-11T00:07:31.369 INFO:tasks.workunit.client.0.smithi111.stdout:1/797: chown d2/de/d93 210803 1 2024-09-11T00:07:31.370 INFO:tasks.workunit.client.1.smithi203.stdout:9/771: creat d6/de/d19/d21/dd0/dde/ffb x:0 0 0 2024-09-11T00:07:31.374 INFO:tasks.workunit.client.0.smithi111.stdout:6/796: dwrite d7/f5e [0,4194304] 0 2024-09-11T00:07:31.375 INFO:tasks.workunit.client.0.smithi111.stdout:1/798: chown d2/de/d12/d3c/d4b/d6a/d63/d73/da1/fe8 20986 1 2024-09-11T00:07:31.375 INFO:tasks.workunit.client.0.smithi111.stdout:7/853: dwrite dd/d1d/d7e/df8/d8f/d9f/fc6 [0,4194304] 0 2024-09-11T00:07:31.376 INFO:tasks.workunit.client.0.smithi111.stdout:6/797: chown d7/d2b/dd4/cd5 0 1 2024-09-11T00:07:31.377 INFO:tasks.workunit.client.0.smithi111.stdout:7/854: fdatasync dd/d1d/d2d/d2e/f40 0 2024-09-11T00:07:31.380 INFO:tasks.workunit.client.0.smithi111.stdout:9/846: mkdir d6/d52/d8a/d92/d110 0 2024-09-11T00:07:31.382 INFO:tasks.workunit.client.1.smithi203.stdout:2/843: link d13/d47/c52 d13/ddb/c119 0 2024-09-11T00:07:31.389 INFO:tasks.workunit.client.1.smithi203.stdout:2/844: chown d13/d22/c109 1724 1 2024-09-11T00:07:31.394 INFO:tasks.workunit.client.1.smithi203.stdout:0/732: mkdir d0/d1d/d5d/dec/df7 0 2024-09-11T00:07:31.395 INFO:tasks.workunit.client.0.smithi111.stdout:2/761: mkdir d0/d3/de/d3b/d92/d103 0 2024-09-11T00:07:31.396 INFO:tasks.workunit.client.1.smithi203.stdout:0/733: stat d0/d2/d7e/la4 0 2024-09-11T00:07:31.397 INFO:tasks.workunit.client.0.smithi111.stdout:2/762: dread - d0/d3/de/d3b/d62/feb zero size 2024-09-11T00:07:31.399 INFO:tasks.workunit.client.0.smithi111.stdout:2/763: read d0/d3/f27 [2919560,28492] 0 2024-09-11T00:07:31.399 INFO:tasks.workunit.client.1.smithi203.stdout:1/883: dread d8/d19/d60/d90/d3e/d66/f6e [0,4194304] 0 2024-09-11T00:07:31.400 INFO:tasks.workunit.client.0.smithi111.stdout:2/764: chown d0/d3/d12/f96 483139614 1 2024-09-11T00:07:31.402 INFO:tasks.workunit.client.0.smithi111.stdout:3/846: symlink d1c/d1d/d22/d23/d58/df2/l127 0 2024-09-11T00:07:31.405 INFO:tasks.workunit.client.1.smithi203.stdout:1/884: chown d8/d19/d60/d90/d3e/d4b/d80/da2 262 1 2024-09-11T00:07:31.406 INFO:tasks.workunit.client.0.smithi111.stdout:0/844: rmdir d3/d13/d1e/d29/db0/dce/ddb/de6 39 2024-09-11T00:07:31.412 INFO:tasks.workunit.client.1.smithi203.stdout:2/845: creat d13/d56/d69/dcb/f11a x:0 0 0 2024-09-11T00:07:31.413 INFO:tasks.workunit.client.0.smithi111.stdout:4/787: read - d18/d3b/f8e zero size 2024-09-11T00:07:31.413 INFO:tasks.workunit.client.1.smithi203.stdout:7/771: link dd/d1c/d52/d8f/le7 dd/d1c/d52/d8f/d111/l118 0 2024-09-11T00:07:31.417 INFO:tasks.workunit.client.1.smithi203.stdout:4/697: write db/dd/d26/f76 [1479348,34290] 0 2024-09-11T00:07:31.418 INFO:tasks.workunit.client.0.smithi111.stdout:6/798: dread - d7/d22/d26/fcd zero size 2024-09-11T00:07:31.419 INFO:tasks.workunit.client.1.smithi203.stdout:1/885: creat d8/d9/d15/d27/f140 x:0 0 0 2024-09-11T00:07:31.419 INFO:tasks.workunit.client.0.smithi111.stdout:6/799: fsync d7/d22/d2c/d38/f71 0 2024-09-11T00:07:31.421 INFO:tasks.workunit.client.0.smithi111.stdout:7/855: mknod dd/d1d/d7e/df8/d8f/d9f/c116 0 2024-09-11T00:07:31.422 INFO:tasks.workunit.client.0.smithi111.stdout:7/856: dread - dd/d48/ff4 zero size 2024-09-11T00:07:31.423 INFO:tasks.workunit.client.0.smithi111.stdout:9/847: creat d6/dc/d73/f111 x:0 0 0 2024-09-11T00:07:31.426 INFO:tasks.workunit.client.0.smithi111.stdout:5/854: getdents d10/d1e/d23/d30/d59/d52/d85/dd2/df1 0 2024-09-11T00:07:31.434 INFO:tasks.workunit.client.1.smithi203.stdout:3/813: dwrite d8/da/d37/d83/da3/fca [0,4194304] 0 2024-09-11T00:07:31.437 INFO:tasks.workunit.client.0.smithi111.stdout:8/825: dwrite d11/d21/d38/f5e [4194304,4194304] 0 2024-09-11T00:07:31.440 INFO:tasks.workunit.client.0.smithi111.stdout:3/847: symlink d1c/d126/l128 0 2024-09-11T00:07:31.440 INFO:tasks.workunit.client.0.smithi111.stdout:8/826: write d11/d23/d7e/d93/fcd [1029928,120352] 0 2024-09-11T00:07:31.441 INFO:tasks.workunit.client.1.smithi203.stdout:0/734: getdents d0/d2/db3 0 2024-09-11T00:07:31.443 INFO:tasks.workunit.client.1.smithi203.stdout:3/814: chown d8/da/d11/c27 1402173 1 2024-09-11T00:07:31.447 INFO:tasks.workunit.client.1.smithi203.stdout:0/735: chown d0/d2/d7e/da1/df5/c72 748245 1 2024-09-11T00:07:31.450 INFO:tasks.workunit.client.0.smithi111.stdout:6/800: creat d7/d22/d3f/d74/d7f/d61/d6a/d9f/db6/f112 x:0 0 0 2024-09-11T00:07:31.451 INFO:tasks.workunit.client.1.smithi203.stdout:7/772: write dd/d1c/f66 [1067486,98323] 0 2024-09-11T00:07:31.451 INFO:tasks.workunit.client.0.smithi111.stdout:6/801: write d7/d22/d26/d95/f9c [2344677,76710] 0 2024-09-11T00:07:31.454 INFO:tasks.workunit.client.1.smithi203.stdout:0/736: write d0/d2/f32 [724130,120366] 0 2024-09-11T00:07:31.456 INFO:tasks.workunit.client.0.smithi111.stdout:7/857: rename dd/d1d/d76/l101 to dd/d1d/d4d/d115/l117 0 2024-09-11T00:07:31.457 INFO:tasks.workunit.client.0.smithi111.stdout:9/848: mknod d6/db/c112 0 2024-09-11T00:07:31.462 INFO:tasks.workunit.client.1.smithi203.stdout:9/772: dwrite d6/de/d47/de1/dec/df8/f79 [0,4194304] 0 2024-09-11T00:07:31.466 INFO:tasks.workunit.client.0.smithi111.stdout:2/765: rmdir d0/d3/d2e/ded/de2 0 2024-09-11T00:07:31.466 INFO:tasks.workunit.client.0.smithi111.stdout:3/848: readlink d1c/d1d/d22/d31/d62/ld0 0 2024-09-11T00:07:31.471 INFO:tasks.workunit.client.1.smithi203.stdout:2/846: dwrite d13/d15/d30/fa9 [0,4194304] 0 2024-09-11T00:07:31.473 INFO:tasks.workunit.client.0.smithi111.stdout:7/858: mkdir dd/d1d/d7e/df8/d8f/dac/d118 0 2024-09-11T00:07:31.477 INFO:tasks.workunit.client.0.smithi111.stdout:9/849: fsync d6/d52/fcb 0 2024-09-11T00:07:31.479 INFO:tasks.workunit.client.1.smithi203.stdout:2/847: chown d13/d22/f7c 18 1 2024-09-11T00:07:31.479 INFO:tasks.workunit.client.0.smithi111.stdout:4/788: dread d18/d3b/d61/f7c [0,4194304] 0 2024-09-11T00:07:31.480 INFO:tasks.workunit.client.1.smithi203.stdout:1/886: dwrite d8/d19/f57 [0,4194304] 0 2024-09-11T00:07:31.480 INFO:tasks.workunit.client.0.smithi111.stdout:8/827: mkdir d11/d23/d2c/d46/d64/df8/d105 0 2024-09-11T00:07:31.481 INFO:tasks.workunit.client.1.smithi203.stdout:8/704: sync 2024-09-11T00:07:31.481 INFO:tasks.workunit.client.0.smithi111.stdout:4/789: write d18/d20/d40/d78/fb2 [1115584,14968] 0 2024-09-11T00:07:31.490 INFO:tasks.workunit.client.0.smithi111.stdout:9/850: symlink d6/d52/d8a/df0/l113 0 2024-09-11T00:07:31.501 INFO:tasks.workunit.client.0.smithi111.stdout:1/799: sync 2024-09-11T00:07:31.503 INFO:tasks.workunit.client.0.smithi111.stdout:7/859: dread dd/da6/faa [0,4194304] 0 2024-09-11T00:07:31.504 INFO:tasks.workunit.client.0.smithi111.stdout:5/855: dwrite d10/d1e/d23/d26/d78/d7a/f83 [0,4194304] 0 2024-09-11T00:07:31.507 INFO:tasks.workunit.client.1.smithi203.stdout:4/698: dwrite db/dd/d16/f4f [4194304,4194304] 0 2024-09-11T00:07:31.510 INFO:tasks.workunit.client.0.smithi111.stdout:8/828: rmdir d11/d23/d2c/d46 39 2024-09-11T00:07:31.514 INFO:tasks.workunit.client.0.smithi111.stdout:9/851: mkdir d6/ddd/d114 0 2024-09-11T00:07:31.515 INFO:tasks.workunit.client.0.smithi111.stdout:1/800: dread d2/de/d12/d3c/d4b/d6a/d63/d73/da1/f50 [0,4194304] 0 2024-09-11T00:07:31.516 INFO:tasks.workunit.client.0.smithi111.stdout:7/860: mknod dd/d48/d69/c119 0 2024-09-11T00:07:31.518 INFO:tasks.workunit.client.1.smithi203.stdout:4/699: write db/d12/d15/d2a/d71/f94 [4996561,125605] 0 2024-09-11T00:07:31.523 INFO:tasks.workunit.client.0.smithi111.stdout:5/856: rename d10/d1e/d23/d30/dd8/da2/d66/d76/f106 to d10/d1e/d23/d30/d59/d7b/d82/f117 0 2024-09-11T00:07:31.528 INFO:tasks.workunit.client.0.smithi111.stdout:8/829: write d11/d23/d3d/f94 [830013,116831] 0 2024-09-11T00:07:31.528 INFO:tasks.workunit.client.0.smithi111.stdout:1/801: dread d2/de/d12/ff9 [0,4194304] 0 2024-09-11T00:07:31.528 INFO:tasks.workunit.client.0.smithi111.stdout:6/802: write d7/f23 [2461724,25798] 0 2024-09-11T00:07:31.531 INFO:tasks.workunit.client.0.smithi111.stdout:3/849: dread d1c/d1d/d22/d23/d58/df2/f102 [0,4194304] 0 2024-09-11T00:07:31.533 INFO:tasks.workunit.client.0.smithi111.stdout:3/850: stat d1c/d1d/d22/d44/d5a/d74/d7b 0 2024-09-11T00:07:31.540 INFO:tasks.workunit.client.0.smithi111.stdout:5/857: mkdir d10/d1e/d23/d30/d59/d52/d85/dd2/d118 0 2024-09-11T00:07:31.541 INFO:tasks.workunit.client.0.smithi111.stdout:0/845: sync 2024-09-11T00:07:31.542 INFO:tasks.workunit.client.0.smithi111.stdout:0/846: stat d3/d13/d1e/l58 0 2024-09-11T00:07:31.545 INFO:tasks.workunit.client.0.smithi111.stdout:2/766: write d0/d3/d2e/f4f [747857,70908] 0 2024-09-11T00:07:31.547 INFO:tasks.workunit.client.0.smithi111.stdout:6/803: fdatasync d7/f6b 0 2024-09-11T00:07:31.548 INFO:tasks.workunit.client.0.smithi111.stdout:1/802: creat d2/de/d12/d3c/d4b/d6a/d63/d73/da1/db9/f10c x:0 0 0 2024-09-11T00:07:31.550 INFO:tasks.workunit.client.1.smithi203.stdout:3/815: creat d8/da/d5c/d6b/d6c/f11f x:0 0 0 2024-09-11T00:07:31.550 INFO:tasks.workunit.client.0.smithi111.stdout:9/852: truncate d6/db/d34/d37/d4c/d99/f10f 2589956 0 2024-09-11T00:07:31.553 INFO:tasks.workunit.client.1.smithi203.stdout:7/773: mknod dd/d1c/d52/d8f/d31/d58/c119 0 2024-09-11T00:07:31.554 INFO:tasks.workunit.client.0.smithi111.stdout:7/861: creat dd/d1d/d7e/df8/d8f/dac/d112/f11a x:0 0 0 2024-09-11T00:07:31.557 INFO:tasks.workunit.client.1.smithi203.stdout:9/773: chown d6/de/d19/c98 100762 1 2024-09-11T00:07:31.557 INFO:tasks.workunit.client.0.smithi111.stdout:0/847: unlink d3/d13/d1e/d29/f2d 0 2024-09-11T00:07:31.558 INFO:tasks.workunit.client.0.smithi111.stdout:0/848: stat d3/dc/l5e 0 2024-09-11T00:07:31.559 INFO:tasks.workunit.client.1.smithi203.stdout:2/848: creat d13/d15/d30/d5a/dd9/f11b x:0 0 0 2024-09-11T00:07:31.559 INFO:tasks.workunit.client.0.smithi111.stdout:0/849: chown d3/d13/l40 14 1 2024-09-11T00:07:31.561 INFO:tasks.workunit.client.1.smithi203.stdout:8/705: symlink d1/d13/d17/d2f/d52/d59/lec 0 2024-09-11T00:07:31.568 INFO:tasks.workunit.client.0.smithi111.stdout:7/862: dwrite dd/d48/d69/fbb [0,4194304] 0 2024-09-11T00:07:31.573 INFO:tasks.workunit.client.1.smithi203.stdout:9/774: dread d6/de/d19/d24/fb0 [0,4194304] 0 2024-09-11T00:07:31.574 INFO:tasks.workunit.client.1.smithi203.stdout:4/700: symlink db/d12/d15/d2a/d88/d95/ldd 0 2024-09-11T00:07:31.575 INFO:tasks.workunit.client.0.smithi111.stdout:3/851: mknod d1c/d1d/d22/c129 0 2024-09-11T00:07:31.580 INFO:tasks.workunit.client.0.smithi111.stdout:4/790: dwrite d18/d1f/f2e [0,4194304] 0 2024-09-11T00:07:31.585 INFO:tasks.workunit.client.0.smithi111.stdout:4/791: dread d18/d20/d4a/d6b/fe3 [0,4194304] 0 2024-09-11T00:07:31.590 INFO:tasks.workunit.client.0.smithi111.stdout:8/830: dwrite d11/f12 [8388608,4194304] 0 2024-09-11T00:07:31.593 INFO:tasks.workunit.client.0.smithi111.stdout:5/858: dread d10/d1e/d23/d30/dd8/da2/d66/f67 [4194304,4194304] 0 2024-09-11T00:07:31.594 INFO:tasks.workunit.client.0.smithi111.stdout:9/853: write d6/dc/d73/fd8 [961861,115031] 0 2024-09-11T00:07:31.597 INFO:tasks.workunit.client.0.smithi111.stdout:5/859: dread - d10/d1e/d23/d30/dd8/da2/d66/d76/f113 zero size 2024-09-11T00:07:31.598 INFO:tasks.workunit.client.1.smithi203.stdout:5/821: sync 2024-09-11T00:07:31.598 INFO:tasks.workunit.client.1.smithi203.stdout:6/744: sync 2024-09-11T00:07:31.601 INFO:tasks.workunit.client.0.smithi111.stdout:2/767: dwrite d0/d3/d12/f41 [0,4194304] 0 2024-09-11T00:07:31.602 INFO:tasks.workunit.client.0.smithi111.stdout:1/803: dwrite d2/de/d93/d9f/f1a [0,4194304] 0 2024-09-11T00:07:31.602 INFO:tasks.workunit.client.0.smithi111.stdout:5/860: chown d10/d1e/d23/d26/d3a/d98/d6d/d9e 5690473 1 2024-09-11T00:07:31.605 INFO:tasks.workunit.client.0.smithi111.stdout:0/850: write d3/d13/d1e/f72 [823442,94617] 0 2024-09-11T00:07:31.607 INFO:tasks.workunit.client.0.smithi111.stdout:1/804: chown d2/de/d12/d3c/d4b/d6a/d63/fb7 363673 1 2024-09-11T00:07:31.607 INFO:tasks.workunit.client.0.smithi111.stdout:4/792: mkdir d18/d20/d3c/d5e/daa/dbb/dfa 0 2024-09-11T00:07:31.608 INFO:tasks.workunit.client.0.smithi111.stdout:6/804: truncate d7/f6b 469750 0 2024-09-11T00:07:31.609 INFO:tasks.workunit.client.0.smithi111.stdout:0/851: chown d3/d13/d1e/deb/d61/d93/fe5 557 1 2024-09-11T00:07:31.610 INFO:tasks.workunit.client.0.smithi111.stdout:6/805: dread - d7/f105 zero size 2024-09-11T00:07:31.610 INFO:tasks.workunit.client.0.smithi111.stdout:4/793: dread - d18/d1f/d36/d95/fa3 zero size 2024-09-11T00:07:31.611 INFO:tasks.workunit.client.0.smithi111.stdout:8/831: fdatasync d11/d23/d2c/d7f/fae 0 2024-09-11T00:07:31.612 INFO:tasks.workunit.client.0.smithi111.stdout:6/806: chown d7/d22/d3f/d74/d7f/d79 542 1 2024-09-11T00:07:31.614 INFO:tasks.workunit.client.1.smithi203.stdout:3/816: mkdir d8/d120 0 2024-09-11T00:07:31.616 INFO:tasks.workunit.client.1.smithi203.stdout:1/887: link d8/d19/d60/d90/d3e/d4b/d41/fda d8/d19/d60/d90/d3e/dfe/f141 0 2024-09-11T00:07:31.619 INFO:tasks.workunit.client.1.smithi203.stdout:9/775: getdents d6/de/d47/de1/dec/df8/def 0 2024-09-11T00:07:31.621 INFO:tasks.workunit.client.0.smithi111.stdout:9/854: truncate d6/db/d1b/f33 920452 0 2024-09-11T00:07:31.621 INFO:tasks.workunit.client.0.smithi111.stdout:5/861: mknod d10/d1e/d23/d30/d59/d52/dd6/c119 0 2024-09-11T00:07:31.623 INFO:tasks.workunit.client.0.smithi111.stdout:5/862: chown d10/f1b 29 1 2024-09-11T00:07:31.623 INFO:tasks.workunit.client.1.smithi203.stdout:0/737: getdents d0/d2/d7e/da1/dc9/de7/d77 0 2024-09-11T00:07:31.626 INFO:tasks.workunit.client.0.smithi111.stdout:4/794: dwrite d18/d1f/d36/d95/dde/ff3 [0,4194304] 0 2024-09-11T00:07:31.628 INFO:tasks.workunit.client.0.smithi111.stdout:4/795: chown d18/d20/de0 75941 1 2024-09-11T00:07:31.628 INFO:tasks.workunit.client.0.smithi111.stdout:0/852: creat d3/d13/d1e/deb/d61/d93/d102/f127 x:0 0 0 2024-09-11T00:07:31.631 INFO:tasks.workunit.client.0.smithi111.stdout:0/853: chown d3/d26/d77/dd6/fda 8552686 1 2024-09-11T00:07:31.633 INFO:tasks.workunit.client.0.smithi111.stdout:6/807: creat d7/d22/d2c/d38/d39/f113 x:0 0 0 2024-09-11T00:07:31.639 INFO:tasks.workunit.client.1.smithi203.stdout:6/745: dread d0/f16 [0,4194304] 0 2024-09-11T00:07:31.639 INFO:tasks.workunit.client.1.smithi203.stdout:9/776: symlink d6/lfc 0 2024-09-11T00:07:31.642 INFO:tasks.workunit.client.0.smithi111.stdout:5/863: mkdir d10/d1e/d23/d30/d59/d7b/d11a 0 2024-09-11T00:07:31.643 INFO:tasks.workunit.client.1.smithi203.stdout:8/706: getdents d1 0 2024-09-11T00:07:31.643 INFO:tasks.workunit.client.0.smithi111.stdout:3/852: sync 2024-09-11T00:07:31.647 INFO:tasks.workunit.client.0.smithi111.stdout:4/796: unlink d18/d1f/d36/d95/dde/ce1 0 2024-09-11T00:07:31.650 INFO:tasks.workunit.client.0.smithi111.stdout:7/863: dread dd/da6/fe8 [0,4194304] 0 2024-09-11T00:07:31.650 INFO:tasks.workunit.client.0.smithi111.stdout:6/808: creat d7/d22/d3f/d74/d7f/f114 x:0 0 0 2024-09-11T00:07:31.651 INFO:tasks.workunit.client.1.smithi203.stdout:5/822: creat dc/d4f/d5c/f112 x:0 0 0 2024-09-11T00:07:31.652 INFO:tasks.workunit.client.1.smithi203.stdout:2/849: truncate d13/d15/d19/d1c/d73/f81 4095027 0 2024-09-11T00:07:31.653 INFO:tasks.workunit.client.0.smithi111.stdout:6/809: write d7/d22/d1d/f31 [445405,50198] 0 2024-09-11T00:07:31.654 INFO:tasks.workunit.client.1.smithi203.stdout:8/707: chown d1/d13/d17/d77/lad 13 1 2024-09-11T00:07:31.662 INFO:tasks.workunit.client.0.smithi111.stdout:3/853: symlink d1c/d1d/d22/d23/dff/l12a 0 2024-09-11T00:07:31.664 INFO:tasks.workunit.client.0.smithi111.stdout:3/854: chown d1c/d1d/d22/d23/d58/fbb 58844 1 2024-09-11T00:07:31.667 INFO:tasks.workunit.client.1.smithi203.stdout:9/777: rename d6/de/lb8 to d6/de/d19/d24/d6c/da8/lfd 0 2024-09-11T00:07:31.668 INFO:tasks.workunit.client.1.smithi203.stdout:2/850: write d13/d56/f8f [4943770,61950] 0 2024-09-11T00:07:31.669 INFO:tasks.workunit.client.0.smithi111.stdout:1/805: write d2/de/d12/d3c/d4b/d6a/d63/f6e [1476904,97116] 0 2024-09-11T00:07:31.670 INFO:tasks.workunit.client.1.smithi203.stdout:9/778: chown d6/f8c 6281 1 2024-09-11T00:07:31.672 INFO:tasks.workunit.client.0.smithi111.stdout:2/768: dwrite d0/d3/de/d3b/d62/f78 [0,4194304] 0 2024-09-11T00:07:31.674 INFO:tasks.workunit.client.0.smithi111.stdout:2/769: chown d0/d3/de/d3b/d63/l8d 1861582 1 2024-09-11T00:07:31.675 INFO:tasks.workunit.client.0.smithi111.stdout:2/770: chown d0/d3/de/d3b/d92/df2 68370 1 2024-09-11T00:07:31.677 INFO:tasks.workunit.client.0.smithi111.stdout:7/864: rename dd/d1d/d4d/d115 to dd/d1d/d2d/d2e/d11b 0 2024-09-11T00:07:31.678 INFO:tasks.workunit.client.0.smithi111.stdout:7/865: dread - dd/ddf/f102 zero size 2024-09-11T00:07:31.692 INFO:tasks.workunit.client.1.smithi203.stdout:4/701: dwrite db/dd/d26/f77 [0,4194304] 0 2024-09-11T00:07:31.693 INFO:tasks.workunit.client.0.smithi111.stdout:7/866: dwrite dd/d1d/d1f/d24/f10b [4194304,4194304] 0 2024-09-11T00:07:31.694 INFO:tasks.workunit.client.0.smithi111.stdout:5/864: creat d10/d1e/d23/d30/dd8/d63/dbb/db5/f11b x:0 0 0 2024-09-11T00:07:31.694 INFO:tasks.workunit.client.1.smithi203.stdout:8/708: creat d1/d13/d17/d2f/d52/d49/d7a/fed x:0 0 0 2024-09-11T00:07:31.709 INFO:tasks.workunit.client.0.smithi111.stdout:9/855: write d6/dc/f87 [154320,80863] 0 2024-09-11T00:07:31.710 INFO:tasks.workunit.client.1.smithi203.stdout:4/702: write db/d12/d15/d2a/d88/f90 [3492512,26588] 0 2024-09-11T00:07:31.713 INFO:tasks.workunit.client.0.smithi111.stdout:8/832: write d11/d23/d2c/d46/f8c [2565107,108760] 0 2024-09-11T00:07:31.716 INFO:tasks.workunit.client.1.smithi203.stdout:2/851: dwrite d13/d15/d30/fc0 [0,4194304] 0 2024-09-11T00:07:31.721 INFO:tasks.workunit.client.0.smithi111.stdout:5/865: dread d10/d1e/d23/fa1 [0,4194304] 0 2024-09-11T00:07:31.722 INFO:tasks.workunit.client.1.smithi203.stdout:7/774: dread dd/d4d/f5a [0,4194304] 0 2024-09-11T00:07:31.723 INFO:tasks.workunit.client.1.smithi203.stdout:9/779: dwrite d6/de/d19/d21/dd0/dde/ffb [0,4194304] 0 2024-09-11T00:07:31.724 INFO:tasks.workunit.client.0.smithi111.stdout:5/866: stat d10/d1e/d23 0 2024-09-11T00:07:31.732 INFO:tasks.workunit.client.1.smithi203.stdout:5/823: mkdir dc/dd/d13/d113 0 2024-09-11T00:07:31.732 INFO:tasks.workunit.client.0.smithi111.stdout:1/806: dwrite d2/de/d12/d6c/fcd [0,4194304] 0 2024-09-11T00:07:31.734 INFO:tasks.workunit.client.1.smithi203.stdout:3/817: dwrite d8/da/d5c/f8d [0,4194304] 0 2024-09-11T00:07:31.736 INFO:tasks.workunit.client.0.smithi111.stdout:1/807: chown d2/de/d93/d9f/f20 236833 1 2024-09-11T00:07:31.739 INFO:tasks.workunit.client.1.smithi203.stdout:8/709: rename d1/d13/d17/d2f/d52/d59/lec to d1/d13/d17/d2f/d52/d49/d7a/lee 0 2024-09-11T00:07:31.739 INFO:tasks.workunit.client.0.smithi111.stdout:1/808: readlink d2/de/d12/d3c/l52 0 2024-09-11T00:07:31.741 INFO:tasks.workunit.client.1.smithi203.stdout:0/738: dwrite d0/d1d/f44 [0,4194304] 0 2024-09-11T00:07:31.743 INFO:tasks.workunit.client.1.smithi203.stdout:8/710: chown d1/d13/d43/d46/db0/fd4 151186 1 2024-09-11T00:07:31.746 INFO:tasks.workunit.client.0.smithi111.stdout:5/867: dwrite d10/d1e/d23/d30/d59/d52/d85/dd2/fbd [0,4194304] 0 2024-09-11T00:07:31.751 INFO:tasks.workunit.client.0.smithi111.stdout:7/867: unlink dd/d1d/d4d/c77 0 2024-09-11T00:07:31.752 INFO:tasks.workunit.client.1.smithi203.stdout:6/746: dwrite d0/d54/d9c/d35/d39/d3c/f6e [0,4194304] 0 2024-09-11T00:07:31.753 INFO:tasks.workunit.client.0.smithi111.stdout:7/868: chown dd/d1d/d4d/d82/d10f 1 1 2024-09-11T00:07:31.754 INFO:tasks.workunit.client.0.smithi111.stdout:5/868: truncate d10/d1e/d23/d26/d3a/d98/d6d/def/f10f 175871 0 2024-09-11T00:07:31.756 INFO:tasks.workunit.client.0.smithi111.stdout:0/854: write d3/dc/f1f [1783064,66818] 0 2024-09-11T00:07:31.758 INFO:tasks.workunit.client.0.smithi111.stdout:5/869: stat d10/d1e/d23/d30/dd8/da2/d66/d76/l79 0 2024-09-11T00:07:31.776 INFO:tasks.workunit.client.1.smithi203.stdout:2/852: mknod d13/d15/d30/dfa/c11c 0 2024-09-11T00:07:31.784 INFO:tasks.workunit.client.0.smithi111.stdout:9/856: mkdir d6/dc/d7c/d115 0 2024-09-11T00:07:31.785 INFO:tasks.workunit.client.1.smithi203.stdout:4/703: symlink db/dd/d16/d38/d3c/d41/lde 0 2024-09-11T00:07:31.786 INFO:tasks.workunit.client.0.smithi111.stdout:3/855: write d1c/d1d/d22/d31/f79 [624419,27073] 0 2024-09-11T00:07:31.789 INFO:tasks.workunit.client.1.smithi203.stdout:1/888: dread d8/faf [0,4194304] 0 2024-09-11T00:07:31.796 INFO:tasks.workunit.client.0.smithi111.stdout:2/771: write d0/d3/d12/d52/f87 [1393245,105085] 0 2024-09-11T00:07:31.797 INFO:tasks.workunit.client.0.smithi111.stdout:2/772: write d0/d3/d2e/f4f [3352181,42689] 0 2024-09-11T00:07:31.803 INFO:tasks.workunit.client.1.smithi203.stdout:7/775: unlink dd/d4d/fa6 0 2024-09-11T00:07:31.804 INFO:tasks.workunit.client.1.smithi203.stdout:3/818: mkdir d8/d2a/dd0/d121 0 2024-09-11T00:07:31.812 INFO:tasks.workunit.client.1.smithi203.stdout:0/739: dread d0/d1d/f2e [0,4194304] 0 2024-09-11T00:07:31.813 INFO:tasks.workunit.client.1.smithi203.stdout:5/824: symlink dc/dd/d15/d3b/d7a/l114 0 2024-09-11T00:07:31.813 INFO:tasks.workunit.client.0.smithi111.stdout:6/810: creat d7/d22/d3f/d74/f115 x:0 0 0 2024-09-11T00:07:31.815 INFO:tasks.workunit.client.0.smithi111.stdout:6/811: write d7/d22/d26/f10a [1497078,21818] 0 2024-09-11T00:07:31.816 INFO:tasks.workunit.client.1.smithi203.stdout:0/740: chown d0/d2/d7e/da1/dc9/de7/cd8 1478 1 2024-09-11T00:07:31.817 INFO:tasks.workunit.client.0.smithi111.stdout:1/809: chown d2/de/d12/d3c/d4b/d6a/d63/d73/da1/f42 21543 1 2024-09-11T00:07:31.828 INFO:tasks.workunit.client.0.smithi111.stdout:0/855: creat d3/d26/d77/dd6/f128 x:0 0 0 2024-09-11T00:07:31.829 INFO:tasks.workunit.client.0.smithi111.stdout:0/856: chown d3/daf/c123 12 1 2024-09-11T00:07:31.831 INFO:tasks.workunit.client.0.smithi111.stdout:7/869: dwrite dd/f18 [0,4194304] 0 2024-09-11T00:07:31.834 INFO:tasks.workunit.client.0.smithi111.stdout:5/870: mkdir d10/d1e/d23/d30/d59/d52/d85/d11c 0 2024-09-11T00:07:31.836 INFO:tasks.workunit.client.1.smithi203.stdout:9/780: symlink d6/de/d32/lfe 0 2024-09-11T00:07:31.840 INFO:tasks.workunit.client.1.smithi203.stdout:4/704: fdatasync db/f6c 0 2024-09-11T00:07:31.840 INFO:tasks.workunit.client.1.smithi203.stdout:8/711: write d1/d13/d17/f38 [310197,11559] 0 2024-09-11T00:07:31.842 INFO:tasks.workunit.client.0.smithi111.stdout:4/797: getdents d18/d20/d4a 0 2024-09-11T00:07:31.843 INFO:tasks.workunit.client.0.smithi111.stdout:4/798: chown d18/d20/d4a 8095 1 2024-09-11T00:07:31.844 INFO:tasks.workunit.client.0.smithi111.stdout:9/857: creat d6/db/d34/d37/d4c/d99/f116 x:0 0 0 2024-09-11T00:07:31.847 INFO:tasks.workunit.client.0.smithi111.stdout:8/833: mknod d11/d23/d2c/d46/d64/df8/d105/c106 0 2024-09-11T00:07:31.854 INFO:tasks.workunit.client.0.smithi111.stdout:2/773: mkdir d0/d3/de/d3b/d97/d104 0 2024-09-11T00:07:31.856 INFO:tasks.workunit.client.1.smithi203.stdout:3/819: dread d8/da/d37/d83/db9/fcb [0,4194304] 0 2024-09-11T00:07:31.856 INFO:tasks.workunit.client.0.smithi111.stdout:6/812: rename d7/d22/l34 to d7/d2b/dd4/l116 0 2024-09-11T00:07:31.858 INFO:tasks.workunit.client.0.smithi111.stdout:1/810: rmdir d2/de/d12 39 2024-09-11T00:07:31.859 INFO:tasks.workunit.client.0.smithi111.stdout:6/813: chown d7/d22/d3f/d74/d7f/d61/lc1 85 1 2024-09-11T00:07:31.859 INFO:tasks.workunit.client.1.smithi203.stdout:2/853: mknod d13/d102/c11d 0 2024-09-11T00:07:31.859 INFO:tasks.workunit.client.1.smithi203.stdout:6/747: dwrite d0/f2d [4194304,4194304] 0 2024-09-11T00:07:31.866 INFO:tasks.workunit.client.1.smithi203.stdout:3/820: truncate d8/da/d37/d53/dea/f10f 783400 0 2024-09-11T00:07:31.868 INFO:tasks.workunit.client.1.smithi203.stdout:3/821: chown d8/d17/c10e 3724 1 2024-09-11T00:07:31.871 INFO:tasks.workunit.client.0.smithi111.stdout:5/871: symlink d10/d1e/d23/d30/d59/d52/d85/l11d 0 2024-09-11T00:07:31.875 INFO:tasks.workunit.client.0.smithi111.stdout:4/799: mknod d18/d1f/d33/cfb 0 2024-09-11T00:07:31.875 INFO:tasks.workunit.client.1.smithi203.stdout:7/776: creat dd/d3b/d9f/d10e/f11a x:0 0 0 2024-09-11T00:07:31.876 INFO:tasks.workunit.client.1.smithi203.stdout:0/741: write d0/d1d/f90 [934696,6344] 0 2024-09-11T00:07:31.876 INFO:tasks.workunit.client.0.smithi111.stdout:3/856: write d1c/d1d/d22/d31/d62/dc7/f103 [917386,113654] 0 2024-09-11T00:07:31.876 INFO:tasks.workunit.client.0.smithi111.stdout:6/814: dread d7/d22/d26/d87/d41/f82 [0,4194304] 0 2024-09-11T00:07:31.877 INFO:tasks.workunit.client.1.smithi203.stdout:0/742: stat d0/d2/f51 0 2024-09-11T00:07:31.880 INFO:tasks.workunit.client.1.smithi203.stdout:5/825: mknod dc/d4f/d5c/c115 0 2024-09-11T00:07:31.884 INFO:tasks.workunit.client.0.smithi111.stdout:8/834: truncate d11/d21/d38/fe2 432205 0 2024-09-11T00:07:31.885 INFO:tasks.workunit.client.1.smithi203.stdout:8/712: dread d1/d13/d22/d6f/d8d/f6b [0,4194304] 0 2024-09-11T00:07:31.888 INFO:tasks.workunit.client.0.smithi111.stdout:2/774: dread - d0/d3/de/d50/d9d/fce zero size 2024-09-11T00:07:31.890 INFO:tasks.workunit.client.0.smithi111.stdout:2/775: write d0/d3/f37 [1711958,107693] 0 2024-09-11T00:07:31.891 INFO:tasks.workunit.client.1.smithi203.stdout:2/854: creat d13/ddb/f11e x:0 0 0 2024-09-11T00:07:31.894 INFO:tasks.workunit.client.1.smithi203.stdout:4/705: creat db/d12/d15/d2a/dcb/fdf x:0 0 0 2024-09-11T00:07:31.896 INFO:tasks.workunit.client.1.smithi203.stdout:1/889: write d8/d19/d60/d90/d3e/d4b/f92 [1946240,56131] 0 2024-09-11T00:07:31.898 INFO:tasks.workunit.client.1.smithi203.stdout:3/822: mkdir d8/da/d37/d53/da2/d122 0 2024-09-11T00:07:31.903 INFO:tasks.workunit.client.0.smithi111.stdout:6/815: fdatasync d7/d22/d2c/d38/d56/dbf/fc3 0 2024-09-11T00:07:31.906 INFO:tasks.workunit.client.1.smithi203.stdout:5/826: symlink dc/d2b/l116 0 2024-09-11T00:07:31.909 INFO:tasks.workunit.client.0.smithi111.stdout:8/835: mknod d11/d23/d2c/d46/d81/dd2/c107 0 2024-09-11T00:07:31.909 INFO:tasks.workunit.client.0.smithi111.stdout:0/857: dwrite d3/d13/f17 [0,4194304] 0 2024-09-11T00:07:31.909 INFO:tasks.workunit.client.1.smithi203.stdout:8/713: symlink d1/d13/d17/d48/d9d/lef 0 2024-09-11T00:07:31.909 INFO:tasks.workunit.client.0.smithi111.stdout:8/836: chown d11/f1d 93 1 2024-09-11T00:07:31.910 INFO:tasks.workunit.client.0.smithi111.stdout:0/858: chown d3/daf/db2/fcd 614121 1 2024-09-11T00:07:31.910 INFO:tasks.workunit.client.0.smithi111.stdout:9/858: dwrite d6/db/d34/d37/f29 [0,4194304] 0 2024-09-11T00:07:31.912 INFO:tasks.workunit.client.0.smithi111.stdout:7/870: dwrite dd/d1d/d1f/f50 [0,4194304] 0 2024-09-11T00:07:31.913 INFO:tasks.workunit.client.0.smithi111.stdout:1/811: symlink d2/l10d 0 2024-09-11T00:07:31.914 INFO:tasks.workunit.client.1.smithi203.stdout:9/781: creat d6/de/d19/d24/d40/d45/fff x:0 0 0 2024-09-11T00:07:31.914 INFO:tasks.workunit.client.0.smithi111.stdout:1/812: chown d2/l10d 529929498 1 2024-09-11T00:07:31.922 INFO:tasks.workunit.client.0.smithi111.stdout:2/776: creat d0/d3/de/d68/df1/f105 x:0 0 0 2024-09-11T00:07:31.923 INFO:tasks.workunit.client.0.smithi111.stdout:3/857: write d1c/d1d/d22/d44/d5a/dcd/f116 [23716,109363] 0 2024-09-11T00:07:31.924 INFO:tasks.workunit.client.1.smithi203.stdout:1/890: fsync d8/d9/d15/d35/faa 0 2024-09-11T00:07:31.925 INFO:tasks.workunit.client.1.smithi203.stdout:0/743: write d0/f19 [5223952,23517] 0 2024-09-11T00:07:31.925 INFO:tasks.workunit.client.0.smithi111.stdout:3/858: chown d1c/d21/dae/cb8 26433 1 2024-09-11T00:07:31.927 INFO:tasks.workunit.client.0.smithi111.stdout:5/872: mknod d10/d1e/d23/d30/d59/d7b/d11a/c11e 0 2024-09-11T00:07:31.928 INFO:tasks.workunit.client.1.smithi203.stdout:3/823: mknod d8/d2a/dd0/c123 0 2024-09-11T00:07:31.930 INFO:tasks.workunit.client.1.smithi203.stdout:0/744: truncate d0/d2/d37/f47 1767969 0 2024-09-11T00:07:31.936 INFO:tasks.workunit.client.1.smithi203.stdout:8/714: mkdir d1/d13/d3a/df0 0 2024-09-11T00:07:31.941 INFO:tasks.workunit.client.1.smithi203.stdout:4/706: creat db/dd/d26/d42/d5e/db5/fe0 x:0 0 0 2024-09-11T00:07:31.944 INFO:tasks.workunit.client.0.smithi111.stdout:9/859: chown d6/db/d34/d37/d4c/d99/f10f 10633 1 2024-09-11T00:07:31.945 INFO:tasks.workunit.client.0.smithi111.stdout:9/860: dread - d6/dc/d73/f111 zero size 2024-09-11T00:07:31.947 INFO:tasks.workunit.client.0.smithi111.stdout:7/871: mkdir dd/d1d/d76/db6/d11c 0 2024-09-11T00:07:31.949 INFO:tasks.workunit.client.0.smithi111.stdout:5/873: dread d10/d1e/d23/d30/dd8/da2/ffe [0,4194304] 0 2024-09-11T00:07:31.949 INFO:tasks.workunit.client.1.smithi203.stdout:3/824: creat d8/da/d37/d83/da3/f124 x:0 0 0 2024-09-11T00:07:31.951 INFO:tasks.workunit.client.0.smithi111.stdout:5/874: chown d10/d1e/d23/d26/d78/d7a/f83 102465996 1 2024-09-11T00:07:31.951 INFO:tasks.workunit.client.1.smithi203.stdout:2/855: link d13/d15/d19/f42 d13/d15/d19/d1c/d73/d7a/f11f 0 2024-09-11T00:07:31.953 INFO:tasks.workunit.client.0.smithi111.stdout:2/777: mkdir d0/d3/de/dd4/d106 0 2024-09-11T00:07:31.954 INFO:tasks.workunit.client.1.smithi203.stdout:8/715: unlink d1/d13/d17/d2f/f32 0 2024-09-11T00:07:31.959 INFO:tasks.workunit.client.1.smithi203.stdout:8/716: read d1/d13/d22/d6f/d8d/f6b [1114971,93321] 0 2024-09-11T00:07:31.971 INFO:tasks.workunit.client.1.smithi203.stdout:9/782: dread d6/de/d19/f1b [0,4194304] 0 2024-09-11T00:07:31.971 INFO:tasks.workunit.client.1.smithi203.stdout:2/856: fsync d13/d15/d30/d59/fc9 0 2024-09-11T00:07:31.984 INFO:tasks.workunit.client.0.smithi111.stdout:9/861: chown d6/db/d7a/d9a/l102 22 1 2024-09-11T00:07:31.989 INFO:tasks.workunit.client.0.smithi111.stdout:0/859: dread d3/d13/d66/fa0 [0,4194304] 0 2024-09-11T00:07:31.989 INFO:tasks.workunit.client.0.smithi111.stdout:1/813: creat d2/de/d12/d6c/dbd/f10e x:0 0 0 2024-09-11T00:07:31.990 INFO:tasks.workunit.client.1.smithi203.stdout:2/857: creat d13/d102/f120 x:0 0 0 2024-09-11T00:07:31.994 INFO:tasks.workunit.client.0.smithi111.stdout:2/778: creat d0/d3/de/dd4/f107 x:0 0 0 2024-09-11T00:07:31.994 INFO:tasks.workunit.client.0.smithi111.stdout:8/837: write d11/fa1 [274420,82295] 0 2024-09-11T00:07:31.996 INFO:tasks.workunit.client.0.smithi111.stdout:3/859: unlink d1c/d1d/d22/d31/d62/dc7/cd4 0 2024-09-11T00:07:31.996 INFO:tasks.workunit.client.0.smithi111.stdout:2/779: chown d0/d3/de/d68/df1 3458394 1 2024-09-11T00:07:31.997 INFO:tasks.workunit.client.0.smithi111.stdout:4/800: link d18/d20/d40/l55 d18/d20/d3c/d5e/daa/dbb/lfc 0 2024-09-11T00:07:31.998 INFO:tasks.workunit.client.1.smithi203.stdout:1/891: write d8/d19/d60/d90/d3e/d9b/fa8 [2517535,44642] 0 2024-09-11T00:07:32.000 INFO:tasks.workunit.client.1.smithi203.stdout:5/827: dwrite dc/dd/d13/f14 [0,4194304] 0 2024-09-11T00:07:32.005 INFO:tasks.workunit.client.1.smithi203.stdout:1/892: write d8/d19/d60/f10f [144687,47009] 0 2024-09-11T00:07:32.005 INFO:tasks.workunit.client.1.smithi203.stdout:2/858: creat d13/d15/d19/d1c/d73/f121 x:0 0 0 2024-09-11T00:07:32.011 INFO:tasks.workunit.client.0.smithi111.stdout:5/875: write d10/d1e/d23/d30/d59/d52/f95 [2710373,73699] 0 2024-09-11T00:07:32.011 INFO:tasks.workunit.client.1.smithi203.stdout:8/717: write d1/d13/d17/d77/dea/da6/fcd [453601,52856] 0 2024-09-11T00:07:32.015 INFO:tasks.workunit.client.0.smithi111.stdout:7/872: rename dd/d48/d69/f6b to dd/d1d/d1f/f11d 0 2024-09-11T00:07:32.016 INFO:tasks.workunit.client.0.smithi111.stdout:5/876: write d10/d1e/d23/d30/d59/d52/f95 [37553,16643] 0 2024-09-11T00:07:32.017 INFO:tasks.workunit.client.1.smithi203.stdout:2/859: write d13/d15/d30/d59/f10e [106333,5160] 0 2024-09-11T00:07:32.018 INFO:tasks.workunit.client.1.smithi203.stdout:9/783: rename d6/de/l1d to d6/de/d19/l100 0 2024-09-11T00:07:32.018 INFO:tasks.workunit.client.0.smithi111.stdout:7/873: chown dd/d1d/d7e/df8/dad/ffb 2 1 2024-09-11T00:07:32.025 INFO:tasks.workunit.client.1.smithi203.stdout:4/707: dwrite db/d12/f7d [0,4194304] 0 2024-09-11T00:07:32.025 INFO:tasks.workunit.client.1.smithi203.stdout:0/745: dwrite d0/f5c [0,4194304] 0 2024-09-11T00:07:32.026 INFO:tasks.workunit.client.0.smithi111.stdout:9/862: symlink d6/db/d1b/d41/d80/l117 0 2024-09-11T00:07:32.031 INFO:tasks.workunit.client.0.smithi111.stdout:0/860: read - d3/fc4 zero size 2024-09-11T00:07:32.033 INFO:tasks.workunit.client.0.smithi111.stdout:0/861: fdatasync d3/da/d7b/d84/fef 0 2024-09-11T00:07:32.036 INFO:tasks.workunit.client.1.smithi203.stdout:3/825: dwrite d8/da/d37/d83/d65/f66 [0,4194304] 0 2024-09-11T00:07:32.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:31 smithi203 ceph-mon[33225]: Adjusting osd_memory_target on smithi111 to 1216M 2024-09-11T00:07:32.046 INFO:tasks.workunit.client.1.smithi203.stdout:8/718: symlink d1/d13/d43/d46/d76/lf1 0 2024-09-11T00:07:32.047 INFO:tasks.workunit.client.1.smithi203.stdout:5/828: write dc/dd/d15/f37 [270397,97662] 0 2024-09-11T00:07:32.048 INFO:tasks.workunit.client.1.smithi203.stdout:4/708: dread db/dd/d26/f76 [0,4194304] 0 2024-09-11T00:07:32.059 INFO:tasks.workunit.client.1.smithi203.stdout:9/784: creat d6/de/dc4/f101 x:0 0 0 2024-09-11T00:07:32.064 INFO:tasks.workunit.client.0.smithi111.stdout:6/816: getdents d7/d22/d1d/d8c 0 2024-09-11T00:07:32.066 INFO:tasks.workunit.client.1.smithi203.stdout:9/785: truncate d6/de/d32/d52/fe8 160206 0 2024-09-11T00:07:32.069 INFO:tasks.workunit.client.1.smithi203.stdout:1/893: mknod d8/d19/c142 0 2024-09-11T00:07:32.081 INFO:tasks.workunit.client.1.smithi203.stdout:5/829: dread f8 [0,4194304] 0 2024-09-11T00:07:32.085 INFO:tasks.workunit.client.1.smithi203.stdout:8/719: mkdir d1/d13/d17/d48/df2 0 2024-09-11T00:07:32.093 INFO:tasks.workunit.client.1.smithi203.stdout:0/746: dwrite d0/d2/d37/f4b [0,4194304] 0 2024-09-11T00:07:32.095 INFO:tasks.workunit.client.0.smithi111.stdout:1/814: write d2/de/d12/d3c/d4b/d6a/d63/d73/da1/f2d [1637920,93101] 0 2024-09-11T00:07:32.096 INFO:tasks.workunit.client.0.smithi111.stdout:3/860: symlink d1c/d1d/d22/l12b 0 2024-09-11T00:07:32.097 INFO:tasks.workunit.client.0.smithi111.stdout:1/815: dread - d2/de/d12/d88/f107 zero size 2024-09-11T00:07:32.098 INFO:tasks.workunit.client.0.smithi111.stdout:9/863: dwrite d6/dc/d73/f77 [4194304,4194304] 0 2024-09-11T00:07:32.099 INFO:tasks.workunit.client.0.smithi111.stdout:9/864: readlink d6/db/d1b/l4d 0 2024-09-11T00:07:32.099 INFO:tasks.workunit.client.1.smithi203.stdout:2/860: write d13/d15/f29 [1931834,98364] 0 2024-09-11T00:07:32.100 INFO:tasks.workunit.client.0.smithi111.stdout:1/816: stat d2/de/d12/d6c/dbd/f10e 0 2024-09-11T00:07:32.103 INFO:tasks.workunit.client.1.smithi203.stdout:2/861: chown d13/d15/d30/dfa/daf 27586 1 2024-09-11T00:07:32.104 INFO:tasks.workunit.client.1.smithi203.stdout:1/894: dread - d8/d19/d60/d90/d3e/d4b/d80/d8d/da3/ff6 zero size 2024-09-11T00:07:32.106 INFO:tasks.workunit.client.1.smithi203.stdout:5/830: unlink dc/d4f/d5c/f69 0 2024-09-11T00:07:32.110 INFO:tasks.workunit.client.1.smithi203.stdout:4/709: dwrite db/dd/d26/d42/f45 [0,4194304] 0 2024-09-11T00:07:32.112 INFO:tasks.workunit.client.1.smithi203.stdout:2/862: write d13/d15/d19/d1c/d76/f108 [186581,87664] 0 2024-09-11T00:07:32.112 INFO:tasks.workunit.client.0.smithi111.stdout:6/817: write d7/f15 [876249,106142] 0 2024-09-11T00:07:32.122 INFO:tasks.workunit.client.1.smithi203.stdout:2/863: chown d13/d15/d19/d1c/d73/dc4/cb4 13884086 1 2024-09-11T00:07:32.124 INFO:tasks.workunit.client.1.smithi203.stdout:2/864: readlink d13/d47/l9d 0 2024-09-11T00:07:32.124 INFO:tasks.workunit.client.1.smithi203.stdout:9/786: mknod d6/de/d32/c102 0 2024-09-11T00:07:32.126 INFO:tasks.workunit.client.1.smithi203.stdout:3/826: link d8/le d8/da/d5c/d80/l125 0 2024-09-11T00:07:32.129 INFO:tasks.workunit.client.1.smithi203.stdout:5/831: stat dc/dd/d1e/dc6/ld2 0 2024-09-11T00:07:32.132 INFO:tasks.workunit.client.1.smithi203.stdout:4/710: dread - db/dd/d26/d42/d5e/fb8 zero size 2024-09-11T00:07:32.133 INFO:tasks.workunit.client.1.smithi203.stdout:0/747: mkdir d0/df8 0 2024-09-11T00:07:32.134 INFO:tasks.workunit.client.0.smithi111.stdout:5/877: sync 2024-09-11T00:07:32.134 INFO:tasks.workunit.client.1.smithi203.stdout:4/711: fdatasync db/d12/d15/d2a/d88/fc1 0 2024-09-11T00:07:32.139 INFO:tasks.workunit.client.1.smithi203.stdout:8/720: write d1/d13/f33 [1415883,95758] 0 2024-09-11T00:07:32.141 INFO:tasks.workunit.client.1.smithi203.stdout:9/787: fdatasync d6/de/d19/d24/d6c/f75 0 2024-09-11T00:07:32.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:31 smithi111 ceph-mon[27539]: Adjusting osd_memory_target on smithi111 to 1216M 2024-09-11T00:07:32.153 INFO:tasks.workunit.client.1.smithi203.stdout:2/865: rename d13/d56/d69/cfc to d13/d56/d69/c122 0 2024-09-11T00:07:32.155 INFO:tasks.workunit.client.1.smithi203.stdout:0/748: dwrite d0/d2/d7e/da1/fe2 [0,4194304] 0 2024-09-11T00:07:32.157 INFO:tasks.workunit.client.1.smithi203.stdout:5/832: dread dc/dd/d15/d3b/fc1 [0,4194304] 0 2024-09-11T00:07:32.159 INFO:tasks.workunit.client.1.smithi203.stdout:5/833: truncate dc/d91/f10e 1167191 0 2024-09-11T00:07:32.161 INFO:tasks.workunit.client.1.smithi203.stdout:4/712: unlink db/dd/d16/d38/d3c/d41/f6d 0 2024-09-11T00:07:32.163 INFO:tasks.workunit.client.1.smithi203.stdout:8/721: fsync d1/fc 0 2024-09-11T00:07:32.166 INFO:tasks.workunit.client.1.smithi203.stdout:3/827: write d8/da/d37/d83/fe2 [1359980,79043] 0 2024-09-11T00:07:32.175 INFO:tasks.workunit.client.1.smithi203.stdout:2/866: fsync d13/d15/d30/d5a/fef 0 2024-09-11T00:07:32.177 INFO:tasks.workunit.client.1.smithi203.stdout:0/749: readlink d0/d1d/d5d/ld6 0 2024-09-11T00:07:32.180 INFO:tasks.workunit.client.1.smithi203.stdout:5/834: fdatasync dc/d91/fd6 0 2024-09-11T00:07:32.181 INFO:tasks.workunit.client.1.smithi203.stdout:6/748: sync 2024-09-11T00:07:32.183 INFO:tasks.workunit.client.1.smithi203.stdout:4/713: symlink db/dd/d16/le1 0 2024-09-11T00:07:32.184 INFO:tasks.workunit.client.1.smithi203.stdout:6/749: write d0/d32/d5a/fba [3822772,93173] 0 2024-09-11T00:07:32.187 INFO:tasks.workunit.client.1.smithi203.stdout:8/722: creat d1/d13/d3a/d75/ff3 x:0 0 0 2024-09-11T00:07:32.196 INFO:tasks.workunit.client.1.smithi203.stdout:1/895: link d8/d19/d31/f59 d8/d19/d60/d90/d3e/d4b/db2/f143 0 2024-09-11T00:07:32.202 INFO:tasks.workunit.client.1.smithi203.stdout:0/750: symlink d0/d2/d37/d80/lf9 0 2024-09-11T00:07:32.203 INFO:tasks.workunit.client.1.smithi203.stdout:0/751: stat d0/d2/d37/d80/fbe 0 2024-09-11T00:07:32.211 INFO:tasks.workunit.client.1.smithi203.stdout:6/750: truncate d0/d32/f43 4603951 0 2024-09-11T00:07:32.215 INFO:tasks.workunit.client.1.smithi203.stdout:1/896: dwrite d8/d11/fc9 [0,4194304] 0 2024-09-11T00:07:32.217 INFO:tasks.workunit.client.1.smithi203.stdout:8/723: mkdir d1/d78/df4 0 2024-09-11T00:07:32.220 INFO:tasks.workunit.client.1.smithi203.stdout:3/828: creat d8/da/d37/d53/dcd/f126 x:0 0 0 2024-09-11T00:07:32.225 INFO:tasks.workunit.client.1.smithi203.stdout:9/788: link d6/de/dc4/c7f d6/de/d32/d9e/c103 0 2024-09-11T00:07:32.228 INFO:tasks.workunit.client.1.smithi203.stdout:2/867: dwrite d13/d56/d69/d99/fdd [0,4194304] 0 2024-09-11T00:07:32.238 INFO:tasks.workunit.client.1.smithi203.stdout:5/835: getdents dc/ddf 0 2024-09-11T00:07:32.240 INFO:tasks.workunit.client.0.smithi111.stdout:8/838: creat d11/d23/d3d/d5f/f108 x:0 0 0 2024-09-11T00:07:32.241 INFO:tasks.workunit.client.1.smithi203.stdout:5/836: chown dc/d91 0 1 2024-09-11T00:07:32.241 INFO:tasks.workunit.client.1.smithi203.stdout:4/714: mknod db/ce2 0 2024-09-11T00:07:32.242 INFO:tasks.workunit.client.0.smithi111.stdout:5/878: sync 2024-09-11T00:07:32.245 INFO:tasks.workunit.client.0.smithi111.stdout:2/780: rmdir d0/d3/de/d50/dda/de8 0 2024-09-11T00:07:32.248 INFO:tasks.workunit.client.0.smithi111.stdout:2/781: truncate d0/d3/de/d50/d9d/ffa 922489 0 2024-09-11T00:07:32.252 INFO:tasks.workunit.client.1.smithi203.stdout:6/751: rename d0/d54/d9c/d35/d38/f49 to d0/d71/ff1 0 2024-09-11T00:07:32.255 INFO:tasks.workunit.client.0.smithi111.stdout:9/865: mkdir d6/d52/d8a/d8e/d118 0 2024-09-11T00:07:32.257 INFO:tasks.workunit.client.0.smithi111.stdout:1/817: creat d2/de/d12/d3c/d4b/d6a/d63/f10f x:0 0 0 2024-09-11T00:07:32.258 INFO:tasks.workunit.client.1.smithi203.stdout:0/752: dwrite d0/d2/d37/d7f/f85 [0,4194304] 0 2024-09-11T00:07:32.258 INFO:tasks.workunit.client.1.smithi203.stdout:8/724: mknod d1/d13/d17/d48/d9d/da9/cf5 0 2024-09-11T00:07:32.258 INFO:tasks.workunit.client.1.smithi203.stdout:1/897: dread d8/d9/d15/d35/d81/f83 [0,4194304] 0 2024-09-11T00:07:32.261 INFO:tasks.workunit.client.0.smithi111.stdout:4/801: rename d18/d3b/d9f/c56 to d18/d3b/d61/cfd 0 2024-09-11T00:07:32.262 INFO:tasks.workunit.client.0.smithi111.stdout:0/862: write d3/d13/d1e/d29/db0/dce/f10b [4532529,120919] 0 2024-09-11T00:07:32.265 INFO:tasks.workunit.client.0.smithi111.stdout:7/874: link dd/d48/d69/fe1 dd/d1d/f11e 0 2024-09-11T00:07:32.265 INFO:tasks.workunit.client.1.smithi203.stdout:7/777: sync 2024-09-11T00:07:32.269 INFO:tasks.workunit.client.1.smithi203.stdout:5/837: creat dc/dd/d15/d3b/d7a/f117 x:0 0 0 2024-09-11T00:07:32.270 INFO:tasks.workunit.client.0.smithi111.stdout:5/879: mkdir d10/d1e/d23/d2b/d2f/d11f 0 2024-09-11T00:07:32.272 INFO:tasks.workunit.client.1.smithi203.stdout:4/715: unlink db/dd/l4a 0 2024-09-11T00:07:32.273 INFO:tasks.workunit.client.0.smithi111.stdout:3/861: mkdir d1c/d1d/d22/d44/d5a/dcd/dd2/d112/d12c 0 2024-09-11T00:07:32.274 INFO:tasks.workunit.client.0.smithi111.stdout:9/866: stat d6/db/d1b/cd4 0 2024-09-11T00:07:32.275 INFO:tasks.workunit.client.0.smithi111.stdout:3/862: dread - d1c/d21/fa2 zero size 2024-09-11T00:07:32.279 INFO:tasks.workunit.client.0.smithi111.stdout:1/818: dread d2/de/d12/d3c/d4b/d6a/f65 [0,4194304] 0 2024-09-11T00:07:32.281 INFO:tasks.workunit.client.0.smithi111.stdout:8/839: dread d11/f33 [0,4194304] 0 2024-09-11T00:07:32.283 INFO:tasks.workunit.client.1.smithi203.stdout:2/868: dread d13/d22/fdc [0,4194304] 0 2024-09-11T00:07:32.284 INFO:tasks.workunit.client.1.smithi203.stdout:0/753: mkdir d0/d2/d37/dfa 0 2024-09-11T00:07:32.287 INFO:tasks.workunit.client.1.smithi203.stdout:1/898: mknod d8/d19/d60/d90/d3e/d4b/d80/d91/c144 0 2024-09-11T00:07:32.289 INFO:tasks.workunit.client.1.smithi203.stdout:3/829: write d8/da/d37/d83/d6a/f7d [809304,101480] 0 2024-09-11T00:07:32.289 INFO:tasks.workunit.client.0.smithi111.stdout:4/802: read d18/d20/d3c/d5e/d75/f76 [25470,91767] 0 2024-09-11T00:07:32.290 INFO:tasks.workunit.client.1.smithi203.stdout:9/789: symlink d6/de/d47/dc3/l104 0 2024-09-11T00:07:32.291 INFO:tasks.workunit.client.0.smithi111.stdout:7/875: creat dd/d1d/d2d/d2e/f11f x:0 0 0 2024-09-11T00:07:32.291 INFO:tasks.workunit.client.0.smithi111.stdout:6/818: mkdir d7/d22/d3f/d74/d7f/d79/da4/d117 0 2024-09-11T00:07:32.293 INFO:tasks.workunit.client.0.smithi111.stdout:6/819: readlink d7/d22/d2c/d38/d56/dbf/l108 0 2024-09-11T00:07:32.294 INFO:tasks.workunit.client.0.smithi111.stdout:9/867: creat d6/d52/d8a/f119 x:0 0 0 2024-09-11T00:07:32.296 INFO:tasks.workunit.client.1.smithi203.stdout:7/778: dread - dd/d3b/fa4 zero size 2024-09-11T00:07:32.301 INFO:tasks.workunit.client.1.smithi203.stdout:6/752: creat d0/d54/d9c/d35/d38/dc0/ddb/d82/ff2 x:0 0 0 2024-09-11T00:07:32.301 INFO:tasks.workunit.client.1.smithi203.stdout:0/754: fsync d0/d2/f9c 0 2024-09-11T00:07:32.302 INFO:tasks.workunit.client.1.smithi203.stdout:2/869: mknod d13/d15/d19/d1c/d76/d94/d97/df8/c123 0 2024-09-11T00:07:32.303 INFO:tasks.workunit.client.0.smithi111.stdout:0/863: truncate d3/d1c/f23 1009672 0 2024-09-11T00:07:32.305 INFO:tasks.workunit.client.0.smithi111.stdout:0/864: write d3/da/d7b/d84/f8b [714297,92724] 0 2024-09-11T00:07:32.306 INFO:tasks.workunit.client.1.smithi203.stdout:5/838: symlink dc/dd/d9b/dff/l118 0 2024-09-11T00:07:32.307 INFO:tasks.workunit.client.1.smithi203.stdout:5/839: stat dc/d4f/d5c/d76 0 2024-09-11T00:07:32.308 INFO:tasks.workunit.client.1.smithi203.stdout:8/725: dread d1/d13/d17/d81/fc1 [4194304,4194304] 0 2024-09-11T00:07:32.309 INFO:tasks.workunit.client.0.smithi111.stdout:6/820: creat d7/d22/d1d/d83/f118 x:0 0 0 2024-09-11T00:07:32.310 INFO:tasks.workunit.client.1.smithi203.stdout:7/779: creat dd/d1c/d52/d8f/d31/d67/dc3/f11b x:0 0 0 2024-09-11T00:07:32.311 INFO:tasks.workunit.client.0.smithi111.stdout:3/863: mkdir d1c/d21/dae/dfe/d12d 0 2024-09-11T00:07:32.313 INFO:tasks.workunit.client.1.smithi203.stdout:0/755: dread - d0/d87/fc7 zero size 2024-09-11T00:07:32.313 INFO:tasks.workunit.client.0.smithi111.stdout:9/868: mknod d6/db/d1b/d56/c11a 0 2024-09-11T00:07:32.313 INFO:tasks.workunit.client.1.smithi203.stdout:4/716: truncate db/dd/d16/d38/d3c/fdc 326694 0 2024-09-11T00:07:32.317 INFO:tasks.workunit.client.0.smithi111.stdout:1/819: mknod d2/de/d105/c110 0 2024-09-11T00:07:32.320 INFO:tasks.workunit.client.0.smithi111.stdout:1/820: fsync d2/de/d12/d3c/d4b/d6a/d63/f10f 0 2024-09-11T00:07:32.321 INFO:tasks.workunit.client.0.smithi111.stdout:2/782: rename d0/d3/ca to d0/d3/d12/c108 0 2024-09-11T00:07:32.323 INFO:tasks.workunit.client.1.smithi203.stdout:6/753: truncate d0/d32/f46 943511 0 2024-09-11T00:07:32.323 INFO:tasks.workunit.client.1.smithi203.stdout:6/754: readlink d0/l12 0 2024-09-11T00:07:32.324 INFO:tasks.workunit.client.0.smithi111.stdout:8/840: fdatasync d11/d23/d2c/f45 0 2024-09-11T00:07:32.325 INFO:tasks.workunit.client.1.smithi203.stdout:6/755: chown d0/d54/fee 7546 1 2024-09-11T00:07:32.327 INFO:tasks.workunit.client.1.smithi203.stdout:2/870: creat d13/d15/d19/d1c/d73/d7a/f124 x:0 0 0 2024-09-11T00:07:32.331 INFO:tasks.workunit.client.0.smithi111.stdout:4/803: dwrite d18/d20/d3c/d5e/d75/fa8 [0,4194304] 0 2024-09-11T00:07:32.333 INFO:tasks.workunit.client.1.smithi203.stdout:5/840: mknod dc/dd/d15/dbd/dce/c119 0 2024-09-11T00:07:32.334 INFO:tasks.workunit.client.0.smithi111.stdout:4/804: readlink d18/d20/d40/d78/d79/d90/lc7 0 2024-09-11T00:07:32.336 INFO:tasks.workunit.client.1.smithi203.stdout:9/790: truncate d6/de/d19/f31 2919362 0 2024-09-11T00:07:32.338 INFO:tasks.workunit.client.0.smithi111.stdout:8/841: dread d11/d23/d2c/d46/d64/fdc [0,4194304] 0 2024-09-11T00:07:32.338 INFO:tasks.workunit.client.0.smithi111.stdout:6/821: creat d7/d22/d2c/d38/d39/db3/f119 x:0 0 0 2024-09-11T00:07:32.339 INFO:tasks.workunit.client.0.smithi111.stdout:8/842: readlink d11/d23/d3d/dca/dcf/l7d 0 2024-09-11T00:07:32.341 INFO:tasks.workunit.client.0.smithi111.stdout:8/843: read - d11/d23/d3d/dca/dcf/dc3/f100 zero size 2024-09-11T00:07:32.342 INFO:tasks.workunit.client.1.smithi203.stdout:7/780: rename dd/d1c/d7c/ff1 to dd/d1c/d52/dff/f11c 0 2024-09-11T00:07:32.349 INFO:tasks.workunit.client.1.smithi203.stdout:4/717: symlink db/d12/d15/le3 0 2024-09-11T00:07:32.353 INFO:tasks.workunit.client.0.smithi111.stdout:5/880: rename d10/d1e/d23/fdc to d10/d1e/d23/d2b/d2f/f120 0 2024-09-11T00:07:32.355 INFO:tasks.workunit.client.1.smithi203.stdout:3/830: truncate d8/da/d37/f47 525030 0 2024-09-11T00:07:32.357 INFO:tasks.workunit.client.1.smithi203.stdout:8/726: mknod d1/d13/d17/cf6 0 2024-09-11T00:07:32.360 INFO:tasks.workunit.client.1.smithi203.stdout:5/841: truncate dc/dd/d15/dbd/d59/dbb/fe1 513130 0 2024-09-11T00:07:32.361 INFO:tasks.workunit.client.1.smithi203.stdout:5/842: fsync dc/dd/d13/f14 0 2024-09-11T00:07:32.364 INFO:tasks.workunit.client.1.smithi203.stdout:9/791: symlink d6/de/d32/d9e/l105 0 2024-09-11T00:07:32.365 INFO:tasks.workunit.client.0.smithi111.stdout:7/876: link dd/d48/c9c dd/d48/d69/dea/c120 0 2024-09-11T00:07:32.367 INFO:tasks.workunit.client.1.smithi203.stdout:9/792: write d6/de/d32/d52/d55/d66/fe9 [961377,4771] 0 2024-09-11T00:07:32.368 INFO:tasks.workunit.client.0.smithi111.stdout:0/865: mknod d3/d13/d1e/d29/db0/dce/ddb/de6/c129 0 2024-09-11T00:07:32.372 INFO:tasks.workunit.client.1.smithi203.stdout:7/781: creat dd/d1c/d52/d8f/d31/d4a/d6e/dcc/dea/f11d x:0 0 0 2024-09-11T00:07:32.372 INFO:tasks.workunit.client.1.smithi203.stdout:2/871: write d13/d15/d30/d59/fc9 [471061,395] 0 2024-09-11T00:07:32.374 INFO:tasks.workunit.client.0.smithi111.stdout:9/869: dwrite d6/db/d1b/d56/dc8/fef [0,4194304] 0 2024-09-11T00:07:32.374 INFO:tasks.workunit.client.0.smithi111.stdout:0/866: dread d3/d13/d1e/f72 [0,4194304] 0 2024-09-11T00:07:32.375 INFO:tasks.workunit.client.0.smithi111.stdout:6/822: creat d7/d22/d26/d87/d41/d77/f11a x:0 0 0 2024-09-11T00:07:32.376 INFO:tasks.workunit.client.1.smithi203.stdout:0/756: dwrite d0/d2/d7e/f8f [0,4194304] 0 2024-09-11T00:07:32.376 INFO:tasks.workunit.client.0.smithi111.stdout:9/870: readlink d6/dc/d7c/lc6 0 2024-09-11T00:07:32.378 INFO:tasks.workunit.client.1.smithi203.stdout:1/899: getdents d8/d19/d60/d90/d3e/d4b/d80/d8d/db0 0 2024-09-11T00:07:32.378 INFO:tasks.workunit.client.0.smithi111.stdout:3/864: symlink d1c/d1d/d22/d23/d58/l12e 0 2024-09-11T00:07:32.379 INFO:tasks.workunit.client.0.smithi111.stdout:9/871: chown d6/db/d34/d37/d4c/d99/cf3 859060024 1 2024-09-11T00:07:32.381 INFO:tasks.workunit.client.0.smithi111.stdout:3/865: write d1c/d1d/d22/f120 [205774,125509] 0 2024-09-11T00:07:32.383 INFO:tasks.workunit.client.1.smithi203.stdout:0/757: chown d0/d2/d7e/da1/dc9/de7/cd7 0 1 2024-09-11T00:07:32.384 INFO:tasks.workunit.client.0.smithi111.stdout:1/821: sync 2024-09-11T00:07:32.385 INFO:tasks.workunit.client.1.smithi203.stdout:6/756: dread d0/d54/d9c/f18 [4194304,4194304] 0 2024-09-11T00:07:32.385 INFO:tasks.workunit.client.0.smithi111.stdout:3/866: truncate d1c/d1d/dac/ff7 571107 0 2024-09-11T00:07:32.388 INFO:tasks.workunit.client.0.smithi111.stdout:3/867: write d1c/d1d/d22/d44/d5a/f69 [82256,12283] 0 2024-09-11T00:07:32.389 INFO:tasks.workunit.client.1.smithi203.stdout:8/727: creat d1/d13/d17/d77/ff7 x:0 0 0 2024-09-11T00:07:32.389 INFO:tasks.workunit.client.0.smithi111.stdout:7/877: mkdir dd/d1d/d7e/dc8/d121 0 2024-09-11T00:07:32.391 INFO:tasks.workunit.client.1.smithi203.stdout:5/843: mkdir dc/dd/d9b/dae/d11a 0 2024-09-11T00:07:32.393 INFO:tasks.workunit.client.0.smithi111.stdout:4/805: creat d18/d20/d3c/d5e/daa/dbb/dfa/ffe x:0 0 0 2024-09-11T00:07:32.393 INFO:tasks.workunit.client.0.smithi111.stdout:3/868: write d1c/d1d/d22/d31/d62/f11f [337583,47557] 0 2024-09-11T00:07:32.393 INFO:tasks.workunit.client.0.smithi111.stdout:0/867: dwrite f2 [0,4194304] 0 2024-09-11T00:07:32.400 INFO:tasks.workunit.client.0.smithi111.stdout:2/783: link d0/d3/de/d4b/dd9/ce4 d0/d3/d12/d38/c109 0 2024-09-11T00:07:32.401 INFO:tasks.workunit.client.1.smithi203.stdout:2/872: mknod d13/d15/d19/d1c/d76/d94/d97/df8/c125 0 2024-09-11T00:07:32.402 INFO:tasks.workunit.client.1.smithi203.stdout:0/758: mknod d0/d2/d7e/da1/dc9/de7/cfb 0 2024-09-11T00:07:32.402 INFO:tasks.workunit.client.1.smithi203.stdout:6/757: rmdir d0/d32/d5a 39 2024-09-11T00:07:32.403 INFO:tasks.workunit.client.0.smithi111.stdout:2/784: write d0/d3/de/d3b/d97/f8b [1656052,68746] 0 2024-09-11T00:07:32.404 INFO:tasks.workunit.client.0.smithi111.stdout:4/806: rmdir d18/d20/d3c/d5e/daa/dbb 39 2024-09-11T00:07:32.405 INFO:tasks.workunit.client.1.smithi203.stdout:2/873: readlink d13/d15/l103 0 2024-09-11T00:07:32.406 INFO:tasks.workunit.client.0.smithi111.stdout:3/869: read d1c/d1d/d22/d23/d58/f75 [239918,64892] 0 2024-09-11T00:07:32.412 INFO:tasks.workunit.client.1.smithi203.stdout:9/793: rename d6/de/d19/d24/d54/f9c to d6/de/d19/d21/f106 0 2024-09-11T00:07:32.414 INFO:tasks.workunit.client.1.smithi203.stdout:4/718: dread db/d12/d15/d2a/d88/f89 [0,4194304] 0 2024-09-11T00:07:32.417 INFO:tasks.workunit.client.0.smithi111.stdout:8/844: creat d11/d23/d3d/f109 x:0 0 0 2024-09-11T00:07:32.420 INFO:tasks.workunit.client.1.smithi203.stdout:3/831: write d8/da/d37/d83/f107 [115386,57143] 0 2024-09-11T00:07:32.421 INFO:tasks.workunit.client.0.smithi111.stdout:5/881: creat d10/d1e/d23/d30/f121 x:0 0 0 2024-09-11T00:07:32.423 INFO:tasks.workunit.client.1.smithi203.stdout:2/874: unlink d13/fb2 0 2024-09-11T00:07:32.424 INFO:tasks.workunit.client.1.smithi203.stdout:3/832: write d8/da/d5c/f106 [4588893,50292] 0 2024-09-11T00:07:32.427 INFO:tasks.workunit.client.0.smithi111.stdout:8/845: dread d11/f33 [4194304,4194304] 0 2024-09-11T00:07:32.431 INFO:tasks.workunit.client.1.smithi203.stdout:8/728: rmdir d1/d13/d3a/df0 0 2024-09-11T00:07:32.434 INFO:tasks.workunit.client.0.smithi111.stdout:2/785: creat d0/d3/de/d3b/d62/d6d/f10a x:0 0 0 2024-09-11T00:07:32.435 INFO:tasks.workunit.client.0.smithi111.stdout:2/786: stat d0/d3/de/f51 0 2024-09-11T00:07:32.436 INFO:tasks.workunit.client.1.smithi203.stdout:8/729: dread d1/d13/d43/dab/fbd [0,4194304] 0 2024-09-11T00:07:32.437 INFO:tasks.workunit.client.0.smithi111.stdout:7/878: write dd/d1d/d76/db6/fd1 [609988,64340] 0 2024-09-11T00:07:32.438 INFO:tasks.workunit.client.0.smithi111.stdout:0/868: getdents d3/da/d7b/db3/d11c 0 2024-09-11T00:07:32.439 INFO:tasks.workunit.client.0.smithi111.stdout:7/879: truncate dd/d1d/f11e 838850 0 2024-09-11T00:07:32.441 INFO:tasks.workunit.client.0.smithi111.stdout:3/870: read d1c/d1d/d22/d31/d62/f78 [753568,125653] 0 2024-09-11T00:07:32.441 INFO:tasks.workunit.client.1.smithi203.stdout:4/719: fdatasync db/dd/d16/d38/d3c/fc4 0 2024-09-11T00:07:32.442 INFO:tasks.workunit.client.1.smithi203.stdout:7/782: write dd/d1c/d52/d8f/d31/f45 [2197045,46441] 0 2024-09-11T00:07:32.442 INFO:tasks.workunit.client.0.smithi111.stdout:9/872: truncate d6/db/d34/d37/f7e 2598882 0 2024-09-11T00:07:32.443 INFO:tasks.workunit.client.1.smithi203.stdout:0/759: dread d0/d2/f1a [0,4194304] 0 2024-09-11T00:07:32.445 INFO:tasks.workunit.client.1.smithi203.stdout:7/783: dread - dd/d1c/d52/f6f zero size 2024-09-11T00:07:32.446 INFO:tasks.workunit.client.1.smithi203.stdout:8/730: read d1/d13/d43/dab/fbd [342822,67746] 0 2024-09-11T00:07:32.447 INFO:tasks.workunit.client.0.smithi111.stdout:9/873: dread d6/db/d1b/d41/f57 [0,4194304] 0 2024-09-11T00:07:32.447 INFO:tasks.workunit.client.0.smithi111.stdout:5/882: mkdir d10/d1e/d23/d30/d59/d52/d85/d122 0 2024-09-11T00:07:32.451 INFO:tasks.workunit.client.0.smithi111.stdout:8/846: symlink d11/d23/d2c/d53/dbd/l10a 0 2024-09-11T00:07:32.454 INFO:tasks.workunit.client.1.smithi203.stdout:6/758: write d0/d54/d9c/d35/d38/f84 [28068,70095] 0 2024-09-11T00:07:32.455 INFO:tasks.workunit.client.0.smithi111.stdout:4/807: symlink d18/d20/d4a/df9/lff 0 2024-09-11T00:07:32.455 INFO:tasks.workunit.client.1.smithi203.stdout:6/759: readlink d0/d54/d9c/d35/d38/dc0/ddb/d82/lb6 0 2024-09-11T00:07:32.456 INFO:tasks.workunit.client.1.smithi203.stdout:6/760: readlink d0/d71/lb5 0 2024-09-11T00:07:32.457 INFO:tasks.workunit.client.0.smithi111.stdout:4/808: truncate d18/d20/d40/d78/d79/fdd 712277 0 2024-09-11T00:07:32.458 INFO:tasks.workunit.client.0.smithi111.stdout:2/787: mknod d0/d3/d2e/ded/dd8/c10b 0 2024-09-11T00:07:32.460 INFO:tasks.workunit.client.0.smithi111.stdout:0/869: mknod d3/d1c/d50/c12a 0 2024-09-11T00:07:32.464 INFO:tasks.workunit.client.0.smithi111.stdout:3/871: creat d1c/d1d/dac/f12f x:0 0 0 2024-09-11T00:07:32.465 INFO:tasks.workunit.client.0.smithi111.stdout:6/823: link d7/d22/d26/d87/d41/d77/f98 d7/d22/d3f/d74/d7f/d79/f11b 0 2024-09-11T00:07:32.467 INFO:tasks.workunit.client.0.smithi111.stdout:6/824: dread - d7/d22/d26/fcd zero size 2024-09-11T00:07:32.467 INFO:tasks.workunit.client.0.smithi111.stdout:9/874: fdatasync d6/dc/dc1/fe4 0 2024-09-11T00:07:32.467 INFO:tasks.workunit.client.0.smithi111.stdout:3/872: truncate d1c/d1d/d22/d23/d2f/f11a 830872 0 2024-09-11T00:07:32.469 INFO:tasks.workunit.client.0.smithi111.stdout:5/883: symlink d10/d1e/d23/d30/d59/d7b/l123 0 2024-09-11T00:07:32.471 INFO:tasks.workunit.client.0.smithi111.stdout:4/809: dwrite d18/d20/d3c/f9a [0,4194304] 0 2024-09-11T00:07:32.473 INFO:tasks.workunit.client.0.smithi111.stdout:4/810: write d18/d20/f34 [3222510,37497] 0 2024-09-11T00:07:32.474 INFO:tasks.workunit.client.1.smithi203.stdout:3/833: dwrite d8/da/d37/fd5 [0,4194304] 0 2024-09-11T00:07:32.476 INFO:tasks.workunit.client.1.smithi203.stdout:2/875: dread d13/d47/fc7 [0,4194304] 0 2024-09-11T00:07:32.476 INFO:tasks.workunit.client.0.smithi111.stdout:1/822: link d2/de/d12/dc7/lcc d2/de/d12/d6c/df5/l111 0 2024-09-11T00:07:32.477 INFO:tasks.workunit.client.0.smithi111.stdout:4/811: truncate d18/d1f/d36/d95/dde/ff3 4273788 0 2024-09-11T00:07:32.478 INFO:tasks.workunit.client.0.smithi111.stdout:1/823: dread - d2/de/d12/d3c/d4b/fdc zero size 2024-09-11T00:07:32.480 INFO:tasks.workunit.client.0.smithi111.stdout:2/788: symlink d0/d3/de/d4b/dd9/l10c 0 2024-09-11T00:07:32.493 INFO:tasks.workunit.client.0.smithi111.stdout:3/873: mknod d1c/d1d/d22/d23/d2f/d63/c130 0 2024-09-11T00:07:32.495 INFO:tasks.workunit.client.0.smithi111.stdout:9/875: creat d6/d52/d8a/d92/f11b x:0 0 0 2024-09-11T00:07:32.497 INFO:tasks.workunit.client.0.smithi111.stdout:6/825: symlink d7/d22/d2c/d38/d56/dbf/dca/l11c 0 2024-09-11T00:07:32.503 INFO:tasks.workunit.client.0.smithi111.stdout:4/812: mkdir d18/d20/d40/d78/d100 0 2024-09-11T00:07:32.503 INFO:tasks.workunit.client.0.smithi111.stdout:8/847: dwrite d11/d23/d2c/d46/d81/dd2/fda [0,4194304] 0 2024-09-11T00:07:32.510 INFO:tasks.workunit.client.0.smithi111.stdout:0/870: mkdir d3/da/d7b/db3/d11c/d12b 0 2024-09-11T00:07:32.513 INFO:tasks.workunit.client.0.smithi111.stdout:9/876: mkdir d6/db/d7a/d9a/d11c 0 2024-09-11T00:07:32.520 INFO:tasks.workunit.client.0.smithi111.stdout:0/871: dread d3/dc/fa5 [0,4194304] 0 2024-09-11T00:07:32.521 INFO:tasks.workunit.client.1.smithi203.stdout:2/876: dread d13/d15/d30/f91 [0,4194304] 0 2024-09-11T00:07:32.521 INFO:tasks.workunit.client.0.smithi111.stdout:0/872: chown d3/d1c/c9b 1417958 1 2024-09-11T00:07:32.522 INFO:tasks.workunit.client.0.smithi111.stdout:3/874: readlink d1c/d1d/d22/d23/d2f/de8/d5f/lb1 0 2024-09-11T00:07:32.525 INFO:tasks.workunit.client.1.smithi203.stdout:4/720: mknod db/dd/d26/d42/ce4 0 2024-09-11T00:07:32.525 INFO:tasks.workunit.client.0.smithi111.stdout:7/880: sync 2024-09-11T00:07:32.530 INFO:tasks.workunit.client.0.smithi111.stdout:9/877: creat d6/db/db8/dce/f11d x:0 0 0 2024-09-11T00:07:32.533 INFO:tasks.workunit.client.0.smithi111.stdout:6/826: creat d7/d22/d2c/dff/d110/f11d x:0 0 0 2024-09-11T00:07:32.534 INFO:tasks.workunit.client.0.smithi111.stdout:4/813: symlink d18/d20/de0/l101 0 2024-09-11T00:07:32.537 INFO:tasks.workunit.client.0.smithi111.stdout:8/848: rmdir d11/d23/d3d/dca/dcf 39 2024-09-11T00:07:32.538 INFO:tasks.workunit.client.0.smithi111.stdout:6/827: chown d7/d22/d2c/d38/d56/dbf/dca/l11c 38583052 1 2024-09-11T00:07:32.540 INFO:tasks.workunit.client.0.smithi111.stdout:0/873: symlink d3/daf/db2/l12c 0 2024-09-11T00:07:32.541 INFO:tasks.workunit.client.1.smithi203.stdout:3/834: mkdir d8/d2a/d127 0 2024-09-11T00:07:32.541 INFO:tasks.workunit.client.0.smithi111.stdout:1/824: dwrite d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/fa0 [0,4194304] 0 2024-09-11T00:07:32.541 INFO:tasks.workunit.client.0.smithi111.stdout:0/874: chown d3/d26/d77 488646329 1 2024-09-11T00:07:32.544 INFO:tasks.workunit.client.0.smithi111.stdout:5/884: truncate d10/d1e/d23/d30/dd8/da2/f58 4059762 0 2024-09-11T00:07:32.544 INFO:tasks.workunit.client.0.smithi111.stdout:2/789: dwrite d0/d3/de/d4b/fb2 [0,4194304] 0 2024-09-11T00:07:32.544 INFO:tasks.workunit.client.0.smithi111.stdout:0/875: chown d3/d13/f6f 3225 1 2024-09-11T00:07:32.547 INFO:tasks.workunit.client.1.smithi203.stdout:4/721: mkdir db/d12/d15/d2a/dcb/de5 0 2024-09-11T00:07:32.550 INFO:tasks.workunit.client.0.smithi111.stdout:2/790: write d0/d3/de/f11 [3971706,51564] 0 2024-09-11T00:07:32.552 INFO:tasks.workunit.client.0.smithi111.stdout:2/791: fdatasync d0/d3/de/d3b/fe9 0 2024-09-11T00:07:32.552 INFO:tasks.workunit.client.0.smithi111.stdout:9/878: symlink d6/db/db8/l11e 0 2024-09-11T00:07:32.555 INFO:tasks.workunit.client.0.smithi111.stdout:2/792: dread - d0/d3/d2e/ded/dd8/fee zero size 2024-09-11T00:07:32.558 INFO:tasks.workunit.client.1.smithi203.stdout:0/760: write d0/d2/f81 [7059430,100772] 0 2024-09-11T00:07:32.563 INFO:tasks.workunit.client.1.smithi203.stdout:7/784: write dd/d1c/d52/d8f/d31/d58/d93/d98/faf [3879712,25493] 0 2024-09-11T00:07:32.563 INFO:tasks.workunit.client.0.smithi111.stdout:8/849: unlink f7 0 2024-09-11T00:07:32.566 INFO:tasks.workunit.client.1.smithi203.stdout:2/877: creat d13/d22/dd6/f126 x:0 0 0 2024-09-11T00:07:32.567 INFO:tasks.workunit.client.0.smithi111.stdout:6/828: rmdir d7/d22/d26 39 2024-09-11T00:07:32.570 INFO:tasks.workunit.client.1.smithi203.stdout:4/722: truncate db/dd/d26/d42/d5e/fb8 711450 0 2024-09-11T00:07:32.572 INFO:tasks.workunit.client.0.smithi111.stdout:3/875: write d1c/d21/f3a [3289534,50996] 0 2024-09-11T00:07:32.575 INFO:tasks.workunit.client.1.smithi203.stdout:6/761: write d0/d54/d9c/d35/d38/dc0/ddb/f7f [166440,66028] 0 2024-09-11T00:07:32.577 INFO:tasks.workunit.client.1.smithi203.stdout:4/723: write db/d12/d15/d2a/d88/fc1 [1428745,121065] 0 2024-09-11T00:07:32.577 INFO:tasks.workunit.client.0.smithi111.stdout:2/793: dread d0/d3/de/d3b/d63/fa5 [0,4194304] 0 2024-09-11T00:07:32.580 INFO:tasks.workunit.client.1.smithi203.stdout:0/761: creat d0/d2/d7e/da1/dc9/de7/d77/ffc x:0 0 0 2024-09-11T00:07:32.582 INFO:tasks.workunit.client.1.smithi203.stdout:0/762: chown d0/df8 13987987 1 2024-09-11T00:07:32.583 INFO:tasks.workunit.client.0.smithi111.stdout:6/829: dwrite d7/f105 [0,4194304] 0 2024-09-11T00:07:32.583 INFO:tasks.workunit.client.1.smithi203.stdout:3/835: write d8/da/d11/f5d [2755302,50073] 0 2024-09-11T00:07:32.584 INFO:tasks.workunit.client.0.smithi111.stdout:7/881: mkdir dd/d122 0 2024-09-11T00:07:32.586 INFO:tasks.workunit.client.0.smithi111.stdout:6/830: write d7/d22/d3f/d74/f96 [2174865,120102] 0 2024-09-11T00:07:32.586 INFO:tasks.workunit.client.1.smithi203.stdout:8/731: dwrite d1/f3b [0,4194304] 0 2024-09-11T00:07:32.589 INFO:tasks.workunit.client.0.smithi111.stdout:1/825: write d2/de/d12/d88/fac [741431,107718] 0 2024-09-11T00:07:32.589 INFO:tasks.workunit.client.0.smithi111.stdout:4/814: dwrite d18/f32 [0,4194304] 0 2024-09-11T00:07:32.593 INFO:tasks.workunit.client.1.smithi203.stdout:8/732: write d1/fc [12964138,85384] 0 2024-09-11T00:07:32.597 INFO:tasks.workunit.client.0.smithi111.stdout:5/885: fsync d10/d1e/d23/f10e 0 2024-09-11T00:07:32.600 INFO:tasks.workunit.client.1.smithi203.stdout:4/724: mkdir db/d12/d15/d2a/d88/d95/dc2/de6 0 2024-09-11T00:07:32.600 INFO:tasks.workunit.client.1.smithi203.stdout:2/878: mkdir d13/d15/d30/d5a/d8b/df7/d127 0 2024-09-11T00:07:32.607 INFO:tasks.workunit.client.0.smithi111.stdout:6/831: chown d7/d22/d3f/d74/d7f/d61/d6a/c76 1474344 1 2024-09-11T00:07:32.613 INFO:tasks.workunit.client.0.smithi111.stdout:8/850: mkdir d11/d23/d3d/d10b 0 2024-09-11T00:07:32.615 INFO:tasks.workunit.client.1.smithi203.stdout:6/762: truncate d0/d54/d9c/d35/d38/d73/d74/fa7 3573186 0 2024-09-11T00:07:32.619 INFO:tasks.workunit.client.0.smithi111.stdout:9/879: sync 2024-09-11T00:07:32.619 INFO:tasks.workunit.client.0.smithi111.stdout:3/876: mkdir d1c/d1d/d22/d23/d58/d131 0 2024-09-11T00:07:32.621 INFO:tasks.workunit.client.0.smithi111.stdout:6/832: dread d7/d22/d1d/d69/ff1 [0,4194304] 0 2024-09-11T00:07:32.622 INFO:tasks.workunit.client.1.smithi203.stdout:0/763: fdatasync d0/d2/f8 0 2024-09-11T00:07:32.623 INFO:tasks.workunit.client.0.smithi111.stdout:1/826: truncate d2/de/d12/d3c/d4b/d6a/d63/d73/da1/fe8 146194 0 2024-09-11T00:07:32.623 INFO:tasks.workunit.client.0.smithi111.stdout:1/827: stat d2/d2b 0 2024-09-11T00:07:32.625 INFO:tasks.workunit.client.0.smithi111.stdout:1/828: readlink d2/de/d12/d3c/l48 0 2024-09-11T00:07:32.628 INFO:tasks.workunit.client.1.smithi203.stdout:7/785: dread dd/d1c/f29 [4194304,4194304] 0 2024-09-11T00:07:32.629 INFO:tasks.workunit.client.0.smithi111.stdout:0/876: dwrite d3/d1c/dd0/fe4 [0,4194304] 0 2024-09-11T00:07:32.631 INFO:tasks.workunit.client.0.smithi111.stdout:5/886: truncate d10/d1e/d23/d2b/d5c/fb3 713999 0 2024-09-11T00:07:32.633 INFO:tasks.workunit.client.0.smithi111.stdout:5/887: readlink d10/d1e/d23/d30/d59/dd1/df6/d111/l112 0 2024-09-11T00:07:32.641 INFO:tasks.workunit.client.1.smithi203.stdout:0/764: creat d0/d2/d37/d80/ffd x:0 0 0 2024-09-11T00:07:32.643 INFO:tasks.workunit.client.1.smithi203.stdout:0/765: fsync d0/dc5/ff1 0 2024-09-11T00:07:32.646 INFO:tasks.workunit.client.0.smithi111.stdout:9/880: chown d6/ddd/c106 1161303 1 2024-09-11T00:07:32.651 INFO:tasks.workunit.client.1.smithi203.stdout:6/763: mknod d0/d54/d9c/cf3 0 2024-09-11T00:07:32.652 INFO:tasks.workunit.client.0.smithi111.stdout:2/794: rename d0/d3/de/d3b/d92/fc3 to d0/d3/de/f10d 0 2024-09-11T00:07:32.653 INFO:tasks.workunit.client.1.smithi203.stdout:3/836: write d8/d17/ddd/fe4 [4862997,23858] 0 2024-09-11T00:07:32.657 INFO:tasks.workunit.client.1.smithi203.stdout:8/733: dwrite d1/d13/d17/d8b/fcb [0,4194304] 0 2024-09-11T00:07:32.657 INFO:tasks.workunit.client.1.smithi203.stdout:2/879: dwrite d13/d15/d19/d1c/d73/dc8/fe2 [0,4194304] 0 2024-09-11T00:07:32.660 INFO:tasks.workunit.client.0.smithi111.stdout:1/829: dread - d2/de/d12/d3c/fb2 zero size 2024-09-11T00:07:32.661 INFO:tasks.workunit.client.1.smithi203.stdout:0/766: rename d0/d2/f81 to d0/df8/ffe 0 2024-09-11T00:07:32.663 INFO:tasks.workunit.client.0.smithi111.stdout:7/882: creat dd/d48/f123 x:0 0 0 2024-09-11T00:07:32.668 INFO:tasks.workunit.client.0.smithi111.stdout:0/877: mkdir d3/d13/d1e/d29/d49/df2/d12d 0 2024-09-11T00:07:32.672 INFO:tasks.workunit.client.0.smithi111.stdout:5/888: fsync d10/d1e/d23/d30/dd8/da2/d66/d76/fae 0 2024-09-11T00:07:32.674 INFO:tasks.workunit.client.1.smithi203.stdout:4/725: link db/d12/d15/d2a/l85 db/dd/d16/d38/le7 0 2024-09-11T00:07:32.677 INFO:tasks.workunit.client.1.smithi203.stdout:4/726: fsync db/d12/d15/d2a/d71/f94 0 2024-09-11T00:07:32.679 INFO:tasks.workunit.client.0.smithi111.stdout:8/851: mkdir d11/d23/d3d/d5f/d99/d10c 0 2024-09-11T00:07:32.682 INFO:tasks.workunit.client.0.smithi111.stdout:9/881: readlink d6/l31 0 2024-09-11T00:07:32.683 INFO:tasks.workunit.client.0.smithi111.stdout:6/833: creat d7/d22/d3f/d74/d7f/d79/da4/d117/f11e x:0 0 0 2024-09-11T00:07:32.686 INFO:tasks.workunit.client.0.smithi111.stdout:3/877: truncate d1c/d1d/d22/d44/d5a/dcd/dd2/def/df5/f118 2102731 0 2024-09-11T00:07:32.687 INFO:tasks.workunit.client.0.smithi111.stdout:3/878: readlink d1c/d1d/d22/d23/l51 0 2024-09-11T00:07:32.690 INFO:tasks.workunit.client.0.smithi111.stdout:4/815: rename d18/d1f/d33/fbf to d18/d20/d4a/d6b/ded/df6/f102 0 2024-09-11T00:07:32.695 INFO:tasks.workunit.client.0.smithi111.stdout:1/830: mknod d2/de/d93/d9f/dc0/c112 0 2024-09-11T00:07:32.696 INFO:tasks.workunit.client.1.smithi203.stdout:0/767: symlink d0/d1d/d4c/lff 0 2024-09-11T00:07:32.697 INFO:tasks.workunit.client.0.smithi111.stdout:1/831: truncate d2/d2b/f10a 422682 0 2024-09-11T00:07:32.697 INFO:tasks.workunit.client.0.smithi111.stdout:7/883: write dd/d1d/d7e/dc8/f64 [2798754,13424] 0 2024-09-11T00:07:32.698 INFO:tasks.workunit.client.1.smithi203.stdout:0/768: write d0/d2/d92/fd9 [1767548,3368] 0 2024-09-11T00:07:32.698 INFO:tasks.workunit.client.0.smithi111.stdout:1/832: stat d2/de/d93/d9f/c60 0 2024-09-11T00:07:32.699 INFO:tasks.workunit.client.1.smithi203.stdout:6/764: getdents d0/d32/d5a/ddd 0 2024-09-11T00:07:32.700 INFO:tasks.workunit.client.0.smithi111.stdout:7/884: readlink dd/d1d/d7e/df8/d8f/d9f/d79/la9 0 2024-09-11T00:07:32.700 INFO:tasks.workunit.client.0.smithi111.stdout:8/852: dread d11/d23/d2c/d46/d64/fa6 [0,4194304] 0 2024-09-11T00:07:32.701 INFO:tasks.workunit.client.1.smithi203.stdout:0/769: write d0/f8c [1052153,24220] 0 2024-09-11T00:07:32.701 INFO:tasks.workunit.client.0.smithi111.stdout:6/834: readlink d7/l6f 0 2024-09-11T00:07:32.702 INFO:tasks.workunit.client.0.smithi111.stdout:7/885: chown dd/d1d/f39 9 1 2024-09-11T00:07:32.702 INFO:tasks.workunit.client.1.smithi203.stdout:4/727: unlink db/dd/d26/d42/d5e/fb8 0 2024-09-11T00:07:32.702 INFO:tasks.workunit.client.1.smithi203.stdout:3/837: link d8/dce/f101 d8/da/d37/d53/da2/d122/f128 0 2024-09-11T00:07:32.703 INFO:tasks.workunit.client.0.smithi111.stdout:6/835: chown d7/d22/d2c/dff 16757546 1 2024-09-11T00:07:32.704 INFO:tasks.workunit.client.1.smithi203.stdout:6/765: fdatasync d0/d5b/d5c/fa8 0 2024-09-11T00:07:32.704 INFO:tasks.workunit.client.1.smithi203.stdout:0/770: fdatasync d0/d2/f9c 0 2024-09-11T00:07:32.706 INFO:tasks.workunit.client.0.smithi111.stdout:3/879: unlink d1c/d1d/d22/d31/f87 0 2024-09-11T00:07:32.707 INFO:tasks.workunit.client.1.smithi203.stdout:8/734: link d1/d13/d17/d2f/d52/d49/lc4 d1/d13/d17/d48/d9d/lf8 0 2024-09-11T00:07:32.709 INFO:tasks.workunit.client.0.smithi111.stdout:2/795: mkdir d0/d3/de/d10e 0 2024-09-11T00:07:32.711 INFO:tasks.workunit.client.1.smithi203.stdout:3/838: symlink d8/da/d37/d53/dea/de8/l129 0 2024-09-11T00:07:32.714 INFO:tasks.workunit.client.1.smithi203.stdout:8/735: rmdir d1/d13/d43 39 2024-09-11T00:07:32.719 INFO:tasks.workunit.client.1.smithi203.stdout:0/771: unlink d0/d2/d37/d7f/ca3 0 2024-09-11T00:07:32.720 INFO:tasks.workunit.client.1.smithi203.stdout:4/728: dread db/dd/d16/d38/f74 [0,4194304] 0 2024-09-11T00:07:32.721 INFO:tasks.workunit.client.0.smithi111.stdout:1/833: dread - d2/de/d12/faa zero size 2024-09-11T00:07:32.723 INFO:tasks.workunit.client.0.smithi111.stdout:8/853: creat d11/d21/d6f/dab/f10d x:0 0 0 2024-09-11T00:07:32.724 INFO:tasks.workunit.client.1.smithi203.stdout:6/766: read d0/d54/d9c/d35/d38/d73/d74/fec [102092,2661] 0 2024-09-11T00:07:32.727 INFO:tasks.workunit.client.0.smithi111.stdout:7/886: rmdir dd/da6 39 2024-09-11T00:07:32.728 INFO:tasks.workunit.client.0.smithi111.stdout:7/887: chown dd/d1d/d76/l9a 3313205 1 2024-09-11T00:07:32.732 INFO:tasks.workunit.client.0.smithi111.stdout:4/816: dread d18/d20/d3c/f58 [0,4194304] 0 2024-09-11T00:07:32.734 INFO:tasks.workunit.client.1.smithi203.stdout:0/772: dwrite d0/f18 [0,4194304] 0 2024-09-11T00:07:32.735 INFO:tasks.workunit.client.1.smithi203.stdout:4/729: symlink db/dd/d26/dcd/le8 0 2024-09-11T00:07:32.735 INFO:tasks.workunit.client.0.smithi111.stdout:1/834: mkdir d2/de/d12/d3c/d4b/d6a/d63/d113 0 2024-09-11T00:07:32.738 INFO:tasks.workunit.client.1.smithi203.stdout:3/839: rename d8/c1e to d8/da/d37/d83/d65/d8b/c12a 0 2024-09-11T00:07:32.740 INFO:tasks.workunit.client.0.smithi111.stdout:0/878: truncate d3/d1c/dd0/fe4 1982091 0 2024-09-11T00:07:32.742 INFO:tasks.workunit.client.0.smithi111.stdout:0/879: chown d3/d26/d77/f45 1832411062 1 2024-09-11T00:07:32.744 INFO:tasks.workunit.client.0.smithi111.stdout:5/889: rename l9 to d10/d1e/d23/d30/dd8/d63/l124 0 2024-09-11T00:07:32.747 INFO:tasks.workunit.client.1.smithi203.stdout:0/773: unlink d0/fc2 0 2024-09-11T00:07:32.748 INFO:tasks.workunit.client.1.smithi203.stdout:8/736: write d1/d13/d17/d2f/d52/f92 [927266,48930] 0 2024-09-11T00:07:32.750 INFO:tasks.workunit.client.1.smithi203.stdout:0/774: write d0/d1d/f44 [3070681,74599] 0 2024-09-11T00:07:32.751 INFO:tasks.workunit.client.0.smithi111.stdout:1/835: chown d2/de/d12/d3c/d4b/d6a/d63/d73/da1/lfe 259858 1 2024-09-11T00:07:32.752 INFO:tasks.workunit.client.0.smithi111.stdout:8/854: mknod d11/d23/d3d/d8d/c10e 0 2024-09-11T00:07:32.754 INFO:tasks.workunit.client.1.smithi203.stdout:4/730: symlink db/d12/d15/d2a/d71/le9 0 2024-09-11T00:07:32.756 INFO:tasks.workunit.client.1.smithi203.stdout:4/731: chown db 512013 1 2024-09-11T00:07:32.757 INFO:tasks.workunit.client.0.smithi111.stdout:0/880: dread d3/d13/f10f [0,4194304] 0 2024-09-11T00:07:32.759 INFO:tasks.workunit.client.1.smithi203.stdout:0/775: truncate d0/d2/d37/d5b/fda 420324 0 2024-09-11T00:07:32.764 INFO:tasks.workunit.client.1.smithi203.stdout:4/732: write db/dd/d16/d38/f3b [1000759,29102] 0 2024-09-11T00:07:32.768 INFO:tasks.workunit.client.1.smithi203.stdout:4/733: stat db/dd/d26/d42/d5e/l62 0 2024-09-11T00:07:32.768 INFO:tasks.workunit.client.1.smithi203.stdout:3/840: dwrite d8/da/d37/d83/da3/fca [0,4194304] 0 2024-09-11T00:07:32.771 INFO:tasks.workunit.client.0.smithi111.stdout:1/836: dwrite d2/de/d12/f1c [0,4194304] 0 2024-09-11T00:07:32.774 INFO:tasks.workunit.client.0.smithi111.stdout:0/881: fdatasync d3/d13/d1e/d29/f9a 0 2024-09-11T00:07:32.777 INFO:tasks.workunit.client.0.smithi111.stdout:7/888: dread dd/d1d/d1f/f23 [0,4194304] 0 2024-09-11T00:07:32.783 INFO:tasks.workunit.client.1.smithi203.stdout:4/734: creat db/dd/d26/fea x:0 0 0 2024-09-11T00:07:32.785 INFO:tasks.workunit.client.1.smithi203.stdout:4/735: readlink db/d12/d15/lbb 0 2024-09-11T00:07:32.786 INFO:tasks.workunit.client.1.smithi203.stdout:3/841: rename d8/da/d5c/f61 to d8/da/d37/d11e/f12b 0 2024-09-11T00:07:32.786 INFO:tasks.workunit.client.0.smithi111.stdout:9/882: rename d6/dc/d7c to d6/db/d1b/d11f 0 2024-09-11T00:07:32.786 INFO:tasks.workunit.client.0.smithi111.stdout:4/817: dwrite d18/d20/d3c/d5e/daa/fc6 [0,4194304] 0 2024-09-11T00:07:32.787 INFO:tasks.workunit.client.1.smithi203.stdout:6/767: dwrite d0/d32/f43 [0,4194304] 0 2024-09-11T00:07:32.788 INFO:tasks.workunit.client.1.smithi203.stdout:8/737: truncate d1/d13/d17/d2f/d52/d49/f93 718595 0 2024-09-11T00:07:32.790 INFO:tasks.workunit.client.0.smithi111.stdout:5/890: link d10/d1e/d23/d2b/d2f/fda d10/d1e/d23/d2b/d92/f125 0 2024-09-11T00:07:32.791 INFO:tasks.workunit.client.0.smithi111.stdout:4/818: read d18/d20/d40/d78/fb2 [3129343,2775] 0 2024-09-11T00:07:32.805 INFO:tasks.workunit.client.0.smithi111.stdout:9/883: mkdir d6/d52/d8a/d8e/d120 0 2024-09-11T00:07:32.806 INFO:tasks.workunit.client.1.smithi203.stdout:6/768: symlink d0/d5b/d5c/lf4 0 2024-09-11T00:07:32.807 INFO:tasks.workunit.client.0.smithi111.stdout:1/837: symlink d2/d2b/dc9/df0/l114 0 2024-09-11T00:07:32.807 INFO:tasks.workunit.client.1.smithi203.stdout:6/769: chown d0/d5b/f8f 12 1 2024-09-11T00:07:32.810 INFO:tasks.workunit.client.0.smithi111.stdout:0/882: dread d3/d13/d1e/deb/d61/d93/fa1 [0,4194304] 0 2024-09-11T00:07:32.812 INFO:tasks.workunit.client.0.smithi111.stdout:8/855: getdents d11/d21/d6f/dab 0 2024-09-11T00:07:32.815 INFO:tasks.workunit.client.0.smithi111.stdout:4/819: creat d18/d3b/d51/f103 x:0 0 0 2024-09-11T00:07:32.817 INFO:tasks.workunit.client.1.smithi203.stdout:3/842: dread d8/da/d37/fd5 [0,4194304] 0 2024-09-11T00:07:32.818 INFO:tasks.workunit.client.1.smithi203.stdout:1/900: sync 2024-09-11T00:07:32.819 INFO:tasks.workunit.client.1.smithi203.stdout:6/770: truncate d0/f95 4641074 0 2024-09-11T00:07:32.820 INFO:tasks.workunit.client.1.smithi203.stdout:4/736: link db/dd/c44 db/dd/d16/ceb 0 2024-09-11T00:07:32.822 INFO:tasks.workunit.client.0.smithi111.stdout:6/836: rename d7/d22/d3f/d74/d7f/d61/d6a/l9d to d7/d22/d2c/dff/d110/l11f 0 2024-09-11T00:07:32.824 INFO:tasks.workunit.client.0.smithi111.stdout:0/883: dread d3/d74/fae [0,4194304] 0 2024-09-11T00:07:32.825 INFO:tasks.workunit.client.1.smithi203.stdout:3/843: mknod d8/da/d37/d83/d65/d8b/c12c 0 2024-09-11T00:07:32.828 INFO:tasks.workunit.client.0.smithi111.stdout:1/838: symlink d2/de/d12/d3c/d4b/d6a/d63/d73/da1/db9/l115 0 2024-09-11T00:07:32.828 INFO:tasks.workunit.client.1.smithi203.stdout:1/901: creat d8/d19/d60/d90/d3e/d4b/d80/d8d/da3/f145 x:0 0 0 2024-09-11T00:07:32.829 INFO:tasks.workunit.client.0.smithi111.stdout:7/889: dwrite dd/f3a [0,4194304] 0 2024-09-11T00:07:32.832 INFO:tasks.workunit.client.1.smithi203.stdout:6/771: creat d0/d54/d9c/d35/d39/db2/ff5 x:0 0 0 2024-09-11T00:07:32.834 INFO:tasks.workunit.client.0.smithi111.stdout:6/837: symlink d7/d22/d2c/dff/d110/l120 0 2024-09-11T00:07:32.835 INFO:tasks.workunit.client.0.smithi111.stdout:1/839: creat d2/de/d12/d3c/d4b/d6a/d63/f116 x:0 0 0 2024-09-11T00:07:32.839 INFO:tasks.workunit.client.0.smithi111.stdout:5/891: link d10/d1e/d23/d30/dd8/da2/fcf d10/d1e/d23/d2b/d5c/d61/f126 0 2024-09-11T00:07:32.846 INFO:tasks.workunit.client.0.smithi111.stdout:3/880: rename d1c/d1d/d22/d23/d2f/de8/lea to d1c/d1d/d22/d23/dff/l132 0 2024-09-11T00:07:32.846 INFO:tasks.workunit.client.1.smithi203.stdout:8/738: rename d1/d13/d43/d46/db0/fce to d1/d13/d17/d48/d61/ff9 0 2024-09-11T00:07:32.850 INFO:tasks.workunit.client.0.smithi111.stdout:3/881: read d1c/d1d/d22/d31/d62/dc7/f103 [231720,42731] 0 2024-09-11T00:07:32.853 INFO:tasks.workunit.client.0.smithi111.stdout:7/890: dread - dd/da6/fed zero size 2024-09-11T00:07:32.853 INFO:tasks.workunit.client.0.smithi111.stdout:1/840: mknod d2/de/d93/c117 0 2024-09-11T00:07:32.856 INFO:tasks.workunit.client.1.smithi203.stdout:3/844: dread d8/da/d37/d83/da3/fca [0,4194304] 0 2024-09-11T00:07:32.857 INFO:tasks.workunit.client.1.smithi203.stdout:4/737: dwrite db/dd/d16/d38/d3c/fdc [0,4194304] 0 2024-09-11T00:07:32.857 INFO:tasks.workunit.client.0.smithi111.stdout:4/820: truncate d18/d20/d40/d78/f86 4176449 0 2024-09-11T00:07:32.859 INFO:tasks.workunit.client.1.smithi203.stdout:1/902: mkdir d8/d9/d15/d35/d146 0 2024-09-11T00:07:32.863 INFO:tasks.workunit.client.0.smithi111.stdout:9/884: write d6/db/f6d [384648,96302] 0 2024-09-11T00:07:32.867 INFO:tasks.workunit.client.1.smithi203.stdout:8/739: truncate d1/d13/d43/d46/d76/f98 393771 0 2024-09-11T00:07:32.867 INFO:tasks.workunit.client.1.smithi203.stdout:8/740: chown d1/f3f 67232425 1 2024-09-11T00:07:32.872 INFO:tasks.workunit.client.0.smithi111.stdout:9/885: dread d6/db/d34/fca [0,4194304] 0 2024-09-11T00:07:32.872 INFO:tasks.workunit.client.1.smithi203.stdout:1/903: read - d8/d19/d60/d90/d3e/dfe/f141 zero size 2024-09-11T00:07:32.873 INFO:tasks.workunit.client.1.smithi203.stdout:4/738: rename db/dd/d16/d38/d3c/d41/c6a to db/d12/d15/d2a/d88/d95/dc2/cec 0 2024-09-11T00:07:32.875 INFO:tasks.workunit.client.1.smithi203.stdout:8/741: mkdir d1/d13/d17/d48/dfa 0 2024-09-11T00:07:32.876 INFO:tasks.workunit.client.0.smithi111.stdout:5/892: dread d10/d1e/d25/f75 [0,4194304] 0 2024-09-11T00:07:32.878 INFO:tasks.workunit.client.0.smithi111.stdout:3/882: read - d1c/f9e zero size 2024-09-11T00:07:32.879 INFO:tasks.workunit.client.0.smithi111.stdout:8/856: dwrite d11/d23/d2c/d46/f4d [0,4194304] 0 2024-09-11T00:07:32.880 INFO:tasks.workunit.client.0.smithi111.stdout:8/857: readlink d11/d21/la2 0 2024-09-11T00:07:32.880 INFO:tasks.workunit.client.1.smithi203.stdout:1/904: symlink d8/d19/d60/dff/l147 0 2024-09-11T00:07:32.884 INFO:tasks.workunit.client.1.smithi203.stdout:6/772: dwrite d0/f2a [4194304,4194304] 0 2024-09-11T00:07:32.886 INFO:tasks.workunit.client.0.smithi111.stdout:6/838: write d7/d22/d1d/d83/fa1 [1502157,39546] 0 2024-09-11T00:07:32.888 INFO:tasks.workunit.client.1.smithi203.stdout:1/905: mknod d8/d19/d60/d90/d3e/d9b/c148 0 2024-09-11T00:07:32.897 INFO:tasks.workunit.client.0.smithi111.stdout:0/884: getdents d3 0 2024-09-11T00:07:32.900 INFO:tasks.workunit.client.1.smithi203.stdout:6/773: fdatasync d0/d54/d9c/d7b/fd1 0 2024-09-11T00:07:32.900 INFO:tasks.workunit.client.1.smithi203.stdout:3/845: write d8/d17/fdb [825114,62809] 0 2024-09-11T00:07:32.901 INFO:tasks.workunit.client.1.smithi203.stdout:8/742: dwrite d1/d13/d43/d46/db0/fd4 [0,4194304] 0 2024-09-11T00:07:32.902 INFO:tasks.workunit.client.1.smithi203.stdout:1/906: creat d8/d19/d60/d90/d3e/d9b/f149 x:0 0 0 2024-09-11T00:07:32.904 INFO:tasks.workunit.client.0.smithi111.stdout:3/883: mknod d1c/d126/c133 0 2024-09-11T00:07:32.907 INFO:tasks.workunit.client.1.smithi203.stdout:1/907: readlink d8/l37 0 2024-09-11T00:07:32.912 INFO:tasks.workunit.client.1.smithi203.stdout:3/846: rename d8/da/db3/ffa to d8/da/d37/d53/dea/de5/f12d 0 2024-09-11T00:07:32.914 INFO:tasks.workunit.client.1.smithi203.stdout:3/847: chown d8/da/d37/d83/d65/f66 750 1 2024-09-11T00:07:32.915 INFO:tasks.workunit.client.1.smithi203.stdout:6/774: creat d0/d5b/ff6 x:0 0 0 2024-09-11T00:07:32.916 INFO:tasks.workunit.client.1.smithi203.stdout:6/775: fsync d0/d32/f58 0 2024-09-11T00:07:32.916 INFO:tasks.workunit.client.0.smithi111.stdout:2/796: rename d0/d3/d12/c1b to d0/d3/c10f 0 2024-09-11T00:07:32.924 INFO:tasks.workunit.client.0.smithi111.stdout:4/821: write d18/d39/fc8 [3087165,76329] 0 2024-09-11T00:07:32.926 INFO:tasks.workunit.client.1.smithi203.stdout:3/848: mknod d8/d3c/c12e 0 2024-09-11T00:07:32.929 INFO:tasks.workunit.client.0.smithi111.stdout:5/893: symlink d10/d1e/d23/d30/d59/d52/d85/d122/l127 0 2024-09-11T00:07:32.930 INFO:tasks.workunit.client.0.smithi111.stdout:2/797: dread d0/d3/f3e [0,4194304] 0 2024-09-11T00:07:32.934 INFO:tasks.workunit.client.1.smithi203.stdout:1/908: creat d8/d19/d60/d90/d3e/dfe/f14a x:0 0 0 2024-09-11T00:07:32.934 INFO:tasks.workunit.client.1.smithi203.stdout:8/743: dread d1/d13/d17/d77/dea/da6/fcd [0,4194304] 0 2024-09-11T00:07:32.934 INFO:tasks.workunit.client.0.smithi111.stdout:9/886: dread d6/dc/d73/fb9 [0,4194304] 0 2024-09-11T00:07:32.941 INFO:tasks.workunit.client.0.smithi111.stdout:7/891: write f8 [4744407,57435] 0 2024-09-11T00:07:32.942 INFO:tasks.workunit.client.0.smithi111.stdout:4/822: dwrite d18/d20/d40/d78/fd3 [0,4194304] 0 2024-09-11T00:07:32.943 INFO:tasks.workunit.client.0.smithi111.stdout:1/841: getdents d2/d2b 0 2024-09-11T00:07:32.944 INFO:tasks.workunit.client.1.smithi203.stdout:1/909: mkdir d8/d19/d60/d90/d3e/d4b/d41/d14b 0 2024-09-11T00:07:32.946 INFO:tasks.workunit.client.1.smithi203.stdout:6/776: link d0/d54/d9c/d7b/f8a d0/d71/db9/ff7 0 2024-09-11T00:07:32.949 INFO:tasks.workunit.client.0.smithi111.stdout:5/894: dwrite d10/d1e/d23/d30/dd8/f110 [0,4194304] 0 2024-09-11T00:07:32.958 INFO:tasks.workunit.client.0.smithi111.stdout:8/858: truncate d11/f12 9732161 0 2024-09-11T00:07:32.960 INFO:tasks.workunit.client.1.smithi203.stdout:6/777: fsync d0/d32/d5a/fb7 0 2024-09-11T00:07:32.960 INFO:tasks.workunit.client.0.smithi111.stdout:8/859: write d11/d23/d3d/d8d/fa3 [5824754,58182] 0 2024-09-11T00:07:32.962 INFO:tasks.workunit.client.1.smithi203.stdout:3/849: write d8/da/d37/d83/d6a/dad/f100 [4228489,48099] 0 2024-09-11T00:07:32.964 INFO:tasks.workunit.client.0.smithi111.stdout:7/892: symlink dd/d1d/d2d/l124 0 2024-09-11T00:07:32.967 INFO:tasks.workunit.client.0.smithi111.stdout:7/893: fdatasync dd/d1d/d2d/d2e/f11f 0 2024-09-11T00:07:32.968 INFO:tasks.workunit.client.1.smithi203.stdout:6/778: unlink d0/d32/f34 0 2024-09-11T00:07:32.969 INFO:tasks.workunit.client.0.smithi111.stdout:8/860: dread d11/f9c [0,4194304] 0 2024-09-11T00:07:32.970 INFO:tasks.workunit.client.0.smithi111.stdout:6/839: dwrite d7/fd [0,4194304] 0 2024-09-11T00:07:32.970 INFO:tasks.workunit.client.0.smithi111.stdout:8/861: stat d11/fa1 0 2024-09-11T00:07:32.971 INFO:tasks.workunit.client.0.smithi111.stdout:3/884: truncate d1c/d21/f3a 200923 0 2024-09-11T00:07:32.973 INFO:tasks.workunit.client.0.smithi111.stdout:3/885: chown d1c/d1d/d22/d23/laf 7685496 1 2024-09-11T00:07:32.977 INFO:tasks.workunit.client.1.smithi203.stdout:8/744: dwrite d1/d13/d22/d6f/f60 [0,4194304] 0 2024-09-11T00:07:32.977 INFO:tasks.workunit.client.0.smithi111.stdout:5/895: fsync d10/d1e/d23/fa1 0 2024-09-11T00:07:32.977 INFO:tasks.workunit.client.1.smithi203.stdout:1/910: link d8/d19/d60/d90/d3e/d4b/cde d8/d19/d60/d90/d3e/d4b/d80/d91/c14c 0 2024-09-11T00:07:32.981 INFO:tasks.workunit.client.1.smithi203.stdout:3/850: creat d8/d2a/dd0/d121/f12f x:0 0 0 2024-09-11T00:07:32.983 INFO:tasks.workunit.client.1.smithi203.stdout:1/911: dread - d8/d19/d60/d90/d3e/d9b/f149 zero size 2024-09-11T00:07:32.984 INFO:tasks.workunit.client.1.smithi203.stdout:8/745: read d1/d13/d3a/d75/fdd [2984264,86181] 0 2024-09-11T00:07:32.986 INFO:tasks.workunit.client.1.smithi203.stdout:1/912: chown d8/d9/d15/d35/d146 48149450 1 2024-09-11T00:07:32.990 INFO:tasks.workunit.client.1.smithi203.stdout:1/913: chown d8/d19/d60/d90/d3e/f12c 1541684 1 2024-09-11T00:07:32.990 INFO:tasks.workunit.client.1.smithi203.stdout:6/779: link d0/d54/d9c/c57 d0/d5b/d9f/cf8 0 2024-09-11T00:07:32.996 INFO:tasks.workunit.client.0.smithi111.stdout:0/885: rename d3/d1c/d50/c64 to d3/d13/d1e/d29/d49/c12e 0 2024-09-11T00:07:32.997 INFO:tasks.workunit.client.1.smithi203.stdout:3/851: creat d8/da/d37/d83/d6a/dad/f130 x:0 0 0 2024-09-11T00:07:32.999 INFO:tasks.workunit.client.1.smithi203.stdout:8/746: mkdir d1/d13/d43/dab/dfb 0 2024-09-11T00:07:33.001 INFO:tasks.workunit.client.0.smithi111.stdout:4/823: dread f15 [4194304,4194304] 0 2024-09-11T00:07:33.003 INFO:tasks.workunit.client.0.smithi111.stdout:4/824: chown d18/d1f/d36/d95 28760825 1 2024-09-11T00:07:33.005 INFO:tasks.workunit.client.0.smithi111.stdout:2/798: creat d0/d3/de/d3b/d99/f110 x:0 0 0 2024-09-11T00:07:33.005 INFO:tasks.workunit.client.0.smithi111.stdout:3/886: truncate d1c/d1d/d22/f60 4225251 0 2024-09-11T00:07:33.009 INFO:tasks.workunit.client.0.smithi111.stdout:8/862: dread ff [0,4194304] 0 2024-09-11T00:07:33.010 INFO:tasks.workunit.client.1.smithi203.stdout:3/852: mkdir d8/da/d37/d83/db9/d131 0 2024-09-11T00:07:33.014 INFO:tasks.workunit.client.1.smithi203.stdout:3/853: dread d8/da/d37/d53/dea/f10f [0,4194304] 0 2024-09-11T00:07:33.015 INFO:tasks.workunit.client.0.smithi111.stdout:1/842: dwrite d2/f104 [0,4194304] 0 2024-09-11T00:07:33.017 INFO:tasks.workunit.client.0.smithi111.stdout:7/894: dwrite fa [0,4194304] 0 2024-09-11T00:07:33.017 INFO:tasks.workunit.client.1.smithi203.stdout:8/747: symlink d1/d13/d43/d46/db0/dcf/lfc 0 2024-09-11T00:07:33.024 INFO:tasks.workunit.client.0.smithi111.stdout:9/887: rename d6/db/d34/db5 to d6/dc/d73/d121 0 2024-09-11T00:07:33.032 INFO:tasks.workunit.client.1.smithi203.stdout:3/854: dread - d8/da/d37/d83/d6a/f8a zero size 2024-09-11T00:07:33.032 INFO:tasks.workunit.client.1.smithi203.stdout:8/748: mknod d1/d13/d17/d2f/d52/d49/d68/dba/cfd 0 2024-09-11T00:07:33.034 INFO:tasks.workunit.client.1.smithi203.stdout:3/855: chown d8/d17/l92 441417 1 2024-09-11T00:07:33.035 INFO:tasks.workunit.client.0.smithi111.stdout:5/896: rename d10/d1e/d23/d30/d59/dd1 to d10/d1e/d23/d2b/d2f/d11f/d128 0 2024-09-11T00:07:33.036 INFO:tasks.workunit.client.1.smithi203.stdout:1/914: dwrite d8/d19/d60/d90/d3e/d9b/ff4 [0,4194304] 0 2024-09-11T00:07:33.037 INFO:tasks.workunit.client.0.smithi111.stdout:9/888: dread d6/d52/fd5 [0,4194304] 0 2024-09-11T00:07:33.038 INFO:tasks.workunit.client.1.smithi203.stdout:6/780: dread d0/d54/d9c/d35/d38/dc0/ddb/f7f [0,4194304] 0 2024-09-11T00:07:33.045 INFO:tasks.workunit.client.0.smithi111.stdout:0/886: dread d3/dc/f43 [0,4194304] 0 2024-09-11T00:07:33.055 INFO:tasks.workunit.client.0.smithi111.stdout:6/840: rename d7/d22/d26/d87 to d7/d22/d1d/d83/d121 0 2024-09-11T00:07:33.056 INFO:tasks.workunit.client.1.smithi203.stdout:1/915: readlink d8/d9/d15/d35/d81/db9/dce/d106/l109 0 2024-09-11T00:07:33.056 INFO:tasks.workunit.client.0.smithi111.stdout:2/799: write d0/d3/de/f1f [3521960,100401] 0 2024-09-11T00:07:33.058 INFO:tasks.workunit.client.0.smithi111.stdout:5/897: chown d10/d1e/d23/d30/dd8/d7e/f5b 597 1 2024-09-11T00:07:33.062 INFO:tasks.workunit.client.1.smithi203.stdout:6/781: truncate d0/d71/db9/ff7 4683824 0 2024-09-11T00:07:33.062 INFO:tasks.workunit.client.0.smithi111.stdout:3/887: rmdir d1c/d21/dae/dfe/d12d 0 2024-09-11T00:07:33.065 INFO:tasks.workunit.client.0.smithi111.stdout:4/825: write d18/d3b/d61/f9e [2431084,116865] 0 2024-09-11T00:07:33.066 INFO:tasks.workunit.client.0.smithi111.stdout:8/863: fdatasync d11/f12 0 2024-09-11T00:07:33.067 INFO:tasks.workunit.client.1.smithi203.stdout:3/856: link d8/da/d37/d53/dea/fb7 d8/da/d37/d53/dea/de5/d103/f132 0 2024-09-11T00:07:33.068 INFO:tasks.workunit.client.0.smithi111.stdout:1/843: creat d2/de/d12/d3c/d4b/d6a/d63/d73/f118 x:0 0 0 2024-09-11T00:07:33.070 INFO:tasks.workunit.client.1.smithi203.stdout:6/782: unlink d0/d54/d9c/d35/d38/dc0/ddb/d82/lb6 0 2024-09-11T00:07:33.070 INFO:tasks.workunit.client.0.smithi111.stdout:0/887: mkdir d3/d13/d1e/d29/db0/dce/ddb/de6/d12f 0 2024-09-11T00:07:33.071 INFO:tasks.workunit.client.1.smithi203.stdout:3/857: dread - d8/da/d37/d53/dcd/f126 zero size 2024-09-11T00:07:33.071 INFO:tasks.workunit.client.0.smithi111.stdout:0/888: stat d3/d26/d77 0 2024-09-11T00:07:33.073 INFO:tasks.workunit.client.0.smithi111.stdout:7/895: rename dd/f3a to dd/d1d/d76/f125 0 2024-09-11T00:07:33.073 INFO:tasks.workunit.client.0.smithi111.stdout:2/800: truncate d0/d3/de/f5d 4797698 0 2024-09-11T00:07:33.077 INFO:tasks.workunit.client.1.smithi203.stdout:3/858: creat d8/d17/ddd/f133 x:0 0 0 2024-09-11T00:07:33.077 INFO:tasks.workunit.client.1.smithi203.stdout:8/749: dread d1/d13/d17/d2f/d52/d59/f6e [0,4194304] 0 2024-09-11T00:07:33.082 INFO:tasks.workunit.client.1.smithi203.stdout:1/916: write d8/d19/d60/d90/d3e/d4b/d80/d8d/da3/dd2/f133 [4713496,73302] 0 2024-09-11T00:07:33.084 INFO:tasks.workunit.client.1.smithi203.stdout:6/783: dread d0/d54/d9c/d35/d39/d3c/f6e [0,4194304] 0 2024-09-11T00:07:33.084 INFO:tasks.workunit.client.0.smithi111.stdout:3/888: write d1c/d1d/d22/d23/d2f/de8/d5f/f8c [3406842,124965] 0 2024-09-11T00:07:33.089 INFO:tasks.workunit.client.0.smithi111.stdout:8/864: creat d11/d23/d2c/d53/dfc/f10f x:0 0 0 2024-09-11T00:07:33.091 INFO:tasks.workunit.client.0.smithi111.stdout:3/889: stat d1c/d1d/d22/d23/d58/d5c/fcf 0 2024-09-11T00:07:33.091 INFO:tasks.workunit.client.0.smithi111.stdout:9/889: write d6/fc2 [375619,4476] 0 2024-09-11T00:07:33.094 INFO:tasks.workunit.client.1.smithi203.stdout:8/750: symlink d1/d13/d17/d2f/lfe 0 2024-09-11T00:07:33.098 INFO:tasks.workunit.client.1.smithi203.stdout:1/917: mkdir d8/d19/d60/d90/d3e/d4b/d80/da2/d116/d14d 0 2024-09-11T00:07:33.099 INFO:tasks.workunit.client.0.smithi111.stdout:0/889: dwrite d3/d13/d1e/deb/d61/d93/f10c [0,4194304] 0 2024-09-11T00:07:33.099 INFO:tasks.workunit.client.0.smithi111.stdout:6/841: dread d7/d22/d1d/f75 [0,4194304] 0 2024-09-11T00:07:33.100 INFO:tasks.workunit.client.1.smithi203.stdout:5/844: sync 2024-09-11T00:07:33.100 INFO:tasks.workunit.client.1.smithi203.stdout:9/794: sync 2024-09-11T00:07:33.101 INFO:tasks.workunit.client.0.smithi111.stdout:7/896: dwrite dd/d1d/d1f/d24/f10c [0,4194304] 0 2024-09-11T00:07:33.103 INFO:tasks.workunit.client.0.smithi111.stdout:9/890: stat d6/d52/l7b 0 2024-09-11T00:07:33.103 INFO:tasks.workunit.client.0.smithi111.stdout:8/865: write d11/d23/d3d/d8d/fa3 [2647423,68392] 0 2024-09-11T00:07:33.113 INFO:tasks.workunit.client.1.smithi203.stdout:3/859: dread d8/da/f97 [0,4194304] 0 2024-09-11T00:07:33.114 INFO:tasks.workunit.client.0.smithi111.stdout:5/898: dwrite d10/d1e/d23/d2b/d5c/d61/f126 [0,4194304] 0 2024-09-11T00:07:33.117 INFO:tasks.workunit.client.1.smithi203.stdout:6/784: dread d0/d54/d9c/d35/d39/d3c/f79 [0,4194304] 0 2024-09-11T00:07:33.117 INFO:tasks.workunit.client.1.smithi203.stdout:3/860: chown d8/da/d37/d53/d63 9470 1 2024-09-11T00:07:33.120 INFO:tasks.workunit.client.1.smithi203.stdout:8/751: getdents d1/d13/d17/d77/dea/da6 0 2024-09-11T00:07:33.121 INFO:tasks.workunit.client.0.smithi111.stdout:2/801: dwrite d0/d3/de/d3b/d92/fd3 [0,4194304] 0 2024-09-11T00:07:33.124 INFO:tasks.workunit.client.0.smithi111.stdout:1/844: dwrite d2/de/d12/d3c/d4b/d6a/d63/d95/fdf [0,4194304] 0 2024-09-11T00:07:33.126 INFO:tasks.workunit.client.1.smithi203.stdout:1/918: getdents d8/d19/d60/d90/d3e/d4b/d80/d8d 0 2024-09-11T00:07:33.128 INFO:tasks.workunit.client.1.smithi203.stdout:6/785: truncate d0/d5b/d9f/ff0 558656 0 2024-09-11T00:07:33.129 INFO:tasks.workunit.client.1.smithi203.stdout:8/752: dread - d1/d13/fb5 zero size 2024-09-11T00:07:33.131 INFO:tasks.workunit.client.1.smithi203.stdout:3/861: write d8/d2a/dd0/ff7 [1418426,89469] 0 2024-09-11T00:07:33.131 INFO:tasks.workunit.client.1.smithi203.stdout:5/845: getdents dc/dd/d15/d3b 0 2024-09-11T00:07:33.137 INFO:tasks.workunit.client.1.smithi203.stdout:6/786: chown d0/d54/d9c/c26 1860558 1 2024-09-11T00:07:33.140 INFO:tasks.workunit.client.1.smithi203.stdout:6/787: fsync d0/d54/d9c/d35/d38/dc0/fe5 0 2024-09-11T00:07:33.146 INFO:tasks.workunit.client.1.smithi203.stdout:1/919: rename d8/d19/d60/d90/d3e/d4b/l12e to d8/d9/d15/d27/d102/l14e 0 2024-09-11T00:07:33.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:32 smithi111 ceph-mon[27539]: pgmap v14: 65 pgs: 65 active+clean; 3.4 GiB data, 9.9 GiB used, 526 GiB / 536 GiB avail; 100 MiB/s rd, 255 MiB/s wr, 550 op/s 2024-09-11T00:07:33.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:32 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:33.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:32 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:33.154 INFO:tasks.workunit.client.1.smithi203.stdout:3/862: dread d8/da/d37/d83/d65/f66 [0,4194304] 0 2024-09-11T00:07:33.156 INFO:tasks.workunit.client.1.smithi203.stdout:8/753: dwrite d1/d13/d43/d46/fe7 [0,4194304] 0 2024-09-11T00:07:33.156 INFO:tasks.workunit.client.1.smithi203.stdout:6/788: symlink d0/d54/d9c/d7b/lf9 0 2024-09-11T00:07:33.160 INFO:tasks.workunit.client.1.smithi203.stdout:5/846: getdents dc/d4f/d5c 0 2024-09-11T00:07:33.161 INFO:tasks.workunit.client.1.smithi203.stdout:1/920: creat d8/d11/de1/d12d/f14f x:0 0 0 2024-09-11T00:07:33.172 INFO:tasks.workunit.client.1.smithi203.stdout:9/795: dread d6/de/d19/d24/f36 [0,4194304] 0 2024-09-11T00:07:33.172 INFO:tasks.workunit.client.1.smithi203.stdout:1/921: read - d8/d19/d60/d90/d3e/d4b/d80/da2/fb3 zero size 2024-09-11T00:07:33.174 INFO:tasks.workunit.client.1.smithi203.stdout:1/922: chown d8/f49 1750 1 2024-09-11T00:07:33.178 INFO:tasks.workunit.client.1.smithi203.stdout:1/923: chown d8/d19/d60/d90/d3e/d4b/d80/d8d/da3/d12a/f9f 60240897 1 2024-09-11T00:07:33.181 INFO:tasks.workunit.client.1.smithi203.stdout:6/789: rename d0/d54/d9c/d35/d39/c81 to d0/d54/d9c/cfa 0 2024-09-11T00:07:33.182 INFO:tasks.workunit.client.1.smithi203.stdout:9/796: dread d6/de/d19/d24/d54/db2/fdd [0,4194304] 0 2024-09-11T00:07:33.188 INFO:tasks.workunit.client.1.smithi203.stdout:8/754: rename d1/d13/d3a/d75/ff3 to d1/d13/d17/d2f/d52/fff 0 2024-09-11T00:07:33.190 INFO:tasks.workunit.client.1.smithi203.stdout:8/755: stat d1/d78/c7b 0 2024-09-11T00:07:33.190 INFO:tasks.workunit.client.1.smithi203.stdout:6/790: truncate d0/d5b/f8f 640962 0 2024-09-11T00:07:33.191 INFO:tasks.workunit.client.1.smithi203.stdout:8/756: write d1/f16 [23995,125483] 0 2024-09-11T00:07:33.194 INFO:tasks.workunit.client.0.smithi111.stdout:3/890: creat d1c/d1d/d22/d23/d2f/d63/d7e/f134 x:0 0 0 2024-09-11T00:07:33.194 INFO:tasks.workunit.client.1.smithi203.stdout:8/757: write d1/f3d [961492,34449] 0 2024-09-11T00:07:33.200 INFO:tasks.workunit.client.0.smithi111.stdout:0/890: dread - d3/d13/d1e/deb/d61/d93/da7/fc6 zero size 2024-09-11T00:07:33.203 INFO:tasks.workunit.client.0.smithi111.stdout:0/891: write d3/da/d7b/d84/fef [989333,54476] 0 2024-09-11T00:07:33.206 INFO:tasks.workunit.client.1.smithi203.stdout:8/758: rename d1/d13/d17/d77/f79 to d1/d13/d17/d48/d9d/da9/f100 0 2024-09-11T00:07:33.206 INFO:tasks.workunit.client.1.smithi203.stdout:1/924: dread d8/d19/d60/d90/d3e/d4b/d80/d91/dac/f121 [4194304,4194304] 0 2024-09-11T00:07:33.208 INFO:tasks.workunit.client.0.smithi111.stdout:8/866: rename d11/f9d to d11/d23/d2c/d46/d64/df8/f110 0 2024-09-11T00:07:33.213 INFO:tasks.workunit.client.1.smithi203.stdout:7/786: sync 2024-09-11T00:07:33.213 INFO:tasks.workunit.client.0.smithi111.stdout:6/842: dread d7/f5a [0,4194304] 0 2024-09-11T00:07:33.213 INFO:tasks.workunit.client.0.smithi111.stdout:5/899: unlink d10/d1e/d23/d2b/dad/ce6 0 2024-09-11T00:07:33.215 INFO:tasks.workunit.client.0.smithi111.stdout:2/802: mkdir d0/d3/de/d68/d111 0 2024-09-11T00:07:33.218 INFO:tasks.workunit.client.1.smithi203.stdout:3/863: dwrite d8/da/d37/f9f [0,4194304] 0 2024-09-11T00:07:33.219 INFO:tasks.workunit.client.1.smithi203.stdout:8/759: mkdir d1/d13/d17/d48/d101 0 2024-09-11T00:07:33.219 INFO:tasks.workunit.client.0.smithi111.stdout:0/892: dwrite f1 [0,4194304] 0 2024-09-11T00:07:33.219 INFO:tasks.workunit.client.0.smithi111.stdout:9/891: dread d6/db/db8/dce/dcf/fbd [0,4194304] 0 2024-09-11T00:07:33.221 INFO:tasks.workunit.client.1.smithi203.stdout:9/797: getdents d6/de/d32/d52/d55/d66 0 2024-09-11T00:07:33.222 INFO:tasks.workunit.client.0.smithi111.stdout:4/826: link d18/fa4 d18/d20/d3c/d5e/daa/f104 0 2024-09-11T00:07:33.233 INFO:tasks.workunit.client.1.smithi203.stdout:5/847: dwrite dc/dd/d56/dad/f64 [0,4194304] 0 2024-09-11T00:07:33.234 INFO:tasks.workunit.client.0.smithi111.stdout:6/843: creat d7/d22/d3f/d74/d7f/d61/d6a/dba/f122 x:0 0 0 2024-09-11T00:07:33.236 INFO:tasks.workunit.client.1.smithi203.stdout:3/864: dread d8/da/d37/d53/dea/f10f [0,4194304] 0 2024-09-11T00:07:33.238 INFO:tasks.workunit.client.1.smithi203.stdout:9/798: read - d6/de/d19/f84 zero size 2024-09-11T00:07:33.239 INFO:tasks.workunit.client.0.smithi111.stdout:9/892: dwrite d6/dc/f87 [0,4194304] 0 2024-09-11T00:07:33.244 INFO:tasks.workunit.client.0.smithi111.stdout:4/827: dwrite d18/d20/d3c/d5e/d75/d8d/dce/ff1 [0,4194304] 0 2024-09-11T00:07:33.246 INFO:tasks.workunit.client.0.smithi111.stdout:4/828: chown d18/d20/d3c/d5e/d75/d8d 1 1 2024-09-11T00:07:33.247 INFO:tasks.workunit.client.1.smithi203.stdout:5/848: creat dc/d4f/d5c/f11b x:0 0 0 2024-09-11T00:07:33.253 INFO:tasks.workunit.client.1.smithi203.stdout:1/925: dwrite d8/f68 [4194304,4194304] 0 2024-09-11T00:07:33.256 INFO:tasks.workunit.client.0.smithi111.stdout:5/900: mkdir d10/d1e/d23/d30/dd8/d63/d129 0 2024-09-11T00:07:33.261 INFO:tasks.workunit.client.0.smithi111.stdout:2/803: mkdir d0/d3/de/dd4/d106/d112 0 2024-09-11T00:07:33.261 INFO:tasks.workunit.client.1.smithi203.stdout:6/791: dwrite d0/d54/d9c/f72 [4194304,4194304] 0 2024-09-11T00:07:33.267 INFO:tasks.workunit.client.1.smithi203.stdout:3/865: symlink d8/da/d37/d83/l134 0 2024-09-11T00:07:33.277 INFO:tasks.workunit.client.1.smithi203.stdout:3/866: chown d8/da/d37/fd5 30 1 2024-09-11T00:07:33.277 INFO:tasks.workunit.client.1.smithi203.stdout:9/799: rename d6/de/d19/l100 to d6/de/d32/d52/d55/d66/daa/df7/l107 0 2024-09-11T00:07:33.280 INFO:tasks.workunit.client.1.smithi203.stdout:8/760: write d1/fe [8445757,63895] 0 2024-09-11T00:07:33.284 INFO:tasks.workunit.client.0.smithi111.stdout:1/845: truncate d2/de/d12/d3c/d4b/d6a/d63/d73/da1/f47 3022664 0 2024-09-11T00:07:33.285 INFO:tasks.workunit.client.1.smithi203.stdout:6/792: dread d0/d32/f43 [0,4194304] 0 2024-09-11T00:07:33.288 INFO:tasks.workunit.client.0.smithi111.stdout:7/897: link dd/d48/d69/fd7 dd/f126 0 2024-09-11T00:07:33.288 INFO:tasks.workunit.client.0.smithi111.stdout:3/891: dwrite f1a [0,4194304] 0 2024-09-11T00:07:33.288 INFO:tasks.workunit.client.1.smithi203.stdout:6/793: stat d0/d54/f68 0 2024-09-11T00:07:33.290 INFO:tasks.workunit.client.0.smithi111.stdout:0/893: write d3/d1c/f4a [383174,94028] 0 2024-09-11T00:07:33.291 INFO:tasks.workunit.client.1.smithi203.stdout:5/849: creat dc/dd/d15/f11c x:0 0 0 2024-09-11T00:07:33.292 INFO:tasks.workunit.client.0.smithi111.stdout:8/867: dwrite d11/d8e/fbf [0,4194304] 0 2024-09-11T00:07:33.292 INFO:tasks.workunit.client.1.smithi203.stdout:9/800: readlink d6/de/d19/d24/d54/db2/l8b 0 2024-09-11T00:07:33.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:32 smithi203 ceph-mon[33225]: pgmap v14: 65 pgs: 65 active+clean; 3.4 GiB data, 9.9 GiB used, 526 GiB / 536 GiB avail; 100 MiB/s rd, 255 MiB/s wr, 550 op/s 2024-09-11T00:07:33.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:32 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:33.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:32 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:33.295 INFO:tasks.workunit.client.0.smithi111.stdout:8/868: chown d11/d23/d2c/d53/dfc/fd6 0 1 2024-09-11T00:07:33.305 INFO:tasks.workunit.client.0.smithi111.stdout:9/893: creat d6/db/d34/f122 x:0 0 0 2024-09-11T00:07:33.306 INFO:tasks.workunit.client.1.smithi203.stdout:7/787: dwrite dd/d1c/d52/d8f/d31/f50 [0,4194304] 0 2024-09-11T00:07:33.308 INFO:tasks.workunit.client.0.smithi111.stdout:9/894: chown d6/db/d7a/cfb 4530633 1 2024-09-11T00:07:33.308 INFO:tasks.workunit.client.1.smithi203.stdout:2/880: sync 2024-09-11T00:07:33.309 INFO:tasks.workunit.client.0.smithi111.stdout:0/894: dwrite f2 [0,4194304] 0 2024-09-11T00:07:33.310 INFO:tasks.workunit.client.1.smithi203.stdout:0/776: sync 2024-09-11T00:07:33.311 INFO:tasks.workunit.client.1.smithi203.stdout:4/739: sync 2024-09-11T00:07:33.313 INFO:tasks.workunit.client.1.smithi203.stdout:3/867: dwrite d8/da/d5c/d6b/d6c/f11f [0,4194304] 0 2024-09-11T00:07:33.316 INFO:tasks.workunit.client.1.smithi203.stdout:1/926: dread d8/d9/d15/d27/fb6 [0,4194304] 0 2024-09-11T00:07:33.325 INFO:tasks.workunit.client.1.smithi203.stdout:5/850: creat dc/dd/d1e/dc6/d103/f11d x:0 0 0 2024-09-11T00:07:33.327 INFO:tasks.workunit.client.0.smithi111.stdout:8/869: rename d11/d23/d2c/d46/d64/df8/d105 to d11/d23/d2c/d46/d81/da5/d111 0 2024-09-11T00:07:33.328 INFO:tasks.workunit.client.0.smithi111.stdout:6/844: link d7/d22/d26/lc4 d7/d22/d3f/d74/d7f/d79/l123 0 2024-09-11T00:07:33.329 INFO:tasks.workunit.client.1.smithi203.stdout:3/868: fsync d8/d2a/ff4 0 2024-09-11T00:07:33.329 INFO:tasks.workunit.client.1.smithi203.stdout:8/761: dwrite d1/d13/d17/d2f/d52/d49/fd1 [0,4194304] 0 2024-09-11T00:07:33.332 INFO:tasks.workunit.client.1.smithi203.stdout:4/740: rename db/dd/d26/d42/d5e to db/dd/d16/ded 0 2024-09-11T00:07:33.337 INFO:tasks.workunit.client.1.smithi203.stdout:0/777: creat d0/d2/db3/f100 x:0 0 0 2024-09-11T00:07:33.343 INFO:tasks.workunit.client.0.smithi111.stdout:2/804: getdents d0/d3/d12/d38 0 2024-09-11T00:07:33.345 INFO:tasks.workunit.client.0.smithi111.stdout:2/805: dread d0/d83/fcd [0,4194304] 0 2024-09-11T00:07:33.348 INFO:tasks.workunit.client.1.smithi203.stdout:1/927: rmdir d8/d28/d64 39 2024-09-11T00:07:33.349 INFO:tasks.workunit.client.0.smithi111.stdout:2/806: write d0/d3/de/d3b/d92/ffd [44032,73461] 0 2024-09-11T00:07:33.350 INFO:tasks.workunit.client.0.smithi111.stdout:5/901: write d10/d1e/d25/f29 [3978988,33864] 0 2024-09-11T00:07:33.351 INFO:tasks.workunit.client.0.smithi111.stdout:4/829: dwrite d18/d20/d40/f42 [0,4194304] 0 2024-09-11T00:07:33.353 INFO:tasks.workunit.client.1.smithi203.stdout:1/928: chown d8/d9/d15/c105 3 1 2024-09-11T00:07:33.357 INFO:tasks.workunit.client.1.smithi203.stdout:6/794: dread d0/d54/d9c/d35/d39/f6a [0,4194304] 0 2024-09-11T00:07:33.360 INFO:tasks.workunit.client.1.smithi203.stdout:3/869: fsync d8/f16 0 2024-09-11T00:07:33.361 INFO:tasks.workunit.client.0.smithi111.stdout:8/870: creat d11/d23/d7e/f112 x:0 0 0 2024-09-11T00:07:33.363 INFO:tasks.workunit.client.1.smithi203.stdout:2/881: rename d13/d15/d30/d5a/dac/lde to d13/d47/l128 0 2024-09-11T00:07:33.364 INFO:tasks.workunit.client.0.smithi111.stdout:7/898: link dd/d1d/c53 dd/d48/c127 0 2024-09-11T00:07:33.364 INFO:tasks.workunit.client.1.smithi203.stdout:9/801: write d6/de/d32/d52/d55/d66/fb1 [2028964,28905] 0 2024-09-11T00:07:33.366 INFO:tasks.workunit.client.1.smithi203.stdout:8/762: creat d1/d13/d17/d77/dea/f102 x:0 0 0 2024-09-11T00:07:33.367 INFO:tasks.workunit.client.1.smithi203.stdout:9/802: readlink d6/de/d19/d24/d40/d45/l9f 0 2024-09-11T00:07:33.369 INFO:tasks.workunit.client.1.smithi203.stdout:0/778: stat d0/d2/fb 0 2024-09-11T00:07:33.372 INFO:tasks.workunit.client.1.smithi203.stdout:5/851: unlink dc/dd/c98 0 2024-09-11T00:07:33.372 INFO:tasks.workunit.client.0.smithi111.stdout:3/892: link d1c/d1d/d22/d23/d58/df2/c10d d1c/d1d/d22/d44/d5a/dba/c135 0 2024-09-11T00:07:33.373 INFO:tasks.workunit.client.1.smithi203.stdout:5/852: readlink dc/d2b/l68 0 2024-09-11T00:07:33.374 INFO:tasks.workunit.client.0.smithi111.stdout:2/807: mkdir d0/d3/de/d3b/d92/d113 0 2024-09-11T00:07:33.377 INFO:tasks.workunit.client.0.smithi111.stdout:5/902: mkdir d10/d1e/d23/d30/dd8/da2/d12a 0 2024-09-11T00:07:33.381 INFO:tasks.workunit.client.1.smithi203.stdout:4/741: rename db/dd/d16/d38/d3c/d41/f8e to db/dd/d26/dcd/fee 0 2024-09-11T00:07:33.384 INFO:tasks.workunit.client.0.smithi111.stdout:0/895: creat d3/da/f130 x:0 0 0 2024-09-11T00:07:33.386 INFO:tasks.workunit.client.0.smithi111.stdout:0/896: chown d3/cbd 161 1 2024-09-11T00:07:33.389 INFO:tasks.workunit.client.0.smithi111.stdout:3/893: dwrite d1c/d1d/d22/d31/f79 [0,4194304] 0 2024-09-11T00:07:33.392 INFO:tasks.workunit.client.0.smithi111.stdout:7/899: fsync dd/d49/fa5 0 2024-09-11T00:07:33.393 INFO:tasks.workunit.client.1.smithi203.stdout:9/803: creat d6/de/d19/d24/d6c/da8/f108 x:0 0 0 2024-09-11T00:07:33.396 INFO:tasks.workunit.client.0.smithi111.stdout:7/900: read dd/f8c [4710522,26958] 0 2024-09-11T00:07:33.397 INFO:tasks.workunit.client.0.smithi111.stdout:2/808: truncate d0/d3/fb8 1887653 0 2024-09-11T00:07:33.397 INFO:tasks.workunit.client.0.smithi111.stdout:8/871: dread d11/d21/d6f/dab/fc1 [4194304,4194304] 0 2024-09-11T00:07:33.398 INFO:tasks.workunit.client.1.smithi203.stdout:0/779: creat d0/d87/f101 x:0 0 0 2024-09-11T00:07:33.398 INFO:tasks.workunit.client.1.smithi203.stdout:5/853: creat dc/dd/d15/dbd/d59/da8/f11e x:0 0 0 2024-09-11T00:07:33.399 INFO:tasks.workunit.client.1.smithi203.stdout:6/795: dread d0/d32/d5a/fba [0,4194304] 0 2024-09-11T00:07:33.401 INFO:tasks.workunit.client.1.smithi203.stdout:9/804: read d6/de/d32/d52/d55/d66/fb1 [2182176,22834] 0 2024-09-11T00:07:33.401 INFO:tasks.workunit.client.1.smithi203.stdout:3/870: dread d8/da/d37/d83/d6a/f8c [0,4194304] 0 2024-09-11T00:07:33.404 INFO:tasks.workunit.client.1.smithi203.stdout:1/929: rename d8/d19/f57 to d8/d19/d60/d90/d3e/dfe/f150 0 2024-09-11T00:07:33.409 INFO:tasks.workunit.client.1.smithi203.stdout:4/742: symlink db/dd/d16/d38/d3c/d41/lef 0 2024-09-11T00:07:33.410 INFO:tasks.workunit.client.0.smithi111.stdout:0/897: creat d3/da/d7b/db3/d11c/f131 x:0 0 0 2024-09-11T00:07:33.414 INFO:tasks.workunit.client.1.smithi203.stdout:0/780: rmdir d0/d87/db9 39 2024-09-11T00:07:33.420 INFO:tasks.workunit.client.1.smithi203.stdout:5/854: dwrite dc/dd/d1e/fa1 [0,4194304] 0 2024-09-11T00:07:33.420 INFO:tasks.workunit.client.1.smithi203.stdout:0/781: truncate d0/d2/d37/d5b/fe3 257623 0 2024-09-11T00:07:33.421 INFO:tasks.workunit.client.0.smithi111.stdout:9/895: getdents d6/db/d1b/d56 0 2024-09-11T00:07:33.422 INFO:tasks.workunit.client.0.smithi111.stdout:6/845: write f3 [3162043,43769] 0 2024-09-11T00:07:33.427 INFO:tasks.workunit.client.0.smithi111.stdout:7/901: creat dd/d1d/d7e/df8/dad/f128 x:0 0 0 2024-09-11T00:07:33.428 INFO:tasks.workunit.client.0.smithi111.stdout:8/872: chown d11/d23/d3d/dca/dcf/dc3 7 1 2024-09-11T00:07:33.431 INFO:tasks.workunit.client.1.smithi203.stdout:6/796: rename d0/d32/f5e to d0/d5b/d5c/d6f/ffb 0 2024-09-11T00:07:33.437 INFO:tasks.workunit.client.1.smithi203.stdout:8/763: dwrite d1/d13/d17/f62 [0,4194304] 0 2024-09-11T00:07:33.438 INFO:tasks.workunit.client.1.smithi203.stdout:1/930: stat d8/d28/d64/da0/lb5 0 2024-09-11T00:07:33.447 INFO:tasks.workunit.client.0.smithi111.stdout:3/894: creat d1c/d1d/d22/d23/d58/d131/f136 x:0 0 0 2024-09-11T00:07:33.447 INFO:tasks.workunit.client.0.smithi111.stdout:8/873: readlink d11/d21/lc7 0 2024-09-11T00:07:33.448 INFO:tasks.workunit.client.0.smithi111.stdout:9/896: mkdir d6/db/d34/d37/d123 0 2024-09-11T00:07:33.449 INFO:tasks.workunit.client.0.smithi111.stdout:4/830: getdents d18/d20/d3c 0 2024-09-11T00:07:33.452 INFO:tasks.workunit.client.0.smithi111.stdout:8/874: chown d11/d23/d2c/d46/d64/cd8 322411130 1 2024-09-11T00:07:33.453 INFO:tasks.workunit.client.1.smithi203.stdout:5/855: chown dc/l8a 201610708 1 2024-09-11T00:07:33.455 INFO:tasks.workunit.client.0.smithi111.stdout:5/903: dwrite d10/d1e/d23/d26/f3e [0,4194304] 0 2024-09-11T00:07:33.456 INFO:tasks.workunit.client.1.smithi203.stdout:0/782: dwrite d0/d2/d7e/da1/df5/fdc [0,4194304] 0 2024-09-11T00:07:33.456 INFO:tasks.workunit.client.1.smithi203.stdout:3/871: dread d8/da/d11/fb6 [0,4194304] 0 2024-09-11T00:07:33.460 INFO:tasks.workunit.client.0.smithi111.stdout:3/895: unlink d1c/d1d/d22/d23/d2f/f67 0 2024-09-11T00:07:33.463 INFO:tasks.workunit.client.0.smithi111.stdout:3/896: fsync d1c/d1d/d22/d23/d2f/f11a 0 2024-09-11T00:07:33.465 INFO:tasks.workunit.client.1.smithi203.stdout:2/882: dwrite d13/d15/d19/f42 [0,4194304] 0 2024-09-11T00:07:33.465 INFO:tasks.workunit.client.0.smithi111.stdout:4/831: creat d18/d20/d40/d78/f105 x:0 0 0 2024-09-11T00:07:33.469 INFO:tasks.workunit.client.0.smithi111.stdout:0/898: dread d3/f7a [0,4194304] 0 2024-09-11T00:07:33.472 INFO:tasks.workunit.client.0.smithi111.stdout:9/897: rename d6/db/d34/d37/f19 to d6/d52/f124 0 2024-09-11T00:07:33.478 INFO:tasks.workunit.client.0.smithi111.stdout:8/875: creat d11/d21/d6f/f113 x:0 0 0 2024-09-11T00:07:33.480 INFO:tasks.workunit.client.1.smithi203.stdout:8/764: chown d1/d13/d22/c23 55642569 1 2024-09-11T00:07:33.486 INFO:tasks.workunit.client.0.smithi111.stdout:4/832: creat d18/d3b/f106 x:0 0 0 2024-09-11T00:07:33.486 INFO:tasks.workunit.client.0.smithi111.stdout:3/897: dwrite f1a [0,4194304] 0 2024-09-11T00:07:33.487 INFO:tasks.workunit.client.0.smithi111.stdout:1/846: sync 2024-09-11T00:07:33.489 INFO:tasks.workunit.client.0.smithi111.stdout:7/902: dwrite dd/f8c [4194304,4194304] 0 2024-09-11T00:07:33.489 INFO:tasks.workunit.client.1.smithi203.stdout:3/872: dwrite d8/da/d37/d53/f108 [0,4194304] 0 2024-09-11T00:07:33.490 INFO:tasks.workunit.client.0.smithi111.stdout:6/846: truncate d7/d22/d2c/f37 2811 0 2024-09-11T00:07:33.491 INFO:tasks.workunit.client.1.smithi203.stdout:4/743: dread db/f57 [0,4194304] 0 2024-09-11T00:07:33.492 INFO:tasks.workunit.client.0.smithi111.stdout:9/898: mknod d6/db/d1b/d56/dc8/c125 0 2024-09-11T00:07:33.493 INFO:tasks.workunit.client.0.smithi111.stdout:9/899: stat d6/dc/l23 0 2024-09-11T00:07:33.503 INFO:tasks.workunit.client.0.smithi111.stdout:1/847: mknod d2/de/d12/d3c/d4b/c119 0 2024-09-11T00:07:33.508 INFO:tasks.workunit.client.0.smithi111.stdout:7/903: truncate dd/d1d/d7e/df8/dad/ff2 139885 0 2024-09-11T00:07:33.509 INFO:tasks.workunit.client.0.smithi111.stdout:4/833: dwrite d18/d20/d4a/f64 [4194304,4194304] 0 2024-09-11T00:07:33.512 INFO:tasks.workunit.client.0.smithi111.stdout:0/899: dread d3/d13/d1e/d29/db0/dce/f10b [0,4194304] 0 2024-09-11T00:07:33.513 INFO:tasks.workunit.client.0.smithi111.stdout:1/848: creat d2/de/d12/d3c/d4b/d6a/d63/d73/db8/f11a x:0 0 0 2024-09-11T00:07:33.515 INFO:tasks.workunit.client.0.smithi111.stdout:8/876: rename d11/d21/d6f/lec to d11/d23/d2c/d46/l114 0 2024-09-11T00:07:33.515 INFO:tasks.workunit.client.0.smithi111.stdout:0/900: write d3/daf/db2/ff4 [3938786,55795] 0 2024-09-11T00:07:33.517 INFO:tasks.workunit.client.0.smithi111.stdout:4/834: mknod d18/d1f/d33/c107 0 2024-09-11T00:07:33.519 INFO:tasks.workunit.client.0.smithi111.stdout:4/835: dread - d18/d1f/f93 zero size 2024-09-11T00:07:33.522 INFO:tasks.workunit.client.0.smithi111.stdout:9/900: rename d6/db/d1b/d41/l82 to d6/d52/d8a/d8e/d120/l126 0 2024-09-11T00:07:33.523 INFO:tasks.workunit.client.0.smithi111.stdout:0/901: mknod d3/d1c/dd0/c132 0 2024-09-11T00:07:33.525 INFO:tasks.workunit.client.0.smithi111.stdout:0/902: chown d3/da/d7b/c119 156011 1 2024-09-11T00:07:33.525 INFO:tasks.workunit.client.0.smithi111.stdout:6/847: link d7/f6b d7/d22/d2c/d38/f124 0 2024-09-11T00:07:33.529 INFO:tasks.workunit.client.0.smithi111.stdout:4/836: fsync d18/d20/f30 0 2024-09-11T00:07:33.533 INFO:tasks.workunit.client.1.smithi203.stdout:6/797: dwrite d0/d54/fdf [4194304,4194304] 0 2024-09-11T00:07:33.537 INFO:tasks.workunit.client.0.smithi111.stdout:9/901: mknod d6/dc/d73/c127 0 2024-09-11T00:07:33.540 INFO:tasks.workunit.client.0.smithi111.stdout:6/848: dwrite d7/f11 [8388608,4194304] 0 2024-09-11T00:07:33.542 INFO:tasks.workunit.client.0.smithi111.stdout:0/903: mkdir d3/d1c/dd0/d117/d133 0 2024-09-11T00:07:33.543 INFO:tasks.workunit.client.0.smithi111.stdout:6/849: stat d7/d22/d1d/d8c/l4b 0 2024-09-11T00:07:33.544 INFO:tasks.workunit.client.0.smithi111.stdout:4/837: symlink d18/d3b/dae/l108 0 2024-09-11T00:07:33.548 INFO:tasks.workunit.client.0.smithi111.stdout:0/904: rmdir d3/d1c 39 2024-09-11T00:07:33.549 INFO:tasks.workunit.client.0.smithi111.stdout:9/902: read d6/db/d1b/d74/f84 [58798,96371] 0 2024-09-11T00:07:33.551 INFO:tasks.workunit.client.0.smithi111.stdout:7/904: rename dd/d1d/d1f/f9b to dd/f129 0 2024-09-11T00:07:33.553 INFO:tasks.workunit.client.0.smithi111.stdout:2/809: sync 2024-09-11T00:07:33.555 INFO:tasks.workunit.client.0.smithi111.stdout:4/838: creat d18/d20/d3c/f109 x:0 0 0 2024-09-11T00:07:33.556 INFO:tasks.workunit.client.1.smithi203.stdout:9/805: creat d6/de/d19/d24/d54/db2/f109 x:0 0 0 2024-09-11T00:07:33.557 INFO:tasks.workunit.client.0.smithi111.stdout:6/850: mknod d7/d22/d2c/d103/c125 0 2024-09-11T00:07:33.557 INFO:tasks.workunit.client.1.smithi203.stdout:9/806: chown d6/de/d32/d52/f4b 3069 1 2024-09-11T00:07:33.558 INFO:tasks.workunit.client.1.smithi203.stdout:2/883: rename d13/d22/d53/l83 to d13/d15/d30/d5a/dac/l129 0 2024-09-11T00:07:33.560 INFO:tasks.workunit.client.0.smithi111.stdout:9/903: fdatasync d6/db/f18 0 2024-09-11T00:07:33.561 INFO:tasks.workunit.client.0.smithi111.stdout:7/905: mkdir dd/d49/d12a 0 2024-09-11T00:07:33.561 INFO:tasks.workunit.client.1.smithi203.stdout:3/873: mkdir d8/da/d5c/d6b/d6c/d135 0 2024-09-11T00:07:33.562 INFO:tasks.workunit.client.0.smithi111.stdout:2/810: rmdir d0/d3/d12 39 2024-09-11T00:07:33.563 INFO:tasks.workunit.client.1.smithi203.stdout:4/744: mkdir db/dd/d16/df0 0 2024-09-11T00:07:33.565 INFO:tasks.workunit.client.0.smithi111.stdout:0/905: chown d3/d13/f73 16 1 2024-09-11T00:07:33.569 INFO:tasks.workunit.client.0.smithi111.stdout:4/839: mknod d18/d20/d40/d78/d79/d90/c10a 0 2024-09-11T00:07:33.570 INFO:tasks.workunit.client.1.smithi203.stdout:5/856: readlink dc/d4f/d5c/d76/l104 0 2024-09-11T00:07:33.571 INFO:tasks.workunit.client.1.smithi203.stdout:5/857: stat dc/f87 0 2024-09-11T00:07:33.573 INFO:tasks.workunit.client.1.smithi203.stdout:0/783: creat d0/d2/d37/dfa/f102 x:0 0 0 2024-09-11T00:07:33.574 INFO:tasks.workunit.client.0.smithi111.stdout:9/904: rename d6/db/d7a/la9 to d6/db/d7a/l128 0 2024-09-11T00:07:33.576 INFO:tasks.workunit.client.1.smithi203.stdout:9/807: fdatasync d6/de/d19/f84 0 2024-09-11T00:07:33.578 INFO:tasks.workunit.client.0.smithi111.stdout:2/811: dwrite d0/d3/de/d3b/d97/f8b [4194304,4194304] 0 2024-09-11T00:07:33.582 INFO:tasks.workunit.client.1.smithi203.stdout:3/874: mknod d8/da/d37/d53/dea/de5/d103/c136 0 2024-09-11T00:07:33.584 INFO:tasks.workunit.client.1.smithi203.stdout:4/745: symlink db/dd/d16/d38/d3c/da6/lf1 0 2024-09-11T00:07:33.586 INFO:tasks.workunit.client.1.smithi203.stdout:6/798: truncate d0/d54/d9c/d35/d38/dc0/ddb/d82/f91 1928097 0 2024-09-11T00:07:33.586 INFO:tasks.workunit.client.1.smithi203.stdout:4/746: dread - db/dd/d16/fca zero size 2024-09-11T00:07:33.593 INFO:tasks.workunit.client.0.smithi111.stdout:3/898: write ff [971872,124019] 0 2024-09-11T00:07:33.594 INFO:tasks.workunit.client.0.smithi111.stdout:9/905: mkdir d6/db/d1b/d56/dc8/d129 0 2024-09-11T00:07:33.596 INFO:tasks.workunit.client.0.smithi111.stdout:5/904: dwrite d10/d1e/f21 [0,4194304] 0 2024-09-11T00:07:33.599 INFO:tasks.workunit.client.0.smithi111.stdout:5/905: fdatasync d10/d1e/d23/d30/dd8/d63/f10d 0 2024-09-11T00:07:33.600 INFO:tasks.workunit.client.0.smithi111.stdout:5/906: chown d10/d1e/d23/fa1 201707269 1 2024-09-11T00:07:33.601 INFO:tasks.workunit.client.0.smithi111.stdout:7/906: rmdir dd/d49/d12a 0 2024-09-11T00:07:33.603 INFO:tasks.workunit.client.1.smithi203.stdout:4/747: fdatasync db/dd/d16/d38/d3c/d41/fbd 0 2024-09-11T00:07:33.610 INFO:tasks.workunit.client.0.smithi111.stdout:9/906: creat d6/db/d1b/d41/d80/f12a x:0 0 0 2024-09-11T00:07:33.611 INFO:tasks.workunit.client.1.smithi203.stdout:0/784: dread d0/f8c [0,4194304] 0 2024-09-11T00:07:33.613 INFO:tasks.workunit.client.0.smithi111.stdout:0/906: mknod d3/da/d7b/db3/d11c/d12b/c134 0 2024-09-11T00:07:33.638 INFO:tasks.workunit.client.0.smithi111.stdout:7/907: truncate dd/d1d/d7e/df8/d8f/fb2 210018 0 2024-09-11T00:07:33.640 INFO:tasks.workunit.client.1.smithi203.stdout:0/785: mkdir d0/d2/d37/d5b/d103 0 2024-09-11T00:07:33.641 INFO:tasks.workunit.client.0.smithi111.stdout:8/877: write d11/d23/d2c/d7f/fad [1305738,29493] 0 2024-09-11T00:07:33.642 INFO:tasks.workunit.client.1.smithi203.stdout:3/875: link d8/d2a/dd0/c123 d8/da/d37/d83/dc0/c137 0 2024-09-11T00:07:33.644 INFO:tasks.workunit.client.0.smithi111.stdout:0/907: dread - d3/d13/d1e/d29/d49/df2/f111 zero size 2024-09-11T00:07:33.645 INFO:tasks.workunit.client.1.smithi203.stdout:6/799: rename d0/d5b/ff6 to d0/d54/d9c/d35/d39/ffc 0 2024-09-11T00:07:33.646 INFO:tasks.workunit.client.0.smithi111.stdout:5/907: truncate d10/d1e/d25/f93 3418467 0 2024-09-11T00:07:33.646 INFO:tasks.workunit.client.1.smithi203.stdout:6/800: write d0/d54/fee [424869,14057] 0 2024-09-11T00:07:33.648 INFO:tasks.workunit.client.1.smithi203.stdout:9/808: getdents d6/de/d32/d52/d55 0 2024-09-11T00:07:33.650 INFO:tasks.workunit.client.1.smithi203.stdout:9/809: chown d6/de/d32/d9e 266 1 2024-09-11T00:07:33.650 INFO:tasks.workunit.client.0.smithi111.stdout:5/908: write d10/d1e/d23/d30/d59/d52/fe4 [3368808,52074] 0 2024-09-11T00:07:33.651 INFO:tasks.workunit.client.0.smithi111.stdout:1/849: dwrite d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/d7b/d87/f94 [4194304,4194304] 0 2024-09-11T00:07:33.656 INFO:tasks.workunit.client.1.smithi203.stdout:3/876: mknod d8/da/d37/d83/da3/c138 0 2024-09-11T00:07:33.657 INFO:tasks.workunit.client.1.smithi203.stdout:0/786: dwrite d0/d1d/d5d/dba/fdf [0,4194304] 0 2024-09-11T00:07:33.659 INFO:tasks.workunit.client.1.smithi203.stdout:3/877: fsync d8/d17/ddd/f133 0 2024-09-11T00:07:33.660 INFO:tasks.workunit.client.0.smithi111.stdout:0/908: fdatasync d3/d26/d77/dd6/f128 0 2024-09-11T00:07:33.666 INFO:tasks.workunit.client.0.smithi111.stdout:3/899: getdents d1c/d1d/d22/d23/d2f/de8 0 2024-09-11T00:07:33.671 INFO:tasks.workunit.client.1.smithi203.stdout:3/878: mkdir d8/d17/ddd/d139 0 2024-09-11T00:07:33.673 INFO:tasks.workunit.client.0.smithi111.stdout:1/850: rmdir d2/de/d12/d6c/df5 39 2024-09-11T00:07:33.674 INFO:tasks.workunit.client.0.smithi111.stdout:1/851: stat d2/dad/fcf 0 2024-09-11T00:07:33.674 INFO:tasks.workunit.client.0.smithi111.stdout:8/878: mknod d11/d23/d2c/c115 0 2024-09-11T00:07:33.677 INFO:tasks.workunit.client.1.smithi203.stdout:3/879: mkdir d8/da/d5c/d6b/d6c/d13a 0 2024-09-11T00:07:33.681 INFO:tasks.workunit.client.0.smithi111.stdout:1/852: readlink d2/de/d12/l33 0 2024-09-11T00:07:33.682 INFO:tasks.workunit.client.0.smithi111.stdout:3/900: read d1c/d1d/d22/d44/f7c [2345292,6494] 0 2024-09-11T00:07:33.686 INFO:tasks.workunit.client.0.smithi111.stdout:1/853: chown d2/de/d12/d3c/d4b/d6a/d63/f10f 1860408 1 2024-09-11T00:07:33.686 INFO:tasks.workunit.client.1.smithi203.stdout:2/884: write d13/d15/d30/d5a/dcf/fed [371728,69101] 0 2024-09-11T00:07:33.686 INFO:tasks.workunit.client.1.smithi203.stdout:3/880: creat d8/da/d37/d83/d6a/dad/f13b x:0 0 0 2024-09-11T00:07:33.688 INFO:tasks.workunit.client.1.smithi203.stdout:3/881: chown d8/f58 842577 1 2024-09-11T00:07:33.691 INFO:tasks.workunit.client.1.smithi203.stdout:2/885: rmdir d13/d15/d19/d1c/d73/dc4 39 2024-09-11T00:07:33.692 INFO:tasks.workunit.client.0.smithi111.stdout:6/851: dwrite d7/d2b/f8b [0,4194304] 0 2024-09-11T00:07:33.692 INFO:tasks.workunit.client.0.smithi111.stdout:3/901: chown d1c/d1d/d22/d23/d2f/de8/d5f/d98/fc3 5093393 1 2024-09-11T00:07:33.695 INFO:tasks.workunit.client.0.smithi111.stdout:1/854: mkdir d2/de/d12/dc7/d11b 0 2024-09-11T00:07:33.696 INFO:tasks.workunit.client.0.smithi111.stdout:6/852: chown d7/d22/d3f/d74/d7f/f114 276340 1 2024-09-11T00:07:33.698 INFO:tasks.workunit.client.0.smithi111.stdout:2/812: write d0/d83/f9c [355590,16647] 0 2024-09-11T00:07:33.700 INFO:tasks.workunit.client.0.smithi111.stdout:4/840: dwrite d18/fb3 [0,4194304] 0 2024-09-11T00:07:33.700 INFO:tasks.workunit.client.0.smithi111.stdout:1/855: read - d2/de/d12/d3c/fec zero size 2024-09-11T00:07:33.702 INFO:tasks.workunit.client.1.smithi203.stdout:5/858: dwrite dc/d91/fcb [0,4194304] 0 2024-09-11T00:07:33.705 INFO:tasks.workunit.client.1.smithi203.stdout:0/787: dread d0/d2/d37/f3e [0,4194304] 0 2024-09-11T00:07:33.729 INFO:tasks.workunit.client.0.smithi111.stdout:0/909: dread d3/d13/d1e/d29/f53 [0,4194304] 0 2024-09-11T00:07:33.730 INFO:tasks.workunit.client.1.smithi203.stdout:3/882: dread d8/da/d5c/d6b/d6c/fd9 [0,4194304] 0 2024-09-11T00:07:33.778 INFO:tasks.workunit.client.0.smithi111.stdout:1/856: sync 2024-09-11T00:07:33.790 INFO:tasks.workunit.client.0.smithi111.stdout:1/857: dwrite d2/de/d12/d3c/d4b/d6a/d63/f6e [0,4194304] 0 2024-09-11T00:07:33.811 INFO:tasks.workunit.client.0.smithi111.stdout:6/853: stat d7/d22/d3f/f54 0 2024-09-11T00:07:33.814 INFO:tasks.workunit.client.1.smithi203.stdout:0/788: mknod d0/df8/c104 0 2024-09-11T00:07:33.815 INFO:tasks.workunit.client.0.smithi111.stdout:4/841: mkdir d18/d3b/d9f/d10b 0 2024-09-11T00:07:33.816 INFO:tasks.workunit.client.1.smithi203.stdout:5/859: dread dc/d4f/d5c/fda [0,4194304] 0 2024-09-11T00:07:33.817 INFO:tasks.workunit.client.0.smithi111.stdout:9/907: write d6/db/d34/d37/f1d [1051536,129373] 0 2024-09-11T00:07:33.823 INFO:tasks.workunit.client.1.smithi203.stdout:0/789: unlink d0/f19 0 2024-09-11T00:07:33.824 INFO:tasks.workunit.client.1.smithi203.stdout:4/748: dwrite db/d12/d15/d2a/f87 [4194304,4194304] 0 2024-09-11T00:07:33.825 INFO:tasks.workunit.client.0.smithi111.stdout:1/858: truncate d2/de/d12/d3c/d4b/d6a/f9e 402203 0 2024-09-11T00:07:33.826 INFO:tasks.workunit.client.1.smithi203.stdout:6/801: write d0/f5f [4632718,107687] 0 2024-09-11T00:07:33.828 INFO:tasks.workunit.client.0.smithi111.stdout:2/813: dwrite d0/d3/d12/d52/f87 [0,4194304] 0 2024-09-11T00:07:33.831 INFO:tasks.workunit.client.1.smithi203.stdout:6/802: write d0/d54/d9c/d35/f99 [2080894,7859] 0 2024-09-11T00:07:33.831 INFO:tasks.workunit.client.1.smithi203.stdout:9/810: write d6/de/d32/d52/d55/f2b [3374256,20250] 0 2024-09-11T00:07:33.832 INFO:tasks.workunit.client.0.smithi111.stdout:1/859: write d2/de/d12/d3c/d4b/d6a/d63/d95/fdf [1173238,39192] 0 2024-09-11T00:07:33.835 INFO:tasks.workunit.client.0.smithi111.stdout:6/854: fsync d7/d22/d3f/d74/d7f/d61/d6a/dba/f93 0 2024-09-11T00:07:33.837 INFO:tasks.workunit.client.0.smithi111.stdout:5/909: write d10/d1e/d23/d26/f50 [2217549,65430] 0 2024-09-11T00:07:33.838 INFO:tasks.workunit.client.0.smithi111.stdout:7/908: dwrite dd/d1d/d7e/dc8/fca [0,4194304] 0 2024-09-11T00:07:33.840 INFO:tasks.workunit.client.1.smithi203.stdout:0/790: symlink d0/d2/d7e/da1/df5/l105 0 2024-09-11T00:07:33.844 INFO:tasks.workunit.client.1.smithi203.stdout:4/749: mknod db/d12/d15/d2a/d88/cf2 0 2024-09-11T00:07:33.848 INFO:tasks.workunit.client.0.smithi111.stdout:3/902: getdents d1c/d1d/d22/dfd 0 2024-09-11T00:07:33.851 INFO:tasks.workunit.client.0.smithi111.stdout:1/860: read - d2/dad/fcf zero size 2024-09-11T00:07:33.852 INFO:tasks.workunit.client.1.smithi203.stdout:3/883: write d8/da/d5c/d6b/d6c/fd9 [42125,53415] 0 2024-09-11T00:07:33.854 INFO:tasks.workunit.client.0.smithi111.stdout:8/879: dwrite d11/d23/d2c/d46/f63 [4194304,4194304] 0 2024-09-11T00:07:33.854 INFO:tasks.workunit.client.1.smithi203.stdout:3/884: chown d8/da/d5c/f106 8 1 2024-09-11T00:07:33.857 INFO:tasks.workunit.client.1.smithi203.stdout:0/791: truncate d0/fc6 2345241 0 2024-09-11T00:07:33.857 INFO:tasks.workunit.client.0.smithi111.stdout:0/910: dread d3/f7 [0,4194304] 0 2024-09-11T00:07:33.857 INFO:tasks.workunit.client.0.smithi111.stdout:8/880: write d11/d23/d7e/f112 [340425,35204] 0 2024-09-11T00:07:33.860 INFO:tasks.workunit.client.0.smithi111.stdout:8/881: chown d11/d23/d2c/d53/cdf 14109478 1 2024-09-11T00:07:33.861 INFO:tasks.workunit.client.0.smithi111.stdout:9/908: creat d6/d52/d8a/d92/dc5/f12b x:0 0 0 2024-09-11T00:07:33.863 INFO:tasks.workunit.client.0.smithi111.stdout:9/909: chown d6/d52/d8a/d92/d110 103420 1 2024-09-11T00:07:33.863 INFO:tasks.workunit.client.0.smithi111.stdout:5/910: creat d10/d1e/d23/d30/d59/d7b/d11a/f12b x:0 0 0 2024-09-11T00:07:33.866 INFO:tasks.workunit.client.0.smithi111.stdout:9/910: write d6/db/d1b/fd7 [875553,1887] 0 2024-09-11T00:07:33.866 INFO:tasks.workunit.client.1.smithi203.stdout:9/811: creat d6/de/d47/de1/dec/df8/def/f10a x:0 0 0 2024-09-11T00:07:33.870 INFO:tasks.workunit.client.0.smithi111.stdout:7/909: rename dd/d1d/d7e/df8/d8f/d9f/fc7 to dd/d48/d69/dbe/dc4/f12b 0 2024-09-11T00:07:33.870 INFO:tasks.workunit.client.1.smithi203.stdout:5/860: dwrite dc/dd/d15/dbd/dce/fdc [0,4194304] 0 2024-09-11T00:07:33.871 INFO:tasks.workunit.client.0.smithi111.stdout:7/910: read dd/d1d/d1f/f5e [6437651,64368] 0 2024-09-11T00:07:33.876 INFO:tasks.workunit.client.1.smithi203.stdout:3/885: creat d8/da/d37/d83/d65/d8b/f13c x:0 0 0 2024-09-11T00:07:33.877 INFO:tasks.workunit.client.1.smithi203.stdout:0/792: creat d0/d2/d37/d5b/d73/db6/f106 x:0 0 0 2024-09-11T00:07:33.878 INFO:tasks.workunit.client.0.smithi111.stdout:4/842: dwrite d18/d20/d3c/d5e/d75/f9b [0,4194304] 0 2024-09-11T00:07:33.880 INFO:tasks.workunit.client.1.smithi203.stdout:6/803: creat d0/d54/d9c/d35/d39/ffd x:0 0 0 2024-09-11T00:07:33.884 INFO:tasks.workunit.client.1.smithi203.stdout:5/861: write dc/d4f/d5c/f112 [338216,58625] 0 2024-09-11T00:07:33.885 INFO:tasks.workunit.client.0.smithi111.stdout:2/814: symlink d0/d3/de/d68/d111/l114 0 2024-09-11T00:07:33.885 INFO:tasks.workunit.client.1.smithi203.stdout:9/812: rename d6/de/d19/d21/c2e to d6/de/d19/d24/d54/db2/de2/c10b 0 2024-09-11T00:07:33.887 INFO:tasks.workunit.client.0.smithi111.stdout:6/855: creat d7/d22/d1d/d109/f126 x:0 0 0 2024-09-11T00:07:33.890 INFO:tasks.workunit.client.0.smithi111.stdout:0/911: creat d3/d13/d1e/deb/d61/d93/da7/f135 x:0 0 0 2024-09-11T00:07:33.894 INFO:tasks.workunit.client.1.smithi203.stdout:6/804: creat d0/d32/d5a/ffe x:0 0 0 2024-09-11T00:07:33.898 INFO:tasks.workunit.client.1.smithi203.stdout:3/886: dwrite d8/da/f2f [0,4194304] 0 2024-09-11T00:07:33.905 INFO:tasks.workunit.client.1.smithi203.stdout:0/793: mknod d0/c107 0 2024-09-11T00:07:33.906 INFO:tasks.workunit.client.1.smithi203.stdout:9/813: mkdir d6/de/d19/d24/d54/db2/de2/d10c 0 2024-09-11T00:07:33.910 INFO:tasks.workunit.client.1.smithi203.stdout:4/750: dread db/dd/d26/f30 [0,4194304] 0 2024-09-11T00:07:33.913 INFO:tasks.workunit.client.0.smithi111.stdout:3/903: fdatasync f17 0 2024-09-11T00:07:33.914 INFO:tasks.workunit.client.1.smithi203.stdout:3/887: mkdir d8/da/d37/d53/d13d 0 2024-09-11T00:07:33.917 INFO:tasks.workunit.client.0.smithi111.stdout:7/911: mkdir dd/d1d/d76/db6/d12c 0 2024-09-11T00:07:33.920 INFO:tasks.workunit.client.0.smithi111.stdout:1/861: fsync d2/de/d12/d3c/d4b/d6a/f3d 0 2024-09-11T00:07:33.923 INFO:tasks.workunit.client.1.smithi203.stdout:9/814: creat d6/de/d32/d9e/f10d x:0 0 0 2024-09-11T00:07:33.923 INFO:tasks.workunit.client.0.smithi111.stdout:7/912: dread dd/da6/faa [0,4194304] 0 2024-09-11T00:07:33.925 INFO:tasks.workunit.client.1.smithi203.stdout:4/751: mkdir db/dd/d26/df3 0 2024-09-11T00:07:33.926 INFO:tasks.workunit.client.0.smithi111.stdout:8/882: write d11/d23/d2c/d46/d64/f76 [339358,54225] 0 2024-09-11T00:07:33.928 INFO:tasks.workunit.client.0.smithi111.stdout:5/911: mknod d10/d1e/d23/d2b/d5c/d61/d103/c12c 0 2024-09-11T00:07:33.931 INFO:tasks.workunit.client.0.smithi111.stdout:9/911: mkdir d6/dc/d12c 0 2024-09-11T00:07:33.932 INFO:tasks.workunit.client.1.smithi203.stdout:6/805: write d0/d32/f3a [1486739,130348] 0 2024-09-11T00:07:33.933 INFO:tasks.workunit.client.1.smithi203.stdout:6/806: fsync d0/f5f 0 2024-09-11T00:07:33.935 INFO:tasks.workunit.client.1.smithi203.stdout:5/862: dwrite dc/dd/d15/d3b/fc1 [0,4194304] 0 2024-09-11T00:07:33.935 INFO:tasks.workunit.client.1.smithi203.stdout:4/752: chown db/d12/d15/d2a/c75 44 1 2024-09-11T00:07:33.937 INFO:tasks.workunit.client.0.smithi111.stdout:4/843: sync 2024-09-11T00:07:33.938 INFO:tasks.workunit.client.1.smithi203.stdout:4/753: fsync db/dd/d16/d38/d3c/fc4 0 2024-09-11T00:07:33.939 INFO:tasks.workunit.client.0.smithi111.stdout:4/844: chown d18/d20/d40/d78/f105 124371172 1 2024-09-11T00:07:33.947 INFO:tasks.workunit.client.1.smithi203.stdout:7/788: sync 2024-09-11T00:07:33.949 INFO:tasks.workunit.client.1.smithi203.stdout:5/863: rmdir dc/dd/d15/dbd/d59 39 2024-09-11T00:07:33.952 INFO:tasks.workunit.client.1.smithi203.stdout:3/888: rename d8/d17/ddd/f133 to d8/f13e 0 2024-09-11T00:07:33.954 INFO:tasks.workunit.client.0.smithi111.stdout:8/883: mknod d11/d23/d3d/d5f/d99/c116 0 2024-09-11T00:07:33.956 INFO:tasks.workunit.client.1.smithi203.stdout:0/794: link d0/d2/fc4 d0/d2/d37/d80/f108 0 2024-09-11T00:07:33.958 INFO:tasks.workunit.client.1.smithi203.stdout:0/795: fsync d0/d2/d7e/da1/fe2 0 2024-09-11T00:07:33.959 INFO:tasks.workunit.client.0.smithi111.stdout:3/904: write d1c/d1d/d22/dfd/f105 [540795,112534] 0 2024-09-11T00:07:33.961 INFO:tasks.workunit.client.1.smithi203.stdout:9/815: write d6/de/d32/f59 [1270871,37412] 0 2024-09-11T00:07:33.963 INFO:tasks.workunit.client.1.smithi203.stdout:6/807: truncate d0/d54/d9c/d35/d38/f2e 10730 0 2024-09-11T00:07:33.967 INFO:tasks.workunit.client.0.smithi111.stdout:6/856: truncate d7/d22/d1d/d83/d121/d41/f82 28091 0 2024-09-11T00:07:33.968 INFO:tasks.workunit.client.0.smithi111.stdout:5/912: dread d10/d1e/d23/d26/fd4 [0,4194304] 0 2024-09-11T00:07:33.969 INFO:tasks.workunit.client.0.smithi111.stdout:9/912: write d6/f3b [1634951,73141] 0 2024-09-11T00:07:33.970 INFO:tasks.workunit.client.0.smithi111.stdout:7/913: truncate dd/d1d/d76/db6/ff5 19827 0 2024-09-11T00:07:33.971 INFO:tasks.workunit.client.1.smithi203.stdout:7/789: write dd/fa7 [653969,101777] 0 2024-09-11T00:07:33.971 INFO:tasks.workunit.client.1.smithi203.stdout:4/754: creat db/d12/d15/d2a/dcb/de5/ff4 x:0 0 0 2024-09-11T00:07:33.972 INFO:tasks.workunit.client.0.smithi111.stdout:6/857: truncate d7/d22/d1d/d109/f126 805336 0 2024-09-11T00:07:33.973 INFO:tasks.workunit.client.1.smithi203.stdout:0/796: rmdir d0/d1d/d5d/dec 39 2024-09-11T00:07:33.974 INFO:tasks.workunit.client.0.smithi111.stdout:3/905: mknod d1c/d1d/d22/d23/d2f/d63/d7e/c137 0 2024-09-11T00:07:33.975 INFO:tasks.workunit.client.1.smithi203.stdout:0/797: write d0/d1d/d5d/dba/fdf [3744055,83835] 0 2024-09-11T00:07:33.975 INFO:tasks.workunit.client.0.smithi111.stdout:0/912: dwrite d3/d1c/f4f [0,4194304] 0 2024-09-11T00:07:33.975 INFO:tasks.workunit.client.1.smithi203.stdout:9/816: unlink d6/de/d19/d24/d40/d45/l9f 0 2024-09-11T00:07:33.976 INFO:tasks.workunit.client.0.smithi111.stdout:7/914: chown dd/d1d/d7e/df8/d8f/d9f/fc6 483 1 2024-09-11T00:07:33.977 INFO:tasks.workunit.client.0.smithi111.stdout:2/815: getdents d0/d3/d2e/ded/dd8 0 2024-09-11T00:07:33.978 INFO:tasks.workunit.client.1.smithi203.stdout:9/817: chown d6/de/d19/d24/d54 1916025223 1 2024-09-11T00:07:33.978 INFO:tasks.workunit.client.1.smithi203.stdout:3/889: creat d8/d17/ddd/d139/f13f x:0 0 0 2024-09-11T00:07:33.981 INFO:tasks.workunit.client.0.smithi111.stdout:1/862: creat d2/de/d12/d3c/d4b/d6a/d3a/f11c x:0 0 0 2024-09-11T00:07:33.986 INFO:tasks.workunit.client.0.smithi111.stdout:9/913: mkdir d6/db/db8/dce/d12d 0 2024-09-11T00:07:33.989 INFO:tasks.workunit.client.0.smithi111.stdout:4/845: creat d18/d3b/d61/f10c x:0 0 0 2024-09-11T00:07:33.992 INFO:tasks.workunit.client.0.smithi111.stdout:3/906: creat d1c/d1d/d22/d23/d2f/d63/d7e/f138 x:0 0 0 2024-09-11T00:07:33.996 INFO:tasks.workunit.client.0.smithi111.stdout:9/914: dread d6/d52/d8a/f103 [0,4194304] 0 2024-09-11T00:07:33.997 INFO:tasks.workunit.client.1.smithi203.stdout:3/890: truncate d8/f3d 3297229 0 2024-09-11T00:07:33.997 INFO:tasks.workunit.client.0.smithi111.stdout:8/884: dwrite d11/d23/d2c/d46/f8f [0,4194304] 0 2024-09-11T00:07:33.998 INFO:tasks.workunit.client.0.smithi111.stdout:2/816: rename d0/d3/de to d0/d3/de/d115 22 2024-09-11T00:07:33.998 INFO:tasks.workunit.client.1.smithi203.stdout:3/891: dread - d8/da/d5c/d80/fb8 zero size 2024-09-11T00:07:33.999 INFO:tasks.workunit.client.1.smithi203.stdout:7/790: fdatasync dd/d1c/f2b 0 2024-09-11T00:07:33.999 INFO:tasks.workunit.client.1.smithi203.stdout:4/755: symlink db/lf5 0 2024-09-11T00:07:34.001 INFO:tasks.workunit.client.1.smithi203.stdout:5/864: getdents dc 0 2024-09-11T00:07:34.001 INFO:tasks.workunit.client.1.smithi203.stdout:4/756: stat c5 0 2024-09-11T00:07:34.006 INFO:tasks.workunit.client.1.smithi203.stdout:4/757: dread - db/d12/d15/d2a/dcb/fdf zero size 2024-09-11T00:07:34.009 INFO:tasks.workunit.client.1.smithi203.stdout:0/798: dwrite d0/d2/d7e/da1/fe2 [0,4194304] 0 2024-09-11T00:07:34.012 INFO:tasks.workunit.client.1.smithi203.stdout:0/799: readlink d0/d2/d7e/da1/df5/l56 0 2024-09-11T00:07:34.014 INFO:tasks.workunit.client.0.smithi111.stdout:5/913: dread d10/d1e/d23/d26/f34 [0,4194304] 0 2024-09-11T00:07:34.017 INFO:tasks.workunit.client.0.smithi111.stdout:3/907: dwrite d1c/d1d/d22/d44/d5a/f69 [0,4194304] 0 2024-09-11T00:07:34.023 INFO:tasks.workunit.client.1.smithi203.stdout:5/865: symlink dc/dd/d9b/dff/l11f 0 2024-09-11T00:07:34.023 INFO:tasks.workunit.client.1.smithi203.stdout:4/758: fdatasync db/dd/d16/f7b 0 2024-09-11T00:07:34.024 INFO:tasks.workunit.client.0.smithi111.stdout:0/913: dwrite d3/d13/d1e/deb/d61/f7e [0,4194304] 0 2024-09-11T00:07:34.028 INFO:tasks.workunit.client.1.smithi203.stdout:9/818: dwrite d6/de/d19/d24/d6c/f75 [0,4194304] 0 2024-09-11T00:07:34.030 INFO:tasks.workunit.client.0.smithi111.stdout:2/817: mkdir d0/d3/de/d4b/dd9/d116 0 2024-09-11T00:07:34.033 INFO:tasks.workunit.client.1.smithi203.stdout:9/819: stat d6/de/f74 0 2024-09-11T00:07:34.034 INFO:tasks.workunit.client.0.smithi111.stdout:8/885: unlink d11/d23/d2c/d46/d81/da5/ce6 0 2024-09-11T00:07:34.034 INFO:tasks.workunit.client.1.smithi203.stdout:4/759: chown db/dd/d16/d38/f3b 11772 1 2024-09-11T00:07:34.040 INFO:tasks.workunit.client.0.smithi111.stdout:9/915: truncate d6/db/d1b/d56/f6b 3205557 0 2024-09-11T00:07:34.040 INFO:tasks.workunit.client.0.smithi111.stdout:4/846: mknod d18/d20/d40/c10d 0 2024-09-11T00:07:34.043 INFO:tasks.workunit.client.1.smithi203.stdout:3/892: dwrite d8/da/d37/d83/d6a/f72 [0,4194304] 0 2024-09-11T00:07:34.043 INFO:tasks.workunit.client.1.smithi203.stdout:9/820: fdatasync d6/de/fa9 0 2024-09-11T00:07:34.049 INFO:tasks.workunit.client.1.smithi203.stdout:0/800: dwrite d0/f5c [0,4194304] 0 2024-09-11T00:07:34.050 INFO:tasks.workunit.client.1.smithi203.stdout:7/791: link dd/d1c/l34 dd/d1c/d52/d8f/d31/d58/d93/l11e 0 2024-09-11T00:07:34.051 INFO:tasks.workunit.client.0.smithi111.stdout:5/914: mknod d10/d1e/d23/d2b/dad/c12d 0 2024-09-11T00:07:34.053 INFO:tasks.workunit.client.1.smithi203.stdout:5/866: mkdir dc/dd/d13/d113/d120 0 2024-09-11T00:07:34.053 INFO:tasks.workunit.client.1.smithi203.stdout:7/792: stat dd/d1c/d7c/cfa 0 2024-09-11T00:07:34.054 INFO:tasks.workunit.client.0.smithi111.stdout:0/914: truncate d3/d13/d1e/f2e 3473122 0 2024-09-11T00:07:34.054 INFO:tasks.workunit.client.0.smithi111.stdout:3/908: dread d1c/d21/f6c [0,4194304] 0 2024-09-11T00:07:34.055 INFO:tasks.workunit.client.1.smithi203.stdout:4/760: mkdir db/d12/d15/d2a/d88/df6 0 2024-09-11T00:07:34.055 INFO:tasks.workunit.client.0.smithi111.stdout:1/863: link d2/de/d12/d3c/d4b/d6a/fab d2/de/d12/d6c/df5/f11d 0 2024-09-11T00:07:34.057 INFO:tasks.workunit.client.0.smithi111.stdout:6/858: getdents d7/d2b/dd4 0 2024-09-11T00:07:34.058 INFO:tasks.workunit.client.0.smithi111.stdout:6/859: chown d7/d22/d2c/d38/d56/dbf 31 1 2024-09-11T00:07:34.059 INFO:tasks.workunit.client.0.smithi111.stdout:2/818: mknod d0/d3/d2e/c117 0 2024-09-11T00:07:34.061 INFO:tasks.workunit.client.0.smithi111.stdout:8/886: rename d11/d23/d2c/fc5 to d11/d23/d3d/d5f/d99/d10c/f117 0 2024-09-11T00:07:34.063 INFO:tasks.workunit.client.1.smithi203.stdout:0/801: mknod d0/d2/d7e/c109 0 2024-09-11T00:07:34.064 INFO:tasks.workunit.client.1.smithi203.stdout:9/821: read - d6/de/f85 zero size 2024-09-11T00:07:34.068 INFO:tasks.workunit.client.0.smithi111.stdout:5/915: dread d10/d1e/d23/d2b/d5c/fb3 [0,4194304] 0 2024-09-11T00:07:34.069 INFO:tasks.workunit.client.0.smithi111.stdout:3/909: creat d1c/d21/db4/f139 x:0 0 0 2024-09-11T00:07:34.071 INFO:tasks.workunit.client.1.smithi203.stdout:7/793: symlink dd/d1c/d52/d8f/d31/d4a/d6e/df6/l11f 0 2024-09-11T00:07:34.074 INFO:tasks.workunit.client.1.smithi203.stdout:0/802: chown d0/d2/d7e/da1/dc9/de7/fca 18990279 1 2024-09-11T00:07:34.075 INFO:tasks.workunit.client.0.smithi111.stdout:0/915: rename d3/d1c/dd0/d117/f124 to d3/d26/f136 0 2024-09-11T00:07:34.079 INFO:tasks.workunit.client.1.smithi203.stdout:4/761: creat db/dd/ff7 x:0 0 0 2024-09-11T00:07:34.080 INFO:tasks.workunit.client.0.smithi111.stdout:8/887: symlink d11/d21/d6f/l118 0 2024-09-11T00:07:34.081 INFO:tasks.workunit.client.0.smithi111.stdout:6/860: truncate d7/d22/d2c/d38/d56/dbf/fc3 80983 0 2024-09-11T00:07:34.082 INFO:tasks.workunit.client.1.smithi203.stdout:4/762: read db/f7e [295208,25208] 0 2024-09-11T00:07:34.083 INFO:tasks.workunit.client.1.smithi203.stdout:5/867: dwrite dc/dd/d56/ffc [4194304,4194304] 0 2024-09-11T00:07:34.086 INFO:tasks.workunit.client.1.smithi203.stdout:3/893: dread d8/f16 [0,4194304] 0 2024-09-11T00:07:34.087 INFO:tasks.workunit.client.1.smithi203.stdout:7/794: rename dd/d1c/d52/dff/f11c to dd/d3b/d5b/ddd/f120 0 2024-09-11T00:07:34.090 INFO:tasks.workunit.client.0.smithi111.stdout:5/916: mkdir d10/d1e/d23/d26/d78/d12e 0 2024-09-11T00:07:34.091 INFO:tasks.workunit.client.1.smithi203.stdout:9/822: creat d6/de/d32/d52/f10e x:0 0 0 2024-09-11T00:07:34.091 INFO:tasks.workunit.client.1.smithi203.stdout:0/803: mkdir d0/d1d/d5d/d10a 0 2024-09-11T00:07:34.094 INFO:tasks.workunit.client.1.smithi203.stdout:5/868: rename dc/dd/d15/f37 to dc/d2b/f121 0 2024-09-11T00:07:34.094 INFO:tasks.workunit.client.1.smithi203.stdout:9/823: dread - d6/de/d19/d24/d54/db2/f109 zero size 2024-09-11T00:07:34.095 INFO:tasks.workunit.client.0.smithi111.stdout:0/916: chown d3/daf/c123 5472 1 2024-09-11T00:07:34.097 INFO:tasks.workunit.client.0.smithi111.stdout:3/910: rename d1c/d1d/d22/c129 to d1c/d21/dae/c13a 0 2024-09-11T00:07:34.101 INFO:tasks.workunit.client.1.smithi203.stdout:7/795: mknod dd/d1c/d52/d8f/d31/d4a/d6e/df6/c121 0 2024-09-11T00:07:34.102 INFO:tasks.workunit.client.1.smithi203.stdout:7/796: chown fc 5004 1 2024-09-11T00:07:34.102 INFO:tasks.workunit.client.0.smithi111.stdout:0/917: write d3/da/d7b/d84/f8b [832991,125795] 0 2024-09-11T00:07:34.102 INFO:tasks.workunit.client.0.smithi111.stdout:6/861: fdatasync f6 0 2024-09-11T00:07:34.105 INFO:tasks.workunit.client.1.smithi203.stdout:0/804: mknod d0/d2/d37/d5b/d73/c10b 0 2024-09-11T00:07:34.106 INFO:tasks.workunit.client.0.smithi111.stdout:1/864: creat d2/de/f11e x:0 0 0 2024-09-11T00:07:34.106 INFO:tasks.workunit.client.1.smithi203.stdout:1/931: sync 2024-09-11T00:07:34.108 INFO:tasks.workunit.client.1.smithi203.stdout:5/869: fdatasync dc/d4f/d5c/d76/fb2 0 2024-09-11T00:07:34.110 INFO:tasks.workunit.client.0.smithi111.stdout:5/917: unlink d10/d1e/d23/d30/d59/d52/d85/l11d 0 2024-09-11T00:07:34.114 INFO:tasks.workunit.client.0.smithi111.stdout:8/888: dwrite d11/d23/d3d/d5f/d99/d10c/f117 [0,4194304] 0 2024-09-11T00:07:34.116 INFO:tasks.workunit.client.1.smithi203.stdout:0/805: symlink d0/d2/d37/d80/l10c 0 2024-09-11T00:07:34.118 INFO:tasks.workunit.client.1.smithi203.stdout:3/894: mknod d8/da/d37/d53/dea/de5/d103/c140 0 2024-09-11T00:07:34.121 INFO:tasks.workunit.client.1.smithi203.stdout:2/886: sync 2024-09-11T00:07:34.121 INFO:tasks.workunit.client.1.smithi203.stdout:8/765: sync 2024-09-11T00:07:34.122 INFO:tasks.workunit.client.1.smithi203.stdout:5/870: rename dc/dd/d56/dad/f60 to dc/d4f/d5c/dc9/f122 0 2024-09-11T00:07:34.126 INFO:tasks.workunit.client.1.smithi203.stdout:2/887: stat d13/l89 0 2024-09-11T00:07:34.126 INFO:tasks.workunit.client.1.smithi203.stdout:7/797: creat dd/d1c/d52/d8f/d31/d4a/f122 x:0 0 0 2024-09-11T00:07:34.135 INFO:tasks.workunit.client.1.smithi203.stdout:0/806: dread d0/f5 [0,4194304] 0 2024-09-11T00:07:34.137 INFO:tasks.workunit.client.1.smithi203.stdout:8/766: creat d1/d13/d17/d2f/d9e/f103 x:0 0 0 2024-09-11T00:07:34.139 INFO:tasks.workunit.client.1.smithi203.stdout:0/807: fsync d0/d2/d37/d5b/d73/fe8 0 2024-09-11T00:07:34.141 INFO:tasks.workunit.client.1.smithi203.stdout:8/767: chown d1/d13/d17/d2f/d52/d49/d7a/fed 313 1 2024-09-11T00:07:34.141 INFO:tasks.workunit.client.1.smithi203.stdout:3/895: dwrite d8/da/f2f [4194304,4194304] 0 2024-09-11T00:07:34.144 INFO:tasks.workunit.client.1.smithi203.stdout:2/888: mknod d13/d15/d19/d1c/d73/c12a 0 2024-09-11T00:07:34.145 INFO:tasks.workunit.client.1.smithi203.stdout:8/768: chown d1/d13/d17/d2f/fb7 952380771 1 2024-09-11T00:07:34.149 INFO:tasks.workunit.client.0.smithi111.stdout:6/862: dread d7/d22/d1d/d83/fa1 [0,4194304] 0 2024-09-11T00:07:34.150 INFO:tasks.workunit.client.1.smithi203.stdout:7/798: creat dd/d3b/d5b/dd9/f123 x:0 0 0 2024-09-11T00:07:34.151 INFO:tasks.workunit.client.0.smithi111.stdout:6/863: dread - d7/d22/d2c/dff/d110/f11d zero size 2024-09-11T00:07:34.153 INFO:tasks.workunit.client.1.smithi203.stdout:0/808: rmdir d0/d2/d37/d7f 39 2024-09-11T00:07:34.161 INFO:tasks.workunit.client.1.smithi203.stdout:7/799: fdatasync dd/d1c/d7c/d8c/fe2 0 2024-09-11T00:07:34.164 INFO:tasks.workunit.client.1.smithi203.stdout:0/809: symlink d0/d2/d7e/dd2/l10d 0 2024-09-11T00:07:34.166 INFO:tasks.workunit.client.1.smithi203.stdout:3/896: dread d8/da/d37/d53/f62 [0,4194304] 0 2024-09-11T00:07:34.166 INFO:tasks.workunit.client.0.smithi111.stdout:4/847: dwrite d18/d39/f66 [0,4194304] 0 2024-09-11T00:07:34.170 INFO:tasks.workunit.client.1.smithi203.stdout:8/769: mknod d1/d13/d17/d48/d101/c104 0 2024-09-11T00:07:34.179 INFO:tasks.workunit.client.1.smithi203.stdout:0/810: creat d0/dc5/f10e x:0 0 0 2024-09-11T00:07:34.180 INFO:tasks.workunit.client.0.smithi111.stdout:9/916: dwrite d6/db/d34/d37/f35 [4194304,4194304] 0 2024-09-11T00:07:34.188 INFO:tasks.workunit.client.1.smithi203.stdout:4/763: truncate db/d12/d15/d2a/d88/faa 431861 0 2024-09-11T00:07:34.192 INFO:tasks.workunit.client.1.smithi203.stdout:2/889: rename d13/d15/d19/d1c/d76/d94/d97/df8/c123 to d13/d56/c12b 0 2024-09-11T00:07:34.195 INFO:tasks.workunit.client.1.smithi203.stdout:0/811: mknod d0/d9f/c10f 0 2024-09-11T00:07:34.202 INFO:tasks.workunit.client.0.smithi111.stdout:9/917: dread d6/d52/f90 [0,4194304] 0 2024-09-11T00:07:34.204 INFO:tasks.workunit.client.0.smithi111.stdout:9/918: write d6/f88 [2346367,57894] 0 2024-09-11T00:07:34.209 INFO:tasks.workunit.client.0.smithi111.stdout:0/918: sync 2024-09-11T00:07:34.221 INFO:tasks.workunit.client.0.smithi111.stdout:7/915: write dd/d1d/d76/db6/ff5 [796581,56444] 0 2024-09-11T00:07:34.221 INFO:tasks.workunit.client.0.smithi111.stdout:1/865: symlink d2/d2b/dc9/df0/l11f 0 2024-09-11T00:07:34.223 INFO:tasks.workunit.client.0.smithi111.stdout:7/916: fsync dd/d1d/d1f/d24/f111 0 2024-09-11T00:07:34.224 INFO:tasks.workunit.client.0.smithi111.stdout:2/819: getdents d0/d3/de/db4 0 2024-09-11T00:07:34.225 INFO:tasks.workunit.client.0.smithi111.stdout:5/918: fsync d10/d1e/d23/d30/d59/d7b/fc8 0 2024-09-11T00:07:34.233 INFO:tasks.workunit.client.0.smithi111.stdout:1/866: mknod d2/d2b/c120 0 2024-09-11T00:07:34.236 INFO:tasks.workunit.client.0.smithi111.stdout:6/864: mkdir d7/d22/d1d/d83/d121/d127 0 2024-09-11T00:07:34.238 INFO:tasks.workunit.client.0.smithi111.stdout:4/848: creat d18/d20/d3c/d5e/daa/dbb/ddc/f10e x:0 0 0 2024-09-11T00:07:34.245 INFO:tasks.workunit.client.1.smithi203.stdout:3/897: mkdir d8/da/d5c/d141 0 2024-09-11T00:07:34.245 INFO:tasks.workunit.client.1.smithi203.stdout:8/770: mknod d1/d13/d17/d48/dfa/c105 0 2024-09-11T00:07:34.246 INFO:tasks.workunit.client.1.smithi203.stdout:4/764: creat db/d12/d15/d2a/d88/d95/dc2/ff8 x:0 0 0 2024-09-11T00:07:34.249 INFO:tasks.workunit.client.1.smithi203.stdout:5/871: write dc/dd/f28 [719442,91361] 0 2024-09-11T00:07:34.251 INFO:tasks.workunit.client.0.smithi111.stdout:1/867: creat d2/de/d12/d3c/d4b/d6a/d63/d73/da1/db9/f121 x:0 0 0 2024-09-11T00:07:34.252 INFO:tasks.workunit.client.1.smithi203.stdout:0/812: symlink d0/d1d/d4c/l110 0 2024-09-11T00:07:34.254 INFO:tasks.workunit.client.0.smithi111.stdout:5/919: symlink d10/d1e/d23/d30/d59/l12f 0 2024-09-11T00:07:34.254 INFO:tasks.workunit.client.1.smithi203.stdout:0/813: readlink d0/d2/d92/la6 0 2024-09-11T00:07:34.256 INFO:tasks.workunit.client.1.smithi203.stdout:3/898: dread - d8/da/d37/d53/dea/fb7 zero size 2024-09-11T00:07:34.257 INFO:tasks.workunit.client.1.smithi203.stdout:9/824: dwrite d6/de/d32/feb [0,4194304] 0 2024-09-11T00:07:34.257 INFO:tasks.workunit.client.0.smithi111.stdout:6/865: rmdir d7/d22/d2c/dff/d110 39 2024-09-11T00:07:34.258 INFO:tasks.workunit.client.1.smithi203.stdout:9/825: readlink d6/de/dc4/l3b 0 2024-09-11T00:07:34.265 INFO:tasks.workunit.client.0.smithi111.stdout:0/919: creat d3/d13/f137 x:0 0 0 2024-09-11T00:07:34.268 INFO:tasks.workunit.client.1.smithi203.stdout:5/872: fsync dc/d91/fdb 0 2024-09-11T00:07:34.270 INFO:tasks.workunit.client.1.smithi203.stdout:5/873: chown dc/dd/d56/lfe 28991364 1 2024-09-11T00:07:34.272 INFO:tasks.workunit.client.1.smithi203.stdout:2/890: dwrite d13/d15/d19/d1c/d73/d7a/ff2 [0,4194304] 0 2024-09-11T00:07:34.274 INFO:tasks.workunit.client.1.smithi203.stdout:0/814: chown d0/d1d/c2f 0 1 2024-09-11T00:07:34.275 INFO:tasks.workunit.client.1.smithi203.stdout:0/815: stat d0/d1d/c84 0 2024-09-11T00:07:34.275 INFO:tasks.workunit.client.1.smithi203.stdout:3/899: dread - d8/da/d37/d83/da3/fa6 zero size 2024-09-11T00:07:34.276 INFO:tasks.workunit.client.1.smithi203.stdout:0/816: fsync d0/d2/d37/d80/ffd 0 2024-09-11T00:07:34.277 INFO:tasks.workunit.client.1.smithi203.stdout:9/826: fsync d6/f8c 0 2024-09-11T00:07:34.282 INFO:tasks.workunit.client.1.smithi203.stdout:8/771: unlink d1/d13/d17/d48/d9d/lf8 0 2024-09-11T00:07:34.287 INFO:tasks.workunit.client.0.smithi111.stdout:4/849: creat d18/d3b/d61/f10f x:0 0 0 2024-09-11T00:07:34.291 INFO:tasks.workunit.client.1.smithi203.stdout:2/891: creat d13/d15/d19/d1c/f12c x:0 0 0 2024-09-11T00:07:34.292 INFO:tasks.workunit.client.1.smithi203.stdout:9/827: dwrite d6/de/d19/d21/d87/f90 [0,4194304] 0 2024-09-11T00:07:34.292 INFO:tasks.workunit.client.0.smithi111.stdout:9/919: link d6/db/d1b/d41/d80/ff2 d6/dc/f12e 0 2024-09-11T00:07:34.293 INFO:tasks.workunit.client.0.smithi111.stdout:8/889: write d11/d21/d6f/fe9 [708245,58147] 0 2024-09-11T00:07:34.294 INFO:tasks.workunit.client.0.smithi111.stdout:3/911: dwrite d1c/d1d/d22/d44/d5a/d74/f110 [0,4194304] 0 2024-09-11T00:07:34.297 INFO:tasks.workunit.client.0.smithi111.stdout:3/912: truncate d1c/d1d/d22/f120 348408 0 2024-09-11T00:07:34.299 INFO:tasks.workunit.client.1.smithi203.stdout:3/900: dread - d8/dce/f101 zero size 2024-09-11T00:07:34.300 INFO:tasks.workunit.client.0.smithi111.stdout:0/920: creat d3/d13/d1e/d29/f138 x:0 0 0 2024-09-11T00:07:34.304 INFO:tasks.workunit.client.0.smithi111.stdout:9/920: unlink d6/db/d34/d37/l10e 0 2024-09-11T00:07:34.308 INFO:tasks.workunit.client.0.smithi111.stdout:5/920: link d10/f1b d10/d1e/d23/d2b/f130 0 2024-09-11T00:07:34.309 INFO:tasks.workunit.client.0.smithi111.stdout:6/866: rmdir d7/d22/d1d/d83 39 2024-09-11T00:07:34.310 INFO:tasks.workunit.client.0.smithi111.stdout:4/850: mknod d18/d20/d40/c110 0 2024-09-11T00:07:34.310 INFO:tasks.workunit.client.0.smithi111.stdout:5/921: chown d10/d1e/d23/d2b/d2f/d11f/d128/df6 118937962 1 2024-09-11T00:07:34.312 INFO:tasks.workunit.client.0.smithi111.stdout:3/913: dread - d1c/d1d/d22/d31/d62/fd5 zero size 2024-09-11T00:07:34.315 INFO:tasks.workunit.client.1.smithi203.stdout:0/817: mknod d0/d87/c111 0 2024-09-11T00:07:34.316 INFO:tasks.workunit.client.0.smithi111.stdout:7/917: dwrite dd/d1d/d4d/fb3 [4194304,4194304] 0 2024-09-11T00:07:34.319 INFO:tasks.workunit.client.1.smithi203.stdout:4/765: write db/f6c [3876885,86710] 0 2024-09-11T00:07:34.320 INFO:tasks.workunit.client.1.smithi203.stdout:4/766: dread - db/d12/fa4 zero size 2024-09-11T00:07:34.322 INFO:tasks.workunit.client.1.smithi203.stdout:8/772: link d1/d13/d17/d2f/d52/fff d1/d13/d17/d81/d97/f106 0 2024-09-11T00:07:34.327 INFO:tasks.workunit.client.1.smithi203.stdout:9/828: link d6/de/d19/f97 d6/de/d19/d24/d40/f10f 0 2024-09-11T00:07:34.330 INFO:tasks.workunit.client.1.smithi203.stdout:0/818: fsync d0/d2/d37/d5b/fc0 0 2024-09-11T00:07:34.331 INFO:tasks.workunit.client.0.smithi111.stdout:4/851: dread d18/d3b/d61/f87 [0,4194304] 0 2024-09-11T00:07:34.332 INFO:tasks.workunit.client.0.smithi111.stdout:1/868: write d2/de/f29 [2592959,17662] 0 2024-09-11T00:07:34.332 INFO:tasks.workunit.client.1.smithi203.stdout:1/932: sync 2024-09-11T00:07:34.332 INFO:tasks.workunit.client.1.smithi203.stdout:6/808: sync 2024-09-11T00:07:34.333 INFO:tasks.workunit.client.1.smithi203.stdout:3/901: rename d8/d3c/l4c to d8/da/d37/l142 0 2024-09-11T00:07:34.333 INFO:tasks.workunit.client.0.smithi111.stdout:2/820: sync 2024-09-11T00:07:34.335 INFO:tasks.workunit.client.0.smithi111.stdout:2/821: readlink d0/d3/d12/d52/l45 0 2024-09-11T00:07:34.340 INFO:tasks.workunit.client.0.smithi111.stdout:2/822: write d0/d3/de/d50/d9d/ffa [1606924,34453] 0 2024-09-11T00:07:34.342 INFO:tasks.workunit.client.1.smithi203.stdout:5/874: write dc/dd/d15/d3b/d7a/f9e [1211455,35322] 0 2024-09-11T00:07:34.342 INFO:tasks.workunit.client.1.smithi203.stdout:9/829: chown d6/de/d19/d24/d6c/fea 250879128 1 2024-09-11T00:07:34.343 INFO:tasks.workunit.client.1.smithi203.stdout:0/819: symlink d0/d2/d67/l112 0 2024-09-11T00:07:34.344 INFO:tasks.workunit.client.0.smithi111.stdout:7/918: fsync dd/d1d/d4d/fb9 0 2024-09-11T00:07:34.347 INFO:tasks.workunit.client.0.smithi111.stdout:6/867: mkdir d7/d22/d1d/d83/d121/d41/d77/d128 0 2024-09-11T00:07:34.348 INFO:tasks.workunit.client.0.smithi111.stdout:6/868: readlink d7/l8 0 2024-09-11T00:07:34.350 INFO:tasks.workunit.client.1.smithi203.stdout:3/902: mkdir d8/d2a/d143 0 2024-09-11T00:07:34.351 INFO:tasks.workunit.client.0.smithi111.stdout:5/922: creat d10/d1e/d23/d2b/dad/df8/f131 x:0 0 0 2024-09-11T00:07:34.354 INFO:tasks.workunit.client.0.smithi111.stdout:0/921: rmdir d3/d13/d1e/d29/db0/dce/d103 0 2024-09-11T00:07:34.356 INFO:tasks.workunit.client.1.smithi203.stdout:5/875: creat dc/dd/d56/dad/da5/f123 x:0 0 0 2024-09-11T00:07:34.357 INFO:tasks.workunit.client.1.smithi203.stdout:2/892: dwrite d13/d56/f78 [0,4194304] 0 2024-09-11T00:07:34.358 INFO:tasks.workunit.client.0.smithi111.stdout:4/852: creat d18/d20/d4a/d6b/f111 x:0 0 0 2024-09-11T00:07:34.359 INFO:tasks.workunit.client.1.smithi203.stdout:5/876: dread dc/fd4 [0,4194304] 0 2024-09-11T00:07:34.359 INFO:tasks.workunit.client.1.smithi203.stdout:2/893: dread - d13/d15/d19/d1c/f3c zero size 2024-09-11T00:07:34.360 INFO:tasks.workunit.client.0.smithi111.stdout:0/922: dread d3/d1c/f4a [0,4194304] 0 2024-09-11T00:07:34.361 INFO:tasks.workunit.client.0.smithi111.stdout:1/869: mknod d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/c122 0 2024-09-11T00:07:34.362 INFO:tasks.workunit.client.0.smithi111.stdout:8/890: sync 2024-09-11T00:07:34.365 INFO:tasks.workunit.client.0.smithi111.stdout:3/914: write d1c/d1d/d86/fd7 [1369254,10289] 0 2024-09-11T00:07:34.367 INFO:tasks.workunit.client.0.smithi111.stdout:7/919: dread dd/d1d/d4d/fb3 [0,4194304] 0 2024-09-11T00:07:34.374 INFO:tasks.workunit.client.0.smithi111.stdout:5/923: mkdir d10/d1e/d23/d30/dd8/da2/d132 0 2024-09-11T00:07:34.376 INFO:tasks.workunit.client.0.smithi111.stdout:5/924: chown d10/d1e/d23/d26/d78/f7f 3711 1 2024-09-11T00:07:34.380 INFO:tasks.workunit.client.0.smithi111.stdout:1/870: mkdir d2/de/d12/d3c/d4b/d6a/d63/d73/da1/db9/d123 0 2024-09-11T00:07:34.382 INFO:tasks.workunit.client.0.smithi111.stdout:9/921: rename d6/db/d1b/l36 to d6/l12f 0 2024-09-11T00:07:34.383 INFO:tasks.workunit.client.0.smithi111.stdout:9/922: write d6/dc/d73/fd8 [29688,67149] 0 2024-09-11T00:07:34.384 INFO:tasks.workunit.client.0.smithi111.stdout:2/823: symlink d0/d3/de/d10e/l118 0 2024-09-11T00:07:34.385 INFO:tasks.workunit.client.0.smithi111.stdout:3/915: creat d1c/d21/d92/f13b x:0 0 0 2024-09-11T00:07:34.390 INFO:tasks.workunit.client.0.smithi111.stdout:6/869: write d7/d22/d2c/d38/f45 [2040318,120491] 0 2024-09-11T00:07:34.392 INFO:tasks.workunit.client.0.smithi111.stdout:7/920: symlink dd/d122/l12d 0 2024-09-11T00:07:34.394 INFO:tasks.workunit.client.0.smithi111.stdout:2/824: creat d0/d3/de/d3b/d92/f119 x:0 0 0 2024-09-11T00:07:34.394 INFO:tasks.workunit.client.0.smithi111.stdout:4/853: creat d18/d20/d40/f112 x:0 0 0 2024-09-11T00:07:34.397 INFO:tasks.workunit.client.0.smithi111.stdout:9/923: mkdir d6/db/db8/dce/d12d/d130 0 2024-09-11T00:07:34.398 INFO:tasks.workunit.client.0.smithi111.stdout:8/891: dread d11/d23/d2c/d46/fc8 [0,4194304] 0 2024-09-11T00:07:34.398 INFO:tasks.workunit.client.0.smithi111.stdout:2/825: stat d0/d3/de/d3b/d62/d6d/c95 0 2024-09-11T00:07:34.403 INFO:tasks.workunit.client.0.smithi111.stdout:3/916: symlink d1c/d1d/d22/d44/d5a/l13c 0 2024-09-11T00:07:34.403 INFO:tasks.workunit.client.0.smithi111.stdout:5/925: getdents d10/d1e/d23/d30/dd8/d63/dbb/db5 0 2024-09-11T00:07:34.409 INFO:tasks.workunit.client.0.smithi111.stdout:4/854: rename d18/d20/d3c/f58 to d18/d20/d40/def/f113 0 2024-09-11T00:07:34.410 INFO:tasks.workunit.client.0.smithi111.stdout:0/923: link d3/da/f21 d3/d13/d1e/f139 0 2024-09-11T00:07:34.411 INFO:tasks.workunit.client.0.smithi111.stdout:2/826: mkdir d0/d3/de/d4b/d11a 0 2024-09-11T00:07:34.412 INFO:tasks.workunit.client.0.smithi111.stdout:7/921: dwrite dd/d1d/d7e/df8/d8f/fc2 [0,4194304] 0 2024-09-11T00:07:34.412 INFO:tasks.workunit.client.0.smithi111.stdout:8/892: symlink d11/d21/d38/l119 0 2024-09-11T00:07:34.413 INFO:tasks.workunit.client.0.smithi111.stdout:9/924: write d6/db/d1b/d41/f57 [958643,52823] 0 2024-09-11T00:07:34.415 INFO:tasks.workunit.client.0.smithi111.stdout:3/917: rename d1c/d1d/d22/d23/laf to d1c/d1d/d22/d23/d58/d5c/l13d 0 2024-09-11T00:07:34.415 INFO:tasks.workunit.client.0.smithi111.stdout:1/871: dread d2/de/f17 [0,4194304] 0 2024-09-11T00:07:34.417 INFO:tasks.workunit.client.0.smithi111.stdout:3/918: chown f6 304 1 2024-09-11T00:07:34.419 INFO:tasks.workunit.client.0.smithi111.stdout:4/855: fsync d18/d20/d40/d78/fd7 0 2024-09-11T00:07:34.419 INFO:tasks.workunit.client.0.smithi111.stdout:8/893: creat d11/f11a x:0 0 0 2024-09-11T00:07:34.419 INFO:tasks.workunit.client.0.smithi111.stdout:5/926: link d10/d1e/d23/cfb d10/d1e/d23/d30/d59/d52/c133 0 2024-09-11T00:07:34.422 INFO:tasks.workunit.client.0.smithi111.stdout:9/925: creat d6/d52/d8a/d92/d110/f131 x:0 0 0 2024-09-11T00:07:34.423 INFO:tasks.workunit.client.0.smithi111.stdout:1/872: dread - d2/de/d12/d3c/d4b/fdc zero size 2024-09-11T00:07:34.424 INFO:tasks.workunit.client.1.smithi203.stdout:9/830: symlink d6/de/d32/l110 0 2024-09-11T00:07:34.426 INFO:tasks.workunit.client.1.smithi203.stdout:5/877: mkdir dc/d91/d124 0 2024-09-11T00:07:34.427 INFO:tasks.workunit.client.1.smithi203.stdout:4/767: rename db/dd/d26/f3f to db/dd/d16/d38/ff9 0 2024-09-11T00:07:34.428 INFO:tasks.workunit.client.1.smithi203.stdout:6/809: write d0/d5b/d5c/fac [1302736,56198] 0 2024-09-11T00:07:34.429 INFO:tasks.workunit.client.0.smithi111.stdout:2/827: write d0/d3/d12/d52/d6c/f8f [3646814,69144] 0 2024-09-11T00:07:34.429 INFO:tasks.workunit.client.1.smithi203.stdout:0/820: write d0/d2/f65 [4041194,70418] 0 2024-09-11T00:07:34.435 INFO:tasks.workunit.client.1.smithi203.stdout:9/831: stat d6/de/d19/d24/d6c/da8/lfd 0 2024-09-11T00:07:34.436 INFO:tasks.workunit.client.1.smithi203.stdout:6/810: creat d0/d5b/fff x:0 0 0 2024-09-11T00:07:34.436 INFO:tasks.workunit.client.0.smithi111.stdout:4/856: creat d18/d20/d3c/d5e/daa/dbb/f114 x:0 0 0 2024-09-11T00:07:34.436 INFO:tasks.workunit.client.0.smithi111.stdout:0/924: read d3/d74/fde [1991319,81490] 0 2024-09-11T00:07:34.437 INFO:tasks.workunit.client.0.smithi111.stdout:2/828: chown d0/d3/f27 541 1 2024-09-11T00:07:34.439 INFO:tasks.workunit.client.0.smithi111.stdout:7/922: dwrite dd/d1d/d2d/d2e/f11f [0,4194304] 0 2024-09-11T00:07:34.440 INFO:tasks.workunit.client.1.smithi203.stdout:1/933: rename d8/d19/d60/d90/d3e/d4b/d80/d91/cbd to d8/d19/d60/d90/d3e/d4b/d80/d91/dac/c151 0 2024-09-11T00:07:34.443 INFO:tasks.workunit.client.0.smithi111.stdout:9/926: mkdir d6/dc/d12c/d132 0 2024-09-11T00:07:34.444 INFO:tasks.workunit.client.1.smithi203.stdout:8/773: dwrite d1/d13/d22/d6f/f8a [0,4194304] 0 2024-09-11T00:07:34.444 INFO:tasks.workunit.client.0.smithi111.stdout:9/927: dread - d6/dc/d73/f111 zero size 2024-09-11T00:07:34.446 INFO:tasks.workunit.client.0.smithi111.stdout:6/870: dread d7/d22/d3f/d74/d7f/d79/da4/fab [0,4194304] 0 2024-09-11T00:07:34.447 INFO:tasks.workunit.client.0.smithi111.stdout:1/873: dread d2/de/d12/d3c/d4b/d6a/d63/d95/fdf [0,4194304] 0 2024-09-11T00:07:34.452 INFO:tasks.workunit.client.0.smithi111.stdout:8/894: dread d11/d23/d2c/f3b [0,4194304] 0 2024-09-11T00:07:34.454 INFO:tasks.workunit.client.0.smithi111.stdout:8/895: chown d11/d23/d7e/l96 191 1 2024-09-11T00:07:34.456 INFO:tasks.workunit.client.1.smithi203.stdout:4/768: symlink db/d12/d15/d2a/d88/d95/dc2/de6/lfa 0 2024-09-11T00:07:34.458 INFO:tasks.workunit.client.1.smithi203.stdout:9/832: truncate d6/de/d19/d24/d54/db2/de2/fd7 348301 0 2024-09-11T00:07:34.460 INFO:tasks.workunit.client.0.smithi111.stdout:5/927: dwrite d10/d1e/d23/d2b/f33 [0,4194304] 0 2024-09-11T00:07:34.461 INFO:tasks.workunit.client.0.smithi111.stdout:1/874: dread d2/de/d12/d3c/d4b/d6a/d63/d73/da1/f50 [0,4194304] 0 2024-09-11T00:07:34.461 INFO:tasks.workunit.client.1.smithi203.stdout:2/894: dwrite d13/d56/d69/dcb/fe1 [0,4194304] 0 2024-09-11T00:07:34.463 INFO:tasks.workunit.client.0.smithi111.stdout:3/919: rename d1c/d1d/d22/d44/d5a/d74/d7b/f10f to d1c/d1d/d22/d44/f13e 0 2024-09-11T00:07:34.464 INFO:tasks.workunit.client.0.smithi111.stdout:3/920: chown ld 462 1 2024-09-11T00:07:34.464 INFO:tasks.workunit.client.1.smithi203.stdout:2/895: chown d13/d15/d19/d1c/d76/fb3 104 1 2024-09-11T00:07:34.465 INFO:tasks.workunit.client.1.smithi203.stdout:8/774: symlink d1/d13/d43/d46/d76/l107 0 2024-09-11T00:07:34.467 INFO:tasks.workunit.client.0.smithi111.stdout:9/928: symlink d6/dc/d12c/l133 0 2024-09-11T00:07:34.468 INFO:tasks.workunit.client.0.smithi111.stdout:9/929: write d6/db/f18 [3895971,85206] 0 2024-09-11T00:07:34.474 INFO:tasks.workunit.client.0.smithi111.stdout:2/829: mkdir d0/d11b 0 2024-09-11T00:07:34.478 INFO:tasks.workunit.client.0.smithi111.stdout:2/830: truncate d0/d3/de/d50/d9d/ffa 2371949 0 2024-09-11T00:07:34.482 INFO:tasks.workunit.client.0.smithi111.stdout:6/871: write d7/d22/d1d/f88 [991624,25876] 0 2024-09-11T00:07:34.483 INFO:tasks.workunit.client.0.smithi111.stdout:4/857: mknod d18/d20/d3c/d5e/d75/d8d/db8/c115 0 2024-09-11T00:07:34.488 INFO:tasks.workunit.client.0.smithi111.stdout:5/928: creat d10/d1e/d23/d30/d59/d52/dd6/f134 x:0 0 0 2024-09-11T00:07:34.491 INFO:tasks.workunit.client.0.smithi111.stdout:9/930: rmdir d6/d52 39 2024-09-11T00:07:34.493 INFO:tasks.workunit.client.0.smithi111.stdout:1/875: dread d2/de/d12/d6c/df5/f11d [0,4194304] 0 2024-09-11T00:07:34.495 INFO:tasks.workunit.client.0.smithi111.stdout:2/831: fsync d0/f1a 0 2024-09-11T00:07:34.504 INFO:tasks.workunit.client.0.smithi111.stdout:5/929: readlink d10/d1e/d25/d6e/le3 0 2024-09-11T00:07:34.505 INFO:tasks.workunit.client.0.smithi111.stdout:3/921: creat d1c/d21/d92/d115/f13f x:0 0 0 2024-09-11T00:07:34.507 INFO:tasks.workunit.client.0.smithi111.stdout:5/930: truncate d10/d1e/d23/d2b/d2f/f120 632721 0 2024-09-11T00:07:34.508 INFO:tasks.workunit.client.0.smithi111.stdout:4/858: dread d18/d20/d3c/f9a [0,4194304] 0 2024-09-11T00:07:34.513 INFO:tasks.workunit.client.0.smithi111.stdout:0/925: getdents d3/d13/d1e/deb/d61/d93/d102 0 2024-09-11T00:07:34.515 INFO:tasks.workunit.client.0.smithi111.stdout:1/876: dread d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/d7b/fd6 [0,4194304] 0 2024-09-11T00:07:34.515 INFO:tasks.workunit.client.0.smithi111.stdout:6/872: rmdir d7/d22/d26/d95/dd6 39 2024-09-11T00:07:34.516 INFO:tasks.workunit.client.0.smithi111.stdout:5/931: dread d10/d1e/d23/d26/d3a/d98/d6d/fc7 [0,4194304] 0 2024-09-11T00:07:34.517 INFO:tasks.workunit.client.0.smithi111.stdout:8/896: getdents d11/d23/d3d/d5f/d99 0 2024-09-11T00:07:34.519 INFO:tasks.workunit.client.0.smithi111.stdout:3/922: fsync d1c/d21/d92/f9a 0 2024-09-11T00:07:34.526 INFO:tasks.workunit.client.0.smithi111.stdout:6/873: mkdir d7/d22/d1d/d8c/d4a/d129 0 2024-09-11T00:07:34.529 INFO:tasks.workunit.client.0.smithi111.stdout:1/877: truncate d2/de/d12/d3c/d4b/fc8 415814 0 2024-09-11T00:07:34.534 INFO:tasks.workunit.client.0.smithi111.stdout:9/931: link d6/db/d1b/d41/fda d6/db/d34/d37/d4c/d7f/d97/de8/f134 0 2024-09-11T00:07:34.536 INFO:tasks.workunit.client.0.smithi111.stdout:0/926: mknod d3/da/c13a 0 2024-09-11T00:07:34.542 INFO:tasks.workunit.client.1.smithi203.stdout:7/800: sync 2024-09-11T00:07:34.542 INFO:tasks.workunit.client.1.smithi203.stdout:4/769: mkdir db/dd/d26/dcd/dfb 0 2024-09-11T00:07:34.546 INFO:tasks.workunit.client.1.smithi203.stdout:2/896: fdatasync d13/d15/d30/f63 0 2024-09-11T00:07:34.549 INFO:tasks.workunit.client.1.smithi203.stdout:0/821: getdents d0/dc5 0 2024-09-11T00:07:34.552 INFO:tasks.workunit.client.1.smithi203.stdout:9/833: symlink d6/de/d19/d24/d54/db2/l111 0 2024-09-11T00:07:34.555 INFO:tasks.workunit.client.1.smithi203.stdout:2/897: truncate d13/d22/f4a 2275839 0 2024-09-11T00:07:34.558 INFO:tasks.workunit.client.1.smithi203.stdout:8/775: link d1/d13/d17/d2f/lfe d1/d13/d17/d2f/d52/d49/l108 0 2024-09-11T00:07:34.558 INFO:tasks.workunit.client.1.smithi203.stdout:2/898: fdatasync d13/d15/d19/d1c/d73/d7a/ff2 0 2024-09-11T00:07:34.559 INFO:tasks.workunit.client.1.smithi203.stdout:0/822: mknod d0/d1d/c113 0 2024-09-11T00:07:34.559 INFO:tasks.workunit.client.1.smithi203.stdout:1/934: getdents d8/d19/d60/d90/d3e/dfe 0 2024-09-11T00:07:34.561 INFO:tasks.workunit.client.1.smithi203.stdout:0/823: stat d0/d2/d37/d5b/f79 0 2024-09-11T00:07:34.562 INFO:tasks.workunit.client.1.smithi203.stdout:9/834: mkdir d6/de/d32/d112 0 2024-09-11T00:07:34.565 INFO:tasks.workunit.client.0.smithi111.stdout:7/923: sync 2024-09-11T00:07:34.565 INFO:tasks.workunit.client.1.smithi203.stdout:7/801: dread dd/d1c/d52/d8f/d31/f36 [0,4194304] 0 2024-09-11T00:07:34.566 INFO:tasks.workunit.client.1.smithi203.stdout:4/770: getdents db/d12/d15 0 2024-09-11T00:07:34.567 INFO:tasks.workunit.client.1.smithi203.stdout:1/935: creat d8/d19/d60/d90/d3e/d4b/d80/d91/f152 x:0 0 0 2024-09-11T00:07:34.571 INFO:tasks.workunit.client.1.smithi203.stdout:2/899: mkdir d13/d15/d12d 0 2024-09-11T00:07:34.572 INFO:tasks.workunit.client.0.smithi111.stdout:2/832: truncate d0/d3/de/f10d 4480411 0 2024-09-11T00:07:34.573 INFO:tasks.workunit.client.0.smithi111.stdout:4/859: write d18/d20/d3c/d5e/daa/f104 [168678,21143] 0 2024-09-11T00:07:34.573 INFO:tasks.workunit.client.0.smithi111.stdout:6/874: write d7/d22/d26/f73 [1306562,76099] 0 2024-09-11T00:07:34.574 INFO:tasks.workunit.client.1.smithi203.stdout:9/835: mkdir d6/de/d19/d24/d113 0 2024-09-11T00:07:34.577 INFO:tasks.workunit.client.0.smithi111.stdout:4/860: write d18/d1f/f2e [4772711,55313] 0 2024-09-11T00:07:34.580 INFO:tasks.workunit.client.1.smithi203.stdout:4/771: dread db/f23 [0,4194304] 0 2024-09-11T00:07:34.581 INFO:tasks.workunit.client.1.smithi203.stdout:9/836: chown d6/de/d19/d24/d54/db2/de2/fba 253 1 2024-09-11T00:07:34.581 INFO:tasks.workunit.client.1.smithi203.stdout:2/900: symlink d13/d15/d30/dfa/daf/l12e 0 2024-09-11T00:07:34.583 INFO:tasks.workunit.client.1.smithi203.stdout:6/811: dwrite d0/d5b/d9f/fbb [0,4194304] 0 2024-09-11T00:07:34.584 INFO:tasks.workunit.client.0.smithi111.stdout:0/927: rename d3/d13/d1e/deb/fb7 to d3/da/d7b/db3/f13b 0 2024-09-11T00:07:34.586 INFO:tasks.workunit.client.1.smithi203.stdout:9/837: dread - d6/de/dc4/f101 zero size 2024-09-11T00:07:34.587 INFO:tasks.workunit.client.0.smithi111.stdout:7/924: truncate f7 1878459 0 2024-09-11T00:07:34.595 INFO:tasks.workunit.client.0.smithi111.stdout:1/878: link d2/de/d12/d3c/d4b/d6a/d63/d73/da1/c8e d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/d7b/c124 0 2024-09-11T00:07:34.596 INFO:tasks.workunit.client.1.smithi203.stdout:4/772: symlink db/d12/d15/d2a/d88/d95/lfc 0 2024-09-11T00:07:34.604 INFO:tasks.workunit.client.0.smithi111.stdout:3/923: link d1c/d1d/d22/d23/d2f/de8/d5f/c8a d1c/d1d/d22/d23/d2f/d63/c140 0 2024-09-11T00:07:34.604 INFO:tasks.workunit.client.1.smithi203.stdout:8/776: dwrite d1/f11 [0,4194304] 0 2024-09-11T00:07:34.605 INFO:tasks.workunit.client.1.smithi203.stdout:4/773: read db/dd/d16/f24 [1405066,130776] 0 2024-09-11T00:07:34.607 INFO:tasks.workunit.client.0.smithi111.stdout:1/879: dread d2/de/d12/d3c/d4b/d6a/d63/d73/da1/f2d [0,4194304] 0 2024-09-11T00:07:34.607 INFO:tasks.workunit.client.1.smithi203.stdout:2/901: unlink d13/d56/d69/c122 0 2024-09-11T00:07:34.609 INFO:tasks.workunit.client.1.smithi203.stdout:9/838: dread d6/de/d19/d24/d6c/f75 [0,4194304] 0 2024-09-11T00:07:34.610 INFO:tasks.workunit.client.1.smithi203.stdout:7/802: dwrite dd/d1c/d52/d8f/d31/d67/dc8/fb6 [0,4194304] 0 2024-09-11T00:07:34.611 INFO:tasks.workunit.client.1.smithi203.stdout:1/936: dread d8/d19/d60/f87 [0,4194304] 0 2024-09-11T00:07:34.615 INFO:tasks.workunit.client.0.smithi111.stdout:4/861: truncate d18/f1b 5033359 0 2024-09-11T00:07:34.617 INFO:tasks.workunit.client.0.smithi111.stdout:4/862: chown d18/d20/d40/d78/fcb 105048 1 2024-09-11T00:07:34.617 INFO:tasks.workunit.client.0.smithi111.stdout:7/925: rmdir dd/d1d/d7e/df8/d8f/d9f 39 2024-09-11T00:07:34.620 INFO:tasks.workunit.client.0.smithi111.stdout:9/932: link d6/db/d34/d37/f29 d6/d52/d8a/f135 0 2024-09-11T00:07:34.622 INFO:tasks.workunit.client.1.smithi203.stdout:2/902: fdatasync d13/d47/f86 0 2024-09-11T00:07:34.627 INFO:tasks.workunit.client.0.smithi111.stdout:6/875: mknod d7/d22/d26/d95/dd6/c12a 0 2024-09-11T00:07:34.631 INFO:tasks.workunit.client.1.smithi203.stdout:4/774: dwrite db/dd/d16/f6e [0,4194304] 0 2024-09-11T00:07:34.634 INFO:tasks.workunit.client.0.smithi111.stdout:1/880: symlink d2/d77/l125 0 2024-09-11T00:07:34.637 INFO:tasks.workunit.client.1.smithi203.stdout:6/812: write d0/d5b/d5c/d6f/fc1 [797080,124741] 0 2024-09-11T00:07:34.641 INFO:tasks.workunit.client.1.smithi203.stdout:6/813: dread - d0/d54/d9c/d35/d38/dc0/ddb/d82/ff2 zero size 2024-09-11T00:07:34.648 INFO:tasks.workunit.client.1.smithi203.stdout:6/814: chown d0/d5b/d5c/d6f/de7 1 1 2024-09-11T00:07:34.648 INFO:tasks.workunit.client.1.smithi203.stdout:7/803: mknod dd/d1c/d52/d8f/d31/d4a/d105/d115/c124 0 2024-09-11T00:07:34.649 INFO:tasks.workunit.client.0.smithi111.stdout:9/933: rename d6/db/d1b/ca6 to d6/d52/d8a/d92/d110/c136 0 2024-09-11T00:07:34.650 INFO:tasks.workunit.client.0.smithi111.stdout:0/928: dwrite d3/d13/f89 [4194304,4194304] 0 2024-09-11T00:07:34.652 INFO:tasks.workunit.client.1.smithi203.stdout:8/777: dread d1/d13/d17/d2f/d9e/f66 [0,4194304] 0 2024-09-11T00:07:34.654 INFO:tasks.workunit.client.0.smithi111.stdout:2/833: link d0/d3/d98/fbb d0/d3/de/d68/df1/f11c 0 2024-09-11T00:07:34.655 INFO:tasks.workunit.client.0.smithi111.stdout:5/932: sync 2024-09-11T00:07:34.657 INFO:tasks.workunit.client.0.smithi111.stdout:3/924: getdents d1c/d1d/d22/d23/d2f/de5/d123 0 2024-09-11T00:07:34.660 INFO:tasks.workunit.client.0.smithi111.stdout:4/863: link d18/d3b/f106 d18/d1f/d36/f116 0 2024-09-11T00:07:34.660 INFO:tasks.workunit.client.1.smithi203.stdout:9/839: write d6/de/dc4/f42 [4843197,81033] 0 2024-09-11T00:07:34.661 INFO:tasks.workunit.client.0.smithi111.stdout:5/933: dread d10/d1e/d23/d2b/d5c/fb3 [0,4194304] 0 2024-09-11T00:07:34.662 INFO:tasks.workunit.client.1.smithi203.stdout:1/937: write d8/d119/ffc [995461,128538] 0 2024-09-11T00:07:34.662 INFO:tasks.workunit.client.0.smithi111.stdout:4/864: write d18/d3b/d61/f10c [582561,91117] 0 2024-09-11T00:07:34.662 INFO:tasks.workunit.client.0.smithi111.stdout:5/934: chown d10/d1e/d23/d2b/d5c/la7 23 1 2024-09-11T00:07:34.664 INFO:tasks.workunit.client.1.smithi203.stdout:9/840: stat d6/de/dc4/ce7 0 2024-09-11T00:07:34.666 INFO:tasks.workunit.client.1.smithi203.stdout:8/778: creat d1/d13/d17/d2f/d52/d49/d68/dba/f109 x:0 0 0 2024-09-11T00:07:34.666 INFO:tasks.workunit.client.1.smithi203.stdout:6/815: dread d0/d54/d9c/f72 [4194304,4194304] 0 2024-09-11T00:07:34.667 INFO:tasks.workunit.client.0.smithi111.stdout:0/929: truncate d3/d1c/fad 926555 0 2024-09-11T00:07:34.668 INFO:tasks.workunit.client.0.smithi111.stdout:9/934: read d6/db/d1b/f4b [2121531,86070] 0 2024-09-11T00:07:34.670 INFO:tasks.workunit.client.0.smithi111.stdout:9/935: chown d6/db/db8/fc4 0 1 2024-09-11T00:07:34.671 INFO:tasks.workunit.client.0.smithi111.stdout:4/865: dread d18/d20/d40/f8c [0,4194304] 0 2024-09-11T00:07:34.671 INFO:tasks.workunit.client.1.smithi203.stdout:9/841: rmdir d6/de/d32 39 2024-09-11T00:07:34.673 INFO:tasks.workunit.client.0.smithi111.stdout:3/925: fsync d1c/d1d/d22/d23/f28 0 2024-09-11T00:07:34.674 INFO:tasks.workunit.client.1.smithi203.stdout:1/938: mkdir d8/d19/d60/d90/d3e/d4b/d80/d8d/da3/d153 0 2024-09-11T00:07:34.676 INFO:tasks.workunit.client.1.smithi203.stdout:4/775: write db/dd/d16/d38/d3c/d41/f46 [2284934,11670] 0 2024-09-11T00:07:34.677 INFO:tasks.workunit.client.1.smithi203.stdout:4/776: readlink db/d12/d15/l9e 0 2024-09-11T00:07:34.682 INFO:tasks.workunit.client.1.smithi203.stdout:9/842: chown d6/de/d32/d52/f10e 27607361 1 2024-09-11T00:07:34.684 INFO:tasks.workunit.client.1.smithi203.stdout:8/779: dread d1/d13/d17/d48/fc0 [0,4194304] 0 2024-09-11T00:07:34.685 INFO:tasks.workunit.client.0.smithi111.stdout:9/936: rename d6/ddd/d114 to d6/d52/d8a/d137 0 2024-09-11T00:07:34.687 INFO:tasks.workunit.client.1.smithi203.stdout:9/843: chown d6/f76 7586 1 2024-09-11T00:07:34.688 INFO:tasks.workunit.client.0.smithi111.stdout:3/926: symlink d1c/d1d/d22/d44/d5a/dcd/l141 0 2024-09-11T00:07:34.688 INFO:tasks.workunit.client.0.smithi111.stdout:7/926: link dd/c73 dd/d1d/d7e/df8/d8f/c12e 0 2024-09-11T00:07:34.689 INFO:tasks.workunit.client.1.smithi203.stdout:7/804: dwrite dd/d1c/f57 [0,4194304] 0 2024-09-11T00:07:34.689 INFO:tasks.workunit.client.0.smithi111.stdout:5/935: fdatasync d10/d1e/d23/d2b/d2f/fda 0 2024-09-11T00:07:34.690 INFO:tasks.workunit.client.0.smithi111.stdout:2/834: link d0/d3/c25 d0/d3/de/d3b/d97/d104/c11d 0 2024-09-11T00:07:34.692 INFO:tasks.workunit.client.0.smithi111.stdout:3/927: dread d1c/d1d/d22/d23/d2f/f7a [0,4194304] 0 2024-09-11T00:07:34.698 INFO:tasks.workunit.client.0.smithi111.stdout:7/927: read - dd/d1d/d76/fa3 zero size 2024-09-11T00:07:34.702 INFO:tasks.workunit.client.0.smithi111.stdout:3/928: mkdir d1c/d1d/d86/d142 0 2024-09-11T00:07:34.705 INFO:tasks.workunit.client.1.smithi203.stdout:7/805: rename dd/d1c/d52/d8f/d31/d58/d93/d98/l116 to dd/d1c/d52/d8f/d31/d4a/d105/dbb/de8/l125 0 2024-09-11T00:07:34.707 INFO:tasks.workunit.client.1.smithi203.stdout:4/777: dread db/dd/d16/f55 [0,4194304] 0 2024-09-11T00:07:34.708 INFO:tasks.workunit.client.0.smithi111.stdout:0/930: getdents d3/d1c/d50/dec 0 2024-09-11T00:07:34.712 INFO:tasks.workunit.client.0.smithi111.stdout:9/937: fdatasync d6/db/d1b/d41/fda 0 2024-09-11T00:07:34.712 INFO:tasks.workunit.client.0.smithi111.stdout:0/931: read d3/d13/f89 [3809534,119429] 0 2024-09-11T00:07:34.712 INFO:tasks.workunit.client.1.smithi203.stdout:4/778: read db/dd/d26/d42/f45 [1792568,121208] 0 2024-09-11T00:07:34.712 INFO:tasks.workunit.client.1.smithi203.stdout:1/939: dread d8/d9/fbb [0,4194304] 0 2024-09-11T00:07:34.713 INFO:tasks.workunit.client.0.smithi111.stdout:0/932: stat d3/d13/d66/fa0 0 2024-09-11T00:07:34.717 INFO:tasks.workunit.client.1.smithi203.stdout:7/806: fdatasync dd/d1c/d52/f6f 0 2024-09-11T00:07:34.717 INFO:tasks.workunit.client.0.smithi111.stdout:5/936: dread d10/d1e/d23/d30/dd8/d7e/fb1 [0,4194304] 0 2024-09-11T00:07:34.718 INFO:tasks.workunit.client.1.smithi203.stdout:7/807: chown dd/f113 19390546 1 2024-09-11T00:07:34.719 INFO:tasks.workunit.client.0.smithi111.stdout:8/897: sync 2024-09-11T00:07:34.720 INFO:tasks.workunit.client.0.smithi111.stdout:5/937: stat d10/d1e/d23/d2b/d2f/l41 0 2024-09-11T00:07:34.721 INFO:tasks.workunit.client.0.smithi111.stdout:4/866: getdents d18/d1f/d36 0 2024-09-11T00:07:34.722 INFO:tasks.workunit.client.0.smithi111.stdout:4/867: chown d18/d3b/d51/f63 464 1 2024-09-11T00:07:34.722 INFO:tasks.workunit.client.0.smithi111.stdout:3/929: fdatasync d1c/d1d/d22/d31/d62/fda 0 2024-09-11T00:07:34.730 INFO:tasks.workunit.client.1.smithi203.stdout:7/808: read - dd/ff9 zero size 2024-09-11T00:07:34.734 INFO:tasks.workunit.client.1.smithi203.stdout:1/940: getdents d8/d19/d60/dff/d135 0 2024-09-11T00:07:34.734 INFO:tasks.workunit.client.0.smithi111.stdout:2/835: write d0/d3/d98/fbb [959864,16228] 0 2024-09-11T00:07:34.735 INFO:tasks.workunit.client.0.smithi111.stdout:7/928: write dd/d1d/d7e/dc8/fd8 [622389,55341] 0 2024-09-11T00:07:34.736 INFO:tasks.workunit.client.1.smithi203.stdout:8/780: dwrite d1/d13/d3a/da4/fe1 [0,4194304] 0 2024-09-11T00:07:34.741 INFO:tasks.workunit.client.1.smithi203.stdout:9/844: dwrite d6/de/d32/d52/f92 [0,4194304] 0 2024-09-11T00:07:34.745 INFO:tasks.workunit.client.1.smithi203.stdout:9/845: dread d6/f76 [0,4194304] 0 2024-09-11T00:07:34.750 INFO:tasks.workunit.client.1.smithi203.stdout:4/779: dwrite db/dd/d16/f24 [0,4194304] 0 2024-09-11T00:07:34.754 INFO:tasks.workunit.client.0.smithi111.stdout:2/836: creat d0/d83/f11e x:0 0 0 2024-09-11T00:07:34.754 INFO:tasks.workunit.client.1.smithi203.stdout:7/809: link dd/d1c/d52/ff8 dd/d1c/d7c/f126 0 2024-09-11T00:07:34.754 INFO:tasks.workunit.client.0.smithi111.stdout:6/876: sync 2024-09-11T00:07:34.757 INFO:tasks.workunit.client.0.smithi111.stdout:3/930: dwrite d1c/d1d/d22/d23/d58/f11d [0,4194304] 0 2024-09-11T00:07:34.758 INFO:tasks.workunit.client.0.smithi111.stdout:8/898: symlink d11/d23/d3d/dfa/l11b 0 2024-09-11T00:07:34.760 INFO:tasks.workunit.client.1.smithi203.stdout:4/780: symlink db/d12/d15/d2a/dc3/lfd 0 2024-09-11T00:07:34.768 INFO:tasks.workunit.client.1.smithi203.stdout:8/781: dwrite d1/d13/d17/f38 [0,4194304] 0 2024-09-11T00:07:34.769 INFO:tasks.workunit.client.1.smithi203.stdout:7/810: rmdir dd/d1c/d52/d8f/d31/d4a/d6e/df6 39 2024-09-11T00:07:34.781 INFO:tasks.workunit.client.1.smithi203.stdout:9/846: dwrite d6/f96 [0,4194304] 0 2024-09-11T00:07:34.784 INFO:tasks.workunit.client.0.smithi111.stdout:3/931: truncate f17 3016728 0 2024-09-11T00:07:34.786 INFO:tasks.workunit.client.0.smithi111.stdout:3/932: chown d1c/d1d/d22/dfd/f104 1164943573 1 2024-09-11T00:07:34.787 INFO:tasks.workunit.client.1.smithi203.stdout:8/782: creat d1/d13/d17/d2f/d52/d49/f10a x:0 0 0 2024-09-11T00:07:34.787 INFO:tasks.workunit.client.1.smithi203.stdout:7/811: creat dd/d3b/d5b/f127 x:0 0 0 2024-09-11T00:07:34.789 INFO:tasks.workunit.client.0.smithi111.stdout:1/881: sync 2024-09-11T00:07:34.790 INFO:tasks.workunit.client.1.smithi203.stdout:7/812: chown dd/d3b/fd7 104405 1 2024-09-11T00:07:34.795 INFO:tasks.workunit.client.1.smithi203.stdout:1/941: dread d8/d19/d31/f88 [0,4194304] 0 2024-09-11T00:07:34.795 INFO:tasks.workunit.client.0.smithi111.stdout:9/938: link d6/db/d1b/le9 d6/db/d1b/d56/dc8/l138 0 2024-09-11T00:07:34.797 INFO:tasks.workunit.client.0.smithi111.stdout:9/939: chown d6/db/d34/d37/f48 3319753 1 2024-09-11T00:07:34.798 INFO:tasks.workunit.client.1.smithi203.stdout:8/783: mkdir d1/d13/d17/d48/d9d/d10b 0 2024-09-11T00:07:34.798 INFO:tasks.workunit.client.0.smithi111.stdout:0/933: getdents d3/d13/d1e/d29 0 2024-09-11T00:07:34.799 INFO:tasks.workunit.client.0.smithi111.stdout:0/934: stat d3/d13/d1e/f4d 0 2024-09-11T00:07:34.800 INFO:tasks.workunit.client.0.smithi111.stdout:0/935: dread - d3/da/f130 zero size 2024-09-11T00:07:34.801 INFO:tasks.workunit.client.1.smithi203.stdout:4/781: dread db/dd/d16/ded/fa7 [0,4194304] 0 2024-09-11T00:07:34.805 INFO:tasks.workunit.client.0.smithi111.stdout:8/899: write d11/d23/d3d/d5f/fd9 [4958725,128272] 0 2024-09-11T00:07:34.806 INFO:tasks.workunit.client.0.smithi111.stdout:5/938: getdents d10/d1e/d23/d2b/d92/db8 0 2024-09-11T00:07:34.808 INFO:tasks.workunit.client.0.smithi111.stdout:7/929: creat dd/d48/f12f x:0 0 0 2024-09-11T00:07:34.810 INFO:tasks.workunit.client.0.smithi111.stdout:7/930: fsync dd/d1d/d7e/df8/d8f/dac/d112/f11a 0 2024-09-11T00:07:34.811 INFO:tasks.workunit.client.1.smithi203.stdout:9/847: creat d6/de/d19/d24/f114 x:0 0 0 2024-09-11T00:07:34.811 INFO:tasks.workunit.client.0.smithi111.stdout:4/868: link d18/d39/cc0 d18/d3b/d9f/d10b/c117 0 2024-09-11T00:07:34.812 INFO:tasks.workunit.client.0.smithi111.stdout:4/869: readlink d18/d20/l70 0 2024-09-11T00:07:34.813 INFO:tasks.workunit.client.1.smithi203.stdout:4/782: dread - db/dd/d26/fa3 zero size 2024-09-11T00:07:34.813 INFO:tasks.workunit.client.0.smithi111.stdout:4/870: dread - d18/d20/d3c/f98 zero size 2024-09-11T00:07:34.814 INFO:tasks.workunit.client.1.smithi203.stdout:8/784: rename d1/d13/d17/d2f/d52/d59/c87 to d1/d13/d22/d6f/d8d/c10c 0 2024-09-11T00:07:34.816 INFO:tasks.workunit.client.1.smithi203.stdout:9/848: dread - d6/de/d19/f9a zero size 2024-09-11T00:07:34.817 INFO:tasks.workunit.client.0.smithi111.stdout:0/936: mknod d3/da/d7b/db3/d11c/d12b/c13c 0 2024-09-11T00:07:34.818 INFO:tasks.workunit.client.0.smithi111.stdout:4/871: truncate d18/d1f/d36/d95/dde/ff3 4517253 0 2024-09-11T00:07:34.818 INFO:tasks.workunit.client.0.smithi111.stdout:5/939: dread d10/f19 [0,4194304] 0 2024-09-11T00:07:34.820 INFO:tasks.workunit.client.0.smithi111.stdout:0/937: dread - d3/da/d7b/db3/d11c/f131 zero size 2024-09-11T00:07:34.820 INFO:tasks.workunit.client.0.smithi111.stdout:4/872: fdatasync d18/d20/d40/d78/fd3 0 2024-09-11T00:07:34.820 INFO:tasks.workunit.client.1.smithi203.stdout:8/785: chown d1/d13/d17/d2f/d52/f92 27234 1 2024-09-11T00:07:34.820 INFO:tasks.workunit.client.1.smithi203.stdout:9/849: readlink d6/de/d19/d24/d54/ld5 0 2024-09-11T00:07:34.822 INFO:tasks.workunit.client.0.smithi111.stdout:0/938: write d3/da/f130 [765369,91556] 0 2024-09-11T00:07:34.827 INFO:tasks.workunit.client.0.smithi111.stdout:2/837: getdents d0/d3/d12 0 2024-09-11T00:07:34.828 INFO:tasks.workunit.client.1.smithi203.stdout:9/850: mkdir d6/de/d47/dc3/d115 0 2024-09-11T00:07:34.829 INFO:tasks.workunit.client.0.smithi111.stdout:6/877: link d7/d22/d3f/d74/d7f/d79/cf3 d7/d22/c12b 0 2024-09-11T00:07:34.832 INFO:tasks.workunit.client.1.smithi203.stdout:8/786: rename d1/d13/d3a/fb3 to d1/d13/d43/dab/f10d 0 2024-09-11T00:07:34.834 INFO:tasks.workunit.client.1.smithi203.stdout:7/813: dwrite dd/d1c/d52/d8f/d31/d4a/f68 [0,4194304] 0 2024-09-11T00:07:34.837 INFO:tasks.workunit.client.1.smithi203.stdout:7/814: readlink dd/d1c/d7c/l87 0 2024-09-11T00:07:34.839 INFO:tasks.workunit.client.0.smithi111.stdout:7/931: write dd/d48/d69/dea/ff3 [879739,71274] 0 2024-09-11T00:07:34.840 INFO:tasks.workunit.client.0.smithi111.stdout:8/900: dread d11/d23/d2c/d46/f4d [0,4194304] 0 2024-09-11T00:07:34.842 INFO:tasks.workunit.client.1.smithi203.stdout:1/942: dread d8/d19/d60/d90/f104 [0,4194304] 0 2024-09-11T00:07:34.843 INFO:tasks.workunit.client.0.smithi111.stdout:4/873: mknod d18/d20/d3c/d5e/daa/dbb/ddc/c118 0 2024-09-11T00:07:34.848 INFO:tasks.workunit.client.1.smithi203.stdout:7/815: creat dd/d1c/d52/f128 x:0 0 0 2024-09-11T00:07:34.852 INFO:tasks.workunit.client.1.smithi203.stdout:4/783: dwrite db/d12/f93 [0,4194304] 0 2024-09-11T00:07:34.853 INFO:tasks.workunit.client.0.smithi111.stdout:1/882: rename d2/de/d12/d3c/d4b/d6a/d63/fb7 to d2/de/d12/f126 0 2024-09-11T00:07:34.855 INFO:tasks.workunit.client.0.smithi111.stdout:2/838: mknod d0/d3/de/d3b/d97/c11f 0 2024-09-11T00:07:34.859 INFO:tasks.workunit.client.0.smithi111.stdout:6/878: creat d7/d22/d3f/d74/d7f/d61/d6a/d9f/f12c x:0 0 0 2024-09-11T00:07:34.863 INFO:tasks.workunit.client.0.smithi111.stdout:3/933: getdents d1c/d21/dae/dfe 0 2024-09-11T00:07:34.865 INFO:tasks.workunit.client.1.smithi203.stdout:4/784: symlink db/d12/d15/d2a/d88/d95/lfe 0 2024-09-11T00:07:34.868 INFO:tasks.workunit.client.0.smithi111.stdout:5/940: symlink d10/d1e/d23/d26/d3a/dea/d115/l135 0 2024-09-11T00:07:34.869 INFO:tasks.workunit.client.1.smithi203.stdout:7/816: mkdir dd/d1c/d52/d8f/d31/d67/dc3/d129 0 2024-09-11T00:07:34.870 INFO:tasks.workunit.client.1.smithi203.stdout:1/943: write d8/d9/fbb [3555795,33849] 0 2024-09-11T00:07:34.872 INFO:tasks.workunit.client.0.smithi111.stdout:7/932: rmdir dd/d122 39 2024-09-11T00:07:34.873 INFO:tasks.workunit.client.1.smithi203.stdout:9/851: getdents d6/de/d19/d21/dd0/dde 0 2024-09-11T00:07:34.876 INFO:tasks.workunit.client.1.smithi203.stdout:9/852: dread - d6/de/d19/d24/f114 zero size 2024-09-11T00:07:34.877 INFO:tasks.workunit.client.1.smithi203.stdout:9/853: stat d6/de/d32/d52/d55/d66 0 2024-09-11T00:07:34.878 INFO:tasks.workunit.client.0.smithi111.stdout:6/879: dwrite d7/d22/d3f/d74/d7f/d61/d6a/d9f/db6/f112 [0,4194304] 0 2024-09-11T00:07:34.882 INFO:tasks.workunit.client.1.smithi203.stdout:1/944: symlink d8/d19/d60/d90/d3e/d4b/d80/d8d/da3/l154 0 2024-09-11T00:07:34.882 INFO:tasks.workunit.client.1.smithi203.stdout:8/787: truncate d1/d13/d22/d6f/d8d/f6b 1421834 0 2024-09-11T00:07:34.887 INFO:tasks.workunit.client.0.smithi111.stdout:2/839: readlink d0/l24 0 2024-09-11T00:07:34.891 INFO:tasks.workunit.client.0.smithi111.stdout:8/901: mkdir d11/d23/d3d/dca/dcf/d11c 0 2024-09-11T00:07:34.891 INFO:tasks.workunit.client.1.smithi203.stdout:4/785: dwrite db/dd/d16/d38/d3c/f72 [0,4194304] 0 2024-09-11T00:07:34.891 INFO:tasks.workunit.client.0.smithi111.stdout:7/933: mkdir dd/d1d/d7e/dc8/d130 0 2024-09-11T00:07:34.894 INFO:tasks.workunit.client.1.smithi203.stdout:9/854: symlink d6/de/d32/d112/l116 0 2024-09-11T00:07:34.896 INFO:tasks.workunit.client.1.smithi203.stdout:1/945: mknod d8/d9/d15/d35/c155 0 2024-09-11T00:07:34.896 INFO:tasks.workunit.client.1.smithi203.stdout:9/855: chown d6/de/d32/c102 352885 1 2024-09-11T00:07:34.897 INFO:tasks.workunit.client.1.smithi203.stdout:7/817: link dd/d3b/d9f/ca0 dd/d1c/d52/d8f/d31/d4a/c12a 0 2024-09-11T00:07:34.897 INFO:tasks.workunit.client.0.smithi111.stdout:0/939: dwrite d3/fc4 [0,4194304] 0 2024-09-11T00:07:34.898 INFO:tasks.workunit.client.0.smithi111.stdout:9/940: rename d6/d52/d8a/l9b to d6/d52/d8a/d8e/d120/l139 0 2024-09-11T00:07:34.906 INFO:tasks.workunit.client.0.smithi111.stdout:3/934: write d1c/d1d/d22/d23/f91 [1353252,2585] 0 2024-09-11T00:07:34.908 INFO:tasks.workunit.client.0.smithi111.stdout:7/934: mkdir dd/d48/d69/dea/d131 0 2024-09-11T00:07:34.909 INFO:tasks.workunit.client.0.smithi111.stdout:4/874: dwrite d18/d3b/f60 [0,4194304] 0 2024-09-11T00:07:34.912 INFO:tasks.workunit.client.0.smithi111.stdout:5/941: link d10/f19 d10/d1e/d23/d2b/d2f/d11f/d128/df6/d111/f136 0 2024-09-11T00:07:34.912 INFO:tasks.workunit.client.1.smithi203.stdout:3/903: sync 2024-09-11T00:07:34.916 INFO:tasks.workunit.client.0.smithi111.stdout:1/883: dwrite d2/de/d93/d9f/f20 [4194304,4194304] 0 2024-09-11T00:07:34.916 INFO:tasks.workunit.client.0.smithi111.stdout:0/940: readlink d3/d13/d66/l88 0 2024-09-11T00:07:34.916 INFO:tasks.workunit.client.0.smithi111.stdout:9/941: unlink d6/dc/f20 0 2024-09-11T00:07:34.917 INFO:tasks.workunit.client.1.smithi203.stdout:4/786: rename db/d12/d15/d2a/f82 to db/dd/d26/dcd/fff 0 2024-09-11T00:07:34.917 INFO:tasks.workunit.client.1.smithi203.stdout:8/788: write d1/d13/d22/d6f/fbc [43074,68861] 0 2024-09-11T00:07:34.924 INFO:tasks.workunit.client.0.smithi111.stdout:0/941: chown d3/da/d7b/d84/f8b 67405651 1 2024-09-11T00:07:34.925 INFO:tasks.workunit.client.0.smithi111.stdout:6/880: dwrite d7/d22/d3f/d74/d7f/d61/d6a/dba/f122 [0,4194304] 0 2024-09-11T00:07:34.925 INFO:tasks.workunit.client.0.smithi111.stdout:7/935: creat dd/d1d/d1f/d24/dd2/f132 x:0 0 0 2024-09-11T00:07:34.926 INFO:tasks.workunit.client.1.smithi203.stdout:8/789: fsync d1/d13/f1b 0 2024-09-11T00:07:34.928 INFO:tasks.workunit.client.0.smithi111.stdout:5/942: fsync d10/f16 0 2024-09-11T00:07:34.928 INFO:tasks.workunit.client.0.smithi111.stdout:9/942: write d6/db/d34/d37/f1d [1207851,43872] 0 2024-09-11T00:07:34.930 INFO:tasks.workunit.client.1.smithi203.stdout:6/816: sync 2024-09-11T00:07:34.931 INFO:tasks.workunit.client.1.smithi203.stdout:5/878: sync 2024-09-11T00:07:34.931 INFO:tasks.workunit.client.1.smithi203.stdout:2/903: sync 2024-09-11T00:07:34.931 INFO:tasks.workunit.client.1.smithi203.stdout:0/824: sync 2024-09-11T00:07:34.931 INFO:tasks.workunit.client.0.smithi111.stdout:2/840: rename d0/l2b to d0/d3/d12/d52/l120 0 2024-09-11T00:07:34.932 INFO:tasks.workunit.client.1.smithi203.stdout:1/946: creat d8/d9/d15/d35/f156 x:0 0 0 2024-09-11T00:07:34.935 INFO:tasks.workunit.client.0.smithi111.stdout:7/936: dread - dd/f126 zero size 2024-09-11T00:07:34.937 INFO:tasks.workunit.client.0.smithi111.stdout:4/875: creat d18/d20/d4a/d6b/ded/df6/f119 x:0 0 0 2024-09-11T00:07:34.939 INFO:tasks.workunit.client.0.smithi111.stdout:1/884: symlink d2/de/d12/d3c/d4b/d6a/d63/d73/da1/db9/l127 0 2024-09-11T00:07:34.943 INFO:tasks.workunit.client.0.smithi111.stdout:6/881: creat d7/d22/d1d/d69/db4/f12d x:0 0 0 2024-09-11T00:07:34.949 INFO:tasks.workunit.client.0.smithi111.stdout:5/943: mknod d10/d1e/d23/d30/dd8/da2/d66/d76/c137 0 2024-09-11T00:07:34.955 INFO:tasks.workunit.client.1.smithi203.stdout:5/879: mkdir dc/dd/d13/d113/d120/d125 0 2024-09-11T00:07:34.956 INFO:tasks.workunit.client.0.smithi111.stdout:6/882: creat d7/d22/d2c/d38/d39/f12e x:0 0 0 2024-09-11T00:07:34.958 INFO:tasks.workunit.client.1.smithi203.stdout:9/856: write d6/de/d19/f4c [3417683,119597] 0 2024-09-11T00:07:34.963 INFO:tasks.workunit.client.0.smithi111.stdout:5/944: chown d10/d1e/f102 3314 1 2024-09-11T00:07:34.963 INFO:tasks.workunit.client.1.smithi203.stdout:6/817: creat d0/d32/f100 x:0 0 0 2024-09-11T00:07:34.965 INFO:tasks.workunit.client.1.smithi203.stdout:6/818: readlink d0/d32/l33 0 2024-09-11T00:07:34.968 INFO:tasks.workunit.client.1.smithi203.stdout:4/787: write db/dd/d26/f28 [1628192,108099] 0 2024-09-11T00:07:34.972 INFO:tasks.workunit.client.1.smithi203.stdout:5/880: fdatasync dc/dd/d56/f9c 0 2024-09-11T00:07:34.978 INFO:tasks.workunit.client.1.smithi203.stdout:3/904: dwrite d8/da/d5c/d6b/d6c/fac [0,4194304] 0 2024-09-11T00:07:34.980 INFO:tasks.workunit.client.1.smithi203.stdout:7/818: dread dd/d3b/d5b/f7b [4194304,4194304] 0 2024-09-11T00:07:34.982 INFO:tasks.workunit.client.0.smithi111.stdout:6/883: creat d7/d22/d2c/d38/d56/f12f x:0 0 0 2024-09-11T00:07:34.983 INFO:tasks.workunit.client.1.smithi203.stdout:8/790: rename d1/d13/f19 to d1/d13/d17/d48/d61/f10e 0 2024-09-11T00:07:34.983 INFO:tasks.workunit.client.0.smithi111.stdout:0/942: link d3/d13/d1e/d29/db0/dce/l116 d3/d13/d1e/d29/d70/l13d 0 2024-09-11T00:07:34.986 INFO:tasks.workunit.client.1.smithi203.stdout:0/825: getdents d0/d2/d7e 0 2024-09-11T00:07:34.988 INFO:tasks.workunit.client.0.smithi111.stdout:8/902: sync 2024-09-11T00:07:34.990 INFO:tasks.workunit.client.1.smithi203.stdout:8/791: chown d1/d13/d17/d48/df2 29881445 1 2024-09-11T00:07:34.992 INFO:tasks.workunit.client.0.smithi111.stdout:3/935: dread d1c/d1d/d22/d31/fc8 [0,4194304] 0 2024-09-11T00:07:34.993 INFO:tasks.workunit.client.1.smithi203.stdout:1/947: write d8/d19/d60/d90/d3e/d4b/d41/fda [562366,39849] 0 2024-09-11T00:07:34.994 INFO:tasks.workunit.client.1.smithi203.stdout:2/904: link d13/d15/f23 d13/d22/d53/f12f 0 2024-09-11T00:07:34.995 INFO:tasks.workunit.client.0.smithi111.stdout:9/943: getdents d6/db/d7a 0 2024-09-11T00:07:34.998 INFO:tasks.workunit.client.0.smithi111.stdout:0/943: dread d3/da/f130 [0,4194304] 0 2024-09-11T00:07:34.999 INFO:tasks.workunit.client.0.smithi111.stdout:7/937: dwrite dd/f126 [0,4194304] 0 2024-09-11T00:07:34.999 INFO:tasks.workunit.client.1.smithi203.stdout:4/788: chown db/d12/d15/d2a/lce 5 1 2024-09-11T00:07:35.000 INFO:tasks.workunit.client.0.smithi111.stdout:9/944: chown d6/db/d34/fca 925005 1 2024-09-11T00:07:35.001 INFO:tasks.workunit.client.0.smithi111.stdout:1/885: creat d2/f128 x:0 0 0 2024-09-11T00:07:35.002 INFO:tasks.workunit.client.0.smithi111.stdout:4/876: dwrite d18/d20/d4a/fc1 [0,4194304] 0 2024-09-11T00:07:35.003 INFO:tasks.workunit.client.0.smithi111.stdout:6/884: read - d7/d22/d1d/d83/d121/fd2 zero size 2024-09-11T00:07:35.005 INFO:tasks.workunit.client.0.smithi111.stdout:4/877: chown d18/d20/d4a/df9 1991047 1 2024-09-11T00:07:35.005 INFO:tasks.workunit.client.1.smithi203.stdout:0/826: mknod d0/d2/d37/d80/c114 0 2024-09-11T00:07:35.007 INFO:tasks.workunit.client.1.smithi203.stdout:0/827: dread d0/d2/f8a [0,4194304] 0 2024-09-11T00:07:35.011 INFO:tasks.workunit.client.0.smithi111.stdout:6/885: fdatasync d7/d22/d3f/d74/d7f/d61/f81 0 2024-09-11T00:07:35.012 INFO:tasks.workunit.client.0.smithi111.stdout:4/878: dread d18/d3b/d61/f87 [0,4194304] 0 2024-09-11T00:07:35.013 INFO:tasks.workunit.client.0.smithi111.stdout:2/841: link d0/c4c d0/d3/d12/d52/c121 0 2024-09-11T00:07:35.013 INFO:tasks.workunit.client.1.smithi203.stdout:2/905: truncate d13/d22/f7c 11262 0 2024-09-11T00:07:35.015 INFO:tasks.workunit.client.0.smithi111.stdout:0/944: mkdir d3/da/d7b/db3/d13e 0 2024-09-11T00:07:35.017 INFO:tasks.workunit.client.0.smithi111.stdout:9/945: chown d6/d52/d8a/cfc 0 1 2024-09-11T00:07:35.018 INFO:tasks.workunit.client.0.smithi111.stdout:3/936: dwrite ff [0,4194304] 0 2024-09-11T00:07:35.025 INFO:tasks.workunit.client.1.smithi203.stdout:5/881: write dc/dd/d1e/d7b/fb1 [481887,77313] 0 2024-09-11T00:07:35.026 INFO:tasks.workunit.client.1.smithi203.stdout:3/905: write d8/da/d37/f3f [2780688,123483] 0 2024-09-11T00:07:35.029 INFO:tasks.workunit.client.0.smithi111.stdout:7/938: truncate dd/d49/f99 4309681 0 2024-09-11T00:07:35.033 INFO:tasks.workunit.client.1.smithi203.stdout:8/792: unlink d1/d13/c2a 0 2024-09-11T00:07:35.035 INFO:tasks.workunit.client.1.smithi203.stdout:1/948: mknod d8/d9/d15/d35/c157 0 2024-09-11T00:07:35.038 INFO:tasks.workunit.client.0.smithi111.stdout:2/842: readlink d0/d3/de/l90 0 2024-09-11T00:07:35.038 INFO:tasks.workunit.client.1.smithi203.stdout:8/793: read d1/d13/d22/f58 [3470480,22512] 0 2024-09-11T00:07:35.038 INFO:tasks.workunit.client.1.smithi203.stdout:9/857: link d6/de/d19/d24/d54/db2/de2/c10b d6/de/d32/d52/d55/c117 0 2024-09-11T00:07:35.040 INFO:tasks.workunit.client.0.smithi111.stdout:0/945: mknod d3/d13/d1e/deb/c13f 0 2024-09-11T00:07:35.040 INFO:tasks.workunit.client.0.smithi111.stdout:5/945: dread d10/d1e/d23/d26/d3a/d98/f77 [0,4194304] 0 2024-09-11T00:07:35.041 INFO:tasks.workunit.client.1.smithi203.stdout:8/794: truncate d1/d13/d17/d77/ff7 286784 0 2024-09-11T00:07:35.041 INFO:tasks.workunit.client.0.smithi111.stdout:9/946: mknod d6/ddd/c13a 0 2024-09-11T00:07:35.042 INFO:tasks.workunit.client.0.smithi111.stdout:0/946: chown d3/d26/c9f 742900 1 2024-09-11T00:07:35.043 INFO:tasks.workunit.client.0.smithi111.stdout:8/903: write d11/d23/d2c/f3b [1835060,49892] 0 2024-09-11T00:07:35.046 INFO:tasks.workunit.client.1.smithi203.stdout:6/819: getdents d0/d71/db9 0 2024-09-11T00:07:35.048 INFO:tasks.workunit.client.1.smithi203.stdout:2/906: creat d13/d15/d12d/f130 x:0 0 0 2024-09-11T00:07:35.048 INFO:tasks.workunit.client.0.smithi111.stdout:1/886: dread d2/f6f [0,4194304] 0 2024-09-11T00:07:35.056 INFO:tasks.workunit.client.1.smithi203.stdout:1/949: unlink d8/d19/d60/d90/d3e/d9b/c13e 0 2024-09-11T00:07:35.059 INFO:tasks.workunit.client.1.smithi203.stdout:5/882: mkdir dc/dd/d15/dbd/d126 0 2024-09-11T00:07:35.060 INFO:tasks.workunit.client.1.smithi203.stdout:0/828: dread d0/d2/d7e/da1/fcf [0,4194304] 0 2024-09-11T00:07:35.061 INFO:tasks.workunit.client.0.smithi111.stdout:8/904: rename d11/d23/d3d/dca/cd7 to d11/d23/d7e/d93/c11d 0 2024-09-11T00:07:35.062 INFO:tasks.workunit.client.1.smithi203.stdout:1/950: dread d8/d19/d60/d90/d3e/d4b/d80/da2/fed [0,4194304] 0 2024-09-11T00:07:35.063 INFO:tasks.workunit.client.1.smithi203.stdout:3/906: creat d8/d2a/d127/f144 x:0 0 0 2024-09-11T00:07:35.065 INFO:tasks.workunit.client.1.smithi203.stdout:6/820: unlink d0/d54/d9c/d35/d39/fe2 0 2024-09-11T00:07:35.065 INFO:tasks.workunit.client.0.smithi111.stdout:6/886: dwrite d7/f5a [0,4194304] 0 2024-09-11T00:07:35.066 INFO:tasks.workunit.client.0.smithi111.stdout:4/879: getdents d18/d3b/d9f 0 2024-09-11T00:07:35.067 INFO:tasks.workunit.client.0.smithi111.stdout:2/843: dread d0/f1a [0,4194304] 0 2024-09-11T00:07:35.067 INFO:tasks.workunit.client.0.smithi111.stdout:0/947: unlink d3/da/d7b/d84/da8/fd2 0 2024-09-11T00:07:35.068 INFO:tasks.workunit.client.1.smithi203.stdout:4/789: getdents db/d12/d15/d2a/d88 0 2024-09-11T00:07:35.070 INFO:tasks.workunit.client.0.smithi111.stdout:6/887: readlink d7/d22/la3 0 2024-09-11T00:07:35.073 INFO:tasks.workunit.client.0.smithi111.stdout:1/887: dread d2/de/d12/d3c/d4b/d6a/f7a [0,4194304] 0 2024-09-11T00:07:35.075 INFO:tasks.workunit.client.0.smithi111.stdout:5/946: link d10/d1e/d23/d2b/d2f/c99 d10/d1e/d23/d30/c138 0 2024-09-11T00:07:35.077 INFO:tasks.workunit.client.1.smithi203.stdout:3/907: dwrite d8/d17/f74 [0,4194304] 0 2024-09-11T00:07:35.081 INFO:tasks.workunit.client.1.smithi203.stdout:2/907: write d13/d15/d30/f91 [2219424,47836] 0 2024-09-11T00:07:35.081 INFO:tasks.workunit.client.1.smithi203.stdout:0/829: write d0/f8c [2571419,24971] 0 2024-09-11T00:07:35.082 INFO:tasks.workunit.client.0.smithi111.stdout:4/880: creat d18/d3b/d51/f11a x:0 0 0 2024-09-11T00:07:35.089 INFO:tasks.workunit.client.0.smithi111.stdout:6/888: symlink d7/d22/d3f/d74/d7f/d79/da4/d117/l130 0 2024-09-11T00:07:35.089 INFO:tasks.workunit.client.0.smithi111.stdout:1/888: dwrite d2/d2b/f10a [0,4194304] 0 2024-09-11T00:07:35.090 INFO:tasks.workunit.client.1.smithi203.stdout:0/830: dread - d0/d87/f101 zero size 2024-09-11T00:07:35.090 INFO:tasks.workunit.client.1.smithi203.stdout:6/821: chown d0/d54/d9c/d7b/f8a 3423509 1 2024-09-11T00:07:35.091 INFO:tasks.workunit.client.1.smithi203.stdout:9/858: creat d6/de/d19/d24/f118 x:0 0 0 2024-09-11T00:07:35.093 INFO:tasks.workunit.client.1.smithi203.stdout:4/790: mkdir db/d12/d15/d2a/d88/d95/dc2/d100 0 2024-09-11T00:07:35.095 INFO:tasks.workunit.client.1.smithi203.stdout:4/791: stat db/dd/d16/fb1 0 2024-09-11T00:07:35.100 INFO:tasks.workunit.client.0.smithi111.stdout:4/881: fsync d18/d20/d3c/d5e/f92 0 2024-09-11T00:07:35.105 INFO:tasks.workunit.client.1.smithi203.stdout:2/908: rename d13/d15/d30/d5a/dd9/f11b to d13/d15/d12d/f131 0 2024-09-11T00:07:35.108 INFO:tasks.workunit.client.1.smithi203.stdout:8/795: truncate d1/d13/d3a/f44 1294881 0 2024-09-11T00:07:35.109 INFO:tasks.workunit.client.0.smithi111.stdout:2/844: mkdir d0/d3/de/d3b/d62/d122 0 2024-09-11T00:07:35.110 INFO:tasks.workunit.client.1.smithi203.stdout:1/951: dwrite d8/f10a [0,4194304] 0 2024-09-11T00:07:35.110 INFO:tasks.workunit.client.1.smithi203.stdout:0/831: creat d0/d2/d7e/da1/df5/f115 x:0 0 0 2024-09-11T00:07:35.111 INFO:tasks.workunit.client.0.smithi111.stdout:2/845: write d0/d3/de/d3b/d62/d6d/f10a [909314,26562] 0 2024-09-11T00:07:35.111 INFO:tasks.workunit.client.0.smithi111.stdout:8/905: link d11/d23/d2c/d46/d81/da5/d111/c106 d11/d23/d3d/d5f/d99/d10c/c11e 0 2024-09-11T00:07:35.114 INFO:tasks.workunit.client.0.smithi111.stdout:8/906: write d11/d23/d3d/f109 [68685,86732] 0 2024-09-11T00:07:35.114 INFO:tasks.workunit.client.0.smithi111.stdout:6/889: fdatasync d7/d22/d26/d95/dd6/ffe 0 2024-09-11T00:07:35.116 INFO:tasks.workunit.client.0.smithi111.stdout:5/947: write d10/d1e/d23/d2b/d5c/fb7 [2406772,93114] 0 2024-09-11T00:07:35.116 INFO:tasks.workunit.client.1.smithi203.stdout:0/832: stat d0/df8/c104 0 2024-09-11T00:07:35.117 INFO:tasks.workunit.client.0.smithi111.stdout:1/889: read d2/de/d12/d3c/d4b/d6a/d63/d73/da1/f2d [204959,116212] 0 2024-09-11T00:07:35.117 INFO:tasks.workunit.client.0.smithi111.stdout:0/948: write d3/d1c/f42 [723013,103620] 0 2024-09-11T00:07:35.121 INFO:tasks.workunit.client.1.smithi203.stdout:3/908: mknod d8/da/d37/d83/d65/d115/c145 0 2024-09-11T00:07:35.123 INFO:tasks.workunit.client.1.smithi203.stdout:9/859: dread d6/de/fe3 [0,4194304] 0 2024-09-11T00:07:35.131 INFO:tasks.workunit.client.1.smithi203.stdout:6/822: fdatasync d0/f8 0 2024-09-11T00:07:35.132 INFO:tasks.workunit.client.1.smithi203.stdout:8/796: dwrite d1/d13/d43/d46/fe7 [4194304,4194304] 0 2024-09-11T00:07:35.136 INFO:tasks.workunit.client.1.smithi203.stdout:5/883: dread dc/d4f/d5c/dc9/f122 [0,4194304] 0 2024-09-11T00:07:35.136 INFO:tasks.workunit.client.0.smithi111.stdout:3/937: sync 2024-09-11T00:07:35.137 INFO:tasks.workunit.client.1.smithi203.stdout:8/797: fsync d1/d13/d43/d46/db0/fd4 0 2024-09-11T00:07:35.139 INFO:tasks.workunit.client.1.smithi203.stdout:1/952: dwrite d8/d9/d15/d35/d81/db9/dce/feb [0,4194304] 0 2024-09-11T00:07:35.143 INFO:tasks.workunit.client.1.smithi203.stdout:9/860: mknod d6/de/d19/d21/da0/c119 0 2024-09-11T00:07:35.144 INFO:tasks.workunit.client.1.smithi203.stdout:1/953: chown d8/d9/d15/d35/d81/db9/dce/d106/l109 139694 1 2024-09-11T00:07:35.148 INFO:tasks.workunit.client.1.smithi203.stdout:5/884: mknod dc/dd/d1e/d7b/c127 0 2024-09-11T00:07:35.149 INFO:tasks.workunit.client.1.smithi203.stdout:4/792: truncate db/dd/d16/f4f 5855286 0 2024-09-11T00:07:35.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:34 smithi111 ceph-mon[27539]: pgmap v15: 65 pgs: 65 active+clean; 3.4 GiB data, 9.9 GiB used, 526 GiB / 536 GiB avail; 68 MiB/s rd, 170 MiB/s wr, 371 op/s 2024-09-11T00:07:35.152 INFO:tasks.workunit.client.1.smithi203.stdout:6/823: rmdir d0/d54/d9c/d35/d38/dc0/ddb 39 2024-09-11T00:07:35.172 INFO:tasks.workunit.client.0.smithi111.stdout:2/846: rename d0/d3/de/f43 to d0/d3/d2e/f123 0 2024-09-11T00:07:35.173 INFO:tasks.workunit.client.0.smithi111.stdout:0/949: read - d3/d13/d1e/d29/f105 zero size 2024-09-11T00:07:35.174 INFO:tasks.workunit.client.0.smithi111.stdout:1/890: fsync d2/de/d12/d3c/d4b/d6a/fab 0 2024-09-11T00:07:35.175 INFO:tasks.workunit.client.0.smithi111.stdout:3/938: mkdir d1c/d1d/d22/d23/d2f/de5/d143 0 2024-09-11T00:07:35.176 INFO:tasks.workunit.client.0.smithi111.stdout:6/890: read d7/d22/d1d/d83/d121/d7a/dc5/fc6 [3718967,12729] 0 2024-09-11T00:07:35.176 INFO:tasks.workunit.client.0.smithi111.stdout:1/891: chown d2/de/d12/d3c/l52 35 1 2024-09-11T00:07:35.176 INFO:tasks.workunit.client.0.smithi111.stdout:5/948: creat d10/d1e/d23/d26/d78/d12e/f139 x:0 0 0 2024-09-11T00:07:35.177 INFO:tasks.workunit.client.0.smithi111.stdout:8/907: rename d11/d23/d7e/l96 to d11/d23/d7e/d93/db5/l11f 0 2024-09-11T00:07:35.177 INFO:tasks.workunit.client.0.smithi111.stdout:3/939: chown d1c/d21/d92/f9a 0 1 2024-09-11T00:07:35.185 INFO:tasks.workunit.client.0.smithi111.stdout:6/891: chown d7/d22/d1d/d83/d121/d41/d77/fce 3 1 2024-09-11T00:07:35.185 INFO:tasks.workunit.client.0.smithi111.stdout:0/950: creat d3/d26/d77/dd6/f140 x:0 0 0 2024-09-11T00:07:35.185 INFO:tasks.workunit.client.0.smithi111.stdout:1/892: mkdir d2/de/d12/d6c/df5/d129 0 2024-09-11T00:07:35.185 INFO:tasks.workunit.client.0.smithi111.stdout:5/949: stat d10/d1e/d23/d30/dd8/da2/d66/d76/c137 0 2024-09-11T00:07:35.186 INFO:tasks.workunit.client.0.smithi111.stdout:8/908: write d11/d23/d2c/d46/d64/fa6 [4252182,57254] 0 2024-09-11T00:07:35.187 INFO:tasks.workunit.client.0.smithi111.stdout:3/940: rmdir d1c/d1d/d22/d44 39 2024-09-11T00:07:35.187 INFO:tasks.workunit.client.0.smithi111.stdout:8/909: chown d11 707452 1 2024-09-11T00:07:35.189 INFO:tasks.workunit.client.0.smithi111.stdout:1/893: mknod d2/dad/c12a 0 2024-09-11T00:07:35.191 INFO:tasks.workunit.client.0.smithi111.stdout:6/892: creat d7/d22/d26/d95/f131 x:0 0 0 2024-09-11T00:07:35.194 INFO:tasks.workunit.client.0.smithi111.stdout:6/893: unlink d7/d22/d2c/c44 0 2024-09-11T00:07:35.195 INFO:tasks.workunit.client.1.smithi203.stdout:1/954: creat d8/d19/d60/d90/d3e/d4b/d80/d8d/db0/f158 x:0 0 0 2024-09-11T00:07:35.196 INFO:tasks.workunit.client.1.smithi203.stdout:6/824: chown d0/c30 859 1 2024-09-11T00:07:35.196 INFO:tasks.workunit.client.0.smithi111.stdout:6/894: chown d7/d2b/dd4/ce7 89944997 1 2024-09-11T00:07:35.196 INFO:tasks.workunit.client.1.smithi203.stdout:2/909: truncate d13/d56/d69/f9b 1061446 0 2024-09-11T00:07:35.197 INFO:tasks.workunit.client.0.smithi111.stdout:0/951: getdents d3/d13/d1e/d29/db0/dce/ddb/de6 0 2024-09-11T00:07:35.199 INFO:tasks.workunit.client.1.smithi203.stdout:6/825: write d0/d32/f3a [2508321,6981] 0 2024-09-11T00:07:35.200 INFO:tasks.workunit.client.1.smithi203.stdout:4/793: creat db/d12/d15/d2a/d88/df6/f101 x:0 0 0 2024-09-11T00:07:35.204 INFO:tasks.workunit.client.1.smithi203.stdout:0/833: dread d0/d9f/fb0 [0,4194304] 0 2024-09-11T00:07:35.205 INFO:tasks.workunit.client.0.smithi111.stdout:1/894: dread d2/de/d93/d9f/f20 [4194304,4194304] 0 2024-09-11T00:07:35.206 INFO:tasks.workunit.client.1.smithi203.stdout:0/834: fsync d0/f18 0 2024-09-11T00:07:35.206 INFO:tasks.workunit.client.1.smithi203.stdout:4/794: write db/dd/d16/ded/db5/fe0 [826288,112639] 0 2024-09-11T00:07:35.208 INFO:tasks.workunit.client.0.smithi111.stdout:5/950: dwrite d10/d1e/d23/d30/dd8/d63/dbb/db5/f11b [0,4194304] 0 2024-09-11T00:07:35.209 INFO:tasks.workunit.client.1.smithi203.stdout:4/795: write db/d12/f1e [2619453,115783] 0 2024-09-11T00:07:35.210 INFO:tasks.workunit.client.0.smithi111.stdout:8/910: dwrite d11/d23/d2c/d46/f8c [0,4194304] 0 2024-09-11T00:07:35.213 INFO:tasks.workunit.client.1.smithi203.stdout:4/796: read db/f73 [1513487,77640] 0 2024-09-11T00:07:35.213 INFO:tasks.workunit.client.1.smithi203.stdout:1/955: dread - d8/d19/d60/d90/d3e/d4b/d80/d91/dac/f112 zero size 2024-09-11T00:07:35.215 INFO:tasks.workunit.client.0.smithi111.stdout:0/952: link d3/d13/fdd d3/d1c/d50/f141 0 2024-09-11T00:07:35.216 INFO:tasks.workunit.client.1.smithi203.stdout:2/910: truncate d13/d15/d30/d5a/fef 1067240 0 2024-09-11T00:07:35.216 INFO:tasks.workunit.client.0.smithi111.stdout:3/941: write d1c/d1d/d22/d31/d62/dc7/f103 [1263148,118340] 0 2024-09-11T00:07:35.220 INFO:tasks.workunit.client.0.smithi111.stdout:8/911: fsync f8 0 2024-09-11T00:07:35.220 INFO:tasks.workunit.client.0.smithi111.stdout:3/942: stat d1c/d1d/d22/d23/d58/d5c/fcf 0 2024-09-11T00:07:35.221 INFO:tasks.workunit.client.0.smithi111.stdout:7/939: sync 2024-09-11T00:07:35.223 INFO:tasks.workunit.client.1.smithi203.stdout:3/909: dread d8/da/d37/d53/da2/de1/f10c [0,4194304] 0 2024-09-11T00:07:35.223 INFO:tasks.workunit.client.1.smithi203.stdout:0/835: fsync d0/d1d/d4c/f6d 0 2024-09-11T00:07:35.225 INFO:tasks.workunit.client.0.smithi111.stdout:6/895: dwrite d7/d22/d2c/d38/d39/db3/f119 [0,4194304] 0 2024-09-11T00:07:35.229 INFO:tasks.workunit.client.1.smithi203.stdout:9/861: getdents d6/de/d32/d52/d55/da2/dda 0 2024-09-11T00:07:35.231 INFO:tasks.workunit.client.1.smithi203.stdout:6/826: symlink d0/d54/d9c/d7b/l101 0 2024-09-11T00:07:35.232 INFO:tasks.workunit.client.1.smithi203.stdout:4/797: dread db/dd/d16/d38/d3c/f72 [0,4194304] 0 2024-09-11T00:07:35.235 INFO:tasks.workunit.client.1.smithi203.stdout:9/862: dread d6/f76 [0,4194304] 0 2024-09-11T00:07:35.235 INFO:tasks.workunit.client.1.smithi203.stdout:5/885: dwrite dc/dd/d15/dbd/d59/f46 [4194304,4194304] 0 2024-09-11T00:07:35.236 INFO:tasks.workunit.client.1.smithi203.stdout:6/827: chown d0/d54/d9c/d7b/d7e 29 1 2024-09-11T00:07:35.238 INFO:tasks.workunit.client.0.smithi111.stdout:8/912: fdatasync d11/d23/d2c/d46/d64/fe1 0 2024-09-11T00:07:35.242 INFO:tasks.workunit.client.0.smithi111.stdout:1/895: link d2/dad/c12a d2/d2b/dc9/c12b 0 2024-09-11T00:07:35.243 INFO:tasks.workunit.client.1.smithi203.stdout:3/910: creat d8/da/d5c/d6b/d6c/f146 x:0 0 0 2024-09-11T00:07:35.248 INFO:tasks.workunit.client.0.smithi111.stdout:9/947: sync 2024-09-11T00:07:35.248 INFO:tasks.workunit.client.0.smithi111.stdout:4/882: sync 2024-09-11T00:07:35.248 INFO:tasks.workunit.client.0.smithi111.stdout:2/847: sync 2024-09-11T00:07:35.249 INFO:tasks.workunit.client.0.smithi111.stdout:7/940: creat dd/d1d/d7e/dc8/d130/f133 x:0 0 0 2024-09-11T00:07:35.250 INFO:tasks.workunit.client.1.smithi203.stdout:4/798: mkdir db/dd/d26/d42/d102 0 2024-09-11T00:07:35.251 INFO:tasks.workunit.client.1.smithi203.stdout:4/799: stat db/f8a 0 2024-09-11T00:07:35.252 INFO:tasks.workunit.client.1.smithi203.stdout:5/886: creat dc/d9f/f128 x:0 0 0 2024-09-11T00:07:35.252 INFO:tasks.workunit.client.1.smithi203.stdout:1/956: write d8/d119/fdc [2526002,13758] 0 2024-09-11T00:07:35.255 INFO:tasks.workunit.client.1.smithi203.stdout:6/828: mkdir d0/d5b/d5c/d6f/d102 0 2024-09-11T00:07:35.260 INFO:tasks.workunit.client.0.smithi111.stdout:9/948: fdatasync d6/db/d34/d37/f1d 0 2024-09-11T00:07:35.260 INFO:tasks.workunit.client.0.smithi111.stdout:1/896: fdatasync d2/de/d12/d3c/d4b/d6a/f9e 0 2024-09-11T00:07:35.261 INFO:tasks.workunit.client.0.smithi111.stdout:7/941: unlink dd/l13 0 2024-09-11T00:07:35.261 INFO:tasks.workunit.client.1.smithi203.stdout:0/836: fsync d0/d2/fd 0 2024-09-11T00:07:35.262 INFO:tasks.workunit.client.0.smithi111.stdout:6/896: dwrite d7/d2b/f8b [0,4194304] 0 2024-09-11T00:07:35.262 INFO:tasks.workunit.client.0.smithi111.stdout:5/951: dwrite d10/d1e/d23/d30/d59/d52/d85/dd2/df1/fde [0,4194304] 0 2024-09-11T00:07:35.263 INFO:tasks.workunit.client.1.smithi203.stdout:3/911: rename d8/da/d5c/d6b/f118 to d8/da/d37/d83/db9/f147 0 2024-09-11T00:07:35.263 INFO:tasks.workunit.client.1.smithi203.stdout:0/837: dread - d0/d2/d37/d5b/d73/fe8 zero size 2024-09-11T00:07:35.265 INFO:tasks.workunit.client.0.smithi111.stdout:6/897: readlink d7/d2b/le6 0 2024-09-11T00:07:35.267 INFO:tasks.workunit.client.0.smithi111.stdout:9/949: fsync d6/db/d34/f122 0 2024-09-11T00:07:35.269 INFO:tasks.workunit.client.0.smithi111.stdout:0/953: dwrite d3/d13/d1e/d29/d70/f9d [0,4194304] 0 2024-09-11T00:07:35.272 INFO:tasks.workunit.client.1.smithi203.stdout:5/887: unlink dc/dd/d15/dbd/d59/dbb/fe0 0 2024-09-11T00:07:35.273 INFO:tasks.workunit.client.1.smithi203.stdout:1/957: chown d8/d19/d60/d90/d3e/d4b/d80/d91/dac/c151 26 1 2024-09-11T00:07:35.275 INFO:tasks.workunit.client.1.smithi203.stdout:5/888: readlink dc/d4f/d5c/d76/l80 0 2024-09-11T00:07:35.279 INFO:tasks.workunit.client.0.smithi111.stdout:0/954: write d3/d13/d1e/deb/d61/d93/d102/f127 [871054,3967] 0 2024-09-11T00:07:35.283 INFO:tasks.workunit.client.0.smithi111.stdout:7/942: fsync f8 0 2024-09-11T00:07:35.284 INFO:tasks.workunit.client.0.smithi111.stdout:1/897: fdatasync d2/de/d12/d88/f107 0 2024-09-11T00:07:35.285 INFO:tasks.workunit.client.1.smithi203.stdout:2/911: write d13/d56/d69/f9b [711559,105161] 0 2024-09-11T00:07:35.285 INFO:tasks.workunit.client.1.smithi203.stdout:0/838: dwrite d0/f18 [0,4194304] 0 2024-09-11T00:07:35.288 INFO:tasks.workunit.client.0.smithi111.stdout:3/943: dread d1c/d1d/f77 [0,4194304] 0 2024-09-11T00:07:35.290 INFO:tasks.workunit.client.0.smithi111.stdout:3/944: fsync d1c/d1d/d22/d23/f52 0 2024-09-11T00:07:35.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:34 smithi203 ceph-mon[33225]: pgmap v15: 65 pgs: 65 active+clean; 3.4 GiB data, 9.9 GiB used, 526 GiB / 536 GiB avail; 68 MiB/s rd, 170 MiB/s wr, 371 op/s 2024-09-11T00:07:35.297 INFO:tasks.workunit.client.1.smithi203.stdout:6/829: rename d0/d54/d9c/d35/d38/f2e to d0/d54/d9c/d7b/d7e/d94/f103 0 2024-09-11T00:07:35.298 INFO:tasks.workunit.client.0.smithi111.stdout:0/955: mkdir d3/d13/d1e/d29/d70/d142 0 2024-09-11T00:07:35.300 INFO:tasks.workunit.client.1.smithi203.stdout:0/839: symlink d0/d9f/l116 0 2024-09-11T00:07:35.300 INFO:tasks.workunit.client.1.smithi203.stdout:1/958: dread d8/d19/d60/d90/d3e/d66/fc6 [0,4194304] 0 2024-09-11T00:07:35.301 INFO:tasks.workunit.client.1.smithi203.stdout:9/863: getdents d6/de/dc4 0 2024-09-11T00:07:35.303 INFO:tasks.workunit.client.1.smithi203.stdout:6/830: dread d0/d5b/d5c/fa8 [0,4194304] 0 2024-09-11T00:07:35.304 INFO:tasks.workunit.client.0.smithi111.stdout:4/883: dread d18/d3b/d61/f9e [0,4194304] 0 2024-09-11T00:07:35.304 INFO:tasks.workunit.client.0.smithi111.stdout:4/884: chown d18/d3b/cc2 43942887 1 2024-09-11T00:07:35.305 INFO:tasks.workunit.client.1.smithi203.stdout:9/864: chown d6/de/d19/d24/lcb 1 1 2024-09-11T00:07:35.305 INFO:tasks.workunit.client.1.smithi203.stdout:2/912: creat d13/d15/d19/d1c/d73/d7a/f132 x:0 0 0 2024-09-11T00:07:35.307 INFO:tasks.workunit.client.0.smithi111.stdout:7/943: dwrite dd/f26 [0,4194304] 0 2024-09-11T00:07:35.308 INFO:tasks.workunit.client.1.smithi203.stdout:5/889: mknod dc/dd/d9b/dae/d11a/c129 0 2024-09-11T00:07:35.310 INFO:tasks.workunit.client.0.smithi111.stdout:8/913: link d11/d23/d2c/d46/d81/dd2/c107 d11/d23/d3d/d5f/c120 0 2024-09-11T00:07:35.311 INFO:tasks.workunit.client.1.smithi203.stdout:0/840: mknod d0/d2/d7e/c117 0 2024-09-11T00:07:35.312 INFO:tasks.workunit.client.0.smithi111.stdout:8/914: fdatasync d11/d23/d2c/d53/dfc/fd6 0 2024-09-11T00:07:35.313 INFO:tasks.workunit.client.1.smithi203.stdout:1/959: dread - d8/d19/d60/d90/f122 zero size 2024-09-11T00:07:35.314 INFO:tasks.workunit.client.1.smithi203.stdout:1/960: readlink d8/l37 0 2024-09-11T00:07:35.315 INFO:tasks.workunit.client.0.smithi111.stdout:6/898: getdents d7/d2b/dd4 0 2024-09-11T00:07:35.319 INFO:tasks.workunit.client.0.smithi111.stdout:5/952: truncate d10/d1e/d23/d30/d3c/f4e 756580 0 2024-09-11T00:07:35.321 INFO:tasks.workunit.client.1.smithi203.stdout:5/890: unlink dc/dd/d15/d3b/lf9 0 2024-09-11T00:07:35.322 INFO:tasks.workunit.client.1.smithi203.stdout:0/841: rmdir d0/dc5 39 2024-09-11T00:07:35.323 INFO:tasks.workunit.client.1.smithi203.stdout:2/913: fdatasync d13/d22/f7c 0 2024-09-11T00:07:35.324 INFO:tasks.workunit.client.0.smithi111.stdout:9/950: dwrite d6/db/d34/d37/d4c/d7f/d97/fb3 [0,4194304] 0 2024-09-11T00:07:35.325 INFO:tasks.workunit.client.1.smithi203.stdout:0/842: chown d0/d2/d37/c42 110479285 1 2024-09-11T00:07:35.325 INFO:tasks.workunit.client.0.smithi111.stdout:4/885: mkdir d18/d1f/d36/d95/dda/d11b 0 2024-09-11T00:07:35.327 INFO:tasks.workunit.client.1.smithi203.stdout:0/843: stat d0/d1d/d5d/d70/ff0 0 2024-09-11T00:07:35.328 INFO:tasks.workunit.client.0.smithi111.stdout:9/951: chown d6/db/d1b/d41/f9e 1570 1 2024-09-11T00:07:35.332 INFO:tasks.workunit.client.0.smithi111.stdout:2/848: rename d0/d3/de/d68/d111/l114 to d0/d3/de/d3b/l124 0 2024-09-11T00:07:35.333 INFO:tasks.workunit.client.1.smithi203.stdout:3/912: dread d8/da/d11/f75 [0,4194304] 0 2024-09-11T00:07:35.335 INFO:tasks.workunit.client.1.smithi203.stdout:2/914: symlink d13/d15/d19/d1c/dfd/l133 0 2024-09-11T00:07:35.336 INFO:tasks.workunit.client.0.smithi111.stdout:7/944: mknod dd/d1d/d4d/d82/d100/c134 0 2024-09-11T00:07:35.338 INFO:tasks.workunit.client.0.smithi111.stdout:3/945: write d1c/d1d/d22/d23/d58/f75 [831439,61795] 0 2024-09-11T00:07:35.343 INFO:tasks.workunit.client.0.smithi111.stdout:3/946: read d1c/d1d/d22/d23/d58/df2/f102 [601511,11960] 0 2024-09-11T00:07:35.344 INFO:tasks.workunit.client.0.smithi111.stdout:6/899: creat d7/d22/d1d/d69/db4/f132 x:0 0 0 2024-09-11T00:07:35.347 INFO:tasks.workunit.client.0.smithi111.stdout:1/898: truncate d2/fd 7778038 0 2024-09-11T00:07:35.349 INFO:tasks.workunit.client.0.smithi111.stdout:1/899: fsync d2/de/d93/d9f/f1a 0 2024-09-11T00:07:35.350 INFO:tasks.workunit.client.0.smithi111.stdout:8/915: dread d11/d21/f9a [0,4194304] 0 2024-09-11T00:07:35.353 INFO:tasks.workunit.client.0.smithi111.stdout:7/945: dread dd/d1d/d2d/d2e/f11f [0,4194304] 0 2024-09-11T00:07:35.354 INFO:tasks.workunit.client.0.smithi111.stdout:1/900: fsync d2/de/d12/d6c/dbd/f10e 0 2024-09-11T00:07:35.354 INFO:tasks.workunit.client.0.smithi111.stdout:4/886: creat d18/d1f/d36/d95/dda/f11c x:0 0 0 2024-09-11T00:07:35.357 INFO:tasks.workunit.client.0.smithi111.stdout:2/849: creat d0/d3/d98/dff/f125 x:0 0 0 2024-09-11T00:07:35.358 INFO:tasks.workunit.client.0.smithi111.stdout:9/952: read d6/db/f83 [672192,46443] 0 2024-09-11T00:07:35.359 INFO:tasks.workunit.client.0.smithi111.stdout:6/900: mkdir d7/d22/d1d/d69/db4/d133 0 2024-09-11T00:07:35.359 INFO:tasks.workunit.client.0.smithi111.stdout:4/887: write d18/d20/d4a/d6b/ded/df6/f119 [74658,126075] 0 2024-09-11T00:07:35.362 INFO:tasks.workunit.client.0.smithi111.stdout:4/888: chown d18/d20/d4a/c69 473440 1 2024-09-11T00:07:35.363 INFO:tasks.workunit.client.0.smithi111.stdout:3/947: symlink d1c/l144 0 2024-09-11T00:07:35.365 INFO:tasks.workunit.client.0.smithi111.stdout:4/889: read d18/f81 [161529,82915] 0 2024-09-11T00:07:35.368 INFO:tasks.workunit.client.0.smithi111.stdout:4/890: write d18/d3b/d51/f11a [1009871,78652] 0 2024-09-11T00:07:35.407 INFO:tasks.workunit.client.1.smithi203.stdout:3/913: chown d8/da/d37/d53/da2/l105 5330327 1 2024-09-11T00:07:35.408 INFO:tasks.workunit.client.1.smithi203.stdout:2/915: readlink d13/l51 0 2024-09-11T00:07:35.408 INFO:tasks.workunit.client.1.smithi203.stdout:0/844: write d0/d2/d37/d5b/d73/db6/fd0 [745910,6500] 0 2024-09-11T00:07:35.414 INFO:tasks.workunit.client.1.smithi203.stdout:9/865: dread d6/de/d19/d24/d40/f10f [0,4194304] 0 2024-09-11T00:07:35.418 INFO:tasks.workunit.client.1.smithi203.stdout:9/866: chown d6/de/d32/d52/d55/da2/cf2 11486085 1 2024-09-11T00:07:35.469 INFO:tasks.workunit.client.0.smithi111.stdout:5/953: creat d10/d1e/d23/d30/dd8/f13a x:0 0 0 2024-09-11T00:07:35.474 INFO:tasks.workunit.client.0.smithi111.stdout:7/946: mkdir dd/d49/d110/d135 0 2024-09-11T00:07:35.478 INFO:tasks.workunit.client.0.smithi111.stdout:8/916: mknod d11/d23/d3d/d10b/c121 0 2024-09-11T00:07:35.484 INFO:tasks.workunit.client.0.smithi111.stdout:0/956: dwrite d3/da/d7b/db3/f13b [0,4194304] 0 2024-09-11T00:07:35.485 INFO:tasks.workunit.client.0.smithi111.stdout:2/850: creat d0/d3/de/d3b/d97/f126 x:0 0 0 2024-09-11T00:07:35.502 INFO:tasks.workunit.client.0.smithi111.stdout:4/891: rename f15 to d18/d3b/dae/f11d 0 2024-09-11T00:07:35.505 INFO:tasks.workunit.client.0.smithi111.stdout:1/901: link d2/de/fe5 d2/de/d93/d9f/dc0/f12c 0 2024-09-11T00:07:35.518 INFO:tasks.workunit.client.0.smithi111.stdout:8/917: mknod d11/d23/d2c/d53/c122 0 2024-09-11T00:07:35.528 INFO:tasks.workunit.client.0.smithi111.stdout:2/851: mkdir d0/d83/d127 0 2024-09-11T00:07:35.546 INFO:tasks.workunit.client.0.smithi111.stdout:7/947: getdents dd/d48/d69/dea/d131 0 2024-09-11T00:07:35.548 INFO:tasks.workunit.client.0.smithi111.stdout:8/918: fdatasync d11/d21/f9a 0 2024-09-11T00:07:35.550 INFO:tasks.workunit.client.0.smithi111.stdout:8/919: write d11/d23/d2c/d53/dfc/f10f [724607,87353] 0 2024-09-11T00:07:35.554 INFO:tasks.workunit.client.0.smithi111.stdout:6/901: link d7/d22/d1d/d83/d121/fad d7/d22/d1d/d83/d121/d7a/dc5/f134 0 2024-09-11T00:07:35.565 INFO:tasks.workunit.client.0.smithi111.stdout:6/902: fsync d7/d22/d26/d95/dd6/ffe 0 2024-09-11T00:07:35.566 INFO:tasks.workunit.client.1.smithi203.stdout:5/891: rename dc/d2b/dba/c101 to dc/d4f/d5c/c12a 0 2024-09-11T00:07:35.571 INFO:tasks.workunit.client.1.smithi203.stdout:8/798: sync 2024-09-11T00:07:35.572 INFO:tasks.workunit.client.1.smithi203.stdout:7/819: sync 2024-09-11T00:07:35.576 INFO:tasks.workunit.client.0.smithi111.stdout:8/920: dread d11/d21/d38/f5e [4194304,4194304] 0 2024-09-11T00:07:35.580 INFO:tasks.workunit.client.0.smithi111.stdout:7/948: rename dd/f8c to dd/d48/f136 0 2024-09-11T00:07:35.583 INFO:tasks.workunit.client.0.smithi111.stdout:7/949: mkdir dd/d1d/d76/db6/d137 0 2024-09-11T00:07:35.584 INFO:tasks.workunit.client.1.smithi203.stdout:3/914: rmdir d8/da/d11/d109 0 2024-09-11T00:07:35.585 INFO:tasks.workunit.client.1.smithi203.stdout:0/845: link d0/d1d/l5f d0/d1d/d5d/d10a/l118 0 2024-09-11T00:07:35.585 INFO:tasks.workunit.client.1.smithi203.stdout:3/915: chown d8/f16 27590329 1 2024-09-11T00:07:35.589 INFO:tasks.workunit.client.1.smithi203.stdout:0/846: dread - d0/d2/d7e/da1/df5/f115 zero size 2024-09-11T00:07:35.591 INFO:tasks.workunit.client.1.smithi203.stdout:7/820: mknod dd/d1c/d52/d8f/d31/d58/d93/d98/dfc/c12b 0 2024-09-11T00:07:35.594 INFO:tasks.workunit.client.1.smithi203.stdout:7/821: write dd/d1c/d52/d8f/fe3 [1261654,52943] 0 2024-09-11T00:07:35.594 INFO:tasks.workunit.client.0.smithi111.stdout:7/950: symlink dd/d1d/l138 0 2024-09-11T00:07:35.604 INFO:tasks.workunit.client.0.smithi111.stdout:8/921: dread d11/d23/d3d/f94 [0,4194304] 0 2024-09-11T00:07:35.605 INFO:tasks.workunit.client.1.smithi203.stdout:7/822: truncate dd/d3b/fb9 1349770 0 2024-09-11T00:07:35.605 INFO:tasks.workunit.client.1.smithi203.stdout:3/916: creat d8/da/d37/d53/da2/d122/f148 x:0 0 0 2024-09-11T00:07:35.605 INFO:tasks.workunit.client.1.smithi203.stdout:0/847: mknod d0/dc5/c119 0 2024-09-11T00:07:35.608 INFO:tasks.workunit.client.1.smithi203.stdout:3/917: truncate d8/d2a/dd0/ff7 1949701 0 2024-09-11T00:07:35.608 INFO:tasks.workunit.client.0.smithi111.stdout:8/922: write d11/d23/d3d/f44 [2984475,121811] 0 2024-09-11T00:07:35.615 INFO:tasks.workunit.client.1.smithi203.stdout:7/823: dread dd/d1c/d52/d8f/d31/d4a/d105/f75 [0,4194304] 0 2024-09-11T00:07:35.618 INFO:tasks.workunit.client.1.smithi203.stdout:7/824: write dd/d3b/d9f/d10e/f11a [427397,25293] 0 2024-09-11T00:07:35.621 INFO:tasks.workunit.client.0.smithi111.stdout:3/948: mkdir d1c/d21/d145 0 2024-09-11T00:07:35.649 INFO:tasks.workunit.client.1.smithi203.stdout:2/916: write d13/d15/d19/d1c/d76/fb3 [1126655,100008] 0 2024-09-11T00:07:35.652 INFO:tasks.workunit.client.0.smithi111.stdout:9/953: write d6/dc/f17 [5623426,66452] 0 2024-09-11T00:07:35.654 INFO:tasks.workunit.client.1.smithi203.stdout:2/917: creat d13/d15/d30/d5a/dac/f134 x:0 0 0 2024-09-11T00:07:35.657 INFO:tasks.workunit.client.0.smithi111.stdout:9/954: creat d6/db/db8/dce/d12d/f13b x:0 0 0 2024-09-11T00:07:35.657 INFO:tasks.workunit.client.1.smithi203.stdout:2/918: write d13/d15/d30/d5a/dcf/fed [337976,58488] 0 2024-09-11T00:07:35.660 INFO:tasks.workunit.client.1.smithi203.stdout:9/867: dwrite d6/de/d19/f7a [0,4194304] 0 2024-09-11T00:07:35.668 INFO:tasks.workunit.client.0.smithi111.stdout:1/902: mkdir d2/de/d12/d3c/d4b/d6a/d12d 0 2024-09-11T00:07:35.668 INFO:tasks.workunit.client.0.smithi111.stdout:1/903: chown d2/dad/ce1 4368740 1 2024-09-11T00:07:35.671 INFO:tasks.workunit.client.0.smithi111.stdout:1/904: symlink d2/d2b/dc9/l12e 0 2024-09-11T00:07:35.679 INFO:tasks.workunit.client.0.smithi111.stdout:5/954: dwrite d10/d1e/d23/d2b/dad/fca [0,4194304] 0 2024-09-11T00:07:35.680 INFO:tasks.workunit.client.0.smithi111.stdout:9/955: dread d6/dc/dc1/fe4 [0,4194304] 0 2024-09-11T00:07:35.682 INFO:tasks.workunit.client.0.smithi111.stdout:1/905: dread d2/de/f29 [0,4194304] 0 2024-09-11T00:07:35.682 INFO:tasks.workunit.client.1.smithi203.stdout:2/919: dwrite d13/d15/d19/d1c/d73/dc8/fe2 [0,4194304] 0 2024-09-11T00:07:35.691 INFO:tasks.workunit.client.1.smithi203.stdout:2/920: truncate d13/d22/f3f 1159542 0 2024-09-11T00:07:35.696 INFO:tasks.workunit.client.0.smithi111.stdout:5/955: link d10/f19 d10/d1e/d23/d30/d59/d52/d85/d11c/f13b 0 2024-09-11T00:07:35.698 INFO:tasks.workunit.client.1.smithi203.stdout:2/921: mkdir d13/d15/d30/d5a/dac/d135 0 2024-09-11T00:07:35.702 INFO:tasks.workunit.client.1.smithi203.stdout:2/922: creat d13/d15/d30/d5a/d8b/df4/f136 x:0 0 0 2024-09-11T00:07:35.703 INFO:tasks.workunit.client.0.smithi111.stdout:0/957: truncate f1 4175212 0 2024-09-11T00:07:35.704 INFO:tasks.workunit.client.0.smithi111.stdout:0/958: chown d3/d13/d1e/l58 226354717 1 2024-09-11T00:07:35.705 INFO:tasks.workunit.client.0.smithi111.stdout:0/959: fdatasync d3/fc4 0 2024-09-11T00:07:35.709 INFO:tasks.workunit.client.1.smithi203.stdout:2/923: mkdir d13/d15/d19/d1c/d73/d137 0 2024-09-11T00:07:35.711 INFO:tasks.workunit.client.1.smithi203.stdout:2/924: fsync d13/d56/d69/ff5 0 2024-09-11T00:07:35.713 INFO:tasks.workunit.client.0.smithi111.stdout:2/852: write d0/d3/d12/d52/fbd [1757834,130622] 0 2024-09-11T00:07:35.713 INFO:tasks.workunit.client.0.smithi111.stdout:4/892: dwrite d18/d20/d40/def/f113 [0,4194304] 0 2024-09-11T00:07:35.716 INFO:tasks.workunit.client.0.smithi111.stdout:0/960: dread d3/d13/d1e/d29/d70/f9d [0,4194304] 0 2024-09-11T00:07:35.724 INFO:tasks.workunit.client.0.smithi111.stdout:2/853: dread d0/d3/f3e [0,4194304] 0 2024-09-11T00:07:35.728 INFO:tasks.workunit.client.0.smithi111.stdout:4/893: truncate d18/d20/d40/d78/f86 2247434 0 2024-09-11T00:07:35.731 INFO:tasks.workunit.client.1.smithi203.stdout:5/892: write dc/dd/d15/dbd/f81 [1288030,8686] 0 2024-09-11T00:07:35.731 INFO:tasks.workunit.client.1.smithi203.stdout:8/799: truncate d1/f11 801028 0 2024-09-11T00:07:35.733 INFO:tasks.workunit.client.0.smithi111.stdout:7/951: write dd/da6/faa [810140,130511] 0 2024-09-11T00:07:35.736 INFO:tasks.workunit.client.0.smithi111.stdout:8/923: write d11/d23/d3d/d5f/fe0 [64103,67718] 0 2024-09-11T00:07:35.737 INFO:tasks.workunit.client.0.smithi111.stdout:7/952: mknod dd/d1d/d7e/dc8/c139 0 2024-09-11T00:07:35.737 INFO:tasks.workunit.client.0.smithi111.stdout:8/924: chown c3 123 1 2024-09-11T00:07:35.738 INFO:tasks.workunit.client.1.smithi203.stdout:8/800: read d1/d13/d17/d48/d9d/da9/f100 [1179719,30205] 0 2024-09-11T00:07:35.742 INFO:tasks.workunit.client.0.smithi111.stdout:0/961: dread d3/d26/d77/fbc [0,4194304] 0 2024-09-11T00:07:35.743 INFO:tasks.workunit.client.1.smithi203.stdout:2/925: dread d13/d15/f45 [0,4194304] 0 2024-09-11T00:07:35.744 INFO:tasks.workunit.client.1.smithi203.stdout:0/848: dwrite d0/d1d/d5d/f9b [0,4194304] 0 2024-09-11T00:07:35.748 INFO:tasks.workunit.client.0.smithi111.stdout:6/903: sync 2024-09-11T00:07:35.749 INFO:tasks.workunit.client.0.smithi111.stdout:3/949: write d1c/d1d/d22/d23/d2f/de8/d5f/f10e [3102506,77239] 0 2024-09-11T00:07:35.749 INFO:tasks.workunit.client.1.smithi203.stdout:8/801: fsync d1/d13/d17/d81/d97/fb1 0 2024-09-11T00:07:35.749 INFO:tasks.workunit.client.1.smithi203.stdout:0/849: stat d0/d2/d7e/lb4 0 2024-09-11T00:07:35.750 INFO:tasks.workunit.client.1.smithi203.stdout:5/893: link dc/dd/d15/d3b/d73/f83 dc/dd/d9b/dae/d11a/f12b 0 2024-09-11T00:07:35.751 INFO:tasks.workunit.client.1.smithi203.stdout:8/802: chown d1/lda 34 1 2024-09-11T00:07:35.751 INFO:tasks.workunit.client.0.smithi111.stdout:8/925: mknod d11/d23/d3d/d5f/c123 0 2024-09-11T00:07:35.753 INFO:tasks.workunit.client.0.smithi111.stdout:9/956: rename d6/db/d34/d37/f35 to d6/db/d1b/d41/f13c 0 2024-09-11T00:07:35.754 INFO:tasks.workunit.client.1.smithi203.stdout:7/825: dwrite dd/d1c/d52/d8f/d31/d67/dc3/ddb/fee [0,4194304] 0 2024-09-11T00:07:35.755 INFO:tasks.workunit.client.0.smithi111.stdout:0/962: mkdir d3/d26/d143 0 2024-09-11T00:07:35.756 INFO:tasks.workunit.client.1.smithi203.stdout:0/850: read d0/d2/d92/fd9 [3703099,90592] 0 2024-09-11T00:07:35.759 INFO:tasks.workunit.client.0.smithi111.stdout:7/953: rmdir dd/d1d/d76/db6/d137 0 2024-09-11T00:07:35.762 INFO:tasks.workunit.client.1.smithi203.stdout:5/894: symlink dc/dd/d56/l12c 0 2024-09-11T00:07:35.765 INFO:tasks.workunit.client.1.smithi203.stdout:5/895: chown dc/dd/d15/f23 244 1 2024-09-11T00:07:35.766 INFO:tasks.workunit.client.1.smithi203.stdout:2/926: mkdir d13/d15/d30/d5a/d8b/df7/d127/d138 0 2024-09-11T00:07:35.769 INFO:tasks.workunit.client.1.smithi203.stdout:5/896: chown dc/dd/d15/dbd/d59/fd7 6523591 1 2024-09-11T00:07:35.770 INFO:tasks.workunit.client.1.smithi203.stdout:2/927: readlink d13/d15/d30/d5a/d8b/lbe 0 2024-09-11T00:07:35.771 INFO:tasks.workunit.client.1.smithi203.stdout:8/803: rename d1/d13/d3a/da4/fe1 to d1/d13/d17/d2f/d52/d49/d68/f10f 0 2024-09-11T00:07:35.773 INFO:tasks.workunit.client.1.smithi203.stdout:2/928: stat d13/d15/d19/d1c/d76/d94/d97/cf1 0 2024-09-11T00:07:35.775 INFO:tasks.workunit.client.0.smithi111.stdout:0/963: mknod d3/d13/d66/c144 0 2024-09-11T00:07:35.777 INFO:tasks.workunit.client.0.smithi111.stdout:0/964: chown d3/d13/f137 294 1 2024-09-11T00:07:35.779 INFO:tasks.workunit.client.0.smithi111.stdout:0/965: write d3/d1c/fd5 [819637,73668] 0 2024-09-11T00:07:35.783 INFO:tasks.workunit.client.0.smithi111.stdout:4/894: rename d18/d3b/d9f/d10b/c117 to d18/d3b/d51/c11e 0 2024-09-11T00:07:35.783 INFO:tasks.workunit.client.0.smithi111.stdout:3/950: rename d1c to d1c/d1d/d22/d23/dff/d146 22 2024-09-11T00:07:35.787 INFO:tasks.workunit.client.1.smithi203.stdout:2/929: mknod d13/d15/d12d/c139 0 2024-09-11T00:07:35.790 INFO:tasks.workunit.client.1.smithi203.stdout:2/930: dread d13/d22/f7c [0,4194304] 0 2024-09-11T00:07:35.790 INFO:tasks.workunit.client.1.smithi203.stdout:8/804: dread d1/d13/d17/d8b/f9c [0,4194304] 0 2024-09-11T00:07:35.792 INFO:tasks.workunit.client.0.smithi111.stdout:0/966: chown d3/da/d7b/f83 65650560 1 2024-09-11T00:07:35.793 INFO:tasks.workunit.client.0.smithi111.stdout:9/957: creat d6/f13d x:0 0 0 2024-09-11T00:07:35.794 INFO:tasks.workunit.client.1.smithi203.stdout:8/805: dread d1/d13/d17/d8b/f9c [0,4194304] 0 2024-09-11T00:07:35.795 INFO:tasks.workunit.client.0.smithi111.stdout:4/895: mkdir d18/d20/d40/d78/d79/d90/d11f 0 2024-09-11T00:07:35.797 INFO:tasks.workunit.client.0.smithi111.stdout:4/896: fdatasync d18/d20/d3c/d5e/d75/d8d/dce/ff1 0 2024-09-11T00:07:35.797 INFO:tasks.workunit.client.1.smithi203.stdout:9/868: dwrite d6/de/dc4/ff5 [0,4194304] 0 2024-09-11T00:07:35.797 INFO:tasks.workunit.client.1.smithi203.stdout:2/931: chown d13/l34 85915 1 2024-09-11T00:07:35.798 INFO:tasks.workunit.client.0.smithi111.stdout:6/904: dread d7/d22/d3f/d74/d7f/d79/da4/fe5 [0,4194304] 0 2024-09-11T00:07:35.798 INFO:tasks.workunit.client.0.smithi111.stdout:0/967: mknod d3/d26/c145 0 2024-09-11T00:07:35.799 INFO:tasks.workunit.client.0.smithi111.stdout:5/956: write d10/d1e/d23/d26/d78/f7f [3319457,113146] 0 2024-09-11T00:07:35.799 INFO:tasks.workunit.client.1.smithi203.stdout:2/932: read d13/d56/f78 [757208,50595] 0 2024-09-11T00:07:35.804 INFO:tasks.workunit.client.1.smithi203.stdout:3/918: write d8/da/d37/d53/f9b [117617,90231] 0 2024-09-11T00:07:35.804 INFO:tasks.workunit.client.1.smithi203.stdout:2/933: write d13/d15/d19/d1c/d76/f108 [262458,108092] 0 2024-09-11T00:07:35.809 INFO:tasks.workunit.client.1.smithi203.stdout:2/934: write d13/d15/d12d/f130 [926712,115546] 0 2024-09-11T00:07:35.811 INFO:tasks.workunit.client.1.smithi203.stdout:0/851: dread d0/d2/d67/fa5 [0,4194304] 0 2024-09-11T00:07:35.815 INFO:tasks.workunit.client.1.smithi203.stdout:3/919: truncate d8/d3c/fa8 3695321 0 2024-09-11T00:07:35.818 INFO:tasks.workunit.client.1.smithi203.stdout:8/806: chown d1/d13/d17/d48/d61/l99 87470 1 2024-09-11T00:07:35.821 INFO:tasks.workunit.client.0.smithi111.stdout:2/854: dwrite d0/d3/d2e/f66 [0,4194304] 0 2024-09-11T00:07:35.823 INFO:tasks.workunit.client.1.smithi203.stdout:2/935: fsync d13/d56/d69/d99/fcd 0 2024-09-11T00:07:35.828 INFO:tasks.workunit.client.0.smithi111.stdout:8/926: write d11/d23/d2c/feb [1128219,122447] 0 2024-09-11T00:07:35.833 INFO:tasks.workunit.client.0.smithi111.stdout:7/954: write dd/d1d/d2d/d2e/f70 [376763,130061] 0 2024-09-11T00:07:35.834 INFO:tasks.workunit.client.0.smithi111.stdout:2/855: truncate d0/d3/de/f10d 3120151 0 2024-09-11T00:07:35.835 INFO:tasks.workunit.client.0.smithi111.stdout:4/897: link d18/d20/d4a/df9/lff d18/d20/d3c/d5e/daa/dbb/ddc/l120 0 2024-09-11T00:07:35.836 INFO:tasks.workunit.client.0.smithi111.stdout:5/957: link d10/d1e/d23/d30/dd8/da2/d66/d76/fae d10/d1e/d23/d26/d3a/d104/f13c 0 2024-09-11T00:07:35.837 INFO:tasks.workunit.client.0.smithi111.stdout:7/955: fdatasync dd/d1d/d1f/d24/fb5 0 2024-09-11T00:07:35.840 INFO:tasks.workunit.client.0.smithi111.stdout:8/927: creat d11/d23/d2c/f124 x:0 0 0 2024-09-11T00:07:35.841 INFO:tasks.workunit.client.0.smithi111.stdout:5/958: rmdir d10/d1e/d23/d30/dd8/d7e 39 2024-09-11T00:07:35.843 INFO:tasks.workunit.client.0.smithi111.stdout:6/905: dread d7/d22/d26/f10a [0,4194304] 0 2024-09-11T00:07:35.844 INFO:tasks.workunit.client.0.smithi111.stdout:4/898: getdents d18/d20/d3c 0 2024-09-11T00:07:35.845 INFO:tasks.workunit.client.0.smithi111.stdout:8/928: rename d11/c5c to d11/d23/d3d/dca/dcf/d11c/c125 0 2024-09-11T00:07:35.846 INFO:tasks.workunit.client.0.smithi111.stdout:1/906: sync 2024-09-11T00:07:35.850 INFO:tasks.workunit.client.0.smithi111.stdout:2/856: dwrite d0/d3/d2e/ded/dd8/fee [0,4194304] 0 2024-09-11T00:07:35.855 INFO:tasks.workunit.client.1.smithi203.stdout:4/800: sync 2024-09-11T00:07:35.855 INFO:tasks.workunit.client.1.smithi203.stdout:0/852: creat d0/d2/d7e/da1/df5/f11a x:0 0 0 2024-09-11T00:07:35.857 INFO:tasks.workunit.client.0.smithi111.stdout:5/959: dwrite d10/d1e/d23/d26/d78/d12e/f139 [0,4194304] 0 2024-09-11T00:07:35.858 INFO:tasks.workunit.client.0.smithi111.stdout:8/929: mknod d11/d23/d2c/d46/d81/c126 0 2024-09-11T00:07:35.858 INFO:tasks.workunit.client.1.smithi203.stdout:5/897: write dc/dd/d1e/f27 [1707369,94168] 0 2024-09-11T00:07:35.860 INFO:tasks.workunit.client.1.smithi203.stdout:4/801: fdatasync db/d12/fad 0 2024-09-11T00:07:35.863 INFO:tasks.workunit.client.0.smithi111.stdout:6/906: read d7/f6b [136765,61778] 0 2024-09-11T00:07:35.865 INFO:tasks.workunit.client.1.smithi203.stdout:3/920: mknod d8/da/d37/d83/d6a/c149 0 2024-09-11T00:07:35.867 INFO:tasks.workunit.client.0.smithi111.stdout:2/857: chown d0/fc 13096 1 2024-09-11T00:07:35.868 INFO:tasks.workunit.client.0.smithi111.stdout:6/907: chown d7/d22/d1d/c72 12778 1 2024-09-11T00:07:35.871 INFO:tasks.workunit.client.0.smithi111.stdout:6/908: dread - d7/d22/d3f/d74/d7f/d61/d6a/d9f/f12c zero size 2024-09-11T00:07:35.872 INFO:tasks.workunit.client.0.smithi111.stdout:4/899: truncate d18/f1b 4654437 0 2024-09-11T00:07:35.873 INFO:tasks.workunit.client.1.smithi203.stdout:9/869: write d6/de/d19/d24/f36 [3121328,10458] 0 2024-09-11T00:07:35.874 INFO:tasks.workunit.client.0.smithi111.stdout:3/951: sync 2024-09-11T00:07:35.879 INFO:tasks.workunit.client.0.smithi111.stdout:2/858: dread d0/d83/f9c [0,4194304] 0 2024-09-11T00:07:35.880 INFO:tasks.workunit.client.1.smithi203.stdout:4/802: symlink db/d12/d15/d2a/d88/d95/dc2/l103 0 2024-09-11T00:07:35.884 INFO:tasks.workunit.client.1.smithi203.stdout:5/898: truncate dc/dd/d1e/dc6/ff3 903488 0 2024-09-11T00:07:35.884 INFO:tasks.workunit.client.1.smithi203.stdout:0/853: dwrite d0/d2/d7e/f8f [4194304,4194304] 0 2024-09-11T00:07:35.886 INFO:tasks.workunit.client.0.smithi111.stdout:9/958: dread d6/db/d34/d37/d4c/d7f/f96 [0,4194304] 0 2024-09-11T00:07:35.889 INFO:tasks.workunit.client.0.smithi111.stdout:0/968: write d3/d13/d1e/deb/d61/d93/fe5 [513123,97912] 0 2024-09-11T00:07:35.892 INFO:tasks.workunit.client.0.smithi111.stdout:5/960: dread d10/d1e/d23/d30/d3c/f4e [0,4194304] 0 2024-09-11T00:07:35.892 INFO:tasks.workunit.client.1.smithi203.stdout:3/921: read d8/da/d11/f89 [3570624,21024] 0 2024-09-11T00:07:35.906 INFO:tasks.workunit.client.0.smithi111.stdout:7/956: truncate dd/d1d/d1f/d24/f10c 535600 0 2024-09-11T00:07:35.907 INFO:tasks.workunit.client.1.smithi203.stdout:5/899: mkdir dc/dd/d9b/dae/d12d 0 2024-09-11T00:07:35.909 INFO:tasks.workunit.client.1.smithi203.stdout:9/870: dread d6/de/d19/fa7 [0,4194304] 0 2024-09-11T00:07:35.913 INFO:tasks.workunit.client.0.smithi111.stdout:2/859: mkdir d0/d3/de/db4/d128 0 2024-09-11T00:07:35.914 INFO:tasks.workunit.client.0.smithi111.stdout:2/860: read - d0/d83/f11e zero size 2024-09-11T00:07:35.915 INFO:tasks.workunit.client.1.smithi203.stdout:2/936: creat d13/f13a x:0 0 0 2024-09-11T00:07:35.920 INFO:tasks.workunit.client.1.smithi203.stdout:8/807: link d1/d13/d43/ca2 d1/d13/d22/d6f/c110 0 2024-09-11T00:07:35.920 INFO:tasks.workunit.client.0.smithi111.stdout:1/907: write d2/de/d12/d3c/d4b/d6a/d3a/f68 [1525997,95048] 0 2024-09-11T00:07:35.923 INFO:tasks.workunit.client.0.smithi111.stdout:9/959: creat d6/db/db8/dce/f13e x:0 0 0 2024-09-11T00:07:35.924 INFO:tasks.workunit.client.0.smithi111.stdout:3/952: dread d1c/d1d/d22/f70 [0,4194304] 0 2024-09-11T00:07:35.925 INFO:tasks.workunit.client.0.smithi111.stdout:9/960: dread - d6/db/d34/d37/d4c/d99/f116 zero size 2024-09-11T00:07:35.928 INFO:tasks.workunit.client.0.smithi111.stdout:0/969: chown d3/d13/d1e/d29/db0/dce/fdc 4572021 1 2024-09-11T00:07:35.929 INFO:tasks.workunit.client.0.smithi111.stdout:6/909: write d7/d22/d3f/d74/d7f/d79/fb2 [673795,7803] 0 2024-09-11T00:07:35.931 INFO:tasks.workunit.client.0.smithi111.stdout:5/961: write d10/d1e/d23/d30/dd8/d63/f6f [3131372,34349] 0 2024-09-11T00:07:35.933 INFO:tasks.workunit.client.1.smithi203.stdout:2/937: chown d13/d15/d19/d1c/d73/dc4/cc2 56435609 1 2024-09-11T00:07:35.936 INFO:tasks.workunit.client.1.smithi203.stdout:4/803: link c5 db/d12/d15/d2a/d88/d95/dc2/d100/c104 0 2024-09-11T00:07:35.939 INFO:tasks.workunit.client.1.smithi203.stdout:8/808: creat d1/d13/d17/d2f/d52/d59/f111 x:0 0 0 2024-09-11T00:07:35.941 INFO:tasks.workunit.client.0.smithi111.stdout:1/908: rename d2/de/d12/d6c/df5 to d2/de/d12/dc7/d12f 0 2024-09-11T00:07:35.942 INFO:tasks.workunit.client.1.smithi203.stdout:0/854: dread d0/d2/d7e/da1/fe2 [0,4194304] 0 2024-09-11T00:07:35.943 INFO:tasks.workunit.client.1.smithi203.stdout:0/855: chown d0/d1d/c113 564 1 2024-09-11T00:07:35.943 INFO:tasks.workunit.client.0.smithi111.stdout:2/861: dread d0/d83/f85 [0,4194304] 0 2024-09-11T00:07:35.946 INFO:tasks.workunit.client.0.smithi111.stdout:4/900: link d18/d3b/d61/f7c d18/d3b/d9f/db7/de5/f121 0 2024-09-11T00:07:35.947 INFO:tasks.workunit.client.1.smithi203.stdout:9/871: getdents d6/de/d19/d24/d113 0 2024-09-11T00:07:35.949 INFO:tasks.workunit.client.1.smithi203.stdout:2/938: creat d13/d15/d19/d1c/d73/d7a/f13b x:0 0 0 2024-09-11T00:07:35.949 INFO:tasks.workunit.client.0.smithi111.stdout:8/930: getdents d11/d23/d3d/d5f/d99/d10c 0 2024-09-11T00:07:35.950 INFO:tasks.workunit.client.1.smithi203.stdout:9/872: write d6/de/d19/d24/d40/d45/fff [547417,118210] 0 2024-09-11T00:07:35.952 INFO:tasks.workunit.client.1.smithi203.stdout:2/939: fdatasync d13/d15/d19/d1c/d73/d7a/f11f 0 2024-09-11T00:07:35.953 INFO:tasks.workunit.client.1.smithi203.stdout:9/873: chown d6/de/d32/d52/f92 4133191 1 2024-09-11T00:07:35.953 INFO:tasks.workunit.client.1.smithi203.stdout:4/804: fsync db/dd/d16/ded/fa7 0 2024-09-11T00:07:35.957 INFO:tasks.workunit.client.0.smithi111.stdout:7/957: mknod dd/d122/c13a 0 2024-09-11T00:07:35.960 INFO:tasks.workunit.client.1.smithi203.stdout:5/900: rename dc/dd/d56/dad/f64 to dc/dd/d13/f12e 0 2024-09-11T00:07:35.962 INFO:tasks.workunit.client.1.smithi203.stdout:3/922: getdents d8/d2a/dd0/d121 0 2024-09-11T00:07:35.963 INFO:tasks.workunit.client.0.smithi111.stdout:3/953: dwrite d1c/d1d/d22/d23/fb7 [0,4194304] 0 2024-09-11T00:07:35.963 INFO:tasks.workunit.client.0.smithi111.stdout:2/862: readlink d0/d3/de/d3b/d63/lea 0 2024-09-11T00:07:35.967 INFO:tasks.workunit.client.0.smithi111.stdout:6/910: mknod d7/d22/d1d/d83/d121/d41/c135 0 2024-09-11T00:07:35.968 INFO:tasks.workunit.client.0.smithi111.stdout:4/901: truncate d18/d20/d3c/f98 553198 0 2024-09-11T00:07:35.973 INFO:tasks.workunit.client.1.smithi203.stdout:8/809: dwrite d1/d13/d17/d81/d97/fb1 [0,4194304] 0 2024-09-11T00:07:35.973 INFO:tasks.workunit.client.1.smithi203.stdout:6/831: sync 2024-09-11T00:07:35.976 INFO:tasks.workunit.client.0.smithi111.stdout:2/863: mknod d0/d3/de/d50/dda/c129 0 2024-09-11T00:07:35.977 INFO:tasks.workunit.client.1.smithi203.stdout:3/923: creat d8/dce/f14a x:0 0 0 2024-09-11T00:07:35.978 INFO:tasks.workunit.client.1.smithi203.stdout:4/805: creat db/dd/d26/dcd/dfb/f105 x:0 0 0 2024-09-11T00:07:35.981 INFO:tasks.workunit.client.1.smithi203.stdout:4/806: chown db/d12/d15/d2a/d71/l8c 2267547 1 2024-09-11T00:07:35.985 INFO:tasks.workunit.client.0.smithi111.stdout:9/961: write d6/d52/f124 [2832849,42498] 0 2024-09-11T00:07:35.986 INFO:tasks.workunit.client.0.smithi111.stdout:4/902: creat d18/d20/d40/d78/d79/db0/f122 x:0 0 0 2024-09-11T00:07:35.987 INFO:tasks.workunit.client.0.smithi111.stdout:9/962: readlink d6/db/d1b/le9 0 2024-09-11T00:07:35.988 INFO:tasks.workunit.client.0.smithi111.stdout:4/903: readlink d18/d20/l70 0 2024-09-11T00:07:35.990 INFO:tasks.workunit.client.0.smithi111.stdout:1/909: creat d2/de/d12/d6c/f130 x:0 0 0 2024-09-11T00:07:35.993 INFO:tasks.workunit.client.1.smithi203.stdout:9/874: rmdir d6/de/d19/d21/d87/df6 0 2024-09-11T00:07:35.993 INFO:tasks.workunit.client.1.smithi203.stdout:8/810: truncate d1/d13/d17/f26 3742025 0 2024-09-11T00:07:35.995 INFO:tasks.workunit.client.1.smithi203.stdout:0/856: dwrite d0/f5 [0,4194304] 0 2024-09-11T00:07:35.996 INFO:tasks.workunit.client.1.smithi203.stdout:3/924: mkdir d8/da/d37/d83/d65/d8b/d14b 0 2024-09-11T00:07:35.996 INFO:tasks.workunit.client.0.smithi111.stdout:7/958: dwrite dd/d48/fd0 [0,4194304] 0 2024-09-11T00:07:35.997 INFO:tasks.workunit.client.1.smithi203.stdout:0/857: readlink d0/d2/d7e/da1/df5/l4f 0 2024-09-11T00:07:35.999 INFO:tasks.workunit.client.1.smithi203.stdout:3/925: stat d8/da/d37/d83/d6a/f7d 0 2024-09-11T00:07:36.001 INFO:tasks.workunit.client.1.smithi203.stdout:4/807: unlink db/d12/fa4 0 2024-09-11T00:07:36.002 INFO:tasks.workunit.client.1.smithi203.stdout:3/926: stat d8/d17/ff2 0 2024-09-11T00:07:36.003 INFO:tasks.workunit.client.0.smithi111.stdout:8/931: rename d11/d23/d2c/d53/dbd/l10a to d11/d23/l127 0 2024-09-11T00:07:36.007 INFO:tasks.workunit.client.1.smithi203.stdout:5/901: dread dc/dd/d1e/fa1 [0,4194304] 0 2024-09-11T00:07:36.007 INFO:tasks.workunit.client.1.smithi203.stdout:1/961: sync 2024-09-11T00:07:36.010 INFO:tasks.workunit.client.1.smithi203.stdout:2/940: truncate d13/d56/d69/d99/fdd 2991829 0 2024-09-11T00:07:36.010 INFO:tasks.workunit.client.1.smithi203.stdout:7/826: sync 2024-09-11T00:07:36.011 INFO:tasks.workunit.client.1.smithi203.stdout:2/941: stat d13/d15/d19/l6b 0 2024-09-11T00:07:36.012 INFO:tasks.workunit.client.0.smithi111.stdout:9/963: readlink d6/db/d7a/l128 0 2024-09-11T00:07:36.015 INFO:tasks.workunit.client.0.smithi111.stdout:0/970: sync 2024-09-11T00:07:36.017 INFO:tasks.workunit.client.0.smithi111.stdout:3/954: link d1c/d1d/d22/d23/d2f/de8/f53 d1c/f147 0 2024-09-11T00:07:36.018 INFO:tasks.workunit.client.0.smithi111.stdout:6/911: dwrite d7/d22/d1d/d83/d121/d41/d77/fce [0,4194304] 0 2024-09-11T00:07:36.019 INFO:tasks.workunit.client.0.smithi111.stdout:3/955: stat d1c/d1d/d22/d31/d62/fda 0 2024-09-11T00:07:36.020 INFO:tasks.workunit.client.1.smithi203.stdout:6/832: write d0/d54/d9c/d7b/fc4 [229929,116083] 0 2024-09-11T00:07:36.020 INFO:tasks.workunit.client.0.smithi111.stdout:6/912: readlink d7/d22/d1d/l90 0 2024-09-11T00:07:36.021 INFO:tasks.workunit.client.1.smithi203.stdout:8/811: rename d1/d13/d43/d46/l8c to d1/d13/d43/d46/db0/l112 0 2024-09-11T00:07:36.023 INFO:tasks.workunit.client.0.smithi111.stdout:8/932: dwrite d11/d23/d2c/f124 [0,4194304] 0 2024-09-11T00:07:36.027 INFO:tasks.workunit.client.1.smithi203.stdout:4/808: symlink db/d12/d15/l106 0 2024-09-11T00:07:36.031 INFO:tasks.workunit.client.0.smithi111.stdout:1/910: symlink d2/de/d12/d6c/dbd/l131 0 2024-09-11T00:07:36.033 INFO:tasks.workunit.client.0.smithi111.stdout:2/864: dread d0/d3/de/db4/ff3 [0,4194304] 0 2024-09-11T00:07:36.035 INFO:tasks.workunit.client.0.smithi111.stdout:2/865: chown d0/d3/d2e/ded/dd8 208934 1 2024-09-11T00:07:36.036 INFO:tasks.workunit.client.0.smithi111.stdout:2/866: stat d0/d3/d2e/c4d 0 2024-09-11T00:07:36.039 INFO:tasks.workunit.client.0.smithi111.stdout:5/962: rename d10/d1e/d23/d2b/d5c/d61/l97 to d10/d1e/d23/d30/dd8/d7e/l13d 0 2024-09-11T00:07:36.046 INFO:tasks.workunit.client.0.smithi111.stdout:4/904: symlink d18/d20/l123 0 2024-09-11T00:07:36.049 INFO:tasks.workunit.client.1.smithi203.stdout:9/875: creat d6/de/d47/dc3/d115/f11a x:0 0 0 2024-09-11T00:07:36.051 INFO:tasks.workunit.client.0.smithi111.stdout:9/964: write d6/d52/d8a/f103 [80461,40261] 0 2024-09-11T00:07:36.053 INFO:tasks.workunit.client.1.smithi203.stdout:0/858: symlink d0/d87/l11b 0 2024-09-11T00:07:36.053 INFO:tasks.workunit.client.0.smithi111.stdout:9/965: chown d6/d52/d8a/d92/ce5 3915366 1 2024-09-11T00:07:36.054 INFO:tasks.workunit.client.1.smithi203.stdout:0/859: chown d0/d87/fc7 260 1 2024-09-11T00:07:36.055 INFO:tasks.workunit.client.1.smithi203.stdout:2/942: rename d13/d22/d53/fab to d13/d56/d69/d99/f13c 0 2024-09-11T00:07:36.062 INFO:tasks.workunit.client.1.smithi203.stdout:6/833: unlink d0/d5b/d5c/fa8 0 2024-09-11T00:07:36.062 INFO:tasks.workunit.client.0.smithi111.stdout:8/933: creat d11/d23/d2c/d46/d81/da5/f128 x:0 0 0 2024-09-11T00:07:36.062 INFO:tasks.workunit.client.0.smithi111.stdout:4/905: dwrite d18/d20/d40/d78/f105 [0,4194304] 0 2024-09-11T00:07:36.071 INFO:tasks.workunit.client.1.smithi203.stdout:5/902: read dc/d4f/d5c/d76/f78 [10640,82005] 0 2024-09-11T00:07:36.076 INFO:tasks.workunit.client.0.smithi111.stdout:7/959: dread dd/d1d/d2d/f86 [0,4194304] 0 2024-09-11T00:07:36.078 INFO:tasks.workunit.client.1.smithi203.stdout:1/962: symlink d8/l159 0 2024-09-11T00:07:36.080 INFO:tasks.workunit.client.1.smithi203.stdout:6/834: dwrite d0/d5b/d5c/f90 [0,4194304] 0 2024-09-11T00:07:36.082 INFO:tasks.workunit.client.0.smithi111.stdout:5/963: creat d10/d1e/d23/d30/d59/d7b/d82/d86/f13e x:0 0 0 2024-09-11T00:07:36.083 INFO:tasks.workunit.client.1.smithi203.stdout:6/835: fsync d0/f10 0 2024-09-11T00:07:36.087 INFO:tasks.workunit.client.0.smithi111.stdout:9/966: creat d6/db/d1b/d11f/f13f x:0 0 0 2024-09-11T00:07:36.091 INFO:tasks.workunit.client.1.smithi203.stdout:9/876: truncate d6/de/d47/de1/dec/fee 703808 0 2024-09-11T00:07:36.091 INFO:tasks.workunit.client.0.smithi111.stdout:3/956: mkdir d1c/d1d/d22/d44/d5a/d74/d7b/d148 0 2024-09-11T00:07:36.094 INFO:tasks.workunit.client.0.smithi111.stdout:1/911: dwrite d2/de/d93/d9c/fe7 [0,4194304] 0 2024-09-11T00:07:36.097 INFO:tasks.workunit.client.1.smithi203.stdout:7/827: rename dd/d1c/d52/d8f/f3f to dd/d1c/d52/d8f/d31/d67/dc8/f12c 0 2024-09-11T00:07:36.100 INFO:tasks.workunit.client.1.smithi203.stdout:4/809: dwrite db/dd/d26/dcd/fc5 [0,4194304] 0 2024-09-11T00:07:36.102 INFO:tasks.workunit.client.0.smithi111.stdout:7/960: mkdir dd/d48/d69/dbe/d13b 0 2024-09-11T00:07:36.104 INFO:tasks.workunit.client.1.smithi203.stdout:8/812: truncate d1/d13/d17/f38 1901506 0 2024-09-11T00:07:36.104 INFO:tasks.workunit.client.0.smithi111.stdout:7/961: chown dd/d1d/c3c 4760 1 2024-09-11T00:07:36.107 INFO:tasks.workunit.client.1.smithi203.stdout:8/813: chown d1/d13/l30 1 1 2024-09-11T00:07:36.113 INFO:tasks.workunit.client.1.smithi203.stdout:0/860: write d0/d2/d37/d80/fbe [1013533,30371] 0 2024-09-11T00:07:36.116 INFO:tasks.workunit.client.0.smithi111.stdout:5/964: unlink d10/f16 0 2024-09-11T00:07:36.116 INFO:tasks.workunit.client.0.smithi111.stdout:9/967: dread - d6/db/d1b/fc0 zero size 2024-09-11T00:07:36.119 INFO:tasks.workunit.client.1.smithi203.stdout:1/963: symlink d8/d19/d60/d90/d3e/d4b/d80/d8d/da3/dd2/l15a 0 2024-09-11T00:07:36.120 INFO:tasks.workunit.client.0.smithi111.stdout:0/971: dwrite d3/f3b [0,4194304] 0 2024-09-11T00:07:36.121 INFO:tasks.workunit.client.0.smithi111.stdout:2/867: link d0/d3/de/d3b/d63/fec d0/d3/de/d4b/f12a 0 2024-09-11T00:07:36.122 INFO:tasks.workunit.client.0.smithi111.stdout:3/957: read - d1c/d1d/d86/f109 zero size 2024-09-11T00:07:36.122 INFO:tasks.workunit.client.0.smithi111.stdout:1/912: mkdir d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/d132 0 2024-09-11T00:07:36.123 INFO:tasks.workunit.client.1.smithi203.stdout:6/836: stat d0/d54/d9c/d35/f3f 0 2024-09-11T00:07:36.123 INFO:tasks.workunit.client.0.smithi111.stdout:3/958: stat d1c/d21/c45 0 2024-09-11T00:07:36.124 INFO:tasks.workunit.client.0.smithi111.stdout:2/868: dread d0/d83/fcd [0,4194304] 0 2024-09-11T00:07:36.125 INFO:tasks.workunit.client.1.smithi203.stdout:1/964: chown d8/d9/d15/d35/d81 118 1 2024-09-11T00:07:36.125 INFO:tasks.workunit.client.1.smithi203.stdout:3/927: link d8/da/d37/d83/d65/d8b/l11d d8/d2a/dd0/l14c 0 2024-09-11T00:07:36.125 INFO:tasks.workunit.client.0.smithi111.stdout:3/959: readlink d1c/d1d/d22/d23/d2f/de8/l3c 0 2024-09-11T00:07:36.126 INFO:tasks.workunit.client.0.smithi111.stdout:0/972: read d3/d13/d1e/deb/d61/d93/fa1 [4132141,111039] 0 2024-09-11T00:07:36.131 INFO:tasks.workunit.client.1.smithi203.stdout:4/810: dwrite db/d12/f1e [0,4194304] 0 2024-09-11T00:07:36.141 INFO:tasks.workunit.client.1.smithi203.stdout:0/861: dwrite d0/d2/d7e/da1/dc9/de7/d77/ffc [0,4194304] 0 2024-09-11T00:07:36.146 INFO:tasks.workunit.client.1.smithi203.stdout:7/828: dread - dd/d1c/d52/d8f/d31/d67/f109 zero size 2024-09-11T00:07:36.152 INFO:tasks.workunit.client.1.smithi203.stdout:6/837: creat d0/d54/d9c/d35/d38/d73/f104 x:0 0 0 2024-09-11T00:07:36.154 INFO:tasks.workunit.client.1.smithi203.stdout:3/928: rmdir d8/d17/ddd 39 2024-09-11T00:07:36.155 INFO:tasks.workunit.client.0.smithi111.stdout:4/906: sync 2024-09-11T00:07:36.167 INFO:tasks.workunit.client.1.smithi203.stdout:4/811: chown db/d12/d15/d2a/dcb/cd2 690 1 2024-09-11T00:07:36.169 INFO:tasks.workunit.client.1.smithi203.stdout:8/814: write d1/f8 [2005242,22962] 0 2024-09-11T00:07:36.172 INFO:tasks.workunit.client.1.smithi203.stdout:2/943: dwrite d13/d56/d69/d99/fdd [0,4194304] 0 2024-09-11T00:07:36.177 INFO:tasks.workunit.client.1.smithi203.stdout:5/903: creat dc/d4f/d5c/f12f x:0 0 0 2024-09-11T00:07:36.179 INFO:tasks.workunit.client.1.smithi203.stdout:6/838: fdatasync d0/f93 0 2024-09-11T00:07:36.181 INFO:tasks.workunit.client.1.smithi203.stdout:6/839: readlink d0/d32/l44 0 2024-09-11T00:07:36.182 INFO:tasks.workunit.client.1.smithi203.stdout:7/829: mknod dd/d1c/d52/d8f/d31/d58/d93/d98/dfc/c12d 0 2024-09-11T00:07:36.185 INFO:tasks.workunit.client.1.smithi203.stdout:1/965: creat d8/d19/d60/d90/d3e/d4b/d80/da2/d116/d14d/f15b x:0 0 0 2024-09-11T00:07:36.187 INFO:tasks.workunit.client.1.smithi203.stdout:4/812: creat db/dd/d26/dcd/f107 x:0 0 0 2024-09-11T00:07:36.192 INFO:tasks.workunit.client.0.smithi111.stdout:5/965: creat d10/d1e/d23/d2b/d2f/f13f x:0 0 0 2024-09-11T00:07:36.194 INFO:tasks.workunit.client.0.smithi111.stdout:1/913: stat d2/de/d12/fa3 0 2024-09-11T00:07:36.195 INFO:tasks.workunit.client.1.smithi203.stdout:2/944: dread - d13/d15/d19/d1c/fd7 zero size 2024-09-11T00:07:36.196 INFO:tasks.workunit.client.0.smithi111.stdout:2/869: creat d0/d3/de/dd4/f12b x:0 0 0 2024-09-11T00:07:36.197 INFO:tasks.workunit.client.1.smithi203.stdout:2/945: stat d13/d56/d69/dcb/f11a 0 2024-09-11T00:07:36.198 INFO:tasks.workunit.client.1.smithi203.stdout:5/904: creat dc/d2b/dba/f130 x:0 0 0 2024-09-11T00:07:36.200 INFO:tasks.workunit.client.1.smithi203.stdout:3/929: write d8/d17/f84 [109671,13278] 0 2024-09-11T00:07:36.202 INFO:tasks.workunit.client.0.smithi111.stdout:6/913: rename d7/l18 to d7/d22/l136 0 2024-09-11T00:07:36.205 INFO:tasks.workunit.client.0.smithi111.stdout:0/973: fdatasync d3/d13/d1e/d29/db0/f101 0 2024-09-11T00:07:36.206 INFO:tasks.workunit.client.1.smithi203.stdout:6/840: write d0/d5b/d9f/dbe/fde [413574,73864] 0 2024-09-11T00:07:36.206 INFO:tasks.workunit.client.0.smithi111.stdout:7/962: mknod dd/d1d/c13c 0 2024-09-11T00:07:36.209 INFO:tasks.workunit.client.1.smithi203.stdout:7/830: unlink dd/d1c/d52/d8f/d31/d4a/d105/dbb/lcb 0 2024-09-11T00:07:36.210 INFO:tasks.workunit.client.0.smithi111.stdout:4/907: symlink d18/d39/l124 0 2024-09-11T00:07:36.212 INFO:tasks.workunit.client.0.smithi111.stdout:9/968: getdents d6/db/d34/d37/d109 0 2024-09-11T00:07:36.214 INFO:tasks.workunit.client.0.smithi111.stdout:4/908: truncate d18/d20/d40/d78/d79/fdd 1077093 0 2024-09-11T00:07:36.214 INFO:tasks.workunit.client.0.smithi111.stdout:5/966: truncate d10/d1e/d23/d30/d59/d7b/f73 89033 0 2024-09-11T00:07:36.216 INFO:tasks.workunit.client.1.smithi203.stdout:5/905: dwrite dc/dd/d13/f3e [4194304,4194304] 0 2024-09-11T00:07:36.217 INFO:tasks.workunit.client.0.smithi111.stdout:1/914: dread d2/de/d12/d3c/d4b/d6a/d63/f6e [0,4194304] 0 2024-09-11T00:07:36.219 INFO:tasks.workunit.client.1.smithi203.stdout:8/815: mkdir d1/d13/d17/d48/d61/d113 0 2024-09-11T00:07:36.221 INFO:tasks.workunit.client.0.smithi111.stdout:2/870: symlink d0/d3/de/d3b/d99/l12c 0 2024-09-11T00:07:36.226 INFO:tasks.workunit.client.0.smithi111.stdout:3/960: dwrite d1c/d1d/fd1 [0,4194304] 0 2024-09-11T00:07:36.227 INFO:tasks.workunit.client.1.smithi203.stdout:1/966: write d8/d19/f26 [470644,91039] 0 2024-09-11T00:07:36.231 INFO:tasks.workunit.client.1.smithi203.stdout:1/967: stat d8/d119/fdc 0 2024-09-11T00:07:36.234 INFO:tasks.workunit.client.1.smithi203.stdout:7/831: mknod dd/d1c/d52/d8f/d31/d58/d93/d98/c12e 0 2024-09-11T00:07:36.235 INFO:tasks.workunit.client.1.smithi203.stdout:7/832: readlink dd/d1c/d52/d8f/d31/d67/lb8 0 2024-09-11T00:07:36.239 INFO:tasks.workunit.client.1.smithi203.stdout:9/877: rename d6/de/d32/d52/d55/d66/daa/df7/l107 to d6/de/d32/l11b 0 2024-09-11T00:07:36.240 INFO:tasks.workunit.client.0.smithi111.stdout:0/974: write d3/daf/db2/f11d [546501,46092] 0 2024-09-11T00:07:36.241 INFO:tasks.workunit.client.1.smithi203.stdout:0/862: getdents d0/d87 0 2024-09-11T00:07:36.242 INFO:tasks.workunit.client.0.smithi111.stdout:7/963: write dd/ddf/f104 [339661,98592] 0 2024-09-11T00:07:36.242 INFO:tasks.workunit.client.0.smithi111.stdout:3/961: dread d1c/d1d/d22/f70 [0,4194304] 0 2024-09-11T00:07:36.243 INFO:tasks.workunit.client.0.smithi111.stdout:5/967: rmdir d10/d1e/d23/d26/d3a/d98/d6d/def 39 2024-09-11T00:07:36.243 INFO:tasks.workunit.client.1.smithi203.stdout:0/863: truncate d0/dc5/ff1 648842 0 2024-09-11T00:07:36.247 INFO:tasks.workunit.client.1.smithi203.stdout:0/864: chown d0/d2/d37/d5b/d73/fbf 7244930 1 2024-09-11T00:07:36.247 INFO:tasks.workunit.client.1.smithi203.stdout:8/816: creat d1/d13/d17/d2f/d9e/f114 x:0 0 0 2024-09-11T00:07:36.249 INFO:tasks.workunit.client.1.smithi203.stdout:8/817: readlink d1/d13/d43/lc9 0 2024-09-11T00:07:36.252 INFO:tasks.workunit.client.1.smithi203.stdout:6/841: creat d0/d5b/d5c/d6f/d102/f105 x:0 0 0 2024-09-11T00:07:36.252 INFO:tasks.workunit.client.0.smithi111.stdout:9/969: dwrite d6/db/f79 [0,4194304] 0 2024-09-11T00:07:36.253 INFO:tasks.workunit.client.0.smithi111.stdout:8/934: rename d11/d23/d3d/dca/dcf/d11c/c125 to d11/d23/d2c/d46/d81/dd2/c129 0 2024-09-11T00:07:36.255 INFO:tasks.workunit.client.0.smithi111.stdout:9/970: write d6/db/d1b/d41/d80/f12a [451914,109707] 0 2024-09-11T00:07:36.256 INFO:tasks.workunit.client.1.smithi203.stdout:1/968: creat d8/d9/d15/d35/d81/f15c x:0 0 0 2024-09-11T00:07:36.257 INFO:tasks.workunit.client.0.smithi111.stdout:9/971: chown d6/db/d1b/fc0 28 1 2024-09-11T00:07:36.258 INFO:tasks.workunit.client.1.smithi203.stdout:2/946: write d13/d22/d53/f12f [2523817,127497] 0 2024-09-11T00:07:36.259 INFO:tasks.workunit.client.1.smithi203.stdout:4/813: rename db/dd/d16/ded/l62 to db/dd/d16/d38/d3c/da6/l108 0 2024-09-11T00:07:36.267 INFO:tasks.workunit.client.0.smithi111.stdout:3/962: mkdir d1c/d1d/d22/d23/dff/d149 0 2024-09-11T00:07:36.269 INFO:tasks.workunit.client.1.smithi203.stdout:8/818: creat d1/d13/d43/d46/db0/dcf/f115 x:0 0 0 2024-09-11T00:07:36.269 INFO:tasks.workunit.client.1.smithi203.stdout:5/906: dread dc/d4f/d5c/d76/f111 [0,4194304] 0 2024-09-11T00:07:36.272 INFO:tasks.workunit.client.0.smithi111.stdout:5/968: creat d10/d1e/d23/d2b/d2f/d11f/d128/df6/d111/f140 x:0 0 0 2024-09-11T00:07:36.272 INFO:tasks.workunit.client.1.smithi203.stdout:8/819: chown d1/d13/d17/d48/d9d/da9/f100 7 1 2024-09-11T00:07:36.272 INFO:tasks.workunit.client.1.smithi203.stdout:6/842: dwrite d0/d32/f100 [0,4194304] 0 2024-09-11T00:07:36.275 INFO:tasks.workunit.client.1.smithi203.stdout:4/814: creat db/d12/d15/f109 x:0 0 0 2024-09-11T00:07:36.278 INFO:tasks.workunit.client.1.smithi203.stdout:3/930: rename d8/da/d37/d53/dea/de5/d103/c110 to d8/d17/ddd/d139/c14d 0 2024-09-11T00:07:36.278 INFO:tasks.workunit.client.0.smithi111.stdout:6/914: creat d7/d22/d1d/f137 x:0 0 0 2024-09-11T00:07:36.279 INFO:tasks.workunit.client.1.smithi203.stdout:4/815: readlink db/dd/d26/dcd/le8 0 2024-09-11T00:07:36.280 INFO:tasks.workunit.client.0.smithi111.stdout:9/972: creat d6/d52/f140 x:0 0 0 2024-09-11T00:07:36.280 INFO:tasks.workunit.client.0.smithi111.stdout:5/969: dread d10/d1e/d23/d2b/d92/fbc [0,4194304] 0 2024-09-11T00:07:36.284 INFO:tasks.workunit.client.0.smithi111.stdout:1/915: dread d2/de/d93/d9c/fa2 [0,4194304] 0 2024-09-11T00:07:36.285 INFO:tasks.workunit.client.0.smithi111.stdout:9/973: readlink d6/dc/d73/led 0 2024-09-11T00:07:36.286 INFO:tasks.workunit.client.0.smithi111.stdout:0/975: rename d3/f80 to d3/d13/d1e/deb/d61/d93/d102/f146 0 2024-09-11T00:07:36.286 INFO:tasks.workunit.client.1.smithi203.stdout:7/833: rmdir dd/d1c/d52/d8f/d31/d58/d93/d98/dfc/d108 0 2024-09-11T00:07:36.286 INFO:tasks.workunit.client.1.smithi203.stdout:2/947: mknod d13/d15/d30/d5a/dac/d135/c13d 0 2024-09-11T00:07:36.288 INFO:tasks.workunit.client.0.smithi111.stdout:4/909: getdents d18/d20/d3c/d5e/daa 0 2024-09-11T00:07:36.291 INFO:tasks.workunit.client.0.smithi111.stdout:0/976: dread d3/daf/db2/f11d [0,4194304] 0 2024-09-11T00:07:36.291 INFO:tasks.workunit.client.1.smithi203.stdout:6/843: chown d0/d54/d9c/d35/d38/f84 26805976 1 2024-09-11T00:07:36.299 INFO:tasks.workunit.client.1.smithi203.stdout:8/820: read d1/d13/d17/d2f/d52/fa0 [812928,98944] 0 2024-09-11T00:07:36.302 INFO:tasks.workunit.client.0.smithi111.stdout:2/871: sync 2024-09-11T00:07:36.302 INFO:tasks.workunit.client.0.smithi111.stdout:5/970: rmdir d10/d1e/d23/d26/d78/d12e 39 2024-09-11T00:07:36.304 INFO:tasks.workunit.client.1.smithi203.stdout:1/969: dread d8/d19/d60/d90/d3e/d4b/d80/d91/dac/f121 [0,4194304] 0 2024-09-11T00:07:36.304 INFO:tasks.workunit.client.1.smithi203.stdout:4/816: creat db/dd/d26/dcd/dfb/f10a x:0 0 0 2024-09-11T00:07:36.304 INFO:tasks.workunit.client.0.smithi111.stdout:2/872: write d0/d3/de/d68/df1/f11c [323300,121299] 0 2024-09-11T00:07:36.306 INFO:tasks.workunit.client.1.smithi203.stdout:4/817: write db/d12/f1e [4325123,51449] 0 2024-09-11T00:07:36.306 INFO:tasks.workunit.client.1.smithi203.stdout:0/865: creat d0/d1d/d5d/f11c x:0 0 0 2024-09-11T00:07:36.307 INFO:tasks.workunit.client.0.smithi111.stdout:6/915: truncate d7/d22/d26/d95/dd6/ffe 537599 0 2024-09-11T00:07:36.308 INFO:tasks.workunit.client.0.smithi111.stdout:3/963: write d1c/d1d/d22/d23/d2f/de8/d5f/d98/ff3 [955211,121151] 0 2024-09-11T00:07:36.312 INFO:tasks.workunit.client.1.smithi203.stdout:2/948: fdatasync d13/d15/d19/d1c/d76/d94/fce 0 2024-09-11T00:07:36.314 INFO:tasks.workunit.client.0.smithi111.stdout:4/910: creat d18/d3b/f125 x:0 0 0 2024-09-11T00:07:36.318 INFO:tasks.workunit.client.0.smithi111.stdout:7/964: getdents dd/d49/d110 0 2024-09-11T00:07:36.319 INFO:tasks.workunit.client.1.smithi203.stdout:9/878: getdents d6/de/d47/de1/dec 0 2024-09-11T00:07:36.322 INFO:tasks.workunit.client.0.smithi111.stdout:1/916: dread d2/de/d12/f28 [0,4194304] 0 2024-09-11T00:07:36.322 INFO:tasks.workunit.client.1.smithi203.stdout:3/931: mkdir d8/da/d5c/d6b/d6c/d13a/d14e 0 2024-09-11T00:07:36.324 INFO:tasks.workunit.client.1.smithi203.stdout:8/821: symlink d1/d13/d17/d77/l116 0 2024-09-11T00:07:36.325 INFO:tasks.workunit.client.0.smithi111.stdout:2/873: creat d0/d3/d12/d38/f12d x:0 0 0 2024-09-11T00:07:36.326 INFO:tasks.workunit.client.0.smithi111.stdout:2/874: chown d0/d3/de/d4b 33873198 1 2024-09-11T00:07:36.327 INFO:tasks.workunit.client.1.smithi203.stdout:4/818: mknod db/dd/d16/c10b 0 2024-09-11T00:07:36.328 INFO:tasks.workunit.client.1.smithi203.stdout:5/907: dwrite dc/d9f/fbf [0,4194304] 0 2024-09-11T00:07:36.328 INFO:tasks.workunit.client.1.smithi203.stdout:8/822: chown d1/d13/d43/d46/cc2 0 1 2024-09-11T00:07:36.329 INFO:tasks.workunit.client.0.smithi111.stdout:6/916: mkdir d7/d22/d26/d95/dd6/d138 0 2024-09-11T00:07:36.331 INFO:tasks.workunit.client.1.smithi203.stdout:0/866: fsync d0/d2/d67/f93 0 2024-09-11T00:07:36.331 INFO:tasks.workunit.client.1.smithi203.stdout:7/834: dread dd/f1a [4194304,4194304] 0 2024-09-11T00:07:36.332 INFO:tasks.workunit.client.0.smithi111.stdout:3/964: unlink d1c/d1d/d22/d44/d5a/d74/f111 0 2024-09-11T00:07:36.333 INFO:tasks.workunit.client.0.smithi111.stdout:3/965: chown d1c/d21/dae 3 1 2024-09-11T00:07:36.333 INFO:tasks.workunit.client.1.smithi203.stdout:1/970: truncate d8/d19/d60/d90/d3e/d66/f6e 3473114 0 2024-09-11T00:07:36.334 INFO:tasks.workunit.client.1.smithi203.stdout:0/867: fsync d0/d2/d7e/da1/dc9/de7/d77/ffc 0 2024-09-11T00:07:36.336 INFO:tasks.workunit.client.1.smithi203.stdout:0/868: chown d0/d2/d37/d80/l10c 76484637 1 2024-09-11T00:07:36.337 INFO:tasks.workunit.client.0.smithi111.stdout:4/911: rmdir d18/d20/d3c/d5e/d75/d8d/dce 39 2024-09-11T00:07:36.342 INFO:tasks.workunit.client.0.smithi111.stdout:7/965: chown dd/d1d/d7e/df8/d8f/d9f 224698 1 2024-09-11T00:07:36.344 INFO:tasks.workunit.client.0.smithi111.stdout:9/974: creat d6/db/d1b/f141 x:0 0 0 2024-09-11T00:07:36.345 INFO:tasks.workunit.client.0.smithi111.stdout:7/966: truncate dd/d48/d69/fbb 4681489 0 2024-09-11T00:07:36.348 INFO:tasks.workunit.client.0.smithi111.stdout:7/967: write dd/d1d/d1f/d24/f10b [2358671,97811] 0 2024-09-11T00:07:36.349 INFO:tasks.workunit.client.0.smithi111.stdout:8/935: sync 2024-09-11T00:07:36.356 INFO:tasks.workunit.client.0.smithi111.stdout:6/917: read d7/d22/d2c/d38/d39/fc9 [267665,73979] 0 2024-09-11T00:07:36.357 INFO:tasks.workunit.client.1.smithi203.stdout:7/835: chown dd/d1c/d52/d8f/d31/d4a/f86 1550340265 1 2024-09-11T00:07:36.357 INFO:tasks.workunit.client.1.smithi203.stdout:7/836: stat dd/l15 0 2024-09-11T00:07:36.358 INFO:tasks.workunit.client.1.smithi203.stdout:8/823: creat d1/d13/d17/d2f/d52/d49/d68/dba/f117 x:0 0 0 2024-09-11T00:07:36.360 INFO:tasks.workunit.client.0.smithi111.stdout:0/977: rename d3/d13/d1e/deb/d61 to d3/d1c/d147 0 2024-09-11T00:07:36.362 INFO:tasks.workunit.client.1.smithi203.stdout:6/844: write d0/d5b/d5c/d6f/ffb [1016454,13286] 0 2024-09-11T00:07:36.366 INFO:tasks.workunit.client.1.smithi203.stdout:1/971: write d8/d9/d15/d35/d81/f83 [4782743,11563] 0 2024-09-11T00:07:36.367 INFO:tasks.workunit.client.0.smithi111.stdout:1/917: symlink d2/de/d12/d3c/d4b/d6a/d63/d113/l133 0 2024-09-11T00:07:36.367 INFO:tasks.workunit.client.1.smithi203.stdout:4/819: write db/dd/d16/f55 [951582,64609] 0 2024-09-11T00:07:36.367 INFO:tasks.workunit.client.1.smithi203.stdout:1/972: chown d8/d119/fdc 31 1 2024-09-11T00:07:36.368 INFO:tasks.workunit.client.0.smithi111.stdout:1/918: chown d2/de/lb0 0 1 2024-09-11T00:07:36.369 INFO:tasks.workunit.client.1.smithi203.stdout:0/869: fsync d0/d2/d37/d5b/d73/f99 0 2024-09-11T00:07:36.373 INFO:tasks.workunit.client.1.smithi203.stdout:0/870: stat d0/d2/d37/d5b/d73/c10b 0 2024-09-11T00:07:36.375 INFO:tasks.workunit.client.0.smithi111.stdout:5/971: link d10/d1e/d23/d30/dd8/d7e/la5 d10/d1e/d23/d30/dd8/d63/dbb/db5/l141 0 2024-09-11T00:07:36.380 INFO:tasks.workunit.client.0.smithi111.stdout:2/875: dwrite d0/d3/de/d3b/d63/fdd [0,4194304] 0 2024-09-11T00:07:36.384 INFO:tasks.workunit.client.0.smithi111.stdout:9/975: write d6/dc/f108 [686651,39697] 0 2024-09-11T00:07:36.386 INFO:tasks.workunit.client.0.smithi111.stdout:3/966: fsync f17 0 2024-09-11T00:07:36.388 INFO:tasks.workunit.client.0.smithi111.stdout:6/918: mknod d7/d22/d1d/d8c/c139 0 2024-09-11T00:07:36.391 INFO:tasks.workunit.client.0.smithi111.stdout:6/919: fsync d7/d22/d26/d95/f131 0 2024-09-11T00:07:36.391 INFO:tasks.workunit.client.1.smithi203.stdout:5/908: mknod dc/dd/d15/dbd/de5/d10b/c131 0 2024-09-11T00:07:36.393 INFO:tasks.workunit.client.0.smithi111.stdout:6/920: dread - d7/d22/d3f/d74/d7f/d61/d6a/d9f/f12c zero size 2024-09-11T00:07:36.394 INFO:tasks.workunit.client.0.smithi111.stdout:4/912: link d18/d20/d40/f112 d18/d20/d3c/d5e/f126 0 2024-09-11T00:07:36.396 INFO:tasks.workunit.client.0.smithi111.stdout:4/913: chown d18/d1f/d33 1445326 1 2024-09-11T00:07:36.396 INFO:tasks.workunit.client.1.smithi203.stdout:5/909: read dc/dd/d15/dbd/d59/f46 [1522464,6548] 0 2024-09-11T00:07:36.397 INFO:tasks.workunit.client.1.smithi203.stdout:7/837: fsync dd/d1c/d52/d8f/d31/d4a/d105/f65 0 2024-09-11T00:07:36.399 INFO:tasks.workunit.client.0.smithi111.stdout:2/876: dread d0/d3/f1c [0,4194304] 0 2024-09-11T00:07:36.399 INFO:tasks.workunit.client.0.smithi111.stdout:7/968: dwrite dd/f10 [0,4194304] 0 2024-09-11T00:07:36.401 INFO:tasks.workunit.client.1.smithi203.stdout:6/845: fsync d0/d54/d9c/d35/f3f 0 2024-09-11T00:07:36.401 INFO:tasks.workunit.client.1.smithi203.stdout:4/820: dread db/d12/d15/d2a/f87 [4194304,4194304] 0 2024-09-11T00:07:36.401 INFO:tasks.workunit.client.0.smithi111.stdout:2/877: fsync d0/d3/d12/d52/d6c/f7c 0 2024-09-11T00:07:36.404 INFO:tasks.workunit.client.0.smithi111.stdout:1/919: rename d2/de/d12/d6c/dbd to d2/de/d12/d88/d134 0 2024-09-11T00:07:36.407 INFO:tasks.workunit.client.1.smithi203.stdout:2/949: link d13/d22/f6f d13/d15/d30/dfa/daf/dec/f13e 0 2024-09-11T00:07:36.407 INFO:tasks.workunit.client.0.smithi111.stdout:5/972: creat d10/d1e/d23/d2b/d2f/d11f/f142 x:0 0 0 2024-09-11T00:07:36.408 INFO:tasks.workunit.client.0.smithi111.stdout:8/936: dread d11/fc0 [0,4194304] 0 2024-09-11T00:07:36.413 INFO:tasks.workunit.client.1.smithi203.stdout:1/973: rename d8/d28/d64/cbf to d8/d19/d60/d90/d3e/d66/d12f/c15d 0 2024-09-11T00:07:36.414 INFO:tasks.workunit.client.1.smithi203.stdout:0/871: symlink d0/d1d/d5d/d70/l11d 0 2024-09-11T00:07:36.416 INFO:tasks.workunit.client.1.smithi203.stdout:8/824: write d1/d13/d17/d8b/fa8 [513738,67508] 0 2024-09-11T00:07:36.417 INFO:tasks.workunit.client.0.smithi111.stdout:9/976: mkdir d6/db/db8/dce/dcf/d142 0 2024-09-11T00:07:36.419 INFO:tasks.workunit.client.1.smithi203.stdout:0/872: stat d0/d2/d37/d5b/d73/l7d 0 2024-09-11T00:07:36.419 INFO:tasks.workunit.client.1.smithi203.stdout:3/932: link d8/da/d37/d53/dea/fb7 d8/da/d37/d83/db9/f14f 0 2024-09-11T00:07:36.422 INFO:tasks.workunit.client.0.smithi111.stdout:0/978: mknod d3/d13/d1e/d29/d49/df2/d12d/c148 0 2024-09-11T00:07:36.423 INFO:tasks.workunit.client.0.smithi111.stdout:4/914: fsync f5 0 2024-09-11T00:07:36.427 INFO:tasks.workunit.client.0.smithi111.stdout:7/969: truncate dd/fcc 1099091 0 2024-09-11T00:07:36.428 INFO:tasks.workunit.client.0.smithi111.stdout:2/878: dread - d0/d3/fc0 zero size 2024-09-11T00:07:36.430 INFO:tasks.workunit.client.0.smithi111.stdout:2/879: stat d0/d3/de/d50/d9d/fa3 0 2024-09-11T00:07:36.432 INFO:tasks.workunit.client.0.smithi111.stdout:5/973: fdatasync d10/f6b 0 2024-09-11T00:07:36.434 INFO:tasks.workunit.client.0.smithi111.stdout:3/967: write d1c/d1d/d22/d44/f56 [676907,91027] 0 2024-09-11T00:07:36.435 INFO:tasks.workunit.client.1.smithi203.stdout:2/950: fdatasync d13/d15/f32 0 2024-09-11T00:07:36.439 INFO:tasks.workunit.client.1.smithi203.stdout:9/879: getdents d6/de/d19/d21/dd0 0 2024-09-11T00:07:36.441 INFO:tasks.workunit.client.1.smithi203.stdout:5/910: write dc/fc3 [2568769,35867] 0 2024-09-11T00:07:36.442 INFO:tasks.workunit.client.1.smithi203.stdout:8/825: mkdir d1/d13/d17/d48/d118 0 2024-09-11T00:07:36.445 INFO:tasks.workunit.client.0.smithi111.stdout:1/920: write d2/de/ff [1963762,122568] 0 2024-09-11T00:07:36.447 INFO:tasks.workunit.client.0.smithi111.stdout:6/921: dwrite d7/d22/d3f/d74/d7f/d79/da4/fb9 [0,4194304] 0 2024-09-11T00:07:36.449 INFO:tasks.workunit.client.1.smithi203.stdout:0/873: rename d0/df8 to d0/d2/d7e/da1/dc9/de7/d11e 0 2024-09-11T00:07:36.450 INFO:tasks.workunit.client.0.smithi111.stdout:4/915: symlink d18/d20/d3c/d5e/daa/dbb/l127 0 2024-09-11T00:07:36.452 INFO:tasks.workunit.client.1.smithi203.stdout:0/874: stat d0/dc5/f10e 0 2024-09-11T00:07:36.455 INFO:tasks.workunit.client.1.smithi203.stdout:0/875: write d0/d1d/d5d/dba/fdf [1922874,37216] 0 2024-09-11T00:07:36.456 INFO:tasks.workunit.client.0.smithi111.stdout:4/916: dread d18/d1f/dc5/ff0 [0,4194304] 0 2024-09-11T00:07:36.458 INFO:tasks.workunit.client.0.smithi111.stdout:4/917: truncate d18/d3b/d61/f10f 278023 0 2024-09-11T00:07:36.459 INFO:tasks.workunit.client.0.smithi111.stdout:8/937: dread d11/d23/d2c/d46/d64/f88 [0,4194304] 0 2024-09-11T00:07:36.460 INFO:tasks.workunit.client.1.smithi203.stdout:0/876: read d0/d1d/d4c/f6d [3768169,32611] 0 2024-09-11T00:07:36.460 INFO:tasks.workunit.client.0.smithi111.stdout:8/938: chown d11/d23/d3d/f94 1 1 2024-09-11T00:07:36.461 INFO:tasks.workunit.client.0.smithi111.stdout:5/974: mkdir d10/d1e/d23/d30/d59/d52/dd6/dee/d143 0 2024-09-11T00:07:36.463 INFO:tasks.workunit.client.1.smithi203.stdout:1/974: dwrite d8/d9/d15/fc1 [0,4194304] 0 2024-09-11T00:07:36.466 INFO:tasks.workunit.client.0.smithi111.stdout:9/977: creat d6/db/db8/dce/d12d/d130/f143 x:0 0 0 2024-09-11T00:07:36.467 INFO:tasks.workunit.client.1.smithi203.stdout:2/951: symlink d13/d15/d30/dfa/l13f 0 2024-09-11T00:07:36.468 INFO:tasks.workunit.client.1.smithi203.stdout:3/933: dwrite d8/da/d11/f89 [0,4194304] 0 2024-09-11T00:07:36.469 INFO:tasks.workunit.client.1.smithi203.stdout:0/877: chown d0/d2/d37/d80/ffd 1565 1 2024-09-11T00:07:36.474 INFO:tasks.workunit.client.1.smithi203.stdout:2/952: dread d13/d22/f6f [0,4194304] 0 2024-09-11T00:07:36.475 INFO:tasks.workunit.client.1.smithi203.stdout:6/846: truncate d0/d54/d9c/d35/d38/dc0/ddb/fe1 2115247 0 2024-09-11T00:07:36.476 INFO:tasks.workunit.client.1.smithi203.stdout:6/847: stat d0/d71/c86 0 2024-09-11T00:07:36.485 INFO:tasks.workunit.client.0.smithi111.stdout:6/922: mknod d7/d22/d3f/d74/d7f/d61/d6a/d9f/db6/c13a 0 2024-09-11T00:07:36.488 INFO:tasks.workunit.client.1.smithi203.stdout:4/821: link db/d12/d15/d2a/d88/f89 db/dd/d26/d42/d102/f10c 0 2024-09-11T00:07:36.489 INFO:tasks.workunit.client.0.smithi111.stdout:7/970: rename dd/d1d/d7e/df8/d8f/d9f/d79/lcf to dd/d1d/d7e/df8/d8f/dac/d118/l13d 0 2024-09-11T00:07:36.489 INFO:tasks.workunit.client.0.smithi111.stdout:2/880: mknod d0/d11b/c12e 0 2024-09-11T00:07:36.491 INFO:tasks.workunit.client.1.smithi203.stdout:9/880: dwrite d6/de/d19/d24/f6d [0,4194304] 0 2024-09-11T00:07:36.491 INFO:tasks.workunit.client.0.smithi111.stdout:4/918: truncate d18/d3b/d51/f67 975726 0 2024-09-11T00:07:36.492 INFO:tasks.workunit.client.1.smithi203.stdout:1/975: creat d8/d19/d60/d90/d3e/d4b/d80/d8d/da3/dd2/f15e x:0 0 0 2024-09-11T00:07:36.492 INFO:tasks.workunit.client.0.smithi111.stdout:1/921: dwrite d2/de/d12/d3c/d4b/d6a/d63/f6e [0,4194304] 0 2024-09-11T00:07:36.494 INFO:tasks.workunit.client.0.smithi111.stdout:3/968: mkdir d1c/d1d/d22/d44/d5a/d74/d7b/d148/d14a 0 2024-09-11T00:07:36.495 INFO:tasks.workunit.client.1.smithi203.stdout:6/848: dwrite d0/d54/fdf [4194304,4194304] 0 2024-09-11T00:07:36.501 INFO:tasks.workunit.client.1.smithi203.stdout:8/826: fsync d1/f16 0 2024-09-11T00:07:36.505 INFO:tasks.workunit.client.1.smithi203.stdout:0/878: dread - d0/d2/d7e/da1/dc9/fee zero size 2024-09-11T00:07:36.505 INFO:tasks.workunit.client.1.smithi203.stdout:2/953: creat d13/d22/dd6/f140 x:0 0 0 2024-09-11T00:07:36.508 INFO:tasks.workunit.client.0.smithi111.stdout:0/979: link d3/d13/d66/c144 d3/da/d7b/db3/d11c/c149 0 2024-09-11T00:07:36.510 INFO:tasks.workunit.client.1.smithi203.stdout:2/954: chown d13/d15/f32 29508 1 2024-09-11T00:07:36.510 INFO:tasks.workunit.client.0.smithi111.stdout:0/980: chown d3/da 971135981 1 2024-09-11T00:07:36.511 INFO:tasks.workunit.client.0.smithi111.stdout:7/971: creat dd/d1d/d1f/f13e x:0 0 0 2024-09-11T00:07:36.512 INFO:tasks.workunit.client.0.smithi111.stdout:5/975: dread d10/d1e/d23/d30/dd8/da2/ff5 [0,4194304] 0 2024-09-11T00:07:36.512 INFO:tasks.workunit.client.1.smithi203.stdout:2/955: chown d13/d15/d30/fc0 238967 1 2024-09-11T00:07:36.516 INFO:tasks.workunit.client.0.smithi111.stdout:2/881: mknod d0/d3/de/d3b/d62/d6d/da1/c12f 0 2024-09-11T00:07:36.517 INFO:tasks.workunit.client.1.smithi203.stdout:4/822: dwrite db/d12/d15/d2a/dcb/de5/ff4 [0,4194304] 0 2024-09-11T00:07:36.517 INFO:tasks.workunit.client.0.smithi111.stdout:2/882: write d0/d3/de/f44 [1958846,14679] 0 2024-09-11T00:07:36.518 INFO:tasks.workunit.client.0.smithi111.stdout:8/939: mkdir d11/d23/d3d/d5f/d12a 0 2024-09-11T00:07:36.519 INFO:tasks.workunit.client.0.smithi111.stdout:2/883: fdatasync d0/d3/de/d3b/d62/feb 0 2024-09-11T00:07:36.522 INFO:tasks.workunit.client.1.smithi203.stdout:1/976: dread d8/d9/d15/d35/d81/db9/dce/feb [0,4194304] 0 2024-09-11T00:07:36.524 INFO:tasks.workunit.client.0.smithi111.stdout:1/922: mkdir d2/de/d105/d135 0 2024-09-11T00:07:36.526 INFO:tasks.workunit.client.1.smithi203.stdout:6/849: symlink d0/d5b/d5c/d6f/l106 0 2024-09-11T00:07:36.527 INFO:tasks.workunit.client.0.smithi111.stdout:3/969: symlink d1c/d21/dae/dfe/l14b 0 2024-09-11T00:07:36.529 INFO:tasks.workunit.client.1.smithi203.stdout:8/827: creat d1/d13/d22/d6f/f119 x:0 0 0 2024-09-11T00:07:36.530 INFO:tasks.workunit.client.0.smithi111.stdout:9/978: mknod d6/c144 0 2024-09-11T00:07:36.531 INFO:tasks.workunit.client.1.smithi203.stdout:8/828: fdatasync d1/f3d 0 2024-09-11T00:07:36.532 INFO:tasks.workunit.client.1.smithi203.stdout:0/879: symlink d0/d2/d37/dfa/l11f 0 2024-09-11T00:07:36.535 INFO:tasks.workunit.client.0.smithi111.stdout:0/981: chown d3/dc/f43 854795 1 2024-09-11T00:07:36.535 INFO:tasks.workunit.client.0.smithi111.stdout:2/884: dwrite d0/d3/de/f1f [4194304,4194304] 0 2024-09-11T00:07:36.541 INFO:tasks.workunit.client.0.smithi111.stdout:5/976: truncate d10/f1a 4729458 0 2024-09-11T00:07:36.542 INFO:tasks.workunit.client.0.smithi111.stdout:5/977: readlink d10/d1e/d23/d30/ld0 0 2024-09-11T00:07:36.547 INFO:tasks.workunit.client.1.smithi203.stdout:5/911: getdents dc/d9f 0 2024-09-11T00:07:36.552 INFO:tasks.workunit.client.0.smithi111.stdout:6/923: dwrite d7/d22/d1d/d83/d121/f57 [4194304,4194304] 0 2024-09-11T00:07:36.555 INFO:tasks.workunit.client.1.smithi203.stdout:8/829: dwrite d1/d13/d17/d2f/d52/d59/f111 [0,4194304] 0 2024-09-11T00:07:36.556 INFO:tasks.workunit.client.0.smithi111.stdout:9/979: stat d6/c12 0 2024-09-11T00:07:36.557 INFO:tasks.workunit.client.0.smithi111.stdout:3/970: dread d1c/d1d/d22/d23/d2f/de8/d5f/f10e [0,4194304] 0 2024-09-11T00:07:36.564 INFO:tasks.workunit.client.0.smithi111.stdout:2/885: mknod d0/d83/c130 0 2024-09-11T00:07:36.566 INFO:tasks.workunit.client.0.smithi111.stdout:0/982: truncate d3/d13/d1e/d29/db0/f101 976190 0 2024-09-11T00:07:36.570 INFO:tasks.workunit.client.0.smithi111.stdout:5/978: fsync d10/d1e/d23/d30/dd8/d7e/fab 0 2024-09-11T00:07:36.571 INFO:tasks.workunit.client.1.smithi203.stdout:6/850: mkdir d0/d5b/d5c/d6f/de7/d107 0 2024-09-11T00:07:36.573 INFO:tasks.workunit.client.1.smithi203.stdout:9/881: write d6/de/d19/f31 [1138162,105939] 0 2024-09-11T00:07:36.575 INFO:tasks.workunit.client.0.smithi111.stdout:8/940: rename d11/d23/d2c/d46/d81/dd2/c129 to d11/d23/df2/c12b 0 2024-09-11T00:07:36.576 INFO:tasks.workunit.client.0.smithi111.stdout:8/941: chown d11/d8e/dd4 6 1 2024-09-11T00:07:36.581 INFO:tasks.workunit.client.1.smithi203.stdout:0/880: mkdir d0/d2/d7e/da1/d120 0 2024-09-11T00:07:36.583 INFO:tasks.workunit.client.1.smithi203.stdout:4/823: write db/d12/d15/d2a/f87 [8191926,71458] 0 2024-09-11T00:07:36.585 INFO:tasks.workunit.client.1.smithi203.stdout:0/881: chown d0/d2/d37/d5b/d73/le5 0 1 2024-09-11T00:07:36.586 INFO:tasks.workunit.client.1.smithi203.stdout:8/830: symlink d1/d13/d22/l11a 0 2024-09-11T00:07:36.588 INFO:tasks.workunit.client.0.smithi111.stdout:6/924: creat d7/d22/d3f/d74/d7f/d79/da4/f13b x:0 0 0 2024-09-11T00:07:36.588 INFO:tasks.workunit.client.0.smithi111.stdout:4/919: write d18/d20/d3c/d5e/d75/d8d/dce/fd9 [1087080,54007] 0 2024-09-11T00:07:36.589 INFO:tasks.workunit.client.0.smithi111.stdout:7/972: write dd/d1d/d7e/df8/d8f/dac/fff [2739838,32441] 0 2024-09-11T00:07:36.591 INFO:tasks.workunit.client.1.smithi203.stdout:5/912: dread dc/d2b/f93 [0,4194304] 0 2024-09-11T00:07:36.593 INFO:tasks.workunit.client.0.smithi111.stdout:6/925: write d7/d22/d2c/d38/d39/f113 [790224,87414] 0 2024-09-11T00:07:36.593 INFO:tasks.workunit.client.0.smithi111.stdout:4/920: read d18/d20/d4a/f64 [6162484,108223] 0 2024-09-11T00:07:36.595 INFO:tasks.workunit.client.1.smithi203.stdout:2/956: dwrite d13/d22/fbd [0,4194304] 0 2024-09-11T00:07:36.598 INFO:tasks.workunit.client.0.smithi111.stdout:1/923: dwrite d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/fae [0,4194304] 0 2024-09-11T00:07:36.600 INFO:tasks.workunit.client.1.smithi203.stdout:1/977: write d8/d19/d60/d90/d3e/d66/f6e [3675125,91260] 0 2024-09-11T00:07:36.603 INFO:tasks.workunit.client.0.smithi111.stdout:2/886: creat d0/d3/d12/f131 x:0 0 0 2024-09-11T00:07:36.613 INFO:tasks.workunit.client.1.smithi203.stdout:0/882: dwrite d0/f8c [0,4194304] 0 2024-09-11T00:07:36.614 INFO:tasks.workunit.client.0.smithi111.stdout:7/973: creat dd/d1d/d7e/dc8/d130/f13f x:0 0 0 2024-09-11T00:07:36.617 INFO:tasks.workunit.client.0.smithi111.stdout:6/926: fsync d7/d22/d1d/d83/d121/fa6 0 2024-09-11T00:07:36.619 INFO:tasks.workunit.client.0.smithi111.stdout:4/921: mknod d18/d1f/d36/c128 0 2024-09-11T00:07:36.626 INFO:tasks.workunit.client.0.smithi111.stdout:3/971: rename d1c/d1d/d22/d44/l10b to d1c/d1d/d22/d44/d5a/d74/d7b/d148/l14c 0 2024-09-11T00:07:36.627 INFO:tasks.workunit.client.0.smithi111.stdout:3/972: readlink d1c/d126/l128 0 2024-09-11T00:07:36.630 INFO:tasks.workunit.client.0.smithi111.stdout:9/980: creat d6/dc/f145 x:0 0 0 2024-09-11T00:07:36.631 INFO:tasks.workunit.client.1.smithi203.stdout:5/913: dread dc/fc3 [0,4194304] 0 2024-09-11T00:07:36.637 INFO:tasks.workunit.client.0.smithi111.stdout:1/924: dread d2/de/d12/d3c/d4b/d6a/f3d [0,4194304] 0 2024-09-11T00:07:36.638 INFO:tasks.workunit.client.0.smithi111.stdout:5/979: dread d10/d1e/d23/d30/dd8/d7e/f88 [0,4194304] 0 2024-09-11T00:07:36.640 INFO:tasks.workunit.client.0.smithi111.stdout:4/922: fdatasync d18/d20/d40/d78/fcb 0 2024-09-11T00:07:36.647 INFO:tasks.workunit.client.0.smithi111.stdout:0/983: rename d3/d13/f68 to d3/da/d7b/db3/d11c/f14a 0 2024-09-11T00:07:36.651 INFO:tasks.workunit.client.0.smithi111.stdout:9/981: mknod d6/db/d1b/d11f/c146 0 2024-09-11T00:07:36.653 INFO:tasks.workunit.client.1.smithi203.stdout:6/851: symlink d0/d5b/l108 0 2024-09-11T00:07:36.655 INFO:tasks.workunit.client.1.smithi203.stdout:9/882: creat d6/de/d32/d52/d55/d66/daa/f11c x:0 0 0 2024-09-11T00:07:36.656 INFO:tasks.workunit.client.0.smithi111.stdout:5/980: mknod d10/d1e/d23/d2b/d92/c144 0 2024-09-11T00:07:36.660 INFO:tasks.workunit.client.0.smithi111.stdout:4/923: unlink d18/d1f/d33/c3a 0 2024-09-11T00:07:36.661 INFO:tasks.workunit.client.0.smithi111.stdout:4/924: readlink d18/d20/d40/l4d 0 2024-09-11T00:07:36.662 INFO:tasks.workunit.client.1.smithi203.stdout:4/824: creat db/d12/d15/d2a/d88/df6/f10d x:0 0 0 2024-09-11T00:07:36.663 INFO:tasks.workunit.client.0.smithi111.stdout:8/942: link d11/d23/d7e/d93/c11d d11/d23/d7e/d93/c12c 0 2024-09-11T00:07:36.665 INFO:tasks.workunit.client.1.smithi203.stdout:8/831: fsync d1/d13/d17/d48/d9d/da9/fdb 0 2024-09-11T00:07:36.668 INFO:tasks.workunit.client.1.smithi203.stdout:8/832: fsync d1/d13/d17/d2f/d9e/f103 0 2024-09-11T00:07:36.668 INFO:tasks.workunit.client.0.smithi111.stdout:2/887: write d0/d3/de/d50/d9d/ff8 [615204,46648] 0 2024-09-11T00:07:36.669 INFO:tasks.workunit.client.0.smithi111.stdout:0/984: chown d3/d13/d66/cfd 14962 1 2024-09-11T00:07:36.669 INFO:tasks.workunit.client.0.smithi111.stdout:1/925: dread d2/d77/faf [0,4194304] 0 2024-09-11T00:07:36.669 INFO:tasks.workunit.client.1.smithi203.stdout:8/833: readlink d1/d13/d43/lc9 0 2024-09-11T00:07:36.671 INFO:tasks.workunit.client.1.smithi203.stdout:2/957: rename d13/ddb/lf9 to d13/d15/d30/d5a/dcf/l141 0 2024-09-11T00:07:36.672 INFO:tasks.workunit.client.1.smithi203.stdout:9/883: dwrite d6/de/d32/d52/d55/d66/daa/f11c [0,4194304] 0 2024-09-11T00:07:36.675 INFO:tasks.workunit.client.1.smithi203.stdout:1/978: truncate d8/d9/d15/fc5 3291278 0 2024-09-11T00:07:36.677 INFO:tasks.workunit.client.1.smithi203.stdout:0/883: truncate d0/d2/d37/f38 4295253 0 2024-09-11T00:07:36.678 INFO:tasks.workunit.client.1.smithi203.stdout:1/979: truncate d8/d9/d15/ff3 5163593 0 2024-09-11T00:07:36.679 INFO:tasks.workunit.client.1.smithi203.stdout:5/914: fsync dc/dd/d1e/f29 0 2024-09-11T00:07:36.682 INFO:tasks.workunit.client.0.smithi111.stdout:4/925: creat d18/d3b/d9f/d10b/f129 x:0 0 0 2024-09-11T00:07:36.682 INFO:tasks.workunit.client.0.smithi111.stdout:1/926: dwrite d2/de/d12/d6c/f130 [0,4194304] 0 2024-09-11T00:07:36.683 INFO:tasks.workunit.client.1.smithi203.stdout:6/852: fdatasync d0/d32/d5a/fba 0 2024-09-11T00:07:36.687 INFO:tasks.workunit.client.0.smithi111.stdout:6/927: rename d7/d22/c20 to d7/d22/d3f/d74/d7f/d61/d6a/d9f/db6/c13c 0 2024-09-11T00:07:36.691 INFO:tasks.workunit.client.0.smithi111.stdout:7/974: dwrite dd/f97 [0,4194304] 0 2024-09-11T00:07:36.700 INFO:tasks.workunit.client.1.smithi203.stdout:2/958: truncate d13/d47/f86 217039 0 2024-09-11T00:07:36.703 INFO:tasks.workunit.client.0.smithi111.stdout:3/973: dwrite d1c/d21/d92/f9a [0,4194304] 0 2024-09-11T00:07:36.703 INFO:tasks.workunit.client.0.smithi111.stdout:4/926: read d18/d3b/dae/f11d [5758977,71280] 0 2024-09-11T00:07:36.704 INFO:tasks.workunit.client.1.smithi203.stdout:0/884: fdatasync d0/d2/fe6 0 2024-09-11T00:07:36.705 INFO:tasks.workunit.client.0.smithi111.stdout:4/927: chown d18/d20/d40/d78/d79/d90/d91 88784445 1 2024-09-11T00:07:36.712 INFO:tasks.workunit.client.0.smithi111.stdout:9/982: write d6/db/d34/d37/d4c/d99/f10f [3282580,24635] 0 2024-09-11T00:07:36.714 INFO:tasks.workunit.client.1.smithi203.stdout:5/915: mknod dc/dd/d1e/dc6/d103/c132 0 2024-09-11T00:07:36.716 INFO:tasks.workunit.client.0.smithi111.stdout:1/927: dread d2/d2b/dc9/dba/fcb [0,4194304] 0 2024-09-11T00:07:36.722 INFO:tasks.workunit.client.1.smithi203.stdout:6/853: truncate d0/d32/d5a/fad 1193272 0 2024-09-11T00:07:36.724 INFO:tasks.workunit.client.1.smithi203.stdout:4/825: truncate db/dd/d16/d38/fc9 126101 0 2024-09-11T00:07:36.724 INFO:tasks.workunit.client.0.smithi111.stdout:2/888: read - d0/d3/d12/d38/f12d zero size 2024-09-11T00:07:36.727 INFO:tasks.workunit.client.1.smithi203.stdout:4/826: write db/d12/d15/d2a/d88/f90 [3527724,103706] 0 2024-09-11T00:07:36.727 INFO:tasks.workunit.client.0.smithi111.stdout:9/983: dwrite d6/db/d1b/fd7 [0,4194304] 0 2024-09-11T00:07:36.734 INFO:tasks.workunit.client.0.smithi111.stdout:8/943: creat d11/d23/d3d/d5f/f12d x:0 0 0 2024-09-11T00:07:36.737 INFO:tasks.workunit.client.1.smithi203.stdout:0/885: mknod d0/d87/db9/c121 0 2024-09-11T00:07:36.740 INFO:tasks.workunit.client.0.smithi111.stdout:2/889: dwrite d0/d3/de/d68/df1/f11c [0,4194304] 0 2024-09-11T00:07:36.743 INFO:tasks.workunit.client.0.smithi111.stdout:5/981: dwrite d10/f19 [0,4194304] 0 2024-09-11T00:07:36.743 INFO:tasks.workunit.client.0.smithi111.stdout:1/928: stat d2/fd 0 2024-09-11T00:07:36.746 INFO:tasks.workunit.client.1.smithi203.stdout:6/854: fsync d0/d54/d9c/d35/d38/d73/d74/fec 0 2024-09-11T00:07:36.747 INFO:tasks.workunit.client.0.smithi111.stdout:0/985: creat d3/f14b x:0 0 0 2024-09-11T00:07:36.747 INFO:tasks.workunit.client.0.smithi111.stdout:5/982: readlink d10/d1e/d23/d30/dd8/da2/d66/d76/l79 0 2024-09-11T00:07:36.748 INFO:tasks.workunit.client.1.smithi203.stdout:8/834: link d1/d13/d17/d48/dfa/c105 d1/d13/d17/d48/d118/c11b 0 2024-09-11T00:07:36.749 INFO:tasks.workunit.client.0.smithi111.stdout:0/986: chown d3/da/d7b/db3/d11c/d12b 18143 1 2024-09-11T00:07:36.752 INFO:tasks.workunit.client.1.smithi203.stdout:9/884: link d6/de/fbd d6/de/d32/d52/d55/da2/dda/f11d 0 2024-09-11T00:07:36.752 INFO:tasks.workunit.client.0.smithi111.stdout:5/983: truncate d10/d1e/d23/d30/dd8/d63/f6f 3595009 0 2024-09-11T00:07:36.753 INFO:tasks.workunit.client.0.smithi111.stdout:6/928: dwrite d7/d2b/fae [4194304,4194304] 0 2024-09-11T00:07:36.754 INFO:tasks.workunit.client.1.smithi203.stdout:8/835: read d1/d13/f33 [1179079,29143] 0 2024-09-11T00:07:36.758 INFO:tasks.workunit.client.0.smithi111.stdout:7/975: creat dd/d49/d110/d135/f140 x:0 0 0 2024-09-11T00:07:36.761 INFO:tasks.workunit.client.0.smithi111.stdout:7/976: chown dd/d1d/d76/db6/c10a 0 1 2024-09-11T00:07:36.763 INFO:tasks.workunit.client.0.smithi111.stdout:9/984: creat d6/dc/d73/f147 x:0 0 0 2024-09-11T00:07:36.764 INFO:tasks.workunit.client.0.smithi111.stdout:7/977: stat dd/d48/d69/dbe 0 2024-09-11T00:07:36.766 INFO:tasks.workunit.client.1.smithi203.stdout:1/980: write d8/d19/d60/d90/d3e/d4b/d80/d91/dac/fd6 [3531124,47782] 0 2024-09-11T00:07:36.766 INFO:tasks.workunit.client.0.smithi111.stdout:3/974: creat d1c/d1d/d22/d23/d2f/de5/d123/f14d x:0 0 0 2024-09-11T00:07:36.770 INFO:tasks.workunit.client.0.smithi111.stdout:1/929: creat d2/de/d12/dc7/d12f/f136 x:0 0 0 2024-09-11T00:07:36.771 INFO:tasks.workunit.client.0.smithi111.stdout:5/984: dwrite d10/d1e/d23/d30/dd8/d63/f6f [0,4194304] 0 2024-09-11T00:07:36.774 INFO:tasks.workunit.client.0.smithi111.stdout:5/985: chown d10/d1e/d23/d30/d59/d7b/d82/d86/f13e 17 1 2024-09-11T00:07:36.779 INFO:tasks.workunit.client.1.smithi203.stdout:5/916: creat dc/dd/d15/d3b/d73/de8/f133 x:0 0 0 2024-09-11T00:07:36.780 INFO:tasks.workunit.client.0.smithi111.stdout:3/975: creat d1c/d21/d92/f14e x:0 0 0 2024-09-11T00:07:36.785 INFO:tasks.workunit.client.1.smithi203.stdout:2/959: dwrite d13/d15/d19/d1c/d76/f8e [4194304,4194304] 0 2024-09-11T00:07:36.786 INFO:tasks.workunit.client.1.smithi203.stdout:9/885: dwrite d6/de/d32/d52/f10e [0,4194304] 0 2024-09-11T00:07:36.787 INFO:tasks.workunit.client.0.smithi111.stdout:0/987: mknod d3/da/d7b/db3/d13e/c14c 0 2024-09-11T00:07:36.796 INFO:tasks.workunit.client.0.smithi111.stdout:6/929: mkdir d7/d106/d13d 0 2024-09-11T00:07:36.796 INFO:tasks.workunit.client.0.smithi111.stdout:8/944: dread d11/d23/d3d/f86 [0,4194304] 0 2024-09-11T00:07:36.808 INFO:tasks.workunit.client.1.smithi203.stdout:5/917: creat dc/dd/d9b/dff/f134 x:0 0 0 2024-09-11T00:07:36.810 INFO:tasks.workunit.client.0.smithi111.stdout:1/930: rename d2/de/d12/d3c/d4b/d6a/lde to d2/de/d12/d88/l137 0 2024-09-11T00:07:36.812 INFO:tasks.workunit.client.0.smithi111.stdout:5/986: symlink d10/d1e/d23/d30/dd8/da2/d66/l145 0 2024-09-11T00:07:36.813 INFO:tasks.workunit.client.1.smithi203.stdout:2/960: dwrite d13/f13a [0,4194304] 0 2024-09-11T00:07:36.813 INFO:tasks.workunit.client.0.smithi111.stdout:3/976: dread d1c/d1d/d22/d23/d2f/d63/f6b [0,4194304] 0 2024-09-11T00:07:36.815 INFO:tasks.workunit.client.0.smithi111.stdout:8/945: rename d11/d23/d7e/d93/dba/fd0 to d11/d23/d2c/d7f/f12e 0 2024-09-11T00:07:36.822 INFO:tasks.workunit.client.0.smithi111.stdout:1/931: fdatasync d2/de/f53 0 2024-09-11T00:07:36.822 INFO:tasks.workunit.client.0.smithi111.stdout:8/946: write d11/d23/d2c/f124 [1655350,65615] 0 2024-09-11T00:07:36.823 INFO:tasks.workunit.client.0.smithi111.stdout:3/977: rmdir d1c/d1d/d22/d31/d62/dc7 39 2024-09-11T00:07:36.827 INFO:tasks.workunit.client.0.smithi111.stdout:3/978: chown d1c/d1d/d86/cf8 91344974 1 2024-09-11T00:07:36.828 INFO:tasks.workunit.client.0.smithi111.stdout:7/978: dwrite dd/d48/d69/f6f [0,4194304] 0 2024-09-11T00:07:36.830 INFO:tasks.workunit.client.0.smithi111.stdout:5/987: rename d10/d1e/d23/d2b/d2f/d11f to d10/d108/d116/d146 0 2024-09-11T00:07:36.830 INFO:tasks.workunit.client.0.smithi111.stdout:9/985: write d6/db/d1b/d56/f72 [1119340,108806] 0 2024-09-11T00:07:36.831 INFO:tasks.workunit.client.1.smithi203.stdout:2/961: dread d13/d22/fbd [0,4194304] 0 2024-09-11T00:07:36.831 INFO:tasks.workunit.client.1.smithi203.stdout:6/855: dwrite d0/d54/d9c/f18 [4194304,4194304] 0 2024-09-11T00:07:36.833 INFO:tasks.workunit.client.0.smithi111.stdout:2/890: dwrite d0/d3/de/d4b/f12a [0,4194304] 0 2024-09-11T00:07:36.833 INFO:tasks.workunit.client.0.smithi111.stdout:3/979: write d1c/d1d/d22/d44/d5a/d74/f110 [2614432,43603] 0 2024-09-11T00:07:36.835 INFO:tasks.workunit.client.1.smithi203.stdout:4/827: rename db/dd/d16/d38/d3c/da6/l108 to db/d12/d15/d2a/l10e 0 2024-09-11T00:07:36.837 INFO:tasks.workunit.client.1.smithi203.stdout:0/886: getdents d0/d1d/d4c 0 2024-09-11T00:07:36.838 INFO:tasks.workunit.client.1.smithi203.stdout:9/886: link d6/de/d19/d24/f36 d6/de/d32/d52/d55/d66/daa/f11e 0 2024-09-11T00:07:36.843 INFO:tasks.workunit.client.1.smithi203.stdout:8/836: dwrite d1/d13/d17/d81/d97/f106 [0,4194304] 0 2024-09-11T00:07:36.852 INFO:tasks.workunit.client.0.smithi111.stdout:8/947: rename d11/d23/d3d/d5f/d99/d10c to d11/d23/d7e/d93/dba/d12f 0 2024-09-11T00:07:36.857 INFO:tasks.workunit.client.1.smithi203.stdout:1/981: write d8/d19/d60/d90/d3e/d4b/d80/d8d/da3/d12a/f4f [3349179,45878] 0 2024-09-11T00:07:36.858 INFO:tasks.workunit.client.1.smithi203.stdout:4/828: rename db/dd/d16/d38/d3c/f68 to db/dd/d26/dcd/dfb/f10f 0 2024-09-11T00:07:36.860 INFO:tasks.workunit.client.0.smithi111.stdout:7/979: mknod dd/d1d/d7e/df8/dad/c141 0 2024-09-11T00:07:36.861 INFO:tasks.workunit.client.1.smithi203.stdout:0/887: mkdir d0/d2/d7e/da1/dc9/d122 0 2024-09-11T00:07:36.861 INFO:tasks.workunit.client.0.smithi111.stdout:2/891: mkdir d0/d3/de/d50/dda/d132 0 2024-09-11T00:07:36.861 INFO:tasks.workunit.client.0.smithi111.stdout:4/928: sync 2024-09-11T00:07:36.863 INFO:tasks.workunit.client.0.smithi111.stdout:9/986: fsync d6/db/d34/f47 0 2024-09-11T00:07:36.865 INFO:tasks.workunit.client.0.smithi111.stdout:9/987: chown d6/db/d1b/d11f/d115 108112 1 2024-09-11T00:07:36.866 INFO:tasks.workunit.client.1.smithi203.stdout:0/888: write d0/d2/d37/f4b [4690495,63465] 0 2024-09-11T00:07:36.867 INFO:tasks.workunit.client.0.smithi111.stdout:1/932: creat d2/de/d105/d135/f138 x:0 0 0 2024-09-11T00:07:36.869 INFO:tasks.workunit.client.1.smithi203.stdout:8/837: creat d1/d78/df4/f11c x:0 0 0 2024-09-11T00:07:36.870 INFO:tasks.workunit.client.0.smithi111.stdout:8/948: rename d11/d23/d2c/c9f to d11/d23/d3d/dca/dcf/dc3/c130 0 2024-09-11T00:07:36.873 INFO:tasks.workunit.client.0.smithi111.stdout:7/980: unlink dd/d1d/d4d/c74 0 2024-09-11T00:07:36.875 INFO:tasks.workunit.client.1.smithi203.stdout:0/889: symlink d0/d2/d7e/da1/df5/l123 0 2024-09-11T00:07:36.878 INFO:tasks.workunit.client.1.smithi203.stdout:0/890: write d0/dc5/ff1 [467279,127345] 0 2024-09-11T00:07:36.883 INFO:tasks.workunit.client.1.smithi203.stdout:0/891: mknod d0/d1d/d4c/c124 0 2024-09-11T00:07:36.884 INFO:tasks.workunit.client.0.smithi111.stdout:8/949: dwrite d11/d23/d2c/feb [0,4194304] 0 2024-09-11T00:07:36.888 INFO:tasks.workunit.client.1.smithi203.stdout:0/892: mknod d0/d87/db9/c125 0 2024-09-11T00:07:36.891 INFO:tasks.workunit.client.0.smithi111.stdout:0/988: sync 2024-09-11T00:07:36.892 INFO:tasks.workunit.client.0.smithi111.stdout:5/988: link d10/d1e/d23/d30/d59/d52/c133 d10/d108/d116/c147 0 2024-09-11T00:07:36.896 INFO:tasks.workunit.client.0.smithi111.stdout:5/989: stat d10/d1e/d23/d2b/dad/c12d 0 2024-09-11T00:07:36.897 INFO:tasks.workunit.client.1.smithi203.stdout:2/962: dread d13/d56/d69/dcb/fe1 [0,4194304] 0 2024-09-11T00:07:36.897 INFO:tasks.workunit.client.1.smithi203.stdout:5/918: dwrite dc/dd/d15/d3b/d7a/f90 [0,4194304] 0 2024-09-11T00:07:36.898 INFO:tasks.workunit.client.0.smithi111.stdout:2/892: dread d0/d3/de/d3b/d62/f78 [0,4194304] 0 2024-09-11T00:07:36.903 INFO:tasks.workunit.client.0.smithi111.stdout:1/933: link d2/de/d12/d3c/d4b/d6a/d63/d73/da1/f42 d2/de/d12/d88/d134/f139 0 2024-09-11T00:07:36.903 INFO:tasks.workunit.client.1.smithi203.stdout:2/963: write d13/d15/d19/d1c/d73/f81 [3834159,72475] 0 2024-09-11T00:07:36.906 INFO:tasks.workunit.client.1.smithi203.stdout:2/964: stat d13/d15/d30/d59 0 2024-09-11T00:07:36.906 INFO:tasks.workunit.client.0.smithi111.stdout:4/929: getdents d18/d20/d4a/d6b 0 2024-09-11T00:07:36.907 INFO:tasks.workunit.client.1.smithi203.stdout:5/919: chown dc/d4f/d5c/dc9/fe2 437 1 2024-09-11T00:07:36.910 INFO:tasks.workunit.client.0.smithi111.stdout:5/990: truncate d10/f6b 271521 0 2024-09-11T00:07:36.912 INFO:tasks.workunit.client.0.smithi111.stdout:8/950: rename d11/d23/d2c/d53/c5d to d11/d21/d6f/c131 0 2024-09-11T00:07:36.915 INFO:tasks.workunit.client.0.smithi111.stdout:2/893: creat d0/d3/de/db4/f133 x:0 0 0 2024-09-11T00:07:36.916 INFO:tasks.workunit.client.0.smithi111.stdout:0/989: truncate d3/daf/ff1 2820820 0 2024-09-11T00:07:36.919 INFO:tasks.workunit.client.0.smithi111.stdout:3/980: write d1c/d1d/d22/d44/f6f [4883106,55599] 0 2024-09-11T00:07:36.921 INFO:tasks.workunit.client.0.smithi111.stdout:4/930: dread - d18/d20/d3c/d5e/daa/dbb/ddc/fea zero size 2024-09-11T00:07:36.921 INFO:tasks.workunit.client.0.smithi111.stdout:6/930: sync 2024-09-11T00:07:36.922 INFO:tasks.workunit.client.1.smithi203.stdout:4/829: write db/f23 [664582,117421] 0 2024-09-11T00:07:36.923 INFO:tasks.workunit.client.1.smithi203.stdout:9/887: dwrite d6/de/f85 [0,4194304] 0 2024-09-11T00:07:36.926 INFO:tasks.workunit.client.0.smithi111.stdout:1/934: mknod d2/de/d12/d3c/d4b/d6a/d3a/c13a 0 2024-09-11T00:07:36.930 INFO:tasks.workunit.client.0.smithi111.stdout:2/894: rename d0/d3/d2e/ded/dd8/ldf to d0/d3/de/d3b/d97/l134 0 2024-09-11T00:07:36.933 INFO:tasks.workunit.client.1.smithi203.stdout:5/920: dwrite dc/dd/d15/f11c [0,4194304] 0 2024-09-11T00:07:36.936 INFO:tasks.workunit.client.0.smithi111.stdout:0/990: creat d3/d1c/d147/d93/d102/f14d x:0 0 0 2024-09-11T00:07:36.937 INFO:tasks.workunit.client.1.smithi203.stdout:9/888: fsync d6/de/d19/d24/f27 0 2024-09-11T00:07:36.938 INFO:tasks.workunit.client.0.smithi111.stdout:0/991: chown d3/d13/f5a 87935056 1 2024-09-11T00:07:36.945 INFO:tasks.workunit.client.0.smithi111.stdout:7/981: write dd/d1d/d2d/d2e/f7a [354306,99726] 0 2024-09-11T00:07:36.946 INFO:tasks.workunit.client.1.smithi203.stdout:4/830: symlink db/dd/d16/ded/db5/l110 0 2024-09-11T00:07:36.946 INFO:tasks.workunit.client.1.smithi203.stdout:5/921: dread dc/d4f/d5c/d76/f111 [0,4194304] 0 2024-09-11T00:07:36.947 INFO:tasks.workunit.client.0.smithi111.stdout:7/982: fdatasync dd/d1d/d1f/d24/dd2/f132 0 2024-09-11T00:07:36.948 INFO:tasks.workunit.client.0.smithi111.stdout:4/931: truncate d18/d20/d40/d78/fd7 2632927 0 2024-09-11T00:07:36.948 INFO:tasks.workunit.client.0.smithi111.stdout:9/988: truncate d6/dc/d73/fd8 201708 0 2024-09-11T00:07:36.949 INFO:tasks.workunit.client.1.smithi203.stdout:4/831: chown db/dd/d26/f77 2654022 1 2024-09-11T00:07:36.949 INFO:tasks.workunit.client.0.smithi111.stdout:7/983: chown dd/d48/d69/dea/d131 3666 1 2024-09-11T00:07:36.952 INFO:tasks.workunit.client.0.smithi111.stdout:4/932: truncate d18/d1f/d36/d95/dda/f11c 193562 0 2024-09-11T00:07:36.952 INFO:tasks.workunit.client.1.smithi203.stdout:0/893: write d0/d2/d37/d5b/d73/fbf [2316447,45453] 0 2024-09-11T00:07:36.953 INFO:tasks.workunit.client.0.smithi111.stdout:3/981: rename d1c/d1d/d22/le7 to d1c/d21/d145/l14f 0 2024-09-11T00:07:36.956 INFO:tasks.workunit.client.1.smithi203.stdout:0/894: write d0/d2/d7e/da1/df5/f115 [1046463,9768] 0 2024-09-11T00:07:36.958 INFO:tasks.workunit.client.1.smithi203.stdout:0/895: chown d0/d2/d37/lf2 221624 1 2024-09-11T00:07:36.958 INFO:tasks.workunit.client.0.smithi111.stdout:8/951: dread d11/d23/d3d/f94 [0,4194304] 0 2024-09-11T00:07:36.960 INFO:tasks.workunit.client.0.smithi111.stdout:7/984: mkdir dd/da6/d142 0 2024-09-11T00:07:36.962 INFO:tasks.workunit.client.1.smithi203.stdout:0/896: read d0/dc5/ff1 [611017,60239] 0 2024-09-11T00:07:36.965 INFO:tasks.workunit.client.1.smithi203.stdout:9/889: dread d6/de/d19/d24/d54/f9d [0,4194304] 0 2024-09-11T00:07:36.969 INFO:tasks.workunit.client.1.smithi203.stdout:2/965: dread d13/d15/f1b [0,4194304] 0 2024-09-11T00:07:36.969 INFO:tasks.workunit.client.1.smithi203.stdout:5/922: dread dc/dd/f28 [0,4194304] 0 2024-09-11T00:07:36.969 INFO:tasks.workunit.client.0.smithi111.stdout:1/935: rename d2/de/d12/d3c/d4b/fc8 to d2/de/d12/dc7/f13b 0 2024-09-11T00:07:36.969 INFO:tasks.workunit.client.0.smithi111.stdout:0/992: link d3/d1c/d147/fca d3/dc/f14e 0 2024-09-11T00:07:36.970 INFO:tasks.workunit.client.1.smithi203.stdout:9/890: chown d6/de/d19/d24/d6c/da8/cbe 366 1 2024-09-11T00:07:36.972 INFO:tasks.workunit.client.0.smithi111.stdout:5/991: dread d10/d1e/d25/f4a [4194304,4194304] 0 2024-09-11T00:07:36.976 INFO:tasks.workunit.client.1.smithi203.stdout:5/923: read dc/dd/d13/f12e [2645491,41842] 0 2024-09-11T00:07:36.978 INFO:tasks.workunit.client.0.smithi111.stdout:6/931: write d7/d22/d2c/d38/d39/ff9 [659493,106835] 0 2024-09-11T00:07:36.981 INFO:tasks.workunit.client.0.smithi111.stdout:6/932: write d7/d22/d2c/d38/f71 [3636011,117840] 0 2024-09-11T00:07:36.985 INFO:tasks.workunit.client.0.smithi111.stdout:9/989: rename d6/d52/d8a/d8e/d120 to d6/db/d1b/d56/dc8/d129/d148 0 2024-09-11T00:07:36.987 INFO:tasks.workunit.client.1.smithi203.stdout:5/924: creat dc/dd/d56/f135 x:0 0 0 2024-09-11T00:07:36.990 INFO:tasks.workunit.client.1.smithi203.stdout:2/966: unlink d13/d47/cc3 0 2024-09-11T00:07:36.992 INFO:tasks.workunit.client.1.smithi203.stdout:9/891: mknod d6/de/d19/d24/d40/d45/c11f 0 2024-09-11T00:07:36.995 INFO:tasks.workunit.client.0.smithi111.stdout:7/985: mkdir dd/d1d/d143 0 2024-09-11T00:07:36.999 INFO:tasks.workunit.client.0.smithi111.stdout:4/933: dwrite d18/d3b/d61/f7c [0,4194304] 0 2024-09-11T00:07:37.001 INFO:tasks.workunit.client.0.smithi111.stdout:3/982: link d1c/d1d/d22/d23/d2f/de8/l65 d1c/d1d/d22/d23/d58/df2/l150 0 2024-09-11T00:07:37.008 INFO:tasks.workunit.client.0.smithi111.stdout:6/933: fdatasync d7/d22/d3f/d74/d7f/d79/f11b 0 2024-09-11T00:07:37.010 INFO:tasks.workunit.client.0.smithi111.stdout:6/934: write d7/d22/d2c/d38/f71 [898544,43101] 0 2024-09-11T00:07:37.011 INFO:tasks.workunit.client.1.smithi203.stdout:0/897: write d0/d2/d7e/da1/fe1 [878030,21030] 0 2024-09-11T00:07:37.021 INFO:tasks.workunit.client.0.smithi111.stdout:0/993: truncate d3/d13/fdd 532269 0 2024-09-11T00:07:37.021 INFO:tasks.workunit.client.0.smithi111.stdout:1/936: mkdir d2/de/d12/d6c/d13c 0 2024-09-11T00:07:37.023 INFO:tasks.workunit.client.1.smithi203.stdout:2/967: link d13/d15/f65 d13/d15/d19/d1c/d73/dc4/f142 0 2024-09-11T00:07:37.024 INFO:tasks.workunit.client.1.smithi203.stdout:5/925: write dc/dd/d9b/dae/fb3 [2565184,19587] 0 2024-09-11T00:07:37.024 INFO:tasks.workunit.client.0.smithi111.stdout:8/952: link d11/d23/d3d/d5f/fe0 d11/d23/d2c/f132 0 2024-09-11T00:07:37.026 INFO:tasks.workunit.client.1.smithi203.stdout:5/926: write dc/dd/d1e/f27 [67252,81460] 0 2024-09-11T00:07:37.027 INFO:tasks.workunit.client.0.smithi111.stdout:4/934: mkdir d18/d20/d4a/df9/d12a 0 2024-09-11T00:07:37.028 INFO:tasks.workunit.client.1.smithi203.stdout:5/927: stat dc/dd/d15/dbd/d59 0 2024-09-11T00:07:37.029 INFO:tasks.workunit.client.0.smithi111.stdout:3/983: read - d1c/d21/db4/ffc zero size 2024-09-11T00:07:37.029 INFO:tasks.workunit.client.0.smithi111.stdout:5/992: dwrite d10/d1e/d23/d30/d59/d7b/fc8 [0,4194304] 0 2024-09-11T00:07:37.031 INFO:tasks.workunit.client.0.smithi111.stdout:3/984: readlink d1c/d1d/d22/d31/lec 0 2024-09-11T00:07:37.031 INFO:tasks.workunit.client.0.smithi111.stdout:5/993: readlink d10/d1e/d23/d2b/d5c/l91 0 2024-09-11T00:07:37.033 INFO:tasks.workunit.client.0.smithi111.stdout:0/994: mknod d3/d1c/d50/dec/d118/c14f 0 2024-09-11T00:07:37.035 INFO:tasks.workunit.client.1.smithi203.stdout:5/928: readlink dc/dd/d15/l10f 0 2024-09-11T00:07:37.035 INFO:tasks.workunit.client.1.smithi203.stdout:0/898: dwrite d0/d1d/d5d/f11c [0,4194304] 0 2024-09-11T00:07:37.037 INFO:tasks.workunit.client.0.smithi111.stdout:3/985: read d1c/f147 [1355199,9796] 0 2024-09-11T00:07:37.037 INFO:tasks.workunit.client.0.smithi111.stdout:0/995: read d3/d26/d77/f82 [535684,1873] 0 2024-09-11T00:07:37.040 INFO:tasks.workunit.client.0.smithi111.stdout:1/937: symlink d2/de/d105/l13d 0 2024-09-11T00:07:37.042 INFO:tasks.workunit.client.1.smithi203.stdout:9/892: dwrite d6/de/d47/de1/dec/fee [0,4194304] 0 2024-09-11T00:07:37.049 INFO:tasks.workunit.client.1.smithi203.stdout:5/929: unlink dc/dd/d9b/cc5 0 2024-09-11T00:07:37.049 INFO:tasks.workunit.client.0.smithi111.stdout:2/895: sync 2024-09-11T00:07:37.053 INFO:tasks.workunit.client.0.smithi111.stdout:8/953: write d11/d23/d2c/d46/f4d [12879092,39187] 0 2024-09-11T00:07:37.057 INFO:tasks.workunit.client.1.smithi203.stdout:0/899: rename d0/d2/d7e/da1/df5/cf4 to d0/d87/c126 0 2024-09-11T00:07:37.059 INFO:tasks.workunit.client.0.smithi111.stdout:6/935: creat d7/d22/d1d/d83/d121/d41/d77/d128/f13e x:0 0 0 2024-09-11T00:07:37.060 INFO:tasks.workunit.client.0.smithi111.stdout:5/994: fdatasync d10/d1e/f28 0 2024-09-11T00:07:37.060 INFO:tasks.workunit.client.1.smithi203.stdout:2/968: write d13/d47/fc7 [2663714,3486] 0 2024-09-11T00:07:37.061 INFO:tasks.workunit.client.0.smithi111.stdout:8/954: read d11/d23/d2c/d53/f55 [3364470,82103] 0 2024-09-11T00:07:37.067 INFO:tasks.workunit.client.0.smithi111.stdout:0/996: creat d3/d13/d1e/d29/f150 x:0 0 0 2024-09-11T00:07:37.067 INFO:tasks.workunit.client.0.smithi111.stdout:1/938: read - d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/fdb zero size 2024-09-11T00:07:37.070 INFO:tasks.workunit.client.1.smithi203.stdout:2/969: creat d13/d56/d69/f143 x:0 0 0 2024-09-11T00:07:37.071 INFO:tasks.workunit.client.1.smithi203.stdout:9/893: link d6/de/f74 d6/de/d32/d9e/f120 0 2024-09-11T00:07:37.074 INFO:tasks.workunit.client.0.smithi111.stdout:9/990: getdents d6/db/d34 0 2024-09-11T00:07:37.075 INFO:tasks.workunit.client.1.smithi203.stdout:0/900: getdents d0/d2/d37/d5b/d73/db6 0 2024-09-11T00:07:37.076 INFO:tasks.workunit.client.0.smithi111.stdout:9/991: chown d6/ddd/c106 1628 1 2024-09-11T00:07:37.077 INFO:tasks.workunit.client.0.smithi111.stdout:5/995: mkdir d10/d1e/d23/d2b/d5c/d61/d148 0 2024-09-11T00:07:37.078 INFO:tasks.workunit.client.1.smithi203.stdout:9/894: mknod d6/de/d47/de1/dec/df8/def/c121 0 2024-09-11T00:07:37.085 INFO:tasks.workunit.client.0.smithi111.stdout:0/997: symlink d3/da/d7b/db3/d11c/d12b/l151 0 2024-09-11T00:07:37.085 INFO:tasks.workunit.client.1.smithi203.stdout:5/930: write dc/d4f/d5c/d76/f78 [417736,79400] 0 2024-09-11T00:07:37.087 INFO:tasks.workunit.client.1.smithi203.stdout:5/931: chown dc/dd/d56/dad 10 1 2024-09-11T00:07:37.087 INFO:tasks.workunit.client.1.smithi203.stdout:9/895: symlink d6/de/d32/d52/d55/l122 0 2024-09-11T00:07:37.088 INFO:tasks.workunit.client.0.smithi111.stdout:4/935: truncate d18/d20/d40/d78/fd3 440676 0 2024-09-11T00:07:37.094 INFO:tasks.workunit.client.0.smithi111.stdout:6/936: write d7/d22/d2c/d38/d56/faf [246596,10776] 0 2024-09-11T00:07:37.095 INFO:tasks.workunit.client.0.smithi111.stdout:3/986: dwrite d1c/d1d/d22/d23/d2f/d63/f81 [0,4194304] 0 2024-09-11T00:07:37.098 INFO:tasks.workunit.client.1.smithi203.stdout:9/896: creat d6/de/d19/d24/d54/db2/de2/d10c/f123 x:0 0 0 2024-09-11T00:07:37.100 INFO:tasks.workunit.client.1.smithi203.stdout:0/901: write d0/d2/d67/f93 [634310,23298] 0 2024-09-11T00:07:37.100 INFO:tasks.workunit.client.0.smithi111.stdout:2/896: dwrite d0/d3/f36 [0,4194304] 0 2024-09-11T00:07:37.109 INFO:tasks.workunit.client.0.smithi111.stdout:1/939: link d2/d2b/dc9/c12b d2/de/d12/dc7/d12f/c13e 0 2024-09-11T00:07:37.112 INFO:tasks.workunit.client.0.smithi111.stdout:8/955: dwrite d11/d23/d2c/f103 [0,4194304] 0 2024-09-11T00:07:37.113 INFO:tasks.workunit.client.1.smithi203.stdout:5/932: write dc/dd/f3d [945387,102429] 0 2024-09-11T00:07:37.113 INFO:tasks.workunit.client.0.smithi111.stdout:3/987: truncate d1c/d1d/d22/d23/dff/f122 694599 0 2024-09-11T00:07:37.119 INFO:tasks.workunit.client.1.smithi203.stdout:0/902: mkdir d0/d1d/d5d/dec/df7/d127 0 2024-09-11T00:07:37.122 INFO:tasks.workunit.client.1.smithi203.stdout:0/903: chown d0/d2/d7e/da1/dc9/de7/d11e/ffe 38 1 2024-09-11T00:07:37.123 INFO:tasks.workunit.client.0.smithi111.stdout:2/897: read d0/d3/fb8 [1863169,110456] 0 2024-09-11T00:07:37.123 INFO:tasks.workunit.client.0.smithi111.stdout:4/936: write d18/d20/d3c/d5e/daa/dbb/ddc/fea [434029,4853] 0 2024-09-11T00:07:37.125 INFO:tasks.workunit.client.1.smithi203.stdout:5/933: rmdir dc/dd 39 2024-09-11T00:07:37.126 INFO:tasks.workunit.client.0.smithi111.stdout:1/940: fdatasync d2/fda 0 2024-09-11T00:07:37.127 INFO:tasks.workunit.client.0.smithi111.stdout:8/956: stat d11/d23/d2c/d53/cf0 0 2024-09-11T00:07:37.127 INFO:tasks.workunit.client.0.smithi111.stdout:9/992: dwrite d6/db/f49 [0,4194304] 0 2024-09-11T00:07:37.129 INFO:tasks.workunit.client.0.smithi111.stdout:0/998: dwrite d3/f7 [0,4194304] 0 2024-09-11T00:07:37.133 INFO:tasks.workunit.client.0.smithi111.stdout:7/986: sync 2024-09-11T00:07:37.138 INFO:tasks.workunit.client.1.smithi203.stdout:9/897: dread d6/de/d19/d21/d87/f90 [0,4194304] 0 2024-09-11T00:07:37.144 INFO:tasks.workunit.client.1.smithi203.stdout:9/898: mknod d6/de/d47/de1/dec/c124 0 2024-09-11T00:07:37.148 INFO:tasks.workunit.client.1.smithi203.stdout:9/899: symlink d6/de/d47/de1/dec/df8/def/l125 0 2024-09-11T00:07:37.154 INFO:tasks.workunit.client.0.smithi111.stdout:3/988: symlink d1c/d1d/d22/d23/d58/d5c/l151 0 2024-09-11T00:07:37.155 INFO:tasks.workunit.client.0.smithi111.stdout:8/957: rmdir d11/d23/d2c/d7f 39 2024-09-11T00:07:37.157 INFO:tasks.workunit.client.0.smithi111.stdout:9/993: mknod d6/d52/d8a/d137/c149 0 2024-09-11T00:07:37.159 INFO:tasks.workunit.client.0.smithi111.stdout:4/937: getdents d18/d3b/d51/dbd 0 2024-09-11T00:07:37.160 INFO:tasks.workunit.client.0.smithi111.stdout:9/994: write d6/dc/f145 [822141,118342] 0 2024-09-11T00:07:37.162 INFO:tasks.workunit.client.0.smithi111.stdout:3/989: unlink d1c/d1d/d22/d44/d5a/fe4 0 2024-09-11T00:07:37.163 INFO:tasks.workunit.client.0.smithi111.stdout:8/958: mknod d11/d21/d6f/c133 0 2024-09-11T00:07:37.164 INFO:tasks.workunit.client.0.smithi111.stdout:1/941: dread d2/d2b/f10a [0,4194304] 0 2024-09-11T00:07:37.166 INFO:tasks.workunit.client.0.smithi111.stdout:4/938: creat d18/d1f/d36/f12b x:0 0 0 2024-09-11T00:07:37.170 INFO:tasks.workunit.client.0.smithi111.stdout:0/999: mknod d3/d13/d1e/d29/db0/c152 0 2024-09-11T00:07:37.171 INFO:tasks.workunit.client.0.smithi111.stdout:8/959: creat d11/d21/d6f/f134 x:0 0 0 2024-09-11T00:07:37.174 INFO:tasks.workunit.client.0.smithi111.stdout:4/939: creat d18/d3b/d51/f12c x:0 0 0 2024-09-11T00:07:37.175 INFO:tasks.workunit.client.0.smithi111.stdout:1/942: creat d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/d132/f13f x:0 0 0 2024-09-11T00:07:37.188 INFO:tasks.workunit.client.0.smithi111.stdout:3/990: write d1c/d21/db4/ffc [239932,100821] 0 2024-09-11T00:07:37.199 INFO:tasks.workunit.client.0.smithi111.stdout:7/987: dwrite f7 [0,4194304] 0 2024-09-11T00:07:37.201 INFO:tasks.workunit.client.0.smithi111.stdout:9/995: dwrite d6/db/d34/d37/d4c/d99/fea [0,4194304] 0 2024-09-11T00:07:37.204 INFO:tasks.workunit.client.0.smithi111.stdout:4/940: dwrite d18/d1f/d36/f116 [0,4194304] 0 2024-09-11T00:07:37.205 INFO:tasks.workunit.client.0.smithi111.stdout:8/960: dread d11/d23/d3d/fb2 [0,4194304] 0 2024-09-11T00:07:37.205 INFO:tasks.workunit.client.0.smithi111.stdout:1/943: dwrite d2/de/d12/d3c/d4b/d6a/d63/d73/da1/fc2 [0,4194304] 0 2024-09-11T00:07:37.206 INFO:tasks.workunit.client.0.smithi111.stdout:9/996: chown d6/db/d34/d37/d4c/d99/cf3 6 1 2024-09-11T00:07:37.213 INFO:tasks.workunit.client.0.smithi111.stdout:5/996: sync 2024-09-11T00:07:37.216 INFO:tasks.workunit.client.0.smithi111.stdout:5/997: chown d10/d1e/d23/d2b/d92/f125 38 1 2024-09-11T00:07:37.281 INFO:tasks.workunit.client.0.smithi111.stdout:6/937: sync 2024-09-11T00:07:37.282 INFO:tasks.workunit.client.0.smithi111.stdout:2/898: sync 2024-09-11T00:07:37.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:36 smithi203 ceph-mon[33225]: pgmap v16: 65 pgs: 65 active+clean; 3.4 GiB data, 9.9 GiB used, 526 GiB / 536 GiB avail; 68 MiB/s rd, 170 MiB/s wr, 371 op/s 2024-09-11T00:07:37.393 INFO:tasks.workunit.client.0.smithi111.stdout:4/941: sync 2024-09-11T00:07:37.393 INFO:tasks.workunit.client.0.smithi111.stdout:9/997: sync 2024-09-11T00:07:37.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:36 smithi111 ceph-mon[27539]: pgmap v16: 65 pgs: 65 active+clean; 3.4 GiB data, 9.9 GiB used, 526 GiB / 536 GiB avail; 68 MiB/s rd, 170 MiB/s wr, 371 op/s 2024-09-11T00:07:37.413 INFO:tasks.workunit.client.0.smithi111.stdout:7/988: read - dd/d1d/d76/db6/f10e zero size 2024-09-11T00:07:37.418 INFO:tasks.workunit.client.0.smithi111.stdout:6/938: mkdir d7/d22/d1d/d109/d13f 0 2024-09-11T00:07:37.418 INFO:tasks.workunit.client.0.smithi111.stdout:2/899: sync 2024-09-11T00:07:37.418 INFO:tasks.workunit.client.0.smithi111.stdout:9/998: rmdir d6/db/d1b/d56/dc8/d129 39 2024-09-11T00:07:37.419 INFO:tasks.workunit.client.0.smithi111.stdout:1/944: write d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/d7b/fd6 [465232,117064] 0 2024-09-11T00:07:37.420 INFO:tasks.workunit.client.0.smithi111.stdout:3/991: symlink d1c/d1d/d22/d23/d58/l152 0 2024-09-11T00:07:37.421 INFO:tasks.workunit.client.0.smithi111.stdout:1/945: stat d2/de/d12/fa3 0 2024-09-11T00:07:37.424 INFO:tasks.workunit.client.0.smithi111.stdout:9/999: symlink d6/dc/dc1/l14a 0 2024-09-11T00:07:37.431 INFO:tasks.workunit.client.0.smithi111.stdout:4/942: rename d18/d1f/d36/d95/dda/le4 to d18/d1f/l12d 0 2024-09-11T00:07:37.434 INFO:tasks.workunit.client.0.smithi111.stdout:8/961: truncate d11/d23/d2c/f103 155601 0 2024-09-11T00:07:37.434 INFO:tasks.workunit.client.0.smithi111.stdout:5/998: dwrite d10/d1e/d23/d30/d59/d7b/d82/f117 [0,4194304] 0 2024-09-11T00:07:37.434 INFO:tasks.workunit.client.0.smithi111.stdout:1/946: symlink d2/de/d12/dc7/d12f/d129/l140 0 2024-09-11T00:07:37.437 INFO:tasks.workunit.client.0.smithi111.stdout:8/962: chown d11/d23/d7e/d93/fcd 9413 1 2024-09-11T00:07:37.440 INFO:tasks.workunit.client.0.smithi111.stdout:4/943: dread - d18/d20/d3c/d5e/daa/dbb/ddc/f10e zero size 2024-09-11T00:07:37.448 INFO:tasks.workunit.client.0.smithi111.stdout:6/939: dwrite d7/d22/d1d/d83/d121/d41/d77/f98 [0,4194304] 0 2024-09-11T00:07:37.455 INFO:tasks.workunit.client.0.smithi111.stdout:8/963: truncate d11/d23/d2c/f45 7386714 0 2024-09-11T00:07:37.455 INFO:tasks.workunit.client.0.smithi111.stdout:2/900: dwrite d0/d3/de/dd4/f107 [0,4194304] 0 2024-09-11T00:07:37.458 INFO:tasks.workunit.client.0.smithi111.stdout:7/989: dwrite dd/d1d/d7e/df8/dad/ff2 [0,4194304] 0 2024-09-11T00:07:37.458 INFO:tasks.workunit.client.0.smithi111.stdout:3/992: dwrite d1c/d1d/d22/d23/d58/df2/f102 [0,4194304] 0 2024-09-11T00:07:37.466 INFO:tasks.workunit.client.0.smithi111.stdout:8/964: mkdir d11/d23/d3d/d10b/d135 0 2024-09-11T00:07:37.468 INFO:tasks.workunit.client.0.smithi111.stdout:7/990: fsync dd/d48/fd0 0 2024-09-11T00:07:37.473 INFO:tasks.workunit.client.0.smithi111.stdout:8/965: mknod d11/d23/d3d/dfa/c136 0 2024-09-11T00:07:37.477 INFO:tasks.workunit.client.0.smithi111.stdout:2/901: mknod d0/d3/de/d3b/d97/d104/c135 0 2024-09-11T00:07:37.477 INFO:tasks.workunit.client.0.smithi111.stdout:8/966: chown d11/d23/d2c/d46/d81/dd2/fda 27069 1 2024-09-11T00:07:37.479 INFO:tasks.workunit.client.0.smithi111.stdout:2/902: chown d0/d3/de/d50/dda/d132 0 1 2024-09-11T00:07:37.480 INFO:tasks.workunit.client.0.smithi111.stdout:7/991: mkdir dd/d1d/d7e/df8/d8f/d144 0 2024-09-11T00:07:37.480 INFO:tasks.workunit.client.0.smithi111.stdout:1/947: write d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/d7b/d87/f94 [2986239,17099] 0 2024-09-11T00:07:37.482 INFO:tasks.workunit.client.0.smithi111.stdout:8/967: write d11/d23/d3d/d5f/f12d [203776,58707] 0 2024-09-11T00:07:37.489 INFO:tasks.workunit.client.0.smithi111.stdout:7/992: creat dd/d1d/d76/db6/d12c/f145 x:0 0 0 2024-09-11T00:07:37.490 INFO:tasks.workunit.client.0.smithi111.stdout:1/948: creat d2/de/d12/d3c/f141 x:0 0 0 2024-09-11T00:07:37.494 INFO:tasks.workunit.client.0.smithi111.stdout:1/949: dread - d2/d77/ff7 zero size 2024-09-11T00:07:37.499 INFO:tasks.workunit.client.0.smithi111.stdout:8/968: write d11/f1b [3553027,105180] 0 2024-09-11T00:07:37.502 INFO:tasks.workunit.client.0.smithi111.stdout:6/940: dwrite d7/d22/d2c/d38/d39/fc9 [0,4194304] 0 2024-09-11T00:07:37.502 INFO:tasks.workunit.client.0.smithi111.stdout:5/999: sync 2024-09-11T00:07:37.503 INFO:tasks.workunit.client.0.smithi111.stdout:4/944: dread d18/d20/d4a/fc1 [0,4194304] 0 2024-09-11T00:07:37.507 INFO:tasks.workunit.client.0.smithi111.stdout:8/969: chown d11/d23/d2c/f45 13 1 2024-09-11T00:07:37.512 INFO:tasks.workunit.client.0.smithi111.stdout:1/950: write d2/de/d12/d3c/d4b/d6a/d63/d95/fdf [1373230,48503] 0 2024-09-11T00:07:37.512 INFO:tasks.workunit.client.0.smithi111.stdout:3/993: dwrite d1c/d1d/fde [0,4194304] 0 2024-09-11T00:07:37.515 INFO:tasks.workunit.client.0.smithi111.stdout:7/993: dwrite fa [0,4194304] 0 2024-09-11T00:07:37.519 INFO:tasks.workunit.client.0.smithi111.stdout:2/903: dwrite d0/d3/d12/d52/d6c/fd0 [0,4194304] 0 2024-09-11T00:07:37.527 INFO:tasks.workunit.client.0.smithi111.stdout:2/904: creat d0/d3/de/d10e/f136 x:0 0 0 2024-09-11T00:07:37.532 INFO:tasks.workunit.client.0.smithi111.stdout:6/941: dwrite d7/d22/d3f/d74/d7f/d79/da4/fb9 [4194304,4194304] 0 2024-09-11T00:07:37.533 INFO:tasks.workunit.client.0.smithi111.stdout:8/970: rename d11/d23/d2c/d7f/fad to d11/d23/df2/f137 0 2024-09-11T00:07:37.535 INFO:tasks.workunit.client.0.smithi111.stdout:7/994: truncate dd/d1d/d1f/f65 598596 0 2024-09-11T00:07:37.536 INFO:tasks.workunit.client.0.smithi111.stdout:2/905: creat d0/d3/de/d4b/f137 x:0 0 0 2024-09-11T00:07:37.537 INFO:tasks.workunit.client.0.smithi111.stdout:4/945: dread d18/d20/d40/f8f [0,4194304] 0 2024-09-11T00:07:37.540 INFO:tasks.workunit.client.0.smithi111.stdout:6/942: mknod d7/d22/d2c/dff/c140 0 2024-09-11T00:07:37.540 INFO:tasks.workunit.client.0.smithi111.stdout:8/971: truncate d11/d23/d3d/f86 929043 0 2024-09-11T00:07:37.544 INFO:tasks.workunit.client.0.smithi111.stdout:2/906: fsync d0/d3/d12/f96 0 2024-09-11T00:07:37.548 INFO:tasks.workunit.client.0.smithi111.stdout:4/946: rename d18/d20/d3c/d5e/d75/d8d/dce/ff1 to d18/d20/d40/d78/d79/d90/d91/f12e 0 2024-09-11T00:07:37.551 INFO:tasks.workunit.client.0.smithi111.stdout:2/907: symlink d0/d3/de/d3b/d62/d6d/da1/l138 0 2024-09-11T00:07:37.552 INFO:tasks.workunit.client.0.smithi111.stdout:6/943: mknod d7/d22/d1d/d69/db4/d133/c141 0 2024-09-11T00:07:37.554 INFO:tasks.workunit.client.0.smithi111.stdout:2/908: unlink d0/d3/f37 0 2024-09-11T00:07:37.555 INFO:tasks.workunit.client.0.smithi111.stdout:6/944: mknod d7/c142 0 2024-09-11T00:07:37.558 INFO:tasks.workunit.client.0.smithi111.stdout:2/909: getdents d0/d3/de/d3b/d97 0 2024-09-11T00:07:37.561 INFO:tasks.workunit.client.0.smithi111.stdout:2/910: chown d0/d3/de/d50/f59 52469 1 2024-09-11T00:07:37.564 INFO:tasks.workunit.client.0.smithi111.stdout:2/911: unlink d0/d3/d2e/ded/dd8/fee 0 2024-09-11T00:07:37.566 INFO:tasks.workunit.client.0.smithi111.stdout:2/912: read d0/d3/de/f11 [1201663,10545] 0 2024-09-11T00:07:37.573 INFO:tasks.workunit.client.0.smithi111.stdout:6/945: dwrite d7/d22/d1d/d109/f126 [0,4194304] 0 2024-09-11T00:07:37.574 INFO:tasks.workunit.client.0.smithi111.stdout:3/994: write d1c/d21/f3a [364677,20757] 0 2024-09-11T00:07:37.579 INFO:tasks.workunit.client.0.smithi111.stdout:6/946: readlink d7/d22/l48 0 2024-09-11T00:07:37.584 INFO:tasks.workunit.client.0.smithi111.stdout:1/951: dwrite d2/de/d12/d3c/d4b/d6a/d63/d73/da1/f5f [0,4194304] 0 2024-09-11T00:07:37.589 INFO:tasks.workunit.client.0.smithi111.stdout:7/995: dread dd/d48/f61 [4194304,4194304] 0 2024-09-11T00:07:37.590 INFO:tasks.workunit.client.0.smithi111.stdout:6/947: creat d7/d22/d1d/d83/d121/d41/de0/f143 x:0 0 0 2024-09-11T00:07:37.593 INFO:tasks.workunit.client.0.smithi111.stdout:6/948: chown d7/d22/d26/c59 1024079 1 2024-09-11T00:07:37.593 INFO:tasks.workunit.client.0.smithi111.stdout:1/952: truncate d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/d132/f13f 544530 0 2024-09-11T00:07:37.593 INFO:tasks.workunit.client.0.smithi111.stdout:3/995: mknod d1c/d1d/d22/d44/d5a/d74/d7b/de6/c153 0 2024-09-11T00:07:37.603 INFO:tasks.workunit.client.0.smithi111.stdout:2/913: dwrite d0/d3/f93 [0,4194304] 0 2024-09-11T00:07:37.603 INFO:tasks.workunit.client.0.smithi111.stdout:7/996: unlink dd/c73 0 2024-09-11T00:07:37.603 INFO:tasks.workunit.client.0.smithi111.stdout:2/914: chown d0/d3/d2e/ded 10916910 1 2024-09-11T00:07:37.606 INFO:tasks.workunit.client.0.smithi111.stdout:6/949: creat d7/d22/d3f/d74/d7f/d79/da4/d117/f144 x:0 0 0 2024-09-11T00:07:37.608 INFO:tasks.workunit.client.0.smithi111.stdout:3/996: chown d1c/d1d/d22/d23/d2f/d63/c140 8 1 2024-09-11T00:07:37.611 INFO:tasks.workunit.client.0.smithi111.stdout:3/997: write d1c/d1d/d22/d23/f52 [1051917,127158] 0 2024-09-11T00:07:37.613 INFO:tasks.workunit.client.0.smithi111.stdout:3/998: chown d1c/d1d/d22/d23/d58/c106 1533 1 2024-09-11T00:07:37.615 INFO:tasks.workunit.client.0.smithi111.stdout:3/999: write d1c/d1d/d22/d44/f6f [3062102,116690] 0 2024-09-11T00:07:37.616 INFO:tasks.workunit.client.0.smithi111.stdout:2/915: fsync d0/d3/d12/d52/ff5 0 2024-09-11T00:07:37.621 INFO:tasks.workunit.client.0.smithi111.stdout:1/953: fdatasync d2/de/d12/d3c/d4b/d6a/d3a/f3b 0 2024-09-11T00:07:37.622 INFO:tasks.workunit.client.0.smithi111.stdout:1/954: chown d2/d2b/dc9/df0 2580018 1 2024-09-11T00:07:37.623 INFO:tasks.workunit.client.0.smithi111.stdout:6/950: creat d7/d22/d3f/d74/d7f/f145 x:0 0 0 2024-09-11T00:07:37.626 INFO:tasks.workunit.client.0.smithi111.stdout:8/972: sync 2024-09-11T00:07:37.633 INFO:tasks.workunit.client.1.smithi203.stdout:7/838: sync 2024-09-11T00:07:37.635 INFO:tasks.workunit.client.0.smithi111.stdout:1/955: write d2/de/d12/d3c/d4b/d6a/f7a [2781732,81245] 0 2024-09-11T00:07:37.635 INFO:tasks.workunit.client.0.smithi111.stdout:7/997: dwrite dd/d1d/d1f/f23 [0,4194304] 0 2024-09-11T00:07:37.650 INFO:tasks.workunit.client.0.smithi111.stdout:7/998: truncate dd/d1d/d1f/d24/f32 3230772 0 2024-09-11T00:07:37.651 INFO:tasks.workunit.client.0.smithi111.stdout:2/916: dread d0/d3/de/d50/d9d/ff8 [0,4194304] 0 2024-09-11T00:07:37.651 INFO:tasks.workunit.client.0.smithi111.stdout:1/956: dwrite d2/de/ff [0,4194304] 0 2024-09-11T00:07:37.654 INFO:tasks.workunit.client.0.smithi111.stdout:8/973: write d11/d23/d3d/d8d/f61 [1218762,63340] 0 2024-09-11T00:07:37.654 INFO:tasks.workunit.client.0.smithi111.stdout:1/957: fdatasync d2/f128 0 2024-09-11T00:07:37.661 INFO:tasks.workunit.client.0.smithi111.stdout:6/951: dwrite d7/f6b [0,4194304] 0 2024-09-11T00:07:37.664 INFO:tasks.workunit.client.0.smithi111.stdout:8/974: read d11/d23/d2c/d46/f8c [1414808,22044] 0 2024-09-11T00:07:37.669 INFO:tasks.workunit.client.1.smithi203.stdout:7/839: creat dd/d1c/d52/d8f/d31/d4a/d105/f12f x:0 0 0 2024-09-11T00:07:37.670 INFO:tasks.workunit.client.0.smithi111.stdout:4/947: sync 2024-09-11T00:07:37.672 INFO:tasks.workunit.client.0.smithi111.stdout:8/975: fsync d11/fa1 0 2024-09-11T00:07:37.675 INFO:tasks.workunit.client.0.smithi111.stdout:1/958: creat d2/de/d12/d6c/d13c/f142 x:0 0 0 2024-09-11T00:07:37.680 INFO:tasks.workunit.client.1.smithi203.stdout:7/840: mknod dd/d1c/d52/d8f/d31/d58/d93/c130 0 2024-09-11T00:07:37.681 INFO:tasks.workunit.client.0.smithi111.stdout:7/999: dwrite dd/d1d/d1f/d24/f2f [0,4194304] 0 2024-09-11T00:07:37.685 INFO:tasks.workunit.client.0.smithi111.stdout:6/952: write d7/d22/d1d/d83/d121/fd2 [198699,88348] 0 2024-09-11T00:07:37.686 INFO:tasks.workunit.client.1.smithi203.stdout:7/841: fsync dd/d1c/d52/d8f/d31/d58/d93/d98/fb4 0 2024-09-11T00:07:37.687 INFO:tasks.workunit.client.0.smithi111.stdout:8/976: dread d11/d23/d3d/fb2 [0,4194304] 0 2024-09-11T00:07:37.687 INFO:tasks.workunit.client.0.smithi111.stdout:2/917: dwrite d0/d3/d2e/f4f [0,4194304] 0 2024-09-11T00:07:37.692 INFO:tasks.workunit.client.0.smithi111.stdout:6/953: dread d7/d22/d2c/d38/d56/faf [0,4194304] 0 2024-09-11T00:07:37.697 INFO:tasks.workunit.client.0.smithi111.stdout:8/977: symlink d11/d23/d2c/l138 0 2024-09-11T00:07:37.697 INFO:tasks.workunit.client.0.smithi111.stdout:2/918: readlink d0/d3/de/d3b/d62/d6d/da1/la2 0 2024-09-11T00:07:37.701 INFO:tasks.workunit.client.0.smithi111.stdout:2/919: mkdir d0/d11b/d139 0 2024-09-11T00:07:37.701 INFO:tasks.workunit.client.0.smithi111.stdout:2/920: dread - d0/d3/de/d3b/d97/f126 zero size 2024-09-11T00:07:37.702 INFO:tasks.workunit.client.0.smithi111.stdout:4/948: write d18/d3b/d61/f87 [258288,54731] 0 2024-09-11T00:07:37.703 INFO:tasks.workunit.client.0.smithi111.stdout:8/978: creat d11/d21/d38/f139 x:0 0 0 2024-09-11T00:07:37.705 INFO:tasks.workunit.client.0.smithi111.stdout:8/979: stat d11/l17 0 2024-09-11T00:07:37.705 INFO:tasks.workunit.client.0.smithi111.stdout:6/954: link d7/d22/d1d/d69/db4/fdf d7/d22/d3f/d74/d7f/d79/f146 0 2024-09-11T00:07:37.707 INFO:tasks.workunit.client.1.smithi203.stdout:7/842: write dd/d1c/d52/d8f/d31/d58/d93/d98/fd4 [101728,41586] 0 2024-09-11T00:07:37.711 INFO:tasks.workunit.client.0.smithi111.stdout:2/921: rename d0/d3/de/d3b/d62/d6d/da1/la2 to d0/d3/de/d4b/l13a 0 2024-09-11T00:07:37.713 INFO:tasks.workunit.client.0.smithi111.stdout:1/959: dwrite d2/de/d12/d3c/d4b/d6a/d63/d73/da1/f10b [0,4194304] 0 2024-09-11T00:07:37.713 INFO:tasks.workunit.client.0.smithi111.stdout:8/980: write d11/d23/d3d/d8d/fa3 [8497485,99038] 0 2024-09-11T00:07:37.716 INFO:tasks.workunit.client.0.smithi111.stdout:2/922: mknod d0/d3/d12/d38/c13b 0 2024-09-11T00:07:37.719 INFO:tasks.workunit.client.0.smithi111.stdout:8/981: write d11/d23/d3d/f94 [2587287,104636] 0 2024-09-11T00:07:37.725 INFO:tasks.workunit.client.0.smithi111.stdout:4/949: dwrite d18/d20/d3c/d5e/d75/d8d/dce/ff8 [0,4194304] 0 2024-09-11T00:07:37.738 INFO:tasks.workunit.client.1.smithi203.stdout:6/856: sync 2024-09-11T00:07:37.738 INFO:tasks.workunit.client.1.smithi203.stdout:3/934: sync 2024-09-11T00:07:37.746 INFO:tasks.workunit.client.0.smithi111.stdout:6/955: write d7/d22/d2c/d38/d56/dbf/fc3 [304821,116019] 0 2024-09-11T00:07:37.749 INFO:tasks.workunit.client.1.smithi203.stdout:3/935: fdatasync d8/da/db3/f35 0 2024-09-11T00:07:37.752 INFO:tasks.workunit.client.0.smithi111.stdout:8/982: rename d11/d23/d2c/d46/d81/da5 to d11/d23/d7e/d93/d13a 0 2024-09-11T00:07:37.754 INFO:tasks.workunit.client.1.smithi203.stdout:6/857: symlink d0/d54/d9c/d35/l109 0 2024-09-11T00:07:37.758 INFO:tasks.workunit.client.0.smithi111.stdout:2/923: symlink d0/d3/d12/l13c 0 2024-09-11T00:07:37.759 INFO:tasks.workunit.client.1.smithi203.stdout:3/936: creat d8/da/d37/d83/d65/f150 x:0 0 0 2024-09-11T00:07:37.760 INFO:tasks.workunit.client.0.smithi111.stdout:1/960: creat d2/de/d12/d3c/d4b/d6a/d63/d73/da1/db9/d123/f143 x:0 0 0 2024-09-11T00:07:37.762 INFO:tasks.workunit.client.1.smithi203.stdout:6/858: symlink d0/d54/d9c/d35/d39/d3c/l10a 0 2024-09-11T00:07:37.765 INFO:tasks.workunit.client.0.smithi111.stdout:4/950: mkdir d18/d20/d40/d78/d79/d90/d11f/d12f 0 2024-09-11T00:07:37.766 INFO:tasks.workunit.client.0.smithi111.stdout:4/951: fsync d18/fa4 0 2024-09-11T00:07:37.766 INFO:tasks.workunit.client.0.smithi111.stdout:2/924: dread d0/d3/de/d50/d9d/fe5 [0,4194304] 0 2024-09-11T00:07:37.767 INFO:tasks.workunit.client.0.smithi111.stdout:8/983: mkdir d11/d23/d3d/d10b/d135/d13b 0 2024-09-11T00:07:37.769 INFO:tasks.workunit.client.0.smithi111.stdout:1/961: mknod d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/d106/c144 0 2024-09-11T00:07:37.772 INFO:tasks.workunit.client.1.smithi203.stdout:3/937: link d8/da/d37/d53/fab d8/da/d37/d11e/f151 0 2024-09-11T00:07:37.773 INFO:tasks.workunit.client.1.smithi203.stdout:6/859: truncate d0/d54/d9c/d35/d38/d73/d74/fa7 2446616 0 2024-09-11T00:07:37.774 INFO:tasks.workunit.client.0.smithi111.stdout:1/962: symlink d2/de/d12/dc7/l145 0 2024-09-11T00:07:37.776 INFO:tasks.workunit.client.1.smithi203.stdout:3/938: symlink d8/d3c/l152 0 2024-09-11T00:07:37.779 INFO:tasks.workunit.client.0.smithi111.stdout:2/925: dread d0/d3/de/d68/df1/f11c [0,4194304] 0 2024-09-11T00:07:37.782 INFO:tasks.workunit.client.1.smithi203.stdout:3/939: truncate d8/da/d37/d53/dea/f10f 1023965 0 2024-09-11T00:07:37.783 INFO:tasks.workunit.client.0.smithi111.stdout:4/952: link d18/d3b/d51/f12c d18/d20/d40/d78/d79/db0/de2/f130 0 2024-09-11T00:07:37.784 INFO:tasks.workunit.client.0.smithi111.stdout:1/963: rmdir d2/de/d12/d3c/d4b 39 2024-09-11T00:07:37.787 INFO:tasks.workunit.client.1.smithi203.stdout:3/940: creat d8/da/d37/d83/d65/f153 x:0 0 0 2024-09-11T00:07:37.789 INFO:tasks.workunit.client.0.smithi111.stdout:2/926: creat d0/d3/de/d3b/d99/f13d x:0 0 0 2024-09-11T00:07:37.790 INFO:tasks.workunit.client.0.smithi111.stdout:4/953: symlink d18/d3b/d9f/l131 0 2024-09-11T00:07:37.794 INFO:tasks.workunit.client.0.smithi111.stdout:1/964: creat d2/de/d93/d9c/f146 x:0 0 0 2024-09-11T00:07:37.795 INFO:tasks.workunit.client.0.smithi111.stdout:6/956: dwrite d7/d22/d3f/d74/d7f/d61/d6a/fac [0,4194304] 0 2024-09-11T00:07:37.795 INFO:tasks.workunit.client.0.smithi111.stdout:2/927: read - d0/d3/d12/d38/f12d zero size 2024-09-11T00:07:37.802 INFO:tasks.workunit.client.0.smithi111.stdout:6/957: readlink d7/d22/l2a 0 2024-09-11T00:07:37.802 INFO:tasks.workunit.client.0.smithi111.stdout:2/928: rmdir d0/d3/de/d4b/dd9 39 2024-09-11T00:07:37.803 INFO:tasks.workunit.client.0.smithi111.stdout:1/965: write d2/de/d12/d3c/d4b/d6a/d63/d73/da1/f10b [2119887,56472] 0 2024-09-11T00:07:37.805 INFO:tasks.workunit.client.0.smithi111.stdout:2/929: chown d0/d3/de/d50/l82 109 1 2024-09-11T00:07:37.805 INFO:tasks.workunit.client.0.smithi111.stdout:8/984: truncate d11/d23/d3d/f109 48464 0 2024-09-11T00:07:37.808 INFO:tasks.workunit.client.0.smithi111.stdout:1/966: mknod d2/de/d12/d3c/d4b/dc3/c147 0 2024-09-11T00:07:37.808 INFO:tasks.workunit.client.1.smithi203.stdout:6/860: dwrite d0/d54/d9c/f66 [4194304,4194304] 0 2024-09-11T00:07:37.808 INFO:tasks.workunit.client.1.smithi203.stdout:1/982: sync 2024-09-11T00:07:37.809 INFO:tasks.workunit.client.1.smithi203.stdout:0/904: sync 2024-09-11T00:07:37.809 INFO:tasks.workunit.client.1.smithi203.stdout:9/900: sync 2024-09-11T00:07:37.809 INFO:tasks.workunit.client.1.smithi203.stdout:8/838: sync 2024-09-11T00:07:37.809 INFO:tasks.workunit.client.1.smithi203.stdout:4/832: sync 2024-09-11T00:07:37.809 INFO:tasks.workunit.client.1.smithi203.stdout:2/970: sync 2024-09-11T00:07:37.809 INFO:tasks.workunit.client.1.smithi203.stdout:5/934: sync 2024-09-11T00:07:37.810 INFO:tasks.workunit.client.0.smithi111.stdout:6/958: dread d7/d22/d1d/d83/d121/fd2 [0,4194304] 0 2024-09-11T00:07:37.812 INFO:tasks.workunit.client.1.smithi203.stdout:0/905: chown d0/d2/db3/f100 1132598362 1 2024-09-11T00:07:37.813 INFO:tasks.workunit.client.0.smithi111.stdout:2/930: mknod d0/d3/de/d3b/d63/c13e 0 2024-09-11T00:07:37.813 INFO:tasks.workunit.client.1.smithi203.stdout:4/833: chown db/d12/d15/d2a/d88/f90 178692 1 2024-09-11T00:07:37.814 INFO:tasks.workunit.client.0.smithi111.stdout:1/967: dread - d2/de/d82/ff2 zero size 2024-09-11T00:07:37.815 INFO:tasks.workunit.client.0.smithi111.stdout:2/931: chown d0/d3/d12/d38/cf4 1132 1 2024-09-11T00:07:37.817 INFO:tasks.workunit.client.0.smithi111.stdout:4/954: write d18/d20/d3c/f74 [433031,30710] 0 2024-09-11T00:07:37.820 INFO:tasks.workunit.client.1.smithi203.stdout:1/983: symlink d8/d19/d31/d36/l15f 0 2024-09-11T00:07:37.824 INFO:tasks.workunit.client.0.smithi111.stdout:6/959: creat d7/d22/d1d/d83/f147 x:0 0 0 2024-09-11T00:07:37.827 INFO:tasks.workunit.client.1.smithi203.stdout:3/941: dwrite d8/d2a/f40 [4194304,4194304] 0 2024-09-11T00:07:37.828 INFO:tasks.workunit.client.0.smithi111.stdout:8/985: write d11/d21/f22 [3406981,116623] 0 2024-09-11T00:07:37.829 INFO:tasks.workunit.client.0.smithi111.stdout:1/968: creat d2/de/d12/d3c/d4b/d6a/d63/d73/da1/db9/f148 x:0 0 0 2024-09-11T00:07:37.838 INFO:tasks.workunit.client.0.smithi111.stdout:2/932: link d0/d3/de/d3b/d62/feb d0/d3/d2e/ded/dd8/f13f 0 2024-09-11T00:07:37.838 INFO:tasks.workunit.client.1.smithi203.stdout:8/839: unlink d1/d13/d17/c80 0 2024-09-11T00:07:37.838 INFO:tasks.workunit.client.1.smithi203.stdout:6/861: dwrite d0/d54/d9c/d35/d38/dc0/fe5 [0,4194304] 0 2024-09-11T00:07:37.838 INFO:tasks.workunit.client.0.smithi111.stdout:6/960: dwrite d7/d22/d1d/d69/db4/f132 [0,4194304] 0 2024-09-11T00:07:37.839 INFO:tasks.workunit.client.1.smithi203.stdout:9/901: creat d6/de/df9/f126 x:0 0 0 2024-09-11T00:07:37.840 INFO:tasks.workunit.client.0.smithi111.stdout:8/986: mkdir d11/d21/d6f/d13c 0 2024-09-11T00:07:37.841 INFO:tasks.workunit.client.0.smithi111.stdout:2/933: chown d0/d3/d12/l13c 88 1 2024-09-11T00:07:37.846 INFO:tasks.workunit.client.0.smithi111.stdout:1/969: creat d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/d132/f149 x:0 0 0 2024-09-11T00:07:37.849 INFO:tasks.workunit.client.1.smithi203.stdout:5/935: dread dc/dd/d15/dbd/d59/dbb/fe1 [0,4194304] 0 2024-09-11T00:07:37.850 INFO:tasks.workunit.client.0.smithi111.stdout:4/955: creat d18/d20/f132 x:0 0 0 2024-09-11T00:07:37.851 INFO:tasks.workunit.client.1.smithi203.stdout:8/840: truncate d1/d13/d3a/f44 676518 0 2024-09-11T00:07:37.857 INFO:tasks.workunit.client.0.smithi111.stdout:8/987: dread d11/d23/d3d/f86 [0,4194304] 0 2024-09-11T00:07:37.858 INFO:tasks.workunit.client.1.smithi203.stdout:6/862: chown d0/d54/d9c/d7b/d7e/d94/f103 12113583 1 2024-09-11T00:07:37.858 INFO:tasks.workunit.client.1.smithi203.stdout:3/942: dwrite d8/da/d37/d83/d65/d8b/f13c [0,4194304] 0 2024-09-11T00:07:37.858 INFO:tasks.workunit.client.1.smithi203.stdout:9/902: truncate d6/de/fe3 350653 0 2024-09-11T00:07:37.858 INFO:tasks.workunit.client.0.smithi111.stdout:1/970: mkdir d2/de/d12/dc7/d14a 0 2024-09-11T00:07:37.859 INFO:tasks.workunit.client.0.smithi111.stdout:8/988: write d11/d23/d2c/d46/f8f [2753221,64164] 0 2024-09-11T00:07:37.860 INFO:tasks.workunit.client.1.smithi203.stdout:0/906: dwrite d0/d2/f8 [0,4194304] 0 2024-09-11T00:07:37.863 INFO:tasks.workunit.client.1.smithi203.stdout:0/907: write d0/d1d/f44 [813776,101323] 0 2024-09-11T00:07:37.863 INFO:tasks.workunit.client.0.smithi111.stdout:8/989: stat d11/d23/d3d/f94 0 2024-09-11T00:07:37.864 INFO:tasks.workunit.client.0.smithi111.stdout:4/956: creat d18/d20/d40/d78/d79/d90/d11f/f133 x:0 0 0 2024-09-11T00:07:37.869 INFO:tasks.workunit.client.0.smithi111.stdout:2/934: rename d0/d3/de/d3b/d97/l134 to d0/d3/de/d10e/l140 0 2024-09-11T00:07:37.870 INFO:tasks.workunit.client.1.smithi203.stdout:5/936: unlink dc/dd/d56/dad/l96 0 2024-09-11T00:07:37.874 INFO:tasks.workunit.client.1.smithi203.stdout:2/971: dread d13/d15/d19/d1c/d73/dc4/f142 [0,4194304] 0 2024-09-11T00:07:37.880 INFO:tasks.workunit.client.1.smithi203.stdout:1/984: write d8/d19/d60/d90/d3e/d4b/d80/d91/dac/fe4 [538896,24202] 0 2024-09-11T00:07:37.881 INFO:tasks.workunit.client.1.smithi203.stdout:4/834: write db/dd/d26/fd0 [687625,41456] 0 2024-09-11T00:07:37.884 INFO:tasks.workunit.client.1.smithi203.stdout:4/835: chown db/f10 611 1 2024-09-11T00:07:37.888 INFO:tasks.workunit.client.1.smithi203.stdout:6/863: rename d0/d54/d9c/le to d0/d54/d9c/d7b/d7e/d94/l10b 0 2024-09-11T00:07:37.889 INFO:tasks.workunit.client.0.smithi111.stdout:4/957: mknod d18/d20/d3c/d5e/d75/d8d/db8/c134 0 2024-09-11T00:07:37.890 INFO:tasks.workunit.client.1.smithi203.stdout:3/943: dread d8/da/d37/d53/da2/fbd [0,4194304] 0 2024-09-11T00:07:37.894 INFO:tasks.workunit.client.1.smithi203.stdout:9/903: creat d6/de/d19/d24/d54/db2/de2/d10c/f127 x:0 0 0 2024-09-11T00:07:37.895 INFO:tasks.workunit.client.1.smithi203.stdout:8/841: dwrite d1/d13/d17/d77/dea/da6/fcd [0,4194304] 0 2024-09-11T00:07:37.897 INFO:tasks.workunit.client.0.smithi111.stdout:2/935: unlink d0/d3/de/d3b/d62/d6d/da1/c12f 0 2024-09-11T00:07:37.899 INFO:tasks.workunit.client.0.smithi111.stdout:6/961: getdents d7/d22/d1d 0 2024-09-11T00:07:37.902 INFO:tasks.workunit.client.1.smithi203.stdout:2/972: mknod d13/d15/d19/d1c/d76/d94/c144 0 2024-09-11T00:07:37.902 INFO:tasks.workunit.client.1.smithi203.stdout:9/904: chown d6/de/d32/d52/f4b 5813189 1 2024-09-11T00:07:37.903 INFO:tasks.workunit.client.0.smithi111.stdout:1/971: mknod d2/de/d12/d3c/d4b/d6a/d63/d73/c14b 0 2024-09-11T00:07:37.905 INFO:tasks.workunit.client.1.smithi203.stdout:2/973: write d13/d15/d19/d1c/d73/d7a/f11f [1042434,5290] 0 2024-09-11T00:07:37.910 INFO:tasks.workunit.client.0.smithi111.stdout:6/962: dread d7/f30 [0,4194304] 0 2024-09-11T00:07:37.911 INFO:tasks.workunit.client.0.smithi111.stdout:2/936: fsync d0/d3/f27 0 2024-09-11T00:07:37.912 INFO:tasks.workunit.client.0.smithi111.stdout:6/963: write d7/d22/d1d/f88 [368171,103418] 0 2024-09-11T00:07:37.913 INFO:tasks.workunit.client.0.smithi111.stdout:2/937: fsync d0/d3/d98/dff/f125 0 2024-09-11T00:07:37.920 INFO:tasks.workunit.client.0.smithi111.stdout:8/990: dwrite d11/f12 [4194304,4194304] 0 2024-09-11T00:07:37.924 INFO:tasks.workunit.client.1.smithi203.stdout:5/937: creat dc/dd/d15/dbd/d126/f136 x:0 0 0 2024-09-11T00:07:37.928 INFO:tasks.workunit.client.1.smithi203.stdout:6/864: dread d0/d54/d9c/d35/d38/d73/d74/fec [0,4194304] 0 2024-09-11T00:07:37.930 INFO:tasks.workunit.client.1.smithi203.stdout:2/974: rmdir d13/d102 39 2024-09-11T00:07:37.932 INFO:tasks.workunit.client.1.smithi203.stdout:9/905: truncate d6/de/d19/d24/d54/f9d 2130321 0 2024-09-11T00:07:37.933 INFO:tasks.workunit.client.0.smithi111.stdout:1/972: dwrite d2/de/d82/ff2 [0,4194304] 0 2024-09-11T00:07:37.935 INFO:tasks.workunit.client.1.smithi203.stdout:6/865: chown d0/d54/d9c/d35/d38/d73/fca 35759136 1 2024-09-11T00:07:37.936 INFO:tasks.workunit.client.0.smithi111.stdout:6/964: rename d7/f105 to d7/d22/d1d/d83/d121/d41/f148 0 2024-09-11T00:07:37.940 INFO:tasks.workunit.client.1.smithi203.stdout:3/944: creat d8/d2a/d143/f154 x:0 0 0 2024-09-11T00:07:37.942 INFO:tasks.workunit.client.0.smithi111.stdout:2/938: getdents d0/d83 0 2024-09-11T00:07:37.943 INFO:tasks.workunit.client.1.smithi203.stdout:1/985: dread d8/d19/d60/d90/f53 [0,4194304] 0 2024-09-11T00:07:37.944 INFO:tasks.workunit.client.1.smithi203.stdout:8/842: dwrite d1/d13/d17/d2f/d9e/f66 [0,4194304] 0 2024-09-11T00:07:37.949 INFO:tasks.workunit.client.1.smithi203.stdout:0/908: rename d0/d2/d92/l86 to d0/l128 0 2024-09-11T00:07:37.950 INFO:tasks.workunit.client.1.smithi203.stdout:9/906: symlink d6/de/d47/de1/dec/df8/def/l128 0 2024-09-11T00:07:37.952 INFO:tasks.workunit.client.1.smithi203.stdout:5/938: mknod dc/dd/d56/dad/c137 0 2024-09-11T00:07:37.952 INFO:tasks.workunit.client.1.smithi203.stdout:4/836: getdents db/d12/d15/d2a/dc3 0 2024-09-11T00:07:37.953 INFO:tasks.workunit.client.0.smithi111.stdout:1/973: dwrite d2/de/d93/d9c/f146 [0,4194304] 0 2024-09-11T00:07:37.953 INFO:tasks.workunit.client.1.smithi203.stdout:3/945: creat d8/da/d37/d83/da3/f155 x:0 0 0 2024-09-11T00:07:37.954 INFO:tasks.workunit.client.1.smithi203.stdout:0/909: chown d0/d1d/d5d/dba/feb 6754490 1 2024-09-11T00:07:37.957 INFO:tasks.workunit.client.1.smithi203.stdout:8/843: mknod d1/d13/d17/d48/d9d/d10b/c11d 0 2024-09-11T00:07:37.958 INFO:tasks.workunit.client.0.smithi111.stdout:8/991: dwrite d11/f9c [0,4194304] 0 2024-09-11T00:07:37.960 INFO:tasks.workunit.client.1.smithi203.stdout:8/844: write d1/f3b [428546,57997] 0 2024-09-11T00:07:37.961 INFO:tasks.workunit.client.1.smithi203.stdout:6/866: dread d0/d32/f100 [0,4194304] 0 2024-09-11T00:07:37.962 INFO:tasks.workunit.client.0.smithi111.stdout:2/939: dwrite d0/d83/f11e [0,4194304] 0 2024-09-11T00:07:37.962 INFO:tasks.workunit.client.0.smithi111.stdout:8/992: chown d11/d23/d3d/d5f/f108 11495157 1 2024-09-11T00:07:37.963 INFO:tasks.workunit.client.1.smithi203.stdout:6/867: readlink d0/d54/lcf 0 2024-09-11T00:07:37.963 INFO:tasks.workunit.client.0.smithi111.stdout:1/974: truncate d2/de/d12/d3c/d4b/d6a/d3a/f11c 450418 0 2024-09-11T00:07:37.968 INFO:tasks.workunit.client.0.smithi111.stdout:6/965: link d7/d22/d1d/d83/d121/d41/d77/ffc d7/d22/d26/f149 0 2024-09-11T00:07:37.971 INFO:tasks.workunit.client.0.smithi111.stdout:8/993: rename d11/d23/d2c/d53/dfc/f10f to d11/d8e/dd4/f13d 0 2024-09-11T00:07:37.977 INFO:tasks.workunit.client.1.smithi203.stdout:7/843: sync 2024-09-11T00:07:37.982 INFO:tasks.workunit.client.0.smithi111.stdout:6/966: dwrite d7/d22/d1d/d83/f147 [0,4194304] 0 2024-09-11T00:07:37.982 INFO:tasks.workunit.client.0.smithi111.stdout:8/994: unlink d11/d21/d6f/dab/fb1 0 2024-09-11T00:07:37.984 INFO:tasks.workunit.client.0.smithi111.stdout:8/995: chown d11/d21/d38/f5e 13810707 1 2024-09-11T00:07:37.985 INFO:tasks.workunit.client.0.smithi111.stdout:1/975: link d2/de/d93/d9c/fa2 d2/de/d93/d9f/f14c 0 2024-09-11T00:07:37.986 INFO:tasks.workunit.client.1.smithi203.stdout:2/975: dwrite d13/d15/f1b [0,4194304] 0 2024-09-11T00:07:37.994 INFO:tasks.workunit.client.0.smithi111.stdout:8/996: mknod d11/d23/d7e/d93/dba/c13e 0 2024-09-11T00:07:37.995 INFO:tasks.workunit.client.1.smithi203.stdout:3/946: write d8/da/f44 [4240305,106180] 0 2024-09-11T00:07:37.996 INFO:tasks.workunit.client.0.smithi111.stdout:1/976: symlink d2/de/d12/d6c/d13c/l14d 0 2024-09-11T00:07:37.997 INFO:tasks.workunit.client.0.smithi111.stdout:6/967: mkdir d7/d22/d26/d95/dd6/d138/d14a 0 2024-09-11T00:07:38.001 INFO:tasks.workunit.client.1.smithi203.stdout:1/986: link d8/l55 d8/d19/d60/d90/d3e/d107/l160 0 2024-09-11T00:07:38.002 INFO:tasks.workunit.client.1.smithi203.stdout:7/844: unlink dd/d1c/d52/d8f/c40 0 2024-09-11T00:07:38.002 INFO:tasks.workunit.client.1.smithi203.stdout:4/837: dwrite db/dd/d26/dcd/dfb/f10a [0,4194304] 0 2024-09-11T00:07:38.008 INFO:tasks.workunit.client.1.smithi203.stdout:9/907: rename d6/de/d19/d24/d40/c5a to d6/de/d47/c129 0 2024-09-11T00:07:38.008 INFO:tasks.workunit.client.1.smithi203.stdout:0/910: dread d0/d2/d7e/da1/fcf [0,4194304] 0 2024-09-11T00:07:38.013 INFO:tasks.workunit.client.0.smithi111.stdout:6/968: fsync d7/d22/d3f/d74/d7f/d61/d6a/dba/f93 0 2024-09-11T00:07:38.013 INFO:tasks.workunit.client.0.smithi111.stdout:1/977: unlink d2/de/d12/d3c/d4b/d6a/d3a/f40 0 2024-09-11T00:07:38.017 INFO:tasks.workunit.client.1.smithi203.stdout:8/845: read d1/d13/d17/d77/dea/f5e [2358959,128946] 0 2024-09-11T00:07:38.025 INFO:tasks.workunit.client.1.smithi203.stdout:1/987: unlink d8/d19/d60/d90/d3e/d4b/d80/d8d/da3/d12a/l62 0 2024-09-11T00:07:38.028 INFO:tasks.workunit.client.1.smithi203.stdout:9/908: dread d6/de/d47/de1/dec/fee [0,4194304] 0 2024-09-11T00:07:38.029 INFO:tasks.workunit.client.1.smithi203.stdout:4/838: rmdir db/dd/d16/ded/db5 39 2024-09-11T00:07:38.030 INFO:tasks.workunit.client.1.smithi203.stdout:4/839: fsync db/f6c 0 2024-09-11T00:07:38.034 INFO:tasks.workunit.client.1.smithi203.stdout:9/909: write d6/de/d47/de1/dec/df8/def/f10a [29226,85044] 0 2024-09-11T00:07:38.035 INFO:tasks.workunit.client.0.smithi111.stdout:6/969: rename d7/d22/d1d/d83/d121/d7a to d7/d22/d3f/d74/d14b 0 2024-09-11T00:07:38.037 INFO:tasks.workunit.client.0.smithi111.stdout:6/970: dread - d7/d22/d1d/d83/d121/d41/de0/f143 zero size 2024-09-11T00:07:38.038 INFO:tasks.workunit.client.1.smithi203.stdout:6/868: write d0/d54/d9c/d35/d39/fd6 [1184304,53848] 0 2024-09-11T00:07:38.039 INFO:tasks.workunit.client.0.smithi111.stdout:4/958: sync 2024-09-11T00:07:38.040 INFO:tasks.workunit.client.0.smithi111.stdout:4/959: fsync d18/d1f/d36/f116 0 2024-09-11T00:07:38.041 INFO:tasks.workunit.client.0.smithi111.stdout:8/997: dread d11/d23/d2c/d46/d81/dd2/fda [0,4194304] 0 2024-09-11T00:07:38.041 INFO:tasks.workunit.client.0.smithi111.stdout:4/960: fdatasync d18/d1f/d36/f116 0 2024-09-11T00:07:38.044 INFO:tasks.workunit.client.1.smithi203.stdout:1/988: creat d8/d19/d60/d90/d3e/d4b/d80/d8d/da3/f161 x:0 0 0 2024-09-11T00:07:38.044 INFO:tasks.workunit.client.1.smithi203.stdout:5/939: dwrite dc/d4f/d5c/fda [0,4194304] 0 2024-09-11T00:07:38.048 INFO:tasks.workunit.client.0.smithi111.stdout:6/971: creat d7/d106/d13d/f14c x:0 0 0 2024-09-11T00:07:38.051 INFO:tasks.workunit.client.1.smithi203.stdout:7/845: write dd/d1c/d52/d8f/d31/d4a/d6e/dcc/dea/fc4 [577886,74271] 0 2024-09-11T00:07:38.051 INFO:tasks.workunit.client.1.smithi203.stdout:3/947: getdents d8/d17/ddd/d139 0 2024-09-11T00:07:38.051 INFO:tasks.workunit.client.1.smithi203.stdout:0/911: link d0/d1d/d4c/f6d d0/d2/db3/f129 0 2024-09-11T00:07:38.052 INFO:tasks.workunit.client.1.smithi203.stdout:4/840: mkdir db/d12/d15/d111 0 2024-09-11T00:07:38.054 INFO:tasks.workunit.client.0.smithi111.stdout:4/961: mkdir d18/d20/d3c/d5e/daa/dbb/dfa/d135 0 2024-09-11T00:07:38.061 INFO:tasks.workunit.client.0.smithi111.stdout:1/978: dwrite d2/de/d12/d3c/d4b/d6a/d63/d73/da1/db9/fc5 [0,4194304] 0 2024-09-11T00:07:38.062 INFO:tasks.workunit.client.1.smithi203.stdout:6/869: creat d0/d54/d9c/d35/d39/d3c/f10c x:0 0 0 2024-09-11T00:07:38.064 INFO:tasks.workunit.client.1.smithi203.stdout:5/940: unlink dc/dd/d15/d3b/c6f 0 2024-09-11T00:07:38.064 INFO:tasks.workunit.client.0.smithi111.stdout:1/979: fdatasync d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/fa0 0 2024-09-11T00:07:38.065 INFO:tasks.workunit.client.1.smithi203.stdout:5/941: fsync dc/d4f/d5c/f12f 0 2024-09-11T00:07:38.067 INFO:tasks.workunit.client.1.smithi203.stdout:1/989: rmdir d8/d9/d15/d35/d81/db9/dce 39 2024-09-11T00:07:38.067 INFO:tasks.workunit.client.0.smithi111.stdout:8/998: creat d11/d23/d3d/f13f x:0 0 0 2024-09-11T00:07:38.069 INFO:tasks.workunit.client.0.smithi111.stdout:6/972: creat d7/d22/d3f/d74/f14d x:0 0 0 2024-09-11T00:07:38.069 INFO:tasks.workunit.client.1.smithi203.stdout:1/990: read d8/d119/ffc [207253,55502] 0 2024-09-11T00:07:38.078 INFO:tasks.workunit.client.1.smithi203.stdout:9/910: write d6/de/d32/d52/fe8 [735274,101170] 0 2024-09-11T00:07:38.079 INFO:tasks.workunit.client.0.smithi111.stdout:2/940: sync 2024-09-11T00:07:38.079 INFO:tasks.workunit.client.0.smithi111.stdout:6/973: dread d7/d22/d2c/d38/f124 [0,4194304] 0 2024-09-11T00:07:38.081 INFO:tasks.workunit.client.0.smithi111.stdout:6/974: write d7/f11 [9460061,66379] 0 2024-09-11T00:07:38.086 INFO:tasks.workunit.client.0.smithi111.stdout:6/975: dread - d7/d22/d3f/d74/d7f/d79/da4/d117/f144 zero size 2024-09-11T00:07:38.086 INFO:tasks.workunit.client.1.smithi203.stdout:3/948: dread d8/da/d11/f55 [4194304,4194304] 0 2024-09-11T00:07:38.089 INFO:tasks.workunit.client.1.smithi203.stdout:6/870: creat d0/d54/d9c/d7b/d7e/d94/f10d x:0 0 0 2024-09-11T00:07:38.090 INFO:tasks.workunit.client.0.smithi111.stdout:4/962: dwrite d18/d3b/f8e [0,4194304] 0 2024-09-11T00:07:38.093 INFO:tasks.workunit.client.0.smithi111.stdout:1/980: creat d2/de/d12/d3c/d4b/d6a/d63/d73/f14e x:0 0 0 2024-09-11T00:07:38.094 INFO:tasks.workunit.client.0.smithi111.stdout:8/999: dread d11/d23/df2/f137 [0,4194304] 0 2024-09-11T00:07:38.101 INFO:tasks.workunit.client.0.smithi111.stdout:4/963: rmdir d18/d20/d3c/d5e/daa 39 2024-09-11T00:07:38.101 INFO:tasks.workunit.client.1.smithi203.stdout:4/841: dwrite db/dd/d26/f30 [4194304,4194304] 0 2024-09-11T00:07:38.103 INFO:tasks.workunit.client.1.smithi203.stdout:9/911: unlink d6/de/d32/d52/d55/d66/fe9 0 2024-09-11T00:07:38.105 INFO:tasks.workunit.client.0.smithi111.stdout:1/981: unlink d2/de/d12/dc7/l145 0 2024-09-11T00:07:38.107 INFO:tasks.workunit.client.0.smithi111.stdout:2/941: getdents d0/d3/de/dd4/d106/d112 0 2024-09-11T00:07:38.108 INFO:tasks.workunit.client.1.smithi203.stdout:8/846: link d1/d13/d17/d2f/d9e/fa7 d1/d13/f11e 0 2024-09-11T00:07:38.111 INFO:tasks.workunit.client.1.smithi203.stdout:5/942: write dc/dd/d13/f14 [57530,37273] 0 2024-09-11T00:07:38.112 INFO:tasks.workunit.client.0.smithi111.stdout:4/964: fsync d18/d20/d3c/f54 0 2024-09-11T00:07:38.113 INFO:tasks.workunit.client.1.smithi203.stdout:3/949: dwrite d8/da/d37/d53/f9b [0,4194304] 0 2024-09-11T00:07:38.117 INFO:tasks.workunit.client.0.smithi111.stdout:6/976: rename d7/d22/d1d/d69 to d7/d22/d3f/d74/d7f/d61/d6a/d14e 0 2024-09-11T00:07:38.121 INFO:tasks.workunit.client.1.smithi203.stdout:7/846: fsync dd/d1c/d52/fce 0 2024-09-11T00:07:38.126 INFO:tasks.workunit.client.1.smithi203.stdout:0/912: dwrite d0/d2/d7e/da1/fde [0,4194304] 0 2024-09-11T00:07:38.127 INFO:tasks.workunit.client.0.smithi111.stdout:4/965: mknod d18/d20/d4a/d6b/ded/c136 0 2024-09-11T00:07:38.128 INFO:tasks.workunit.client.0.smithi111.stdout:1/982: rename d2/de/d93/d9c/f146 to d2/de/d12/d3c/d4b/d6a/d63/d95/f14f 0 2024-09-11T00:07:38.133 INFO:tasks.workunit.client.1.smithi203.stdout:6/871: dread d0/d54/d9c/d7b/f8a [0,4194304] 0 2024-09-11T00:07:38.133 INFO:tasks.workunit.client.1.smithi203.stdout:4/842: dread db/dd/d26/f28 [0,4194304] 0 2024-09-11T00:07:38.142 INFO:tasks.workunit.client.1.smithi203.stdout:8/847: dwrite d1/d13/d17/d8b/fcb [0,4194304] 0 2024-09-11T00:07:38.143 INFO:tasks.workunit.client.0.smithi111.stdout:4/966: dwrite d18/d20/d40/d78/d79/d90/d11f/f133 [0,4194304] 0 2024-09-11T00:07:38.147 INFO:tasks.workunit.client.0.smithi111.stdout:4/967: write d18/d20/d40/d78/f105 [1476916,38895] 0 2024-09-11T00:07:38.148 INFO:tasks.workunit.client.1.smithi203.stdout:3/950: dwrite d8/da/f2f [0,4194304] 0 2024-09-11T00:07:38.151 INFO:tasks.workunit.client.1.smithi203.stdout:1/991: fsync d8/d9/d15/d27/fb6 0 2024-09-11T00:07:38.154 INFO:tasks.workunit.client.1.smithi203.stdout:3/951: dread d8/d3c/fc9 [0,4194304] 0 2024-09-11T00:07:38.155 INFO:tasks.workunit.client.1.smithi203.stdout:0/913: dwrite d0/d2/d7e/da1/df5/f11a [0,4194304] 0 2024-09-11T00:07:38.163 INFO:tasks.workunit.client.0.smithi111.stdout:2/942: dwrite d0/d3/de/d3b/d62/fb5 [0,4194304] 0 2024-09-11T00:07:38.165 INFO:tasks.workunit.client.1.smithi203.stdout:4/843: creat db/d12/d15/d2a/d71/f112 x:0 0 0 2024-09-11T00:07:38.167 INFO:tasks.workunit.client.0.smithi111.stdout:6/977: dread d7/fd [0,4194304] 0 2024-09-11T00:07:38.177 INFO:tasks.workunit.client.1.smithi203.stdout:5/943: creat dc/dd/d1e/f138 x:0 0 0 2024-09-11T00:07:38.179 INFO:tasks.workunit.client.1.smithi203.stdout:8/848: symlink d1/d13/d17/d48/dfa/l11f 0 2024-09-11T00:07:38.179 INFO:tasks.workunit.client.1.smithi203.stdout:5/944: stat dc/d4f/c79 0 2024-09-11T00:07:38.180 INFO:tasks.workunit.client.1.smithi203.stdout:1/992: write d8/d19/d60/d90/d3e/d4b/d80/d8d/da3/dd2/f133 [4427966,56277] 0 2024-09-11T00:07:38.181 INFO:tasks.workunit.client.1.smithi203.stdout:0/914: dwrite d0/d1d/f44 [0,4194304] 0 2024-09-11T00:07:38.182 INFO:tasks.workunit.client.1.smithi203.stdout:9/912: link d6/de/d19/d21/lc5 d6/de/d32/d52/d55/l12a 0 2024-09-11T00:07:38.188 INFO:tasks.workunit.client.1.smithi203.stdout:7/847: rename dd/d1c/d52/d8f/d31/f62 to dd/d4d/f131 0 2024-09-11T00:07:38.198 INFO:tasks.workunit.client.1.smithi203.stdout:8/849: dread d1/d13/d17/d2f/d9e/f66 [0,4194304] 0 2024-09-11T00:07:38.198 INFO:tasks.workunit.client.1.smithi203.stdout:7/848: creat dd/d3b/d5b/dd9/f132 x:0 0 0 2024-09-11T00:07:38.201 INFO:tasks.workunit.client.1.smithi203.stdout:4/844: rename db/d12/d15/d2a/d88/fc1 to db/d12/d15/d2a/dc3/f113 0 2024-09-11T00:07:38.204 INFO:tasks.workunit.client.1.smithi203.stdout:1/993: creat d8/d9/d15/d27/d11a/f162 x:0 0 0 2024-09-11T00:07:38.211 INFO:tasks.workunit.client.1.smithi203.stdout:4/845: dread db/f7e [0,4194304] 0 2024-09-11T00:07:38.213 INFO:tasks.workunit.client.1.smithi203.stdout:6/872: write d0/d71/ff1 [1632460,92370] 0 2024-09-11T00:07:38.217 INFO:tasks.workunit.client.1.smithi203.stdout:8/850: rmdir d1/d13/d17/d48 39 2024-09-11T00:07:38.221 INFO:tasks.workunit.client.1.smithi203.stdout:8/851: read d1/d13/d17/d81/d97/fb1 [788924,36927] 0 2024-09-11T00:07:38.224 INFO:tasks.workunit.client.1.smithi203.stdout:8/852: fsync d1/d13/d17/d77/ff7 0 2024-09-11T00:07:38.227 INFO:tasks.workunit.client.0.smithi111.stdout:4/968: unlink d18/d20/d4a/d6b/f111 0 2024-09-11T00:07:38.227 INFO:tasks.workunit.client.1.smithi203.stdout:5/945: link dc/d2b/l36 dc/dd/d15/dbd/d59/l139 0 2024-09-11T00:07:38.229 INFO:tasks.workunit.client.0.smithi111.stdout:4/969: chown d18/d20/d40/d78/d79/d90/ld6 24 1 2024-09-11T00:07:38.230 INFO:tasks.workunit.client.1.smithi203.stdout:5/946: chown dc/dd/d15/dbd/d59/da8/fd8 180470421 1 2024-09-11T00:07:38.232 INFO:tasks.workunit.client.1.smithi203.stdout:5/947: chown dc/dd/d13/f3e 13 1 2024-09-11T00:07:38.232 INFO:tasks.workunit.client.1.smithi203.stdout:4/846: symlink db/d12/d15/d2a/d71/l114 0 2024-09-11T00:07:38.235 INFO:tasks.workunit.client.1.smithi203.stdout:6/873: fdatasync d0/d54/d9c/d7b/d7e/d94/f103 0 2024-09-11T00:07:38.238 INFO:tasks.workunit.client.1.smithi203.stdout:6/874: write d0/d54/d9c/d35/d39/f51 [2234992,14694] 0 2024-09-11T00:07:38.241 INFO:tasks.workunit.client.0.smithi111.stdout:2/943: mknod d0/d3/de/d3b/d62/c141 0 2024-09-11T00:07:38.242 INFO:tasks.workunit.client.1.smithi203.stdout:6/875: write d0/d54/d9c/d35/d38/d73/f104 [628441,94686] 0 2024-09-11T00:07:38.242 INFO:tasks.workunit.client.1.smithi203.stdout:9/913: link d6/de/d19/d24/d40/fb9 d6/de/d32/d52/d55/f12b 0 2024-09-11T00:07:38.245 INFO:tasks.workunit.client.0.smithi111.stdout:1/983: rename d2/de/d105/c110 to d2/de/d12/d6c/c150 0 2024-09-11T00:07:38.246 INFO:tasks.workunit.client.1.smithi203.stdout:8/853: creat d1/d13/d17/d2f/d52/d49/f120 x:0 0 0 2024-09-11T00:07:38.250 INFO:tasks.workunit.client.1.smithi203.stdout:6/876: dread d0/d54/d9c/d35/d38/d73/f104 [0,4194304] 0 2024-09-11T00:07:38.253 INFO:tasks.workunit.client.1.smithi203.stdout:4/847: dread - db/dd/d16/d38/d3c/d41/fd3 zero size 2024-09-11T00:07:38.259 INFO:tasks.workunit.client.1.smithi203.stdout:4/848: readlink db/dd/d16/d38/le7 0 2024-09-11T00:07:38.264 INFO:tasks.workunit.client.0.smithi111.stdout:1/984: symlink d2/de/d12/dc7/d11b/l151 0 2024-09-11T00:07:38.268 INFO:tasks.workunit.client.1.smithi203.stdout:0/915: dwrite d0/d2/d37/d80/f108 [0,4194304] 0 2024-09-11T00:07:38.270 INFO:tasks.workunit.client.0.smithi111.stdout:1/985: dread - d2/de/d12/d3c/d4b/d6a/d63/d73/f118 zero size 2024-09-11T00:07:38.275 INFO:tasks.workunit.client.1.smithi203.stdout:7/849: dwrite dd/fe9 [0,4194304] 0 2024-09-11T00:07:38.277 INFO:tasks.workunit.client.1.smithi203.stdout:0/916: write d0/d2/d37/d80/fbe [610069,97110] 0 2024-09-11T00:07:38.285 INFO:tasks.workunit.client.1.smithi203.stdout:1/994: dwrite d8/d119/ffc [0,4194304] 0 2024-09-11T00:07:38.286 INFO:tasks.workunit.client.0.smithi111.stdout:1/986: dread d2/de/d12/d3c/d4b/d6a/f9e [0,4194304] 0 2024-09-11T00:07:38.288 INFO:tasks.workunit.client.1.smithi203.stdout:1/995: dread - d8/d19/d60/d90/f122 zero size 2024-09-11T00:07:38.291 INFO:tasks.workunit.client.1.smithi203.stdout:9/914: dread d6/f4a [0,4194304] 0 2024-09-11T00:07:38.291 INFO:tasks.workunit.client.1.smithi203.stdout:4/849: symlink db/dd/d16/d38/d3c/da6/l115 0 2024-09-11T00:07:38.293 INFO:tasks.workunit.client.1.smithi203.stdout:1/996: chown d8/d19/d60/d90/d3e/d4b/d80 9302 1 2024-09-11T00:07:38.298 INFO:tasks.workunit.client.1.smithi203.stdout:5/948: dread dc/dd/d56/fd0 [0,4194304] 0 2024-09-11T00:07:38.300 INFO:tasks.workunit.client.1.smithi203.stdout:4/850: write db/d12/d15/d2a/d88/f90 [3327736,36646] 0 2024-09-11T00:07:38.301 INFO:tasks.workunit.client.1.smithi203.stdout:6/877: dread d0/d71/ff1 [0,4194304] 0 2024-09-11T00:07:38.303 INFO:tasks.workunit.client.0.smithi111.stdout:1/987: truncate d2/de/d12/d3c/d4b/f74 1644388 0 2024-09-11T00:07:38.304 INFO:tasks.workunit.client.0.smithi111.stdout:4/970: write d18/d3b/d51/f67 [865435,98254] 0 2024-09-11T00:07:38.304 INFO:tasks.workunit.client.1.smithi203.stdout:6/878: fsync d0/f5f 0 2024-09-11T00:07:38.307 INFO:tasks.workunit.client.0.smithi111.stdout:6/978: write d7/d22/d1d/d8c/d4a/f85 [1717875,56193] 0 2024-09-11T00:07:38.316 INFO:tasks.workunit.client.0.smithi111.stdout:1/988: rename d2/de/d12/d3c/d4b/d6a/d63/d95/f101 to d2/de/d12/dc7/d12f/f152 0 2024-09-11T00:07:38.316 INFO:tasks.workunit.client.0.smithi111.stdout:2/944: truncate d0/d3/d2e/f4f 1517872 0 2024-09-11T00:07:38.317 INFO:tasks.workunit.client.0.smithi111.stdout:2/945: chown d0/d3 522048 1 2024-09-11T00:07:38.325 INFO:tasks.workunit.client.0.smithi111.stdout:1/989: truncate d2/de/d12/d3c/d4b/d6a/d63/d73/f118 331494 0 2024-09-11T00:07:38.327 INFO:tasks.workunit.client.0.smithi111.stdout:1/990: chown d2/de/d12/d3c/d4b/d6a/d63/d73/da1/d56/d7b/fd6 358 1 2024-09-11T00:07:38.328 INFO:tasks.workunit.client.1.smithi203.stdout:6/879: truncate d0/d54/d9c/d35/f70 1403979 0 2024-09-11T00:07:38.329 INFO:tasks.workunit.client.1.smithi203.stdout:7/850: write dd/d1c/d52/d8f/d31/d67/dc8/f10f [694025,109870] 0 2024-09-11T00:07:38.330 INFO:tasks.workunit.client.1.smithi203.stdout:0/917: write d0/d2/d7e/da1/dc9/de7/d77/f95 [2181468,95613] 0 2024-09-11T00:07:38.333 INFO:tasks.workunit.client.0.smithi111.stdout:4/971: link d18/d20/d40/cab d18/d20/d4a/d6b/c137 0 2024-09-11T00:07:38.336 INFO:tasks.workunit.client.1.smithi203.stdout:9/915: mknod d6/de/c12c 0 2024-09-11T00:07:38.339 INFO:tasks.workunit.client.0.smithi111.stdout:6/979: dwrite d7/d22/d3f/d74/d7f/d79/da4/fe5 [0,4194304] 0 2024-09-11T00:07:38.339 INFO:tasks.workunit.client.0.smithi111.stdout:2/946: rename d0/d3/de/d3b/d97 to d0/d3/de/d3b/d62/d142 0 2024-09-11T00:07:38.340 INFO:tasks.workunit.client.1.smithi203.stdout:8/854: dwrite d1/d13/d17/d48/d61/f71 [4194304,4194304] 0 2024-09-11T00:07:38.340 INFO:tasks.workunit.client.0.smithi111.stdout:2/947: chown d0/d3/de/dd4 1389110 1 2024-09-11T00:07:38.345 INFO:tasks.workunit.client.1.smithi203.stdout:7/851: mknod dd/d1c/d52/d8f/d31/d4a/d105/c133 0 2024-09-11T00:07:38.345 INFO:tasks.workunit.client.1.smithi203.stdout:4/851: link db/d12/d15/d2a/d88/d95/ld9 db/d12/d15/d2a/dc3/l116 0 2024-09-11T00:07:38.345 INFO:tasks.workunit.client.1.smithi203.stdout:1/997: dwrite d8/d9/d15/d27/f39 [0,4194304] 0 2024-09-11T00:07:38.346 INFO:tasks.workunit.client.0.smithi111.stdout:4/972: mknod d18/c138 0 2024-09-11T00:07:38.347 INFO:tasks.workunit.client.0.smithi111.stdout:2/948: mknod d0/d3/d98/c143 0 2024-09-11T00:07:38.349 INFO:tasks.workunit.client.0.smithi111.stdout:1/991: creat d2/f153 x:0 0 0 2024-09-11T00:07:38.351 INFO:tasks.workunit.client.1.smithi203.stdout:7/852: chown dd/d1c/d52/f128 6836 1 2024-09-11T00:07:38.354 INFO:tasks.workunit.client.1.smithi203.stdout:6/880: symlink d0/d54/d9c/d35/d38/dc0/l10e 0 2024-09-11T00:07:38.357 INFO:tasks.workunit.client.0.smithi111.stdout:6/980: link d7/f5e d7/d22/d26/d95/dd6/f14f 0 2024-09-11T00:07:38.359 INFO:tasks.workunit.client.1.smithi203.stdout:8/855: rename d1/d13/d17/d2f/d9e to d1/d13/d22/d6f/d8d/d121 0 2024-09-11T00:07:38.359 INFO:tasks.workunit.client.1.smithi203.stdout:5/949: dread dc/dd/d15/f19 [0,4194304] 0 2024-09-11T00:07:38.361 INFO:tasks.workunit.client.0.smithi111.stdout:1/992: mknod d2/de/d12/d3c/d4b/d6a/d63/d95/c154 0 2024-09-11T00:07:38.367 INFO:tasks.workunit.client.1.smithi203.stdout:6/881: unlink d0/d54/d9c/d35/d39/fd6 0 2024-09-11T00:07:38.370 INFO:tasks.workunit.client.0.smithi111.stdout:1/993: creat d2/de/d12/d3c/d4b/d6a/d63/d73/db8/f155 x:0 0 0 2024-09-11T00:07:38.373 INFO:tasks.workunit.client.1.smithi203.stdout:0/918: getdents d0 0 2024-09-11T00:07:38.373 INFO:tasks.workunit.client.1.smithi203.stdout:5/950: creat dc/dd/d56/f13a x:0 0 0 2024-09-11T00:07:38.375 INFO:tasks.workunit.client.1.smithi203.stdout:4/852: creat db/d12/d15/d2a/d88/d95/dc2/d100/f117 x:0 0 0 2024-09-11T00:07:38.377 INFO:tasks.workunit.client.1.smithi203.stdout:9/916: dwrite d6/de/d19/d24/f6d [8388608,4194304] 0 2024-09-11T00:07:38.377 INFO:tasks.workunit.client.1.smithi203.stdout:7/853: truncate dd/d1c/fb7 15132 0 2024-09-11T00:07:38.378 INFO:tasks.workunit.client.1.smithi203.stdout:0/919: write d0/d2/db3/f100 [687675,12877] 0 2024-09-11T00:07:38.379 INFO:tasks.workunit.client.1.smithi203.stdout:4/853: chown db/dd/d26/l80 4913 1 2024-09-11T00:07:38.383 INFO:tasks.workunit.client.1.smithi203.stdout:4/854: read db/f7e [674113,124358] 0 2024-09-11T00:07:38.388 INFO:tasks.workunit.client.1.smithi203.stdout:5/951: creat dc/dd/d15/dac/f13b x:0 0 0 2024-09-11T00:07:38.390 INFO:tasks.workunit.client.1.smithi203.stdout:5/952: stat dc/dd/d9b/ffd 0 2024-09-11T00:07:38.391 INFO:tasks.workunit.client.1.smithi203.stdout:0/920: fdatasync d0/d2/d7e/dd2/fd4 0 2024-09-11T00:07:38.393 INFO:tasks.workunit.client.1.smithi203.stdout:7/854: mkdir dd/d1c/d52/d8f/d31/d67/dc3/d134 0 2024-09-11T00:07:38.397 INFO:tasks.workunit.client.1.smithi203.stdout:4/855: fdatasync db/dd/d16/d38/d3c/d41/fcf 0 2024-09-11T00:07:38.397 INFO:tasks.workunit.client.0.smithi111.stdout:2/949: write d0/d3/de/f5d [4550553,47063] 0 2024-09-11T00:07:38.399 INFO:tasks.workunit.client.0.smithi111.stdout:4/973: truncate d18/d20/d40/f42 3821633 0 2024-09-11T00:07:38.406 INFO:tasks.workunit.client.1.smithi203.stdout:7/855: rmdir dd/d3b/d9f 39 2024-09-11T00:07:38.411 INFO:tasks.workunit.client.1.smithi203.stdout:8/856: creat d1/d13/d17/d48/d61/f122 x:0 0 0 2024-09-11T00:07:38.411 INFO:tasks.workunit.client.0.smithi111.stdout:6/981: write d7/d22/d1d/d83/d121/d41/d77/ffc [384189,21553] 0 2024-09-11T00:07:38.413 INFO:tasks.workunit.client.1.smithi203.stdout:1/998: dwrite d8/d9/f63 [4194304,4194304] 0 2024-09-11T00:07:38.414 INFO:tasks.workunit.client.0.smithi111.stdout:1/994: dwrite d2/d77/ff7 [0,4194304] 0 2024-09-11T00:07:38.418 INFO:tasks.workunit.client.0.smithi111.stdout:4/974: dwrite d18/d20/d3c/d5e/d75/d8d/dce/ff8 [4194304,4194304] 0 2024-09-11T00:07:38.418 INFO:tasks.workunit.client.0.smithi111.stdout:6/982: dread - d7/d22/d3f/d74/d7f/d61/d6a/d9f/f12c zero size 2024-09-11T00:07:38.420 INFO:tasks.workunit.client.0.smithi111.stdout:6/983: chown d7/d22/d2c/d38/d56/dbf/f102 240325883 1 2024-09-11T00:07:38.422 INFO:tasks.workunit.client.1.smithi203.stdout:6/882: dwrite d0/d32/f7a [0,4194304] 0 2024-09-11T00:07:38.424 INFO:tasks.workunit.client.0.smithi111.stdout:4/975: dread d18/d20/d40/fc4 [0,4194304] 0 2024-09-11T00:07:38.424 INFO:tasks.workunit.client.1.smithi203.stdout:6/883: chown d0/d54/d9c/d35/d38/d73/da1 765 1 2024-09-11T00:07:38.426 INFO:tasks.workunit.client.1.smithi203.stdout:5/953: getdents dc/dd/d56/dad/d100 0 2024-09-11T00:07:38.435 INFO:tasks.workunit.client.1.smithi203.stdout:8/857: creat d1/d13/d22/f123 x:0 0 0 2024-09-11T00:07:38.441 INFO:tasks.workunit.client.1.smithi203.stdout:0/921: creat d0/d2/f12a x:0 0 0 2024-09-11T00:07:38.445 INFO:tasks.workunit.client.0.smithi111.stdout:2/950: truncate d0/d3/de/d3b/d63/fdd 3959874 0 2024-09-11T00:07:38.446 INFO:tasks.workunit.client.1.smithi203.stdout:5/954: creat dc/dd/d15/dbd/d126/f13c x:0 0 0 2024-09-11T00:07:38.448 INFO:tasks.workunit.client.1.smithi203.stdout:9/917: dwrite d6/de/d19/d24/f57 [0,4194304] 0 2024-09-11T00:07:38.448 INFO:tasks.workunit.client.1.smithi203.stdout:8/858: symlink d1/d13/d22/d6f/l124 0 2024-09-11T00:07:38.453 INFO:tasks.workunit.client.1.smithi203.stdout:8/859: write d1/d13/d22/d6f/d8d/d121/f114 [539549,65540] 0 2024-09-11T00:07:38.456 INFO:tasks.workunit.client.1.smithi203.stdout:6/884: mknod d0/d32/c10f 0 2024-09-11T00:07:38.456 INFO:tasks.workunit.client.1.smithi203.stdout:7/856: write dd/d1c/d52/d8f/d31/ff4 [958955,35199] 0 2024-09-11T00:07:38.460 INFO:tasks.workunit.client.1.smithi203.stdout:2/976: sync 2024-09-11T00:07:38.460 INFO:tasks.workunit.client.1.smithi203.stdout:3/952: sync 2024-09-11T00:07:38.461 INFO:tasks.workunit.client.1.smithi203.stdout:5/955: unlink dc/dd/d9b/lcd 0 2024-09-11T00:07:38.462 INFO:tasks.workunit.client.1.smithi203.stdout:4/856: getdents db/dd/d16/d38/d3c/da6 0 2024-09-11T00:07:38.462 INFO:tasks.workunit.client.0.smithi111.stdout:2/951: getdents d0/d3/d12/d38 0 2024-09-11T00:07:38.464 INFO:tasks.workunit.client.1.smithi203.stdout:9/918: mknod d6/de/d32/d52/d55/d66/c12d 0 2024-09-11T00:07:38.470 INFO:tasks.workunit.client.1.smithi203.stdout:6/885: truncate d0/f8 804604 0 2024-09-11T00:07:38.473 INFO:tasks.workunit.client.1.smithi203.stdout:8/860: mkdir d1/d13/d17/d2f/d52/d49/d68/dba/d125 0 2024-09-11T00:07:38.476 INFO:tasks.workunit.client.1.smithi203.stdout:3/953: read d8/da/db3/f54 [42419,3368] 0 2024-09-11T00:07:38.477 INFO:tasks.workunit.client.1.smithi203.stdout:1/999: dwrite d8/f1a [0,4194304] 0 2024-09-11T00:07:38.478 INFO:tasks.workunit.client.0.smithi111.stdout:4/976: dread d18/f71 [0,4194304] 0 2024-09-11T00:07:38.479 INFO:tasks.workunit.client.1.smithi203.stdout:2/977: creat d13/d15/d30/dfa/daf/f145 x:0 0 0 2024-09-11T00:07:38.479 INFO:tasks.workunit.client.1.smithi203.stdout:3/954: stat d8/d17/ddd/d139/f13f 0 2024-09-11T00:07:38.479 INFO:tasks.workunit.client.1.smithi203.stdout:0/922: rmdir d0/d2/d37/d5b/d103 0 2024-09-11T00:07:38.480 INFO:tasks.workunit.client.1.smithi203.stdout:2/978: write d13/d15/d30/d59/f6a [999720,128260] 0 2024-09-11T00:07:38.481 INFO:tasks.workunit.client.1.smithi203.stdout:0/923: readlink d0/d1d/d5d/d70/l11d 0 2024-09-11T00:07:38.484 INFO:tasks.workunit.client.0.smithi111.stdout:2/952: rename d0/d3/de/f4a to d0/d3/de/d3b/d62/f144 0 2024-09-11T00:07:38.486 INFO:tasks.workunit.client.1.smithi203.stdout:5/956: unlink dc/d4f/d5c/d76/f111 0 2024-09-11T00:07:38.487 INFO:tasks.workunit.client.1.smithi203.stdout:5/957: read - dc/dd/d15/dac/f13b zero size 2024-09-11T00:07:38.491 INFO:tasks.workunit.client.1.smithi203.stdout:4/857: rmdir db/dd/d26/d42 39 2024-09-11T00:07:38.492 INFO:tasks.workunit.client.1.smithi203.stdout:0/924: dread d0/d2/db3/f100 [0,4194304] 0 2024-09-11T00:07:38.494 INFO:tasks.workunit.client.1.smithi203.stdout:9/919: rename d6/de/d19/d24/d6c/le5 to d6/de/d32/d52/d55/d66/daa/df7/l12e 0 2024-09-11T00:07:38.500 INFO:tasks.workunit.client.1.smithi203.stdout:6/886: mknod d0/d5b/d5c/d6f/c110 0 2024-09-11T00:07:38.501 INFO:tasks.workunit.client.0.smithi111.stdout:2/953: dread d0/d3/d12/d52/d6c/fd0 [0,4194304] 0 2024-09-11T00:07:38.506 INFO:tasks.workunit.client.0.smithi111.stdout:6/984: sync 2024-09-11T00:07:38.506 INFO:tasks.workunit.client.0.smithi111.stdout:1/995: sync 2024-09-11T00:07:38.511 INFO:tasks.workunit.client.1.smithi203.stdout:2/979: truncate d13/d15/d30/dfa/daf/dec/f13e 957737 0 2024-09-11T00:07:38.515 INFO:tasks.workunit.client.0.smithi111.stdout:6/985: rename d7/d22/d2c/c5c to d7/d22/d3f/d74/d7f/d61/d6a/d9f/db6/c150 0 2024-09-11T00:07:38.517 INFO:tasks.workunit.client.0.smithi111.stdout:4/977: link d18/d39/cc0 d18/d20/d3c/d5e/daa/dbb/dfa/d135/c139 0 2024-09-11T00:07:38.517 INFO:tasks.workunit.client.1.smithi203.stdout:7/857: write dd/d1c/fb7 [873594,18967] 0 2024-09-11T00:07:38.518 INFO:tasks.workunit.client.0.smithi111.stdout:6/986: fdatasync d7/d22/d3f/d74/d7f/d79/da4/f13b 0 2024-09-11T00:07:38.519 INFO:tasks.workunit.client.0.smithi111.stdout:4/978: dread - d18/d20/d3c/d5e/f126 zero size 2024-09-11T00:07:38.520 INFO:tasks.workunit.client.1.smithi203.stdout:9/920: fsync d6/f76 0 2024-09-11T00:07:38.520 INFO:tasks.workunit.client.1.smithi203.stdout:8/861: dread d1/d13/d22/d6f/f60 [0,4194304] 0 2024-09-11T00:07:38.524 INFO:tasks.workunit.client.0.smithi111.stdout:2/954: getdents d0/d3/d12/d52/d6c 0 2024-09-11T00:07:38.524 INFO:tasks.workunit.client.1.smithi203.stdout:8/862: chown d1/d13/d17/d8b/fcb 70602419 1 2024-09-11T00:07:38.529 INFO:tasks.workunit.client.0.smithi111.stdout:6/987: readlink d7/d22/d1d/l90 0 2024-09-11T00:07:38.530 INFO:tasks.workunit.client.1.smithi203.stdout:2/980: dread - d13/d15/d19/f114 zero size 2024-09-11T00:07:38.531 INFO:tasks.workunit.client.0.smithi111.stdout:4/979: creat d18/d3b/d9f/db7/de5/f13a x:0 0 0 2024-09-11T00:07:38.532 INFO:tasks.workunit.client.1.smithi203.stdout:0/925: symlink d0/d2/d37/l12b 0 2024-09-11T00:07:38.533 INFO:tasks.workunit.client.1.smithi203.stdout:7/858: fsync dd/d3b/d5b/f7b 0 2024-09-11T00:07:38.535 INFO:tasks.workunit.client.1.smithi203.stdout:5/958: dwrite dc/dd/d1e/f21 [0,4194304] 0 2024-09-11T00:07:38.536 INFO:tasks.workunit.client.1.smithi203.stdout:3/955: rename l6 to d8/da/d37/d83/d65/d8b/d14b/l156 0 2024-09-11T00:07:38.537 INFO:tasks.workunit.client.0.smithi111.stdout:4/980: symlink d18/d3b/dae/l13b 0 2024-09-11T00:07:38.538 INFO:tasks.workunit.client.0.smithi111.stdout:2/955: symlink d0/d3/de/l145 0 2024-09-11T00:07:38.539 INFO:tasks.workunit.client.0.smithi111.stdout:4/981: chown d18/d20/d3c/d5e/daa/f104 24732318 1 2024-09-11T00:07:38.541 INFO:tasks.workunit.client.1.smithi203.stdout:8/863: rename d1/d13/d3a/d75 to d1/d13/d3a/d126 0 2024-09-11T00:07:38.546 INFO:tasks.workunit.client.1.smithi203.stdout:6/887: dwrite d0/d32/d5a/fb7 [0,4194304] 0 2024-09-11T00:07:38.546 INFO:tasks.workunit.client.1.smithi203.stdout:8/864: write d1/d13/d17/d81/d97/f106 [2791184,109807] 0 2024-09-11T00:07:38.553 INFO:tasks.workunit.client.0.smithi111.stdout:6/988: write d7/f15 [2431993,84038] 0 2024-09-11T00:07:38.559 INFO:tasks.workunit.client.1.smithi203.stdout:4/858: rename db/d12/d15/d2a/d88/df6 to db/d12/d15/d2a/d88/d95/dc2/d118 0 2024-09-11T00:07:38.563 INFO:tasks.workunit.client.1.smithi203.stdout:2/981: mknod d13/c146 0 2024-09-11T00:07:38.566 INFO:tasks.workunit.client.0.smithi111.stdout:6/989: truncate d7/d22/d3f/d74/d7f/d79/f146 4514081 0 2024-09-11T00:07:38.570 INFO:tasks.workunit.client.1.smithi203.stdout:8/865: creat d1/d13/d43/d46/d76/dac/f127 x:0 0 0 2024-09-11T00:07:38.572 INFO:tasks.workunit.client.1.smithi203.stdout:5/959: dread dc/dd/d1e/dc6/ff3 [0,4194304] 0 2024-09-11T00:07:38.573 INFO:tasks.workunit.client.0.smithi111.stdout:2/956: write d0/d3/de/d3b/d63/fa5 [2675428,58978] 0 2024-09-11T00:07:38.576 INFO:tasks.workunit.client.0.smithi111.stdout:6/990: truncate d7/d22/fa8 559490 0 2024-09-11T00:07:38.578 INFO:tasks.workunit.client.0.smithi111.stdout:2/957: rmdir d0/d3/de/d50/dda 39 2024-09-11T00:07:38.581 INFO:tasks.workunit.client.0.smithi111.stdout:6/991: creat d7/d22/d26/d95/dd6/f151 x:0 0 0 2024-09-11T00:07:38.582 INFO:tasks.workunit.client.1.smithi203.stdout:9/921: link d6/de/d19/d24/f114 d6/de/d47/f12f 0 2024-09-11T00:07:38.582 INFO:tasks.workunit.client.0.smithi111.stdout:4/982: dwrite d18/d1f/d33/fd4 [0,4194304] 0 2024-09-11T00:07:38.583 INFO:tasks.workunit.client.0.smithi111.stdout:6/992: write d7/d22/d2c/d38/f71 [3028269,32906] 0 2024-09-11T00:07:38.583 INFO:tasks.workunit.client.1.smithi203.stdout:3/956: creat d8/da/d5c/d6b/d6c/d135/f157 x:0 0 0 2024-09-11T00:07:38.584 INFO:tasks.workunit.client.1.smithi203.stdout:5/960: write dc/d4f/d5c/f12f [980235,73942] 0 2024-09-11T00:07:38.588 INFO:tasks.workunit.client.0.smithi111.stdout:4/983: fdatasync d18/d20/d3c/f9a 0 2024-09-11T00:07:38.588 INFO:tasks.workunit.client.1.smithi203.stdout:8/866: creat d1/d13/d17/d2f/d52/d59/f128 x:0 0 0 2024-09-11T00:07:38.590 INFO:tasks.workunit.client.1.smithi203.stdout:9/922: fdatasync d6/de/d19/d24/d40/d45/fff 0 2024-09-11T00:07:38.595 INFO:tasks.workunit.client.0.smithi111.stdout:6/993: rename d7/d22/d3f/d74/d7f/d79/da4/d117/l130 to d7/d22/d1d/d8c/l152 0 2024-09-11T00:07:38.597 INFO:tasks.workunit.client.1.smithi203.stdout:6/888: dwrite d0/d54/d9c/f72 [4194304,4194304] 0 2024-09-11T00:07:38.598 INFO:tasks.workunit.client.1.smithi203.stdout:7/859: dwrite dd/d1c/d52/d8f/d31/d4a/d105/f4c [0,4194304] 0 2024-09-11T00:07:38.611 INFO:tasks.workunit.client.0.smithi111.stdout:4/984: creat d18/d20/d40/d78/d79/d90/d11f/d12f/f13c x:0 0 0 2024-09-11T00:07:38.614 INFO:tasks.workunit.client.0.smithi111.stdout:6/994: truncate d7/d22/d1d/d83/d121/d41/f82 61858 0 2024-09-11T00:07:38.618 INFO:tasks.workunit.client.0.smithi111.stdout:2/958: dwrite d0/d3/d12/fef [0,4194304] 0 2024-09-11T00:07:38.621 INFO:tasks.workunit.client.0.smithi111.stdout:1/996: sync 2024-09-11T00:07:38.624 INFO:tasks.workunit.client.0.smithi111.stdout:2/959: symlink d0/d3/de/d10e/l146 0 2024-09-11T00:07:38.624 INFO:tasks.workunit.client.0.smithi111.stdout:1/997: write d2/de/d12/d3c/d4b/d6a/d63/d95/fdf [332771,14671] 0 2024-09-11T00:07:38.628 INFO:tasks.workunit.client.0.smithi111.stdout:1/998: chown d2/de/d12/d3c/d4b/d6a/d63/d73/da1/fc2 135781 1 2024-09-11T00:07:38.629 INFO:tasks.workunit.client.0.smithi111.stdout:6/995: creat d7/d22/d1d/d83/d121/f153 x:0 0 0 2024-09-11T00:07:38.631 INFO:tasks.workunit.client.0.smithi111.stdout:1/999: write d2/de/d12/d3c/d4b/d6a/d63/f6e [524063,96404] 0 2024-09-11T00:07:38.632 INFO:tasks.workunit.client.0.smithi111.stdout:2/960: rename d0/d3/de/d3b/d92/d103 to d0/d3/d98/d147 0 2024-09-11T00:07:38.638 INFO:tasks.workunit.client.0.smithi111.stdout:2/961: chown d0/d3/de/db4/lca 45052 1 2024-09-11T00:07:38.638 INFO:tasks.workunit.client.1.smithi203.stdout:8/867: dread d1/d13/d43/d46/db0/fd4 [0,4194304] 0 2024-09-11T00:07:38.642 INFO:tasks.workunit.client.0.smithi111.stdout:6/996: rename d7/d22/d2c/d38/d56/dbf/fc3 to d7/d22/d2c/dff/f154 0 2024-09-11T00:07:38.643 INFO:tasks.workunit.client.0.smithi111.stdout:2/962: chown d0/ce3 3009 1 2024-09-11T00:07:38.646 INFO:tasks.workunit.client.0.smithi111.stdout:2/963: rmdir d0/d3/de/d3b/d62/d142/d104 39 2024-09-11T00:07:38.647 INFO:tasks.workunit.client.0.smithi111.stdout:2/964: readlink d0/d3/de/d3b/d63/lcf 0 2024-09-11T00:07:38.654 INFO:tasks.workunit.client.1.smithi203.stdout:2/982: mkdir d13/d15/d19/d1c/d73/d137/d147 0 2024-09-11T00:07:38.655 INFO:tasks.workunit.client.1.smithi203.stdout:0/926: link d0/d1d/c113 d0/d2/d7e/da1/c12c 0 2024-09-11T00:07:38.660 INFO:tasks.workunit.client.1.smithi203.stdout:7/860: truncate dd/d4d/f90 1412283 0 2024-09-11T00:07:38.663 INFO:tasks.workunit.client.1.smithi203.stdout:6/889: rename d0/d54/d9c/d7b/d7e/d94/c9b to d0/d5b/d5c/d6f/de7/d107/c111 0 2024-09-11T00:07:38.664 INFO:tasks.workunit.client.1.smithi203.stdout:5/961: dread dc/dd/d1e/f54 [0,4194304] 0 2024-09-11T00:07:38.665 INFO:tasks.workunit.client.1.smithi203.stdout:8/868: unlink d1/d13/d17/d81/d97/cd7 0 2024-09-11T00:07:38.666 INFO:tasks.workunit.client.1.smithi203.stdout:7/861: dread dd/d1c/d52/d8f/d31/d58/f64 [4194304,4194304] 0 2024-09-11T00:07:38.668 INFO:tasks.workunit.client.1.smithi203.stdout:0/927: creat d0/d1d/d5d/d70/f12d x:0 0 0 2024-09-11T00:07:38.672 INFO:tasks.workunit.client.1.smithi203.stdout:5/962: truncate dc/fd4 1114873 0 2024-09-11T00:07:38.674 INFO:tasks.workunit.client.1.smithi203.stdout:4/859: getdents db/d12/d15/d2a 0 2024-09-11T00:07:38.675 INFO:tasks.workunit.client.1.smithi203.stdout:8/869: rename d1/d13/d17/d48/d9d/da9/cf5 to d1/d13/d17/d48/d61/d113/c129 0 2024-09-11T00:07:38.675 INFO:tasks.workunit.client.1.smithi203.stdout:4/860: dread - db/d12/fab zero size 2024-09-11T00:07:38.678 INFO:tasks.workunit.client.1.smithi203.stdout:3/957: creat d8/da/d37/d83/d6a/f158 x:0 0 0 2024-09-11T00:07:38.678 INFO:tasks.workunit.client.1.smithi203.stdout:8/870: readlink d1/d13/d17/d2f/d52/d59/l90 0 2024-09-11T00:07:38.679 INFO:tasks.workunit.client.1.smithi203.stdout:4/861: fdatasync db/d12/d15/d2a/d88/d95/dc2/d118/f10d 0 2024-09-11T00:07:38.680 INFO:tasks.workunit.client.1.smithi203.stdout:2/983: truncate d13/d15/d30/d5a/fef 1910996 0 2024-09-11T00:07:38.682 INFO:tasks.workunit.client.1.smithi203.stdout:4/862: dread - db/dd/ff7 zero size 2024-09-11T00:07:38.682 INFO:tasks.workunit.client.1.smithi203.stdout:3/958: write d8/da/d37/d83/d65/f150 [447488,13254] 0 2024-09-11T00:07:38.687 INFO:tasks.workunit.client.1.smithi203.stdout:7/862: rename dd/d1c/d52/d8f/d31/d67/dc8/cbf to dd/d1c/d52/d8f/d31/d4a/d6e/dcc/dea/c135 0 2024-09-11T00:07:38.688 INFO:tasks.workunit.client.1.smithi203.stdout:6/890: dwrite d0/d71/ff1 [0,4194304] 0 2024-09-11T00:07:38.689 INFO:tasks.workunit.client.1.smithi203.stdout:8/871: read - d1/d13/d43/dab/f10d zero size 2024-09-11T00:07:38.694 INFO:tasks.workunit.client.1.smithi203.stdout:2/984: dread - d13/d15/d30/d5a/f10b zero size 2024-09-11T00:07:38.694 INFO:tasks.workunit.client.1.smithi203.stdout:0/928: mknod d0/d87/db9/dd5/c12e 0 2024-09-11T00:07:38.697 INFO:tasks.workunit.client.1.smithi203.stdout:7/863: chown dd/d1c/d7c/l99 30928 1 2024-09-11T00:07:38.699 INFO:tasks.workunit.client.1.smithi203.stdout:6/891: unlink d0/d54/d9c/d35/d39/d3c/l59 0 2024-09-11T00:07:38.703 INFO:tasks.workunit.client.1.smithi203.stdout:2/985: dread - d13/d22/dd6/f126 zero size 2024-09-11T00:07:38.703 INFO:tasks.workunit.client.1.smithi203.stdout:0/929: read - d0/d2/d37/d5b/d73/db6/f106 zero size 2024-09-11T00:07:38.704 INFO:tasks.workunit.client.1.smithi203.stdout:9/923: write d6/de/d19/d21/f93 [672528,130457] 0 2024-09-11T00:07:38.705 INFO:tasks.workunit.client.0.smithi111.stdout:2/965: dwrite d0/d3/d12/d52/f87 [4194304,4194304] 0 2024-09-11T00:07:38.708 INFO:tasks.workunit.client.1.smithi203.stdout:7/864: symlink dd/d1c/d52/d8f/d31/d67/dc3/l136 0 2024-09-11T00:07:38.709 INFO:tasks.workunit.client.0.smithi111.stdout:4/985: sync 2024-09-11T00:07:38.713 INFO:tasks.workunit.client.1.smithi203.stdout:6/892: symlink d0/d54/l112 0 2024-09-11T00:07:38.714 INFO:tasks.workunit.client.1.smithi203.stdout:3/959: dread d8/da/d11/f55 [0,4194304] 0 2024-09-11T00:07:38.716 INFO:tasks.workunit.client.0.smithi111.stdout:2/966: dread d0/d3/f3e [0,4194304] 0 2024-09-11T00:07:38.718 INFO:tasks.workunit.client.1.smithi203.stdout:0/930: symlink d0/d2/d37/d5b/l12f 0 2024-09-11T00:07:38.718 INFO:tasks.workunit.client.0.smithi111.stdout:2/967: readlink d0/d3/de/d3b/d63/lea 0 2024-09-11T00:07:38.722 INFO:tasks.workunit.client.1.smithi203.stdout:2/986: dread - d13/d15/d30/d5a/dcf/f10d zero size 2024-09-11T00:07:38.723 INFO:tasks.workunit.client.0.smithi111.stdout:4/986: dwrite d18/d1f/d33/f59 [0,4194304] 0 2024-09-11T00:07:38.729 INFO:tasks.workunit.client.1.smithi203.stdout:5/963: dwrite dc/d91/fdb [0,4194304] 0 2024-09-11T00:07:38.730 INFO:tasks.workunit.client.0.smithi111.stdout:2/968: mknod d0/d3/de/d50/dda/d132/c148 0 2024-09-11T00:07:38.732 INFO:tasks.workunit.client.1.smithi203.stdout:3/960: creat d8/da/d37/d11e/f159 x:0 0 0 2024-09-11T00:07:38.735 INFO:tasks.workunit.client.1.smithi203.stdout:9/924: mkdir d6/de/d19/d24/d40/d45/d130 0 2024-09-11T00:07:38.735 INFO:tasks.workunit.client.1.smithi203.stdout:4/863: dwrite db/f73 [0,4194304] 0 2024-09-11T00:07:38.736 INFO:tasks.workunit.client.0.smithi111.stdout:6/997: sync 2024-09-11T00:07:38.737 INFO:tasks.workunit.client.1.smithi203.stdout:3/961: read - d8/da/d37/d83/d65/f153 zero size 2024-09-11T00:07:38.738 INFO:tasks.workunit.client.0.smithi111.stdout:4/987: link d18/d20/d40/d78/fcb d18/d20/d40/d78/d100/f13d 0 2024-09-11T00:07:38.739 INFO:tasks.workunit.client.0.smithi111.stdout:4/988: chown d18/d20/d40/d78/d79 159 1 2024-09-11T00:07:38.744 INFO:tasks.workunit.client.0.smithi111.stdout:6/998: creat d7/d22/d3f/d74/d14b/f155 x:0 0 0 2024-09-11T00:07:38.746 INFO:tasks.workunit.client.1.smithi203.stdout:2/987: creat d13/d15/d12d/f148 x:0 0 0 2024-09-11T00:07:38.746 INFO:tasks.workunit.client.1.smithi203.stdout:8/872: link d1/d13/d17/d2f/d52/d59/f6e d1/d13/d17/d2f/d52/f12a 0 2024-09-11T00:07:38.748 INFO:tasks.workunit.client.0.smithi111.stdout:4/989: truncate d18/d3b/d51/f103 699806 0 2024-09-11T00:07:38.753 INFO:tasks.workunit.client.1.smithi203.stdout:9/925: stat d6/de/d47/ffa 0 2024-09-11T00:07:38.753 INFO:tasks.workunit.client.1.smithi203.stdout:3/962: mknod d8/da/d37/c15a 0 2024-09-11T00:07:38.758 INFO:tasks.workunit.client.1.smithi203.stdout:9/926: dread - d6/de/d19/d24/d54/db2/f109 zero size 2024-09-11T00:07:38.759 INFO:tasks.workunit.client.1.smithi203.stdout:8/873: mkdir d1/d13/d22/d6f/d12b 0 2024-09-11T00:07:38.761 INFO:tasks.workunit.client.0.smithi111.stdout:6/999: dwrite d7/d2b/fae [4194304,4194304] 0 2024-09-11T00:07:38.766 INFO:tasks.workunit.client.1.smithi203.stdout:0/931: link d0/d2/d7e/da1/df5/l9e d0/d2/d7e/da1/d120/l130 0 2024-09-11T00:07:38.769 INFO:tasks.workunit.client.1.smithi203.stdout:3/963: creat d8/da/d5c/d6b/d6c/f15b x:0 0 0 2024-09-11T00:07:38.771 INFO:tasks.workunit.client.1.smithi203.stdout:6/893: dwrite d0/d32/f100 [0,4194304] 0 2024-09-11T00:07:38.771 INFO:tasks.workunit.client.1.smithi203.stdout:2/988: fdatasync d13/d102/f120 0 2024-09-11T00:07:38.774 INFO:tasks.workunit.client.1.smithi203.stdout:7/865: getdents dd/d1c/d52/d8f/d31/d4a/d6e/df6 0 2024-09-11T00:07:38.774 INFO:tasks.workunit.client.1.smithi203.stdout:5/964: creat dc/f13d x:0 0 0 2024-09-11T00:07:38.777 INFO:tasks.workunit.client.1.smithi203.stdout:0/932: mknod d0/d2/d7e/c131 0 2024-09-11T00:07:38.779 INFO:tasks.workunit.client.1.smithi203.stdout:3/964: rmdir d8/d3c 39 2024-09-11T00:07:38.779 INFO:tasks.workunit.client.1.smithi203.stdout:6/894: chown d0/d5b/d5c/d6f/de7 868 1 2024-09-11T00:07:38.781 INFO:tasks.workunit.client.1.smithi203.stdout:7/866: read dd/d1c/fb7 [207600,50033] 0 2024-09-11T00:07:38.783 INFO:tasks.workunit.client.1.smithi203.stdout:0/933: fsync d0/d2/d37/f47 0 2024-09-11T00:07:38.785 INFO:tasks.workunit.client.1.smithi203.stdout:5/965: write dc/dd/d15/dbd/dce/fdc [4316942,110345] 0 2024-09-11T00:07:38.785 INFO:tasks.workunit.client.1.smithi203.stdout:2/989: chown d13/d15/d30/d5a/dcf/l141 1 1 2024-09-11T00:07:38.789 INFO:tasks.workunit.client.1.smithi203.stdout:3/965: symlink d8/da/d37/l15c 0 2024-09-11T00:07:38.789 INFO:tasks.workunit.client.1.smithi203.stdout:2/990: chown d13/d15/d19/f28 4 1 2024-09-11T00:07:38.790 INFO:tasks.workunit.client.1.smithi203.stdout:7/867: write dd/d3b/d5b/f127 [993325,98811] 0 2024-09-11T00:07:38.790 INFO:tasks.workunit.client.1.smithi203.stdout:5/966: read - dc/dd/d15/d3b/d7a/f117 zero size 2024-09-11T00:07:38.800 INFO:tasks.workunit.client.1.smithi203.stdout:3/966: mkdir d8/da/d37/d15d 0 2024-09-11T00:07:38.801 INFO:tasks.workunit.client.1.smithi203.stdout:2/991: truncate d13/d47/f61 761878 0 2024-09-11T00:07:38.801 INFO:tasks.workunit.client.0.smithi111.stdout:2/969: write d0/d3/de/f44 [2793263,89251] 0 2024-09-11T00:07:38.802 INFO:tasks.workunit.client.0.smithi111.stdout:4/990: rename d18/d3b/d51/f103 to d18/d20/d4a/d6b/f13e 0 2024-09-11T00:07:38.806 INFO:tasks.workunit.client.0.smithi111.stdout:2/970: mkdir d0/d3/d98/d147/d149 0 2024-09-11T00:07:38.808 INFO:tasks.workunit.client.0.smithi111.stdout:4/991: creat d18/d20/d3c/d5e/d75/d8d/dce/f13f x:0 0 0 2024-09-11T00:07:38.809 INFO:tasks.workunit.client.0.smithi111.stdout:2/971: rmdir d0/d3/de/d3b/d63 39 2024-09-11T00:07:38.811 INFO:tasks.workunit.client.0.smithi111.stdout:2/972: symlink d0/d11b/l14a 0 2024-09-11T00:07:38.812 INFO:tasks.workunit.client.0.smithi111.stdout:4/992: rename d18/d20/d3c/d5e/l73 to d18/d1f/d36/d95/l140 0 2024-09-11T00:07:38.814 INFO:tasks.workunit.client.0.smithi111.stdout:2/973: rename d0/d3/de/d3b to d0/d3/de/d3b/d62/d142/d14b 22 2024-09-11T00:07:38.814 INFO:tasks.workunit.client.0.smithi111.stdout:4/993: read - d18/d20/d40/d78/d79/db0/de2/f130 zero size 2024-09-11T00:07:38.815 INFO:tasks.workunit.client.0.smithi111.stdout:2/974: chown d0/d3/d12/d52/fcb 15046433 1 2024-09-11T00:07:38.816 INFO:tasks.workunit.client.1.smithi203.stdout:3/967: write d8/f13e [761626,77414] 0 2024-09-11T00:07:38.821 INFO:tasks.workunit.client.1.smithi203.stdout:2/992: creat d13/d15/d30/dfa/daf/f149 x:0 0 0 2024-09-11T00:07:38.829 INFO:tasks.workunit.client.0.smithi111.stdout:4/994: getdents d18/d1f/d36/d95 0 2024-09-11T00:07:38.829 INFO:tasks.workunit.client.0.smithi111.stdout:4/995: chown d18 132813 1 2024-09-11T00:07:38.830 INFO:tasks.workunit.client.1.smithi203.stdout:6/895: dwrite d0/d5b/d9f/fbb [4194304,4194304] 0 2024-09-11T00:07:38.831 INFO:tasks.workunit.client.1.smithi203.stdout:3/968: fdatasync d8/da/d37/d53/dea/fb7 0 2024-09-11T00:07:38.832 INFO:tasks.workunit.client.0.smithi111.stdout:2/975: getdents d0/d3/de/d3b/d62 0 2024-09-11T00:07:38.844 INFO:tasks.workunit.client.1.smithi203.stdout:4/864: dwrite db/dd/d16/d38/d3c/f72 [0,4194304] 0 2024-09-11T00:07:38.846 INFO:tasks.workunit.client.1.smithi203.stdout:0/934: dwrite d0/d2/f32 [4194304,4194304] 0 2024-09-11T00:07:38.847 INFO:tasks.workunit.client.1.smithi203.stdout:2/993: write d13/d15/d12d/f148 [683250,116512] 0 2024-09-11T00:07:38.847 INFO:tasks.workunit.client.1.smithi203.stdout:9/927: dwrite d6/de/d47/f61 [0,4194304] 0 2024-09-11T00:07:38.849 INFO:tasks.workunit.client.1.smithi203.stdout:4/865: dread - db/dd/d26/dcd/dfb/f105 zero size 2024-09-11T00:07:38.855 INFO:tasks.workunit.client.1.smithi203.stdout:7/868: dwrite dd/f1a [0,4194304] 0 2024-09-11T00:07:38.860 INFO:tasks.workunit.client.1.smithi203.stdout:5/967: dread dc/dd/d15/f23 [0,4194304] 0 2024-09-11T00:07:38.860 INFO:tasks.workunit.client.1.smithi203.stdout:6/896: unlink d0/d54/d9c/d7b/cbd 0 2024-09-11T00:07:38.861 INFO:tasks.workunit.client.1.smithi203.stdout:3/969: fsync d8/da/d5c/d80/fb8 0 2024-09-11T00:07:38.861 INFO:tasks.workunit.client.1.smithi203.stdout:2/994: mknod d13/d15/d19/d1c/dfd/c14a 0 2024-09-11T00:07:38.862 INFO:tasks.workunit.client.1.smithi203.stdout:6/897: readlink d0/l12 0 2024-09-11T00:07:38.862 INFO:tasks.workunit.client.1.smithi203.stdout:9/928: truncate d6/de/d19/d24/f27 2489344 0 2024-09-11T00:07:38.863 INFO:tasks.workunit.client.1.smithi203.stdout:0/935: rename d0/d9f/ca0 to d0/d1d/d5d/d10a/c132 0 2024-09-11T00:07:38.865 INFO:tasks.workunit.client.1.smithi203.stdout:3/970: chown d8/d2a/ff4 82 1 2024-09-11T00:07:38.866 INFO:tasks.workunit.client.1.smithi203.stdout:5/968: write dc/d91/fdb [3848831,73037] 0 2024-09-11T00:07:38.866 INFO:tasks.workunit.client.1.smithi203.stdout:7/869: rmdir dd/d1c/d52/d8f/d31/d4a/d6e/df6 39 2024-09-11T00:07:38.872 INFO:tasks.workunit.client.0.smithi111.stdout:4/996: dread d18/d3b/f106 [0,4194304] 0 2024-09-11T00:07:38.874 INFO:tasks.workunit.client.1.smithi203.stdout:5/969: read dc/d9f/fbf [412508,39528] 0 2024-09-11T00:07:38.874 INFO:tasks.workunit.client.1.smithi203.stdout:2/995: mkdir d13/d15/d30/d5a/d14b 0 2024-09-11T00:07:38.878 INFO:tasks.workunit.client.1.smithi203.stdout:2/996: dread - d13/d15/d30/d5a/d8b/df4/f136 zero size 2024-09-11T00:07:38.880 INFO:tasks.workunit.client.0.smithi111.stdout:4/997: creat d18/d1f/d36/d95/dda/f141 x:0 0 0 2024-09-11T00:07:38.882 INFO:tasks.workunit.client.1.smithi203.stdout:9/929: dread - d6/de/d19/d24/d54/db2/de2/fba zero size 2024-09-11T00:07:38.884 INFO:tasks.workunit.client.1.smithi203.stdout:5/970: creat dc/d4f/d5c/dc9/f13e x:0 0 0 2024-09-11T00:07:38.885 INFO:tasks.workunit.client.0.smithi111.stdout:2/976: dread d0/d3/fb9 [0,4194304] 0 2024-09-11T00:07:38.885 INFO:tasks.workunit.client.1.smithi203.stdout:7/870: mkdir dd/d3b/d9f/d10e/d137 0 2024-09-11T00:07:38.886 INFO:tasks.workunit.client.0.smithi111.stdout:4/998: truncate d18/d20/d3c/d5e/d75/fb1 1936621 0 2024-09-11T00:07:38.888 INFO:tasks.workunit.client.0.smithi111.stdout:4/999: readlink d18/d20/d3c/d5e/daa/dbb/lec 0 2024-09-11T00:07:38.893 INFO:tasks.workunit.client.1.smithi203.stdout:5/971: fsync f8 0 2024-09-11T00:07:38.896 INFO:tasks.workunit.client.0.smithi111.stdout:2/977: link d0/d3/d2e/f47 d0/d83/f14c 0 2024-09-11T00:07:38.898 INFO:tasks.workunit.client.1.smithi203.stdout:9/930: fsync d6/de/d32/f37 0 2024-09-11T00:07:38.903 INFO:tasks.workunit.client.1.smithi203.stdout:6/898: write d0/d54/d9c/d35/d39/d3c/f79 [908870,80651] 0 2024-09-11T00:07:38.907 INFO:tasks.workunit.client.1.smithi203.stdout:5/972: rmdir dc/dd/d56 39 2024-09-11T00:07:38.909 INFO:tasks.workunit.client.0.smithi111.stdout:2/978: symlink d0/d3/de/d4b/dd9/d116/l14d 0 2024-09-11T00:07:38.910 INFO:tasks.workunit.client.1.smithi203.stdout:0/936: getdents d0/d1d/d5d/dec 0 2024-09-11T00:07:38.915 INFO:tasks.workunit.client.0.smithi111.stdout:2/979: rename d0/d3/de/d68/l8a to d0/d3/de/d50/d9d/l14e 0 2024-09-11T00:07:38.916 INFO:tasks.workunit.client.1.smithi203.stdout:6/899: dread d0/d54/d9c/d7b/f8a [0,4194304] 0 2024-09-11T00:07:38.916 INFO:tasks.workunit.client.0.smithi111.stdout:2/980: chown d0/d3/de/dd4/d106 360 1 2024-09-11T00:07:38.916 INFO:tasks.workunit.client.1.smithi203.stdout:9/931: creat d6/de/d32/d52/d55/d66/daa/df7/f131 x:0 0 0 2024-09-11T00:07:38.917 INFO:tasks.workunit.client.1.smithi203.stdout:3/971: link d8/d17/c4f d8/da/d37/d53/da2/d122/c15e 0 2024-09-11T00:07:38.918 INFO:tasks.workunit.client.0.smithi111.stdout:2/981: truncate d0/d3/d12/d38/f12d 730903 0 2024-09-11T00:07:38.920 INFO:tasks.workunit.client.1.smithi203.stdout:5/973: creat dc/dd/d1e/dc6/d103/f13f x:0 0 0 2024-09-11T00:07:38.924 INFO:tasks.workunit.client.1.smithi203.stdout:2/997: getdents d13/d15/d30/d5a 0 2024-09-11T00:07:38.927 INFO:tasks.workunit.client.1.smithi203.stdout:2/998: write d13/d15/d19/d1c/d73/f81 [1544327,3519] 0 2024-09-11T00:07:38.927 INFO:tasks.workunit.client.0.smithi111.stdout:2/982: link d0/l9b d0/d3/de/d3b/d62/d122/l14f 0 2024-09-11T00:07:38.931 INFO:tasks.workunit.client.1.smithi203.stdout:7/871: link dd/d1c/l34 dd/d1c/d52/d8f/d31/d67/l138 0 2024-09-11T00:07:38.932 INFO:tasks.workunit.client.1.smithi203.stdout:0/937: creat d0/d2/d7e/da1/dc9/d122/f133 x:0 0 0 2024-09-11T00:07:38.934 INFO:tasks.workunit.client.1.smithi203.stdout:5/974: symlink dc/d91/d124/l140 0 2024-09-11T00:07:38.939 INFO:tasks.workunit.client.1.smithi203.stdout:2/999: creat d13/f14c x:0 0 0 2024-09-11T00:07:38.940 INFO:tasks.workunit.client.1.smithi203.stdout:6/900: dwrite d0/d5b/d9f/fbb [4194304,4194304] 0 2024-09-11T00:07:38.940 INFO:tasks.workunit.client.0.smithi111.stdout:2/983: link d0/d3/de/f51 d0/d3/d12/d38/f150 0 2024-09-11T00:07:38.943 INFO:tasks.workunit.client.1.smithi203.stdout:0/938: creat d0/d87/db9/dd5/f134 x:0 0 0 2024-09-11T00:07:38.946 INFO:tasks.workunit.client.1.smithi203.stdout:5/975: creat dc/dd/d1e/d7b/f141 x:0 0 0 2024-09-11T00:07:38.949 INFO:tasks.workunit.client.1.smithi203.stdout:0/939: creat d0/d1d/d5d/dec/f135 x:0 0 0 2024-09-11T00:07:38.950 INFO:tasks.workunit.client.1.smithi203.stdout:6/901: fdatasync d0/d54/d9c/d7b/d7e/f9d 0 2024-09-11T00:07:38.951 INFO:tasks.workunit.client.0.smithi111.stdout:2/984: link d0/d3/de/d3b/d62/cb7 d0/d83/c151 0 2024-09-11T00:07:38.952 INFO:tasks.workunit.client.1.smithi203.stdout:5/976: readlink dc/dd/l52 0 2024-09-11T00:07:38.953 INFO:tasks.workunit.client.1.smithi203.stdout:9/932: dread d6/de/dc4/f42 [0,4194304] 0 2024-09-11T00:07:38.959 INFO:tasks.workunit.client.0.smithi111.stdout:2/985: rename d0/d3/de/d3b/d63/lcf to d0/d3/de/d50/d9d/l152 0 2024-09-11T00:07:38.960 INFO:tasks.workunit.client.1.smithi203.stdout:6/902: creat d0/d5b/d9f/f113 x:0 0 0 2024-09-11T00:07:38.965 INFO:tasks.workunit.client.1.smithi203.stdout:3/972: dwrite d8/da/d37/d53/f62 [0,4194304] 0 2024-09-11T00:07:38.968 INFO:tasks.workunit.client.1.smithi203.stdout:9/933: read d6/de/d19/d24/fb0 [486624,28912] 0 2024-09-11T00:07:38.972 INFO:tasks.workunit.client.1.smithi203.stdout:7/872: dread dd/d1c/d52/d8f/d31/d58/fbe [0,4194304] 0 2024-09-11T00:07:38.972 INFO:tasks.workunit.client.1.smithi203.stdout:6/903: stat d0/d32/f46 0 2024-09-11T00:07:38.977 INFO:tasks.workunit.client.1.smithi203.stdout:5/977: dwrite dc/dd/d1e/d7b/f141 [0,4194304] 0 2024-09-11T00:07:38.978 INFO:tasks.workunit.client.1.smithi203.stdout:7/873: write dd/d1c/d52/d8f/d31/d4a/d105/f12f [919971,27445] 0 2024-09-11T00:07:38.979 INFO:tasks.workunit.client.0.smithi111.stdout:2/986: write d0/d3/d12/f41 [4397156,21946] 0 2024-09-11T00:07:38.979 INFO:tasks.workunit.client.1.smithi203.stdout:5/978: chown dc/dd/d15/dbd 3776 1 2024-09-11T00:07:38.982 INFO:tasks.workunit.client.1.smithi203.stdout:9/934: chown d6/de/d47/de1/dec/df8/f81 14662 1 2024-09-11T00:07:38.985 INFO:tasks.workunit.client.1.smithi203.stdout:0/940: getdents d0/d2/d37/d80 0 2024-09-11T00:07:38.985 INFO:tasks.workunit.client.1.smithi203.stdout:6/904: mkdir d0/d5b/d5c/d6f/de7/d114 0 2024-09-11T00:07:38.990 INFO:tasks.workunit.client.0.smithi111.stdout:2/987: truncate d0/d3/d12/f96 648887 0 2024-09-11T00:07:38.992 INFO:tasks.workunit.client.1.smithi203.stdout:6/905: mknod d0/d54/c115 0 2024-09-11T00:07:38.993 INFO:tasks.workunit.client.1.smithi203.stdout:0/941: mknod d0/d2/d37/d5b/d73/db6/c136 0 2024-09-11T00:07:38.993 INFO:tasks.workunit.client.0.smithi111.stdout:2/988: creat d0/d3/d2e/f153 x:0 0 0 2024-09-11T00:07:38.994 INFO:tasks.workunit.client.1.smithi203.stdout:5/979: chown dc/dd/d15/dbd/d59/da8/fd8 2 1 2024-09-11T00:07:38.996 INFO:tasks.workunit.client.0.smithi111.stdout:2/989: dread - d0/d3/de/d68/df1/ffc zero size 2024-09-11T00:07:39.003 INFO:tasks.workunit.client.0.smithi111.stdout:2/990: read d0/d3/de/d3b/d92/fc2 [202826,21780] 0 2024-09-11T00:07:39.006 INFO:tasks.workunit.client.1.smithi203.stdout:5/980: rename dc/dd/f3d to dc/dd/d56/f142 0 2024-09-11T00:07:39.009 INFO:tasks.workunit.client.1.smithi203.stdout:9/935: dread d6/de/d47/de1/dec/fee [0,4194304] 0 2024-09-11T00:07:39.010 INFO:tasks.workunit.client.1.smithi203.stdout:5/981: mkdir dc/dd/d15/d143 0 2024-09-11T00:07:39.012 INFO:tasks.workunit.client.1.smithi203.stdout:7/874: dwrite dd/d1c/d52/d8f/d31/d58/f64 [0,4194304] 0 2024-09-11T00:07:39.013 INFO:tasks.workunit.client.0.smithi111.stdout:2/991: dwrite d0/d3/de/d3b/d62/d142/f8b [4194304,4194304] 0 2024-09-11T00:07:39.014 INFO:tasks.workunit.client.0.smithi111.stdout:2/992: fsync d0/d3/d12/d52/d6c/f8f 0 2024-09-11T00:07:39.019 INFO:tasks.workunit.client.1.smithi203.stdout:6/906: write d0/d54/d9c/d35/d39/f6a [5169375,34833] 0 2024-09-11T00:07:39.019 INFO:tasks.workunit.client.1.smithi203.stdout:0/942: dwrite d0/d2/d7e/da1/dc9/de7/d77/f95 [0,4194304] 0 2024-09-11T00:07:39.019 INFO:tasks.workunit.client.0.smithi111.stdout:2/993: dread d0/d83/f9c [0,4194304] 0 2024-09-11T00:07:39.021 INFO:tasks.workunit.client.1.smithi203.stdout:9/936: mknod d6/de/d19/d21/c132 0 2024-09-11T00:07:39.025 INFO:tasks.workunit.client.1.smithi203.stdout:3/973: dread d8/da/d5c/d6b/d6c/fac [0,4194304] 0 2024-09-11T00:07:39.025 INFO:tasks.workunit.client.1.smithi203.stdout:6/907: read d0/d54/d9c/d35/d39/f51 [8170637,101714] 0 2024-09-11T00:07:39.027 INFO:tasks.workunit.client.0.smithi111.stdout:2/994: truncate d0/d3/de/d50/f59 1484494 0 2024-09-11T00:07:39.031 INFO:tasks.workunit.client.1.smithi203.stdout:6/908: read - d0/d54/d9c/d7b/d7e/d94/f10d zero size 2024-09-11T00:07:39.032 INFO:tasks.workunit.client.1.smithi203.stdout:9/937: symlink d6/de/l133 0 2024-09-11T00:07:39.035 INFO:tasks.workunit.client.1.smithi203.stdout:3/974: mknod d8/d2a/dd0/c15f 0 2024-09-11T00:07:39.037 INFO:tasks.workunit.client.1.smithi203.stdout:3/975: dread - d8/da/d37/d83/da3/fa6 zero size 2024-09-11T00:07:39.038 INFO:tasks.workunit.client.1.smithi203.stdout:5/982: write dc/dd/d13/f7f [565271,62726] 0 2024-09-11T00:07:39.042 INFO:tasks.workunit.client.1.smithi203.stdout:0/943: link d0/f34 d0/d87/db9/f137 0 2024-09-11T00:07:39.043 INFO:tasks.workunit.client.1.smithi203.stdout:3/976: readlink d8/da/l20 0 2024-09-11T00:07:39.044 INFO:tasks.workunit.client.1.smithi203.stdout:5/983: read dc/fc3 [2140377,2902] 0 2024-09-11T00:07:39.044 INFO:tasks.workunit.client.1.smithi203.stdout:0/944: chown d0/fc6 5267980 1 2024-09-11T00:07:39.045 INFO:tasks.workunit.client.1.smithi203.stdout:9/938: creat d6/de/d19/d24/d40/d45/f134 x:0 0 0 2024-09-11T00:07:39.054 INFO:tasks.workunit.client.1.smithi203.stdout:0/945: truncate d0/d2/d92/fd9 3576661 0 2024-09-11T00:07:39.055 INFO:tasks.workunit.client.1.smithi203.stdout:7/875: write dd/d1c/d7c/fba [5861356,6945] 0 2024-09-11T00:07:39.057 INFO:tasks.workunit.client.0.smithi111.stdout:2/995: write d0/d3/de/d68/df1/f11c [2330716,7826] 0 2024-09-11T00:07:39.059 INFO:tasks.workunit.client.1.smithi203.stdout:6/909: dwrite d0/d54/d9c/d35/d38/dc0/fe5 [4194304,4194304] 0 2024-09-11T00:07:39.064 INFO:tasks.workunit.client.1.smithi203.stdout:9/939: creat d6/de/d47/f135 x:0 0 0 2024-09-11T00:07:39.065 INFO:tasks.workunit.client.1.smithi203.stdout:6/910: write d0/d54/fee [193175,32873] 0 2024-09-11T00:07:39.069 INFO:tasks.workunit.client.1.smithi203.stdout:5/984: dwrite dc/dd/d1e/fa1 [0,4194304] 0 2024-09-11T00:07:39.070 INFO:tasks.workunit.client.1.smithi203.stdout:6/911: write d0/d32/d5a/fb7 [1130348,62919] 0 2024-09-11T00:07:39.076 INFO:tasks.workunit.client.1.smithi203.stdout:3/977: write d8/da/d37/d53/fab [197754,21912] 0 2024-09-11T00:07:39.078 INFO:tasks.workunit.client.1.smithi203.stdout:9/940: creat d6/de/df9/f136 x:0 0 0 2024-09-11T00:07:39.087 INFO:tasks.workunit.client.1.smithi203.stdout:6/912: rmdir d0/d54/d9c/d35/d38/dc0/ddb 39 2024-09-11T00:07:39.088 INFO:tasks.workunit.client.0.smithi111.stdout:2/996: write d0/d3/de/d3b/d63/fdd [312705,127433] 0 2024-09-11T00:07:39.091 INFO:tasks.workunit.client.1.smithi203.stdout:6/913: read d0/d32/f100 [917985,126988] 0 2024-09-11T00:07:39.094 INFO:tasks.workunit.client.0.smithi111.stdout:2/997: rename d0/ce3 to d0/d3/d12/d38/c154 0 2024-09-11T00:07:39.094 INFO:tasks.workunit.client.1.smithi203.stdout:6/914: dread - d0/d54/d9c/d35/d39/ffd zero size 2024-09-11T00:07:39.096 INFO:tasks.workunit.client.1.smithi203.stdout:5/985: mkdir dc/dd/d13/d113/d120/d125/d144 0 2024-09-11T00:07:39.099 INFO:tasks.workunit.client.1.smithi203.stdout:6/915: chown d0/d54/d9c/d7b/d7e/d94/f103 95 1 2024-09-11T00:07:39.099 INFO:tasks.workunit.client.1.smithi203.stdout:7/876: dwrite dd/d1c/d52/ff8 [0,4194304] 0 2024-09-11T00:07:39.106 INFO:tasks.workunit.client.0.smithi111.stdout:2/998: creat d0/d3/de/d3b/f155 x:0 0 0 2024-09-11T00:07:39.110 INFO:tasks.workunit.client.0.smithi111.stdout:2/999: creat d0/d3/de/dd4/f156 x:0 0 0 2024-09-11T00:07:39.111 INFO:tasks.workunit.client.1.smithi203.stdout:7/877: mknod dd/d1c/d52/d8f/d31/d4a/d6e/dcc/c139 0 2024-09-11T00:07:39.114 INFO:tasks.workunit.client.1.smithi203.stdout:9/941: dwrite d6/de/d47/f12f [0,4194304] 0 2024-09-11T00:07:39.114 INFO:tasks.workunit.client.1.smithi203.stdout:7/878: mkdir dd/d1c/d7c/d8c/d13a 0 2024-09-11T00:07:39.115 INFO:tasks.workunit.client.1.smithi203.stdout:6/916: getdents d0/d54/d9c/d35/d38/dc0/ddb 0 2024-09-11T00:07:39.117 INFO:tasks.workunit.client.1.smithi203.stdout:9/942: chown d6/de/d19/d24/d40 9 1 2024-09-11T00:07:39.118 INFO:tasks.workunit.client.1.smithi203.stdout:6/917: chown d0/d54/d9c/d35/d39/f51 52747479 1 2024-09-11T00:07:39.119 INFO:tasks.workunit.client.0.smithi111.stderr:+ rm -rf -- ./tmp.ohsekhRNzU 2024-09-11T00:07:39.119 INFO:tasks.workunit.client.1.smithi203.stdout:7/879: chown dd/d1c/d52/d8f/d31/d4a/d6e/dcc/c139 5286001 1 2024-09-11T00:07:39.126 INFO:tasks.workunit.client.1.smithi203.stdout:5/986: write dc/d91/f10e [1182701,17296] 0 2024-09-11T00:07:39.128 INFO:tasks.workunit.client.1.smithi203.stdout:3/978: dread d8/d17/f7e [0,4194304] 0 2024-09-11T00:07:39.131 INFO:tasks.workunit.client.1.smithi203.stdout:5/987: write dc/dd/d15/dbd/d126/f136 [869071,77691] 0 2024-09-11T00:07:39.131 INFO:tasks.workunit.client.1.smithi203.stdout:7/880: fsync dd/d1c/d52/d8f/d31/d67/dc3/fd1 0 2024-09-11T00:07:39.142 INFO:tasks.workunit.client.1.smithi203.stdout:5/988: unlink dc/dd/d15/f19 0 2024-09-11T00:07:39.143 INFO:tasks.workunit.client.1.smithi203.stdout:6/918: link d0/d54/d9c/d35/l53 d0/d5b/d5c/d6f/l116 0 2024-09-11T00:07:39.145 INFO:tasks.workunit.client.1.smithi203.stdout:3/979: rename d8/d17/f74 to d8/da/d37/d53/da2/f160 0 2024-09-11T00:07:39.146 INFO:tasks.workunit.client.1.smithi203.stdout:7/881: truncate dd/d1c/d52/f94 285137 0 2024-09-11T00:07:39.152 INFO:tasks.workunit.client.1.smithi203.stdout:5/989: mkdir dc/dd/d13/d145 0 2024-09-11T00:07:39.153 INFO:tasks.workunit.client.1.smithi203.stdout:9/943: dread d6/de/d19/d24/f27 [0,4194304] 0 2024-09-11T00:07:39.156 INFO:tasks.workunit.client.1.smithi203.stdout:7/882: mkdir dd/d3b/d5b/ddd/df3/d13b 0 2024-09-11T00:07:39.159 INFO:tasks.workunit.client.1.smithi203.stdout:6/919: creat d0/d54/d9c/d7b/f117 x:0 0 0 2024-09-11T00:07:39.161 INFO:tasks.workunit.client.1.smithi203.stdout:9/944: mkdir d6/de/d19/d24/d6c/d137 0 2024-09-11T00:07:39.164 INFO:tasks.workunit.client.1.smithi203.stdout:6/920: rmdir d0/d54/d9c/d35/d39 39 2024-09-11T00:07:39.171 INFO:tasks.workunit.client.1.smithi203.stdout:5/990: dwrite dc/dd/d56/f142 [0,4194304] 0 2024-09-11T00:07:39.178 INFO:tasks.workunit.client.1.smithi203.stdout:5/991: dread - dc/dd/d1e/dc6/d103/f11d zero size 2024-09-11T00:07:39.181 INFO:tasks.workunit.client.1.smithi203.stdout:3/980: dread d8/da/d11/f75 [0,4194304] 0 2024-09-11T00:07:39.184 INFO:tasks.workunit.client.1.smithi203.stdout:6/921: rmdir d0/d54/d9c/d7b/ddc 0 2024-09-11T00:07:39.190 INFO:tasks.workunit.client.1.smithi203.stdout:3/981: rename d8/da/d5c/d6b/l81 to d8/d2a/dd0/l161 0 2024-09-11T00:07:39.193 INFO:tasks.workunit.client.1.smithi203.stdout:6/922: creat d0/d54/d9c/d35/d38/d73/d74/f118 x:0 0 0 2024-09-11T00:07:39.198 INFO:tasks.workunit.client.1.smithi203.stdout:5/992: dwrite dc/dd/d56/f13a [0,4194304] 0 2024-09-11T00:07:39.200 INFO:tasks.workunit.client.1.smithi203.stdout:5/993: readlink dc/l1b 0 2024-09-11T00:07:39.202 INFO:tasks.workunit.client.1.smithi203.stdout:3/982: mknod d8/d2a/dd0/c162 0 2024-09-11T00:07:39.203 INFO:tasks.workunit.client.1.smithi203.stdout:6/923: mkdir d0/d54/d9c/d35/d38/dc0/ddb/d119 0 2024-09-11T00:07:39.208 INFO:tasks.workunit.client.1.smithi203.stdout:9/945: dread d6/de/d19/f7a [0,4194304] 0 2024-09-11T00:07:39.209 INFO:tasks.workunit.client.1.smithi203.stdout:5/994: rename dc/d91/f10e to dc/dd/d13/d145/f146 0 2024-09-11T00:07:39.213 INFO:tasks.workunit.client.1.smithi203.stdout:5/995: read dc/dd/d13/f14 [3085970,78612] 0 2024-09-11T00:07:39.214 INFO:tasks.workunit.client.1.smithi203.stdout:5/996: stat dc/dd/d56/l12c 0 2024-09-11T00:07:39.224 INFO:tasks.workunit.client.1.smithi203.stdout:9/946: rename d6/de/d19/d24 to d6/de/d32/d52/d55/d66/d138 0 2024-09-11T00:07:39.224 INFO:tasks.workunit.client.1.smithi203.stdout:7/883: dwrite dd/d1c/f66 [0,4194304] 0 2024-09-11T00:07:39.226 INFO:tasks.workunit.client.1.smithi203.stdout:6/924: mkdir d0/d71/db9/deb/d11a 0 2024-09-11T00:07:39.229 INFO:tasks.workunit.client.1.smithi203.stdout:5/997: fdatasync dc/d2b/fc2 0 2024-09-11T00:07:39.231 INFO:tasks.workunit.client.1.smithi203.stdout:5/998: chown dc/d4f/d5c/d76/cde 1 1 2024-09-11T00:07:39.236 INFO:tasks.workunit.client.1.smithi203.stdout:3/983: creat d8/da/d37/d83/f163 x:0 0 0 2024-09-11T00:07:39.239 INFO:tasks.workunit.client.1.smithi203.stdout:9/947: symlink d6/de/d19/d21/d87/l139 0 2024-09-11T00:07:39.241 INFO:tasks.workunit.client.1.smithi203.stdout:7/884: symlink dd/d1c/d52/l13c 0 2024-09-11T00:07:39.245 INFO:tasks.workunit.client.1.smithi203.stdout:3/984: mknod d8/da/d37/d83/dc0/c164 0 2024-09-11T00:07:39.247 INFO:tasks.workunit.client.1.smithi203.stdout:9/948: mknod d6/de/d19/d21/d87/c13a 0 2024-09-11T00:07:39.249 INFO:tasks.workunit.client.1.smithi203.stdout:7/885: dread - dd/d4d/d7f/f96 zero size 2024-09-11T00:07:39.251 INFO:tasks.workunit.client.1.smithi203.stdout:3/985: creat d8/da/d5c/d6b/f165 x:0 0 0 2024-09-11T00:07:39.252 INFO:tasks.workunit.client.1.smithi203.stdout:3/986: stat d8/da/db3/lb2 0 2024-09-11T00:07:39.257 INFO:tasks.workunit.client.1.smithi203.stdout:3/987: chown d8/da/d37/f82 63 1 2024-09-11T00:07:39.260 INFO:tasks.workunit.client.1.smithi203.stdout:3/988: stat d8/da/d37/d83/d6a/dad/f130 0 2024-09-11T00:07:39.263 INFO:tasks.workunit.client.1.smithi203.stdout:5/999: write dc/dd/d9b/dae/feb [3484283,71821] 0 2024-09-11T00:07:39.263 INFO:tasks.workunit.client.1.smithi203.stdout:3/989: read d8/da/d37/d53/dea/fd3 [4849722,95530] 0 2024-09-11T00:07:39.265 INFO:tasks.workunit.client.1.smithi203.stdout:7/886: dwrite dd/d1c/d52/d8f/d31/d58/f64 [4194304,4194304] 0 2024-09-11T00:07:39.270 INFO:tasks.workunit.client.1.smithi203.stdout:3/990: symlink d8/l166 0 2024-09-11T00:07:39.271 INFO:tasks.workunit.client.1.smithi203.stdout:9/949: truncate d6/de/f85 1793580 0 2024-09-11T00:07:39.272 INFO:tasks.workunit.client.1.smithi203.stdout:7/887: mknod dd/d1c/d52/d8f/d31/d67/dc8/c13d 0 2024-09-11T00:07:39.274 INFO:tasks.workunit.client.1.smithi203.stdout:9/950: chown d6/de/d47/c60 30 1 2024-09-11T00:07:39.275 INFO:tasks.workunit.client.1.smithi203.stdout:7/888: stat dd/d1c/d52/d8f/d31/d4a/d6e/dcc/dea/f11d 0 2024-09-11T00:07:39.277 INFO:tasks.workunit.client.1.smithi203.stdout:3/991: truncate d8/f3d 2974533 0 2024-09-11T00:07:39.279 INFO:tasks.workunit.client.1.smithi203.stdout:3/992: chown d8/da/d37/f9f 90 1 2024-09-11T00:07:39.281 INFO:tasks.workunit.client.1.smithi203.stdout:7/889: rename dd/d4d to dd/d1c/d7c/d8c/d13e 0 2024-09-11T00:07:39.287 INFO:tasks.workunit.client.1.smithi203.stdout:3/993: dread d8/d3c/fc9 [0,4194304] 0 2024-09-11T00:07:39.290 INFO:tasks.workunit.client.1.smithi203.stdout:7/890: truncate dd/d1c/d52/d8f/d31/d4a/d105/f75 574941 0 2024-09-11T00:07:39.292 INFO:tasks.workunit.client.1.smithi203.stdout:3/994: write d8/da/d37/d11e/f151 [949857,108762] 0 2024-09-11T00:07:39.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:38 smithi203 ceph-mon[33225]: pgmap v17: 65 pgs: 65 active+clean; 3.9 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 105 MiB/s rd, 241 MiB/s wr, 555 op/s 2024-09-11T00:07:39.298 INFO:tasks.workunit.client.1.smithi203.stdout:9/951: dwrite d6/de/d32/d52/d55/d66/d138/f36 [4194304,4194304] 0 2024-09-11T00:07:39.313 INFO:tasks.workunit.client.1.smithi203.stdout:9/952: rename d6/de/d32/d52/d55/d66/d138/d40/d45/d130 to d6/de/d47/de1/dec/d13b 0 2024-09-11T00:07:39.313 INFO:tasks.workunit.client.1.smithi203.stdout:7/891: dread dd/d1c/d7c/d8c/d13e/d7f/f92 [0,4194304] 0 2024-09-11T00:07:39.317 INFO:tasks.workunit.client.1.smithi203.stdout:9/953: truncate d6/de/df9/f126 847133 0 2024-09-11T00:07:39.323 INFO:tasks.workunit.client.1.smithi203.stdout:3/995: dread d8/f16 [0,4194304] 0 2024-09-11T00:07:39.326 INFO:tasks.workunit.client.1.smithi203.stdout:7/892: rename dd/d1c/d52/d8f/d31/d58/d93 to dd/d1c/d52/d8f/d31/d4a/d6e/df6/d13f 0 2024-09-11T00:07:39.333 INFO:tasks.workunit.client.1.smithi203.stdout:9/954: link d6/de/d47/f61 d6/de/d47/de1/dec/d13b/f13c 0 2024-09-11T00:07:39.345 INFO:tasks.workunit.client.1.smithi203.stdout:9/955: creat d6/de/d47/de1/dec/f13d x:0 0 0 2024-09-11T00:07:39.346 INFO:tasks.workunit.client.1.smithi203.stdout:7/893: dread dd/d1c/d7c/d8c/d13e/f73 [0,4194304] 0 2024-09-11T00:07:39.349 INFO:tasks.workunit.client.1.smithi203.stdout:9/956: write d6/de/df9/f126 [1272102,102138] 0 2024-09-11T00:07:39.354 INFO:tasks.workunit.client.1.smithi203.stdout:3/996: dwrite d8/da/d37/d53/da2/fbd [0,4194304] 0 2024-09-11T00:07:39.356 INFO:tasks.workunit.client.1.smithi203.stdout:3/997: chown d8/d2a/dd0/d121 1480 1 2024-09-11T00:07:39.359 INFO:tasks.workunit.client.1.smithi203.stdout:9/957: rename d6/f96 to d6/de/d47/de1/dec/df8/f13e 0 2024-09-11T00:07:39.379 INFO:tasks.workunit.client.1.smithi203.stdout:7/894: dread dd/d1c/d7c/d8c/d13e/f7a [0,4194304] 0 2024-09-11T00:07:39.383 INFO:tasks.workunit.client.1.smithi203.stdout:7/895: creat dd/d3b/d9f/d10e/d137/f140 x:0 0 0 2024-09-11T00:07:39.387 INFO:tasks.workunit.client.1.smithi203.stdout:7/896: unlink dd/f30 0 2024-09-11T00:07:39.397 INFO:tasks.workunit.client.1.smithi203.stdout:3/998: dread d8/d17/f1c [0,4194304] 0 2024-09-11T00:07:39.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:38 smithi111 ceph-mon[27539]: pgmap v17: 65 pgs: 65 active+clean; 3.9 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 105 MiB/s rd, 241 MiB/s wr, 555 op/s 2024-09-11T00:07:39.403 INFO:tasks.workunit.client.1.smithi203.stdout:3/999: rmdir d8/da/d37/d83/d6a/dad 39 2024-09-11T00:07:39.404 INFO:tasks.workunit.client.1.smithi203.stdout:7/897: dwrite dd/d3b/d9f/fb3 [0,4194304] 0 2024-09-11T00:07:39.422 INFO:tasks.workunit.client.1.smithi203.stdout:7/898: dwrite dd/d1c/d52/d8f/d31/ff4 [0,4194304] 0 2024-09-11T00:07:39.442 INFO:tasks.workunit.client.1.smithi203.stdout:7/899: write dd/d1c/d52/d8f/d31/d58/fbe [99293,114853] 0 2024-09-11T00:07:39.445 INFO:tasks.workunit.client.1.smithi203.stdout:7/900: creat dd/d1c/d7c/d8c/d13a/f141 x:0 0 0 2024-09-11T00:07:39.447 INFO:tasks.workunit.client.1.smithi203.stdout:7/901: chown dd/d1c/d7c/fba 19605 1 2024-09-11T00:07:39.456 INFO:tasks.workunit.client.1.smithi203.stdout:7/902: write dd/d1c/d52/d8f/d31/d67/dc3/fd1 [909282,102506] 0 2024-09-11T00:07:39.459 INFO:tasks.workunit.client.1.smithi203.stdout:7/903: chown dd/d1c/d52/d8f/d31/d67/dc8/cc2 980 1 2024-09-11T00:07:39.465 INFO:tasks.workunit.client.1.smithi203.stdout:7/904: write dd/d1c/d52/d8f/d31/d4a/d105/f65 [675370,20640] 0 2024-09-11T00:07:39.468 INFO:tasks.workunit.client.1.smithi203.stdout:7/905: fsync dd/d1c/d7c/d8c/d13e/fef 0 2024-09-11T00:07:39.472 INFO:tasks.workunit.client.1.smithi203.stdout:7/906: creat dd/d1c/d52/d8f/d31/d4a/d105/d115/f142 x:0 0 0 2024-09-11T00:07:39.475 INFO:tasks.workunit.client.1.smithi203.stdout:7/907: write dd/d1c/f2b [3790648,62370] 0 2024-09-11T00:07:39.479 INFO:tasks.workunit.client.1.smithi203.stdout:7/908: mknod dd/d3b/d5b/ddd/c143 0 2024-09-11T00:07:39.483 INFO:tasks.workunit.client.1.smithi203.stdout:7/909: creat dd/d1c/d52/d8f/d31/f144 x:0 0 0 2024-09-11T00:07:39.485 INFO:tasks.workunit.client.1.smithi203.stdout:7/910: chown dd/d1c/d52/d8f/d31/d4a/d6e/dcc/dea/de6 7322641 1 2024-09-11T00:07:39.656 INFO:tasks.workunit.client.1.smithi203.stdout:7/911: write dd/d1c/d52/d8f/d31/f50 [5779131,50347] 0 2024-09-11T00:07:39.660 INFO:tasks.workunit.client.1.smithi203.stdout:7/912: rmdir dd/d3b/d5b/dd9 39 2024-09-11T00:07:39.663 INFO:tasks.workunit.client.1.smithi203.stdout:7/913: symlink dd/d1c/l145 0 2024-09-11T00:07:39.666 INFO:tasks.workunit.client.1.smithi203.stdout:7/914: symlink dd/d1c/d52/d8f/d31/d67/dc8/l146 0 2024-09-11T00:07:39.669 INFO:tasks.workunit.client.1.smithi203.stdout:7/915: dread - dd/d1c/d52/d8f/d31/d4a/d105/d115/f142 zero size 2024-09-11T00:07:39.677 INFO:tasks.workunit.client.1.smithi203.stdout:7/916: truncate dd/d1c/d52/ff8 3480754 0 2024-09-11T00:07:39.680 INFO:tasks.workunit.client.1.smithi203.stdout:7/917: truncate dd/d1c/d52/d8f/d31/f144 87118 0 2024-09-11T00:07:39.696 INFO:tasks.workunit.client.1.smithi203.stdout:7/918: dwrite dd/d1c/d52/f6f [0,4194304] 0 2024-09-11T00:07:39.700 INFO:tasks.workunit.client.1.smithi203.stdout:7/919: write dd/d3b/d5b/ddd/f120 [521572,19857] 0 2024-09-11T00:07:39.709 INFO:tasks.workunit.client.1.smithi203.stdout:7/920: rename dd/d1c/d52/d8f/d31/d58/ce4 to dd/d1c/d52/d8f/d31/d4a/d6e/dcc/dea/de6/c147 0 2024-09-11T00:07:39.725 INFO:tasks.workunit.client.1.smithi203.stdout:7/921: dwrite dd/d3b/d5b/f83 [0,4194304] 0 2024-09-11T00:07:39.732 INFO:tasks.workunit.client.1.smithi203.stdout:7/922: rename dd/d3b/d9f/d10e/d137/f140 to dd/d3b/d9f/d10e/f148 0 2024-09-11T00:07:39.736 INFO:tasks.workunit.client.1.smithi203.stdout:7/923: mknod dd/d1c/d52/d8f/d31/d4a/d6e/dcc/dea/de6/c149 0 2024-09-11T00:07:39.742 INFO:tasks.workunit.client.1.smithi203.stdout:7/924: rename dd/d1c/d7c/d8c/d13e/f5a to dd/d1c/d52/d8f/d31/d4a/d105/dbb/f14a 0 2024-09-11T00:07:39.745 INFO:tasks.workunit.client.1.smithi203.stdout:7/925: fsync dd/d1c/d7c/d8c/d13a/f141 0 2024-09-11T00:07:39.748 INFO:tasks.workunit.client.1.smithi203.stdout:7/926: dread - dd/d1c/d7c/d8c/d13e/f101 zero size 2024-09-11T00:07:39.750 INFO:tasks.workunit.client.1.smithi203.stdout:7/927: chown dd/d1c/d52/d8f/d31/d67/c81 253214 1 2024-09-11T00:07:39.767 INFO:tasks.workunit.client.1.smithi203.stdout:7/928: dwrite dd/d1c/d52/d8f/d31/d4a/d6e/df6/d13f/f9b [0,4194304] 0 2024-09-11T00:07:39.781 INFO:tasks.workunit.client.1.smithi203.stdout:7/929: dread dd/d1c/d52/d8f/d31/d58/f64 [0,4194304] 0 2024-09-11T00:07:39.781 INFO:tasks.workunit.client.1.smithi203.stdout:7/930: stat dd/d1c/d52/ff8 0 2024-09-11T00:07:39.784 INFO:tasks.workunit.client.1.smithi203.stdout:7/931: dread - dd/d1c/d52/fb1 zero size 2024-09-11T00:07:39.786 INFO:tasks.workunit.client.1.smithi203.stdout:7/932: mkdir dd/d3b/d14b 0 2024-09-11T00:07:39.788 INFO:tasks.workunit.client.1.smithi203.stdout:8/874: sync 2024-09-11T00:07:39.795 INFO:tasks.workunit.client.1.smithi203.stdout:7/933: rename dd/d1c/d52/d8f/d31/d4a/d6e/dcc/dea/fc4 to dd/d1c/d52/d8f/d31/d4a/d6e/dcc/dea/f14c 0 2024-09-11T00:07:39.798 INFO:tasks.workunit.client.1.smithi203.stdout:7/934: write dd/d1c/d52/d8f/d31/d67/dc3/ddb/fee [1138218,34420] 0 2024-09-11T00:07:39.810 INFO:tasks.workunit.client.1.smithi203.stdout:8/875: dwrite d1/d13/d22/d6f/d8d/d121/f70 [0,4194304] 0 2024-09-11T00:07:39.811 INFO:tasks.workunit.client.1.smithi203.stdout:7/935: write dd/d1c/f5f [5099084,97226] 0 2024-09-11T00:07:39.815 INFO:tasks.workunit.client.1.smithi203.stdout:7/936: mkdir dd/d3b/d5b/ddd/df3/d14d 0 2024-09-11T00:07:39.827 INFO:tasks.workunit.client.1.smithi203.stdout:8/876: dread d1/f11 [0,4194304] 0 2024-09-11T00:07:39.831 INFO:tasks.workunit.client.1.smithi203.stdout:8/877: mkdir d1/d13/d22/d6f/d8d/d12c 0 2024-09-11T00:07:39.836 INFO:tasks.workunit.client.1.smithi203.stdout:8/878: mkdir d1/d13/d3a/d12d 0 2024-09-11T00:07:39.840 INFO:tasks.workunit.client.1.smithi203.stdout:8/879: write d1/d13/d22/d6f/f60 [4730874,29439] 0 2024-09-11T00:07:39.841 INFO:tasks.workunit.client.1.smithi203.stdout:7/937: dwrite dd/d1c/d7c/d8c/d13e/d7f/f92 [0,4194304] 0 2024-09-11T00:07:39.844 INFO:tasks.workunit.client.1.smithi203.stdout:8/880: creat d1/d13/d3a/da4/f12e x:0 0 0 2024-09-11T00:07:39.846 INFO:tasks.workunit.client.1.smithi203.stdout:7/938: mknod dd/d3b/d5b/ddd/df3/d13b/c14e 0 2024-09-11T00:07:39.849 INFO:tasks.workunit.client.1.smithi203.stdout:7/939: write dd/d3b/fd7 [737783,104886] 0 2024-09-11T00:07:39.856 INFO:tasks.workunit.client.1.smithi203.stdout:7/940: truncate dd/d1c/d7c/d8c/d13e/fd8 782386 0 2024-09-11T00:07:39.859 INFO:tasks.workunit.client.1.smithi203.stdout:7/941: dread - dd/d1c/d52/d8f/d31/d67/f109 zero size 2024-09-11T00:07:39.859 INFO:tasks.workunit.client.1.smithi203.stdout:8/881: symlink d1/d13/d22/d6f/d8d/d12c/l12f 0 2024-09-11T00:07:39.861 INFO:tasks.workunit.client.1.smithi203.stdout:9/958: sync 2024-09-11T00:07:39.861 INFO:tasks.workunit.client.1.smithi203.stdout:4/866: sync 2024-09-11T00:07:39.862 INFO:tasks.workunit.client.1.smithi203.stdout:0/946: sync 2024-09-11T00:07:39.862 INFO:tasks.workunit.client.1.smithi203.stdout:6/925: sync 2024-09-11T00:07:39.865 INFO:tasks.workunit.client.1.smithi203.stdout:9/959: read d6/de/d47/f61 [3089549,116593] 0 2024-09-11T00:07:39.866 INFO:tasks.workunit.client.1.smithi203.stdout:0/947: write d0/d2/d7e/da1/fde [2388659,109360] 0 2024-09-11T00:07:39.867 INFO:tasks.workunit.client.1.smithi203.stdout:6/926: read d0/d5b/d5c/d6f/fc1 [647433,16405] 0 2024-09-11T00:07:39.869 INFO:tasks.workunit.client.1.smithi203.stdout:7/942: unlink dd/d1c/d52/d8f/d31/d4a/d6e/df6/d13f/c130 0 2024-09-11T00:07:39.874 INFO:tasks.workunit.client.1.smithi203.stdout:4/867: dread db/dd/d26/fd0 [0,4194304] 0 2024-09-11T00:07:39.880 INFO:tasks.workunit.client.1.smithi203.stdout:7/943: dread dd/d1c/d52/d8f/d31/d58/fbe [0,4194304] 0 2024-09-11T00:07:39.881 INFO:tasks.workunit.client.1.smithi203.stdout:8/882: write d1/d13/d17/d48/f53 [1188789,97107] 0 2024-09-11T00:07:39.887 INFO:tasks.workunit.client.1.smithi203.stdout:9/960: creat d6/de/d32/d112/f13f x:0 0 0 2024-09-11T00:07:39.887 INFO:tasks.workunit.client.1.smithi203.stdout:6/927: dwrite d0/d32/f7a [0,4194304] 0 2024-09-11T00:07:39.890 INFO:tasks.workunit.client.1.smithi203.stdout:6/928: readlink d0/d54/d9c/d35/d38/dc0/l10e 0 2024-09-11T00:07:39.894 INFO:tasks.workunit.client.1.smithi203.stdout:4/868: rename db/dd/d26/dcd/fee to db/d12/d15/d111/f119 0 2024-09-11T00:07:39.896 INFO:tasks.workunit.client.1.smithi203.stdout:8/883: fsync d1/d13/d17/d48/d9d/fb6 0 2024-09-11T00:07:39.902 INFO:tasks.workunit.client.1.smithi203.stdout:6/929: symlink d0/d54/d9c/d35/db8/l11b 0 2024-09-11T00:07:39.905 INFO:tasks.workunit.client.1.smithi203.stdout:7/944: mknod dd/d3b/d5b/ddd/df3/d14d/c14f 0 2024-09-11T00:07:39.910 INFO:tasks.workunit.client.1.smithi203.stdout:0/948: creat d0/d2/f138 x:0 0 0 2024-09-11T00:07:39.911 INFO:tasks.workunit.client.1.smithi203.stdout:8/884: mknod d1/d78/df4/c130 0 2024-09-11T00:07:39.917 INFO:tasks.workunit.client.1.smithi203.stdout:6/930: rename d0/fc7 to d0/d5b/d5c/d6f/d102/f11c 0 2024-09-11T00:07:39.928 INFO:tasks.workunit.client.1.smithi203.stdout:4/869: creat db/dd/d16/ded/f11a x:0 0 0 2024-09-11T00:07:39.929 INFO:tasks.workunit.client.1.smithi203.stdout:9/961: write d6/de/d32/d52/d55/d66/d138/d40/fb9 [12202,45098] 0 2024-09-11T00:07:39.932 INFO:tasks.workunit.client.1.smithi203.stdout:9/962: fdatasync d6/de/d32/d52/d55/d66/d138/f118 0 2024-09-11T00:07:39.934 INFO:tasks.workunit.client.1.smithi203.stdout:9/963: chown d6/de/d32/f37 13 1 2024-09-11T00:07:39.935 INFO:tasks.workunit.client.1.smithi203.stdout:4/870: symlink db/d12/d15/d2a/dcb/l11b 0 2024-09-11T00:07:39.939 INFO:tasks.workunit.client.1.smithi203.stdout:8/885: rename d1/d13/d22/d6f/d8d/d121/f114 to d1/d13/d17/f131 0 2024-09-11T00:07:39.942 INFO:tasks.workunit.client.1.smithi203.stdout:7/945: dwrite dd/d1c/d52/d8f/f4f [0,4194304] 0 2024-09-11T00:07:39.945 INFO:tasks.workunit.client.1.smithi203.stdout:9/964: unlink d6/de/d47/de1/dec/df8/def/l128 0 2024-09-11T00:07:39.945 INFO:tasks.workunit.client.1.smithi203.stdout:0/949: link d0/d1d/c84 d0/d87/c139 0 2024-09-11T00:07:39.947 INFO:tasks.workunit.client.1.smithi203.stdout:4/871: truncate db/d12/fc8 872853 0 2024-09-11T00:07:39.948 INFO:tasks.workunit.client.1.smithi203.stdout:6/931: link d0/d54/d9c/d35/d38/d73/d74/c87 d0/c11d 0 2024-09-11T00:07:39.951 INFO:tasks.workunit.client.1.smithi203.stdout:8/886: rename d1/f2 to d1/d13/d17/d2f/d52/d49/d68/f132 0 2024-09-11T00:07:39.952 INFO:tasks.workunit.client.1.smithi203.stdout:0/950: truncate d0/d2/d37/d5b/d73/fe8 628094 0 2024-09-11T00:07:39.953 INFO:tasks.workunit.client.1.smithi203.stdout:7/946: mknod dd/d3b/d9f/c150 0 2024-09-11T00:07:39.954 INFO:tasks.workunit.client.1.smithi203.stdout:8/887: chown d1/d13/d3a/l45 84013587 1 2024-09-11T00:07:39.956 INFO:tasks.workunit.client.1.smithi203.stdout:6/932: dread - d0/d5b/d9f/fa6 zero size 2024-09-11T00:07:39.957 INFO:tasks.workunit.client.1.smithi203.stdout:0/951: fdatasync d0/d1d/d5d/f82 0 2024-09-11T00:07:39.960 INFO:tasks.workunit.client.1.smithi203.stdout:4/872: mknod db/c11c 0 2024-09-11T00:07:39.963 INFO:tasks.workunit.client.1.smithi203.stdout:6/933: fdatasync d0/d5b/d9f/ff0 0 2024-09-11T00:07:39.966 INFO:tasks.workunit.client.1.smithi203.stdout:0/952: creat d0/d2/d37/dfa/f13a x:0 0 0 2024-09-11T00:07:39.969 INFO:tasks.workunit.client.1.smithi203.stdout:4/873: creat db/d12/d15/d2a/d88/d95/dc2/f11d x:0 0 0 2024-09-11T00:07:39.974 INFO:tasks.workunit.client.1.smithi203.stdout:4/874: chown db/d12/d15/c36 859918 1 2024-09-11T00:07:39.976 INFO:tasks.workunit.client.1.smithi203.stdout:0/953: symlink d0/d2/d37/dfa/l13b 0 2024-09-11T00:07:39.979 INFO:tasks.workunit.client.1.smithi203.stdout:7/947: creat dd/d1c/d52/d8f/d31/d4a/d6e/df6/d13f/f151 x:0 0 0 2024-09-11T00:07:39.981 INFO:tasks.workunit.client.1.smithi203.stdout:6/934: truncate d0/d54/d9c/d7b/d7e/d94/fb0 1377254 0 2024-09-11T00:07:39.981 INFO:tasks.workunit.client.1.smithi203.stdout:6/935: stat d0/d5b 0 2024-09-11T00:07:39.987 INFO:tasks.workunit.client.1.smithi203.stdout:9/965: dwrite d6/de/d32/d52/d55/d66/d138/d40/f10f [0,4194304] 0 2024-09-11T00:07:39.987 INFO:tasks.workunit.client.1.smithi203.stdout:8/888: dwrite d1/d13/d17/d2f/d52/d59/f111 [0,4194304] 0 2024-09-11T00:07:39.987 INFO:tasks.workunit.client.1.smithi203.stdout:7/948: read dd/d1c/d52/d8f/d31/d4a/d105/f12f [619259,120292] 0 2024-09-11T00:07:39.996 INFO:tasks.workunit.client.1.smithi203.stdout:8/889: fdatasync d1/d13/d17/d8b/fcb 0 2024-09-11T00:07:40.012 INFO:tasks.workunit.client.1.smithi203.stdout:7/949: mknod dd/d1c/d52/d8f/d31/d4a/d105/d115/c152 0 2024-09-11T00:07:40.019 INFO:tasks.workunit.client.1.smithi203.stdout:9/966: dread d6/de/d32/f37 [0,4194304] 0 2024-09-11T00:07:40.025 INFO:tasks.workunit.client.1.smithi203.stdout:7/950: creat dd/d1c/d52/d8f/d31/d67/f153 x:0 0 0 2024-09-11T00:07:40.025 INFO:tasks.workunit.client.1.smithi203.stdout:4/875: write db/d12/d15/d2a/f1b [603110,77864] 0 2024-09-11T00:07:40.028 INFO:tasks.workunit.client.1.smithi203.stdout:9/967: chown d6/de/d32/d52/d55/d66/d138/d54/db2/de2/le4 1264355 1 2024-09-11T00:07:40.028 INFO:tasks.workunit.client.1.smithi203.stdout:4/876: stat db/dd/f13 0 2024-09-11T00:07:40.045 INFO:tasks.workunit.client.1.smithi203.stdout:8/890: dread d1/d13/d17/d48/d61/f71 [4194304,4194304] 0 2024-09-11T00:07:40.048 INFO:tasks.workunit.client.1.smithi203.stdout:8/891: chown d1/d13/d17/d48/d9d 26 1 2024-09-11T00:07:40.052 INFO:tasks.workunit.client.1.smithi203.stdout:8/892: write d1/f3b [830516,18423] 0 2024-09-11T00:07:40.054 INFO:tasks.workunit.client.1.smithi203.stdout:4/877: dwrite db/dd/d16/f55 [0,4194304] 0 2024-09-11T00:07:40.061 INFO:tasks.workunit.client.1.smithi203.stdout:6/936: dwrite d0/d54/d9c/d35/d39/d3c/fd2 [0,4194304] 0 2024-09-11T00:07:40.069 INFO:tasks.workunit.client.1.smithi203.stdout:8/893: mknod d1/d13/d17/d48/df2/c133 0 2024-09-11T00:07:40.071 INFO:tasks.workunit.client.1.smithi203.stdout:7/951: dwrite dd/d3b/fa4 [0,4194304] 0 2024-09-11T00:07:40.080 INFO:tasks.workunit.client.1.smithi203.stdout:8/894: creat d1/d13/d22/f134 x:0 0 0 2024-09-11T00:07:40.085 INFO:tasks.workunit.client.1.smithi203.stdout:7/952: dread dd/d1c/d52/d8f/d31/d67/dc3/fd1 [0,4194304] 0 2024-09-11T00:07:40.092 INFO:tasks.workunit.client.1.smithi203.stdout:4/878: truncate f1 777968 0 2024-09-11T00:07:40.094 INFO:tasks.workunit.client.1.smithi203.stdout:6/937: rename d0/d54/d9c/d35/d38/d73/caf to d0/d54/d9c/d35/d38/dc0/c11e 0 2024-09-11T00:07:40.101 INFO:tasks.workunit.client.1.smithi203.stdout:4/879: creat db/d12/d15/d111/f11e x:0 0 0 2024-09-11T00:07:40.108 INFO:tasks.workunit.client.1.smithi203.stdout:7/953: dwrite dd/f1a [4194304,4194304] 0 2024-09-11T00:07:40.109 INFO:tasks.workunit.client.1.smithi203.stdout:6/938: dread d0/f21 [0,4194304] 0 2024-09-11T00:07:40.115 INFO:tasks.workunit.client.1.smithi203.stdout:9/968: dread d6/de/fa9 [0,4194304] 0 2024-09-11T00:07:40.119 INFO:tasks.workunit.client.1.smithi203.stdout:8/895: dwrite d1/d13/d17/d48/d61/f71 [0,4194304] 0 2024-09-11T00:07:40.126 INFO:tasks.workunit.client.1.smithi203.stdout:6/939: mknod d0/d32/d5a/ddd/c11f 0 2024-09-11T00:07:40.128 INFO:tasks.workunit.client.1.smithi203.stdout:9/969: creat d6/de/d32/d52/d55/d66/d138/d40/f140 x:0 0 0 2024-09-11T00:07:40.129 INFO:tasks.workunit.client.1.smithi203.stdout:4/880: write db/f7e [836955,27085] 0 2024-09-11T00:07:40.135 INFO:tasks.workunit.client.1.smithi203.stdout:7/954: truncate dd/f1a 4452704 0 2024-09-11T00:07:40.136 INFO:tasks.workunit.client.1.smithi203.stdout:9/970: chown d6/de/d32/d52/d55/d66/d138/d40/f140 1063271572 1 2024-09-11T00:07:40.138 INFO:tasks.workunit.client.1.smithi203.stdout:8/896: symlink d1/d13/d43/d46/db0/dcf/l135 0 2024-09-11T00:07:40.143 INFO:tasks.workunit.client.1.smithi203.stdout:7/955: mknod dd/d1c/d52/d8f/d31/d4a/d6e/dcc/dea/de6/c154 0 2024-09-11T00:07:40.144 INFO:tasks.workunit.client.1.smithi203.stdout:6/940: fdatasync d0/d54/d9c/d35/d38/d73/d74/fa7 0 2024-09-11T00:07:40.148 INFO:tasks.workunit.client.1.smithi203.stdout:9/971: unlink d6/de/d32/c72 0 2024-09-11T00:07:40.203 INFO:tasks.workunit.client.1.smithi203.stdout:6/941: creat d0/d5b/f120 x:0 0 0 2024-09-11T00:07:40.204 INFO:tasks.workunit.client.1.smithi203.stdout:8/897: truncate d1/d13/d22/d6f/f60 4294830 0 2024-09-11T00:07:40.214 INFO:tasks.workunit.client.1.smithi203.stdout:8/898: rename d1/d13/d3a/d126 to d1/d13/d17/d2f/d52/d49/d7a/d136 0 2024-09-11T00:07:40.220 INFO:tasks.workunit.client.1.smithi203.stdout:7/956: dwrite dd/ff9 [0,4194304] 0 2024-09-11T00:07:40.225 INFO:tasks.workunit.client.1.smithi203.stdout:6/942: dwrite d0/d54/d9c/d35/d39/f6a [4194304,4194304] 0 2024-09-11T00:07:40.230 INFO:tasks.workunit.client.1.smithi203.stdout:7/957: rmdir dd/d3b/d14b 0 2024-09-11T00:07:40.232 INFO:tasks.workunit.client.1.smithi203.stdout:7/958: fdatasync dd/d1c/d7c/d8c/d13e/fef 0 2024-09-11T00:07:40.235 INFO:tasks.workunit.client.1.smithi203.stdout:6/943: getdents d0/d54/d9c 0 2024-09-11T00:07:40.236 INFO:tasks.workunit.client.1.smithi203.stdout:6/944: stat d0/d54/ca5 0 2024-09-11T00:07:40.238 INFO:tasks.workunit.client.1.smithi203.stdout:7/959: mkdir dd/d1c/d52/d8f/d31/d4a/d105/d115/d155 0 2024-09-11T00:07:40.245 INFO:tasks.workunit.client.1.smithi203.stdout:7/960: chown dd/d1c/d52/d8f/d31/d4a/d6e/df6/d13f/d98/fbd 55 1 2024-09-11T00:07:40.245 INFO:tasks.workunit.client.1.smithi203.stdout:9/972: write d6/de/d32/d52/d55/d66/d138/fb0 [1299457,122131] 0 2024-09-11T00:07:40.250 INFO:tasks.workunit.client.1.smithi203.stdout:7/961: truncate dd/fa7 374558 0 2024-09-11T00:07:40.253 INFO:tasks.workunit.client.1.smithi203.stdout:9/973: creat d6/de/d47/de1/dec/f141 x:0 0 0 2024-09-11T00:07:40.257 INFO:tasks.workunit.client.1.smithi203.stdout:6/945: write d0/d54/f68 [60631,36225] 0 2024-09-11T00:07:40.258 INFO:tasks.workunit.client.1.smithi203.stdout:7/962: mknod dd/d3b/d5b/dd9/c156 0 2024-09-11T00:07:40.260 INFO:tasks.workunit.client.1.smithi203.stdout:6/946: stat d0/d32/d5a/fba 0 2024-09-11T00:07:40.264 INFO:tasks.workunit.client.1.smithi203.stdout:6/947: mkdir d0/d54/d121 0 2024-09-11T00:07:40.266 INFO:tasks.workunit.client.1.smithi203.stdout:9/974: link d6/de/d32/d52/d55/d66/d138/d40/d45/f134 d6/de/d32/d52/d55/d66/daa/f142 0 2024-09-11T00:07:40.267 INFO:tasks.workunit.client.1.smithi203.stdout:6/948: rmdir d0 39 2024-09-11T00:07:40.270 INFO:tasks.workunit.client.1.smithi203.stdout:9/975: write d6/de/d32/d52/d55/d66/d138/d54/db2/de2/d10c/f123 [797974,113310] 0 2024-09-11T00:07:40.273 INFO:tasks.workunit.client.1.smithi203.stdout:6/949: mknod d0/c122 0 2024-09-11T00:07:40.273 INFO:tasks.workunit.client.1.smithi203.stdout:9/976: rmdir d6/de/d47/de1/dec/df8 39 2024-09-11T00:07:40.277 INFO:tasks.workunit.client.1.smithi203.stdout:9/977: write d6/de/d32/d52/d55/f12b [1377511,55522] 0 2024-09-11T00:07:40.286 INFO:tasks.workunit.client.1.smithi203.stdout:9/978: rename d6/de/d32/d52/d55/d66/d138/lcb to d6/de/d19/d21/dd0/l143 0 2024-09-11T00:07:40.288 INFO:tasks.workunit.client.1.smithi203.stdout:9/979: fsync d6/de/d32/d9e/fc8 0 2024-09-11T00:07:40.289 INFO:tasks.workunit.client.1.smithi203.stdout:6/950: write d0/d54/d9c/d35/d38/d73/fca [352505,29023] 0 2024-09-11T00:07:40.293 INFO:tasks.workunit.client.1.smithi203.stdout:9/980: mknod d6/de/d19/d21/dd0/c144 0 2024-09-11T00:07:40.298 INFO:tasks.workunit.client.1.smithi203.stdout:6/951: mkdir d0/d54/d9c/d35/d39/d123 0 2024-09-11T00:07:40.301 INFO:tasks.workunit.client.1.smithi203.stdout:0/954: sync 2024-09-11T00:07:40.303 INFO:tasks.workunit.client.1.smithi203.stdout:0/955: dread - d0/d2/d37/dfa/f13a zero size 2024-09-11T00:07:40.307 INFO:tasks.workunit.client.1.smithi203.stdout:6/952: getdents d0/d32 0 2024-09-11T00:07:40.309 INFO:tasks.workunit.client.1.smithi203.stdout:0/956: mkdir d0/d2/d7e/da1/d120/d13c 0 2024-09-11T00:07:40.310 INFO:tasks.workunit.client.1.smithi203.stdout:0/957: readlink d0/d1d/l49 0 2024-09-11T00:07:40.316 INFO:tasks.workunit.client.1.smithi203.stdout:6/953: write d0/d5b/fbf [577014,92714] 0 2024-09-11T00:07:40.316 INFO:tasks.workunit.client.1.smithi203.stdout:0/958: truncate d0/d2/f41 4548168 0 2024-09-11T00:07:40.318 INFO:tasks.workunit.client.1.smithi203.stdout:9/981: dwrite d6/de/d32/d52/d55/d66/d138/d40/d45/f134 [0,4194304] 0 2024-09-11T00:07:40.319 INFO:tasks.workunit.client.1.smithi203.stdout:6/954: chown d0/d54/d9c/cfa 0 1 2024-09-11T00:07:40.321 INFO:tasks.workunit.client.1.smithi203.stdout:6/955: stat d0/d32/d5a/ddd 0 2024-09-11T00:07:40.501 INFO:tasks.workunit.client.1.smithi203.stdout:0/959: truncate d0/d2/d37/d5b/d73/fbf 3778395 0 2024-09-11T00:07:40.503 INFO:tasks.workunit.client.1.smithi203.stdout:9/982: write d6/de/fe6 [1885676,94920] 0 2024-09-11T00:07:40.507 INFO:tasks.workunit.client.1.smithi203.stdout:9/983: dread - d6/de/d47/de1/dec/f141 zero size 2024-09-11T00:07:40.514 INFO:tasks.workunit.client.1.smithi203.stdout:9/984: symlink d6/de/d32/d52/d55/d66/l145 0 2024-09-11T00:07:40.519 INFO:tasks.workunit.client.1.smithi203.stdout:9/985: chown d6/de/d47/de1/dec/df8/def 12 1 2024-09-11T00:07:40.526 INFO:tasks.workunit.client.1.smithi203.stdout:9/986: write d6/de/d32/d52/d55/d66/d138/d54/db2/de2/d10c/f123 [1121127,42354] 0 2024-09-11T00:07:40.549 INFO:tasks.workunit.client.1.smithi203.stdout:9/987: getdents d6/de/d19/d21/da0 0 2024-09-11T00:07:40.557 INFO:tasks.workunit.client.1.smithi203.stdout:9/988: creat d6/de/d47/dc3/f146 x:0 0 0 2024-09-11T00:07:40.562 INFO:tasks.workunit.client.1.smithi203.stdout:4/881: sync 2024-09-11T00:07:40.565 INFO:tasks.workunit.client.1.smithi203.stdout:9/989: symlink d6/de/d32/d52/d55/d66/daa/df7/l147 0 2024-09-11T00:07:40.566 INFO:tasks.workunit.client.1.smithi203.stdout:4/882: chown db/dd/d16/d38/d3c/da6/l115 60971 1 2024-09-11T00:07:40.568 INFO:tasks.workunit.client.1.smithi203.stdout:4/883: fsync db/d12/d15/f109 0 2024-09-11T00:07:40.579 INFO:tasks.workunit.client.1.smithi203.stdout:4/884: creat db/d12/d15/d2a/d88/d95/dc2/de6/f11f x:0 0 0 2024-09-11T00:07:40.581 INFO:tasks.workunit.client.1.smithi203.stdout:4/885: chown db/dd/d16/cac 0 1 2024-09-11T00:07:40.586 INFO:tasks.workunit.client.1.smithi203.stdout:4/886: truncate db/dd/d26/f77 4593058 0 2024-09-11T00:07:40.647 INFO:tasks.workunit.client.1.smithi203.stdout:4/887: read db/dd/d16/f4f [1216599,58562] 0 2024-09-11T00:07:40.651 INFO:tasks.workunit.client.1.smithi203.stdout:4/888: mknod db/d12/d15/c120 0 2024-09-11T00:07:40.656 INFO:tasks.workunit.client.1.smithi203.stdout:4/889: creat db/dd/d16/d38/d3c/da6/f121 x:0 0 0 2024-09-11T00:07:40.664 INFO:tasks.workunit.client.1.smithi203.stdout:4/890: mknod db/d12/d15/d2a/d88/d95/dc2/d118/c122 0 2024-09-11T00:07:40.681 INFO:tasks.workunit.client.1.smithi203.stdout:8/899: sync 2024-09-11T00:07:40.681 INFO:tasks.workunit.client.1.smithi203.stdout:6/956: sync 2024-09-11T00:07:40.681 INFO:tasks.workunit.client.1.smithi203.stdout:7/963: sync 2024-09-11T00:07:40.684 INFO:tasks.workunit.client.1.smithi203.stdout:8/900: stat d1/d13/d17/d81/lbf 0 2024-09-11T00:07:40.686 INFO:tasks.workunit.client.1.smithi203.stdout:7/964: write dd/d3b/fd7 [3690299,44822] 0 2024-09-11T00:07:40.701 INFO:tasks.workunit.client.1.smithi203.stdout:6/957: link d0/d5b/d5c/d6f/f92 d0/d54/d9c/d35/d39/f124 0 2024-09-11T00:07:40.726 INFO:tasks.workunit.client.1.smithi203.stdout:7/965: dread dd/d1c/f78 [0,4194304] 0 2024-09-11T00:07:40.742 INFO:tasks.workunit.client.1.smithi203.stdout:4/891: rmdir db/dd 39 2024-09-11T00:07:40.804 INFO:tasks.workunit.client.1.smithi203.stdout:9/990: creat d6/de/d32/d52/d55/f148 x:0 0 0 2024-09-11T00:07:40.810 INFO:tasks.workunit.client.1.smithi203.stdout:0/960: creat d0/d2/f13d x:0 0 0 2024-09-11T00:07:40.813 INFO:tasks.workunit.client.1.smithi203.stdout:9/991: rename d6/de/d32/d52/d55/f12b to d6/de/d32/d52/d55/d66/d138/d113/f149 0 2024-09-11T00:07:40.815 INFO:tasks.workunit.client.1.smithi203.stdout:9/992: read d6/de/d19/fa7 [188713,11387] 0 2024-09-11T00:07:40.818 INFO:tasks.workunit.client.1.smithi203.stdout:0/961: creat d0/d2/d37/f13e x:0 0 0 2024-09-11T00:07:40.824 INFO:tasks.workunit.client.1.smithi203.stdout:6/958: write d0/d54/d9c/d35/d39/d3c/f6e [1972891,8865] 0 2024-09-11T00:07:40.827 INFO:tasks.workunit.client.1.smithi203.stdout:6/959: mkdir d0/d32/d5a/ddd/d125 0 2024-09-11T00:07:40.832 INFO:tasks.workunit.client.1.smithi203.stdout:4/892: write db/dd/d16/ded/fa7 [1249503,95803] 0 2024-09-11T00:07:40.838 INFO:tasks.workunit.client.1.smithi203.stdout:7/966: dwrite dd/d1c/d52/d8f/d31/d4a/f86 [0,4194304] 0 2024-09-11T00:07:40.839 INFO:tasks.workunit.client.1.smithi203.stdout:4/893: symlink db/d12/d15/d2a/dcb/de5/l123 0 2024-09-11T00:07:40.849 INFO:tasks.workunit.client.1.smithi203.stdout:4/894: rename db/dd/d16/f6e to db/dd/f124 0 2024-09-11T00:07:40.851 INFO:tasks.workunit.client.1.smithi203.stdout:9/993: mknod d6/de/d32/d52/c14a 0 2024-09-11T00:07:40.858 INFO:tasks.workunit.client.1.smithi203.stdout:9/994: unlink d6/de/d32/d52/d55/d66/d138/d40/d45/f15 0 2024-09-11T00:07:40.861 INFO:tasks.workunit.client.1.smithi203.stdout:0/962: write d0/d2/d37/d5b/fe3 [321856,32453] 0 2024-09-11T00:07:40.864 INFO:tasks.workunit.client.1.smithi203.stdout:9/995: symlink d6/de/d32/d52/d55/d66/d138/d6c/l14b 0 2024-09-11T00:07:40.865 INFO:tasks.workunit.client.1.smithi203.stdout:7/967: truncate dd/d1c/d7c/d8c/d13e/f131 813171 0 2024-09-11T00:07:40.867 INFO:tasks.workunit.client.1.smithi203.stdout:0/963: mknod d0/d2/d7e/da1/dc9/de7/d77/c13f 0 2024-09-11T00:07:40.869 INFO:tasks.workunit.client.1.smithi203.stdout:9/996: chown d6/c69 872 1 2024-09-11T00:07:40.872 INFO:tasks.workunit.client.1.smithi203.stdout:6/960: dwrite d0/d54/d9c/d35/fce [0,4194304] 0 2024-09-11T00:07:40.874 INFO:tasks.workunit.client.1.smithi203.stdout:9/997: stat d6/de/d19/f4c 0 2024-09-11T00:07:40.874 INFO:tasks.workunit.client.1.smithi203.stdout:0/964: creat d0/d1d/d5d/dba/f140 x:0 0 0 2024-09-11T00:07:40.878 INFO:tasks.workunit.client.1.smithi203.stdout:0/965: chown d0/d87/db9/c121 0 1 2024-09-11T00:07:40.881 INFO:tasks.workunit.client.1.smithi203.stdout:4/895: dwrite db/d12/d15/d2a/d71/f96 [0,4194304] 0 2024-09-11T00:07:40.888 INFO:tasks.workunit.client.1.smithi203.stdout:4/896: creat db/dd/d16/f125 x:0 0 0 2024-09-11T00:07:40.894 INFO:tasks.workunit.client.1.smithi203.stdout:9/998: mkdir d6/de/d47/de1/dec/d14c 0 2024-09-11T00:07:40.897 INFO:tasks.workunit.client.1.smithi203.stdout:4/897: creat db/dd/d16/d38/d3c/f126 x:0 0 0 2024-09-11T00:07:40.898 INFO:tasks.workunit.client.1.smithi203.stdout:9/999: readlink d6/de/d32/d52/d55/d66/d138/d6c/l14b 0 2024-09-11T00:07:40.902 INFO:tasks.workunit.client.1.smithi203.stdout:0/966: link d0/d2/d7e/c109 d0/d1d/d5d/d70/c141 0 2024-09-11T00:07:40.903 INFO:tasks.workunit.client.1.smithi203.stdout:7/968: dwrite dd/d1c/d52/d8f/d31/d67/dc8/fd3 [0,4194304] 0 2024-09-11T00:07:40.904 INFO:tasks.workunit.client.1.smithi203.stdout:4/898: rmdir db/d12/d15/d111 39 2024-09-11T00:07:40.906 INFO:tasks.workunit.client.1.smithi203.stdout:6/961: dwrite d0/d5b/f120 [0,4194304] 0 2024-09-11T00:07:40.911 INFO:tasks.workunit.client.1.smithi203.stdout:0/967: mkdir d0/d2/d37/d80/d142 0 2024-09-11T00:07:40.916 INFO:tasks.workunit.client.1.smithi203.stdout:6/962: symlink d0/d54/d9c/d35/d38/dc0/ddb/d82/l126 0 2024-09-11T00:07:40.918 INFO:tasks.workunit.client.1.smithi203.stdout:0/968: symlink d0/d1d/d5d/dec/l143 0 2024-09-11T00:07:40.922 INFO:tasks.workunit.client.1.smithi203.stdout:4/899: rename db/d12/d15/d2a/d88/d95/dc2/l103 to db/dd/d26/d42/d102/l127 0 2024-09-11T00:07:40.924 INFO:tasks.workunit.client.1.smithi203.stdout:6/963: mkdir d0/d5b/d5c/d127 0 2024-09-11T00:07:40.928 INFO:tasks.workunit.client.1.smithi203.stdout:0/969: rename d0/d2/d7e/da1/df5/l105 to d0/d2/d7e/dd2/l144 0 2024-09-11T00:07:40.930 INFO:tasks.workunit.client.1.smithi203.stdout:4/900: mkdir db/d12/d15/d2a/dcb/de5/d128 0 2024-09-11T00:07:40.931 INFO:tasks.workunit.client.1.smithi203.stdout:6/964: read - d0/d32/d5a/ffe zero size 2024-09-11T00:07:40.931 INFO:tasks.workunit.client.1.smithi203.stdout:4/901: dread - db/dd/ff7 zero size 2024-09-11T00:07:40.935 INFO:tasks.workunit.client.1.smithi203.stdout:6/965: unlink d0/d54/d9c/f66 0 2024-09-11T00:07:40.937 INFO:tasks.workunit.client.1.smithi203.stdout:0/970: rename d0/d1d/l59 to d0/d2/d37/d7f/l145 0 2024-09-11T00:07:40.943 INFO:tasks.workunit.client.1.smithi203.stdout:0/971: stat d0/d2/d7e/da1/df5/l9e 0 2024-09-11T00:07:40.947 INFO:tasks.workunit.client.1.smithi203.stdout:7/969: dwrite dd/f22 [0,4194304] 0 2024-09-11T00:07:40.952 INFO:tasks.workunit.client.1.smithi203.stdout:4/902: write db/dd/d16/d38/d3c/fdc [3728025,97231] 0 2024-09-11T00:07:40.955 INFO:tasks.workunit.client.1.smithi203.stdout:7/970: mknod dd/d1c/d7c/d8c/c157 0 2024-09-11T00:07:40.956 INFO:tasks.workunit.client.1.smithi203.stdout:4/903: read db/d12/f37 [1216086,100238] 0 2024-09-11T00:07:40.957 INFO:tasks.workunit.client.1.smithi203.stdout:0/972: getdents d0/d2/d37/d80 0 2024-09-11T00:07:40.957 INFO:tasks.workunit.client.1.smithi203.stdout:6/966: fsync d0/d54/d9c/d7b/d7e/d94/f10d 0 2024-09-11T00:07:40.958 INFO:tasks.workunit.client.1.smithi203.stdout:7/971: fdatasync dd/d1c/d52/d8f/d31/d4a/d105/d115/f142 0 2024-09-11T00:07:40.960 INFO:tasks.workunit.client.1.smithi203.stdout:7/972: write dd/d3b/fa4 [5074756,38382] 0 2024-09-11T00:07:40.962 INFO:tasks.workunit.client.1.smithi203.stdout:4/904: creat db/d12/d15/d2a/d71/f129 x:0 0 0 2024-09-11T00:07:40.966 INFO:tasks.workunit.client.1.smithi203.stdout:6/967: symlink d0/d71/db9/l128 0 2024-09-11T00:07:40.969 INFO:tasks.workunit.client.1.smithi203.stdout:6/968: stat d0/d5b/d5c/d6f/de7/d107 0 2024-09-11T00:07:40.971 INFO:tasks.workunit.client.1.smithi203.stdout:4/905: creat db/d12/d15/d2a/d88/d95/f12a x:0 0 0 2024-09-11T00:07:40.980 INFO:tasks.workunit.client.1.smithi203.stdout:4/906: mknod db/dd/d26/df3/c12b 0 2024-09-11T00:07:40.980 INFO:tasks.workunit.client.1.smithi203.stdout:7/973: write dd/f3e [6682172,13240] 0 2024-09-11T00:07:40.986 INFO:tasks.workunit.client.1.smithi203.stdout:0/973: dwrite d0/d1d/f69 [0,4194304] 0 2024-09-11T00:07:40.987 INFO:tasks.workunit.client.1.smithi203.stdout:6/969: dread d0/d54/d9c/d35/d39/d3c/fd2 [0,4194304] 0 2024-09-11T00:07:40.989 INFO:tasks.workunit.client.1.smithi203.stdout:7/974: creat dd/d1c/d52/d8f/d31/d67/dc8/f158 x:0 0 0 2024-09-11T00:07:40.992 INFO:tasks.workunit.client.1.smithi203.stdout:0/974: write d0/d2/d7e/da1/fe1 [905725,53751] 0 2024-09-11T00:07:41.006 INFO:tasks.workunit.client.1.smithi203.stdout:6/970: truncate d0/d5b/d5c/d6f/d102/f105 1021132 0 2024-09-11T00:07:41.006 INFO:tasks.workunit.client.1.smithi203.stdout:6/971: stat d0/lda 0 2024-09-11T00:07:41.006 INFO:tasks.workunit.client.1.smithi203.stdout:0/975: mkdir d0/d1d/d5d/dec/df7/d146 0 2024-09-11T00:07:41.006 INFO:tasks.workunit.client.1.smithi203.stdout:4/907: dwrite db/dd/d16/d38/d3c/f72 [0,4194304] 0 2024-09-11T00:07:41.006 INFO:tasks.workunit.client.1.smithi203.stdout:8/901: sync 2024-09-11T00:07:41.011 INFO:tasks.workunit.client.1.smithi203.stdout:6/972: symlink d0/d32/l129 0 2024-09-11T00:07:41.012 INFO:tasks.workunit.client.1.smithi203.stdout:4/908: chown db/dd/d26/d42/fd8 195034 1 2024-09-11T00:07:41.014 INFO:tasks.workunit.client.1.smithi203.stdout:0/976: fsync d0/d2/d7e/da1/dc9/fee 0 2024-09-11T00:07:41.020 INFO:tasks.workunit.client.1.smithi203.stdout:6/973: unlink d0/d5b/fa3 0 2024-09-11T00:07:41.021 INFO:tasks.workunit.client.1.smithi203.stdout:0/977: dread d0/d2/d37/d5b/d73/fe8 [0,4194304] 0 2024-09-11T00:07:41.027 INFO:tasks.workunit.client.1.smithi203.stdout:0/978: chown d0/d2/d37/d80/lf9 4002 1 2024-09-11T00:07:41.029 INFO:tasks.workunit.client.1.smithi203.stdout:7/975: dwrite dd/d1c/d52/d8f/d31/d67/f109 [0,4194304] 0 2024-09-11T00:07:41.032 INFO:tasks.workunit.client.1.smithi203.stdout:4/909: fsync db/dd/d26/f77 0 2024-09-11T00:07:41.035 INFO:tasks.workunit.client.1.smithi203.stdout:4/910: write db/dd/d16/ded/fa7 [861066,61201] 0 2024-09-11T00:07:41.037 INFO:tasks.workunit.client.1.smithi203.stdout:7/976: symlink dd/d1c/d52/d8f/d111/l159 0 2024-09-11T00:07:41.041 INFO:tasks.workunit.client.1.smithi203.stdout:7/977: readlink dd/d1c/d7c/l87 0 2024-09-11T00:07:41.048 INFO:tasks.workunit.client.1.smithi203.stdout:8/902: dwrite d1/d13/d17/d81/d97/fb1 [0,4194304] 0 2024-09-11T00:07:41.058 INFO:tasks.workunit.client.1.smithi203.stdout:6/974: truncate d0/d54/d9c/d35/fce 642275 0 2024-09-11T00:07:41.058 INFO:tasks.workunit.client.1.smithi203.stdout:8/903: read - d1/d13/d22/f88 zero size 2024-09-11T00:07:41.058 INFO:tasks.workunit.client.1.smithi203.stdout:6/975: write d0/d54/d9c/d35/d39/ffd [116405,40994] 0 2024-09-11T00:07:41.063 INFO:tasks.workunit.client.1.smithi203.stdout:7/978: link dd/d1c/d52/d8f/d31/f144 dd/d1c/d52/d8f/d31/d4a/d6e/df6/d13f/f15a 0 2024-09-11T00:07:41.065 INFO:tasks.workunit.client.1.smithi203.stdout:8/904: read - d1/d13/d22/d6f/d8d/d121/f103 zero size 2024-09-11T00:07:41.070 INFO:tasks.workunit.client.1.smithi203.stdout:8/905: stat d1/d13/d17/d48/d9d/d10b/c11d 0 2024-09-11T00:07:41.071 INFO:tasks.workunit.client.1.smithi203.stdout:4/911: dwrite db/dd/d26/fa3 [0,4194304] 0 2024-09-11T00:07:41.076 INFO:tasks.workunit.client.1.smithi203.stdout:0/979: dread d0/d2/d37/d7f/f85 [0,4194304] 0 2024-09-11T00:07:41.077 INFO:tasks.workunit.client.1.smithi203.stdout:8/906: mknod d1/d13/d22/d6f/c137 0 2024-09-11T00:07:41.081 INFO:tasks.workunit.client.1.smithi203.stdout:0/980: chown d0/d2/d37/d5b/d73/le5 18117 1 2024-09-11T00:07:41.081 INFO:tasks.workunit.client.1.smithi203.stdout:8/907: dread - d1/d13/d22/d6f/d8d/d121/f103 zero size 2024-09-11T00:07:41.082 INFO:tasks.workunit.client.1.smithi203.stdout:4/912: rmdir db/d12/d15/d2a/dcb 39 2024-09-11T00:07:41.084 INFO:tasks.workunit.client.1.smithi203.stdout:0/981: chown d0/d2/d37/d5b/d73/db6 992 1 2024-09-11T00:07:41.084 INFO:tasks.workunit.client.1.smithi203.stdout:8/908: write d1/d13/d22/f123 [704203,60219] 0 2024-09-11T00:07:41.091 INFO:tasks.workunit.client.1.smithi203.stdout:8/909: fsync d1/d13/f33 0 2024-09-11T00:07:41.097 INFO:tasks.workunit.client.1.smithi203.stdout:7/979: dwrite dd/d1c/d52/d8f/d31/d4a/d105/dbb/f14a [4194304,4194304] 0 2024-09-11T00:07:41.100 INFO:tasks.workunit.client.1.smithi203.stdout:8/910: dread - d1/d13/d17/d2f/d52/d49/fdf zero size 2024-09-11T00:07:41.102 INFO:tasks.workunit.client.1.smithi203.stdout:0/982: dread d0/d2/d37/d7f/f85 [0,4194304] 0 2024-09-11T00:07:41.112 INFO:tasks.workunit.client.1.smithi203.stdout:0/983: rmdir d0/d2/d7e/da1/d120/d13c 0 2024-09-11T00:07:41.117 INFO:tasks.workunit.client.1.smithi203.stdout:0/984: mkdir d0/d2/db3/d147 0 2024-09-11T00:07:41.119 INFO:tasks.workunit.client.1.smithi203.stdout:4/913: truncate db/dd/d26/f30 1330023 0 2024-09-11T00:07:41.122 INFO:tasks.workunit.client.1.smithi203.stdout:8/911: write d1/d13/d17/d48/d9d/da9/f100 [5330302,119460] 0 2024-09-11T00:07:41.126 INFO:tasks.workunit.client.1.smithi203.stdout:0/985: creat d0/d2/d37/f148 x:0 0 0 2024-09-11T00:07:41.129 INFO:tasks.workunit.client.1.smithi203.stdout:4/914: rmdir db/d12/d15/d2a/d88/d95 39 2024-09-11T00:07:41.131 INFO:tasks.workunit.client.1.smithi203.stdout:7/980: dwrite dd/d1c/d52/d8f/d31/d4a/d6e/df6/d13f/d98/dfc/f104 [0,4194304] 0 2024-09-11T00:07:41.132 INFO:tasks.workunit.client.1.smithi203.stdout:8/912: creat d1/d13/d17/d48/d61/d113/f138 x:0 0 0 2024-09-11T00:07:41.135 INFO:tasks.workunit.client.1.smithi203.stdout:8/913: readlink d1/d13/d17/d77/l116 0 2024-09-11T00:07:41.137 INFO:tasks.workunit.client.1.smithi203.stdout:4/915: dread db/dd/d26/d42/d102/f10c [0,4194304] 0 2024-09-11T00:07:41.156 INFO:tasks.workunit.client.1.smithi203.stdout:0/986: creat d0/d1d/d5d/dec/df7/d127/f149 x:0 0 0 2024-09-11T00:07:41.159 INFO:tasks.workunit.client.1.smithi203.stdout:7/981: symlink dd/d1c/d52/l15b 0 2024-09-11T00:07:41.167 INFO:tasks.workunit.client.1.smithi203.stdout:7/982: fsync dd/d1c/d7c/d8c/d13e/f73 0 2024-09-11T00:07:41.169 INFO:tasks.workunit.client.1.smithi203.stdout:0/987: link d0/d2/d7e/da1/dc9/de7/f7c d0/d2/d7e/da1/dc9/d122/f14a 0 2024-09-11T00:07:41.170 INFO:tasks.workunit.client.1.smithi203.stdout:7/983: write dd/d1c/f66 [3752989,3114] 0 2024-09-11T00:07:41.172 INFO:tasks.workunit.client.1.smithi203.stdout:0/988: dread - d0/d2/d37/f13e zero size 2024-09-11T00:07:41.174 INFO:tasks.workunit.client.1.smithi203.stdout:4/916: dwrite db/dd/d16/f4f [0,4194304] 0 2024-09-11T00:07:41.178 INFO:tasks.workunit.client.1.smithi203.stdout:7/984: symlink dd/d3b/d5b/ddd/df3/l15c 0 2024-09-11T00:07:41.178 INFO:tasks.workunit.client.1.smithi203.stdout:8/914: dread d1/d13/d17/d81/fc1 [0,4194304] 0 2024-09-11T00:07:41.183 INFO:tasks.workunit.client.1.smithi203.stdout:4/917: unlink db/dd/d26/dcd/fc5 0 2024-09-11T00:07:41.185 INFO:tasks.workunit.client.1.smithi203.stdout:4/918: write db/f6c [3079500,71582] 0 2024-09-11T00:07:41.193 INFO:tasks.workunit.client.1.smithi203.stdout:8/915: rename d1/d13/d17/d2f/d52/d49/d68/dba to d1/d13/d3a/d139 0 2024-09-11T00:07:41.202 INFO:tasks.workunit.client.1.smithi203.stdout:7/985: dread dd/d1c/d7c/d8c/d13e/f90 [0,4194304] 0 2024-09-11T00:07:41.213 INFO:tasks.workunit.client.1.smithi203.stdout:8/916: dwrite d1/d13/d22/d6f/d8d/d121/f103 [0,4194304] 0 2024-09-11T00:07:41.215 INFO:tasks.workunit.client.1.smithi203.stdout:0/989: link d0/d1d/d4c/f6d d0/d2/d7e/da1/f14b 0 2024-09-11T00:07:41.216 INFO:tasks.workunit.client.1.smithi203.stdout:0/990: stat d0/d1d/c26 0 2024-09-11T00:07:41.217 INFO:tasks.workunit.client.1.smithi203.stdout:8/917: creat d1/d13/d43/d46/db0/dcf/f13a x:0 0 0 2024-09-11T00:07:41.218 INFO:tasks.workunit.client.1.smithi203.stdout:7/986: dwrite dd/d1c/d7c/fba [0,4194304] 0 2024-09-11T00:07:41.221 INFO:tasks.workunit.client.1.smithi203.stdout:7/987: chown dd/d3b/d5b/ddd/df3/l15c 141 1 2024-09-11T00:07:41.236 INFO:tasks.workunit.client.1.smithi203.stdout:4/919: dwrite db/dd/d26/d42/f45 [0,4194304] 0 2024-09-11T00:07:41.240 INFO:tasks.workunit.client.1.smithi203.stdout:0/991: write d0/d2/f51 [2103400,73168] 0 2024-09-11T00:07:41.244 INFO:tasks.workunit.client.1.smithi203.stdout:7/988: getdents dd/d3b 0 2024-09-11T00:07:41.249 INFO:tasks.workunit.client.1.smithi203.stdout:0/992: mkdir d0/d87/db9/dd5/d14c 0 2024-09-11T00:07:41.251 INFO:tasks.workunit.client.1.smithi203.stdout:4/920: mkdir db/d12/d15/d2a/d88/d95/dc2/d12c 0 2024-09-11T00:07:41.251 INFO:tasks.workunit.client.1.smithi203.stdout:7/989: chown dd/d1c/d52/d8f/d31/f45 7983649 1 2024-09-11T00:07:41.256 INFO:tasks.workunit.client.1.smithi203.stdout:8/918: dwrite d1/d13/d17/d48/d9d/da9/fdb [0,4194304] 0 2024-09-11T00:07:41.257 INFO:tasks.workunit.client.1.smithi203.stdout:7/990: readlink dd/d1c/d52/d8f/d31/d67/dc3/l136 0 2024-09-11T00:07:41.265 INFO:tasks.workunit.client.1.smithi203.stdout:8/919: mkdir d1/d13/d43/d46/db0/d13b 0 2024-09-11T00:07:41.278 INFO:tasks.workunit.client.1.smithi203.stdout:8/920: dwrite d1/f8 [0,4194304] 0 2024-09-11T00:07:41.284 INFO:tasks.workunit.client.1.smithi203.stdout:8/921: truncate d1/f37 4562808 0 2024-09-11T00:07:41.286 INFO:tasks.workunit.client.1.smithi203.stdout:8/922: read - d1/d13/d22/f88 zero size 2024-09-11T00:07:41.289 INFO:tasks.workunit.client.1.smithi203.stdout:4/921: truncate db/dd/d16/f4f 5792022 0 2024-09-11T00:07:41.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:40 smithi203 ceph-mon[33225]: pgmap v18: 65 pgs: 65 active+clean; 3.9 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 72 MiB/s rd, 154 MiB/s wr, 368 op/s 2024-09-11T00:07:41.313 INFO:tasks.workunit.client.1.smithi203.stdout:4/922: write db/f7e [1394918,69898] 0 2024-09-11T00:07:41.315 INFO:tasks.workunit.client.1.smithi203.stdout:8/923: dread d1/d13/d17/f131 [0,4194304] 0 2024-09-11T00:07:41.315 INFO:tasks.workunit.client.1.smithi203.stdout:0/993: dwrite d0/d2/d37/d5b/fc1 [0,4194304] 0 2024-09-11T00:07:41.316 INFO:tasks.workunit.client.1.smithi203.stdout:8/924: stat d1/d13/d43/d46/db0 0 2024-09-11T00:07:41.321 INFO:tasks.workunit.client.1.smithi203.stdout:8/925: truncate d1/d13/d17/d77/ff7 679551 0 2024-09-11T00:07:41.333 INFO:tasks.workunit.client.1.smithi203.stdout:8/926: symlink d1/d13/d22/d6f/d12b/l13c 0 2024-09-11T00:07:41.349 INFO:tasks.workunit.client.1.smithi203.stdout:0/994: dwrite d0/d2/d37/d5b/f5e [0,4194304] 0 2024-09-11T00:07:41.351 INFO:tasks.workunit.client.1.smithi203.stdout:4/923: dwrite db/dd/d16/d38/d3c/d41/fae [0,4194304] 0 2024-09-11T00:07:41.353 INFO:tasks.workunit.client.1.smithi203.stdout:0/995: read - d0/d2/f138 zero size 2024-09-11T00:07:41.354 INFO:tasks.workunit.client.1.smithi203.stdout:8/927: dwrite d1/d13/d17/d81/d97/fb1 [4194304,4194304] 0 2024-09-11T00:07:41.361 INFO:tasks.workunit.client.1.smithi203.stdout:0/996: rmdir d0/d2/d37/d5b/d73/db6 39 2024-09-11T00:07:41.364 INFO:tasks.workunit.client.1.smithi203.stdout:8/928: truncate d1/f11 801222 0 2024-09-11T00:07:41.366 INFO:tasks.workunit.client.1.smithi203.stdout:8/929: chown d1/d13/d43/d46/d76/dac 8 1 2024-09-11T00:07:41.367 INFO:tasks.workunit.client.1.smithi203.stdout:0/997: creat d0/d1d/d5d/f14d x:0 0 0 2024-09-11T00:07:41.372 INFO:tasks.workunit.client.1.smithi203.stdout:8/930: creat d1/d13/d22/d6f/f13d x:0 0 0 2024-09-11T00:07:41.374 INFO:tasks.workunit.client.1.smithi203.stdout:8/931: chown d1/d13/d17/d48/d101 151341662 1 2024-09-11T00:07:41.377 INFO:tasks.workunit.client.1.smithi203.stdout:8/932: fdatasync d1/d13/d17/d2f/d52/fff 0 2024-09-11T00:07:41.381 INFO:tasks.workunit.client.1.smithi203.stdout:8/933: mknod d1/d13/d17/d2f/c13e 0 2024-09-11T00:07:41.384 INFO:tasks.workunit.client.1.smithi203.stdout:0/998: write d0/d1d/f90 [1478121,75123] 0 2024-09-11T00:07:41.385 INFO:tasks.workunit.client.1.smithi203.stdout:8/934: write d1/d13/d17/d81/d97/fb1 [2312457,78898] 0 2024-09-11T00:07:41.388 INFO:tasks.workunit.client.1.smithi203.stdout:8/935: dread - d1/d13/d17/d81/fe8 zero size 2024-09-11T00:07:41.393 INFO:tasks.workunit.client.1.smithi203.stdout:0/999: getdents d0/d1d/d5d/dec/df7 0 2024-09-11T00:07:41.397 INFO:tasks.workunit.client.1.smithi203.stdout:4/924: dread db/d12/d15/d2a/f8f [0,4194304] 0 2024-09-11T00:07:41.398 INFO:tasks.workunit.client.1.smithi203.stdout:8/936: unlink d1/d13/d17/d2f/d52/d49/lc4 0 2024-09-11T00:07:41.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:40 smithi111 ceph-mon[27539]: pgmap v18: 65 pgs: 65 active+clean; 3.9 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 72 MiB/s rd, 154 MiB/s wr, 368 op/s 2024-09-11T00:07:41.407 INFO:tasks.workunit.client.1.smithi203.stdout:8/937: write d1/d13/d17/d2f/d52/f92 [858882,72803] 0 2024-09-11T00:07:41.418 INFO:tasks.workunit.client.1.smithi203.stdout:4/925: dwrite db/dd/d16/ded/db5/fe0 [0,4194304] 0 2024-09-11T00:07:41.424 INFO:tasks.workunit.client.1.smithi203.stdout:4/926: mkdir db/d12/d15/d2a/d88/d95/dc2/de6/d12d 0 2024-09-11T00:07:41.426 INFO:tasks.workunit.client.1.smithi203.stdout:4/927: dread - db/dd/d16/d38/d3c/d41/fbd zero size 2024-09-11T00:07:41.431 INFO:tasks.workunit.client.1.smithi203.stdout:4/928: symlink db/d12/d15/d111/l12e 0 2024-09-11T00:07:41.434 INFO:tasks.workunit.client.1.smithi203.stdout:8/938: dread d1/fc [8388608,4194304] 0 2024-09-11T00:07:41.439 INFO:tasks.workunit.client.1.smithi203.stdout:8/939: mknod d1/d13/d43/d46/d76/dac/c13f 0 2024-09-11T00:07:41.446 INFO:tasks.workunit.client.1.smithi203.stdout:8/940: creat d1/d78/df4/f140 x:0 0 0 2024-09-11T00:07:41.447 INFO:tasks.workunit.client.1.smithi203.stdout:4/929: dwrite db/dd/d16/f125 [0,4194304] 0 2024-09-11T00:07:41.450 INFO:tasks.workunit.client.1.smithi203.stdout:4/930: read - db/dd/d16/d38/d3c/f126 zero size 2024-09-11T00:07:41.451 INFO:tasks.workunit.client.1.smithi203.stdout:8/941: creat d1/d13/d17/d2f/d52/f141 x:0 0 0 2024-09-11T00:07:41.457 INFO:tasks.workunit.client.1.smithi203.stdout:4/931: symlink db/dd/d16/d38/d3c/da6/l12f 0 2024-09-11T00:07:41.459 INFO:tasks.workunit.client.1.smithi203.stdout:4/932: readlink db/d12/d15/lbb 0 2024-09-11T00:07:41.460 INFO:tasks.workunit.client.1.smithi203.stdout:8/942: dread d1/f11 [0,4194304] 0 2024-09-11T00:07:41.471 INFO:tasks.workunit.client.1.smithi203.stdout:4/933: creat db/dd/d26/df3/f130 x:0 0 0 2024-09-11T00:07:41.495 INFO:tasks.workunit.client.1.smithi203.stdout:8/943: dread d1/d13/d17/d48/d9d/da9/f100 [0,4194304] 0 2024-09-11T00:07:41.500 INFO:tasks.workunit.client.1.smithi203.stdout:6/976: sync 2024-09-11T00:07:41.509 INFO:tasks.workunit.client.1.smithi203.stdout:8/944: dread - d1/d13/d17/d2f/d52/d49/f10a zero size 2024-09-11T00:07:41.517 INFO:tasks.workunit.client.1.smithi203.stdout:8/945: link d1/d13/l56 d1/d13/d3a/d139/d125/l142 0 2024-09-11T00:07:41.520 INFO:tasks.workunit.client.1.smithi203.stdout:8/946: fdatasync d1/d13/d22/f58 0 2024-09-11T00:07:41.525 INFO:tasks.workunit.client.1.smithi203.stdout:4/934: fsync db/dd/d26/df3/f130 0 2024-09-11T00:07:41.532 INFO:tasks.workunit.client.1.smithi203.stdout:8/947: link d1/d13/d17/d2f/fb7 d1/d13/d17/d2f/f143 0 2024-09-11T00:07:41.535 INFO:tasks.workunit.client.1.smithi203.stdout:8/948: fdatasync d1/d13/d43/fa5 0 2024-09-11T00:07:41.536 INFO:tasks.workunit.client.1.smithi203.stdout:6/977: write d0/f16 [972678,3555] 0 2024-09-11T00:07:41.541 INFO:tasks.workunit.client.1.smithi203.stdout:4/935: link db/d12/d15/d2a/dcb/cd2 db/dd/d16/d38/d3c/d41/c131 0 2024-09-11T00:07:41.545 INFO:tasks.workunit.client.1.smithi203.stdout:6/978: rename d0/d54/d9c/d35/d39/d3c/f79 to d0/d5b/d5c/d6f/de7/d107/f12a 0 2024-09-11T00:07:41.546 INFO:tasks.workunit.client.1.smithi203.stdout:8/949: fsync d1/d13/d43/d46/d76/fe6 0 2024-09-11T00:07:41.548 INFO:tasks.workunit.client.1.smithi203.stdout:6/979: read d0/d71/db9/ff7 [2015384,31606] 0 2024-09-11T00:07:41.549 INFO:tasks.workunit.client.1.smithi203.stdout:8/950: stat d1/d13/d17/l2b 0 2024-09-11T00:07:41.550 INFO:tasks.workunit.client.1.smithi203.stdout:6/980: dread - d0/d54/d9c/d7b/f117 zero size 2024-09-11T00:07:41.551 INFO:tasks.workunit.client.1.smithi203.stdout:6/981: read - d0/d5b/d9f/fd8 zero size 2024-09-11T00:07:41.553 INFO:tasks.workunit.client.1.smithi203.stdout:4/936: mkdir db/d12/d15/d2a/d132 0 2024-09-11T00:07:41.555 INFO:tasks.workunit.client.1.smithi203.stdout:8/951: mkdir d1/d13/d22/d6f/d8d/d121/d144 0 2024-09-11T00:07:41.562 INFO:tasks.workunit.client.1.smithi203.stdout:4/937: symlink db/d12/d15/d2a/l133 0 2024-09-11T00:07:41.566 INFO:tasks.workunit.client.1.smithi203.stdout:7/991: sync 2024-09-11T00:07:41.570 INFO:tasks.workunit.client.1.smithi203.stdout:8/952: getdents d1/d13/d17/d48/d9d/d10b 0 2024-09-11T00:07:41.572 INFO:tasks.workunit.client.1.smithi203.stdout:8/953: read - d1/d13/d43/fae zero size 2024-09-11T00:07:41.574 INFO:tasks.workunit.client.1.smithi203.stdout:6/982: dwrite d0/d32/f7a [0,4194304] 0 2024-09-11T00:07:41.577 INFO:tasks.workunit.client.1.smithi203.stdout:6/983: write d0/d5b/d9f/f113 [1028390,60141] 0 2024-09-11T00:07:41.584 INFO:tasks.workunit.client.1.smithi203.stdout:4/938: dread db/f6c [0,4194304] 0 2024-09-11T00:07:41.588 INFO:tasks.workunit.client.1.smithi203.stdout:4/939: write db/f23 [740691,53233] 0 2024-09-11T00:07:41.591 INFO:tasks.workunit.client.1.smithi203.stdout:8/954: getdents d1/d13/d43/d46 0 2024-09-11T00:07:41.596 INFO:tasks.workunit.client.1.smithi203.stdout:4/940: readlink db/dd/d16/ded/db5/l110 0 2024-09-11T00:07:41.599 INFO:tasks.workunit.client.1.smithi203.stdout:7/992: dread dd/f3e [4194304,4194304] 0 2024-09-11T00:07:41.611 INFO:tasks.workunit.client.1.smithi203.stdout:7/993: dread dd/d1c/d7c/f126 [0,4194304] 0 2024-09-11T00:07:41.629 INFO:tasks.workunit.client.1.smithi203.stdout:8/955: mknod d1/d13/d17/d48/dfa/c145 0 2024-09-11T00:07:41.633 INFO:tasks.workunit.client.1.smithi203.stdout:7/994: creat dd/d3b/d5b/ddd/df3/d13b/f15d x:0 0 0 2024-09-11T00:07:41.634 INFO:tasks.workunit.client.1.smithi203.stdout:4/941: dread db/d12/fc8 [0,4194304] 0 2024-09-11T00:07:41.638 INFO:tasks.workunit.client.1.smithi203.stdout:8/956: unlink d1/d13/d17/f38 0 2024-09-11T00:07:41.640 INFO:tasks.workunit.client.1.smithi203.stdout:4/942: mknod db/d12/d15/d111/c134 0 2024-09-11T00:07:41.644 INFO:tasks.workunit.client.1.smithi203.stdout:8/957: unlink d1/d13/d17/d77/dea/c85 0 2024-09-11T00:07:41.648 INFO:tasks.workunit.client.1.smithi203.stdout:4/943: mkdir db/dd/d26/d135 0 2024-09-11T00:07:41.652 INFO:tasks.workunit.client.1.smithi203.stdout:4/944: fdatasync db/f57 0 2024-09-11T00:07:41.657 INFO:tasks.workunit.client.1.smithi203.stdout:8/958: getdents d1/d13/d17/d48 0 2024-09-11T00:07:41.659 INFO:tasks.workunit.client.1.smithi203.stdout:4/945: mknod db/d12/d15/d2a/c136 0 2024-09-11T00:07:41.665 INFO:tasks.workunit.client.1.smithi203.stdout:4/946: link db/dd/d26/f28 db/d12/d15/d2a/d88/d95/dc2/d118/f137 0 2024-09-11T00:07:41.668 INFO:tasks.workunit.client.1.smithi203.stdout:4/947: write db/dd/d16/ded/fa7 [2850899,41885] 0 2024-09-11T00:07:41.681 INFO:tasks.workunit.client.1.smithi203.stdout:8/959: dread d1/d13/d17/d2f/d52/d49/d68/f10f [0,4194304] 0 2024-09-11T00:07:41.683 INFO:tasks.workunit.client.1.smithi203.stdout:8/960: readlink d1/d13/d22/d6f/l9b 0 2024-09-11T00:07:41.686 INFO:tasks.workunit.client.1.smithi203.stdout:8/961: mkdir d1/d13/d3a/d12d/d146 0 2024-09-11T00:07:41.688 INFO:tasks.workunit.client.1.smithi203.stdout:8/962: readlink d1/d13/l56 0 2024-09-11T00:07:41.697 INFO:tasks.workunit.client.1.smithi203.stdout:8/963: rmdir d1/d13/d43/d46/db0/d13b 0 2024-09-11T00:07:41.698 INFO:tasks.workunit.client.1.smithi203.stdout:4/948: write db/dd/d26/f77 [2731307,12047] 0 2024-09-11T00:07:41.699 INFO:tasks.workunit.client.1.smithi203.stdout:8/964: fdatasync d1/d13/d22/f88 0 2024-09-11T00:07:41.713 INFO:tasks.workunit.client.1.smithi203.stdout:4/949: link db/dd/d26/d42/d102/l127 db/d12/d15/d2a/l138 0 2024-09-11T00:07:41.719 INFO:tasks.workunit.client.1.smithi203.stdout:8/965: dread d1/d13/d17/d77/dea/f5e [0,4194304] 0 2024-09-11T00:07:41.724 INFO:tasks.workunit.client.1.smithi203.stdout:8/966: unlink d1/d13/d17/d2f/d52/d49/f93 0 2024-09-11T00:07:41.729 INFO:tasks.workunit.client.1.smithi203.stdout:8/967: dread d1/d13/d22/d6f/fbc [0,4194304] 0 2024-09-11T00:07:41.730 INFO:tasks.workunit.client.1.smithi203.stdout:8/968: readlink d1/d13/d43/d46/la1 0 2024-09-11T00:07:41.733 INFO:tasks.workunit.client.1.smithi203.stdout:8/969: symlink d1/d78/l147 0 2024-09-11T00:07:41.735 INFO:tasks.workunit.client.1.smithi203.stdout:8/970: fsync d1/d13/d17/d48/d61/f71 0 2024-09-11T00:07:41.748 INFO:tasks.workunit.client.1.smithi203.stdout:8/971: dwrite d1/d13/d17/d77/dea/f5c [0,4194304] 0 2024-09-11T00:07:41.750 INFO:tasks.workunit.client.1.smithi203.stdout:8/972: chown d1/d13/d17/d2f/d52/d49/d68/cb2 6930 1 2024-09-11T00:07:41.752 INFO:tasks.workunit.client.1.smithi203.stdout:8/973: readlink d1/d13/d17/d48/l5a 0 2024-09-11T00:07:41.757 INFO:tasks.workunit.client.1.smithi203.stdout:8/974: truncate d1/d13/d3a/d139/fd3 858238 0 2024-09-11T00:07:41.761 INFO:tasks.workunit.client.1.smithi203.stdout:8/975: creat d1/d13/d43/d46/db0/dcf/f148 x:0 0 0 2024-09-11T00:07:41.772 INFO:tasks.workunit.client.1.smithi203.stdout:8/976: write d1/f11 [114714,118322] 0 2024-09-11T00:07:41.786 INFO:tasks.workunit.client.1.smithi203.stdout:8/977: dwrite d1/d13/d17/d77/dea/f5c [0,4194304] 0 2024-09-11T00:07:41.804 INFO:tasks.workunit.client.1.smithi203.stdout:8/978: dwrite d1/d13/d17/f39 [0,4194304] 0 2024-09-11T00:07:41.807 INFO:tasks.workunit.client.1.smithi203.stdout:8/979: mknod d1/d78/df4/c149 0 2024-09-11T00:07:41.809 INFO:tasks.workunit.client.1.smithi203.stdout:8/980: mkdir d1/d14a 0 2024-09-11T00:07:41.818 INFO:tasks.workunit.client.1.smithi203.stdout:8/981: rmdir d1/d13/d17/d48/d9d/d10b 39 2024-09-11T00:07:41.825 INFO:tasks.workunit.client.1.smithi203.stdout:8/982: rename d1/d13/d22/d6f to d1/d13/d43/d46/db0/dcf/d14b 0 2024-09-11T00:07:41.837 INFO:tasks.workunit.client.1.smithi203.stdout:8/983: dwrite d1/d13/d17/d77/dea/da6/fcd [0,4194304] 0 2024-09-11T00:07:41.952 INFO:tasks.workunit.client.1.smithi203.stdout:8/984: creat d1/f14c x:0 0 0 2024-09-11T00:07:41.955 INFO:tasks.workunit.client.1.smithi203.stdout:8/985: creat d1/d13/d43/d46/d76/f14d x:0 0 0 2024-09-11T00:07:41.969 INFO:tasks.workunit.client.1.smithi203.stdout:8/986: dwrite d1/d13/d43/d46/db0/dcf/d14b/f13d [0,4194304] 0 2024-09-11T00:07:41.973 INFO:tasks.workunit.client.1.smithi203.stdout:8/987: truncate d1/d13/d17/d77/ff7 1027736 0 2024-09-11T00:07:41.979 INFO:tasks.workunit.client.1.smithi203.stdout:8/988: chown d1/d13/d43/d46/db0/dcf/d14b/d8d/d121/f66 4718 1 2024-09-11T00:07:41.982 INFO:tasks.workunit.client.1.smithi203.stdout:8/989: creat d1/d13/d43/dab/f14e x:0 0 0 2024-09-11T00:07:41.986 INFO:tasks.workunit.client.1.smithi203.stdout:8/990: rmdir d1/d13/d17/d81/d97 39 2024-09-11T00:07:41.992 INFO:tasks.workunit.client.1.smithi203.stdout:8/991: getdents d1/d13/d17/d2f/d52/d49/d7a 0 2024-09-11T00:07:42.005 INFO:tasks.workunit.client.1.smithi203.stdout:8/992: dwrite d1/d13/d43/dab/f14e [0,4194304] 0 2024-09-11T00:07:42.010 INFO:tasks.workunit.client.1.smithi203.stdout:8/993: rmdir d1/d13/d17/d2f/d52/d49/d68 39 2024-09-11T00:07:42.015 INFO:tasks.workunit.client.1.smithi203.stdout:8/994: truncate d1/d13/d3a/d139/f117 479814 0 2024-09-11T00:07:42.017 INFO:tasks.workunit.client.1.smithi203.stdout:8/995: stat d1/d13/d3a/da4/de0 0 2024-09-11T00:07:42.024 INFO:tasks.workunit.client.1.smithi203.stdout:8/996: write d1/d13/d17/d2f/d52/d59/f111 [686172,14487] 0 2024-09-11T00:07:42.028 INFO:tasks.workunit.client.1.smithi203.stdout:8/997: mknod d1/d13/d3a/d12d/d146/c14f 0 2024-09-11T00:07:42.036 INFO:tasks.workunit.client.1.smithi203.stdout:8/998: dread d1/d13/d3a/f44 [0,4194304] 0 2024-09-11T00:07:42.037 INFO:tasks.workunit.client.1.smithi203.stdout:8/999: stat d1/d13/d17/d77/dea/c51 0 2024-09-11T00:07:42.060 INFO:tasks.workunit.client.1.smithi203.stdout:7/995: sync 2024-09-11T00:07:42.060 INFO:tasks.workunit.client.1.smithi203.stdout:6/984: sync 2024-09-11T00:07:42.060 INFO:tasks.workunit.client.1.smithi203.stdout:4/950: sync 2024-09-11T00:07:42.064 INFO:tasks.workunit.client.1.smithi203.stdout:4/951: rename db/dd/d26/d135 to db/d12/d15/d111/d139 0 2024-09-11T00:07:42.070 INFO:tasks.workunit.client.1.smithi203.stdout:6/985: symlink d0/d32/d5a/ddd/d125/l12b 0 2024-09-11T00:07:42.075 INFO:tasks.workunit.client.1.smithi203.stdout:6/986: read d0/d32/d5a/fba [2643026,89218] 0 2024-09-11T00:07:42.078 INFO:tasks.workunit.client.1.smithi203.stdout:6/987: chown d0/d5b/d5c/d6f/ffb 31485 1 2024-09-11T00:07:42.086 INFO:tasks.workunit.client.1.smithi203.stdout:7/996: dread dd/d1c/d52/d8f/d31/d67/dc8/fb6 [0,4194304] 0 2024-09-11T00:07:42.096 INFO:tasks.workunit.client.1.smithi203.stdout:4/952: rmdir db/d12/d15/d111/d139 0 2024-09-11T00:07:42.102 INFO:tasks.workunit.client.1.smithi203.stdout:7/997: dread dd/d1c/d52/d8f/d31/d4a/f86 [0,4194304] 0 2024-09-11T00:07:42.106 INFO:tasks.workunit.client.1.smithi203.stdout:6/988: dwrite d0/f95 [0,4194304] 0 2024-09-11T00:07:42.109 INFO:tasks.workunit.client.1.smithi203.stdout:7/998: unlink dd/d1c/d52/d8f/c33 0 2024-09-11T00:07:42.111 INFO:tasks.workunit.client.1.smithi203.stdout:7/999: chown dd/d1c/d52/d8f/d31/ff4 464864870 1 2024-09-11T00:07:42.114 INFO:tasks.workunit.client.1.smithi203.stdout:4/953: dwrite db/f57 [0,4194304] 0 2024-09-11T00:07:42.114 INFO:tasks.workunit.client.1.smithi203.stdout:6/989: fdatasync d0/d54/d9c/f98 0 2024-09-11T00:07:42.117 INFO:tasks.workunit.client.1.smithi203.stdout:6/990: chown d0/d54/d9c/d35/d39/ffc 244 1 2024-09-11T00:07:42.126 INFO:tasks.workunit.client.1.smithi203.stdout:6/991: creat d0/d54/d9c/d35/d38/dc0/ddb/f12c x:0 0 0 2024-09-11T00:07:42.143 INFO:tasks.workunit.client.1.smithi203.stdout:4/954: dwrite db/dd/d16/d38/d3c/d41/fbd [0,4194304] 0 2024-09-11T00:07:42.146 INFO:tasks.workunit.client.1.smithi203.stdout:6/992: dwrite d0/f2d [8388608,4194304] 0 2024-09-11T00:07:42.160 INFO:tasks.workunit.client.1.smithi203.stdout:6/993: mkdir d0/d54/d9c/d35/d39/d3c/d12d 0 2024-09-11T00:07:42.160 INFO:tasks.workunit.client.1.smithi203.stdout:6/994: stat d0/f93 0 2024-09-11T00:07:42.170 INFO:tasks.workunit.client.1.smithi203.stdout:4/955: dwrite db/dd/d16/d38/d3c/d41/f46 [0,4194304] 0 2024-09-11T00:07:42.175 INFO:tasks.workunit.client.1.smithi203.stdout:4/956: mkdir db/d12/d15/d2a/d88/d95/dc2/d13a 0 2024-09-11T00:07:42.179 INFO:tasks.workunit.client.1.smithi203.stdout:4/957: chown db/dd/f124 7 1 2024-09-11T00:07:42.185 INFO:tasks.workunit.client.1.smithi203.stdout:6/995: dwrite d0/d54/d9c/d35/d38/d73/d74/f118 [0,4194304] 0 2024-09-11T00:07:42.197 INFO:tasks.workunit.client.1.smithi203.stdout:4/958: link db/dd/d26/dcd/fff db/d12/d15/d2a/d88/f13b 0 2024-09-11T00:07:42.199 INFO:tasks.workunit.client.1.smithi203.stdout:6/996: creat d0/d5b/d5c/d6f/de7/d114/f12e x:0 0 0 2024-09-11T00:07:42.201 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:41 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:07:42.234 INFO:tasks.workunit.client.1.smithi203.stdout:4/959: write db/f10 [596149,125837] 0 2024-09-11T00:07:42.238 INFO:tasks.workunit.client.1.smithi203.stdout:4/960: stat db/d12/d15/d2a/d88/d95/dc2/d100/c104 0 2024-09-11T00:07:42.243 INFO:tasks.workunit.client.1.smithi203.stdout:4/961: creat db/dd/d26/d42/f13c x:0 0 0 2024-09-11T00:07:42.244 INFO:tasks.workunit.client.1.smithi203.stdout:6/997: dwrite d0/d54/d9c/d35/d38/dc0/ddb/fe1 [0,4194304] 0 2024-09-11T00:07:42.247 INFO:tasks.workunit.client.1.smithi203.stdout:6/998: write d0/d54/d9c/d7b/f117 [1043508,946] 0 2024-09-11T00:07:42.247 INFO:tasks.workunit.client.1.smithi203.stdout:4/962: truncate db/d12/f7d 1414081 0 2024-09-11T00:07:42.251 INFO:tasks.workunit.client.1.smithi203.stdout:6/999: read d0/d54/d9c/d35/d38/dc0/fe5 [7028715,20502] 0 2024-09-11T00:07:42.252 INFO:tasks.workunit.client.1.smithi203.stdout:4/963: creat db/dd/d26/d42/d102/f13d x:0 0 0 2024-09-11T00:07:42.260 INFO:tasks.workunit.client.1.smithi203.stdout:4/964: link db/dd/d26/df3/f130 db/dd/d16/d38/f13e 0 2024-09-11T00:07:42.263 INFO:tasks.workunit.client.1.smithi203.stdout:4/965: rmdir db/d12/d15/d2a/d88/d95/dc2 39 2024-09-11T00:07:42.267 INFO:tasks.workunit.client.1.smithi203.stdout:4/966: truncate db/dd/d16/d38/d3c/da6/f121 498985 0 2024-09-11T00:07:42.290 INFO:tasks.workunit.client.1.smithi203.stdout:4/967: write db/dd/d16/d38/d3c/d41/fb3 [2678006,77776] 0 2024-09-11T00:07:42.303 INFO:tasks.workunit.client.1.smithi203.stdout:4/968: write db/dd/d26/f30 [2298411,57702] 0 2024-09-11T00:07:42.307 INFO:tasks.workunit.client.1.smithi203.stdout:4/969: mkdir db/d12/d15/d2a/d88/d95/dc2/d13f 0 2024-09-11T00:07:42.308 INFO:tasks.workunit.client.1.smithi203.stdout:4/970: readlink db/d12/d15/d2a/dcb/l11b 0 2024-09-11T00:07:42.331 INFO:tasks.workunit.client.1.smithi203.stdout:4/971: dread db/d12/f9a [0,4194304] 0 2024-09-11T00:07:42.351 INFO:tasks.workunit.client.1.smithi203.stdout:4/972: dwrite db/dd/f124 [0,4194304] 0 2024-09-11T00:07:42.358 INFO:tasks.workunit.client.1.smithi203.stdout:4/973: write db/dd/d16/f4f [2949715,30134] 0 2024-09-11T00:07:42.369 INFO:tasks.workunit.client.1.smithi203.stdout:4/974: link db/d12/d15/d2a/d88/faa db/d12/d15/d2a/d88/d95/dc2/d100/f140 0 2024-09-11T00:07:42.381 INFO:tasks.workunit.client.1.smithi203.stdout:4/975: dwrite db/dd/d16/f4f [0,4194304] 0 2024-09-11T00:07:42.385 INFO:tasks.workunit.client.1.smithi203.stdout:4/976: truncate db/f7e 1509164 0 2024-09-11T00:07:42.389 INFO:tasks.workunit.client.1.smithi203.stdout:4/977: read - db/d12/d15/d2a/dcb/fdf zero size 2024-09-11T00:07:42.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:41 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:07:42.403 INFO:tasks.workunit.client.1.smithi203.stdout:4/978: dwrite db/dd/d26/dcd/dfb/f10a [0,4194304] 0 2024-09-11T00:07:42.417 INFO:tasks.workunit.client.1.smithi203.stdout:4/979: truncate db/f57 2136972 0 2024-09-11T00:07:42.421 INFO:tasks.workunit.client.1.smithi203.stdout:4/980: symlink db/d12/d15/l141 0 2024-09-11T00:07:42.423 INFO:tasks.workunit.client.1.smithi203.stdout:4/981: symlink db/dd/d26/df3/l142 0 2024-09-11T00:07:42.426 INFO:tasks.workunit.client.1.smithi203.stdout:4/982: mknod db/dd/d16/d38/d3c/d41/c143 0 2024-09-11T00:07:42.447 INFO:tasks.workunit.client.1.smithi203.stdout:4/983: dread db/f4e [0,4194304] 0 2024-09-11T00:07:42.462 INFO:tasks.workunit.client.1.smithi203.stdout:4/984: write db/f4e [5022660,35357] 0 2024-09-11T00:07:42.468 INFO:tasks.workunit.client.1.smithi203.stdout:4/985: rmdir db/d12/d15/d2a/d71 39 2024-09-11T00:07:42.495 INFO:tasks.workunit.client.1.smithi203.stdout:4/986: write db/dd/d16/fb1 [2968427,78705] 0 2024-09-11T00:07:42.509 INFO:tasks.workunit.client.1.smithi203.stdout:4/987: truncate db/dd/d16/d38/d3c/d41/fae 637110 0 2024-09-11T00:07:42.518 INFO:tasks.workunit.client.1.smithi203.stdout:4/988: write db/d12/d15/d2a/d88/f89 [1045067,93325] 0 2024-09-11T00:07:42.523 INFO:tasks.workunit.client.1.smithi203.stdout:4/989: unlink db/dd/d26/df3/l142 0 2024-09-11T00:07:42.526 INFO:tasks.workunit.client.1.smithi203.stdout:4/990: mkdir db/d12/d15/d2a/d88/d95/dc2/d144 0 2024-09-11T00:07:42.529 INFO:tasks.workunit.client.1.smithi203.stdout:4/991: mkdir db/d12/d15/d2a/d88/d95/dc2/d13f/d145 0 2024-09-11T00:07:42.531 INFO:tasks.workunit.client.1.smithi203.stdout:4/992: write f1 [606687,33423] 0 2024-09-11T00:07:42.533 INFO:tasks.workunit.client.1.smithi203.stdout:4/993: write db/f4e [18690,125189] 0 2024-09-11T00:07:42.536 INFO:tasks.workunit.client.1.smithi203.stdout:4/994: symlink db/d12/l146 0 2024-09-11T00:07:42.540 INFO:tasks.workunit.client.1.smithi203.stdout:4/995: symlink db/d12/d15/d2a/dcb/de5/d128/l147 0 2024-09-11T00:07:42.553 INFO:tasks.workunit.client.1.smithi203.stdout:4/996: dwrite db/dd/d16/d38/d3c/d41/fb3 [4194304,4194304] 0 2024-09-11T00:07:42.557 INFO:tasks.workunit.client.1.smithi203.stdout:4/997: creat db/d12/d15/d2a/dcb/f148 x:0 0 0 2024-09-11T00:07:42.586 INFO:tasks.workunit.client.1.smithi203.stdout:4/998: dread db/d12/d15/d2a/dc3/f113 [0,4194304] 0 2024-09-11T00:07:42.588 INFO:tasks.workunit.client.1.smithi203.stdout:4/999: mknod db/dd/d26/dcd/dfb/c149 0 2024-09-11T00:07:42.596 INFO:tasks.workunit.client.1.smithi203.stderr:+ rm -rf -- ./tmp.5V646qK7jw 2024-09-11T00:07:43.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:42 smithi203 ceph-mon[33225]: pgmap v19: 65 pgs: 65 active+clean; 4.3 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 100 MiB/s rd, 223 MiB/s wr, 532 op/s 2024-09-11T00:07:43.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:42 smithi111 ceph-mon[27539]: pgmap v19: 65 pgs: 65 active+clean; 4.3 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 100 MiB/s rd, 223 MiB/s wr, 532 op/s 2024-09-11T00:07:45.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:44 smithi203 ceph-mon[33225]: pgmap v20: 65 pgs: 65 active+clean; 4.3 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 65 MiB/s rd, 140 MiB/s wr, 348 op/s 2024-09-11T00:07:45.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:44 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:45.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:44 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:45.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:44 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:07:45.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:44 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:07:45.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:44 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:07:45.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:44 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:07:45.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:44 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:07:45.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:44 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:07:45.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:44 smithi203 ceph-mon[33225]: Adjusting osd_memory_target on smithi203 to 2240M 2024-09-11T00:07:45.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:44 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:45.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:44 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:07:45.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:44 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:07:45.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:44 smithi203 ceph-mon[33225]: Updating smithi111:/etc/ceph/ceph.conf 2024-09-11T00:07:45.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:44 smithi203 ceph-mon[33225]: Updating smithi203:/etc/ceph/ceph.conf 2024-09-11T00:07:45.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:44 smithi111 ceph-mon[27539]: pgmap v20: 65 pgs: 65 active+clean; 4.3 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 65 MiB/s rd, 140 MiB/s wr, 348 op/s 2024-09-11T00:07:45.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:44 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:45.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:44 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:45.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:44 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:07:45.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:44 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:07:45.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:44 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:07:45.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:44 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:07:45.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:44 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:07:45.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:44 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T00:07:45.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:44 smithi111 ceph-mon[27539]: Adjusting osd_memory_target on smithi203 to 2240M 2024-09-11T00:07:45.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:44 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:45.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:44 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:07:45.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:44 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:07:45.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:44 smithi111 ceph-mon[27539]: Updating smithi111:/etc/ceph/ceph.conf 2024-09-11T00:07:45.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:44 smithi111 ceph-mon[27539]: Updating smithi203:/etc/ceph/ceph.conf 2024-09-11T00:07:46.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:45 smithi203 ceph-mon[33225]: Updating smithi111:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:07:46.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:45 smithi203 ceph-mon[33225]: Updating smithi203:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:07:46.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:45 smithi203 ceph-mon[33225]: Updating smithi111:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:07:46.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:45 smithi203 ceph-mon[33225]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:07:46.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:45 smithi111 ceph-mon[27539]: Updating smithi111:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:07:46.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:45 smithi111 ceph-mon[27539]: Updating smithi203:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:07:46.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:45 smithi111 ceph-mon[27539]: Updating smithi111:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:07:46.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:45 smithi111 ceph-mon[27539]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:07:47.252 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:46 smithi111 ceph-mon[27539]: pgmap v21: 65 pgs: 65 active+clean; 4.3 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 65 MiB/s rd, 140 MiB/s wr, 348 op/s 2024-09-11T00:07:47.252 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:46 smithi111 ceph-mon[27539]: Updating smithi111:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:07:47.253 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:46 smithi111 ceph-mon[27539]: Updating smithi203:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:07:47.253 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:46 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:47.253 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:46 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:47.253 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:46 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:47.253 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:46 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:47.253 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:46 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:47.253 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:46 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:47.253 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:46 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:47.253 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:46 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:47.253 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:46 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:47.253 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:46 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi111", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-11T00:07:47.253 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:46 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi111", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-11T00:07:47.253 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:46 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:07:47.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:46 smithi203 ceph-mon[33225]: pgmap v21: 65 pgs: 65 active+clean; 4.3 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 65 MiB/s rd, 140 MiB/s wr, 348 op/s 2024-09-11T00:07:47.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:46 smithi203 ceph-mon[33225]: Updating smithi111:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:07:47.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:46 smithi203 ceph-mon[33225]: Updating smithi203:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:07:47.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:46 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:47.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:46 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:47.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:46 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:47.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:46 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:47.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:46 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:47.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:46 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:47.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:46 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:47.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:46 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:47.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:46 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:47.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:46 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi111", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-11T00:07:47.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:46 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi111", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-11T00:07:47.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:46 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:07:48.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:47 smithi203 ceph-mon[33225]: Reconfiguring ceph-exporter.smithi111 (dependencies changed)... 2024-09-11T00:07:48.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:47 smithi203 ceph-mon[33225]: Deploying daemon ceph-exporter.smithi111 on smithi111 2024-09-11T00:07:48.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.336+0000 7fa85e200700 1 -- 172.21.15.111:0/1408696586 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa858100a20 msgr2=0x7fa858102e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:48.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.336+0000 7fa85e200700 1 --2- 172.21.15.111:0/1408696586 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa858100a20 0x7fa858102e00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa84c009910 tx=0x7fa84c009c20 comp rx=0 tx=0).stop 2024-09-11T00:07:48.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.336+0000 7fa85e200700 1 -- 172.21.15.111:0/1408696586 shutdown_connections 2024-09-11T00:07:48.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.336+0000 7fa85e200700 1 --2- 172.21.15.111:0/1408696586 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa858103340 0x7fa858105720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:48.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.336+0000 7fa85e200700 1 --2- 172.21.15.111:0/1408696586 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa858100a20 0x7fa858102e00 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:48.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.336+0000 7fa85e200700 1 -- 172.21.15.111:0/1408696586 >> 172.21.15.111:0/1408696586 conn(0x7fa8580fa440 msgr2=0x7fa8580fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:48.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.337+0000 7fa85e200700 1 -- 172.21.15.111:0/1408696586 shutdown_connections 2024-09-11T00:07:48.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.337+0000 7fa85e200700 1 -- 172.21.15.111:0/1408696586 wait complete. 2024-09-11T00:07:48.339 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:47 smithi111 ceph-mon[27539]: Reconfiguring ceph-exporter.smithi111 (dependencies changed)... 2024-09-11T00:07:48.339 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:47 smithi111 ceph-mon[27539]: Deploying daemon ceph-exporter.smithi111 on smithi111 2024-09-11T00:07:48.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.338+0000 7fa85e200700 1 Processor -- start 2024-09-11T00:07:48.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.338+0000 7fa85e200700 1 -- start start 2024-09-11T00:07:48.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.339+0000 7fa85e200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa858100a20 0x7fa8581979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:48.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.339+0000 7fa85e200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa858103340 0x7fa858197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:48.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.339+0000 7fa85e200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa858198550 con 0x7fa858100a20 2024-09-11T00:07:48.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.339+0000 7fa85e200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa858198690 con 0x7fa858103340 2024-09-11T00:07:48.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.339+0000 7fa85ce00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa858100a20 0x7fa8581979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:48.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.339+0000 7fa85ce00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa858100a20 0x7fa8581979f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:33888/0 (socket says 172.21.15.111:33888) 2024-09-11T00:07:48.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.339+0000 7fa85ce00700 1 -- 172.21.15.111:0/918940023 learned_addr learned my addr 172.21.15.111:0/918940023 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:07:48.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.339+0000 7fa857e00700 1 --2- 172.21.15.111:0/918940023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa858103340 0x7fa858197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:48.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.340+0000 7fa85ce00700 1 -- 172.21.15.111:0/918940023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa858103340 msgr2=0x7fa858197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:48.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.340+0000 7fa85ce00700 1 --2- 172.21.15.111:0/918940023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa858103340 0x7fa858197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:48.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.340+0000 7fa85ce00700 1 -- 172.21.15.111:0/918940023 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84c0095f0 con 0x7fa858100a20 2024-09-11T00:07:48.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.340+0000 7fa857e00700 1 --2- 172.21.15.111:0/918940023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa858103340 0x7fa858197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:07:48.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.340+0000 7fa85ce00700 1 --2- 172.21.15.111:0/918940023 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa858100a20 0x7fa8581979f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa84c000c00 tx=0x7fa84c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:48.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.340+0000 7fa855600700 1 -- 172.21.15.111:0/918940023 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa84c01d070 con 0x7fa858100a20 2024-09-11T00:07:48.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.340+0000 7fa855600700 1 -- 172.21.15.111:0/918940023 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa84c005dc0 con 0x7fa858100a20 2024-09-11T00:07:48.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.340+0000 7fa85e200700 1 -- 172.21.15.111:0/918940023 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa85819d0e0 con 0x7fa858100a20 2024-09-11T00:07:48.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.340+0000 7fa855600700 1 -- 172.21.15.111:0/918940023 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa84c0226a0 con 0x7fa858100a20 2024-09-11T00:07:48.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.341+0000 7fa85e200700 1 -- 172.21.15.111:0/918940023 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa85819d5d0 con 0x7fa858100a20 2024-09-11T00:07:48.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.342+0000 7fa85e200700 1 -- 172.21.15.111:0/918940023 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8580fc000 con 0x7fa858100a20 2024-09-11T00:07:48.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.342+0000 7fa855600700 1 -- 172.21.15.111:0/918940023 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 26) v1 ==== 96222+0+0 (secure 0 0 0) 0x7fa84c0038f0 con 0x7fa858100a20 2024-09-11T00:07:48.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.343+0000 7fa855600700 1 --2- 172.21.15.111:0/918940023 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7fa840073620 0x7fa840075ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:48.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.343+0000 7fa855600700 1 -- 172.21.15.111:0/918940023 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fa84c0958b0 con 0x7fa858100a20 2024-09-11T00:07:48.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.344+0000 7fa857e00700 1 --2- 172.21.15.111:0/918940023 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7fa840073620 0x7fa840075ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:48.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.344+0000 7fa857e00700 1 --2- 172.21.15.111:0/918940023 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7fa840073620 0x7fa840075ad0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa844011490 tx=0x7fa844009260 comp rx=0 tx=0).ready entity=mgr.24469 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:48.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.348+0000 7fa855600700 1 -- 172.21.15.111:0/918940023 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7fa84c059480 con 0x7fa858100a20 2024-09-11T00:07:48.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.671+0000 7fa85e200700 1 -- 172.21.15.111:0/918940023 --> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa858061190 con 0x7fa840073620 2024-09-11T00:07:48.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.673+0000 7fa855600700 1 -- 172.21.15.111:0/918940023 <== mgr.24469 v2:172.21.15.203:6828/1203435425 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fa858061190 con 0x7fa840073620 2024-09-11T00:07:48.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.677+0000 7fa85e200700 1 -- 172.21.15.111:0/918940023 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7fa840073620 msgr2=0x7fa840075ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:48.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.677+0000 7fa85e200700 1 --2- 172.21.15.111:0/918940023 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7fa840073620 0x7fa840075ad0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa844011490 tx=0x7fa844009260 comp rx=0 tx=0).stop 2024-09-11T00:07:48.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.677+0000 7fa85e200700 1 -- 172.21.15.111:0/918940023 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa858100a20 msgr2=0x7fa8581979f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:48.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.677+0000 7fa85e200700 1 --2- 172.21.15.111:0/918940023 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa858100a20 0x7fa8581979f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa84c000c00 tx=0x7fa84c00f690 comp rx=0 tx=0).stop 2024-09-11T00:07:48.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.677+0000 7fa85e200700 1 -- 172.21.15.111:0/918940023 shutdown_connections 2024-09-11T00:07:48.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.677+0000 7fa85e200700 1 --2- 172.21.15.111:0/918940023 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7fa840073620 0x7fa840075ad0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:48.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.677+0000 7fa85e200700 1 --2- 172.21.15.111:0/918940023 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa858100a20 0x7fa8581979f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:48.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.677+0000 7fa85e200700 1 --2- 172.21.15.111:0/918940023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa858103340 0x7fa858197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:48.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.677+0000 7fa85e200700 1 -- 172.21.15.111:0/918940023 >> 172.21.15.111:0/918940023 conn(0x7fa8580fa440 msgr2=0x7fa8580ff0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:48.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.677+0000 7fa85e200700 1 -- 172.21.15.111:0/918940023 shutdown_connections 2024-09-11T00:07:48.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.677+0000 7fa85e200700 1 -- 172.21.15.111:0/918940023 wait complete. 2024-09-11T00:07:48.695 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:07:48.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.848+0000 7f62ece00700 1 -- 172.21.15.111:0/2068123787 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62e8100150 msgr2=0x7f62e8100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:48.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.848+0000 7f62ece00700 1 --2- 172.21.15.111:0/2068123787 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62e8100150 0x7f62e8100560 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f62d8009910 tx=0x7f62d8009c20 comp rx=0 tx=0).stop 2024-09-11T00:07:48.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.848+0000 7f62ece00700 1 -- 172.21.15.111:0/2068123787 shutdown_connections 2024-09-11T00:07:48.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.848+0000 7f62ece00700 1 --2- 172.21.15.111:0/2068123787 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62e8101350 0x7f62e81017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:48.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.848+0000 7f62ece00700 1 --2- 172.21.15.111:0/2068123787 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62e8100150 0x7f62e8100560 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:48.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.848+0000 7f62ece00700 1 -- 172.21.15.111:0/2068123787 >> 172.21.15.111:0/2068123787 conn(0x7f62e80fb6e0 msgr2=0x7f62e80fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:48.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.848+0000 7f62ece00700 1 -- 172.21.15.111:0/2068123787 shutdown_connections 2024-09-11T00:07:48.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.848+0000 7f62ece00700 1 -- 172.21.15.111:0/2068123787 wait complete. 2024-09-11T00:07:48.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.849+0000 7f62ece00700 1 Processor -- start 2024-09-11T00:07:48.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.849+0000 7f62ece00700 1 -- start start 2024-09-11T00:07:48.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.849+0000 7f62ece00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62e8100150 0x7f62e8197ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:48.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.850+0000 7f62ece00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62e8101350 0x7f62e81980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:48.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.850+0000 7f62ece00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e8198700 con 0x7f62e8101350 2024-09-11T00:07:48.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.850+0000 7f62ece00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e8198840 con 0x7f62e8100150 2024-09-11T00:07:48.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.850+0000 7f62e5e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62e8100150 0x7f62e8197ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:48.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.850+0000 7f62e5e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62e8100150 0x7f62e8197ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.111:57504/0 (socket says 172.21.15.111:57504) 2024-09-11T00:07:48.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.850+0000 7f62e5e00700 1 -- 172.21.15.111:0/4089102282 learned_addr learned my addr 172.21.15.111:0/4089102282 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:07:48.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.850+0000 7f62e5400700 1 --2- 172.21.15.111:0/4089102282 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62e8101350 0x7f62e81980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:48.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.850+0000 7f62e5e00700 1 -- 172.21.15.111:0/4089102282 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62e8101350 msgr2=0x7f62e81980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:48.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.850+0000 7f62e5e00700 1 --2- 172.21.15.111:0/4089102282 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62e8101350 0x7f62e81980e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:48.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.850+0000 7f62e5e00700 1 -- 172.21.15.111:0/4089102282 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d80095f0 con 0x7f62e8100150 2024-09-11T00:07:48.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.851+0000 7f62e5e00700 1 --2- 172.21.15.111:0/4089102282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62e8100150 0x7f62e8197ba0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f62d800bda0 tx=0x7f62d800bdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:48.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.851+0000 7f62dea00700 1 -- 172.21.15.111:0/4089102282 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62d801d070 con 0x7f62e8100150 2024-09-11T00:07:48.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.851+0000 7f62dea00700 1 -- 172.21.15.111:0/4089102282 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f62d800f460 con 0x7f62e8100150 2024-09-11T00:07:48.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.851+0000 7f62ece00700 1 -- 172.21.15.111:0/4089102282 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e819d290 con 0x7f62e8100150 2024-09-11T00:07:48.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.851+0000 7f62dea00700 1 -- 172.21.15.111:0/4089102282 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62d8021640 con 0x7f62e8100150 2024-09-11T00:07:48.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.851+0000 7f62ece00700 1 -- 172.21.15.111:0/4089102282 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e819d780 con 0x7f62e8100150 2024-09-11T00:07:48.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.853+0000 7f62ece00700 1 -- 172.21.15.111:0/4089102282 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e8105430 con 0x7f62e8100150 2024-09-11T00:07:48.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.853+0000 7f62dea00700 1 -- 172.21.15.111:0/4089102282 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 26) v1 ==== 96222+0+0 (secure 0 0 0) 0x7f62d800f5d0 con 0x7f62e8100150 2024-09-11T00:07:48.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.854+0000 7f62dea00700 1 --2- 172.21.15.111:0/4089102282 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f62cc073630 0x7f62cc075ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:48.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.854+0000 7f62dea00700 1 -- 172.21.15.111:0/4089102282 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f62d8095880 con 0x7f62e8100150 2024-09-11T00:07:48.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.855+0000 7f62e5400700 1 --2- 172.21.15.111:0/4089102282 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f62cc073630 0x7f62cc075ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:48.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.855+0000 7f62e5400700 1 --2- 172.21.15.111:0/4089102282 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f62cc073630 0x7f62cc075ae0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f62d4005950 tx=0x7f62d400b410 comp rx=0 tx=0).ready entity=mgr.24469 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:48.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:48.861+0000 7f62dea00700 1 -- 172.21.15.111:0/4089102282 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f62d8059330 con 0x7f62e8100150 2024-09-11T00:07:49.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.154+0000 7f62ece00700 1 -- 172.21.15.111:0/4089102282 --> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f62e8061190 con 0x7f62cc073630 2024-09-11T00:07:49.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.155+0000 7f62dea00700 1 -- 172.21.15.111:0/4089102282 <== mgr.24469 v2:172.21.15.203:6828/1203435425 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f62e8061190 con 0x7f62cc073630 2024-09-11T00:07:49.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.158+0000 7f62ece00700 1 -- 172.21.15.111:0/4089102282 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f62cc073630 msgr2=0x7f62cc075ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:49.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.158+0000 7f62ece00700 1 --2- 172.21.15.111:0/4089102282 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f62cc073630 0x7f62cc075ae0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f62d4005950 tx=0x7f62d400b410 comp rx=0 tx=0).stop 2024-09-11T00:07:49.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.158+0000 7f62ece00700 1 -- 172.21.15.111:0/4089102282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62e8100150 msgr2=0x7f62e8197ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:49.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.158+0000 7f62ece00700 1 --2- 172.21.15.111:0/4089102282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62e8100150 0x7f62e8197ba0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f62d800bda0 tx=0x7f62d800bdd0 comp rx=0 tx=0).stop 2024-09-11T00:07:49.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.158+0000 7f62ece00700 1 -- 172.21.15.111:0/4089102282 shutdown_connections 2024-09-11T00:07:49.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.158+0000 7f62ece00700 1 --2- 172.21.15.111:0/4089102282 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f62cc073630 0x7f62cc075ae0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:49.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.158+0000 7f62ece00700 1 --2- 172.21.15.111:0/4089102282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62e8100150 0x7f62e8197ba0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:49.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.158+0000 7f62ece00700 1 --2- 172.21.15.111:0/4089102282 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62e8101350 0x7f62e81980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:49.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.158+0000 7f62ece00700 1 -- 172.21.15.111:0/4089102282 >> 172.21.15.111:0/4089102282 conn(0x7f62e80fb6e0 msgr2=0x7f62e8102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:49.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.158+0000 7f62ece00700 1 -- 172.21.15.111:0/4089102282 shutdown_connections 2024-09-11T00:07:49.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.158+0000 7f62ece00700 1 -- 172.21.15.111:0/4089102282 wait complete. 2024-09-11T00:07:49.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:48 smithi203 ceph-mon[33225]: pgmap v22: 65 pgs: 65 active+clean; 4.0 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 71 MiB/s rd, 155 MiB/s wr, 436 op/s 2024-09-11T00:07:49.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.317+0000 7f53ffe00700 1 -- 172.21.15.111:0/466780779 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f54001011a0 msgr2=0x7f54001015f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:49.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.317+0000 7f53ffe00700 1 --2- 172.21.15.111:0/466780779 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f54001011a0 0x7f54001015f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f53ec009910 tx=0x7f53ec009c20 comp rx=0 tx=0).stop 2024-09-11T00:07:49.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.317+0000 7f53ffe00700 1 -- 172.21.15.111:0/466780779 shutdown_connections 2024-09-11T00:07:49.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.317+0000 7f53ffe00700 1 --2- 172.21.15.111:0/466780779 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f54001011a0 0x7f54001015f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:49.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.317+0000 7f53ffe00700 1 --2- 172.21.15.111:0/466780779 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f54000fffa0 0x7f54001003b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:49.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.317+0000 7f53ffe00700 1 -- 172.21.15.111:0/466780779 >> 172.21.15.111:0/466780779 conn(0x7f54000fb510 msgr2=0x7f54000fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:49.320 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:48 smithi111 ceph-mon[27539]: pgmap v22: 65 pgs: 65 active+clean; 4.0 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 71 MiB/s rd, 155 MiB/s wr, 436 op/s 2024-09-11T00:07:49.323 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.320+0000 7f53ffe00700 1 -- 172.21.15.111:0/466780779 shutdown_connections 2024-09-11T00:07:49.324 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.320+0000 7f53ffe00700 1 -- 172.21.15.111:0/466780779 wait complete. 2024-09-11T00:07:49.325 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.321+0000 7f53ffe00700 1 Processor -- start 2024-09-11T00:07:49.325 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.321+0000 7f53ffe00700 1 -- start start 2024-09-11T00:07:49.325 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.321+0000 7f53ffe00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f54000fffa0 0x7f5400074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:49.325 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.321+0000 7f53ffe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f54001011a0 0x7f5400073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:49.325 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.321+0000 7f53ffe00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5400073680 con 0x7f54001011a0 2024-09-11T00:07:49.325 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.321+0000 7f53ffe00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54000737c0 con 0x7f54000fffa0 2024-09-11T00:07:49.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.321+0000 7f53fe000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f54001011a0 0x7f5400073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:49.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.321+0000 7f53fe000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f54001011a0 0x7f5400073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:33920/0 (socket says 172.21.15.111:33920) 2024-09-11T00:07:49.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.321+0000 7f53fe000700 1 -- 172.21.15.111:0/384305540 learned_addr learned my addr 172.21.15.111:0/384305540 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:07:49.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.322+0000 7f53fea00700 1 --2- 172.21.15.111:0/384305540 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f54000fffa0 0x7f5400074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:49.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.322+0000 7f53fe000700 1 -- 172.21.15.111:0/384305540 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f54000fffa0 msgr2=0x7f5400074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:49.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.322+0000 7f53fe000700 1 --2- 172.21.15.111:0/384305540 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f54000fffa0 0x7f5400074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:49.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.322+0000 7f53fe000700 1 -- 172.21.15.111:0/384305540 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ec0095f0 con 0x7f54001011a0 2024-09-11T00:07:49.327 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.322+0000 7f53fe000700 1 --2- 172.21.15.111:0/384305540 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f54001011a0 0x7f5400073140 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f53ec005b40 tx=0x7f53ec00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:49.327 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.322+0000 7f5404a00700 1 -- 172.21.15.111:0/384305540 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53ec01d070 con 0x7f54001011a0 2024-09-11T00:07:49.327 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.322+0000 7f53ffe00700 1 -- 172.21.15.111:0/384305540 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5400073a40 con 0x7f54001011a0 2024-09-11T00:07:49.327 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.322+0000 7f5404a00700 1 -- 172.21.15.111:0/384305540 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f53ec00f460 con 0x7f54001011a0 2024-09-11T00:07:49.327 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.322+0000 7f5404a00700 1 -- 172.21.15.111:0/384305540 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53ec021640 con 0x7f54001011a0 2024-09-11T00:07:49.327 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.323+0000 7f53ffe00700 1 -- 172.21.15.111:0/384305540 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5400073f30 con 0x7f54001011a0 2024-09-11T00:07:49.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.324+0000 7f53ffe00700 1 -- 172.21.15.111:0/384305540 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5400108af0 con 0x7f54001011a0 2024-09-11T00:07:49.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.325+0000 7f5404a00700 1 -- 172.21.15.111:0/384305540 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 26) v1 ==== 96222+0+0 (secure 0 0 0) 0x7f53ec00fa90 con 0x7f54001011a0 2024-09-11T00:07:49.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.325+0000 7f5404a00700 1 --2- 172.21.15.111:0/384305540 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f53e4073620 0x7f53e4075ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:49.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.326+0000 7f5404a00700 1 -- 172.21.15.111:0/384305540 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f53ec095950 con 0x7f54001011a0 2024-09-11T00:07:49.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.326+0000 7f53fea00700 1 --2- 172.21.15.111:0/384305540 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f53e4073620 0x7f53e4075ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:49.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.327+0000 7f53fea00700 1 --2- 172.21.15.111:0/384305540 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f53e4073620 0x7f53e4075ad0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f53f0005950 tx=0x7f53f00058e0 comp rx=0 tx=0).ready entity=mgr.24469 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:49.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.331+0000 7f5404a00700 1 -- 172.21.15.111:0/384305540 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f53ec059400 con 0x7f54001011a0 2024-09-11T00:07:49.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.602+0000 7f53ffe00700 1 -- 172.21.15.111:0/384305540 --> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5400105af0 con 0x7f53e4073620 2024-09-11T00:07:49.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.620+0000 7f5404a00700 1 -- 172.21.15.111:0/384305540 <== mgr.24469 v2:172.21.15.203:6828/1203435425 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f5400105af0 con 0x7f53e4073620 2024-09-11T00:07:49.622 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:07:49.622 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (8m) 21s ago 10m 13.7M - 0.25.0 c8568f914cd2 eb9e393000ec 2024-09-11T00:07:49.622 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (11m) 21s ago 11m 7696k - 18.2.0 dc2bc1663786 b6e7b6bd4d27 2024-09-11T00:07:49.622 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi203 smithi203 running (10m) 19s ago 10m 7625k - 18.2.0 dc2bc1663786 7bbfd9c27900 2024-09-11T00:07:49.622 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (11m) 21s ago 11m 6665k - 18.2.0 dc2bc1663786 72a36c166ffa 2024-09-11T00:07:49.622 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi203 smithi203 running (9m) 19s ago 9m 6669k - 18.2.0 dc2bc1663786 9b102b6f6d70 2024-09-11T00:07:49.622 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (8m) 21s ago 10m 75.2M - 9.4.7 954c08fa6188 e599624a9c9e 2024-09-11T00:07:49.622 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.gmgsay smithi111 running (3m) 21s ago 3m 13.6M - 18.2.0 dc2bc1663786 795e4ff0075c 2024-09-11T00:07:49.622 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.rucaba smithi111 running (3m) 21s ago 3m 13.7M - 18.2.0 dc2bc1663786 02885adac62c 2024-09-11T00:07:49.622 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.tcrqop smithi203 running (3m) 19s ago 3m 227M - 18.2.0 dc2bc1663786 4df492159bb4 2024-09-11T00:07:49.623 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.uqkbkn smithi203 running (3m) 19s ago 3m 13.7M - 18.2.0 dc2bc1663786 619aa58ea314 2024-09-11T00:07:49.623 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.ypucji smithi111 *:9283,8765,8443 running (12m) 21s ago 12m 238M - 18.2.0 dc2bc1663786 0329ec697a09 2024-09-11T00:07:49.623 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi203.smuspl smithi203 *:8443,9283,8765 running (67s) 19s ago 9m 498M - 19.3.0-4854-g8f219c47 589dd18248e4 5c2e09508810 2024-09-11T00:07:49.623 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (12m) 21s ago 12m 51.9M 2048M 18.2.0 dc2bc1663786 2596322539fb 2024-09-11T00:07:49.623 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi203 smithi203 running (9m) 19s ago 9m 41.9M 2048M 18.2.0 dc2bc1663786 ff8eb7ca85ea 2024-09-11T00:07:49.623 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (11m) 21s ago 11m 7940k - 1.5.0 0da6a335fe13 4fd66ebc9c0d 2024-09-11T00:07:49.623 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi203 smithi203 *:9100 running (9m) 19s ago 9m 7713k - 1.5.0 0da6a335fe13 1cb3ca740f4a 2024-09-11T00:07:49.623 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (8m) 21s ago 8m 179M 1216M 18.2.0 dc2bc1663786 162b7249a591 2024-09-11T00:07:49.623 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (7m) 21s ago 7m 200M 1216M 18.2.0 dc2bc1663786 3614d95b1425 2024-09-11T00:07:49.623 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (7m) 21s ago 7m 169M 1216M 18.2.0 dc2bc1663786 db175d4b09b9 2024-09-11T00:07:49.623 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi203 running (6m) 19s ago 6m 204M 2240M 18.2.0 dc2bc1663786 60b1cef7a70d 2024-09-11T00:07:49.623 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi203 running (6m) 19s ago 6m 178M 2240M 18.2.0 dc2bc1663786 769c7942c42b 2024-09-11T00:07:49.623 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi203 running (5m) 19s ago 5m 187M 2240M 18.2.0 dc2bc1663786 6d824001d40c 2024-09-11T00:07:49.624 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (8m) 21s ago 10m 68.6M - 2.43.0 a07b618ecd1d bd707157a41b 2024-09-11T00:07:49.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.626+0000 7f53ffe00700 1 -- 172.21.15.111:0/384305540 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f53e4073620 msgr2=0x7f53e4075ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:49.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.626+0000 7f53ffe00700 1 --2- 172.21.15.111:0/384305540 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f53e4073620 0x7f53e4075ad0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f53f0005950 tx=0x7f53f00058e0 comp rx=0 tx=0).stop 2024-09-11T00:07:49.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.626+0000 7f53ffe00700 1 -- 172.21.15.111:0/384305540 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f54001011a0 msgr2=0x7f5400073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:49.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.626+0000 7f53ffe00700 1 --2- 172.21.15.111:0/384305540 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f54001011a0 0x7f5400073140 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f53ec005b40 tx=0x7f53ec00be20 comp rx=0 tx=0).stop 2024-09-11T00:07:49.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.626+0000 7f53ffe00700 1 -- 172.21.15.111:0/384305540 shutdown_connections 2024-09-11T00:07:49.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.626+0000 7f53ffe00700 1 --2- 172.21.15.111:0/384305540 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f53e4073620 0x7f53e4075ad0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:49.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.626+0000 7f53ffe00700 1 --2- 172.21.15.111:0/384305540 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f54000fffa0 0x7f5400074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:49.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.626+0000 7f53ffe00700 1 --2- 172.21.15.111:0/384305540 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f54001011a0 0x7f5400073140 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:49.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.626+0000 7f53ffe00700 1 -- 172.21.15.111:0/384305540 >> 172.21.15.111:0/384305540 conn(0x7f54000fb510 msgr2=0x7f54001043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:49.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.626+0000 7f53ffe00700 1 -- 172.21.15.111:0/384305540 shutdown_connections 2024-09-11T00:07:49.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.627+0000 7f53ffe00700 1 -- 172.21.15.111:0/384305540 wait complete. 2024-09-11T00:07:49.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.837+0000 7f1c59200700 1 -- 172.21.15.111:0/1006879599 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1c54103580 msgr2=0x7f1c541039d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:49.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.837+0000 7f1c59200700 1 --2- 172.21.15.111:0/1006879599 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1c54103580 0x7f1c541039d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1c40009910 tx=0x7f1c40009c20 comp rx=0 tx=0).stop 2024-09-11T00:07:49.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.837+0000 7f1c59200700 1 -- 172.21.15.111:0/1006879599 shutdown_connections 2024-09-11T00:07:49.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.837+0000 7f1c59200700 1 --2- 172.21.15.111:0/1006879599 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1c54103580 0x7f1c541039d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:49.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.837+0000 7f1c59200700 1 --2- 172.21.15.111:0/1006879599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c54102380 0x7f1c54102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:49.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.837+0000 7f1c59200700 1 -- 172.21.15.111:0/1006879599 >> 172.21.15.111:0/1006879599 conn(0x7f1c540fd930 msgr2=0x7f1c540ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:49.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.837+0000 7f1c59200700 1 -- 172.21.15.111:0/1006879599 shutdown_connections 2024-09-11T00:07:49.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.837+0000 7f1c59200700 1 -- 172.21.15.111:0/1006879599 wait complete. 2024-09-11T00:07:49.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.838+0000 7f1c59200700 1 Processor -- start 2024-09-11T00:07:49.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.838+0000 7f1c59200700 1 -- start start 2024-09-11T00:07:49.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.839+0000 7f1c59200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c54102380 0x7f1c54197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:49.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.839+0000 7f1c59200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1c54103580 0x7f1c541980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:49.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.839+0000 7f1c59200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c541986d0 con 0x7f1c54103580 2024-09-11T00:07:49.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.839+0000 7f1c59200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c54198810 con 0x7f1c54102380 2024-09-11T00:07:49.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.839+0000 7f1c51400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1c54103580 0x7f1c541980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:49.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.839+0000 7f1c51400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1c54103580 0x7f1c541980b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:33930/0 (socket says 172.21.15.111:33930) 2024-09-11T00:07:49.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.839+0000 7f1c51400700 1 -- 172.21.15.111:0/553938336 learned_addr learned my addr 172.21.15.111:0/553938336 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:07:49.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.839+0000 7f1c51e00700 1 --2- 172.21.15.111:0/553938336 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c54102380 0x7f1c54197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:49.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.839+0000 7f1c51400700 1 -- 172.21.15.111:0/553938336 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c54102380 msgr2=0x7f1c54197b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:49.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.839+0000 7f1c51400700 1 --2- 172.21.15.111:0/553938336 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c54102380 0x7f1c54197b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:49.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.839+0000 7f1c51400700 1 -- 172.21.15.111:0/553938336 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c400095f0 con 0x7f1c54103580 2024-09-11T00:07:49.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.840+0000 7f1c51400700 1 --2- 172.21.15.111:0/553938336 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1c54103580 0x7f1c541980b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1c4000fa00 tx=0x7f1c4000fa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:49.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.840+0000 7f1c4aa00700 1 -- 172.21.15.111:0/553938336 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c4001d070 con 0x7f1c54103580 2024-09-11T00:07:49.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.840+0000 7f1c4aa00700 1 -- 172.21.15.111:0/553938336 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1c40005640 con 0x7f1c54103580 2024-09-11T00:07:49.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.840+0000 7f1c59200700 1 -- 172.21.15.111:0/553938336 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c5419d260 con 0x7f1c54103580 2024-09-11T00:07:49.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.840+0000 7f1c4aa00700 1 -- 172.21.15.111:0/553938336 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c40017400 con 0x7f1c54103580 2024-09-11T00:07:49.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.841+0000 7f1c59200700 1 -- 172.21.15.111:0/553938336 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c5419d750 con 0x7f1c54103580 2024-09-11T00:07:49.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.842+0000 7f1c59200700 1 -- 172.21.15.111:0/553938336 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c5410aed0 con 0x7f1c54103580 2024-09-11T00:07:49.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.843+0000 7f1c4aa00700 1 -- 172.21.15.111:0/553938336 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 26) v1 ==== 96222+0+0 (secure 0 0 0) 0x7f1c40003680 con 0x7f1c54103580 2024-09-11T00:07:49.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.844+0000 7f1c4aa00700 1 --2- 172.21.15.111:0/553938336 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f1c38073670 0x7f1c38075b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:49.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.844+0000 7f1c4aa00700 1 -- 172.21.15.111:0/553938336 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f1c40095cb0 con 0x7f1c54103580 2024-09-11T00:07:49.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.844+0000 7f1c51e00700 1 --2- 172.21.15.111:0/553938336 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f1c38073670 0x7f1c38075b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:49.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.845+0000 7f1c51e00700 1 --2- 172.21.15.111:0/553938336 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f1c38073670 0x7f1c38075b20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1c541033e0 tx=0x7f1c44009260 comp rx=0 tx=0).ready entity=mgr.24469 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:49.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:49.853+0000 7f1c4aa00700 1 -- 172.21.15.111:0/553938336 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f1c40059760 con 0x7f1c54103580 2024-09-11T00:07:50.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:49 smithi111 ceph-mon[27539]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:07:50.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.223+0000 7f1c59200700 1 -- 172.21.15.111:0/553938336 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1c5410b090 con 0x7f1c54103580 2024-09-11T00:07:50.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.223+0000 7f1c4aa00700 1 -- 172.21.15.111:0/553938336 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+766 (secure 0 0 0) 0x7f1c4005c880 con 0x7f1c54103580 2024-09-11T00:07:50.225 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:07:50.226 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-11T00:07:50.226 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-11T00:07:50.226 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:07:50.227 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-11T00:07:50.227 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-09-11T00:07:50.227 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 1 2024-09-11T00:07:50.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:07:50.228 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-11T00:07:50.228 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-11T00:07:50.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:07:50.228 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-11T00:07:50.229 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-11T00:07:50.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:07:50.229 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-11T00:07:50.230 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 13, 2024-09-11T00:07:50.230 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 1 2024-09-11T00:07:50.230 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-11T00:07:50.231 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:07:50.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.226+0000 7f1c59200700 1 -- 172.21.15.111:0/553938336 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f1c38073670 msgr2=0x7f1c38075b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:50.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.226+0000 7f1c59200700 1 --2- 172.21.15.111:0/553938336 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f1c38073670 0x7f1c38075b20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1c541033e0 tx=0x7f1c44009260 comp rx=0 tx=0).stop 2024-09-11T00:07:50.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.226+0000 7f1c59200700 1 -- 172.21.15.111:0/553938336 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1c54103580 msgr2=0x7f1c541980b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:50.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.226+0000 7f1c59200700 1 --2- 172.21.15.111:0/553938336 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1c54103580 0x7f1c541980b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1c4000fa00 tx=0x7f1c4000fa30 comp rx=0 tx=0).stop 2024-09-11T00:07:50.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.226+0000 7f1c59200700 1 -- 172.21.15.111:0/553938336 shutdown_connections 2024-09-11T00:07:50.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.226+0000 7f1c59200700 1 --2- 172.21.15.111:0/553938336 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f1c38073670 0x7f1c38075b20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:50.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.226+0000 7f1c59200700 1 --2- 172.21.15.111:0/553938336 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c54102380 0x7f1c54197b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:50.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.226+0000 7f1c59200700 1 --2- 172.21.15.111:0/553938336 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1c54103580 0x7f1c541980b0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:50.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.226+0000 7f1c59200700 1 -- 172.21.15.111:0/553938336 >> 172.21.15.111:0/553938336 conn(0x7f1c540fd930 msgr2=0x7f1c541067b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:50.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.227+0000 7f1c59200700 1 -- 172.21.15.111:0/553938336 shutdown_connections 2024-09-11T00:07:50.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.227+0000 7f1c59200700 1 -- 172.21.15.111:0/553938336 wait complete. 2024-09-11T00:07:50.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:49 smithi203 ceph-mon[33225]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:07:50.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.389+0000 7fb802400700 1 -- 172.21.15.111:0/2589310118 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7fc0ff380 msgr2=0x7fb7fc0ff7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:50.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.389+0000 7fb802400700 1 --2- 172.21.15.111:0/2589310118 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7fc0ff380 0x7fb7fc0ff7f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8009910 tx=0x7fb7e8009c20 comp rx=0 tx=0).stop 2024-09-11T00:07:50.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.389+0000 7fb802400700 1 -- 172.21.15.111:0/2589310118 shutdown_connections 2024-09-11T00:07:50.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.389+0000 7fb802400700 1 --2- 172.21.15.111:0/2589310118 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7fc0ff380 0x7fb7fc0ff7f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:50.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.389+0000 7fb802400700 1 --2- 172.21.15.111:0/2589310118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7fc0fea30 0x7fb7fc0fee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:50.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.389+0000 7fb802400700 1 -- 172.21.15.111:0/2589310118 >> 172.21.15.111:0/2589310118 conn(0x7fb7fc0fa5e0 msgr2=0x7fb7fc0fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:50.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.390+0000 7fb802400700 1 -- 172.21.15.111:0/2589310118 shutdown_connections 2024-09-11T00:07:50.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.390+0000 7fb802400700 1 -- 172.21.15.111:0/2589310118 wait complete. 2024-09-11T00:07:50.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.391+0000 7fb802400700 1 Processor -- start 2024-09-11T00:07:50.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.392+0000 7fb802400700 1 -- start start 2024-09-11T00:07:50.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.393+0000 7fb802400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7fc0fea30 0x7fb7fc10ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:50.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.393+0000 7fb802400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7fc10f1b0 0x7fb7fc1aa280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:50.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.393+0000 7fb802400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc1122a0 con 0x7fb7fc0fea30 2024-09-11T00:07:50.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.393+0000 7fb7fb400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7fc0fea30 0x7fb7fc10ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:50.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.393+0000 7fb7fb400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7fc0fea30 0x7fb7fc10ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:33938/0 (socket says 172.21.15.111:33938) 2024-09-11T00:07:50.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.393+0000 7fb7fb400700 1 -- 172.21.15.111:0/3045553340 learned_addr learned my addr 172.21.15.111:0/3045553340 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:07:50.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.393+0000 7fb802400700 1 -- 172.21.15.111:0/3045553340 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc112410 con 0x7fb7fc10f1b0 2024-09-11T00:07:50.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.393+0000 7fb7faa00700 1 --2- 172.21.15.111:0/3045553340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7fc10f1b0 0x7fb7fc1aa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:50.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.394+0000 7fb7fb400700 1 -- 172.21.15.111:0/3045553340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7fc10f1b0 msgr2=0x7fb7fc1aa280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:50.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.394+0000 7fb7fb400700 1 --2- 172.21.15.111:0/3045553340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7fc10f1b0 0x7fb7fc1aa280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:50.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.394+0000 7fb7fb400700 1 -- 172.21.15.111:0/3045553340 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e80095f0 con 0x7fb7fc0fea30 2024-09-11T00:07:50.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.394+0000 7fb7fb400700 1 --2- 172.21.15.111:0/3045553340 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7fc0fea30 0x7fb7fc10ec70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00e920 tx=0x7fb7ec00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:50.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.395+0000 7fb7f3e00700 1 -- 172.21.15.111:0/3045553340 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7ec00c9d0 con 0x7fb7fc0fea30 2024-09-11T00:07:50.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.395+0000 7fb7f3e00700 1 -- 172.21.15.111:0/3045553340 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb7ec010430 con 0x7fb7fc0fea30 2024-09-11T00:07:50.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.395+0000 7fb7f3e00700 1 -- 172.21.15.111:0/3045553340 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7ec018650 con 0x7fb7fc0fea30 2024-09-11T00:07:50.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.395+0000 7fb802400700 1 -- 172.21.15.111:0/3045553340 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7fc10f740 con 0x7fb7fc0fea30 2024-09-11T00:07:50.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.395+0000 7fb802400700 1 -- 172.21.15.111:0/3045553340 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7fc1aa9e0 con 0x7fb7fc0fea30 2024-09-11T00:07:50.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.397+0000 7fb802400700 1 -- 172.21.15.111:0/3045553340 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7fc107680 con 0x7fb7fc0fea30 2024-09-11T00:07:50.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.398+0000 7fb7f3e00700 1 -- 172.21.15.111:0/3045553340 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 26) v1 ==== 96222+0+0 (secure 0 0 0) 0x7fb7ec0105a0 con 0x7fb7fc0fea30 2024-09-11T00:07:50.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.399+0000 7fb7f3e00700 1 --2- 172.21.15.111:0/3045553340 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7fb7e0073670 0x7fb7e0075b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:07:50.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.399+0000 7fb7f3e00700 1 -- 172.21.15.111:0/3045553340 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fb7ec014070 con 0x7fb7fc0fea30 2024-09-11T00:07:50.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.400+0000 7fb7faa00700 1 --2- 172.21.15.111:0/3045553340 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7fb7e0073670 0x7fb7e0075b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:07:50.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.401+0000 7fb7faa00700 1 --2- 172.21.15.111:0/3045553340 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7fb7e0073670 0x7fb7e0075b20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb7e800b6f0 tx=0x7fb7e8005fd0 comp rx=0 tx=0).ready entity=mgr.24469 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:07:50.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.404+0000 7fb7f3e00700 1 -- 172.21.15.111:0/3045553340 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7fb7ec0553d0 con 0x7fb7fc0fea30 2024-09-11T00:07:50.802 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.801+0000 7fb802400700 1 -- 172.21.15.111:0/3045553340 --> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7fc061190 con 0x7fb7e0073670 2024-09-11T00:07:50.805 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:07:50.805 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e", 2024-09-11T00:07:50.805 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-11T00:07:50.805 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-11T00:07:50.805 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [], 2024-09-11T00:07:50.805 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "1/2 daemons upgraded", 2024-09-11T00:07:50.805 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "", 2024-09-11T00:07:50.805 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-11T00:07:50.806 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:07:50.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.804+0000 7fb7f3e00700 1 -- 172.21.15.111:0/3045553340 <== mgr.24469 v2:172.21.15.203:6828/1203435425 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fb7fc061190 con 0x7fb7e0073670 2024-09-11T00:07:50.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.808+0000 7fb802400700 1 -- 172.21.15.111:0/3045553340 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7fb7e0073670 msgr2=0x7fb7e0075b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:50.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.808+0000 7fb802400700 1 --2- 172.21.15.111:0/3045553340 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7fb7e0073670 0x7fb7e0075b20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb7e800b6f0 tx=0x7fb7e8005fd0 comp rx=0 tx=0).stop 2024-09-11T00:07:50.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.808+0000 7fb802400700 1 -- 172.21.15.111:0/3045553340 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7fc0fea30 msgr2=0x7fb7fc10ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:07:50.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.808+0000 7fb802400700 1 --2- 172.21.15.111:0/3045553340 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7fc0fea30 0x7fb7fc10ec70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00e920 tx=0x7fb7ec00ec30 comp rx=0 tx=0).stop 2024-09-11T00:07:50.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.808+0000 7fb802400700 1 -- 172.21.15.111:0/3045553340 shutdown_connections 2024-09-11T00:07:50.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.808+0000 7fb802400700 1 --2- 172.21.15.111:0/3045553340 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7fb7e0073670 0x7fb7e0075b20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:50.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.808+0000 7fb802400700 1 --2- 172.21.15.111:0/3045553340 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7fc0fea30 0x7fb7fc10ec70 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:50.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.808+0000 7fb802400700 1 --2- 172.21.15.111:0/3045553340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7fc10f1b0 0x7fb7fc1aa280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:07:50.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.808+0000 7fb802400700 1 -- 172.21.15.111:0/3045553340 >> 172.21.15.111:0/3045553340 conn(0x7fb7fc0fa5e0 msgr2=0x7fb7fc1047c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:07:50.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.808+0000 7fb802400700 1 -- 172.21.15.111:0/3045553340 shutdown_connections 2024-09-11T00:07:50.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:07:50.808+0000 7fb802400700 1 -- 172.21.15.111:0/3045553340 wait complete. 2024-09-11T00:07:51.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:50 smithi111 ceph-mon[27539]: from='client.24531 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:07:51.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:50 smithi111 ceph-mon[27539]: pgmap v23: 65 pgs: 65 active+clean; 4.0 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 34 MiB/s rd, 84 MiB/s wr, 251 op/s 2024-09-11T00:07:51.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:50 smithi111 ceph-mon[27539]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:07:51.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:50 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/553938336' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:07:51.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:50 smithi203 ceph-mon[33225]: from='client.24531 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:07:51.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:50 smithi203 ceph-mon[33225]: pgmap v23: 65 pgs: 65 active+clean; 4.0 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 34 MiB/s rd, 84 MiB/s wr, 251 op/s 2024-09-11T00:07:51.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:50 smithi203 ceph-mon[33225]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:07:51.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:50 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/553938336' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:07:52.203 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:51 smithi203 ceph-mon[33225]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:07:52.203 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:51 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:52.203 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:51 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:52.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:51 smithi111 ceph-mon[27539]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:07:52.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:51 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:52.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:51 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:53.255 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:52 smithi111 ceph-mon[27539]: pgmap v24: 65 pgs: 65 active+clean; 3.0 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 34 MiB/s rd, 85 MiB/s wr, 326 op/s 2024-09-11T00:07:53.255 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:52 smithi111 ceph-mon[27539]: Reconfiguring prometheus.smithi111 (dependencies changed)... 2024-09-11T00:07:53.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:52 smithi203 ceph-mon[33225]: pgmap v24: 65 pgs: 65 active+clean; 3.0 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 34 MiB/s rd, 85 MiB/s wr, 326 op/s 2024-09-11T00:07:53.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:52 smithi203 ceph-mon[33225]: Reconfiguring prometheus.smithi111 (dependencies changed)... 2024-09-11T00:07:54.219 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:53 smithi111 ceph-mon[27539]: Reconfiguring daemon prometheus.smithi111 on smithi111 2024-09-11T00:07:54.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:53 smithi203 ceph-mon[33225]: Reconfiguring daemon prometheus.smithi111 on smithi111 2024-09-11T00:07:55.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:54 smithi203 ceph-mon[33225]: pgmap v25: 65 pgs: 65 active+clean; 3.0 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 5.7 MiB/s rd, 16 MiB/s wr, 162 op/s 2024-09-11T00:07:55.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:54 smithi111 ceph-mon[27539]: pgmap v25: 65 pgs: 65 active+clean; 3.0 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 5.7 MiB/s rd, 16 MiB/s wr, 162 op/s 2024-09-11T00:07:57.258 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:56 smithi111 ceph-mon[27539]: pgmap v26: 65 pgs: 65 active+clean; 3.0 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 5.7 MiB/s rd, 16 MiB/s wr, 162 op/s 2024-09-11T00:07:57.258 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:56 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:07:57.267 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:56 smithi203 ceph-mon[33225]: pgmap v26: 65 pgs: 65 active+clean; 3.0 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 5.7 MiB/s rd, 16 MiB/s wr, 162 op/s 2024-09-11T00:07:57.267 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:56 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:07:59.261 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:58 smithi203 ceph-mon[33225]: pgmap v27: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 5.7 MiB/s rd, 17 MiB/s wr, 236 op/s 2024-09-11T00:07:59.261 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:58 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:59.261 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:58 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:59.261 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:58 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi203", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-11T00:07:59.261 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:58 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi203", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-11T00:07:59.261 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:58 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:07:59.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:58 smithi111 ceph-mon[27539]: pgmap v27: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 5.7 MiB/s rd, 17 MiB/s wr, 236 op/s 2024-09-11T00:07:59.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:58 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:59.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:58 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:07:59.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:58 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi203", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-11T00:07:59.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:58 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi203", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-11T00:07:59.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:58 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:08:00.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:59 smithi203 ceph-mon[33225]: Reconfiguring ceph-exporter.smithi203 (dependencies changed)... 2024-09-11T00:08:00.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:07:59 smithi203 ceph-mon[33225]: Deploying daemon ceph-exporter.smithi203 on smithi203 2024-09-11T00:08:00.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:59 smithi111 ceph-mon[27539]: Reconfiguring ceph-exporter.smithi203 (dependencies changed)... 2024-09-11T00:08:00.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:07:59 smithi111 ceph-mon[27539]: Deploying daemon ceph-exporter.smithi203 on smithi203 2024-09-11T00:08:00.445 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-11T00:08:00.445 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-11T00:08:01.115 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-11T00:08:01.115 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-11T00:08:01.225 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:00 smithi203 ceph-mon[33225]: pgmap v28: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 21 KiB/s rd, 1.1 MiB/s wr, 148 op/s 2024-09-11T00:08:01.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:00 smithi111 ceph-mon[27539]: pgmap v28: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 21 KiB/s rd, 1.1 MiB/s wr, 148 op/s 2024-09-11T00:08:02.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:01 smithi111 ceph-mon[27539]: pgmap v29: 65 pgs: 65 active+clean; 943 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 33 KiB/s rd, 1.6 MiB/s wr, 215 op/s 2024-09-11T00:08:02.219 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:01 smithi203 ceph-mon[33225]: pgmap v29: 65 pgs: 65 active+clean; 943 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 33 KiB/s rd, 1.6 MiB/s wr, 215 op/s 2024-09-11T00:08:05.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:04 smithi203 ceph-mon[33225]: pgmap v30: 65 pgs: 65 active+clean; 943 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 23 KiB/s rd, 1.1 MiB/s wr, 140 op/s 2024-09-11T00:08:05.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:04 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:05.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:04 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:05.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:04 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-11T00:08:05.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:04 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:08:05.055 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:04 smithi111 ceph-mon[27539]: pgmap v30: 65 pgs: 65 active+clean; 943 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 23 KiB/s rd, 1.1 MiB/s wr, 140 op/s 2024-09-11T00:08:05.056 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:04 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:05.056 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:04 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:05.056 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:04 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-11T00:08:05.056 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:04 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:08:06.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:05 smithi203 ceph-mon[33225]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-11T00:08:06.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:05 smithi203 ceph-mon[33225]: Upgrade: Need to upgrade myself (mgr.smithi203.smuspl) 2024-09-11T00:08:06.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:05 smithi203 ceph-mon[33225]: Upgrade: Need to upgrade myself (mgr.smithi203.smuspl) 2024-09-11T00:08:06.060 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:05 smithi111 ceph-mon[27539]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-11T00:08:06.061 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:05 smithi111 ceph-mon[27539]: Upgrade: Need to upgrade myself (mgr.smithi203.smuspl) 2024-09-11T00:08:06.061 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:05 smithi111 ceph-mon[27539]: Upgrade: Need to upgrade myself (mgr.smithi203.smuspl) 2024-09-11T00:08:07.034 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:06 smithi111 ceph-mon[27539]: pgmap v31: 65 pgs: 65 active+clean; 943 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 23 KiB/s rd, 1.1 MiB/s wr, 140 op/s 2024-09-11T00:08:07.034 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:06 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:07.034 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:06 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi111.ypucji", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T00:08:07.034 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:06 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi111.ypucji", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T00:08:07.034 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:06 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T00:08:07.034 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:06 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:08:07.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:06 smithi203 ceph-mon[33225]: pgmap v31: 65 pgs: 65 active+clean; 943 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 23 KiB/s rd, 1.1 MiB/s wr, 140 op/s 2024-09-11T00:08:07.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:06 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:07.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:06 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi111.ypucji", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T00:08:07.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:06 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi111.ypucji", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T00:08:07.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:06 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T00:08:07.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:06 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:08:08.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:07 smithi203 ceph-mon[33225]: Upgrade: Updating mgr.smithi111.ypucji 2024-09-11T00:08:08.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:07 smithi203 ceph-mon[33225]: Deploying daemon mgr.smithi111.ypucji on smithi111 2024-09-11T00:08:08.130 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:07 smithi111 ceph-mon[27539]: Upgrade: Updating mgr.smithi111.ypucji 2024-09-11T00:08:08.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:07 smithi111 ceph-mon[27539]: Deploying daemon mgr.smithi111.ypucji on smithi111 2024-09-11T00:08:08.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:08 smithi111 ceph-mon[27539]: pgmap v32: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 34 KiB/s rd, 1.6 MiB/s wr, 201 op/s 2024-09-11T00:08:09.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:08 smithi203 ceph-mon[33225]: pgmap v32: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 34 KiB/s rd, 1.6 MiB/s wr, 201 op/s 2024-09-11T00:08:11.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:10 smithi203 ceph-mon[33225]: pgmap v33: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 1.1 MiB/s wr, 127 op/s 2024-09-11T00:08:11.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:10 smithi111 ceph-mon[27539]: pgmap v33: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 1.1 MiB/s wr, 127 op/s 2024-09-11T00:08:11.982 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:11 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:08:12.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:11 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:08:13.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:12 smithi203 ceph-mon[33225]: pgmap v34: 65 pgs: 65 active+clean; 290 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 39 KiB/s rd, 1.8 MiB/s wr, 170 op/s 2024-09-11T00:08:13.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:12 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:13.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:12 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:13.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:12 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:08:13.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:12 smithi111 ceph-mon[27539]: pgmap v34: 65 pgs: 65 active+clean; 290 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 39 KiB/s rd, 1.8 MiB/s wr, 170 op/s 2024-09-11T00:08:13.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:12 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:13.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:12 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:13.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:12 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:08:14.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:14 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:14.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:14 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:14.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:14 smithi111 ceph-mon[27539]: pgmap v35: 65 pgs: 65 active+clean; 290 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 103 op/s 2024-09-11T00:08:14.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:14 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:14.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:14 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:14.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:14 smithi203 ceph-mon[33225]: pgmap v35: 65 pgs: 65 active+clean; 290 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 103 op/s 2024-09-11T00:08:16.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:16 smithi111 ceph-mon[27539]: pgmap v36: 65 pgs: 65 active+clean; 290 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 103 op/s 2024-09-11T00:08:16.794 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:16 smithi203 ceph-mon[33225]: pgmap v36: 65 pgs: 65 active+clean; 290 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 103 op/s 2024-09-11T00:08:18.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:18 smithi111 ceph-mon[27539]: pgmap v37: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 1.9 MiB/s wr, 139 op/s 2024-09-11T00:08:18.794 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:18 smithi203 ceph-mon[33225]: pgmap v37: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 1.9 MiB/s wr, 139 op/s 2024-09-11T00:08:20.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:19 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:20.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:19 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:20.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:19 smithi203 ceph-mon[33225]: Standby manager daemon smithi111.ypucji restarted 2024-09-11T00:08:20.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:19 smithi203 ceph-mon[33225]: Standby manager daemon smithi111.ypucji started 2024-09-11T00:08:20.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:19 smithi203 ceph-mon[33225]: from='mgr.? 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.ypucji/crt"}]: dispatch 2024-09-11T00:08:20.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:19 smithi203 ceph-mon[33225]: from='mgr.? 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T00:08:20.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:19 smithi203 ceph-mon[33225]: from='mgr.? 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.ypucji/key"}]: dispatch 2024-09-11T00:08:20.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:19 smithi203 ceph-mon[33225]: from='mgr.? 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T00:08:20.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:19 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:20.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:19 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:20.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:19 smithi111 ceph-mon[27539]: Standby manager daemon smithi111.ypucji restarted 2024-09-11T00:08:20.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:19 smithi111 ceph-mon[27539]: Standby manager daemon smithi111.ypucji started 2024-09-11T00:08:20.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:19 smithi111 ceph-mon[27539]: from='mgr.? 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.ypucji/crt"}]: dispatch 2024-09-11T00:08:20.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:19 smithi111 ceph-mon[27539]: from='mgr.? 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T00:08:20.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:19 smithi111 ceph-mon[27539]: from='mgr.? 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.ypucji/key"}]: dispatch 2024-09-11T00:08:20.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:19 smithi111 ceph-mon[27539]: from='mgr.? 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T00:08:20.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.975+0000 7fd97d800700 1 -- 172.21.15.111:0/3986500632 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd9780fffa0 msgr2=0x7fd9781003b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:20.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.975+0000 7fd97d800700 1 --2- 172.21.15.111:0/3986500632 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd9780fffa0 0x7fd9781003b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd968009910 tx=0x7fd968009c20 comp rx=0 tx=0).stop 2024-09-11T00:08:20.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.975+0000 7fd97d800700 1 -- 172.21.15.111:0/3986500632 shutdown_connections 2024-09-11T00:08:20.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.975+0000 7fd97d800700 1 --2- 172.21.15.111:0/3986500632 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd9781011a0 0x7fd9781015f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:20.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.975+0000 7fd97d800700 1 --2- 172.21.15.111:0/3986500632 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd9780fffa0 0x7fd9781003b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:20.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.975+0000 7fd97d800700 1 -- 172.21.15.111:0/3986500632 >> 172.21.15.111:0/3986500632 conn(0x7fd9780fb510 msgr2=0x7fd9780fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:20.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.975+0000 7fd97d800700 1 -- 172.21.15.111:0/3986500632 shutdown_connections 2024-09-11T00:08:20.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.975+0000 7fd97d800700 1 -- 172.21.15.111:0/3986500632 wait complete. 2024-09-11T00:08:20.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.976+0000 7fd97d800700 1 Processor -- start 2024-09-11T00:08:20.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.976+0000 7fd97d800700 1 -- start start 2024-09-11T00:08:20.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.977+0000 7fd97d800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd9780fffa0 0x7fd9781979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:20.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.977+0000 7fd97d800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd9781011a0 0x7fd978197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:20.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.977+0000 7fd97d800700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd978198520 con 0x7fd9781011a0 2024-09-11T00:08:20.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.977+0000 7fd97d800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd978198660 con 0x7fd9780fffa0 2024-09-11T00:08:20.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.977+0000 7fd977400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd9781011a0 0x7fd978197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:20.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.977+0000 7fd977400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd9781011a0 0x7fd978197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45128/0 (socket says 172.21.15.111:45128) 2024-09-11T00:08:20.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.977+0000 7fd977400700 1 -- 172.21.15.111:0/298465342 learned_addr learned my addr 172.21.15.111:0/298465342 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:08:20.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.977+0000 7fd977e00700 1 --2- 172.21.15.111:0/298465342 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd9780fffa0 0x7fd9781979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:20.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.977+0000 7fd977400700 1 -- 172.21.15.111:0/298465342 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd9780fffa0 msgr2=0x7fd9781979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:20.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.977+0000 7fd977400700 1 --2- 172.21.15.111:0/298465342 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd9780fffa0 0x7fd9781979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:20.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.977+0000 7fd977400700 1 -- 172.21.15.111:0/298465342 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9680095f0 con 0x7fd9781011a0 2024-09-11T00:08:20.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.978+0000 7fd977400700 1 --2- 172.21.15.111:0/298465342 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd9781011a0 0x7fd978197f00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd96400d8d0 tx=0x7fd96400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:20.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.978+0000 7fd974c00700 1 -- 172.21.15.111:0/298465342 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9640098a0 con 0x7fd9781011a0 2024-09-11T00:08:20.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.978+0000 7fd974c00700 1 -- 172.21.15.111:0/298465342 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd964010460 con 0x7fd9781011a0 2024-09-11T00:08:20.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.978+0000 7fd974c00700 1 -- 172.21.15.111:0/298465342 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd96400f5f0 con 0x7fd9781011a0 2024-09-11T00:08:20.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.978+0000 7fd97d800700 1 -- 172.21.15.111:0/298465342 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd97819d110 con 0x7fd9781011a0 2024-09-11T00:08:20.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.978+0000 7fd97d800700 1 -- 172.21.15.111:0/298465342 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd97819d660 con 0x7fd9781011a0 2024-09-11T00:08:20.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.979+0000 7fd97d800700 1 -- 172.21.15.111:0/298465342 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd978105280 con 0x7fd9781011a0 2024-09-11T00:08:20.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.981+0000 7fd974c00700 1 -- 172.21.15.111:0/298465342 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 27) v1 ==== 102433+0+0 (secure 0 0 0) 0x7fd964009a00 con 0x7fd9781011a0 2024-09-11T00:08:20.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.982+0000 7fd974c00700 1 --2- 172.21.15.111:0/298465342 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7fd95c07a480 0x7fd95c07c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:20.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.982+0000 7fd974c00700 1 -- 172.21.15.111:0/298465342 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fd96409ccf0 con 0x7fd9781011a0 2024-09-11T00:08:20.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.982+0000 7fd977e00700 1 --2- 172.21.15.111:0/298465342 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7fd95c07a480 0x7fd95c07c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:20.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.983+0000 7fd977e00700 1 --2- 172.21.15.111:0/298465342 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7fd95c07a480 0x7fd95c07c930 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd968006010 tx=0x7fd96800b560 comp rx=0 tx=0).ready entity=mgr.24469 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:20.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:20.987+0000 7fd974c00700 1 -- 172.21.15.111:0/298465342 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7fd964060820 con 0x7fd9781011a0 2024-09-11T00:08:21.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:20 smithi111 ceph-mon[27539]: pgmap v38: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.4 MiB/s wr, 79 op/s 2024-09-11T00:08:21.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:20 smithi111 ceph-mon[27539]: mgrmap e27: smithi203.smuspl(active, since 70s), standbys: smithi111.ypucji 2024-09-11T00:08:21.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:20 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:21.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:20 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:21.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.256+0000 7fd97d800700 1 -- 172.21.15.111:0/298465342 --> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd978061190 con 0x7fd95c07a480 2024-09-11T00:08:21.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.258+0000 7fd974c00700 1 -- 172.21.15.111:0/298465342 <== mgr.24469 v2:172.21.15.203:6828/1203435425 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7fd978061190 con 0x7fd95c07a480 2024-09-11T00:08:21.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.260+0000 7fd97d800700 1 -- 172.21.15.111:0/298465342 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7fd95c07a480 msgr2=0x7fd95c07c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:21.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.260+0000 7fd97d800700 1 --2- 172.21.15.111:0/298465342 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7fd95c07a480 0x7fd95c07c930 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd968006010 tx=0x7fd96800b560 comp rx=0 tx=0).stop 2024-09-11T00:08:21.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.260+0000 7fd97d800700 1 -- 172.21.15.111:0/298465342 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd9781011a0 msgr2=0x7fd978197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:21.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.260+0000 7fd97d800700 1 --2- 172.21.15.111:0/298465342 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd9781011a0 0x7fd978197f00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd96400d8d0 tx=0x7fd96400dbe0 comp rx=0 tx=0).stop 2024-09-11T00:08:21.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.261+0000 7fd97d800700 1 -- 172.21.15.111:0/298465342 shutdown_connections 2024-09-11T00:08:21.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.261+0000 7fd97d800700 1 --2- 172.21.15.111:0/298465342 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7fd95c07a480 0x7fd95c07c930 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:21.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.261+0000 7fd97d800700 1 --2- 172.21.15.111:0/298465342 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd9780fffa0 0x7fd9781979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:21.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.261+0000 7fd97d800700 1 --2- 172.21.15.111:0/298465342 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd9781011a0 0x7fd978197f00 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:21.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.261+0000 7fd97d800700 1 -- 172.21.15.111:0/298465342 >> 172.21.15.111:0/298465342 conn(0x7fd9780fb510 msgr2=0x7fd9781023c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:21.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.261+0000 7fd97d800700 1 -- 172.21.15.111:0/298465342 shutdown_connections 2024-09-11T00:08:21.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.261+0000 7fd97d800700 1 -- 172.21.15.111:0/298465342 wait complete. 2024-09-11T00:08:21.277 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:08:21.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:20 smithi203 ceph-mon[33225]: pgmap v38: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.4 MiB/s wr, 79 op/s 2024-09-11T00:08:21.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:20 smithi203 ceph-mon[33225]: mgrmap e27: smithi203.smuspl(active, since 70s), standbys: smithi111.ypucji 2024-09-11T00:08:21.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:20 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:21.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:20 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:21.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.462+0000 7f02b0c00700 1 -- 172.21.15.111:0/2657743404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02ac101350 msgr2=0x7f02ac1017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:21.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.462+0000 7f02b0c00700 1 --2- 172.21.15.111:0/2657743404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02ac101350 0x7f02ac1017a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0298009870 tx=0x7f0298009b80 comp rx=0 tx=0).stop 2024-09-11T00:08:21.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.462+0000 7f02b0c00700 1 -- 172.21.15.111:0/2657743404 shutdown_connections 2024-09-11T00:08:21.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.462+0000 7f02b0c00700 1 --2- 172.21.15.111:0/2657743404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02ac101350 0x7f02ac1017a0 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0298009870 tx=0x7f0298009b80 comp rx=0 tx=0).stop 2024-09-11T00:08:21.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.462+0000 7f02b0c00700 1 --2- 172.21.15.111:0/2657743404 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f02ac100150 0x7f02ac100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:21.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.462+0000 7f02b0c00700 1 -- 172.21.15.111:0/2657743404 >> 172.21.15.111:0/2657743404 conn(0x7f02ac0fb6e0 msgr2=0x7f02ac0fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:21.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.464+0000 7f02b0c00700 1 -- 172.21.15.111:0/2657743404 shutdown_connections 2024-09-11T00:08:21.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.464+0000 7f02b0c00700 1 -- 172.21.15.111:0/2657743404 wait complete. 2024-09-11T00:08:21.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.466+0000 7f02b0c00700 1 Processor -- start 2024-09-11T00:08:21.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.466+0000 7f02b0c00700 1 -- start start 2024-09-11T00:08:21.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.466+0000 7f02b0c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02ac100150 0x7f02ac06b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:21.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.466+0000 7f02b0c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f02ac06b6b0 0x7f02ac070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:21.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.466+0000 7f02b0c00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac06bbb0 con 0x7f02ac06b6b0 2024-09-11T00:08:21.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.466+0000 7f02b0c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac06bcf0 con 0x7f02ac100150 2024-09-11T00:08:21.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.467+0000 7f02a9e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02ac100150 0x7f02ac06b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:21.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.467+0000 7f02a9e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02ac100150 0x7f02ac06b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.111:56964/0 (socket says 172.21.15.111:56964) 2024-09-11T00:08:21.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.467+0000 7f02a9e00700 1 -- 172.21.15.111:0/3869566046 learned_addr learned my addr 172.21.15.111:0/3869566046 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:08:21.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.468+0000 7f02a9400700 1 --2- 172.21.15.111:0/3869566046 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f02ac06b6b0 0x7f02ac070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:21.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.468+0000 7f02a9e00700 1 -- 172.21.15.111:0/3869566046 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f02ac06b6b0 msgr2=0x7f02ac070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:21.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.468+0000 7f02a9e00700 1 --2- 172.21.15.111:0/3869566046 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f02ac06b6b0 0x7f02ac070720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:21.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.468+0000 7f02a9e00700 1 -- 172.21.15.111:0/3869566046 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029c0095f0 con 0x7f02ac100150 2024-09-11T00:08:21.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.469+0000 7f02a9e00700 1 --2- 172.21.15.111:0/3869566046 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02ac100150 0x7f02ac06b170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f029c00eb70 tx=0x7f029c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:21.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.469+0000 7f02a9400700 1 --2- 172.21.15.111:0/3869566046 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f02ac06b6b0 0x7f02ac070720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:08:21.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.470+0000 7f02a2a00700 1 -- 172.21.15.111:0/3869566046 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f029c00cc60 con 0x7f02ac100150 2024-09-11T00:08:21.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.470+0000 7f02a2a00700 1 -- 172.21.15.111:0/3869566046 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f029c00cdc0 con 0x7f02ac100150 2024-09-11T00:08:21.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.470+0000 7f02a2a00700 1 -- 172.21.15.111:0/3869566046 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f029c018940 con 0x7f02ac100150 2024-09-11T00:08:21.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.471+0000 7f02b0c00700 1 -- 172.21.15.111:0/3869566046 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0298009520 con 0x7f02ac100150 2024-09-11T00:08:21.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.471+0000 7f02b0c00700 1 -- 172.21.15.111:0/3869566046 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02ac071080 con 0x7f02ac100150 2024-09-11T00:08:21.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.473+0000 7f02b0c00700 1 -- 172.21.15.111:0/3869566046 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02ac074a80 con 0x7f02ac100150 2024-09-11T00:08:21.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.475+0000 7f02a2a00700 1 -- 172.21.15.111:0/3869566046 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 27) v1 ==== 102433+0+0 (secure 0 0 0) 0x7f029c018aa0 con 0x7f02ac100150 2024-09-11T00:08:21.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.476+0000 7f02a2a00700 1 --2- 172.21.15.111:0/3869566046 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f029007a490 0x7f029007c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:21.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.476+0000 7f02a2a00700 1 -- 172.21.15.111:0/3869566046 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f029c014070 con 0x7f02ac100150 2024-09-11T00:08:21.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.477+0000 7f02a9400700 1 --2- 172.21.15.111:0/3869566046 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f029007a490 0x7f029007c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:21.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.479+0000 7f02a9400700 1 --2- 172.21.15.111:0/3869566046 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f029007a490 0x7f029007c940 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0298000c00 tx=0x7f0298019040 comp rx=0 tx=0).ready entity=mgr.24469 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:21.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.492+0000 7f02a2a00700 1 -- 172.21.15.111:0/3869566046 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f029c060fe0 con 0x7f02ac100150 2024-09-11T00:08:21.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.767+0000 7f02b0c00700 1 -- 172.21.15.111:0/3869566046 --> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f02ac105ca0 con 0x7f029007a490 2024-09-11T00:08:21.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.769+0000 7f02a2a00700 1 -- 172.21.15.111:0/3869566046 <== mgr.24469 v2:172.21.15.203:6828/1203435425 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f02ac105ca0 con 0x7f029007a490 2024-09-11T00:08:21.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.772+0000 7f02b0c00700 1 -- 172.21.15.111:0/3869566046 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f029007a490 msgr2=0x7f029007c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:21.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.772+0000 7f02b0c00700 1 --2- 172.21.15.111:0/3869566046 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f029007a490 0x7f029007c940 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0298000c00 tx=0x7f0298019040 comp rx=0 tx=0).stop 2024-09-11T00:08:21.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.772+0000 7f02b0c00700 1 -- 172.21.15.111:0/3869566046 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02ac100150 msgr2=0x7f02ac06b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:21.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.772+0000 7f02b0c00700 1 --2- 172.21.15.111:0/3869566046 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02ac100150 0x7f02ac06b170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f029c00eb70 tx=0x7f029c00ee80 comp rx=0 tx=0).stop 2024-09-11T00:08:21.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.772+0000 7f02b0c00700 1 -- 172.21.15.111:0/3869566046 shutdown_connections 2024-09-11T00:08:21.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.772+0000 7f02b0c00700 1 --2- 172.21.15.111:0/3869566046 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f029007a490 0x7f029007c940 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:21.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.772+0000 7f02b0c00700 1 --2- 172.21.15.111:0/3869566046 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02ac100150 0x7f02ac06b170 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:21.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.772+0000 7f02b0c00700 1 --2- 172.21.15.111:0/3869566046 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f02ac06b6b0 0x7f02ac070720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:21.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.772+0000 7f02b0c00700 1 -- 172.21.15.111:0/3869566046 >> 172.21.15.111:0/3869566046 conn(0x7f02ac0fb6e0 msgr2=0x7f02ac104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:21.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.772+0000 7f02b0c00700 1 -- 172.21.15.111:0/3869566046 shutdown_connections 2024-09-11T00:08:21.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.772+0000 7f02b0c00700 1 -- 172.21.15.111:0/3869566046 wait complete. 2024-09-11T00:08:21.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.918+0000 7f5dc4a00700 1 -- 172.21.15.111:0/4139149562 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5dc0100150 msgr2=0x7f5dc0100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:21.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.918+0000 7f5dc4a00700 1 --2- 172.21.15.111:0/4139149562 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5dc0100150 0x7f5dc0100560 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5db0009910 tx=0x7f5db0009c20 comp rx=0 tx=0).stop 2024-09-11T00:08:21.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.918+0000 7f5dc4a00700 1 -- 172.21.15.111:0/4139149562 shutdown_connections 2024-09-11T00:08:21.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.918+0000 7f5dc4a00700 1 --2- 172.21.15.111:0/4139149562 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5dc0101350 0x7f5dc01017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:21.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.918+0000 7f5dc4a00700 1 --2- 172.21.15.111:0/4139149562 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5dc0100150 0x7f5dc0100560 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:21.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.918+0000 7f5dc4a00700 1 -- 172.21.15.111:0/4139149562 >> 172.21.15.111:0/4139149562 conn(0x7f5dc00fb6e0 msgr2=0x7f5dc00fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:21.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.918+0000 7f5dc4a00700 1 -- 172.21.15.111:0/4139149562 shutdown_connections 2024-09-11T00:08:21.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.918+0000 7f5dc4a00700 1 -- 172.21.15.111:0/4139149562 wait complete. 2024-09-11T00:08:21.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.919+0000 7f5dc4a00700 1 Processor -- start 2024-09-11T00:08:21.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.919+0000 7f5dc4a00700 1 -- start start 2024-09-11T00:08:21.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.920+0000 7f5dc4a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5dc0100150 0x7f5dc01959a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:21.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.920+0000 7f5dc4a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5dc0101350 0x7f5dc0195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:21.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.920+0000 7f5dc4a00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc0196500 con 0x7f5dc0101350 2024-09-11T00:08:21.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.920+0000 7f5dc4a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc0196640 con 0x7f5dc0100150 2024-09-11T00:08:21.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.920+0000 7f5db7e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5dc0101350 0x7f5dc0195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:21.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.920+0000 7f5db7e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5dc0101350 0x7f5dc0195ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45156/0 (socket says 172.21.15.111:45156) 2024-09-11T00:08:21.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.920+0000 7f5db7e00700 1 -- 172.21.15.111:0/684522242 learned_addr learned my addr 172.21.15.111:0/684522242 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:08:21.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.920+0000 7f5dbde00700 1 --2- 172.21.15.111:0/684522242 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5dc0100150 0x7f5dc01959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:21.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.920+0000 7f5db7e00700 1 -- 172.21.15.111:0/684522242 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5dc0100150 msgr2=0x7f5dc01959a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:21.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.920+0000 7f5db7e00700 1 --2- 172.21.15.111:0/684522242 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5dc0100150 0x7f5dc01959a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:21.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.920+0000 7f5db7e00700 1 -- 172.21.15.111:0/684522242 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db00095f0 con 0x7f5dc0101350 2024-09-11T00:08:21.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.921+0000 7f5db7e00700 1 --2- 172.21.15.111:0/684522242 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5dc0101350 0x7f5dc0195ee0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5da800e920 tx=0x7f5da800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:21.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.921+0000 7f5db6a00700 1 -- 172.21.15.111:0/684522242 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5da800c9d0 con 0x7f5dc0101350 2024-09-11T00:08:21.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.921+0000 7f5db6a00700 1 -- 172.21.15.111:0/684522242 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5da8010430 con 0x7f5dc0101350 2024-09-11T00:08:21.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.921+0000 7f5dc4a00700 1 -- 172.21.15.111:0/684522242 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc019b0f0 con 0x7f5dc0101350 2024-09-11T00:08:21.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.921+0000 7f5db6a00700 1 -- 172.21.15.111:0/684522242 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5da8018650 con 0x7f5dc0101350 2024-09-11T00:08:21.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.921+0000 7f5dc4a00700 1 -- 172.21.15.111:0/684522242 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc019b640 con 0x7f5dc0101350 2024-09-11T00:08:21.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.922+0000 7f5dc4a00700 1 -- 172.21.15.111:0/684522242 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc0108ca0 con 0x7f5dc0101350 2024-09-11T00:08:21.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.924+0000 7f5db6a00700 1 -- 172.21.15.111:0/684522242 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 27) v1 ==== 102433+0+0 (secure 0 0 0) 0x7f5da80105a0 con 0x7f5dc0101350 2024-09-11T00:08:21.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.925+0000 7f5db6a00700 1 --2- 172.21.15.111:0/684522242 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f5da407a480 0x7f5da407c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:21.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.925+0000 7f5db6a00700 1 -- 172.21.15.111:0/684522242 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f5da8014070 con 0x7f5dc0101350 2024-09-11T00:08:21.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.926+0000 7f5dbde00700 1 --2- 172.21.15.111:0/684522242 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f5da407a480 0x7f5da407c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:21.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.927+0000 7f5dbde00700 1 --2- 172.21.15.111:0/684522242 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f5da407a480 0x7f5da407c930 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5db0009fd0 tx=0x7f5db0005fd0 comp rx=0 tx=0).ready entity=mgr.24469 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:21.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:21.931+0000 7f5db6a00700 1 -- 172.21.15.111:0/684522242 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f5da8060bf0 con 0x7f5dc0101350 2024-09-11T00:08:22.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.194+0000 7f5dc4a00700 1 -- 172.21.15.111:0/684522242 --> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5dc0105ca0 con 0x7f5da407a480 2024-09-11T00:08:22.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.206+0000 7f5db6a00700 1 -- 172.21.15.111:0/684522242 <== mgr.24469 v2:172.21.15.203:6828/1203435425 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f5dc0105ca0 con 0x7f5da407a480 2024-09-11T00:08:22.209 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:08:22.209 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (9m) 3s ago 11m 13.8M - 0.25.0 c8568f914cd2 eb9e393000ec 2024-09-11T00:08:22.209 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (30s) 3s ago 11m 7037k - 18.2.0 dc2bc1663786 7c40af85314c 2024-09-11T00:08:22.210 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi203 smithi203 starting - - - - 2024-09-11T00:08:22.210 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (11m) 3s ago 11m 6665k - 18.2.0 dc2bc1663786 72a36c166ffa 2024-09-11T00:08:22.210 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi203 smithi203 running (10m) 52s ago 10m 6669k - 18.2.0 dc2bc1663786 9b102b6f6d70 2024-09-11T00:08:22.210 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (9m) 3s ago 11m 73.6M - 9.4.7 954c08fa6188 e599624a9c9e 2024-09-11T00:08:22.210 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.gmgsay smithi111 running (4m) 3s ago 4m 14.2M - 18.2.0 dc2bc1663786 795e4ff0075c 2024-09-11T00:08:22.210 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.rucaba smithi111 running (4m) 3s ago 4m 14.2M - 18.2.0 dc2bc1663786 02885adac62c 2024-09-11T00:08:22.211 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.tcrqop smithi203 running (4m) 52s ago 4m 227M - 18.2.0 dc2bc1663786 4df492159bb4 2024-09-11T00:08:22.211 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.uqkbkn smithi203 running (4m) 52s ago 4m 13.7M - 18.2.0 dc2bc1663786 619aa58ea314 2024-09-11T00:08:22.211 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.ypucji smithi111 *:8443,9283,8765 running (10s) 3s ago 13m 69.3M - 19.3.0-4854-g8f219c47 589dd18248e4 07fa31f49618 2024-09-11T00:08:22.211 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi203.smuspl smithi203 *:8443,9283,8765 running (100s) 52s ago 10m 498M - 19.3.0-4854-g8f219c47 589dd18248e4 5c2e09508810 2024-09-11T00:08:22.211 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (13m) 3s ago 13m 50.2M 2048M 18.2.0 dc2bc1663786 2596322539fb 2024-09-11T00:08:22.211 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi203 smithi203 running (10m) 52s ago 10m 41.9M 2048M 18.2.0 dc2bc1663786 ff8eb7ca85ea 2024-09-11T00:08:22.212 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (11m) 3s ago 11m 8040k - 1.5.0 0da6a335fe13 4fd66ebc9c0d 2024-09-11T00:08:22.212 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi203 smithi203 *:9100 running (10m) 52s ago 10m 7713k - 1.5.0 0da6a335fe13 1cb3ca740f4a 2024-09-11T00:08:22.212 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (8m) 3s ago 8m 179M 1216M 18.2.0 dc2bc1663786 162b7249a591 2024-09-11T00:08:22.212 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (8m) 3s ago 8m 190M 1216M 18.2.0 dc2bc1663786 3614d95b1425 2024-09-11T00:08:22.212 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (7m) 3s ago 7m 156M 1216M 18.2.0 dc2bc1663786 db175d4b09b9 2024-09-11T00:08:22.213 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi203 running (7m) 52s ago 7m 204M 2240M 18.2.0 dc2bc1663786 60b1cef7a70d 2024-09-11T00:08:22.213 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi203 running (6m) 52s ago 6m 178M 2240M 18.2.0 dc2bc1663786 769c7942c42b 2024-09-11T00:08:22.213 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi203 running (6m) 52s ago 6m 187M 2240M 18.2.0 dc2bc1663786 6d824001d40c 2024-09-11T00:08:22.213 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (24s) 3s ago 11m 46.6M - 2.43.0 a07b618ecd1d 5b036a30a88c 2024-09-11T00:08:22.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.209+0000 7f5dc4a00700 1 -- 172.21.15.111:0/684522242 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f5da407a480 msgr2=0x7f5da407c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:22.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.209+0000 7f5dc4a00700 1 --2- 172.21.15.111:0/684522242 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f5da407a480 0x7f5da407c930 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5db0009fd0 tx=0x7f5db0005fd0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.209+0000 7f5dc4a00700 1 -- 172.21.15.111:0/684522242 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5dc0101350 msgr2=0x7f5dc0195ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:22.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.209+0000 7f5dc4a00700 1 --2- 172.21.15.111:0/684522242 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5dc0101350 0x7f5dc0195ee0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5da800e920 tx=0x7f5da800ec30 comp rx=0 tx=0).stop 2024-09-11T00:08:22.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.210+0000 7f5dc4a00700 1 -- 172.21.15.111:0/684522242 shutdown_connections 2024-09-11T00:08:22.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.210+0000 7f5dc4a00700 1 --2- 172.21.15.111:0/684522242 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f5da407a480 0x7f5da407c930 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.210+0000 7f5dc4a00700 1 --2- 172.21.15.111:0/684522242 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5dc0100150 0x7f5dc01959a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.210+0000 7f5dc4a00700 1 --2- 172.21.15.111:0/684522242 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5dc0101350 0x7f5dc0195ee0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.210+0000 7f5dc4a00700 1 -- 172.21.15.111:0/684522242 >> 172.21.15.111:0/684522242 conn(0x7f5dc00fb6e0 msgr2=0x7f5dc0104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:22.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.210+0000 7f5dc4a00700 1 -- 172.21.15.111:0/684522242 shutdown_connections 2024-09-11T00:08:22.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.210+0000 7f5dc4a00700 1 -- 172.21.15.111:0/684522242 wait complete. 2024-09-11T00:08:22.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.364+0000 7f6377e00700 1 -- 172.21.15.111:0/3708881970 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6378101190 msgr2=0x7f63781015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:22.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.364+0000 7f6377e00700 1 --2- 172.21.15.111:0/3708881970 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6378101190 0x7f63781015e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6364009910 tx=0x7f6364009c20 comp rx=0 tx=0).stop 2024-09-11T00:08:22.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.364+0000 7f6377e00700 1 -- 172.21.15.111:0/3708881970 shutdown_connections 2024-09-11T00:08:22.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.364+0000 7f6377e00700 1 --2- 172.21.15.111:0/3708881970 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6378101190 0x7f63781015e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.364+0000 7f6377e00700 1 --2- 172.21.15.111:0/3708881970 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f63780fff90 0x7f63781003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.364+0000 7f6377e00700 1 -- 172.21.15.111:0/3708881970 >> 172.21.15.111:0/3708881970 conn(0x7f63780fb500 msgr2=0x7f63780fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:22.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.364+0000 7f6377e00700 1 -- 172.21.15.111:0/3708881970 shutdown_connections 2024-09-11T00:08:22.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.364+0000 7f6377e00700 1 -- 172.21.15.111:0/3708881970 wait complete. 2024-09-11T00:08:22.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.365+0000 7f6377e00700 1 Processor -- start 2024-09-11T00:08:22.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.365+0000 7f6377e00700 1 -- start start 2024-09-11T00:08:22.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.366+0000 7f6377e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f63780fff90 0x7f63781979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:22.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.366+0000 7f6377e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6378101190 0x7f6378197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:22.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.366+0000 7f6377e00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6378198510 con 0x7f63780fff90 2024-09-11T00:08:22.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.366+0000 7f6377e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6378198650 con 0x7f6378101190 2024-09-11T00:08:22.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.366+0000 7f6376a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f63780fff90 0x7f63781979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:22.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.366+0000 7f6376a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f63780fff90 0x7f63781979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45168/0 (socket says 172.21.15.111:45168) 2024-09-11T00:08:22.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.366+0000 7f6376a00700 1 -- 172.21.15.111:0/4086185232 learned_addr learned my addr 172.21.15.111:0/4086185232 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:08:22.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.366+0000 7f6376000700 1 --2- 172.21.15.111:0/4086185232 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6378101190 0x7f6378197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:22.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.366+0000 7f6376a00700 1 -- 172.21.15.111:0/4086185232 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6378101190 msgr2=0x7f6378197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:22.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.366+0000 7f6376a00700 1 --2- 172.21.15.111:0/4086185232 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6378101190 0x7f6378197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.366+0000 7f6376a00700 1 -- 172.21.15.111:0/4086185232 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63640095f0 con 0x7f63780fff90 2024-09-11T00:08:22.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.367+0000 7f6376a00700 1 --2- 172.21.15.111:0/4086185232 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f63780fff90 0x7f63781979b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f636800d900 tx=0x7f636800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:22.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.367+0000 7f636f400700 1 -- 172.21.15.111:0/4086185232 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f636800b920 con 0x7f63780fff90 2024-09-11T00:08:22.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.367+0000 7f636f400700 1 -- 172.21.15.111:0/4086185232 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6368010460 con 0x7f63780fff90 2024-09-11T00:08:22.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.367+0000 7f6377e00700 1 -- 172.21.15.111:0/4086185232 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f637819d100 con 0x7f63780fff90 2024-09-11T00:08:22.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.367+0000 7f636f400700 1 -- 172.21.15.111:0/4086185232 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f636800f590 con 0x7f63780fff90 2024-09-11T00:08:22.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.367+0000 7f6377e00700 1 -- 172.21.15.111:0/4086185232 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f637819d650 con 0x7f63780fff90 2024-09-11T00:08:22.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.368+0000 7f6377e00700 1 -- 172.21.15.111:0/4086185232 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6378105270 con 0x7f63780fff90 2024-09-11T00:08:22.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.369+0000 7f636f400700 1 -- 172.21.15.111:0/4086185232 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 27) v1 ==== 102433+0+0 (secure 0 0 0) 0x7f63680105d0 con 0x7f63780fff90 2024-09-11T00:08:22.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.370+0000 7f636f400700 1 --2- 172.21.15.111:0/4086185232 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f635c07a480 0x7f635c07c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:22.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.370+0000 7f636f400700 1 -- 172.21.15.111:0/4086185232 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f636809cb10 con 0x7f63780fff90 2024-09-11T00:08:22.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.370+0000 7f6376000700 1 --2- 172.21.15.111:0/4086185232 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f635c07a480 0x7f635c07c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:22.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.371+0000 7f6376000700 1 --2- 172.21.15.111:0/4086185232 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f635c07a480 0x7f635c07c930 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6364006010 tx=0x7f636400b560 comp rx=0 tx=0).ready entity=mgr.24469 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:22.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.375+0000 7f636f400700 1 -- 172.21.15.111:0/4086185232 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f6368060640 con 0x7f63780fff90 2024-09-11T00:08:22.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.831+0000 7f6377e00700 1 -- 172.21.15.111:0/4086185232 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f637802cea0 con 0x7f63780fff90 2024-09-11T00:08:22.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.832+0000 7f636f400700 1 -- 172.21.15.111:0/4086185232 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f6368063760 con 0x7f63780fff90 2024-09-11T00:08:22.834 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:08:22.834 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-11T00:08:22.834 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-11T00:08:22.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:08:22.835 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-11T00:08:22.835 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:08:22.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:08:22.835 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-11T00:08:22.835 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-11T00:08:22.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:08:22.835 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-11T00:08:22.835 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-11T00:08:22.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:08:22.835 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-11T00:08:22.836 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-11T00:08:22.836 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:08:22.836 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-11T00:08:22.836 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:08:22.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.835+0000 7f6377e00700 1 -- 172.21.15.111:0/4086185232 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f635c07a480 msgr2=0x7f635c07c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:22.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.835+0000 7f6377e00700 1 --2- 172.21.15.111:0/4086185232 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f635c07a480 0x7f635c07c930 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6364006010 tx=0x7f636400b560 comp rx=0 tx=0).stop 2024-09-11T00:08:22.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.835+0000 7f6377e00700 1 -- 172.21.15.111:0/4086185232 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f63780fff90 msgr2=0x7f63781979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:22.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.835+0000 7f6377e00700 1 --2- 172.21.15.111:0/4086185232 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f63780fff90 0x7f63781979b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f636800d900 tx=0x7f636800dc10 comp rx=0 tx=0).stop 2024-09-11T00:08:22.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.835+0000 7f6377e00700 1 -- 172.21.15.111:0/4086185232 shutdown_connections 2024-09-11T00:08:22.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.835+0000 7f6377e00700 1 --2- 172.21.15.111:0/4086185232 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f635c07a480 0x7f635c07c930 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.835+0000 7f6377e00700 1 --2- 172.21.15.111:0/4086185232 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f63780fff90 0x7f63781979b0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.835+0000 7f6377e00700 1 --2- 172.21.15.111:0/4086185232 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6378101190 0x7f6378197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.835+0000 7f6377e00700 1 -- 172.21.15.111:0/4086185232 >> 172.21.15.111:0/4086185232 conn(0x7f63780fb500 msgr2=0x7f63781023b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:22.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.835+0000 7f6377e00700 1 -- 172.21.15.111:0/4086185232 shutdown_connections 2024-09-11T00:08:22.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.835+0000 7f6377e00700 1 -- 172.21.15.111:0/4086185232 wait complete. 2024-09-11T00:08:22.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.991+0000 7f8d96200700 1 -- 172.21.15.111:0/4085426163 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d90074d80 msgr2=0x7f8d900731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:22.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.991+0000 7f8d96200700 1 --2- 172.21.15.111:0/4085426163 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d90074d80 0x7f8d900731e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8d80009940 tx=0x7f8d80009c50 comp rx=0 tx=0).stop 2024-09-11T00:08:22.994 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:22 smithi111 ceph-mon[27539]: pgmap v39: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 2.2 MiB/s wr, 109 op/s 2024-09-11T00:08:22.994 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:22 smithi111 ceph-mon[27539]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:08:22.994 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:22 smithi111 ceph-mon[27539]: from='client.24559 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:08:22.994 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:22 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/4086185232' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:08:22.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.992+0000 7f8d96200700 1 -- 172.21.15.111:0/4085426163 shutdown_connections 2024-09-11T00:08:22.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.992+0000 7f8d96200700 1 --2- 172.21.15.111:0/4085426163 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d900737b0 0x7f8d90073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.992+0000 7f8d96200700 1 --2- 172.21.15.111:0/4085426163 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d90074d80 0x7f8d900731e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.992+0000 7f8d96200700 1 -- 172.21.15.111:0/4085426163 >> 172.21.15.111:0/4085426163 conn(0x7f8d900fb6e0 msgr2=0x7f8d900fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:22.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.992+0000 7f8d96200700 1 -- 172.21.15.111:0/4085426163 shutdown_connections 2024-09-11T00:08:22.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.992+0000 7f8d96200700 1 -- 172.21.15.111:0/4085426163 wait complete. 2024-09-11T00:08:22.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.994+0000 7f8d96200700 1 Processor -- start 2024-09-11T00:08:22.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.994+0000 7f8d96200700 1 -- start start 2024-09-11T00:08:22.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.995+0000 7f8d96200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d900737b0 0x7f8d90197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:22.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.995+0000 7f8d96200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d90074d80 0x7f8d90198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:22.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.995+0000 7f8d96200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d90198670 con 0x7f8d90074d80 2024-09-11T00:08:22.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.995+0000 7f8d96200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d901987b0 con 0x7f8d900737b0 2024-09-11T00:08:22.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.995+0000 7f8d8ea00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d90074d80 0x7f8d90198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:22.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.995+0000 7f8d8f400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d900737b0 0x7f8d90197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:22.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.995+0000 7f8d8f400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d900737b0 0x7f8d90197b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.111:57014/0 (socket says 172.21.15.111:57014) 2024-09-11T00:08:22.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.995+0000 7f8d8f400700 1 -- 172.21.15.111:0/538525882 learned_addr learned my addr 172.21.15.111:0/538525882 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:08:22.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.995+0000 7f8d8ea00700 1 -- 172.21.15.111:0/538525882 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d900737b0 msgr2=0x7f8d90197b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:22.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.996+0000 7f8d8ea00700 1 --2- 172.21.15.111:0/538525882 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d900737b0 0x7f8d90197b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.996+0000 7f8d8ea00700 1 -- 172.21.15.111:0/538525882 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d800095f0 con 0x7f8d90074d80 2024-09-11T00:08:22.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.996+0000 7f8d8ea00700 1 --2- 172.21.15.111:0/538525882 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d90074d80 0x7f8d90198050 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c00e970 tx=0x7f8d7c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:22.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.996+0000 7f8d87e00700 1 -- 172.21.15.111:0/538525882 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d7c00c9d0 con 0x7f8d90074d80 2024-09-11T00:08:22.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.996+0000 7f8d87e00700 1 -- 172.21.15.111:0/538525882 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8d7c010430 con 0x7f8d90074d80 2024-09-11T00:08:22.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.996+0000 7f8d87e00700 1 -- 172.21.15.111:0/538525882 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d7c018650 con 0x7f8d90074d80 2024-09-11T00:08:22.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.996+0000 7f8d96200700 1 -- 172.21.15.111:0/538525882 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d9019d260 con 0x7f8d90074d80 2024-09-11T00:08:22.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.996+0000 7f8d96200700 1 -- 172.21.15.111:0/538525882 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d9019d7b0 con 0x7f8d90074d80 2024-09-11T00:08:23.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:22.998+0000 7f8d96200700 1 -- 172.21.15.111:0/538525882 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d9010ae90 con 0x7f8d90074d80 2024-09-11T00:08:23.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:23.000+0000 7f8d87e00700 1 -- 172.21.15.111:0/538525882 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 27) v1 ==== 102433+0+0 (secure 0 0 0) 0x7f8d7c0105a0 con 0x7f8d90074d80 2024-09-11T00:08:23.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:23.002+0000 7f8d87e00700 1 --2- 172.21.15.111:0/538525882 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f8d7407a490 0x7f8d7407c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:23.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:23.002+0000 7f8d87e00700 1 -- 172.21.15.111:0/538525882 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f8d7c014070 con 0x7f8d90074d80 2024-09-11T00:08:23.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:23.002+0000 7f8d8f400700 1 --2- 172.21.15.111:0/538525882 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f8d7407a490 0x7f8d7407c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:23.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:23.003+0000 7f8d8f400700 1 --2- 172.21.15.111:0/538525882 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f8d7407a490 0x7f8d7407c940 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8d8000b670 tx=0x7f8d8000b5a0 comp rx=0 tx=0).ready entity=mgr.24469 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:23.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:23.006+0000 7f8d87e00700 1 -- 172.21.15.111:0/538525882 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f8d7c060d80 con 0x7f8d90074d80 2024-09-11T00:08:23.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:23.287+0000 7f8d96200700 1 -- 172.21.15.111:0/538525882 --> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d90107650 con 0x7f8d7407a490 2024-09-11T00:08:23.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:23.289+0000 7f8d87e00700 1 -- 172.21.15.111:0/538525882 <== mgr.24469 v2:172.21.15.203:6828/1203435425 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f8d90107650 con 0x7f8d7407a490 2024-09-11T00:08:23.291 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:08:23.291 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e", 2024-09-11T00:08:23.291 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-11T00:08:23.291 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-11T00:08:23.291 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-11T00:08:23.291 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr" 2024-09-11T00:08:23.291 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-11T00:08:23.291 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "2/2 daemons upgraded", 2024-09-11T00:08:23.291 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading mgr daemons", 2024-09-11T00:08:23.291 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-11T00:08:23.291 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:08:23.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:23.292+0000 7f8d96200700 1 -- 172.21.15.111:0/538525882 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f8d7407a490 msgr2=0x7f8d7407c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:23.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:23.292+0000 7f8d96200700 1 --2- 172.21.15.111:0/538525882 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f8d7407a490 0x7f8d7407c940 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8d8000b670 tx=0x7f8d8000b5a0 comp rx=0 tx=0).stop 2024-09-11T00:08:23.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:23.292+0000 7f8d96200700 1 -- 172.21.15.111:0/538525882 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d90074d80 msgr2=0x7f8d90198050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:23.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:23.292+0000 7f8d96200700 1 --2- 172.21.15.111:0/538525882 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d90074d80 0x7f8d90198050 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c00e970 tx=0x7f8d7c00ec80 comp rx=0 tx=0).stop 2024-09-11T00:08:23.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:23.292+0000 7f8d96200700 1 -- 172.21.15.111:0/538525882 shutdown_connections 2024-09-11T00:08:23.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:23.292+0000 7f8d96200700 1 --2- 172.21.15.111:0/538525882 >> [v2:172.21.15.203:6828/1203435425,v1:172.21.15.203:6829/1203435425] conn(0x7f8d7407a490 0x7f8d7407c940 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:23.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:23.292+0000 7f8d96200700 1 --2- 172.21.15.111:0/538525882 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d900737b0 0x7f8d90197b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:23.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:23.292+0000 7f8d96200700 1 --2- 172.21.15.111:0/538525882 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d90074d80 0x7f8d90198050 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:23.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:23.292+0000 7f8d96200700 1 -- 172.21.15.111:0/538525882 >> 172.21.15.111:0/538525882 conn(0x7f8d900fb6e0 msgr2=0x7f8d90105f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:23.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:23.292+0000 7f8d96200700 1 -- 172.21.15.111:0/538525882 shutdown_connections 2024-09-11T00:08:23.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:23.292+0000 7f8d96200700 1 -- 172.21.15.111:0/538525882 wait complete. 2024-09-11T00:08:23.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:22 smithi203 ceph-mon[33225]: pgmap v39: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 2.2 MiB/s wr, 109 op/s 2024-09-11T00:08:23.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:22 smithi203 ceph-mon[33225]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:08:23.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:22 smithi203 ceph-mon[33225]: from='client.24559 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:08:23.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:22 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/4086185232' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:08:24.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:23 smithi111 ceph-mon[27539]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:08:24.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:23 smithi203 ceph-mon[33225]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:08:25.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:24 smithi203 ceph-mon[33225]: pgmap v40: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.5 MiB/s wr, 66 op/s 2024-09-11T00:08:25.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:24 smithi203 ceph-mon[33225]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:08:25.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:24 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:25.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:24 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:25.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:24 smithi111 ceph-mon[27539]: pgmap v40: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.5 MiB/s wr, 66 op/s 2024-09-11T00:08:25.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:24 smithi111 ceph-mon[27539]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:08:25.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:24 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:25.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:24 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:27.182 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:26 smithi111 ceph-mon[27539]: pgmap v41: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.5 MiB/s wr, 66 op/s 2024-09-11T00:08:27.182 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:26 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:08:27.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:26 smithi203 ceph-mon[33225]: pgmap v41: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.5 MiB/s wr, 66 op/s 2024-09-11T00:08:27.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:26 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:08:29.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:28 smithi203 ceph-mon[33225]: pgmap v42: 65 pgs: 65 active+clean; 311 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 2.1 MiB/s wr, 110 op/s 2024-09-11T00:08:29.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:28 smithi111 ceph-mon[27539]: pgmap v42: 65 pgs: 65 active+clean; 311 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 2.1 MiB/s wr, 110 op/s 2024-09-11T00:08:31.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:30 smithi203 ceph-mon[33225]: pgmap v43: 65 pgs: 65 active+clean; 311 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 75 op/s 2024-09-11T00:08:31.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:30 smithi111 ceph-mon[27539]: pgmap v43: 65 pgs: 65 active+clean; 311 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 75 op/s 2024-09-11T00:08:33.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:32 smithi203 ceph-mon[33225]: pgmap v44: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 2.2 MiB/s wr, 115 op/s 2024-09-11T00:08:33.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:32 smithi111 ceph-mon[27539]: pgmap v44: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 2.2 MiB/s wr, 115 op/s 2024-09-11T00:08:35.127 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:34 smithi203 ceph-mon[33225]: pgmap v45: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.4 MiB/s wr, 85 op/s 2024-09-11T00:08:35.127 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:34 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:35.127 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:34 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:35.137 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:34 smithi111 ceph-mon[27539]: pgmap v45: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.4 MiB/s wr, 85 op/s 2024-09-11T00:08:35.137 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:34 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:35.137 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:34 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:36.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:35 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:08:36.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:35 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:08:36.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:35 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:36.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:35 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:08:36.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:35 smithi111 ceph-mon[27539]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "mgr fail", "who": "smithi203.smuspl"}]: dispatch 2024-09-11T00:08:36.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:35 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "mgr fail", "who": "smithi203.smuspl"}]: dispatch 2024-09-11T00:08:36.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:35 smithi111 ceph-mon[27539]: osdmap e49: 6 total, 6 up, 6 in 2024-09-11T00:08:36.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:35 smithi111 ceph-mon[27539]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' cmd='[{"prefix": "mgr fail", "who": "smithi203.smuspl"}]': finished 2024-09-11T00:08:36.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:35 smithi111 ceph-mon[27539]: mgrmap e28: smithi111.ypucji(active, starting, since 0.00758101s) 2024-09-11T00:08:36.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:35 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-11T00:08:36.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:35 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-09-11T00:08:36.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:35 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.rucaba"}]: dispatch 2024-09-11T00:08:36.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:35 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.gmgsay"}]: dispatch 2024-09-11T00:08:36.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:35 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.tcrqop"}]: dispatch 2024-09-11T00:08:36.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:35 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.uqkbkn"}]: dispatch 2024-09-11T00:08:36.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:35 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mgr metadata", "who": "smithi111.ypucji", "id": "smithi111.ypucji"}]: dispatch 2024-09-11T00:08:36.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:35 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T00:08:36.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:35 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T00:08:36.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:35 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T00:08:36.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:35 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T00:08:36.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:35 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T00:08:36.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:35 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T00:08:36.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:35 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T00:08:36.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:35 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T00:08:36.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:35 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T00:08:36.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:35 smithi111 ceph-mon[27539]: Manager daemon smithi111.ypucji is now available 2024-09-11T00:08:36.171 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:35 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:08:36.171 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:35 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:08:36.171 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:35 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' 2024-09-11T00:08:36.171 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:35 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:08:36.171 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:35 smithi203 ceph-mon[33225]: from='mgr.24469 172.21.15.203:0/2097010839' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "mgr fail", "who": "smithi203.smuspl"}]: dispatch 2024-09-11T00:08:36.171 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:35 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "mgr fail", "who": "smithi203.smuspl"}]: dispatch 2024-09-11T00:08:36.171 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:35 smithi203 ceph-mon[33225]: osdmap e49: 6 total, 6 up, 6 in 2024-09-11T00:08:36.172 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:35 smithi203 ceph-mon[33225]: from='mgr.24469 ' entity='mgr.smithi203.smuspl' cmd='[{"prefix": "mgr fail", "who": "smithi203.smuspl"}]': finished 2024-09-11T00:08:36.172 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:35 smithi203 ceph-mon[33225]: mgrmap e28: smithi111.ypucji(active, starting, since 0.00758101s) 2024-09-11T00:08:36.172 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:35 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-11T00:08:36.172 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:35 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-09-11T00:08:36.172 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:35 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.rucaba"}]: dispatch 2024-09-11T00:08:36.172 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:35 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.gmgsay"}]: dispatch 2024-09-11T00:08:36.172 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:35 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.tcrqop"}]: dispatch 2024-09-11T00:08:36.172 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:35 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.uqkbkn"}]: dispatch 2024-09-11T00:08:36.172 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:35 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mgr metadata", "who": "smithi111.ypucji", "id": "smithi111.ypucji"}]: dispatch 2024-09-11T00:08:36.172 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:35 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T00:08:36.172 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:35 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T00:08:36.172 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:35 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T00:08:36.172 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:35 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T00:08:36.173 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:35 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T00:08:36.173 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:35 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T00:08:36.173 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:35 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T00:08:36.173 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:35 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T00:08:36.173 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:35 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T00:08:36.173 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:35 smithi203 ceph-mon[33225]: Manager daemon smithi111.ypucji is now available 2024-09-11T00:08:37.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:36 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:08:37.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:36 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:08:37.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:36 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-11T00:08:37.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:36 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.ypucji/mirror_snapshot_schedule"}]: dispatch 2024-09-11T00:08:37.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:36 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.ypucji/trash_purge_schedule"}]: dispatch 2024-09-11T00:08:37.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:36 smithi111 ceph-mon[27539]: mgrmap e29: smithi111.ypucji(active, since 1.01483s) 2024-09-11T00:08:37.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:36 smithi111 ceph-mon[27539]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-11T00:08:37.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:36 smithi111 ceph-mon[27539]: pgmap v3: 65 pgs: 65 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:08:37.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:36 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:08:37.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:36 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:08:37.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:36 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-11T00:08:37.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:36 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.ypucji/mirror_snapshot_schedule"}]: dispatch 2024-09-11T00:08:37.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:36 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.ypucji/trash_purge_schedule"}]: dispatch 2024-09-11T00:08:37.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:36 smithi203 ceph-mon[33225]: mgrmap e29: smithi111.ypucji(active, since 1.01483s) 2024-09-11T00:08:37.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:36 smithi203 ceph-mon[33225]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-11T00:08:37.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:36 smithi203 ceph-mon[33225]: pgmap v3: 65 pgs: 65 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:08:38.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:38 smithi203 ceph-mon[33225]: [11/Sep/2024:00:08:36] ENGINE Bus STARTING 2024-09-11T00:08:38.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:38 smithi203 ceph-mon[33225]: [11/Sep/2024:00:08:36] ENGINE Serving on https://172.21.15.111:7150 2024-09-11T00:08:38.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:38 smithi203 ceph-mon[33225]: [11/Sep/2024:00:08:36] ENGINE Error in HTTPServer.serve 2024-09-11T00:08:38.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Traceback (most recent call last): 2024-09-11T00:08:38.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T00:08:38.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: self._connections.run(self.expiration_interval) 2024-09-11T00:08:38.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T00:08:38.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: self._run(expiration_interval) 2024-09-11T00:08:38.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T00:08:38.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T00:08:38.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T00:08:38.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T00:08:38.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T00:08:38.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: s = self.context.wrap_socket( 2024-09-11T00:08:38.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T00:08:38.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: return self.sslsocket_class._create( 2024-09-11T00:08:38.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T00:08:38.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: self.do_handshake() 2024-09-11T00:08:38.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T00:08:38.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: self._sslobj.do_handshake() 2024-09-11T00:08:38.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T00:08:38.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:38 smithi203 ceph-mon[33225]: [11/Sep/2024:00:08:36] ENGINE Serving on http://172.21.15.111:8765 2024-09-11T00:08:38.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:38 smithi203 ceph-mon[33225]: [11/Sep/2024:00:08:36] ENGINE Bus STARTED 2024-09-11T00:08:38.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:38 smithi203 ceph-mon[33225]: pgmap v4: 65 pgs: 65 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:08:38.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:38 smithi111 ceph-mon[27539]: [11/Sep/2024:00:08:36] ENGINE Bus STARTING 2024-09-11T00:08:38.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:38 smithi111 ceph-mon[27539]: [11/Sep/2024:00:08:36] ENGINE Serving on https://172.21.15.111:7150 2024-09-11T00:08:38.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:38 smithi111 ceph-mon[27539]: [11/Sep/2024:00:08:36] ENGINE Error in HTTPServer.serve 2024-09-11T00:08:38.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Traceback (most recent call last): 2024-09-11T00:08:38.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T00:08:38.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self._connections.run(self.expiration_interval) 2024-09-11T00:08:38.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T00:08:38.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self._run(expiration_interval) 2024-09-11T00:08:38.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T00:08:38.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T00:08:38.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T00:08:38.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T00:08:38.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T00:08:38.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: s = self.context.wrap_socket( 2024-09-11T00:08:38.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T00:08:38.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: return self.sslsocket_class._create( 2024-09-11T00:08:38.404 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T00:08:38.404 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self.do_handshake() 2024-09-11T00:08:38.404 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T00:08:38.404 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self._sslobj.do_handshake() 2024-09-11T00:08:38.404 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T00:08:38.404 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:38 smithi111 ceph-mon[27539]: [11/Sep/2024:00:08:36] ENGINE Serving on http://172.21.15.111:8765 2024-09-11T00:08:38.404 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:38 smithi111 ceph-mon[27539]: [11/Sep/2024:00:08:36] ENGINE Bus STARTED 2024-09-11T00:08:38.404 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:38 smithi111 ceph-mon[27539]: pgmap v4: 65 pgs: 65 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:08:39.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:39 smithi111 ceph-mon[27539]: mgrmap e30: smithi111.ypucji(active, since 3s) 2024-09-11T00:08:39.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:39 smithi203 ceph-mon[33225]: mgrmap e30: smithi111.ypucji(active, since 3s) 2024-09-11T00:08:40.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:40 smithi203 ceph-mon[33225]: pgmap v5: 65 pgs: 65 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:08:40.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:40 smithi111 ceph-mon[27539]: pgmap v5: 65 pgs: 65 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:08:41.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:41 smithi203 ceph-mon[33225]: mgrmap e31: smithi111.ypucji(active, since 5s) 2024-09-11T00:08:41.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:41 smithi111 ceph-mon[27539]: mgrmap e31: smithi111.ypucji(active, since 5s) 2024-09-11T00:08:42.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:42 smithi111 ceph-mon[27539]: pgmap v6: 65 pgs: 65 active+clean; 302 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 549 KiB/s wr, 169 op/s 2024-09-11T00:08:42.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:42 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:42.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:42 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:42.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:42 smithi203 ceph-mon[33225]: pgmap v6: 65 pgs: 65 active+clean; 302 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 549 KiB/s wr, 169 op/s 2024-09-11T00:08:42.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:42 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:42.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:42 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:44.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:44 smithi203 ceph-mon[33225]: pgmap v7: 65 pgs: 65 active+clean; 305 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 55 KiB/s rd, 1.3 MiB/s wr, 251 op/s 2024-09-11T00:08:44.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:44 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:44.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:44 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:44.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:44 smithi203 ceph-mon[33225]: Standby manager daemon smithi203.smuspl started 2024-09-11T00:08:44.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:44 smithi203 ceph-mon[33225]: from='mgr.? 172.21.15.203:0/4099040093' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.smuspl/crt"}]: dispatch 2024-09-11T00:08:44.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:44 smithi203 ceph-mon[33225]: from='mgr.? 172.21.15.203:0/4099040093' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T00:08:44.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:44 smithi203 ceph-mon[33225]: from='mgr.? 172.21.15.203:0/4099040093' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.smuspl/key"}]: dispatch 2024-09-11T00:08:44.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:44 smithi203 ceph-mon[33225]: from='mgr.? 172.21.15.203:0/4099040093' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T00:08:44.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:44 smithi111 ceph-mon[27539]: pgmap v7: 65 pgs: 65 active+clean; 305 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 55 KiB/s rd, 1.3 MiB/s wr, 251 op/s 2024-09-11T00:08:44.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:44 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:44.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:44 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:44.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:44 smithi111 ceph-mon[27539]: Standby manager daemon smithi203.smuspl started 2024-09-11T00:08:44.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:44 smithi111 ceph-mon[27539]: from='mgr.? 172.21.15.203:0/4099040093' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.smuspl/crt"}]: dispatch 2024-09-11T00:08:44.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:44 smithi111 ceph-mon[27539]: from='mgr.? 172.21.15.203:0/4099040093' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T00:08:44.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:44 smithi111 ceph-mon[27539]: from='mgr.? 172.21.15.203:0/4099040093' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.smuspl/key"}]: dispatch 2024-09-11T00:08:44.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:44 smithi111 ceph-mon[27539]: from='mgr.? 172.21.15.203:0/4099040093' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T00:08:45.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:45 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:45.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:45 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:45.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:45 smithi203 ceph-mon[33225]: mgrmap e32: smithi111.ypucji(active, since 9s), standbys: smithi203.smuspl 2024-09-11T00:08:45.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:45 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mgr metadata", "who": "smithi203.smuspl", "id": "smithi203.smuspl"}]: dispatch 2024-09-11T00:08:45.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:45 smithi203 ceph-mon[33225]: pgmap v8: 65 pgs: 65 active+clean; 305 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 1.0 MiB/s wr, 195 op/s 2024-09-11T00:08:45.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:45 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:45.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:45 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:45.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:45 smithi111 ceph-mon[27539]: mgrmap e32: smithi111.ypucji(active, since 9s), standbys: smithi203.smuspl 2024-09-11T00:08:45.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:45 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mgr metadata", "who": "smithi203.smuspl", "id": "smithi203.smuspl"}]: dispatch 2024-09-11T00:08:45.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:45 smithi111 ceph-mon[27539]: pgmap v8: 65 pgs: 65 active+clean; 305 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 1.0 MiB/s wr, 195 op/s 2024-09-11T00:08:47.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:46 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:47.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:46 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:47.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:46 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:47.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:46 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:48.096 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:47 smithi111 ceph-mon[27539]: pgmap v9: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48 KiB/s rd, 1.6 MiB/s wr, 277 op/s 2024-09-11T00:08:48.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:47 smithi203 ceph-mon[33225]: pgmap v9: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48 KiB/s rd, 1.6 MiB/s wr, 277 op/s 2024-09-11T00:08:50.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:49 smithi203 ceph-mon[33225]: pgmap v10: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 1.4 MiB/s wr, 254 op/s 2024-09-11T00:08:50.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:49 smithi111 ceph-mon[27539]: pgmap v10: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 1.4 MiB/s wr, 254 op/s 2024-09-11T00:08:51.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:50 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:51.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:50 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:51.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:50 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:08:51.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:50 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:08:51.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:50 smithi203 ceph-mon[33225]: Updating smithi111:/etc/ceph/ceph.conf 2024-09-11T00:08:51.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:50 smithi203 ceph-mon[33225]: Updating smithi203:/etc/ceph/ceph.conf 2024-09-11T00:08:51.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:50 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:08:51.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:50 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:51.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:50 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:51.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:50 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:08:51.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:50 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:08:51.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:50 smithi111 ceph-mon[27539]: Updating smithi111:/etc/ceph/ceph.conf 2024-09-11T00:08:51.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:50 smithi111 ceph-mon[27539]: Updating smithi203:/etc/ceph/ceph.conf 2024-09-11T00:08:51.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:50 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:08:52.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:51 smithi203 ceph-mon[33225]: Updating smithi111:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:08:52.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:51 smithi203 ceph-mon[33225]: Updating smithi203:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:08:52.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:51 smithi203 ceph-mon[33225]: Updating smithi111:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:08:52.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:51 smithi203 ceph-mon[33225]: pgmap v11: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 56 KiB/s rd, 1.8 MiB/s wr, 314 op/s 2024-09-11T00:08:52.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:51 smithi111 ceph-mon[27539]: Updating smithi111:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:08:52.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:51 smithi111 ceph-mon[27539]: Updating smithi203:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:08:52.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:51 smithi111 ceph-mon[27539]: Updating smithi111:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:08:52.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:51 smithi111 ceph-mon[27539]: pgmap v11: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 56 KiB/s rd, 1.8 MiB/s wr, 314 op/s 2024-09-11T00:08:53.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:53 smithi203 ceph-mon[33225]: Updating smithi111:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:08:53.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:53 smithi203 ceph-mon[33225]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:08:53.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:53 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:53.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:53 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:53.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:53 smithi111 ceph-mon[27539]: Updating smithi111:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:08:53.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:53 smithi111 ceph-mon[27539]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:08:53.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:53 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:53.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:53 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:53.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.450+0000 7ff05fa00700 1 -- 172.21.15.111:0/257419454 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff058100150 msgr2=0x7ff058100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:53.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.450+0000 7ff05fa00700 1 --2- 172.21.15.111:0/257419454 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff058100150 0x7ff058100560 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff04c009910 tx=0x7ff04c009c20 comp rx=0 tx=0).stop 2024-09-11T00:08:53.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.450+0000 7ff05fa00700 1 -- 172.21.15.111:0/257419454 shutdown_connections 2024-09-11T00:08:53.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.450+0000 7ff05fa00700 1 --2- 172.21.15.111:0/257419454 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff058101350 0x7ff0581017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.450+0000 7ff05fa00700 1 --2- 172.21.15.111:0/257419454 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff058100150 0x7ff058100560 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.450+0000 7ff05fa00700 1 -- 172.21.15.111:0/257419454 >> 172.21.15.111:0/257419454 conn(0x7ff0580fb6e0 msgr2=0x7ff0580fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:53.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.450+0000 7ff05fa00700 1 -- 172.21.15.111:0/257419454 shutdown_connections 2024-09-11T00:08:53.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.450+0000 7ff05fa00700 1 -- 172.21.15.111:0/257419454 wait complete. 2024-09-11T00:08:53.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.452+0000 7ff05fa00700 1 Processor -- start 2024-09-11T00:08:53.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.452+0000 7ff05fa00700 1 -- start start 2024-09-11T00:08:53.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.452+0000 7ff05fa00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff058100150 0x7ff058074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:53.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.452+0000 7ff05fa00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff058101350 0x7ff058073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:53.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.452+0000 7ff05fa00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff058073680 con 0x7ff058101350 2024-09-11T00:08:53.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.452+0000 7ff05fa00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0580737c0 con 0x7ff058100150 2024-09-11T00:08:53.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.453+0000 7ff05d000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff058100150 0x7ff058074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:53.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.453+0000 7ff05d000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff058100150 0x7ff058074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.111:37876/0 (socket says 172.21.15.111:37876) 2024-09-11T00:08:53.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.453+0000 7ff05d000700 1 -- 172.21.15.111:0/2030032627 learned_addr learned my addr 172.21.15.111:0/2030032627 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:08:53.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.453+0000 7ff057e00700 1 --2- 172.21.15.111:0/2030032627 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff058101350 0x7ff058073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:53.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.453+0000 7ff05d000700 1 -- 172.21.15.111:0/2030032627 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff058101350 msgr2=0x7ff058073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:53.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.453+0000 7ff05d000700 1 --2- 172.21.15.111:0/2030032627 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff058101350 0x7ff058073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.453+0000 7ff05d000700 1 -- 172.21.15.111:0/2030032627 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04c0095f0 con 0x7ff058100150 2024-09-11T00:08:53.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.453+0000 7ff05d000700 1 --2- 172.21.15.111:0/2030032627 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff058100150 0x7ff058074af0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff04c00f690 tx=0x7ff04c00f6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:53.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.454+0000 7ff055600700 1 -- 172.21.15.111:0/2030032627 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff04c01d070 con 0x7ff058100150 2024-09-11T00:08:53.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.454+0000 7ff05fa00700 1 -- 172.21.15.111:0/2030032627 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff058073a40 con 0x7ff058100150 2024-09-11T00:08:53.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.454+0000 7ff055600700 1 -- 172.21.15.111:0/2030032627 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff04c005dc0 con 0x7ff058100150 2024-09-11T00:08:53.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.454+0000 7ff055600700 1 -- 172.21.15.111:0/2030032627 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff04c017630 con 0x7ff058100150 2024-09-11T00:08:53.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.454+0000 7ff05fa00700 1 -- 172.21.15.111:0/2030032627 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff058073f30 con 0x7ff058100150 2024-09-11T00:08:53.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.455+0000 7ff05fa00700 1 -- 172.21.15.111:0/2030032627 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff058108ca0 con 0x7ff058100150 2024-09-11T00:08:53.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.456+0000 7ff055600700 1 -- 172.21.15.111:0/2030032627 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 32) v1 ==== 102433+0+0 (secure 0 0 0) 0x7ff04c003910 con 0x7ff058100150 2024-09-11T00:08:53.459 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.457+0000 7ff055600700 1 --2- 172.21.15.111:0/2030032627 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7ff04007a480 0x7ff04007c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:53.459 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.457+0000 7ff055600700 1 -- 172.21.15.111:0/2030032627 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7ff04c09e4a0 con 0x7ff058100150 2024-09-11T00:08:53.459 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.457+0000 7ff057e00700 1 --2- 172.21.15.111:0/2030032627 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7ff04007a480 0x7ff04007c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:53.460 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.458+0000 7ff057e00700 1 --2- 172.21.15.111:0/2030032627 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7ff04007a480 0x7ff04007c930 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff044009c60 tx=0x7ff044009260 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:53.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.463+0000 7ff055600700 1 -- 172.21.15.111:0/2030032627 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7ff04c061e00 con 0x7ff058100150 2024-09-11T00:08:53.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.771+0000 7ff05fa00700 1 -- 172.21.15.111:0/2030032627 --> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff058105ca0 con 0x7ff04007a480 2024-09-11T00:08:53.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.794+0000 7ff055600700 1 -- 172.21.15.111:0/2030032627 <== mgr.14744 v2:172.21.15.111:6800/3952658086 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7ff058105ca0 con 0x7ff04007a480 2024-09-11T00:08:53.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.800+0000 7ff05fa00700 1 -- 172.21.15.111:0/2030032627 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7ff04007a480 msgr2=0x7ff04007c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:53.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.800+0000 7ff05fa00700 1 --2- 172.21.15.111:0/2030032627 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7ff04007a480 0x7ff04007c930 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff044009c60 tx=0x7ff044009260 comp rx=0 tx=0).stop 2024-09-11T00:08:53.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.800+0000 7ff05fa00700 1 -- 172.21.15.111:0/2030032627 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff058100150 msgr2=0x7ff058074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:53.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.800+0000 7ff05fa00700 1 --2- 172.21.15.111:0/2030032627 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff058100150 0x7ff058074af0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff04c00f690 tx=0x7ff04c00f6c0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.800+0000 7ff05fa00700 1 -- 172.21.15.111:0/2030032627 shutdown_connections 2024-09-11T00:08:53.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.800+0000 7ff05fa00700 1 --2- 172.21.15.111:0/2030032627 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7ff04007a480 0x7ff04007c930 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.800+0000 7ff05fa00700 1 --2- 172.21.15.111:0/2030032627 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff058100150 0x7ff058074af0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.800+0000 7ff05fa00700 1 --2- 172.21.15.111:0/2030032627 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff058101350 0x7ff058073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.800+0000 7ff05fa00700 1 -- 172.21.15.111:0/2030032627 >> 172.21.15.111:0/2030032627 conn(0x7ff0580fb6e0 msgr2=0x7ff058104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:53.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.801+0000 7ff05fa00700 1 -- 172.21.15.111:0/2030032627 shutdown_connections 2024-09-11T00:08:53.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.801+0000 7ff05fa00700 1 -- 172.21.15.111:0/2030032627 wait complete. 2024-09-11T00:08:53.833 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:08:53.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.978+0000 7f2ce5600700 1 -- 172.21.15.111:0/1695385229 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2ce0101350 msgr2=0x7f2ce01017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:53.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.978+0000 7f2ce5600700 1 --2- 172.21.15.111:0/1695385229 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2ce0101350 0x7f2ce01017a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc009910 tx=0x7f2ccc009c20 comp rx=0 tx=0).stop 2024-09-11T00:08:53.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.978+0000 7f2ce5600700 1 -- 172.21.15.111:0/1695385229 shutdown_connections 2024-09-11T00:08:53.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.978+0000 7f2ce5600700 1 --2- 172.21.15.111:0/1695385229 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2ce0101350 0x7f2ce01017a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.978+0000 7f2ce5600700 1 --2- 172.21.15.111:0/1695385229 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ce0100150 0x7f2ce0100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.978+0000 7f2ce5600700 1 -- 172.21.15.111:0/1695385229 >> 172.21.15.111:0/1695385229 conn(0x7f2ce00fb6e0 msgr2=0x7f2ce00fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:53.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.978+0000 7f2ce5600700 1 -- 172.21.15.111:0/1695385229 shutdown_connections 2024-09-11T00:08:53.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.978+0000 7f2ce5600700 1 -- 172.21.15.111:0/1695385229 wait complete. 2024-09-11T00:08:53.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.979+0000 7f2ce5600700 1 Processor -- start 2024-09-11T00:08:53.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.979+0000 7f2ce5600700 1 -- start start 2024-09-11T00:08:53.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.980+0000 7f2ce5600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ce0100150 0x7f2ce0195960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:53.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.980+0000 7f2ce5600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2ce0101350 0x7f2ce0195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:53.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.980+0000 7f2ce5600700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce01964c0 con 0x7f2ce0101350 2024-09-11T00:08:53.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.980+0000 7f2ce5600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce0196600 con 0x7f2ce0100150 2024-09-11T00:08:53.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.980+0000 7f2cdea00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ce0100150 0x7f2ce0195960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:53.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.980+0000 7f2cde000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2ce0101350 0x7f2ce0195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:53.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.980+0000 7f2cdea00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ce0100150 0x7f2ce0195960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.111:37880/0 (socket says 172.21.15.111:37880) 2024-09-11T00:08:53.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.980+0000 7f2cdea00700 1 -- 172.21.15.111:0/3633616520 learned_addr learned my addr 172.21.15.111:0/3633616520 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:08:53.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.981+0000 7f2cde000700 1 -- 172.21.15.111:0/3633616520 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ce0100150 msgr2=0x7f2ce0195960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:53.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.981+0000 7f2cde000700 1 --2- 172.21.15.111:0/3633616520 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ce0100150 0x7f2ce0195960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.981+0000 7f2cde000700 1 -- 172.21.15.111:0/3633616520 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ccc0095f0 con 0x7f2ce0101350 2024-09-11T00:08:53.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.981+0000 7f2cdea00700 1 --2- 172.21.15.111:0/3633616520 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ce0100150 0x7f2ce0195960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:08:53.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.981+0000 7f2cde000700 1 --2- 172.21.15.111:0/3633616520 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2ce0101350 0x7f2ce0195ea0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc000c00 tx=0x7f2ccc00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:53.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.982+0000 7f2cd7400700 1 -- 172.21.15.111:0/3633616520 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ccc021070 con 0x7f2ce0101350 2024-09-11T00:08:53.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.982+0000 7f2cd7400700 1 -- 172.21.15.111:0/3633616520 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2ccc005dc0 con 0x7f2ce0101350 2024-09-11T00:08:53.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.982+0000 7f2cd7400700 1 -- 172.21.15.111:0/3633616520 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ccc00f7d0 con 0x7f2ce0101350 2024-09-11T00:08:53.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.982+0000 7f2ce5600700 1 -- 172.21.15.111:0/3633616520 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce0072f80 con 0x7f2ce0101350 2024-09-11T00:08:53.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.982+0000 7f2ce5600700 1 -- 172.21.15.111:0/3633616520 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce0073470 con 0x7f2ce0101350 2024-09-11T00:08:53.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.983+0000 7f2ce5600700 1 -- 172.21.15.111:0/3633616520 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce0108ca0 con 0x7f2ce0101350 2024-09-11T00:08:53.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.985+0000 7f2cd7400700 1 -- 172.21.15.111:0/3633616520 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 32) v1 ==== 102433+0+0 (secure 0 0 0) 0x7f2ccc003bc0 con 0x7f2ce0101350 2024-09-11T00:08:53.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.986+0000 7f2cd7400700 1 --2- 172.21.15.111:0/3633616520 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f2cc407a480 0x7f2cc407c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:53.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.986+0000 7f2cd7400700 1 -- 172.21.15.111:0/3633616520 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f2ccc0a2490 con 0x7f2ce0101350 2024-09-11T00:08:53.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.986+0000 7f2cdea00700 1 --2- 172.21.15.111:0/3633616520 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f2cc407a480 0x7f2cc407c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:53.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.987+0000 7f2cdea00700 1 --2- 172.21.15.111:0/3633616520 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f2cc407a480 0x7f2cc407c930 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0007fd0 tx=0x7f2cd0007480 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:53.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:53.997+0000 7f2cd7400700 1 -- 172.21.15.111:0/3633616520 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f2ccc065f10 con 0x7f2ce0101350 2024-09-11T00:08:54.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.288+0000 7f2ce5600700 1 -- 172.21.15.111:0/3633616520 --> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ce0105ca0 con 0x7f2cc407a480 2024-09-11T00:08:54.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.290+0000 7f2cd7400700 1 -- 172.21.15.111:0/3633616520 <== mgr.14744 v2:172.21.15.111:6800/3952658086 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f2ce0105ca0 con 0x7f2cc407a480 2024-09-11T00:08:54.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.292+0000 7f2ce5600700 1 -- 172.21.15.111:0/3633616520 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f2cc407a480 msgr2=0x7f2cc407c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:54.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.292+0000 7f2ce5600700 1 --2- 172.21.15.111:0/3633616520 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f2cc407a480 0x7f2cc407c930 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0007fd0 tx=0x7f2cd0007480 comp rx=0 tx=0).stop 2024-09-11T00:08:54.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.293+0000 7f2ce5600700 1 -- 172.21.15.111:0/3633616520 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2ce0101350 msgr2=0x7f2ce0195ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:54.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.293+0000 7f2ce5600700 1 --2- 172.21.15.111:0/3633616520 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2ce0101350 0x7f2ce0195ea0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc000c00 tx=0x7f2ccc00bd70 comp rx=0 tx=0).stop 2024-09-11T00:08:54.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.293+0000 7f2ce5600700 1 -- 172.21.15.111:0/3633616520 shutdown_connections 2024-09-11T00:08:54.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.293+0000 7f2ce5600700 1 --2- 172.21.15.111:0/3633616520 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f2cc407a480 0x7f2cc407c930 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:54.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.293+0000 7f2ce5600700 1 --2- 172.21.15.111:0/3633616520 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ce0100150 0x7f2ce0195960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:54.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.293+0000 7f2ce5600700 1 --2- 172.21.15.111:0/3633616520 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2ce0101350 0x7f2ce0195ea0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:54.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.293+0000 7f2ce5600700 1 -- 172.21.15.111:0/3633616520 >> 172.21.15.111:0/3633616520 conn(0x7f2ce00fb6e0 msgr2=0x7f2ce0104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:54.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.293+0000 7f2ce5600700 1 -- 172.21.15.111:0/3633616520 shutdown_connections 2024-09-11T00:08:54.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.293+0000 7f2ce5600700 1 -- 172.21.15.111:0/3633616520 wait complete. 2024-09-11T00:08:54.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.450+0000 7f0910200700 1 -- 172.21.15.111:0/2939684003 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0908100c00 msgr2=0x7f0908102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:54.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.450+0000 7f0910200700 1 --2- 172.21.15.111:0/2939684003 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0908100c00 0x7f0908102fe0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f08fc009910 tx=0x7f08fc009c20 comp rx=0 tx=0).stop 2024-09-11T00:08:54.453 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:54 smithi111 ceph-mon[27539]: Updating smithi203:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:08:54.453 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:54 smithi111 ceph-mon[27539]: pgmap v12: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 39 KiB/s rd, 1.8 MiB/s wr, 272 op/s 2024-09-11T00:08:54.453 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:54 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:54.453 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:54 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:54.453 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:54 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:54.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.450+0000 7f0910200700 1 -- 172.21.15.111:0/2939684003 shutdown_connections 2024-09-11T00:08:54.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.450+0000 7f0910200700 1 --2- 172.21.15.111:0/2939684003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0908103520 0x7f0908105900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:54.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.450+0000 7f0910200700 1 --2- 172.21.15.111:0/2939684003 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0908100c00 0x7f0908102fe0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:54.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.450+0000 7f0910200700 1 -- 172.21.15.111:0/2939684003 >> 172.21.15.111:0/2939684003 conn(0x7f09080fa600 msgr2=0x7f09080fca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:54.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.451+0000 7f0910200700 1 -- 172.21.15.111:0/2939684003 shutdown_connections 2024-09-11T00:08:54.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.451+0000 7f0910200700 1 -- 172.21.15.111:0/2939684003 wait complete. 2024-09-11T00:08:54.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.452+0000 7f0910200700 1 Processor -- start 2024-09-11T00:08:54.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.452+0000 7f0910200700 1 -- start start 2024-09-11T00:08:54.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.452+0000 7f0910200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0908100c00 0x7f0908197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:54.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.453+0000 7f0910200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0908103520 0x7f0908198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:54.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.453+0000 7f0910200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09081986b0 con 0x7f0908103520 2024-09-11T00:08:54.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.453+0000 7f0910200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09081987f0 con 0x7f0908100c00 2024-09-11T00:08:54.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.453+0000 7f090ce00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0908103520 0x7f0908198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:54.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.453+0000 7f090ce00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0908103520 0x7f0908198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:55502/0 (socket says 172.21.15.111:55502) 2024-09-11T00:08:54.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.453+0000 7f090ce00700 1 -- 172.21.15.111:0/4137645828 learned_addr learned my addr 172.21.15.111:0/4137645828 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:08:54.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.454+0000 7f090ce00700 1 -- 172.21.15.111:0/4137645828 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0908100c00 msgr2=0x7f0908197b50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T00:08:54.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.454+0000 7f090ce00700 1 --2- 172.21.15.111:0/4137645828 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0908100c00 0x7f0908197b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:54.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.454+0000 7f090ce00700 1 -- 172.21.15.111:0/4137645828 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc0095f0 con 0x7f0908103520 2024-09-11T00:08:54.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.454+0000 7f090ce00700 1 --2- 172.21.15.111:0/4137645828 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0908103520 0x7f0908198090 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f08f400e920 tx=0x7f08f400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:54.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.454+0000 7f0906000700 1 -- 172.21.15.111:0/4137645828 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08f400cba0 con 0x7f0908103520 2024-09-11T00:08:54.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.454+0000 7f0906000700 1 -- 172.21.15.111:0/4137645828 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f08f400cd00 con 0x7f0908103520 2024-09-11T00:08:54.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.454+0000 7f0906000700 1 -- 172.21.15.111:0/4137645828 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08f4018770 con 0x7f0908103520 2024-09-11T00:08:54.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.454+0000 7f0910200700 1 -- 172.21.15.111:0/4137645828 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090819d2a0 con 0x7f0908103520 2024-09-11T00:08:54.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.455+0000 7f0910200700 1 -- 172.21.15.111:0/4137645828 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090819d7a0 con 0x7f0908103520 2024-09-11T00:08:54.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.456+0000 7f0910200700 1 -- 172.21.15.111:0/4137645828 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09080fc1e0 con 0x7f0908103520 2024-09-11T00:08:54.459 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.457+0000 7f0906000700 1 -- 172.21.15.111:0/4137645828 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 32) v1 ==== 102433+0+0 (secure 0 0 0) 0x7f08f4010430 con 0x7f0908103520 2024-09-11T00:08:54.460 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.458+0000 7f0906000700 1 --2- 172.21.15.111:0/4137645828 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f08f007a490 0x7f08f007c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:54.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.459+0000 7f0906000700 1 -- 172.21.15.111:0/4137645828 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f08f4014070 con 0x7f0908103520 2024-09-11T00:08:54.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.459+0000 7f090d800700 1 --2- 172.21.15.111:0/4137645828 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f08f007a490 0x7f08f007c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:54.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.460+0000 7f090d800700 1 --2- 172.21.15.111:0/4137645828 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f08f007a490 0x7f08f007c940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f08fc006010 tx=0x7f08fc009f70 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:54.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.464+0000 7f0906000700 1 -- 172.21.15.111:0/4137645828 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f08f4060e20 con 0x7f0908103520 2024-09-11T00:08:54.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:54 smithi203 ceph-mon[33225]: Updating smithi203:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:08:54.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:54 smithi203 ceph-mon[33225]: pgmap v12: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 39 KiB/s rd, 1.8 MiB/s wr, 272 op/s 2024-09-11T00:08:54.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:54 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:54.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:54 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:54.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:54 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:08:54.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.740+0000 7f0910200700 1 -- 172.21.15.111:0/4137645828 --> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0908061190 con 0x7f08f007a490 2024-09-11T00:08:54.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.750+0000 7f0906000700 1 -- 172.21.15.111:0/4137645828 <== mgr.14744 v2:172.21.15.111:6800/3952658086 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f0908061190 con 0x7f08f007a490 2024-09-11T00:08:54.752 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:08:54.753 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (9m) 10s ago 11m 13.8M - 0.25.0 c8568f914cd2 eb9e393000ec 2024-09-11T00:08:54.753 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (63s) 10s ago 12m 7063k - 18.2.0 dc2bc1663786 7c40af85314c 2024-09-11T00:08:54.753 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi203 smithi203 running (51s) 13s ago 11m 7319k - 18.2.0 dc2bc1663786 922e3261ff70 2024-09-11T00:08:54.753 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (12m) 10s ago 12m 6665k - 18.2.0 dc2bc1663786 72a36c166ffa 2024-09-11T00:08:54.753 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi203 smithi203 running (11m) 13s ago 11m 6669k - 18.2.0 dc2bc1663786 9b102b6f6d70 2024-09-11T00:08:54.753 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (9m) 10s ago 11m 73.7M - 9.4.7 954c08fa6188 e599624a9c9e 2024-09-11T00:08:54.753 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.gmgsay smithi111 running (5m) 10s ago 5m 14.5M - 18.2.0 dc2bc1663786 795e4ff0075c 2024-09-11T00:08:54.753 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.rucaba smithi111 running (4m) 10s ago 4m 14.6M - 18.2.0 dc2bc1663786 02885adac62c 2024-09-11T00:08:54.754 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.tcrqop smithi203 running (5m) 13s ago 4m 232M - 18.2.0 dc2bc1663786 4df492159bb4 2024-09-11T00:08:54.754 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.uqkbkn smithi203 running (4m) 13s ago 4m 14.6M - 18.2.0 dc2bc1663786 619aa58ea314 2024-09-11T00:08:54.754 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.ypucji smithi111 *:8443,9283,8765 running (42s) 10s ago 13m 491M - 19.3.0-4854-g8f219c47 589dd18248e4 07fa31f49618 2024-09-11T00:08:54.754 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi203.smuspl smithi203 *:8443,9283,8765 running (2m) 13s ago 10m 110M - 19.3.0-4854-g8f219c47 589dd18248e4 5c2e09508810 2024-09-11T00:08:54.754 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (13m) 10s ago 13m 53.5M 2048M 18.2.0 dc2bc1663786 2596322539fb 2024-09-11T00:08:54.754 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi203 smithi203 running (10m) 13s ago 10m 44.9M 2048M 18.2.0 dc2bc1663786 ff8eb7ca85ea 2024-09-11T00:08:54.754 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (12m) 10s ago 12m 7826k - 1.5.0 0da6a335fe13 4fd66ebc9c0d 2024-09-11T00:08:54.754 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi203 smithi203 *:9100 running (10m) 13s ago 10m 8216k - 1.5.0 0da6a335fe13 1cb3ca740f4a 2024-09-11T00:08:54.754 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (9m) 10s ago 9m 182M 1216M 18.2.0 dc2bc1663786 162b7249a591 2024-09-11T00:08:54.754 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (8m) 10s ago 8m 200M 1216M 18.2.0 dc2bc1663786 3614d95b1425 2024-09-11T00:08:54.755 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (8m) 10s ago 8m 163M 1216M 18.2.0 dc2bc1663786 db175d4b09b9 2024-09-11T00:08:54.755 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi203 running (7m) 13s ago 7m 217M 2240M 18.2.0 dc2bc1663786 60b1cef7a70d 2024-09-11T00:08:54.755 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi203 running (7m) 13s ago 7m 186M 2240M 18.2.0 dc2bc1663786 769c7942c42b 2024-09-11T00:08:54.755 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi203 running (6m) 13s ago 6m 176M 2240M 18.2.0 dc2bc1663786 6d824001d40c 2024-09-11T00:08:54.755 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (56s) 10s ago 11m 50.0M - 2.43.0 a07b618ecd1d 5b036a30a88c 2024-09-11T00:08:54.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.753+0000 7f0910200700 1 -- 172.21.15.111:0/4137645828 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f08f007a490 msgr2=0x7f08f007c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:54.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.753+0000 7f0910200700 1 --2- 172.21.15.111:0/4137645828 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f08f007a490 0x7f08f007c940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f08fc006010 tx=0x7f08fc009f70 comp rx=0 tx=0).stop 2024-09-11T00:08:54.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.753+0000 7f0910200700 1 -- 172.21.15.111:0/4137645828 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0908103520 msgr2=0x7f0908198090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:54.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.753+0000 7f0910200700 1 --2- 172.21.15.111:0/4137645828 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0908103520 0x7f0908198090 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f08f400e920 tx=0x7f08f400ece0 comp rx=0 tx=0).stop 2024-09-11T00:08:54.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.753+0000 7f0910200700 1 -- 172.21.15.111:0/4137645828 shutdown_connections 2024-09-11T00:08:54.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.753+0000 7f0910200700 1 --2- 172.21.15.111:0/4137645828 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f08f007a490 0x7f08f007c940 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:54.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.753+0000 7f0910200700 1 --2- 172.21.15.111:0/4137645828 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0908100c00 0x7f0908197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:54.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.753+0000 7f0910200700 1 --2- 172.21.15.111:0/4137645828 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0908103520 0x7f0908198090 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:54.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.753+0000 7f0910200700 1 -- 172.21.15.111:0/4137645828 >> 172.21.15.111:0/4137645828 conn(0x7f09080fa600 msgr2=0x7f0908104180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:54.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.754+0000 7f0910200700 1 -- 172.21.15.111:0/4137645828 shutdown_connections 2024-09-11T00:08:54.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.754+0000 7f0910200700 1 -- 172.21.15.111:0/4137645828 wait complete. 2024-09-11T00:08:54.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.960+0000 7f19da000700 1 -- 172.21.15.111:0/3571696878 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19d4101350 msgr2=0x7f19d41017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:54.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.960+0000 7f19da000700 1 --2- 172.21.15.111:0/3571696878 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19d4101350 0x7f19d41017a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f19c0009870 tx=0x7f19c0009b80 comp rx=0 tx=0).stop 2024-09-11T00:08:54.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.960+0000 7f19da000700 1 -- 172.21.15.111:0/3571696878 shutdown_connections 2024-09-11T00:08:54.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.960+0000 7f19da000700 1 --2- 172.21.15.111:0/3571696878 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19d4101350 0x7f19d41017a0 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f19c0009870 tx=0x7f19c0009b80 comp rx=0 tx=0).stop 2024-09-11T00:08:54.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.960+0000 7f19da000700 1 --2- 172.21.15.111:0/3571696878 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19d4100150 0x7f19d4100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:54.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.960+0000 7f19da000700 1 -- 172.21.15.111:0/3571696878 >> 172.21.15.111:0/3571696878 conn(0x7f19d40fb6e0 msgr2=0x7f19d40fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:54.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.961+0000 7f19da000700 1 -- 172.21.15.111:0/3571696878 shutdown_connections 2024-09-11T00:08:54.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.961+0000 7f19da000700 1 -- 172.21.15.111:0/3571696878 wait complete. 2024-09-11T00:08:54.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.962+0000 7f19da000700 1 Processor -- start 2024-09-11T00:08:54.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.963+0000 7f19da000700 1 -- start start 2024-09-11T00:08:54.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.963+0000 7f19da000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19d4100150 0x7f19d410b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:54.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.963+0000 7f19da000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19d410b8c0 0x7f19d4107de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:54.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.963+0000 7f19da000700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d4108320 con 0x7f19d4100150 2024-09-11T00:08:54.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.963+0000 7f19da000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d4108490 con 0x7f19d410b8c0 2024-09-11T00:08:54.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.964+0000 7f19d2a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19d410b8c0 0x7f19d4107de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:54.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.964+0000 7f19d2a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19d410b8c0 0x7f19d4107de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.111:37916/0 (socket says 172.21.15.111:37916) 2024-09-11T00:08:54.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.964+0000 7f19d2a00700 1 -- 172.21.15.111:0/1796067159 learned_addr learned my addr 172.21.15.111:0/1796067159 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:08:54.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.964+0000 7f19d3400700 1 --2- 172.21.15.111:0/1796067159 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19d4100150 0x7f19d410b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:54.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.965+0000 7f19d2a00700 1 -- 172.21.15.111:0/1796067159 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19d4100150 msgr2=0x7f19d410b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:54.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.965+0000 7f19d2a00700 1 --2- 172.21.15.111:0/1796067159 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19d4100150 0x7f19d410b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:54.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.965+0000 7f19d2a00700 1 -- 172.21.15.111:0/1796067159 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c0009520 con 0x7f19d410b8c0 2024-09-11T00:08:54.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.965+0000 7f19d2a00700 1 --2- 172.21.15.111:0/1796067159 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19d410b8c0 0x7f19d4107de0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f19c0009230 tx=0x7f19c000f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:54.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.966+0000 7f19cbe00700 1 -- 172.21.15.111:0/1796067159 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19c001c070 con 0x7f19d410b8c0 2024-09-11T00:08:54.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.966+0000 7f19cbe00700 1 -- 172.21.15.111:0/1796067159 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f19c000b4e0 con 0x7f19d410b8c0 2024-09-11T00:08:54.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.966+0000 7f19da000700 1 -- 172.21.15.111:0/1796067159 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d41086b0 con 0x7f19d410b8c0 2024-09-11T00:08:54.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.966+0000 7f19da000700 1 -- 172.21.15.111:0/1796067159 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d41a22f0 con 0x7f19d410b8c0 2024-09-11T00:08:54.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.967+0000 7f19cbe00700 1 -- 172.21.15.111:0/1796067159 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19c0022d90 con 0x7f19d410b8c0 2024-09-11T00:08:54.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.968+0000 7f19da000700 1 -- 172.21.15.111:0/1796067159 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d4074210 con 0x7f19d410b8c0 2024-09-11T00:08:54.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.971+0000 7f19cbe00700 1 -- 172.21.15.111:0/1796067159 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 32) v1 ==== 102433+0+0 (secure 0 0 0) 0x7f19c0020070 con 0x7f19d410b8c0 2024-09-11T00:08:54.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.972+0000 7f19cbe00700 1 --2- 172.21.15.111:0/1796067159 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f19b807a4d0 0x7f19b807c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:54.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.973+0000 7f19d3400700 1 --2- 172.21.15.111:0/1796067159 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f19b807a4d0 0x7f19b807c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:54.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.973+0000 7f19cbe00700 1 -- 172.21.15.111:0/1796067159 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f19c009e850 con 0x7f19d410b8c0 2024-09-11T00:08:54.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.974+0000 7f19d3400700 1 --2- 172.21.15.111:0/1796067159 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f19b807a4d0 0x7f19b807c980 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f19d41011b0 tx=0x7f19c4009310 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:54.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:54.980+0000 7f19cbe00700 1 -- 172.21.15.111:0/1796067159 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f19c0062360 con 0x7f19d410b8c0 2024-09-11T00:08:55.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.347+0000 7f19da000700 1 -- 172.21.15.111:0/1796067159 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f19d4074400 con 0x7f19d410b8c0 2024-09-11T00:08:55.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.354+0000 7f19cbe00700 1 -- 172.21.15.111:0/1796067159 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f19c0065480 con 0x7f19d410b8c0 2024-09-11T00:08:55.357 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:08:55.357 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-11T00:08:55.357 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-11T00:08:55.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:08:55.357 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-11T00:08:55.357 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:08:55.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:08:55.358 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-11T00:08:55.358 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-11T00:08:55.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:08:55.358 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-11T00:08:55.358 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-11T00:08:55.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:08:55.358 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-11T00:08:55.359 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-11T00:08:55.359 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:08:55.359 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-11T00:08:55.359 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:08:55.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.357+0000 7f19da000700 1 -- 172.21.15.111:0/1796067159 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f19b807a4d0 msgr2=0x7f19b807c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:55.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.357+0000 7f19da000700 1 --2- 172.21.15.111:0/1796067159 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f19b807a4d0 0x7f19b807c980 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f19d41011b0 tx=0x7f19c4009310 comp rx=0 tx=0).stop 2024-09-11T00:08:55.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.357+0000 7f19da000700 1 -- 172.21.15.111:0/1796067159 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19d410b8c0 msgr2=0x7f19d4107de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:55.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.357+0000 7f19da000700 1 --2- 172.21.15.111:0/1796067159 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19d410b8c0 0x7f19d4107de0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f19c0009230 tx=0x7f19c000f740 comp rx=0 tx=0).stop 2024-09-11T00:08:55.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.357+0000 7f19da000700 1 -- 172.21.15.111:0/1796067159 shutdown_connections 2024-09-11T00:08:55.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.357+0000 7f19da000700 1 --2- 172.21.15.111:0/1796067159 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f19b807a4d0 0x7f19b807c980 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:55.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.357+0000 7f19da000700 1 --2- 172.21.15.111:0/1796067159 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19d4100150 0x7f19d410b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:55.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.357+0000 7f19da000700 1 --2- 172.21.15.111:0/1796067159 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19d410b8c0 0x7f19d4107de0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:55.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.357+0000 7f19da000700 1 -- 172.21.15.111:0/1796067159 >> 172.21.15.111:0/1796067159 conn(0x7f19d40fb6e0 msgr2=0x7f19d40fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:55.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.357+0000 7f19da000700 1 -- 172.21.15.111:0/1796067159 shutdown_connections 2024-09-11T00:08:55.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.357+0000 7f19da000700 1 -- 172.21.15.111:0/1796067159 wait complete. 2024-09-11T00:08:55.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.510+0000 7fecc6e00700 1 -- 172.21.15.111:0/97495804 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fecc00fffa0 msgr2=0x7fecc01003b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:55.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.510+0000 7fecc6e00700 1 --2- 172.21.15.111:0/97495804 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fecc00fffa0 0x7fecc01003b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fecb4009910 tx=0x7fecb4009c20 comp rx=0 tx=0).stop 2024-09-11T00:08:55.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.510+0000 7fecc6e00700 1 -- 172.21.15.111:0/97495804 shutdown_connections 2024-09-11T00:08:55.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.510+0000 7fecc6e00700 1 --2- 172.21.15.111:0/97495804 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fecc01011a0 0x7fecc01015f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:55.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.510+0000 7fecc6e00700 1 --2- 172.21.15.111:0/97495804 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fecc00fffa0 0x7fecc01003b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:55.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.510+0000 7fecc6e00700 1 -- 172.21.15.111:0/97495804 >> 172.21.15.111:0/97495804 conn(0x7fecc00fb510 msgr2=0x7fecc00fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:55.513 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:55 smithi111 ceph-mon[27539]: Reconfiguring prometheus.smithi111 (dependencies changed)... 2024-09-11T00:08:55.513 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:55 smithi111 ceph-mon[27539]: Reconfiguring daemon prometheus.smithi111 on smithi111 2024-09-11T00:08:55.513 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:55 smithi111 ceph-mon[27539]: from='client.24593 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:08:55.513 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:55 smithi111 ceph-mon[27539]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:08:55.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.510+0000 7fecc6e00700 1 -- 172.21.15.111:0/97495804 shutdown_connections 2024-09-11T00:08:55.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.510+0000 7fecc6e00700 1 -- 172.21.15.111:0/97495804 wait complete. 2024-09-11T00:08:55.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.511+0000 7fecc6e00700 1 Processor -- start 2024-09-11T00:08:55.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.511+0000 7fecc6e00700 1 -- start start 2024-09-11T00:08:55.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.512+0000 7fecc6e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fecc00fffa0 0x7fecc01957c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:55.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.512+0000 7fecc6e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fecc01011a0 0x7fecc0195d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:55.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.512+0000 7fecc6e00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc0196320 con 0x7fecc00fffa0 2024-09-11T00:08:55.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.512+0000 7fecc6e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc0196460 con 0x7fecc01011a0 2024-09-11T00:08:55.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.512+0000 7fecc5a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fecc00fffa0 0x7fecc01957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:55.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.512+0000 7fecc5a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fecc00fffa0 0x7fecc01957c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:55544/0 (socket says 172.21.15.111:55544) 2024-09-11T00:08:55.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.512+0000 7fecc5a00700 1 -- 172.21.15.111:0/4208541589 learned_addr learned my addr 172.21.15.111:0/4208541589 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:08:55.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.512+0000 7fecc5000700 1 --2- 172.21.15.111:0/4208541589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fecc01011a0 0x7fecc0195d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:55.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.512+0000 7fecc5a00700 1 -- 172.21.15.111:0/4208541589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fecc01011a0 msgr2=0x7fecc0195d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:55.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.512+0000 7fecc5a00700 1 --2- 172.21.15.111:0/4208541589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fecc01011a0 0x7fecc0195d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:55.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.512+0000 7fecc5a00700 1 -- 172.21.15.111:0/4208541589 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb40095f0 con 0x7fecc00fffa0 2024-09-11T00:08:55.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.513+0000 7fecc5a00700 1 --2- 172.21.15.111:0/4208541589 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fecc00fffa0 0x7fecc01957c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fecb400bda0 tx=0x7fecb400bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:55.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.513+0000 7fecbe000700 1 -- 172.21.15.111:0/4208541589 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecb401d070 con 0x7fecc00fffa0 2024-09-11T00:08:55.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.513+0000 7fecbe000700 1 -- 172.21.15.111:0/4208541589 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fecb400f460 con 0x7fecc00fffa0 2024-09-11T00:08:55.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.513+0000 7fecbe000700 1 -- 172.21.15.111:0/4208541589 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecb4021620 con 0x7fecc00fffa0 2024-09-11T00:08:55.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.513+0000 7fecc6e00700 1 -- 172.21.15.111:0/4208541589 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecc019aeb0 con 0x7fecc00fffa0 2024-09-11T00:08:55.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.513+0000 7fecc6e00700 1 -- 172.21.15.111:0/4208541589 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc019b320 con 0x7fecc00fffa0 2024-09-11T00:08:55.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.514+0000 7fecc6e00700 1 -- 172.21.15.111:0/4208541589 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecc0108af0 con 0x7fecc00fffa0 2024-09-11T00:08:55.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.516+0000 7fecbe000700 1 -- 172.21.15.111:0/4208541589 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 32) v1 ==== 102433+0+0 (secure 0 0 0) 0x7fecb400f5d0 con 0x7fecc00fffa0 2024-09-11T00:08:55.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.517+0000 7fecbe000700 1 --2- 172.21.15.111:0/4208541589 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7feca807a480 0x7feca807c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:55.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.517+0000 7fecbe000700 1 -- 172.21.15.111:0/4208541589 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fecb409e600 con 0x7fecc00fffa0 2024-09-11T00:08:55.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.517+0000 7fecc5000700 1 --2- 172.21.15.111:0/4208541589 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7feca807a480 0x7feca807c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:55.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.518+0000 7fecc5000700 1 --2- 172.21.15.111:0/4208541589 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7feca807a480 0x7feca807c930 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fecac005950 tx=0x7fecac00b410 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:55.523 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.521+0000 7fecbe000700 1 -- 172.21.15.111:0/4208541589 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7fecb4062120 con 0x7fecc00fffa0 2024-09-11T00:08:55.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:55 smithi203 ceph-mon[33225]: Reconfiguring prometheus.smithi111 (dependencies changed)... 2024-09-11T00:08:55.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:55 smithi203 ceph-mon[33225]: Reconfiguring daemon prometheus.smithi111 on smithi111 2024-09-11T00:08:55.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:55 smithi203 ceph-mon[33225]: from='client.24593 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:08:55.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:55 smithi203 ceph-mon[33225]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:08:55.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.802+0000 7fecc6e00700 1 -- 172.21.15.111:0/4208541589 --> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fecc0105af0 con 0x7feca807a480 2024-09-11T00:08:55.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.803+0000 7fecbe000700 1 -- 172.21.15.111:0/4208541589 <== mgr.14744 v2:172.21.15.111:6800/3952658086 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7fecc0105af0 con 0x7feca807a480 2024-09-11T00:08:55.805 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:08:55.805 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e", 2024-09-11T00:08:55.805 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-11T00:08:55.805 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-11T00:08:55.805 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-11T00:08:55.805 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr" 2024-09-11T00:08:55.805 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-11T00:08:55.805 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "2/2 daemons upgraded", 2024-09-11T00:08:55.805 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "", 2024-09-11T00:08:55.806 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-11T00:08:55.806 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:08:55.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.806+0000 7fecc6e00700 1 -- 172.21.15.111:0/4208541589 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7feca807a480 msgr2=0x7feca807c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:55.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.806+0000 7fecc6e00700 1 --2- 172.21.15.111:0/4208541589 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7feca807a480 0x7feca807c930 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fecac005950 tx=0x7fecac00b410 comp rx=0 tx=0).stop 2024-09-11T00:08:55.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.806+0000 7fecc6e00700 1 -- 172.21.15.111:0/4208541589 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fecc00fffa0 msgr2=0x7fecc01957c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:55.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.806+0000 7fecc6e00700 1 --2- 172.21.15.111:0/4208541589 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fecc00fffa0 0x7fecc01957c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fecb400bda0 tx=0x7fecb400bdd0 comp rx=0 tx=0).stop 2024-09-11T00:08:55.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.806+0000 7fecc6e00700 1 -- 172.21.15.111:0/4208541589 shutdown_connections 2024-09-11T00:08:55.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.806+0000 7fecc6e00700 1 --2- 172.21.15.111:0/4208541589 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7feca807a480 0x7feca807c930 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:55.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.806+0000 7fecc6e00700 1 --2- 172.21.15.111:0/4208541589 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fecc00fffa0 0x7fecc01957c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:55.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.806+0000 7fecc6e00700 1 --2- 172.21.15.111:0/4208541589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fecc01011a0 0x7fecc0195d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:55.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.806+0000 7fecc6e00700 1 -- 172.21.15.111:0/4208541589 >> 172.21.15.111:0/4208541589 conn(0x7fecc00fb510 msgr2=0x7fecc01043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:55.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.806+0000 7fecc6e00700 1 -- 172.21.15.111:0/4208541589 shutdown_connections 2024-09-11T00:08:55.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:08:55.806+0000 7fecc6e00700 1 -- 172.21.15.111:0/4208541589 wait complete. 2024-09-11T00:08:56.515 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:56 smithi111 ceph-mon[27539]: from='client.14800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:08:56.516 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:56 smithi111 ceph-mon[27539]: pgmap v13: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 1.3 MiB/s wr, 196 op/s 2024-09-11T00:08:56.516 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:56 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/1796067159' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:08:56.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:56 smithi203 ceph-mon[33225]: from='client.14800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:08:56.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:56 smithi203 ceph-mon[33225]: pgmap v13: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 1.3 MiB/s wr, 196 op/s 2024-09-11T00:08:56.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:56 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/1796067159' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:08:57.478 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:57 smithi111 ceph-mon[27539]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:08:57.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:57 smithi203 ceph-mon[33225]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:08:58.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:58 smithi111 ceph-mon[27539]: pgmap v14: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37 KiB/s rd, 1.9 MiB/s wr, 272 op/s 2024-09-11T00:08:58.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:58 smithi203 ceph-mon[33225]: pgmap v14: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37 KiB/s rd, 1.9 MiB/s wr, 272 op/s 2024-09-11T00:09:00.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:08:59 smithi203 ceph-mon[33225]: pgmap v15: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.2 MiB/s wr, 164 op/s 2024-09-11T00:09:00.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:08:59 smithi111 ceph-mon[27539]: pgmap v15: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.2 MiB/s wr, 164 op/s 2024-09-11T00:09:01.683 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:01 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:01.683 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:01 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:01.683 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:01 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-11T00:09:01.683 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:01 smithi203 ceph-mon[33225]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-11T00:09:01.683 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:01 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:09:01.683 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:01 smithi203 ceph-mon[33225]: pgmap v16: 65 pgs: 65 active+clean; 301 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 38 KiB/s rd, 1.5 MiB/s wr, 185 op/s 2024-09-11T00:09:01.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:01 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:01.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:01 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:01.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:01 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-11T00:09:01.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:01 smithi111 ceph-mon[27539]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-11T00:09:01.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:01 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:09:01.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:01 smithi111 ceph-mon[27539]: pgmap v16: 65 pgs: 65 active+clean; 301 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 38 KiB/s rd, 1.5 MiB/s wr, 185 op/s 2024-09-11T00:09:04.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:04 smithi203 ceph-mon[33225]: pgmap v17: 65 pgs: 65 active+clean; 295 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 26 KiB/s rd, 1.5 MiB/s wr, 150 op/s 2024-09-11T00:09:04.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:04 smithi203 ceph-mon[33225]: Upgrade: Updating mgr.smithi203.smuspl 2024-09-11T00:09:04.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:04 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi203.smuspl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T00:09:04.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:04 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T00:09:04.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:04 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:09:04.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:04 smithi203 ceph-mon[33225]: Deploying daemon mgr.smithi203.smuspl on smithi203 2024-09-11T00:09:04.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:04 smithi111 ceph-mon[27539]: pgmap v17: 65 pgs: 65 active+clean; 295 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 26 KiB/s rd, 1.5 MiB/s wr, 150 op/s 2024-09-11T00:09:04.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:04 smithi111 ceph-mon[27539]: Upgrade: Updating mgr.smithi203.smuspl 2024-09-11T00:09:04.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:04 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi203.smuspl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T00:09:04.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:04 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T00:09:04.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:04 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:09:04.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:04 smithi111 ceph-mon[27539]: Deploying daemon mgr.smithi203.smuspl on smithi203 2024-09-11T00:09:06.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:06 smithi203 ceph-mon[33225]: pgmap v18: 65 pgs: 65 active+clean; 295 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 26 KiB/s rd, 1.3 MiB/s wr, 122 op/s 2024-09-11T00:09:06.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:06 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:09:06.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:06 smithi111 ceph-mon[27539]: pgmap v18: 65 pgs: 65 active+clean; 295 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 26 KiB/s rd, 1.3 MiB/s wr, 122 op/s 2024-09-11T00:09:06.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:06 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:09:08.199 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:08 smithi111 ceph-mon[27539]: pgmap v19: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 38 KiB/s rd, 1.7 MiB/s wr, 204 op/s 2024-09-11T00:09:08.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:08 smithi203 ceph-mon[33225]: pgmap v19: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 38 KiB/s rd, 1.7 MiB/s wr, 204 op/s 2024-09-11T00:09:10.044 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:09 smithi203 ceph-mon[33225]: pgmap v20: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.1 MiB/s wr, 128 op/s 2024-09-11T00:09:10.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:09 smithi111 ceph-mon[27539]: pgmap v20: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.1 MiB/s wr, 128 op/s 2024-09-11T00:09:12.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:12 smithi203 ceph-mon[33225]: pgmap v21: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37 KiB/s rd, 1.3 MiB/s wr, 173 op/s 2024-09-11T00:09:12.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:12 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:12.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:12 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:12.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:12 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:09:12.633 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:12 smithi111 ceph-mon[27539]: pgmap v21: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37 KiB/s rd, 1.3 MiB/s wr, 173 op/s 2024-09-11T00:09:12.633 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:12 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:12.633 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:12 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:12.633 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:12 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:09:14.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:14 smithi111 ceph-mon[27539]: pgmap v22: 65 pgs: 65 active+clean; 277 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 1.3 MiB/s wr, 205 op/s 2024-09-11T00:09:14.516 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:14 smithi203 ceph-mon[33225]: pgmap v22: 65 pgs: 65 active+clean; 277 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 1.3 MiB/s wr, 205 op/s 2024-09-11T00:09:16.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:16 smithi203 ceph-mon[33225]: pgmap v23: 65 pgs: 65 active+clean; 277 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 1014 KiB/s wr, 179 op/s 2024-09-11T00:09:16.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:16 smithi111 ceph-mon[27539]: pgmap v23: 65 pgs: 65 active+clean; 277 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 1014 KiB/s wr, 179 op/s 2024-09-11T00:09:17.190 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-11T00:09:17.190 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-11T00:09:18.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:18 smithi111 ceph-mon[27539]: pgmap v24: 65 pgs: 65 active+clean; 269 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 36 KiB/s rd, 1.5 MiB/s wr, 260 op/s 2024-09-11T00:09:18.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:18 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:18.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:18 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:18.481 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-11T00:09:18.481 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-11T00:09:18.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:18 smithi203 ceph-mon[33225]: pgmap v24: 65 pgs: 65 active+clean; 269 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 36 KiB/s rd, 1.5 MiB/s wr, 260 op/s 2024-09-11T00:09:18.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:18 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:18.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:18 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:18.667 DEBUG:teuthology.parallel:result is None 2024-09-11T00:09:19.661 DEBUG:teuthology.parallel:result is None 2024-09-11T00:09:19.662 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T00:09:19.732 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T00:09:19.732 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-11T00:09:19.798 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-11T00:09:19.798 DEBUG:teuthology.parallel:result is None 2024-09-11T00:09:20.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:19 smithi203 ceph-mon[33225]: pgmap v25: 65 pgs: 65 active+clean; 269 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 1.0 MiB/s wr, 178 op/s 2024-09-11T00:09:20.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:19 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:20.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:19 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:20.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:19 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:20.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:19 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:20.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:19 smithi111 ceph-mon[27539]: pgmap v25: 65 pgs: 65 active+clean; 269 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 1.0 MiB/s wr, 178 op/s 2024-09-11T00:09:20.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:19 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:20.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:19 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:20.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:19 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:20.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:19 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:21.017 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:20 smithi203 ceph-mon[33225]: Standby manager daemon smithi203.smuspl restarted 2024-09-11T00:09:21.018 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:20 smithi203 ceph-mon[33225]: Standby manager daemon smithi203.smuspl started 2024-09-11T00:09:21.018 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:20 smithi203 ceph-mon[33225]: from='mgr.? 172.21.15.203:0/2776371362' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.smuspl/crt"}]: dispatch 2024-09-11T00:09:21.018 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:20 smithi203 ceph-mon[33225]: from='mgr.? 172.21.15.203:0/2776371362' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T00:09:21.018 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:20 smithi203 ceph-mon[33225]: from='mgr.? 172.21.15.203:0/2776371362' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.smuspl/key"}]: dispatch 2024-09-11T00:09:21.018 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:20 smithi203 ceph-mon[33225]: from='mgr.? 172.21.15.203:0/2776371362' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T00:09:21.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:20 smithi111 ceph-mon[27539]: Standby manager daemon smithi203.smuspl restarted 2024-09-11T00:09:21.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:20 smithi111 ceph-mon[27539]: Standby manager daemon smithi203.smuspl started 2024-09-11T00:09:21.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:20 smithi111 ceph-mon[27539]: from='mgr.? 172.21.15.203:0/2776371362' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.smuspl/crt"}]: dispatch 2024-09-11T00:09:21.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:20 smithi111 ceph-mon[27539]: from='mgr.? 172.21.15.203:0/2776371362' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T00:09:21.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:20 smithi111 ceph-mon[27539]: from='mgr.? 172.21.15.203:0/2776371362' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.smuspl/key"}]: dispatch 2024-09-11T00:09:21.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:20 smithi111 ceph-mon[27539]: from='mgr.? 172.21.15.203:0/2776371362' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T00:09:21.988 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:21 smithi203 ceph-mon[33225]: mgrmap e33: smithi111.ypucji(active, since 45s), standbys: smithi203.smuspl 2024-09-11T00:09:22.032 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:21 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:09:22.033 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:21 smithi203 ceph-mon[33225]: pgmap v26: 65 pgs: 65 active+clean; 263 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 34 KiB/s rd, 1.3 MiB/s wr, 210 op/s 2024-09-11T00:09:22.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:21 smithi111 ceph-mon[27539]: mgrmap e33: smithi111.ypucji(active, since 45s), standbys: smithi203.smuspl 2024-09-11T00:09:22.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:21 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:09:22.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:21 smithi111 ceph-mon[27539]: pgmap v26: 65 pgs: 65 active+clean; 263 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 34 KiB/s rd, 1.3 MiB/s wr, 210 op/s 2024-09-11T00:09:24.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:24 smithi203 ceph-mon[33225]: pgmap v27: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 1.1 MiB/s wr, 186 op/s 2024-09-11T00:09:24.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:24 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:24.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:24 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:24.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:24 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:09:24.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:24 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:09:24.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:24 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:24.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:24 smithi111 ceph-mon[27539]: pgmap v27: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 1.1 MiB/s wr, 186 op/s 2024-09-11T00:09:24.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:24 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:24.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:24 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:24.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:24 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:09:24.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:24 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:09:24.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:24 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:25.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:25 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:09:25.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:25 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:25.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:25 smithi111 ceph-mon[27539]: Upgrade: Setting container_image for all mgr 2024-09-11T00:09:25.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:25 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:25.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:25 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi111.ypucji"}]: dispatch 2024-09-11T00:09:25.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:25 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi111.ypucji"}]': finished 2024-09-11T00:09:25.404 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:25 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi203.smuspl"}]: dispatch 2024-09-11T00:09:25.404 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:25 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi203.smuspl"}]': finished 2024-09-11T00:09:25.404 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:25 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:25.404 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:25 smithi111 ceph-mon[27539]: Upgrade: Setting container_image for all rgw 2024-09-11T00:09:25.404 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:25 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:25.404 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:25 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:25.404 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:25 smithi111 ceph-mon[27539]: Upgrade: Setting container_image for all rbd-mirror 2024-09-11T00:09:25.404 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:25 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:25.404 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:25 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:25.404 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:25 smithi111 ceph-mon[27539]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-11T00:09:25.404 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:25 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:25.404 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:25 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:25.404 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:25 smithi111 ceph-mon[27539]: Upgrade: Setting container_image for all iscsi 2024-09-11T00:09:25.405 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:25 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:25.405 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:25 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:25.405 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:25 smithi111 ceph-mon[27539]: Upgrade: Setting container_image for all nfs 2024-09-11T00:09:25.405 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:25 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:25.405 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:25 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:25.405 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:25 smithi111 ceph-mon[27539]: Upgrade: Setting container_image for all nvmeof 2024-09-11T00:09:25.405 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:25 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:25.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:25 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:09:25.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:25 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:25.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:25 smithi203 ceph-mon[33225]: Upgrade: Setting container_image for all mgr 2024-09-11T00:09:25.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:25 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:25.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:25 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi111.ypucji"}]: dispatch 2024-09-11T00:09:25.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:25 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi111.ypucji"}]': finished 2024-09-11T00:09:25.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:25 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi203.smuspl"}]: dispatch 2024-09-11T00:09:25.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:25 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi203.smuspl"}]': finished 2024-09-11T00:09:25.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:25 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:25.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:25 smithi203 ceph-mon[33225]: Upgrade: Setting container_image for all rgw 2024-09-11T00:09:25.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:25 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:25.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:25 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:25.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:25 smithi203 ceph-mon[33225]: Upgrade: Setting container_image for all rbd-mirror 2024-09-11T00:09:25.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:25 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:25.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:25 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:25.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:25 smithi203 ceph-mon[33225]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-11T00:09:25.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:25 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:25.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:25 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:25.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:25 smithi203 ceph-mon[33225]: Upgrade: Setting container_image for all iscsi 2024-09-11T00:09:25.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:25 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:25.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:25 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:25.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:25 smithi203 ceph-mon[33225]: Upgrade: Setting container_image for all nfs 2024-09-11T00:09:25.547 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:25 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:25.547 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:25 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:25.547 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:25 smithi203 ceph-mon[33225]: Upgrade: Setting container_image for all nvmeof 2024-09-11T00:09:25.547 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:25 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:25.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.955+0000 7ff889200700 1 -- 172.21.15.111:0/2112658795 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff884101350 msgr2=0x7ff8841017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:25.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.955+0000 7ff889200700 1 --2- 172.21.15.111:0/2112658795 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff884101350 0x7ff8841017a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff870009910 tx=0x7ff870009c20 comp rx=0 tx=0).stop 2024-09-11T00:09:25.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.955+0000 7ff889200700 1 -- 172.21.15.111:0/2112658795 shutdown_connections 2024-09-11T00:09:25.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.955+0000 7ff889200700 1 --2- 172.21.15.111:0/2112658795 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff884101350 0x7ff8841017a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:25.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.955+0000 7ff889200700 1 --2- 172.21.15.111:0/2112658795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff884100150 0x7ff884100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:25.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.955+0000 7ff889200700 1 -- 172.21.15.111:0/2112658795 >> 172.21.15.111:0/2112658795 conn(0x7ff8840fb6e0 msgr2=0x7ff8840fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:25.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.955+0000 7ff889200700 1 -- 172.21.15.111:0/2112658795 shutdown_connections 2024-09-11T00:09:25.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.955+0000 7ff889200700 1 -- 172.21.15.111:0/2112658795 wait complete. 2024-09-11T00:09:25.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.956+0000 7ff889200700 1 Processor -- start 2024-09-11T00:09:25.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.956+0000 7ff889200700 1 -- start start 2024-09-11T00:09:25.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.956+0000 7ff889200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff884100150 0x7ff884197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:25.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.956+0000 7ff889200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff884101350 0x7ff8841980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:25.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.956+0000 7ff889200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8841986d0 con 0x7ff884100150 2024-09-11T00:09:25.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.956+0000 7ff889200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff884198810 con 0x7ff884101350 2024-09-11T00:09:25.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.957+0000 7ff881e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff884100150 0x7ff884197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:25.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.957+0000 7ff881e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff884100150 0x7ff884197b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44416/0 (socket says 172.21.15.111:44416) 2024-09-11T00:09:25.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.957+0000 7ff881e00700 1 -- 172.21.15.111:0/4188696319 learned_addr learned my addr 172.21.15.111:0/4188696319 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:09:25.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.957+0000 7ff881400700 1 --2- 172.21.15.111:0/4188696319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff884101350 0x7ff8841980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:25.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.957+0000 7ff881e00700 1 -- 172.21.15.111:0/4188696319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff884101350 msgr2=0x7ff8841980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:25.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.957+0000 7ff881e00700 1 --2- 172.21.15.111:0/4188696319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff884101350 0x7ff8841980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:25.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.957+0000 7ff881e00700 1 -- 172.21.15.111:0/4188696319 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8700095f0 con 0x7ff884100150 2024-09-11T00:09:25.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.958+0000 7ff881e00700 1 --2- 172.21.15.111:0/4188696319 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff884100150 0x7ff884197b70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff87400d900 tx=0x7ff87400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:25.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.958+0000 7ff87aa00700 1 -- 172.21.15.111:0/4188696319 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8740041f0 con 0x7ff884100150 2024-09-11T00:09:25.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.958+0000 7ff87aa00700 1 -- 172.21.15.111:0/4188696319 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff874004350 con 0x7ff884100150 2024-09-11T00:09:25.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.958+0000 7ff87aa00700 1 -- 172.21.15.111:0/4188696319 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff874003d20 con 0x7ff884100150 2024-09-11T00:09:25.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.958+0000 7ff889200700 1 -- 172.21.15.111:0/4188696319 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff88419d2c0 con 0x7ff884100150 2024-09-11T00:09:25.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.958+0000 7ff889200700 1 -- 172.21.15.111:0/4188696319 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff88419d810 con 0x7ff884100150 2024-09-11T00:09:25.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.959+0000 7ff889200700 1 -- 172.21.15.111:0/4188696319 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff884105430 con 0x7ff884100150 2024-09-11T00:09:25.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.960+0000 7ff87aa00700 1 -- 172.21.15.111:0/4188696319 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 33) v1 ==== 102433+0+0 (secure 0 0 0) 0x7ff874009730 con 0x7ff884100150 2024-09-11T00:09:25.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.962+0000 7ff87aa00700 1 --2- 172.21.15.111:0/4188696319 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7ff86807a480 0x7ff86807c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:25.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.962+0000 7ff87aa00700 1 -- 172.21.15.111:0/4188696319 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7ff87409ce90 con 0x7ff884100150 2024-09-11T00:09:25.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.962+0000 7ff881400700 1 --2- 172.21.15.111:0/4188696319 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7ff86807a480 0x7ff86807c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:25.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.963+0000 7ff881400700 1 --2- 172.21.15.111:0/4188696319 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7ff86807a480 0x7ff86807c930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff870006010 tx=0x7ff87000b560 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:25.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:25.968+0000 7ff87aa00700 1 -- 172.21.15.111:0/4188696319 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7ff874060870 con 0x7ff884100150 2024-09-11T00:09:26.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.230+0000 7ff889200700 1 -- 172.21.15.111:0/4188696319 --> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff884061190 con 0x7ff86807a480 2024-09-11T00:09:26.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.232+0000 7ff87aa00700 1 -- 172.21.15.111:0/4188696319 <== mgr.14744 v2:172.21.15.111:6800/3952658086 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7ff884061190 con 0x7ff86807a480 2024-09-11T00:09:26.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.235+0000 7ff889200700 1 -- 172.21.15.111:0/4188696319 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7ff86807a480 msgr2=0x7ff86807c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:26.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.236+0000 7ff889200700 1 --2- 172.21.15.111:0/4188696319 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7ff86807a480 0x7ff86807c930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff870006010 tx=0x7ff87000b560 comp rx=0 tx=0).stop 2024-09-11T00:09:26.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.236+0000 7ff889200700 1 -- 172.21.15.111:0/4188696319 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff884100150 msgr2=0x7ff884197b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:26.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.236+0000 7ff889200700 1 --2- 172.21.15.111:0/4188696319 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff884100150 0x7ff884197b70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff87400d900 tx=0x7ff87400dc10 comp rx=0 tx=0).stop 2024-09-11T00:09:26.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.236+0000 7ff889200700 1 -- 172.21.15.111:0/4188696319 shutdown_connections 2024-09-11T00:09:26.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.236+0000 7ff889200700 1 --2- 172.21.15.111:0/4188696319 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7ff86807a480 0x7ff86807c930 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.236+0000 7ff889200700 1 --2- 172.21.15.111:0/4188696319 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff884100150 0x7ff884197b70 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.236+0000 7ff889200700 1 --2- 172.21.15.111:0/4188696319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff884101350 0x7ff8841980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.236+0000 7ff889200700 1 -- 172.21.15.111:0/4188696319 >> 172.21.15.111:0/4188696319 conn(0x7ff8840fb6e0 msgr2=0x7ff884102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:26.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.236+0000 7ff889200700 1 -- 172.21.15.111:0/4188696319 shutdown_connections 2024-09-11T00:09:26.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.236+0000 7ff889200700 1 -- 172.21.15.111:0/4188696319 wait complete. 2024-09-11T00:09:26.262 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:09:26.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.391+0000 7f4648e00700 1 -- 172.21.15.111:0/3989097084 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46441035b0 msgr2=0x7f4644103a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:26.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.391+0000 7f4648e00700 1 --2- 172.21.15.111:0/3989097084 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46441035b0 0x7f4644103a00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4630009910 tx=0x7f4630009c20 comp rx=0 tx=0).stop 2024-09-11T00:09:26.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.391+0000 7f4648e00700 1 -- 172.21.15.111:0/3989097084 shutdown_connections 2024-09-11T00:09:26.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.391+0000 7f4648e00700 1 --2- 172.21.15.111:0/3989097084 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46441035b0 0x7f4644103a00 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.391+0000 7f4648e00700 1 --2- 172.21.15.111:0/3989097084 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46441023b0 0x7f46441027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.391+0000 7f4648e00700 1 -- 172.21.15.111:0/3989097084 >> 172.21.15.111:0/3989097084 conn(0x7f46440fd960 msgr2=0x7f46440ffd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:26.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.391+0000 7f4648e00700 1 -- 172.21.15.111:0/3989097084 shutdown_connections 2024-09-11T00:09:26.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.391+0000 7f4648e00700 1 -- 172.21.15.111:0/3989097084 wait complete. 2024-09-11T00:09:26.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.392+0000 7f4648e00700 1 Processor -- start 2024-09-11T00:09:26.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.392+0000 7f4648e00700 1 -- start start 2024-09-11T00:09:26.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.393+0000 7f4648e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46441023b0 0x7f4644197b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:26.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.393+0000 7f4648e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46441035b0 0x7f46441980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:26.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.393+0000 7f4648e00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46441986e0 con 0x7f46441035b0 2024-09-11T00:09:26.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.393+0000 7f4648e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4644198820 con 0x7f46441023b0 2024-09-11T00:09:26.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.393+0000 7f4641400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46441035b0 0x7f46441980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:26.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.393+0000 7f4641400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46441035b0 0x7f46441980c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44442/0 (socket says 172.21.15.111:44442) 2024-09-11T00:09:26.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.393+0000 7f4641400700 1 -- 172.21.15.111:0/2338626227 learned_addr learned my addr 172.21.15.111:0/2338626227 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:09:26.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.393+0000 7f4641e00700 1 --2- 172.21.15.111:0/2338626227 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46441023b0 0x7f4644197b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:26.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.394+0000 7f4641400700 1 -- 172.21.15.111:0/2338626227 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46441023b0 msgr2=0x7f4644197b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:26.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.394+0000 7f4641400700 1 --2- 172.21.15.111:0/2338626227 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46441023b0 0x7f4644197b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.394+0000 7f4641400700 1 -- 172.21.15.111:0/2338626227 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46300095f0 con 0x7f46441035b0 2024-09-11T00:09:26.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.394+0000 7f4641400700 1 --2- 172.21.15.111:0/2338626227 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46441035b0 0x7f46441980c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4630005b40 tx=0x7f463000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:26.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.394+0000 7f463aa00700 1 -- 172.21.15.111:0/2338626227 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f463001d070 con 0x7f46441035b0 2024-09-11T00:09:26.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.394+0000 7f4648e00700 1 -- 172.21.15.111:0/2338626227 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f464419d270 con 0x7f46441035b0 2024-09-11T00:09:26.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.394+0000 7f4648e00700 1 -- 172.21.15.111:0/2338626227 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f464419d760 con 0x7f46441035b0 2024-09-11T00:09:26.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.395+0000 7f463aa00700 1 -- 172.21.15.111:0/2338626227 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f463000f460 con 0x7f46441035b0 2024-09-11T00:09:26.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.395+0000 7f463aa00700 1 -- 172.21.15.111:0/2338626227 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4630021620 con 0x7f46441035b0 2024-09-11T00:09:26.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.396+0000 7f4648e00700 1 -- 172.21.15.111:0/2338626227 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4624005320 con 0x7f46441035b0 2024-09-11T00:09:26.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.398+0000 7f463aa00700 1 -- 172.21.15.111:0/2338626227 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 33) v1 ==== 102433+0+0 (secure 0 0 0) 0x7f4630003a60 con 0x7f46441035b0 2024-09-11T00:09:26.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.399+0000 7f463aa00700 1 --2- 172.21.15.111:0/2338626227 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f462807a480 0x7f462807c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:26.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.400+0000 7f463aa00700 1 -- 172.21.15.111:0/2338626227 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f463009e6b0 con 0x7f46441035b0 2024-09-11T00:09:26.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.400+0000 7f4641e00700 1 --2- 172.21.15.111:0/2338626227 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f462807a480 0x7f462807c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:26.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.401+0000 7f4641e00700 1 --2- 172.21.15.111:0/2338626227 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f462807a480 0x7f462807c930 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4644103410 tx=0x7f463400b410 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:26.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.402+0000 7f463aa00700 1 -- 172.21.15.111:0/2338626227 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f4630062090 con 0x7f46441035b0 2024-09-11T00:09:26.557 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:26 smithi111 ceph-mon[27539]: pgmap v28: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 800 KiB/s wr, 133 op/s 2024-09-11T00:09:26.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.680+0000 7f4648e00700 1 -- 172.21.15.111:0/2338626227 --> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4624000bf0 con 0x7f462807a480 2024-09-11T00:09:26.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.681+0000 7f463aa00700 1 -- 172.21.15.111:0/2338626227 <== mgr.14744 v2:172.21.15.111:6800/3952658086 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f4624000bf0 con 0x7f462807a480 2024-09-11T00:09:26.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.684+0000 7f4648e00700 1 -- 172.21.15.111:0/2338626227 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f462807a480 msgr2=0x7f462807c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:26.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.684+0000 7f4648e00700 1 --2- 172.21.15.111:0/2338626227 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f462807a480 0x7f462807c930 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4644103410 tx=0x7f463400b410 comp rx=0 tx=0).stop 2024-09-11T00:09:26.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.684+0000 7f4648e00700 1 -- 172.21.15.111:0/2338626227 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46441035b0 msgr2=0x7f46441980c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:26.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.684+0000 7f4648e00700 1 --2- 172.21.15.111:0/2338626227 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46441035b0 0x7f46441980c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4630005b40 tx=0x7f463000bd70 comp rx=0 tx=0).stop 2024-09-11T00:09:26.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.684+0000 7f4648e00700 1 -- 172.21.15.111:0/2338626227 shutdown_connections 2024-09-11T00:09:26.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.684+0000 7f4648e00700 1 --2- 172.21.15.111:0/2338626227 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f462807a480 0x7f462807c930 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.684+0000 7f4648e00700 1 --2- 172.21.15.111:0/2338626227 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46441023b0 0x7f4644197b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.684+0000 7f4648e00700 1 --2- 172.21.15.111:0/2338626227 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46441035b0 0x7f46441980c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.684+0000 7f4648e00700 1 -- 172.21.15.111:0/2338626227 >> 172.21.15.111:0/2338626227 conn(0x7f46440fd960 msgr2=0x7f46441067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:26.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.684+0000 7f4648e00700 1 -- 172.21.15.111:0/2338626227 shutdown_connections 2024-09-11T00:09:26.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.684+0000 7f4648e00700 1 -- 172.21.15.111:0/2338626227 wait complete. 2024-09-11T00:09:26.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:26 smithi203 ceph-mon[33225]: pgmap v28: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 800 KiB/s wr, 133 op/s 2024-09-11T00:09:26.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.825+0000 7f73b7400700 1 -- 172.21.15.111:0/1560725120 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73b0100170 msgr2=0x7f73b0100580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:26.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.825+0000 7f73b7400700 1 --2- 172.21.15.111:0/1560725120 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73b0100170 0x7f73b0100580 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f73a4009910 tx=0x7f73a4009c20 comp rx=0 tx=0).stop 2024-09-11T00:09:26.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.825+0000 7f73b7400700 1 -- 172.21.15.111:0/1560725120 shutdown_connections 2024-09-11T00:09:26.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.825+0000 7f73b7400700 1 --2- 172.21.15.111:0/1560725120 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73b0101370 0x7f73b01017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.825+0000 7f73b7400700 1 --2- 172.21.15.111:0/1560725120 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73b0100170 0x7f73b0100580 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.825+0000 7f73b7400700 1 -- 172.21.15.111:0/1560725120 >> 172.21.15.111:0/1560725120 conn(0x7f73b00fb6e0 msgr2=0x7f73b00fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:26.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.825+0000 7f73b7400700 1 -- 172.21.15.111:0/1560725120 shutdown_connections 2024-09-11T00:09:26.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.825+0000 7f73b7400700 1 -- 172.21.15.111:0/1560725120 wait complete. 2024-09-11T00:09:26.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.827+0000 7f73b7400700 1 Processor -- start 2024-09-11T00:09:26.829 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.827+0000 7f73b7400700 1 -- start start 2024-09-11T00:09:26.829 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.827+0000 7f73b7400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73b0100170 0x7f73b0195990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:26.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.827+0000 7f73b7400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73b0101370 0x7f73b0195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:26.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.827+0000 7f73b7400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b01964f0 con 0x7f73b0100170 2024-09-11T00:09:26.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.827+0000 7f73b7400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b0196630 con 0x7f73b0101370 2024-09-11T00:09:26.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.828+0000 7f73b4a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73b0100170 0x7f73b0195990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:26.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.828+0000 7f73b4a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73b0100170 0x7f73b0195990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44468/0 (socket says 172.21.15.111:44468) 2024-09-11T00:09:26.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.828+0000 7f73b4a00700 1 -- 172.21.15.111:0/714280362 learned_addr learned my addr 172.21.15.111:0/714280362 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:09:26.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.828+0000 7f73afe00700 1 --2- 172.21.15.111:0/714280362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73b0101370 0x7f73b0195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:26.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.828+0000 7f73b4a00700 1 -- 172.21.15.111:0/714280362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73b0101370 msgr2=0x7f73b0195ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:26.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.828+0000 7f73b4a00700 1 --2- 172.21.15.111:0/714280362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73b0101370 0x7f73b0195ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:26.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.828+0000 7f73b4a00700 1 -- 172.21.15.111:0/714280362 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a40095f0 con 0x7f73b0100170 2024-09-11T00:09:26.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.829+0000 7f73b4a00700 1 --2- 172.21.15.111:0/714280362 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73b0100170 0x7f73b0195990 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f73a400bda0 tx=0x7f73a400bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:26.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.829+0000 7f73ad600700 1 -- 172.21.15.111:0/714280362 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73a401d070 con 0x7f73b0100170 2024-09-11T00:09:26.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.829+0000 7f73ad600700 1 -- 172.21.15.111:0/714280362 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f73a400f460 con 0x7f73b0100170 2024-09-11T00:09:26.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.829+0000 7f73ad600700 1 -- 172.21.15.111:0/714280362 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73a4021640 con 0x7f73b0100170 2024-09-11T00:09:26.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.829+0000 7f73b7400700 1 -- 172.21.15.111:0/714280362 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b019b080 con 0x7f73b0100170 2024-09-11T00:09:26.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.829+0000 7f73b7400700 1 -- 172.21.15.111:0/714280362 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b019b570 con 0x7f73b0100170 2024-09-11T00:09:26.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.830+0000 7f73b7400700 1 -- 172.21.15.111:0/714280362 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b0108cc0 con 0x7f73b0100170 2024-09-11T00:09:26.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.831+0000 7f73ad600700 1 -- 172.21.15.111:0/714280362 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 33) v1 ==== 102433+0+0 (secure 0 0 0) 0x7f73a400f5d0 con 0x7f73b0100170 2024-09-11T00:09:26.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.833+0000 7f73ad600700 1 --2- 172.21.15.111:0/714280362 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f739807a490 0x7f739807c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:26.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.833+0000 7f73ad600700 1 -- 172.21.15.111:0/714280362 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f73a409e260 con 0x7f73b0100170 2024-09-11T00:09:26.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.833+0000 7f73afe00700 1 --2- 172.21.15.111:0/714280362 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f739807a490 0x7f739807c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:26.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.834+0000 7f73afe00700 1 --2- 172.21.15.111:0/714280362 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f739807a490 0x7f739807c940 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f739c007c60 tx=0x7f739c0073d0 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:26.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:26.838+0000 7f73ad600700 1 -- 172.21.15.111:0/714280362 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f73a4061c40 con 0x7f73b0100170 2024-09-11T00:09:27.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.091+0000 7f73b7400700 1 -- 172.21.15.111:0/714280362 --> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f73b0105cc0 con 0x7f739807a490 2024-09-11T00:09:27.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.101+0000 7f73ad600700 1 -- 172.21.15.111:0/714280362 <== mgr.14744 v2:172.21.15.111:6800/3952658086 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f73b0105cc0 con 0x7f739807a490 2024-09-11T00:09:27.104 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:09:27.104 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (10m) 7s ago 12m 13.8M - 0.25.0 c8568f914cd2 eb9e393000ec 2024-09-11T00:09:27.104 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (95s) 7s ago 12m 7109k - 18.2.0 dc2bc1663786 7c40af85314c 2024-09-11T00:09:27.104 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi203 smithi203 running (83s) 9s ago 11m 7365k - 18.2.0 dc2bc1663786 922e3261ff70 2024-09-11T00:09:27.104 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (12m) 7s ago 12m 6665k - 18.2.0 dc2bc1663786 72a36c166ffa 2024-09-11T00:09:27.104 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi203 smithi203 running (11m) 9s ago 11m 6669k - 18.2.0 dc2bc1663786 9b102b6f6d70 2024-09-11T00:09:27.104 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (10m) 7s ago 12m 73.7M - 9.4.7 954c08fa6188 e599624a9c9e 2024-09-11T00:09:27.104 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.gmgsay smithi111 running (5m) 7s ago 5m 14.9M - 18.2.0 dc2bc1663786 795e4ff0075c 2024-09-11T00:09:27.104 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.rucaba smithi111 running (5m) 7s ago 5m 14.9M - 18.2.0 dc2bc1663786 02885adac62c 2024-09-11T00:09:27.104 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.tcrqop smithi203 running (5m) 9s ago 5m 179M - 18.2.0 dc2bc1663786 4df492159bb4 2024-09-11T00:09:27.105 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.uqkbkn smithi203 running (5m) 9s ago 5m 15.0M - 18.2.0 dc2bc1663786 619aa58ea314 2024-09-11T00:09:27.105 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.ypucji smithi111 *:8443,9283,8765 running (75s) 7s ago 14m 505M - 19.3.0-4854-g8f219c47 589dd18248e4 07fa31f49618 2024-09-11T00:09:27.105 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi203.smuspl smithi203 *:8443,9283,8765 running (16s) 9s ago 11m 69.6M - 19.3.0-4854-g8f219c47 589dd18248e4 7e5a93a5ffa7 2024-09-11T00:09:27.105 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (14m) 7s ago 14m 55.7M 2048M 18.2.0 dc2bc1663786 2596322539fb 2024-09-11T00:09:27.105 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi203 smithi203 running (11m) 9s ago 11m 46.5M 2048M 18.2.0 dc2bc1663786 ff8eb7ca85ea 2024-09-11T00:09:27.105 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (12m) 7s ago 12m 8346k - 1.5.0 0da6a335fe13 4fd66ebc9c0d 2024-09-11T00:09:27.105 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi203 smithi203 *:9100 running (11m) 9s ago 11m 8116k - 1.5.0 0da6a335fe13 1cb3ca740f4a 2024-09-11T00:09:27.105 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (9m) 7s ago 9m 206M 1216M 18.2.0 dc2bc1663786 162b7249a591 2024-09-11T00:09:27.105 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (9m) 7s ago 9m 220M 1216M 18.2.0 dc2bc1663786 3614d95b1425 2024-09-11T00:09:27.105 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (8m) 7s ago 8m 178M 1216M 18.2.0 dc2bc1663786 db175d4b09b9 2024-09-11T00:09:27.105 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi203 running (8m) 9s ago 8m 237M 2240M 18.2.0 dc2bc1663786 60b1cef7a70d 2024-09-11T00:09:27.105 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi203 running (7m) 9s ago 7m 203M 2240M 18.2.0 dc2bc1663786 769c7942c42b 2024-09-11T00:09:27.105 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi203 running (7m) 9s ago 7m 189M 2240M 18.2.0 dc2bc1663786 6d824001d40c 2024-09-11T00:09:27.106 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (27s) 7s ago 12m 48.1M - 2.43.0 a07b618ecd1d 5bce02c90483 2024-09-11T00:09:27.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.105+0000 7f73b7400700 1 -- 172.21.15.111:0/714280362 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f739807a490 msgr2=0x7f739807c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:27.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.105+0000 7f73b7400700 1 --2- 172.21.15.111:0/714280362 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f739807a490 0x7f739807c940 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f739c007c60 tx=0x7f739c0073d0 comp rx=0 tx=0).stop 2024-09-11T00:09:27.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.105+0000 7f73b7400700 1 -- 172.21.15.111:0/714280362 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73b0100170 msgr2=0x7f73b0195990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:27.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.105+0000 7f73b7400700 1 --2- 172.21.15.111:0/714280362 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73b0100170 0x7f73b0195990 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f73a400bda0 tx=0x7f73a400bdd0 comp rx=0 tx=0).stop 2024-09-11T00:09:27.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.105+0000 7f73b7400700 1 -- 172.21.15.111:0/714280362 shutdown_connections 2024-09-11T00:09:27.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.105+0000 7f73b7400700 1 --2- 172.21.15.111:0/714280362 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f739807a490 0x7f739807c940 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:27.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.105+0000 7f73b7400700 1 --2- 172.21.15.111:0/714280362 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f73b0100170 0x7f73b0195990 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:27.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.105+0000 7f73b7400700 1 --2- 172.21.15.111:0/714280362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73b0101370 0x7f73b0195ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:27.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.105+0000 7f73b7400700 1 -- 172.21.15.111:0/714280362 >> 172.21.15.111:0/714280362 conn(0x7f73b00fb6e0 msgr2=0x7f73b01045a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:27.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.105+0000 7f73b7400700 1 -- 172.21.15.111:0/714280362 shutdown_connections 2024-09-11T00:09:27.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.105+0000 7f73b7400700 1 -- 172.21.15.111:0/714280362 wait complete. 2024-09-11T00:09:27.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.244+0000 7f4b62000700 1 -- 172.21.15.111:0/2934410328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b5c101350 msgr2=0x7f4b5c1017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:27.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.244+0000 7f4b62000700 1 --2- 172.21.15.111:0/2934410328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b5c101350 0x7f4b5c1017a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4b48009910 tx=0x7f4b48009c20 comp rx=0 tx=0).stop 2024-09-11T00:09:27.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.244+0000 7f4b62000700 1 -- 172.21.15.111:0/2934410328 shutdown_connections 2024-09-11T00:09:27.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.244+0000 7f4b62000700 1 --2- 172.21.15.111:0/2934410328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b5c101350 0x7f4b5c1017a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:27.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.244+0000 7f4b62000700 1 --2- 172.21.15.111:0/2934410328 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b5c100150 0x7f4b5c100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:27.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.244+0000 7f4b62000700 1 -- 172.21.15.111:0/2934410328 >> 172.21.15.111:0/2934410328 conn(0x7f4b5c0fb6e0 msgr2=0x7f4b5c0fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:27.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.244+0000 7f4b62000700 1 -- 172.21.15.111:0/2934410328 shutdown_connections 2024-09-11T00:09:27.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.244+0000 7f4b62000700 1 -- 172.21.15.111:0/2934410328 wait complete. 2024-09-11T00:09:27.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.245+0000 7f4b62000700 1 Processor -- start 2024-09-11T00:09:27.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.246+0000 7f4b62000700 1 -- start start 2024-09-11T00:09:27.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.246+0000 7f4b62000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b5c100150 0x7f4b5c197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:27.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.246+0000 7f4b62000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b5c101350 0x7f4b5c1980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:27.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.246+0000 7f4b62000700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c1986d0 con 0x7f4b5c100150 2024-09-11T00:09:27.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.246+0000 7f4b62000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c198810 con 0x7f4b5c101350 2024-09-11T00:09:27.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.246+0000 7f4b5b400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b5c100150 0x7f4b5c197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:27.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.246+0000 7f4b5b400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b5c100150 0x7f4b5c197b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44492/0 (socket says 172.21.15.111:44492) 2024-09-11T00:09:27.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.246+0000 7f4b5b400700 1 -- 172.21.15.111:0/2194422802 learned_addr learned my addr 172.21.15.111:0/2194422802 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:09:27.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.246+0000 7f4b5aa00700 1 --2- 172.21.15.111:0/2194422802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b5c101350 0x7f4b5c1980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:27.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.247+0000 7f4b5b400700 1 -- 172.21.15.111:0/2194422802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b5c101350 msgr2=0x7f4b5c1980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:27.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.247+0000 7f4b5b400700 1 --2- 172.21.15.111:0/2194422802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b5c101350 0x7f4b5c1980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:27.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.247+0000 7f4b5b400700 1 -- 172.21.15.111:0/2194422802 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b480095f0 con 0x7f4b5c100150 2024-09-11T00:09:27.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.247+0000 7f4b5b400700 1 --2- 172.21.15.111:0/2194422802 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b5c100150 0x7f4b5c197b70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00e8f0 tx=0x7f4b4c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:27.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.247+0000 7f4b53e00700 1 -- 172.21.15.111:0/2194422802 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b4c009790 con 0x7f4b5c100150 2024-09-11T00:09:27.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.247+0000 7f4b53e00700 1 -- 172.21.15.111:0/2194422802 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4b4c00c810 con 0x7f4b5c100150 2024-09-11T00:09:27.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.247+0000 7f4b62000700 1 -- 172.21.15.111:0/2194422802 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b5c19d2c0 con 0x7f4b5c100150 2024-09-11T00:09:27.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.247+0000 7f4b53e00700 1 -- 172.21.15.111:0/2194422802 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b4c003d20 con 0x7f4b5c100150 2024-09-11T00:09:27.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.248+0000 7f4b62000700 1 -- 172.21.15.111:0/2194422802 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5c19d810 con 0x7f4b5c100150 2024-09-11T00:09:27.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.249+0000 7f4b62000700 1 -- 172.21.15.111:0/2194422802 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b5c105430 con 0x7f4b5c100150 2024-09-11T00:09:27.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.250+0000 7f4b53e00700 1 -- 172.21.15.111:0/2194422802 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 33) v1 ==== 102433+0+0 (secure 0 0 0) 0x7f4b4c0041f0 con 0x7f4b5c100150 2024-09-11T00:09:27.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.251+0000 7f4b53e00700 1 --2- 172.21.15.111:0/2194422802 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f4b4007a480 0x7f4b4007c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:27.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.251+0000 7f4b53e00700 1 -- 172.21.15.111:0/2194422802 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f4b4c014070 con 0x7f4b5c100150 2024-09-11T00:09:27.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.251+0000 7f4b5aa00700 1 --2- 172.21.15.111:0/2194422802 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f4b4007a480 0x7f4b4007c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:27.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.252+0000 7f4b5aa00700 1 --2- 172.21.15.111:0/2194422802 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f4b4007a480 0x7f4b4007c930 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4b48009fd0 tx=0x7f4b48005fd0 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:27.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.256+0000 7f4b53e00700 1 -- 172.21.15.111:0/2194422802 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f4b4c060c90 con 0x7f4b5c100150 2024-09-11T00:09:27.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:27 smithi111 ceph-mon[27539]: Upgrade: Updating node-exporter.smithi111 (1/2) 2024-09-11T00:09:27.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:27 smithi111 ceph-mon[27539]: Deploying daemon node-exporter.smithi111 on smithi111 2024-09-11T00:09:27.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:27 smithi111 ceph-mon[27539]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:09:27.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.591+0000 7f4b62000700 1 -- 172.21.15.111:0/2194422802 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4b5c02cee0 con 0x7f4b5c100150 2024-09-11T00:09:27.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.592+0000 7f4b53e00700 1 -- 172.21.15.111:0/2194422802 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f4b4c063db0 con 0x7f4b5c100150 2024-09-11T00:09:27.594 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:09:27.594 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-11T00:09:27.594 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-11T00:09:27.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:09:27.594 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-11T00:09:27.594 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:09:27.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:09:27.594 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-11T00:09:27.594 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-11T00:09:27.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:09:27.594 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-11T00:09:27.595 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-11T00:09:27.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:09:27.595 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-11T00:09:27.595 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-11T00:09:27.595 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:09:27.595 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-11T00:09:27.595 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:09:27.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.594+0000 7f4b62000700 1 -- 172.21.15.111:0/2194422802 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f4b4007a480 msgr2=0x7f4b4007c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:27.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.594+0000 7f4b62000700 1 --2- 172.21.15.111:0/2194422802 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f4b4007a480 0x7f4b4007c930 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4b48009fd0 tx=0x7f4b48005fd0 comp rx=0 tx=0).stop 2024-09-11T00:09:27.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.594+0000 7f4b62000700 1 -- 172.21.15.111:0/2194422802 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b5c100150 msgr2=0x7f4b5c197b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:27.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.594+0000 7f4b62000700 1 --2- 172.21.15.111:0/2194422802 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b5c100150 0x7f4b5c197b70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00e8f0 tx=0x7f4b4c00ec00 comp rx=0 tx=0).stop 2024-09-11T00:09:27.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.594+0000 7f4b62000700 1 -- 172.21.15.111:0/2194422802 shutdown_connections 2024-09-11T00:09:27.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.594+0000 7f4b62000700 1 --2- 172.21.15.111:0/2194422802 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f4b4007a480 0x7f4b4007c930 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:27.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.594+0000 7f4b62000700 1 --2- 172.21.15.111:0/2194422802 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b5c100150 0x7f4b5c197b70 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:27.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.594+0000 7f4b62000700 1 --2- 172.21.15.111:0/2194422802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b5c101350 0x7f4b5c1980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:27.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.594+0000 7f4b62000700 1 -- 172.21.15.111:0/2194422802 >> 172.21.15.111:0/2194422802 conn(0x7f4b5c0fb6e0 msgr2=0x7f4b5c102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:27.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.594+0000 7f4b62000700 1 -- 172.21.15.111:0/2194422802 shutdown_connections 2024-09-11T00:09:27.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.594+0000 7f4b62000700 1 -- 172.21.15.111:0/2194422802 wait complete. 2024-09-11T00:09:27.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.735+0000 7fb000400700 1 -- 172.21.15.111:0/2058796868 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faff80737b0 msgr2=0x7faff8073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:27.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.735+0000 7fb000400700 1 --2- 172.21.15.111:0/2058796868 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faff80737b0 0x7faff8073c20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fafe4009940 tx=0x7fafe4009c50 comp rx=0 tx=0).stop 2024-09-11T00:09:27.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.735+0000 7fb000400700 1 -- 172.21.15.111:0/2058796868 shutdown_connections 2024-09-11T00:09:27.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.735+0000 7fb000400700 1 --2- 172.21.15.111:0/2058796868 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faff80737b0 0x7faff8073c20 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:27.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.735+0000 7fb000400700 1 --2- 172.21.15.111:0/2058796868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faff8074d80 0x7faff80731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:27.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.735+0000 7fb000400700 1 -- 172.21.15.111:0/2058796868 >> 172.21.15.111:0/2058796868 conn(0x7faff80fb6e0 msgr2=0x7faff80fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:27.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.735+0000 7fb000400700 1 -- 172.21.15.111:0/2058796868 shutdown_connections 2024-09-11T00:09:27.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.735+0000 7fb000400700 1 -- 172.21.15.111:0/2058796868 wait complete. 2024-09-11T00:09:27.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.736+0000 7fb000400700 1 Processor -- start 2024-09-11T00:09:27.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.736+0000 7fb000400700 1 -- start start 2024-09-11T00:09:27.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.737+0000 7fb000400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faff80737b0 0x7faff8197c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:27.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.737+0000 7fb000400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faff8074d80 0x7faff81981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:27.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.737+0000 7fb000400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff81987a0 con 0x7faff80737b0 2024-09-11T00:09:27.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.737+0000 7fb000400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff8198910 con 0x7faff8074d80 2024-09-11T00:09:27.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.737+0000 7faffda00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faff80737b0 0x7faff8197c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:27.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.737+0000 7faffda00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faff80737b0 0x7faff8197c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44524/0 (socket says 172.21.15.111:44524) 2024-09-11T00:09:27.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.737+0000 7faffda00700 1 -- 172.21.15.111:0/1004177853 learned_addr learned my addr 172.21.15.111:0/1004177853 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:09:27.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.737+0000 7faffd000700 1 --2- 172.21.15.111:0/1004177853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faff8074d80 0x7faff81981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:27.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.737+0000 7faffda00700 1 -- 172.21.15.111:0/1004177853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faff8074d80 msgr2=0x7faff81981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:27.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.737+0000 7faffda00700 1 --2- 172.21.15.111:0/1004177853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faff8074d80 0x7faff81981a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:27.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.737+0000 7faffda00700 1 -- 172.21.15.111:0/1004177853 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe40095f0 con 0x7faff80737b0 2024-09-11T00:09:27.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.737+0000 7faffd000700 1 --2- 172.21.15.111:0/1004177853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faff8074d80 0x7faff81981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:09:27.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.738+0000 7faffda00700 1 --2- 172.21.15.111:0/1004177853 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faff80737b0 0x7faff8197c60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fafec00b4b0 tx=0x7fafec00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:27.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.738+0000 7faff6000700 1 -- 172.21.15.111:0/1004177853 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafec011800 con 0x7faff80737b0 2024-09-11T00:09:27.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.738+0000 7faff6000700 1 -- 172.21.15.111:0/1004177853 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fafec011e10 con 0x7faff80737b0 2024-09-11T00:09:27.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.738+0000 7fb000400700 1 -- 172.21.15.111:0/1004177853 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff819d3a0 con 0x7faff80737b0 2024-09-11T00:09:27.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.738+0000 7faff6000700 1 -- 172.21.15.111:0/1004177853 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafec00f2e0 con 0x7faff80737b0 2024-09-11T00:09:27.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.738+0000 7fb000400700 1 -- 172.21.15.111:0/1004177853 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff819d970 con 0x7faff80737b0 2024-09-11T00:09:27.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.739+0000 7fb000400700 1 -- 172.21.15.111:0/1004177853 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff810af10 con 0x7faff80737b0 2024-09-11T00:09:27.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.740+0000 7faff6000700 1 -- 172.21.15.111:0/1004177853 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 33) v1 ==== 102433+0+0 (secure 0 0 0) 0x7fafec010380 con 0x7faff80737b0 2024-09-11T00:09:27.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.741+0000 7faff6000700 1 --2- 172.21.15.111:0/1004177853 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fafe007a490 0x7fafe007c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:27.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.741+0000 7faff6000700 1 -- 172.21.15.111:0/1004177853 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fafec09c9b0 con 0x7faff80737b0 2024-09-11T00:09:27.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.741+0000 7faffd000700 1 --2- 172.21.15.111:0/1004177853 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fafe007a490 0x7fafe007c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:27.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.742+0000 7faffd000700 1 --2- 172.21.15.111:0/1004177853 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fafe007a490 0x7fafe007c940 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7faff8199170 tx=0x7fafe4005fd0 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:27.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:27.746+0000 7faff6000700 1 -- 172.21.15.111:0/1004177853 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7fafec060430 con 0x7faff80737b0 2024-09-11T00:09:27.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:27 smithi203 ceph-mon[33225]: Upgrade: Updating node-exporter.smithi111 (1/2) 2024-09-11T00:09:27.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:27 smithi203 ceph-mon[33225]: Deploying daemon node-exporter.smithi111 on smithi111 2024-09-11T00:09:27.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:27 smithi203 ceph-mon[33225]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:09:28.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:28.010+0000 7fb000400700 1 -- 172.21.15.111:0/1004177853 --> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faff8107650 con 0x7fafe007a490 2024-09-11T00:09:28.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:28.011+0000 7faff6000700 1 -- 172.21.15.111:0/1004177853 <== mgr.14744 v2:172.21.15.111:6800/3952658086 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7faff8107650 con 0x7fafe007a490 2024-09-11T00:09:28.013 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:09:28.013 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e", 2024-09-11T00:09:28.013 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-11T00:09:28.013 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-11T00:09:28.013 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-11T00:09:28.014 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr" 2024-09-11T00:09:28.014 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-11T00:09:28.014 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "2/2 daemons upgraded", 2024-09-11T00:09:28.014 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading node-exporter daemons", 2024-09-11T00:09:28.014 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-11T00:09:28.014 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:09:28.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:28.014+0000 7fb000400700 1 -- 172.21.15.111:0/1004177853 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fafe007a490 msgr2=0x7fafe007c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:28.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:28.014+0000 7fb000400700 1 --2- 172.21.15.111:0/1004177853 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fafe007a490 0x7fafe007c940 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7faff8199170 tx=0x7fafe4005fd0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:28.014+0000 7fb000400700 1 -- 172.21.15.111:0/1004177853 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faff80737b0 msgr2=0x7faff8197c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:28.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:28.014+0000 7fb000400700 1 --2- 172.21.15.111:0/1004177853 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faff80737b0 0x7faff8197c60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fafec00b4b0 tx=0x7fafec00b870 comp rx=0 tx=0).stop 2024-09-11T00:09:28.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:28.014+0000 7fb000400700 1 -- 172.21.15.111:0/1004177853 shutdown_connections 2024-09-11T00:09:28.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:28.014+0000 7fb000400700 1 --2- 172.21.15.111:0/1004177853 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fafe007a490 0x7fafe007c940 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:28.014+0000 7fb000400700 1 --2- 172.21.15.111:0/1004177853 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faff80737b0 0x7faff8197c60 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:28.014+0000 7fb000400700 1 --2- 172.21.15.111:0/1004177853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faff8074d80 0x7faff81981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:28.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:28.014+0000 7fb000400700 1 -- 172.21.15.111:0/1004177853 >> 172.21.15.111:0/1004177853 conn(0x7faff80fb6e0 msgr2=0x7faff8105f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:28.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:28.014+0000 7fb000400700 1 -- 172.21.15.111:0/1004177853 shutdown_connections 2024-09-11T00:09:28.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:28.014+0000 7fb000400700 1 -- 172.21.15.111:0/1004177853 wait complete. 2024-09-11T00:09:28.552 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:28 smithi111 ceph-mon[27539]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:09:28.552 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:28 smithi111 ceph-mon[27539]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:09:28.552 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:28 smithi111 ceph-mon[27539]: pgmap v29: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 800 KiB/s wr, 134 op/s 2024-09-11T00:09:28.552 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:28 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/2194422802' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:28.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:28 smithi203 ceph-mon[33225]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:09:28.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:28 smithi203 ceph-mon[33225]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:09:28.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:28 smithi203 ceph-mon[33225]: pgmap v29: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 800 KiB/s wr, 134 op/s 2024-09-11T00:09:28.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:28 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/2194422802' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:29.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:29 smithi111 ceph-mon[27539]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:09:29.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:29 smithi203 ceph-mon[33225]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:09:30.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:30 smithi111 ceph-mon[27539]: pgmap v30: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 11 KiB/s rd, 277 KiB/s wr, 53 op/s 2024-09-11T00:09:30.669 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:30 smithi203 ceph-mon[33225]: pgmap v30: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 11 KiB/s rd, 277 KiB/s wr, 53 op/s 2024-09-11T00:09:31.514 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:31 smithi111 ceph-mon[27539]: pgmap v31: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 11 KiB/s rd, 277 KiB/s wr, 53 op/s 2024-09-11T00:09:31.794 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:31 smithi203 ceph-mon[33225]: pgmap v31: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 11 KiB/s rd, 277 KiB/s wr, 53 op/s 2024-09-11T00:09:33.033 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:32 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:33.033 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:32 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:33.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:32 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:33.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:32 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:33.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:33 smithi111 ceph-mon[27539]: pgmap v32: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 1.2 KiB/s wr, 21 op/s 2024-09-11T00:09:34.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:33 smithi203 ceph-mon[33225]: pgmap v32: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 1.2 KiB/s wr, 21 op/s 2024-09-11T00:09:35.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:34 smithi203 ceph-mon[33225]: Upgrade: Updating node-exporter.smithi203 (2/2) 2024-09-11T00:09:35.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:34 smithi203 ceph-mon[33225]: Deploying daemon node-exporter.smithi203 on smithi203 2024-09-11T00:09:35.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:34 smithi111 ceph-mon[27539]: Upgrade: Updating node-exporter.smithi203 (2/2) 2024-09-11T00:09:35.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:34 smithi111 ceph-mon[27539]: Deploying daemon node-exporter.smithi203 on smithi203 2024-09-11T00:09:36.029 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:35 smithi203 ceph-mon[33225]: pgmap v33: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 682 B/s wr, 1 op/s 2024-09-11T00:09:36.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:35 smithi111 ceph-mon[27539]: pgmap v33: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 682 B/s wr, 1 op/s 2024-09-11T00:09:37.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:36 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:09:37.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:36 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:09:38.140 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:37 smithi203 ceph-mon[33225]: pgmap v34: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 682 B/s wr, 1 op/s 2024-09-11T00:09:38.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:37 smithi111 ceph-mon[27539]: pgmap v34: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 682 B/s wr, 1 op/s 2024-09-11T00:09:40.151 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:39 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:40.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:39 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:40.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:39 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:09:40.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:39 smithi111 ceph-mon[27539]: pgmap v35: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:09:40.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:39 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:40.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:39 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:40.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:39 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:09:40.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:39 smithi203 ceph-mon[33225]: pgmap v35: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:09:42.458 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:42 smithi111 ceph-mon[27539]: pgmap v36: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:09:42.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:42 smithi203 ceph-mon[33225]: pgmap v36: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:09:43.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:43 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:43.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:43 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:43.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:43 smithi111 ceph-mon[27539]: pgmap v37: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:09:43.794 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:43 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:43.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:43 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:43.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:43 smithi203 ceph-mon[33225]: pgmap v37: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:09:44.794 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:44 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:44.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:44 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:44.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:44 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:44.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:44 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:46.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:45 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:46.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:45 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:46.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:45 smithi203 ceph-mon[33225]: pgmap v38: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:09:46.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:45 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:46.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:45 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:46.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:45 smithi111 ceph-mon[27539]: pgmap v38: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:09:47.304 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:47 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:47.304 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:47 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:47.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:47 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:47.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:47 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:48.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:48 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:48.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:48 smithi111 ceph-mon[27539]: pgmap v39: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:09:48.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:48 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:48.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:48 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:48.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:48 smithi203 ceph-mon[33225]: pgmap v39: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:09:48.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:48 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:50.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:49 smithi203 ceph-mon[33225]: pgmap v40: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:09:50.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:49 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:50.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:49 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:50.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:49 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:09:50.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:49 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:09:50.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:49 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:50.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:49 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:09:50.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:49 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:50.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:49 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:50.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:49 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:50.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:49 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:50.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:49 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:50.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:49 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:50.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:49 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:50.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:49 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:50.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:49 smithi111 ceph-mon[27539]: pgmap v40: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:09:50.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:49 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:50.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:49 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:50.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:49 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:09:50.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:49 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:09:50.156 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:49 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:09:50.156 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:49 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:09:50.156 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:49 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:50.156 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:49 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:50.156 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:49 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:50.156 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:49 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:50.156 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:49 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:50.156 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:49 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:50.156 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:49 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:50.157 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:49 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:09:51.232 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:51 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:09:51.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:51 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:09:52.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:52 smithi203 ceph-mon[33225]: pgmap v41: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:09:52.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:52 smithi203 ceph-mon[33225]: Upgrade: Updating prometheus.smithi111 2024-09-11T00:09:52.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:52 smithi111 ceph-mon[27539]: pgmap v41: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:09:52.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:52 smithi111 ceph-mon[27539]: Upgrade: Updating prometheus.smithi111 2024-09-11T00:09:53.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:53 smithi203 ceph-mon[33225]: Deploying daemon prometheus.smithi111 on smithi111 2024-09-11T00:09:53.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:53 smithi111 ceph-mon[27539]: Deploying daemon prometheus.smithi111 on smithi111 2024-09-11T00:09:54.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:54 smithi111 ceph-mon[27539]: pgmap v42: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:09:54.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:54 smithi203 ceph-mon[33225]: pgmap v42: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:09:56.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:56 smithi203 ceph-mon[33225]: pgmap v43: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:09:56.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:56 smithi111 ceph-mon[27539]: pgmap v43: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:09:58.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.164+0000 7fa608c00700 1 -- 172.21.15.111:0/560636303 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa6040737b0 msgr2=0x7fa604073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:58.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.164+0000 7fa608c00700 1 --2- 172.21.15.111:0/560636303 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa6040737b0 0x7fa604073c20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009940 tx=0x7fa5f0009c50 comp rx=0 tx=0).stop 2024-09-11T00:09:58.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.165+0000 7fa608c00700 1 -- 172.21.15.111:0/560636303 shutdown_connections 2024-09-11T00:09:58.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.165+0000 7fa608c00700 1 --2- 172.21.15.111:0/560636303 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa6040737b0 0x7fa604073c20 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:58.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.165+0000 7fa608c00700 1 --2- 172.21.15.111:0/560636303 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa604074d80 0x7fa6040731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:58.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.165+0000 7fa608c00700 1 -- 172.21.15.111:0/560636303 >> 172.21.15.111:0/560636303 conn(0x7fa6040fb6e0 msgr2=0x7fa6040fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:58.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.165+0000 7fa608c00700 1 -- 172.21.15.111:0/560636303 shutdown_connections 2024-09-11T00:09:58.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.165+0000 7fa608c00700 1 -- 172.21.15.111:0/560636303 wait complete. 2024-09-11T00:09:58.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.166+0000 7fa608c00700 1 Processor -- start 2024-09-11T00:09:58.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.166+0000 7fa608c00700 1 -- start start 2024-09-11T00:09:58.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.167+0000 7fa608c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6040737b0 0x7fa60419bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:58.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.167+0000 7fa608c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa604074d80 0x7fa60419c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:58.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.167+0000 7fa608c00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60419cab0 con 0x7fa604074d80 2024-09-11T00:09:58.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.167+0000 7fa608c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60419cbf0 con 0x7fa6040737b0 2024-09-11T00:09:58.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.167+0000 7fa601400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa604074d80 0x7fa60419c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:58.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.167+0000 7fa601400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa604074d80 0x7fa60419c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:46958/0 (socket says 172.21.15.111:46958) 2024-09-11T00:09:58.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.167+0000 7fa601400700 1 -- 172.21.15.111:0/3831267094 learned_addr learned my addr 172.21.15.111:0/3831267094 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:09:58.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.167+0000 7fa601e00700 1 --2- 172.21.15.111:0/3831267094 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6040737b0 0x7fa60419bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:58.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.168+0000 7fa601400700 1 -- 172.21.15.111:0/3831267094 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6040737b0 msgr2=0x7fa60419bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:58.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.168+0000 7fa601400700 1 --2- 172.21.15.111:0/3831267094 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6040737b0 0x7fa60419bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:58.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.168+0000 7fa601400700 1 -- 172.21.15.111:0/3831267094 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f00095f0 con 0x7fa604074d80 2024-09-11T00:09:58.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.168+0000 7fa601e00700 1 --2- 172.21.15.111:0/3831267094 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6040737b0 0x7fa60419bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:09:58.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.169+0000 7fa601400700 1 --2- 172.21.15.111:0/3831267094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa604074d80 0x7fa60419c490 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00055f0 tx=0x7fa5f0005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:58.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.169+0000 7fa5faa00700 1 -- 172.21.15.111:0/3831267094 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5f001d070 con 0x7fa604074d80 2024-09-11T00:09:58.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.169+0000 7fa5faa00700 1 -- 172.21.15.111:0/3831267094 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa5f000f460 con 0x7fa604074d80 2024-09-11T00:09:58.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.169+0000 7fa5faa00700 1 -- 172.21.15.111:0/3831267094 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5f0021640 con 0x7fa604074d80 2024-09-11T00:09:58.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.169+0000 7fa608c00700 1 -- 172.21.15.111:0/3831267094 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6041a1640 con 0x7fa604074d80 2024-09-11T00:09:58.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.169+0000 7fa608c00700 1 -- 172.21.15.111:0/3831267094 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6041a1b60 con 0x7fa604074d80 2024-09-11T00:09:58.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.170+0000 7fa608c00700 1 -- 172.21.15.111:0/3831267094 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6041049e0 con 0x7fa604074d80 2024-09-11T00:09:58.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.174+0000 7fa5faa00700 1 -- 172.21.15.111:0/3831267094 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 33) v1 ==== 102433+0+0 (secure 0 0 0) 0x7fa5f000fad0 con 0x7fa604074d80 2024-09-11T00:09:58.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.175+0000 7fa5faa00700 1 --2- 172.21.15.111:0/3831267094 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fa5e807a4d0 0x7fa5e807c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:58.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.175+0000 7fa5faa00700 1 -- 172.21.15.111:0/3831267094 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fa5f009e670 con 0x7fa604074d80 2024-09-11T00:09:58.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.175+0000 7fa601e00700 1 --2- 172.21.15.111:0/3831267094 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fa5e807a4d0 0x7fa5e807c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:58.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.176+0000 7fa601e00700 1 --2- 172.21.15.111:0/3831267094 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fa5e807a4d0 0x7fa5e807c980 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4005950 tx=0x7fa5f400b410 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:58.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.178+0000 7fa5faa00700 1 -- 172.21.15.111:0/3831267094 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7fa5f00620d0 con 0x7fa604074d80 2024-09-11T00:09:58.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:58 smithi111 ceph-mon[27539]: pgmap v44: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:09:58.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.430+0000 7fa608c00700 1 -- 172.21.15.111:0/3831267094 --> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa604061190 con 0x7fa5e807a4d0 2024-09-11T00:09:58.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.432+0000 7fa5faa00700 1 -- 172.21.15.111:0/3831267094 <== mgr.14744 v2:172.21.15.111:6800/3952658086 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7fa604061190 con 0x7fa5e807a4d0 2024-09-11T00:09:58.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.434+0000 7fa608c00700 1 -- 172.21.15.111:0/3831267094 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fa5e807a4d0 msgr2=0x7fa5e807c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:58.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.434+0000 7fa608c00700 1 --2- 172.21.15.111:0/3831267094 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fa5e807a4d0 0x7fa5e807c980 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4005950 tx=0x7fa5f400b410 comp rx=0 tx=0).stop 2024-09-11T00:09:58.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.434+0000 7fa608c00700 1 -- 172.21.15.111:0/3831267094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa604074d80 msgr2=0x7fa60419c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:58.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.434+0000 7fa608c00700 1 --2- 172.21.15.111:0/3831267094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa604074d80 0x7fa60419c490 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00055f0 tx=0x7fa5f0005620 comp rx=0 tx=0).stop 2024-09-11T00:09:58.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.434+0000 7fa608c00700 1 -- 172.21.15.111:0/3831267094 shutdown_connections 2024-09-11T00:09:58.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.434+0000 7fa608c00700 1 --2- 172.21.15.111:0/3831267094 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fa5e807a4d0 0x7fa5e807c980 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:58.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.434+0000 7fa608c00700 1 --2- 172.21.15.111:0/3831267094 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6040737b0 0x7fa60419bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:58.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.434+0000 7fa608c00700 1 --2- 172.21.15.111:0/3831267094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa604074d80 0x7fa60419c490 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:58.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.434+0000 7fa608c00700 1 -- 172.21.15.111:0/3831267094 >> 172.21.15.111:0/3831267094 conn(0x7fa6040fb6e0 msgr2=0x7fa604101b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:58.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.435+0000 7fa608c00700 1 -- 172.21.15.111:0/3831267094 shutdown_connections 2024-09-11T00:09:58.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.435+0000 7fa608c00700 1 -- 172.21.15.111:0/3831267094 wait complete. 2024-09-11T00:09:58.452 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:09:58.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:58 smithi203 ceph-mon[33225]: pgmap v44: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:09:58.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.588+0000 7fa0c7e00700 1 -- 172.21.15.111:0/2294261883 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0c81011c0 msgr2=0x7fa0c8101610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:58.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.588+0000 7fa0c7e00700 1 --2- 172.21.15.111:0/2294261883 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0c81011c0 0x7fa0c8101610 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4009910 tx=0x7fa0b4009c20 comp rx=0 tx=0).stop 2024-09-11T00:09:58.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.588+0000 7fa0c7e00700 1 -- 172.21.15.111:0/2294261883 shutdown_connections 2024-09-11T00:09:58.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.588+0000 7fa0c7e00700 1 --2- 172.21.15.111:0/2294261883 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0c81011c0 0x7fa0c8101610 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:58.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.588+0000 7fa0c7e00700 1 --2- 172.21.15.111:0/2294261883 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa0c80fffc0 0x7fa0c81003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:58.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.588+0000 7fa0c7e00700 1 -- 172.21.15.111:0/2294261883 >> 172.21.15.111:0/2294261883 conn(0x7fa0c80fb570 msgr2=0x7fa0c80fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:58.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.588+0000 7fa0c7e00700 1 -- 172.21.15.111:0/2294261883 shutdown_connections 2024-09-11T00:09:58.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.588+0000 7fa0c7e00700 1 -- 172.21.15.111:0/2294261883 wait complete. 2024-09-11T00:09:58.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.589+0000 7fa0c7e00700 1 Processor -- start 2024-09-11T00:09:58.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.589+0000 7fa0c7e00700 1 -- start start 2024-09-11T00:09:58.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.589+0000 7fa0c7e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0c80fffc0 0x7fa0c81979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:58.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.589+0000 7fa0c7e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa0c81011c0 0x7fa0c8197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:58.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.590+0000 7fa0c7e00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c8198500 con 0x7fa0c80fffc0 2024-09-11T00:09:58.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.590+0000 7fa0c7e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c8198640 con 0x7fa0c81011c0 2024-09-11T00:09:58.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.590+0000 7fa0c6a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0c80fffc0 0x7fa0c81979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:58.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.590+0000 7fa0c6a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0c80fffc0 0x7fa0c81979a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:46974/0 (socket says 172.21.15.111:46974) 2024-09-11T00:09:58.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.590+0000 7fa0c6a00700 1 -- 172.21.15.111:0/3705534825 learned_addr learned my addr 172.21.15.111:0/3705534825 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:09:58.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.590+0000 7fa0c6000700 1 --2- 172.21.15.111:0/3705534825 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa0c81011c0 0x7fa0c8197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:58.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.590+0000 7fa0c6a00700 1 -- 172.21.15.111:0/3705534825 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa0c81011c0 msgr2=0x7fa0c8197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:58.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.590+0000 7fa0c6a00700 1 --2- 172.21.15.111:0/3705534825 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa0c81011c0 0x7fa0c8197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:58.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.590+0000 7fa0c6a00700 1 -- 172.21.15.111:0/3705534825 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b40095f0 con 0x7fa0c80fffc0 2024-09-11T00:09:58.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.591+0000 7fa0c6a00700 1 --2- 172.21.15.111:0/3705534825 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0c80fffc0 0x7fa0c81979a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800d900 tx=0x7fa0b800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:58.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.591+0000 7fa0bf400700 1 -- 172.21.15.111:0/3705534825 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0b800b920 con 0x7fa0c80fffc0 2024-09-11T00:09:58.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.591+0000 7fa0bf400700 1 -- 172.21.15.111:0/3705534825 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa0b8010460 con 0x7fa0c80fffc0 2024-09-11T00:09:58.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.591+0000 7fa0c7e00700 1 -- 172.21.15.111:0/3705534825 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c819d0f0 con 0x7fa0c80fffc0 2024-09-11T00:09:58.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.591+0000 7fa0bf400700 1 -- 172.21.15.111:0/3705534825 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0b800f590 con 0x7fa0c80fffc0 2024-09-11T00:09:58.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.591+0000 7fa0c7e00700 1 -- 172.21.15.111:0/3705534825 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c819d640 con 0x7fa0c80fffc0 2024-09-11T00:09:58.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.592+0000 7fa0c7e00700 1 -- 172.21.15.111:0/3705534825 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c81052a0 con 0x7fa0c80fffc0 2024-09-11T00:09:58.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.593+0000 7fa0bf400700 1 -- 172.21.15.111:0/3705534825 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 33) v1 ==== 102433+0+0 (secure 0 0 0) 0x7fa0b80105d0 con 0x7fa0c80fffc0 2024-09-11T00:09:58.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.595+0000 7fa0bf400700 1 --2- 172.21.15.111:0/3705534825 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fa0ac07a480 0x7fa0ac07c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:58.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.595+0000 7fa0bf400700 1 -- 172.21.15.111:0/3705534825 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fa0b809caa0 con 0x7fa0c80fffc0 2024-09-11T00:09:58.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.595+0000 7fa0c6000700 1 --2- 172.21.15.111:0/3705534825 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fa0ac07a480 0x7fa0ac07c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:58.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.596+0000 7fa0c6000700 1 --2- 172.21.15.111:0/3705534825 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fa0ac07a480 0x7fa0ac07c930 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4006010 tx=0x7fa0b400b560 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:58.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.600+0000 7fa0bf400700 1 -- 172.21.15.111:0/3705534825 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7fa0b8060400 con 0x7fa0c80fffc0 2024-09-11T00:09:58.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.852+0000 7fa0c7e00700 1 -- 172.21.15.111:0/3705534825 --> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0c8061190 con 0x7fa0ac07a480 2024-09-11T00:09:58.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.854+0000 7fa0bf400700 1 -- 172.21.15.111:0/3705534825 <== mgr.14744 v2:172.21.15.111:6800/3952658086 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7fa0c8061190 con 0x7fa0ac07a480 2024-09-11T00:09:58.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.857+0000 7fa0c7e00700 1 -- 172.21.15.111:0/3705534825 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fa0ac07a480 msgr2=0x7fa0ac07c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:58.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.857+0000 7fa0c7e00700 1 --2- 172.21.15.111:0/3705534825 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fa0ac07a480 0x7fa0ac07c930 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4006010 tx=0x7fa0b400b560 comp rx=0 tx=0).stop 2024-09-11T00:09:58.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.857+0000 7fa0c7e00700 1 -- 172.21.15.111:0/3705534825 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0c80fffc0 msgr2=0x7fa0c81979a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:58.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.857+0000 7fa0c7e00700 1 --2- 172.21.15.111:0/3705534825 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0c80fffc0 0x7fa0c81979a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800d900 tx=0x7fa0b800dc10 comp rx=0 tx=0).stop 2024-09-11T00:09:58.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.857+0000 7fa0c7e00700 1 -- 172.21.15.111:0/3705534825 shutdown_connections 2024-09-11T00:09:58.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.857+0000 7fa0c7e00700 1 --2- 172.21.15.111:0/3705534825 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fa0ac07a480 0x7fa0ac07c930 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:58.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.857+0000 7fa0c7e00700 1 --2- 172.21.15.111:0/3705534825 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0c80fffc0 0x7fa0c81979a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:58.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.857+0000 7fa0c7e00700 1 --2- 172.21.15.111:0/3705534825 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa0c81011c0 0x7fa0c8197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:58.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.857+0000 7fa0c7e00700 1 -- 172.21.15.111:0/3705534825 >> 172.21.15.111:0/3705534825 conn(0x7fa0c80fb570 msgr2=0x7fa0c81023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:58.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.857+0000 7fa0c7e00700 1 -- 172.21.15.111:0/3705534825 shutdown_connections 2024-09-11T00:09:58.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:58.857+0000 7fa0c7e00700 1 -- 172.21.15.111:0/3705534825 wait complete. 2024-09-11T00:09:59.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.000+0000 7fe239600700 1 -- 172.21.15.111:0/208949359 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe234101190 msgr2=0x7fe2341015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:59.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.000+0000 7fe239600700 1 --2- 172.21.15.111:0/208949359 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe234101190 0x7fe2341015e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009910 tx=0x7fe21c009c20 comp rx=0 tx=0).stop 2024-09-11T00:09:59.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.000+0000 7fe239600700 1 -- 172.21.15.111:0/208949359 shutdown_connections 2024-09-11T00:09:59.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.000+0000 7fe239600700 1 --2- 172.21.15.111:0/208949359 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe234101190 0x7fe2341015e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:59.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.000+0000 7fe239600700 1 --2- 172.21.15.111:0/208949359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2340fff90 0x7fe2341003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:59.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.000+0000 7fe239600700 1 -- 172.21.15.111:0/208949359 >> 172.21.15.111:0/208949359 conn(0x7fe2340fb500 msgr2=0x7fe2340fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:59.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.000+0000 7fe239600700 1 -- 172.21.15.111:0/208949359 shutdown_connections 2024-09-11T00:09:59.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.000+0000 7fe239600700 1 -- 172.21.15.111:0/208949359 wait complete. 2024-09-11T00:09:59.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.001+0000 7fe239600700 1 Processor -- start 2024-09-11T00:09:59.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.001+0000 7fe239600700 1 -- start start 2024-09-11T00:09:59.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.002+0000 7fe239600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2340fff90 0x7fe2341979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:59.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.002+0000 7fe239600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe234101190 0x7fe234197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:59.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.002+0000 7fe239600700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe234198480 con 0x7fe234101190 2024-09-11T00:09:59.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.002+0000 7fe239600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2341985c0 con 0x7fe2340fff90 2024-09-11T00:09:59.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.002+0000 7fe22be00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe234101190 0x7fe234197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:59.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.002+0000 7fe22be00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe234101190 0x7fe234197ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:47004/0 (socket says 172.21.15.111:47004) 2024-09-11T00:09:59.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.002+0000 7fe22be00700 1 -- 172.21.15.111:0/1195869556 learned_addr learned my addr 172.21.15.111:0/1195869556 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:09:59.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.002+0000 7fe233e00700 1 --2- 172.21.15.111:0/1195869556 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2340fff90 0x7fe2341979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:59.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.003+0000 7fe22be00700 1 -- 172.21.15.111:0/1195869556 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2340fff90 msgr2=0x7fe2341979b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:59.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.003+0000 7fe22be00700 1 --2- 172.21.15.111:0/1195869556 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2340fff90 0x7fe2341979b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:59.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.003+0000 7fe22be00700 1 -- 172.21.15.111:0/1195869556 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21c0095f0 con 0x7fe234101190 2024-09-11T00:09:59.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.003+0000 7fe22be00700 1 --2- 172.21.15.111:0/1195869556 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe234101190 0x7fe234197ef0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00b5c0 tx=0x7fe21c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:59.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.003+0000 7fe231600700 1 -- 172.21.15.111:0/1195869556 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe21c01d070 con 0x7fe234101190 2024-09-11T00:09:59.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.003+0000 7fe231600700 1 -- 172.21.15.111:0/1195869556 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe21c022470 con 0x7fe234101190 2024-09-11T00:09:59.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.003+0000 7fe239600700 1 -- 172.21.15.111:0/1195869556 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe23419d020 con 0x7fe234101190 2024-09-11T00:09:59.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.003+0000 7fe239600700 1 -- 172.21.15.111:0/1195869556 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe23419d4e0 con 0x7fe234101190 2024-09-11T00:09:59.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.003+0000 7fe231600700 1 -- 172.21.15.111:0/1195869556 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe21c00f690 con 0x7fe234101190 2024-09-11T00:09:59.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.004+0000 7fe239600700 1 -- 172.21.15.111:0/1195869556 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe234105270 con 0x7fe234101190 2024-09-11T00:09:59.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.006+0000 7fe231600700 1 -- 172.21.15.111:0/1195869556 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 33) v1 ==== 102433+0+0 (secure 0 0 0) 0x7fe21c0225e0 con 0x7fe234101190 2024-09-11T00:09:59.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.007+0000 7fe231600700 1 --2- 172.21.15.111:0/1195869556 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fe21807a480 0x7fe21807c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:59.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.007+0000 7fe231600700 1 -- 172.21.15.111:0/1195869556 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fe21c09e780 con 0x7fe234101190 2024-09-11T00:09:59.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.007+0000 7fe233e00700 1 --2- 172.21.15.111:0/1195869556 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fe21807a480 0x7fe21807c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:59.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.008+0000 7fe233e00700 1 --2- 172.21.15.111:0/1195869556 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fe21807a480 0x7fe21807c930 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe234100ff0 tx=0x7fe22400a3b0 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:59.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.012+0000 7fe231600700 1 -- 172.21.15.111:0/1195869556 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7fe21c062180 con 0x7fe234101190 2024-09-11T00:09:59.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.252+0000 7fe239600700 1 -- 172.21.15.111:0/1195869556 --> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe234061190 con 0x7fe21807a480 2024-09-11T00:09:59.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.262+0000 7fe231600700 1 -- 172.21.15.111:0/1195869556 <== mgr.14744 v2:172.21.15.111:6800/3952658086 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fe234061190 con 0x7fe21807a480 2024-09-11T00:09:59.264 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:09:59.264 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (10m) 14s ago 13m 13.8M - 0.25.0 c8568f914cd2 eb9e393000ec 2024-09-11T00:09:59.264 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (2m) 14s ago 13m 7151k - 18.2.0 dc2bc1663786 7c40af85314c 2024-09-11T00:09:59.265 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi203 smithi203 running (115s) 16s ago 12m 7398k - 18.2.0 dc2bc1663786 922e3261ff70 2024-09-11T00:09:59.265 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (13m) 14s ago 13m 6665k - 18.2.0 dc2bc1663786 72a36c166ffa 2024-09-11T00:09:59.265 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi203 smithi203 running (12m) 16s ago 12m 6669k - 18.2.0 dc2bc1663786 9b102b6f6d70 2024-09-11T00:09:59.265 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (10m) 14s ago 12m 73.8M - 9.4.7 954c08fa6188 e599624a9c9e 2024-09-11T00:09:59.265 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.gmgsay smithi111 running (6m) 14s ago 6m 15.1M - 18.2.0 dc2bc1663786 795e4ff0075c 2024-09-11T00:09:59.265 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.rucaba smithi111 running (5m) 14s ago 5m 15.1M - 18.2.0 dc2bc1663786 02885adac62c 2024-09-11T00:09:59.265 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.tcrqop smithi203 running (6m) 16s ago 6m 152M - 18.2.0 dc2bc1663786 4df492159bb4 2024-09-11T00:09:59.265 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.uqkbkn smithi203 running (5m) 16s ago 5m 15.2M - 18.2.0 dc2bc1663786 619aa58ea314 2024-09-11T00:09:59.265 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.ypucji smithi111 *:8443,9283,8765 running (107s) 14s ago 14m 508M - 19.3.0-4854-g8f219c47 589dd18248e4 07fa31f49618 2024-09-11T00:09:59.265 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi203.smuspl smithi203 *:8443,9283,8765 running (48s) 16s ago 11m 451M - 19.3.0-4854-g8f219c47 589dd18248e4 7e5a93a5ffa7 2024-09-11T00:09:59.265 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (14m) 14s ago 15m 56.5M 2048M 18.2.0 dc2bc1663786 2596322539fb 2024-09-11T00:09:59.265 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi203 smithi203 running (11m) 16s ago 11m 48.1M 2048M 18.2.0 dc2bc1663786 ff8eb7ca85ea 2024-09-11T00:09:59.265 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (27s) 14s ago 13m 6467k - 1.7.0 72c9c2088986 ec478ea14488 2024-09-11T00:09:59.265 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi203 smithi203 *:9100 running (20s) 16s ago 12m 2655k - 1.7.0 72c9c2088986 54d461cde1bc 2024-09-11T00:09:59.266 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (10m) 14s ago 10m 210M 1216M 18.2.0 dc2bc1663786 162b7249a591 2024-09-11T00:09:59.266 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (9m) 14s ago 9m 223M 1216M 18.2.0 dc2bc1663786 3614d95b1425 2024-09-11T00:09:59.266 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (9m) 14s ago 9m 182M 1216M 18.2.0 dc2bc1663786 db175d4b09b9 2024-09-11T00:09:59.266 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi203 running (8m) 16s ago 8m 242M 2240M 18.2.0 dc2bc1663786 60b1cef7a70d 2024-09-11T00:09:59.266 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi203 running (8m) 16s ago 8m 207M 2240M 18.2.0 dc2bc1663786 769c7942c42b 2024-09-11T00:09:59.266 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi203 running (7m) 16s ago 7m 190M 2240M 18.2.0 dc2bc1663786 6d824001d40c 2024-09-11T00:09:59.266 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (59s) 14s ago 12m 56.9M - 2.43.0 a07b618ecd1d 5bce02c90483 2024-09-11T00:09:59.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.265+0000 7fe239600700 1 -- 172.21.15.111:0/1195869556 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fe21807a480 msgr2=0x7fe21807c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:59.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.265+0000 7fe239600700 1 --2- 172.21.15.111:0/1195869556 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fe21807a480 0x7fe21807c930 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe234100ff0 tx=0x7fe22400a3b0 comp rx=0 tx=0).stop 2024-09-11T00:09:59.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.265+0000 7fe239600700 1 -- 172.21.15.111:0/1195869556 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe234101190 msgr2=0x7fe234197ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:59.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.265+0000 7fe239600700 1 --2- 172.21.15.111:0/1195869556 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe234101190 0x7fe234197ef0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00b5c0 tx=0x7fe21c00bd70 comp rx=0 tx=0).stop 2024-09-11T00:09:59.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.265+0000 7fe239600700 1 -- 172.21.15.111:0/1195869556 shutdown_connections 2024-09-11T00:09:59.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.265+0000 7fe239600700 1 --2- 172.21.15.111:0/1195869556 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fe21807a480 0x7fe21807c930 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:59.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.265+0000 7fe239600700 1 --2- 172.21.15.111:0/1195869556 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2340fff90 0x7fe2341979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:59.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.265+0000 7fe239600700 1 --2- 172.21.15.111:0/1195869556 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe234101190 0x7fe234197ef0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:59.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.265+0000 7fe239600700 1 -- 172.21.15.111:0/1195869556 >> 172.21.15.111:0/1195869556 conn(0x7fe2340fb500 msgr2=0x7fe2341023b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:59.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.265+0000 7fe239600700 1 -- 172.21.15.111:0/1195869556 shutdown_connections 2024-09-11T00:09:59.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.265+0000 7fe239600700 1 -- 172.21.15.111:0/1195869556 wait complete. 2024-09-11T00:09:59.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.400+0000 7f5bc5c00700 1 -- 172.21.15.111:0/3018467094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5bc0100c30 msgr2=0x7f5bc0103010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:59.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.400+0000 7f5bc5c00700 1 --2- 172.21.15.111:0/3018467094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5bc0100c30 0x7f5bc0103010 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0009910 tx=0x7f5bb0009c20 comp rx=0 tx=0).stop 2024-09-11T00:09:59.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.400+0000 7f5bc5c00700 1 -- 172.21.15.111:0/3018467094 shutdown_connections 2024-09-11T00:09:59.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.400+0000 7f5bc5c00700 1 --2- 172.21.15.111:0/3018467094 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5bc0103550 0x7f5bc0105930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:59.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.400+0000 7f5bc5c00700 1 --2- 172.21.15.111:0/3018467094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5bc0100c30 0x7f5bc0103010 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:59.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.400+0000 7f5bc5c00700 1 -- 172.21.15.111:0/3018467094 >> 172.21.15.111:0/3018467094 conn(0x7f5bc00fa5d0 msgr2=0x7f5bc00fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:59.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.400+0000 7f5bc5c00700 1 -- 172.21.15.111:0/3018467094 shutdown_connections 2024-09-11T00:09:59.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.400+0000 7f5bc5c00700 1 -- 172.21.15.111:0/3018467094 wait complete. 2024-09-11T00:09:59.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.401+0000 7f5bc5c00700 1 Processor -- start 2024-09-11T00:09:59.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.401+0000 7f5bc5c00700 1 -- start start 2024-09-11T00:09:59.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.401+0000 7f5bc5c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5bc0100c30 0x7f5bc0197af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:59.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.401+0000 7f5bc5c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5bc0103550 0x7f5bc0198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:59.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.401+0000 7f5bc5c00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc0198650 con 0x7f5bc0100c30 2024-09-11T00:09:59.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.401+0000 7f5bc5c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc0198790 con 0x7f5bc0103550 2024-09-11T00:09:59.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.402+0000 7f5bbfe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5bc0100c30 0x7f5bc0197af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:59.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.402+0000 7f5bbfe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5bc0100c30 0x7f5bc0197af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:47010/0 (socket says 172.21.15.111:47010) 2024-09-11T00:09:59.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.402+0000 7f5bbfe00700 1 -- 172.21.15.111:0/1782754340 learned_addr learned my addr 172.21.15.111:0/1782754340 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:09:59.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.402+0000 7f5bbf400700 1 --2- 172.21.15.111:0/1782754340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5bc0103550 0x7f5bc0198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:59.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.402+0000 7f5bbfe00700 1 -- 172.21.15.111:0/1782754340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5bc0103550 msgr2=0x7f5bc0198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:59.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.402+0000 7f5bbfe00700 1 --2- 172.21.15.111:0/1782754340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5bc0103550 0x7f5bc0198030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:59.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.402+0000 7f5bbfe00700 1 -- 172.21.15.111:0/1782754340 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb00095f0 con 0x7f5bc0100c30 2024-09-11T00:09:59.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.402+0000 7f5bbfe00700 1 --2- 172.21.15.111:0/1782754340 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5bc0100c30 0x7f5bc0197af0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0005b40 tx=0x7f5bb000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:59.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.403+0000 7f5bbcc00700 1 -- 172.21.15.111:0/1782754340 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bb001d070 con 0x7f5bc0100c30 2024-09-11T00:09:59.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.403+0000 7f5bbcc00700 1 -- 172.21.15.111:0/1782754340 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5bb000f460 con 0x7f5bc0100c30 2024-09-11T00:09:59.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.403+0000 7f5bc5c00700 1 -- 172.21.15.111:0/1782754340 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc019d1e0 con 0x7f5bc0100c30 2024-09-11T00:09:59.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.403+0000 7f5bbcc00700 1 -- 172.21.15.111:0/1782754340 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bb0021640 con 0x7f5bc0100c30 2024-09-11T00:09:59.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.403+0000 7f5bc5c00700 1 -- 172.21.15.111:0/1782754340 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc019d6d0 con 0x7f5bc0100c30 2024-09-11T00:09:59.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.404+0000 7f5bc5c00700 1 -- 172.21.15.111:0/1782754340 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc00fc1b0 con 0x7f5bc0100c30 2024-09-11T00:09:59.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.405+0000 7f5bbcc00700 1 -- 172.21.15.111:0/1782754340 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 33) v1 ==== 102433+0+0 (secure 0 0 0) 0x7f5bb000fa90 con 0x7f5bc0100c30 2024-09-11T00:09:59.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.406+0000 7f5bbcc00700 1 --2- 172.21.15.111:0/1782754340 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f5ba407a480 0x7f5ba407c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:59.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.406+0000 7f5bbcc00700 1 -- 172.21.15.111:0/1782754340 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f5bb009e2c0 con 0x7f5bc0100c30 2024-09-11T00:09:59.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.406+0000 7f5bbf400700 1 --2- 172.21.15.111:0/1782754340 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f5ba407a480 0x7f5ba407c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:59.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.407+0000 7f5bbf400700 1 --2- 172.21.15.111:0/1782754340 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f5ba407a480 0x7f5ba407c930 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00bbd0 tx=0x7f5bac00b5b0 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:59.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.411+0000 7f5bbcc00700 1 -- 172.21.15.111:0/1782754340 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f5bb0061ca0 con 0x7f5bc0100c30 2024-09-11T00:09:59.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.725+0000 7f5bc5c00700 1 -- 172.21.15.111:0/1782754340 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5bc00681b0 con 0x7f5bc0100c30 2024-09-11T00:09:59.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.725+0000 7f5bbcc00700 1 -- 172.21.15.111:0/1782754340 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f5bb0064dc0 con 0x7f5bc0100c30 2024-09-11T00:09:59.728 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:09:59.728 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-11T00:09:59.728 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-11T00:09:59.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:09:59.728 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-11T00:09:59.728 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:09:59.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:09:59.728 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-11T00:09:59.728 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-11T00:09:59.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:09:59.729 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-11T00:09:59.729 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-11T00:09:59.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:09:59.729 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-11T00:09:59.729 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-11T00:09:59.729 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:09:59.729 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-11T00:09:59.729 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:09:59.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.728+0000 7f5bc5c00700 1 -- 172.21.15.111:0/1782754340 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f5ba407a480 msgr2=0x7f5ba407c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:59.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.728+0000 7f5bc5c00700 1 --2- 172.21.15.111:0/1782754340 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f5ba407a480 0x7f5ba407c930 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00bbd0 tx=0x7f5bac00b5b0 comp rx=0 tx=0).stop 2024-09-11T00:09:59.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.728+0000 7f5bc5c00700 1 -- 172.21.15.111:0/1782754340 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5bc0100c30 msgr2=0x7f5bc0197af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:59.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.728+0000 7f5bc5c00700 1 --2- 172.21.15.111:0/1782754340 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5bc0100c30 0x7f5bc0197af0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0005b40 tx=0x7f5bb000be20 comp rx=0 tx=0).stop 2024-09-11T00:09:59.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.728+0000 7f5bc5c00700 1 -- 172.21.15.111:0/1782754340 shutdown_connections 2024-09-11T00:09:59.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.728+0000 7f5bc5c00700 1 --2- 172.21.15.111:0/1782754340 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f5ba407a480 0x7f5ba407c930 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:59.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.728+0000 7f5bc5c00700 1 --2- 172.21.15.111:0/1782754340 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5bc0100c30 0x7f5bc0197af0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:59.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.728+0000 7f5bc5c00700 1 --2- 172.21.15.111:0/1782754340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5bc0103550 0x7f5bc0198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:59.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.728+0000 7f5bc5c00700 1 -- 172.21.15.111:0/1782754340 >> 172.21.15.111:0/1782754340 conn(0x7f5bc00fa5d0 msgr2=0x7f5bc00ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:59.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.729+0000 7f5bc5c00700 1 -- 172.21.15.111:0/1782754340 shutdown_connections 2024-09-11T00:09:59.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.729+0000 7f5bc5c00700 1 -- 172.21.15.111:0/1782754340 wait complete. 2024-09-11T00:09:59.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.868+0000 7f91f7400700 1 -- 172.21.15.111:0/13542402 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f91f0074d00 msgr2=0x7f91f0073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:59.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.868+0000 7f91f7400700 1 --2- 172.21.15.111:0/13542402 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f91f0074d00 0x7f91f0073160 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009910 tx=0x7f91e4009c20 comp rx=0 tx=0).stop 2024-09-11T00:09:59.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.869+0000 7f91f7400700 1 -- 172.21.15.111:0/13542402 shutdown_connections 2024-09-11T00:09:59.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.869+0000 7f91f7400700 1 --2- 172.21.15.111:0/13542402 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91f0073730 0x7f91f0073ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:59.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.869+0000 7f91f7400700 1 --2- 172.21.15.111:0/13542402 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f91f0074d00 0x7f91f0073160 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:59.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.869+0000 7f91f7400700 1 -- 172.21.15.111:0/13542402 >> 172.21.15.111:0/13542402 conn(0x7f91f00fb6e0 msgr2=0x7f91f00fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:59.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.869+0000 7f91f7400700 1 -- 172.21.15.111:0/13542402 shutdown_connections 2024-09-11T00:09:59.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.869+0000 7f91f7400700 1 -- 172.21.15.111:0/13542402 wait complete. 2024-09-11T00:09:59.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.870+0000 7f91f7400700 1 Processor -- start 2024-09-11T00:09:59.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.870+0000 7f91f7400700 1 -- start start 2024-09-11T00:09:59.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.870+0000 7f91f7400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f91f0073730 0x7f91f0197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:59.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.870+0000 7f91f7400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91f0074d00 0x7f91f01980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:59.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.870+0000 7f91f7400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f01986c0 con 0x7f91f0073730 2024-09-11T00:09:59.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.870+0000 7f91f7400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f0198800 con 0x7f91f0074d00 2024-09-11T00:09:59.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.871+0000 7f91f4a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f91f0073730 0x7f91f0197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:59.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.871+0000 7f91f4a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f91f0073730 0x7f91f0197b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:47038/0 (socket says 172.21.15.111:47038) 2024-09-11T00:09:59.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.871+0000 7f91f4a00700 1 -- 172.21.15.111:0/2729235565 learned_addr learned my addr 172.21.15.111:0/2729235565 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:09:59.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.871+0000 7f91efe00700 1 --2- 172.21.15.111:0/2729235565 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91f0074d00 0x7f91f01980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:59.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.871+0000 7f91f4a00700 1 -- 172.21.15.111:0/2729235565 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91f0074d00 msgr2=0x7f91f01980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:59.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.871+0000 7f91f4a00700 1 --2- 172.21.15.111:0/2729235565 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91f0074d00 0x7f91f01980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:59.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.871+0000 7f91f4a00700 1 -- 172.21.15.111:0/2729235565 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e40095f0 con 0x7f91f0073730 2024-09-11T00:09:59.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.871+0000 7f91efe00700 1 --2- 172.21.15.111:0/2729235565 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91f0074d00 0x7f91f01980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:09:59.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.871+0000 7f91f4a00700 1 --2- 172.21.15.111:0/2729235565 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f91f0073730 0x7f91f0197b60 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f91e4005b40 tx=0x7f91e400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:59.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.872+0000 7f91ed600700 1 -- 172.21.15.111:0/2729235565 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91e401d070 con 0x7f91f0073730 2024-09-11T00:09:59.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.872+0000 7f91ed600700 1 -- 172.21.15.111:0/2729235565 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f91e400f460 con 0x7f91f0073730 2024-09-11T00:09:59.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.872+0000 7f91f7400700 1 -- 172.21.15.111:0/2729235565 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f019d250 con 0x7f91f0073730 2024-09-11T00:09:59.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.872+0000 7f91ed600700 1 -- 172.21.15.111:0/2729235565 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91e4021640 con 0x7f91f0073730 2024-09-11T00:09:59.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.872+0000 7f91f7400700 1 -- 172.21.15.111:0/2729235565 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f019d740 con 0x7f91f0073730 2024-09-11T00:09:59.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.873+0000 7f91f7400700 1 -- 172.21.15.111:0/2729235565 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f010aea0 con 0x7f91f0073730 2024-09-11T00:09:59.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.874+0000 7f91ed600700 1 -- 172.21.15.111:0/2729235565 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 33) v1 ==== 102433+0+0 (secure 0 0 0) 0x7f91e400fa90 con 0x7f91f0073730 2024-09-11T00:09:59.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.875+0000 7f91ed600700 1 --2- 172.21.15.111:0/2729235565 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f91d807a480 0x7f91d807c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:59.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.875+0000 7f91ed600700 1 -- 172.21.15.111:0/2729235565 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f91e409e330 con 0x7f91f0073730 2024-09-11T00:09:59.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.875+0000 7f91efe00700 1 --2- 172.21.15.111:0/2729235565 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f91d807a480 0x7f91d807c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:59.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.876+0000 7f91efe00700 1 --2- 172.21.15.111:0/2729235565 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f91d807a480 0x7f91d807c930 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f91dc005fd0 tx=0x7f91dc005ee0 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:59.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:09:59.880+0000 7f91ed600700 1 -- 172.21.15.111:0/2729235565 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f91e4061d10 con 0x7f91f0073730 2024-09-11T00:10:00.003 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:59 smithi111 ceph-mon[27539]: from='client.14836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:10:00.003 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:59 smithi111 ceph-mon[27539]: from='client.14840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:10:00.003 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:59 smithi111 ceph-mon[27539]: pgmap v45: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:00.004 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:59 smithi111 ceph-mon[27539]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:10:00.004 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:09:59 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/1782754340' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:00.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:00.129+0000 7f91f7400700 1 -- 172.21.15.111:0/2729235565 --> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f91f01076f0 con 0x7f91d807a480 2024-09-11T00:10:00.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:00.130+0000 7f91ed600700 1 -- 172.21.15.111:0/2729235565 <== mgr.14744 v2:172.21.15.111:6800/3952658086 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f91f01076f0 con 0x7f91d807a480 2024-09-11T00:10:00.132 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:10:00.133 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e", 2024-09-11T00:10:00.133 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-11T00:10:00.133 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-11T00:10:00.133 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-11T00:10:00.133 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr" 2024-09-11T00:10:00.133 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-11T00:10:00.134 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "2/2 daemons upgraded", 2024-09-11T00:10:00.134 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading prometheus daemons", 2024-09-11T00:10:00.134 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-11T00:10:00.134 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:10:00.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:00.133+0000 7f91f7400700 1 -- 172.21.15.111:0/2729235565 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f91d807a480 msgr2=0x7f91d807c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:00.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:00.133+0000 7f91f7400700 1 --2- 172.21.15.111:0/2729235565 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f91d807a480 0x7f91d807c930 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f91dc005fd0 tx=0x7f91dc005ee0 comp rx=0 tx=0).stop 2024-09-11T00:10:00.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:00.133+0000 7f91f7400700 1 -- 172.21.15.111:0/2729235565 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f91f0073730 msgr2=0x7f91f0197b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:00.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:00.133+0000 7f91f7400700 1 --2- 172.21.15.111:0/2729235565 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f91f0073730 0x7f91f0197b60 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f91e4005b40 tx=0x7f91e400be20 comp rx=0 tx=0).stop 2024-09-11T00:10:00.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:00.133+0000 7f91f7400700 1 -- 172.21.15.111:0/2729235565 shutdown_connections 2024-09-11T00:10:00.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:00.133+0000 7f91f7400700 1 --2- 172.21.15.111:0/2729235565 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f91d807a480 0x7f91d807c930 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:00.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:00.133+0000 7f91f7400700 1 --2- 172.21.15.111:0/2729235565 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f91f0073730 0x7f91f0197b60 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:00.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:00.133+0000 7f91f7400700 1 --2- 172.21.15.111:0/2729235565 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91f0074d00 0x7f91f01980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:00.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:00.133+0000 7f91f7400700 1 -- 172.21.15.111:0/2729235565 >> 172.21.15.111:0/2729235565 conn(0x7f91f00fb6e0 msgr2=0x7f91f0105fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:00.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:00.134+0000 7f91f7400700 1 -- 172.21.15.111:0/2729235565 shutdown_connections 2024-09-11T00:10:00.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:00.134+0000 7f91f7400700 1 -- 172.21.15.111:0/2729235565 wait complete. 2024-09-11T00:10:00.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:59 smithi203 ceph-mon[33225]: from='client.14836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:10:00.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:59 smithi203 ceph-mon[33225]: from='client.14840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:10:00.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:59 smithi203 ceph-mon[33225]: pgmap v45: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:00.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:59 smithi203 ceph-mon[33225]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:10:00.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:09:59 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/1782754340' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:00.933 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:00 smithi203 ceph-mon[33225]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-11T00:10:00.933 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:00 smithi203 ceph-mon[33225]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-11T00:10:00.933 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:00 smithi203 ceph-mon[33225]: fs cephfs has deprecated feature inline_data enabled. 2024-09-11T00:10:00.933 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:00 smithi203 ceph-mon[33225]: from='client.14852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:10:01.051 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:00 smithi111 ceph-mon[27539]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-11T00:10:01.051 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:00 smithi111 ceph-mon[27539]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-11T00:10:01.051 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:00 smithi111 ceph-mon[27539]: fs cephfs has deprecated feature inline_data enabled. 2024-09-11T00:10:01.051 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:00 smithi111 ceph-mon[27539]: from='client.14852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:10:01.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:01 smithi111 ceph-mon[27539]: pgmap v46: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:02.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:01 smithi203 ceph-mon[33225]: pgmap v46: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:04.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:04 smithi203 ceph-mon[33225]: pgmap v47: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:04.611 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:04 smithi111 ceph-mon[27539]: pgmap v47: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:06.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:06 smithi203 ceph-mon[33225]: pgmap v48: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:06.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:06 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:06.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:06 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:06.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:06 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:10:06.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:06 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:10:06.595 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:06 smithi111 ceph-mon[27539]: pgmap v48: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:06.595 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:06 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:06.595 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:06 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:06.596 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:06 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:10:06.596 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:06 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:10:08.449 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:08 smithi111 ceph-mon[27539]: pgmap v49: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-11T00:10:08.544 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:08 smithi203 ceph-mon[33225]: pgmap v49: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-11T00:10:09.280 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:09 smithi111 ceph-mon[27539]: mgrmap e34: smithi111.ypucji(active, since 93s), standbys: smithi203.smuspl 2024-09-11T00:10:09.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:09 smithi203 ceph-mon[33225]: mgrmap e34: smithi111.ypucji(active, since 93s), standbys: smithi203.smuspl 2024-09-11T00:10:10.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:10 smithi203 ceph-mon[33225]: pgmap v50: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-11T00:10:10.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:10 smithi111 ceph-mon[27539]: pgmap v50: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-11T00:10:12.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:12 smithi111 ceph-mon[27539]: pgmap v51: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-11T00:10:12.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:12 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:12.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:12 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:12.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:12 smithi203 ceph-mon[33225]: pgmap v51: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-11T00:10:12.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:12 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:12.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:12 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:13.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:13 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:13.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:13 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:13.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:13 smithi111 ceph-mon[27539]: pgmap v52: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-11T00:10:14.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:13 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:14.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:13 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:14.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:13 smithi203 ceph-mon[33225]: pgmap v52: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-11T00:10:16.344 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:16 smithi111 ceph-mon[27539]: pgmap v53: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-11T00:10:16.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:16 smithi203 ceph-mon[33225]: pgmap v53: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-11T00:10:17.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:17 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:17.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:17 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:17.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:17 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:10:17.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:17 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:10:17.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:17 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:17.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:17 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-11T00:10:17.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:17 smithi111 ceph-mon[27539]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-11T00:10:17.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:17 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:10:17.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:17 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:17.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:17 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:17.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:17 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:17.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:17 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:17.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:17 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:17.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:17 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:17.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:17 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:17.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:17 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:17.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:17 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:17.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:17 smithi111 ceph-mon[27539]: pgmap v54: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-11T00:10:17.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:17 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:17.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:17 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:17.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:17 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:10:17.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:17 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:10:17.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:17 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:17.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:17 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-11T00:10:17.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:17 smithi203 ceph-mon[33225]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-11T00:10:17.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:17 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:10:17.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:17 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:17.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:17 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:17.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:17 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:17.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:17 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:17.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:17 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:17.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:17 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:17.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:17 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:17.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:17 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:17.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:17 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:17.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:17 smithi203 ceph-mon[33225]: pgmap v54: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-11T00:10:18.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:18 smithi111 ceph-mon[27539]: Upgrade: Updating alertmanager.smithi111 2024-09-11T00:10:18.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:18 smithi111 ceph-mon[27539]: Deploying daemon alertmanager.smithi111 on smithi111 2024-09-11T00:10:18.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:18 smithi203 ceph-mon[33225]: Upgrade: Updating alertmanager.smithi111 2024-09-11T00:10:18.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:18 smithi203 ceph-mon[33225]: Deploying daemon alertmanager.smithi111 on smithi111 2024-09-11T00:10:20.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:19 smithi111 ceph-mon[27539]: pgmap v55: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:20.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:19 smithi203 ceph-mon[33225]: pgmap v55: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:21.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:21 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:10:21.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:21 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:10:22.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:22 smithi203 ceph-mon[33225]: pgmap v56: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:22.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:22 smithi111 ceph-mon[27539]: pgmap v56: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:24.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:24 smithi203 ceph-mon[33225]: pgmap v57: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:24.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:24 smithi111 ceph-mon[27539]: pgmap v57: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:26.326 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:26 smithi111 ceph-mon[27539]: pgmap v58: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:26.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:26 smithi203 ceph-mon[33225]: pgmap v58: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:28.395 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:28 smithi111 ceph-mon[27539]: pgmap v59: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:28.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:28 smithi203 ceph-mon[33225]: pgmap v59: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:29.484 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:29 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:29.485 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:29 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:29.485 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:29 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:10:29.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:29 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:29.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:29 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:29.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:29 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:10:30.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.278+0000 7fc5c2c00700 1 -- 172.21.15.111:0/3170668199 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc5bc101350 msgr2=0x7fc5bc1017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:30.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.278+0000 7fc5c2c00700 1 --2- 172.21.15.111:0/3170668199 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc5bc101350 0x7fc5bc1017a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8009910 tx=0x7fc5a8009c20 comp rx=0 tx=0).stop 2024-09-11T00:10:30.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.278+0000 7fc5c2c00700 1 -- 172.21.15.111:0/3170668199 shutdown_connections 2024-09-11T00:10:30.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.278+0000 7fc5c2c00700 1 --2- 172.21.15.111:0/3170668199 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc5bc101350 0x7fc5bc1017a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:30.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.278+0000 7fc5c2c00700 1 --2- 172.21.15.111:0/3170668199 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc5bc100150 0x7fc5bc100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:30.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.278+0000 7fc5c2c00700 1 -- 172.21.15.111:0/3170668199 >> 172.21.15.111:0/3170668199 conn(0x7fc5bc0fb6e0 msgr2=0x7fc5bc0fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:30.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.278+0000 7fc5c2c00700 1 -- 172.21.15.111:0/3170668199 shutdown_connections 2024-09-11T00:10:30.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.278+0000 7fc5c2c00700 1 -- 172.21.15.111:0/3170668199 wait complete. 2024-09-11T00:10:30.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.279+0000 7fc5c2c00700 1 Processor -- start 2024-09-11T00:10:30.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.279+0000 7fc5c2c00700 1 -- start start 2024-09-11T00:10:30.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.279+0000 7fc5c2c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc5bc100150 0x7fc5bc197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:30.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.279+0000 7fc5c2c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc5bc101350 0x7fc5bc1980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:30.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.279+0000 7fc5c2c00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc1986d0 con 0x7fc5bc100150 2024-09-11T00:10:30.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.279+0000 7fc5c2c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc198810 con 0x7fc5bc101350 2024-09-11T00:10:30.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.280+0000 7fc5bbe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc5bc100150 0x7fc5bc197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:30.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.280+0000 7fc5bbe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc5bc100150 0x7fc5bc197b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50306/0 (socket says 172.21.15.111:50306) 2024-09-11T00:10:30.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.280+0000 7fc5bbe00700 1 -- 172.21.15.111:0/1122892381 learned_addr learned my addr 172.21.15.111:0/1122892381 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:10:30.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.280+0000 7fc5bb400700 1 --2- 172.21.15.111:0/1122892381 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc5bc101350 0x7fc5bc1980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:30.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.280+0000 7fc5bbe00700 1 -- 172.21.15.111:0/1122892381 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc5bc101350 msgr2=0x7fc5bc1980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:30.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.280+0000 7fc5bbe00700 1 --2- 172.21.15.111:0/1122892381 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc5bc101350 0x7fc5bc1980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:30.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.280+0000 7fc5bbe00700 1 -- 172.21.15.111:0/1122892381 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a80095f0 con 0x7fc5bc100150 2024-09-11T00:10:30.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.280+0000 7fc5bb400700 1 --2- 172.21.15.111:0/1122892381 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc5bc101350 0x7fc5bc1980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:10:30.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.280+0000 7fc5bbe00700 1 --2- 172.21.15.111:0/1122892381 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc5bc100150 0x7fc5bc197b70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac00d900 tx=0x7fc5ac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:30.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.281+0000 7fc5b8c00700 1 -- 172.21.15.111:0/1122892381 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5ac0041f0 con 0x7fc5bc100150 2024-09-11T00:10:30.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.281+0000 7fc5b8c00700 1 -- 172.21.15.111:0/1122892381 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc5ac004350 con 0x7fc5bc100150 2024-09-11T00:10:30.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.281+0000 7fc5b8c00700 1 -- 172.21.15.111:0/1122892381 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5ac003da0 con 0x7fc5bc100150 2024-09-11T00:10:30.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.281+0000 7fc5c2c00700 1 -- 172.21.15.111:0/1122892381 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5bc19d2c0 con 0x7fc5bc100150 2024-09-11T00:10:30.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.281+0000 7fc5c2c00700 1 -- 172.21.15.111:0/1122892381 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5bc19d810 con 0x7fc5bc100150 2024-09-11T00:10:30.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.282+0000 7fc5c2c00700 1 -- 172.21.15.111:0/1122892381 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5bc105430 con 0x7fc5bc100150 2024-09-11T00:10:30.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.283+0000 7fc5b8c00700 1 -- 172.21.15.111:0/1122892381 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 34) v1 ==== 102331+0+0 (secure 0 0 0) 0x7fc5ac009730 con 0x7fc5bc100150 2024-09-11T00:10:30.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.284+0000 7fc5b8c00700 1 --2- 172.21.15.111:0/1122892381 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fc5a007a370 0x7fc5a007c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:30.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.284+0000 7fc5b8c00700 1 -- 172.21.15.111:0/1122892381 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fc5ac09cef0 con 0x7fc5bc100150 2024-09-11T00:10:30.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.284+0000 7fc5bb400700 1 --2- 172.21.15.111:0/1122892381 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fc5a007a370 0x7fc5a007c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:30.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.285+0000 7fc5bb400700 1 --2- 172.21.15.111:0/1122892381 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fc5a007a370 0x7fc5a007c820 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc5a800b5c0 tx=0x7fc5a8005960 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:30.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.289+0000 7fc5b8c00700 1 -- 172.21.15.111:0/1122892381 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7fc5ac060a70 con 0x7fc5bc100150 2024-09-11T00:10:30.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:30 smithi111 ceph-mon[27539]: pgmap v60: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:30.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.534+0000 7fc5c2c00700 1 -- 172.21.15.111:0/1122892381 --> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5bc061190 con 0x7fc5a007a370 2024-09-11T00:10:30.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.536+0000 7fc5b8c00700 1 -- 172.21.15.111:0/1122892381 <== mgr.14744 v2:172.21.15.111:6800/3952658086 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fc5bc061190 con 0x7fc5a007a370 2024-09-11T00:10:30.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.539+0000 7fc5c2c00700 1 -- 172.21.15.111:0/1122892381 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fc5a007a370 msgr2=0x7fc5a007c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:30.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.539+0000 7fc5c2c00700 1 --2- 172.21.15.111:0/1122892381 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fc5a007a370 0x7fc5a007c820 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc5a800b5c0 tx=0x7fc5a8005960 comp rx=0 tx=0).stop 2024-09-11T00:10:30.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.539+0000 7fc5c2c00700 1 -- 172.21.15.111:0/1122892381 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc5bc100150 msgr2=0x7fc5bc197b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:30.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.539+0000 7fc5c2c00700 1 --2- 172.21.15.111:0/1122892381 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc5bc100150 0x7fc5bc197b70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac00d900 tx=0x7fc5ac00dcc0 comp rx=0 tx=0).stop 2024-09-11T00:10:30.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.539+0000 7fc5c2c00700 1 -- 172.21.15.111:0/1122892381 shutdown_connections 2024-09-11T00:10:30.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.539+0000 7fc5c2c00700 1 --2- 172.21.15.111:0/1122892381 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fc5a007a370 0x7fc5a007c820 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:30.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.539+0000 7fc5c2c00700 1 --2- 172.21.15.111:0/1122892381 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc5bc100150 0x7fc5bc197b70 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:30.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.539+0000 7fc5c2c00700 1 --2- 172.21.15.111:0/1122892381 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc5bc101350 0x7fc5bc1980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:30.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.539+0000 7fc5c2c00700 1 -- 172.21.15.111:0/1122892381 >> 172.21.15.111:0/1122892381 conn(0x7fc5bc0fb6e0 msgr2=0x7fc5bc102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:30.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.539+0000 7fc5c2c00700 1 -- 172.21.15.111:0/1122892381 shutdown_connections 2024-09-11T00:10:30.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.539+0000 7fc5c2c00700 1 -- 172.21.15.111:0/1122892381 wait complete. 2024-09-11T00:10:30.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:30 smithi203 ceph-mon[33225]: pgmap v60: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:30.557 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:10:30.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.691+0000 7fd688200700 1 -- 172.21.15.111:0/1650538594 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd680101350 msgr2=0x7fd6801017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:30.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.691+0000 7fd688200700 1 --2- 172.21.15.111:0/1650538594 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd680101350 0x7fd6801017a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd66c009910 tx=0x7fd66c009c20 comp rx=0 tx=0).stop 2024-09-11T00:10:30.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.691+0000 7fd688200700 1 -- 172.21.15.111:0/1650538594 shutdown_connections 2024-09-11T00:10:30.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.691+0000 7fd688200700 1 --2- 172.21.15.111:0/1650538594 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd680101350 0x7fd6801017a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:30.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.691+0000 7fd688200700 1 --2- 172.21.15.111:0/1650538594 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd680100150 0x7fd680100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:30.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.691+0000 7fd688200700 1 -- 172.21.15.111:0/1650538594 >> 172.21.15.111:0/1650538594 conn(0x7fd6800fb6e0 msgr2=0x7fd6800fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:30.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.691+0000 7fd688200700 1 -- 172.21.15.111:0/1650538594 shutdown_connections 2024-09-11T00:10:30.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.691+0000 7fd688200700 1 -- 172.21.15.111:0/1650538594 wait complete. 2024-09-11T00:10:30.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.692+0000 7fd688200700 1 Processor -- start 2024-09-11T00:10:30.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.692+0000 7fd688200700 1 -- start start 2024-09-11T00:10:30.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.692+0000 7fd688200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd680100150 0x7fd680195960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:30.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.692+0000 7fd688200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd680101350 0x7fd680195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:30.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.692+0000 7fd688200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd680196430 con 0x7fd680101350 2024-09-11T00:10:30.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.692+0000 7fd688200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd680196570 con 0x7fd680100150 2024-09-11T00:10:30.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.693+0000 7fd684e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd680101350 0x7fd680195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:30.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.693+0000 7fd684e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd680101350 0x7fd680195ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50330/0 (socket says 172.21.15.111:50330) 2024-09-11T00:10:30.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.693+0000 7fd684e00700 1 -- 172.21.15.111:0/1724533723 learned_addr learned my addr 172.21.15.111:0/1724533723 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:10:30.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.693+0000 7fd685800700 1 --2- 172.21.15.111:0/1724533723 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd680100150 0x7fd680195960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:30.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.693+0000 7fd684e00700 1 -- 172.21.15.111:0/1724533723 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd680100150 msgr2=0x7fd680195960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:30.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.693+0000 7fd684e00700 1 --2- 172.21.15.111:0/1724533723 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd680100150 0x7fd680195960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:30.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.693+0000 7fd684e00700 1 -- 172.21.15.111:0/1724533723 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66c0095f0 con 0x7fd680101350 2024-09-11T00:10:30.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.693+0000 7fd684e00700 1 --2- 172.21.15.111:0/1724533723 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd680101350 0x7fd680195ea0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd66c006010 tx=0x7fd66c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:30.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.694+0000 7fd67e000700 1 -- 172.21.15.111:0/1724533723 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd66c01d070 con 0x7fd680101350 2024-09-11T00:10:30.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.694+0000 7fd67e000700 1 -- 172.21.15.111:0/1724533723 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd66c00f460 con 0x7fd680101350 2024-09-11T00:10:30.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.694+0000 7fd688200700 1 -- 172.21.15.111:0/1724533723 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd68019afd0 con 0x7fd680101350 2024-09-11T00:10:30.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.694+0000 7fd67e000700 1 -- 172.21.15.111:0/1724533723 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd66c021640 con 0x7fd680101350 2024-09-11T00:10:30.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.694+0000 7fd688200700 1 -- 172.21.15.111:0/1724533723 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68019b490 con 0x7fd680101350 2024-09-11T00:10:30.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.695+0000 7fd688200700 1 -- 172.21.15.111:0/1724533723 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd680108ca0 con 0x7fd680101350 2024-09-11T00:10:30.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.696+0000 7fd67e000700 1 -- 172.21.15.111:0/1724533723 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 34) v1 ==== 102331+0+0 (secure 0 0 0) 0x7fd66c003a60 con 0x7fd680101350 2024-09-11T00:10:30.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.697+0000 7fd67e000700 1 --2- 172.21.15.111:0/1724533723 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fd66807a370 0x7fd66807c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:30.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.697+0000 7fd67e000700 1 -- 172.21.15.111:0/1724533723 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fd66c09e0b0 con 0x7fd680101350 2024-09-11T00:10:30.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.697+0000 7fd685800700 1 --2- 172.21.15.111:0/1724533723 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fd66807a370 0x7fd66807c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:30.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.698+0000 7fd685800700 1 --2- 172.21.15.111:0/1724533723 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fd66807a370 0x7fd66807c820 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd6801011b0 tx=0x7fd67400a3b0 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:30.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.702+0000 7fd67e000700 1 -- 172.21.15.111:0/1724533723 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7fd66c061cb0 con 0x7fd680101350 2024-09-11T00:10:30.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.965+0000 7fd688200700 1 -- 172.21.15.111:0/1724533723 --> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd680105ca0 con 0x7fd66807a370 2024-09-11T00:10:30.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.966+0000 7fd67e000700 1 -- 172.21.15.111:0/1724533723 <== mgr.14744 v2:172.21.15.111:6800/3952658086 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fd680105ca0 con 0x7fd66807a370 2024-09-11T00:10:30.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.968+0000 7fd688200700 1 -- 172.21.15.111:0/1724533723 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fd66807a370 msgr2=0x7fd66807c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:30.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.968+0000 7fd688200700 1 --2- 172.21.15.111:0/1724533723 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fd66807a370 0x7fd66807c820 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd6801011b0 tx=0x7fd67400a3b0 comp rx=0 tx=0).stop 2024-09-11T00:10:30.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.969+0000 7fd688200700 1 -- 172.21.15.111:0/1724533723 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd680101350 msgr2=0x7fd680195ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:30.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.969+0000 7fd688200700 1 --2- 172.21.15.111:0/1724533723 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd680101350 0x7fd680195ea0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd66c006010 tx=0x7fd66c00bd70 comp rx=0 tx=0).stop 2024-09-11T00:10:30.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.969+0000 7fd688200700 1 -- 172.21.15.111:0/1724533723 shutdown_connections 2024-09-11T00:10:30.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.969+0000 7fd688200700 1 --2- 172.21.15.111:0/1724533723 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fd66807a370 0x7fd66807c820 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:30.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.969+0000 7fd688200700 1 --2- 172.21.15.111:0/1724533723 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd680100150 0x7fd680195960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:30.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.969+0000 7fd688200700 1 --2- 172.21.15.111:0/1724533723 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd680101350 0x7fd680195ea0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:30.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.969+0000 7fd688200700 1 -- 172.21.15.111:0/1724533723 >> 172.21.15.111:0/1724533723 conn(0x7fd6800fb6e0 msgr2=0x7fd680104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:30.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.969+0000 7fd688200700 1 -- 172.21.15.111:0/1724533723 shutdown_connections 2024-09-11T00:10:30.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:30.969+0000 7fd688200700 1 -- 172.21.15.111:0/1724533723 wait complete. 2024-09-11T00:10:31.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.110+0000 7f4c9aa00700 1 -- 172.21.15.111:0/3982493194 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c94100150 msgr2=0x7f4c94100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:31.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.110+0000 7f4c9aa00700 1 --2- 172.21.15.111:0/3982493194 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c94100150 0x7f4c94100560 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4c84009910 tx=0x7f4c84009c20 comp rx=0 tx=0).stop 2024-09-11T00:10:31.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.111+0000 7f4c9aa00700 1 -- 172.21.15.111:0/3982493194 shutdown_connections 2024-09-11T00:10:31.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.111+0000 7f4c9aa00700 1 --2- 172.21.15.111:0/3982493194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4c94101350 0x7f4c941017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.111+0000 7f4c9aa00700 1 --2- 172.21.15.111:0/3982493194 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c94100150 0x7f4c94100560 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.111+0000 7f4c9aa00700 1 -- 172.21.15.111:0/3982493194 >> 172.21.15.111:0/3982493194 conn(0x7f4c940fb6e0 msgr2=0x7f4c940fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:31.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.111+0000 7f4c9aa00700 1 -- 172.21.15.111:0/3982493194 shutdown_connections 2024-09-11T00:10:31.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.111+0000 7f4c9aa00700 1 -- 172.21.15.111:0/3982493194 wait complete. 2024-09-11T00:10:31.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.112+0000 7f4c9aa00700 1 Processor -- start 2024-09-11T00:10:31.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.112+0000 7f4c9aa00700 1 -- start start 2024-09-11T00:10:31.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.112+0000 7f4c9aa00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4c94100150 0x7f4c94074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:31.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.112+0000 7f4c9aa00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c94101350 0x7f4c94073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:31.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.112+0000 7f4c9aa00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c94073680 con 0x7f4c94101350 2024-09-11T00:10:31.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.112+0000 7f4c9aa00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c940737c0 con 0x7f4c94100150 2024-09-11T00:10:31.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.112+0000 7f4c93400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c94101350 0x7f4c94073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:31.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.112+0000 7f4c93400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c94101350 0x7f4c94073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50344/0 (socket says 172.21.15.111:50344) 2024-09-11T00:10:31.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.112+0000 7f4c93400700 1 -- 172.21.15.111:0/1985634480 learned_addr learned my addr 172.21.15.111:0/1985634480 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:10:31.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.112+0000 7f4c93e00700 1 --2- 172.21.15.111:0/1985634480 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4c94100150 0x7f4c94074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:31.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.113+0000 7f4c93400700 1 -- 172.21.15.111:0/1985634480 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4c94100150 msgr2=0x7f4c94074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:31.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.113+0000 7f4c93400700 1 --2- 172.21.15.111:0/1985634480 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4c94100150 0x7f4c94074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.113+0000 7f4c93400700 1 -- 172.21.15.111:0/1985634480 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c840095f0 con 0x7f4c94101350 2024-09-11T00:10:31.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.113+0000 7f4c93400700 1 --2- 172.21.15.111:0/1985634480 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c94101350 0x7f4c94073140 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4c8000c930 tx=0x7f4c8000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:31.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.113+0000 7f4c90c00700 1 -- 172.21.15.111:0/1985634480 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c80007ad0 con 0x7f4c94101350 2024-09-11T00:10:31.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.113+0000 7f4c90c00700 1 -- 172.21.15.111:0/1985634480 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4c8000ce80 con 0x7f4c94101350 2024-09-11T00:10:31.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.113+0000 7f4c90c00700 1 -- 172.21.15.111:0/1985634480 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c80018630 con 0x7f4c94101350 2024-09-11T00:10:31.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.113+0000 7f4c9aa00700 1 -- 172.21.15.111:0/1985634480 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c94073aa0 con 0x7f4c94101350 2024-09-11T00:10:31.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.114+0000 7f4c9aa00700 1 -- 172.21.15.111:0/1985634480 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c9419da00 con 0x7f4c94101350 2024-09-11T00:10:31.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.115+0000 7f4c9aa00700 1 -- 172.21.15.111:0/1985634480 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c94108ca0 con 0x7f4c94101350 2024-09-11T00:10:31.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.116+0000 7f4c90c00700 1 -- 172.21.15.111:0/1985634480 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 34) v1 ==== 102331+0+0 (secure 0 0 0) 0x7f4c80007c30 con 0x7f4c94101350 2024-09-11T00:10:31.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.117+0000 7f4c90c00700 1 --2- 172.21.15.111:0/1985634480 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f4c7807a370 0x7f4c7807c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:31.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.117+0000 7f4c90c00700 1 -- 172.21.15.111:0/1985634480 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f4c8009cc70 con 0x7f4c94101350 2024-09-11T00:10:31.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.117+0000 7f4c93e00700 1 --2- 172.21.15.111:0/1985634480 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f4c7807a370 0x7f4c7807c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:31.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.118+0000 7f4c93e00700 1 --2- 172.21.15.111:0/1985634480 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f4c7807a370 0x7f4c7807c820 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4c84006010 tx=0x7f4c84005280 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:31.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.122+0000 7f4c90c00700 1 -- 172.21.15.111:0/1985634480 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f4c800a3080 con 0x7f4c94101350 2024-09-11T00:10:31.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.357+0000 7f4c9aa00700 1 -- 172.21.15.111:0/1985634480 --> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c94105ca0 con 0x7f4c7807a370 2024-09-11T00:10:31.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.366+0000 7f4c90c00700 1 -- 172.21.15.111:0/1985634480 <== mgr.14744 v2:172.21.15.111:6800/3952658086 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f4c94105ca0 con 0x7f4c7807a370 2024-09-11T00:10:31.368 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:10:31.368 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 starting - - - - 2024-09-11T00:10:31.369 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (2m) 19s ago 13m 7189k - 18.2.0 dc2bc1663786 7c40af85314c 2024-09-11T00:10:31.369 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi203 smithi203 running (2m) 48s ago 12m 7398k - 18.2.0 dc2bc1663786 922e3261ff70 2024-09-11T00:10:31.369 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (13m) 19s ago 13m 6665k - 18.2.0 dc2bc1663786 72a36c166ffa 2024-09-11T00:10:31.369 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi203 smithi203 running (12m) 48s ago 12m 6669k - 18.2.0 dc2bc1663786 9b102b6f6d70 2024-09-11T00:10:31.369 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (11m) 19s ago 13m 74.1M - 9.4.7 954c08fa6188 e599624a9c9e 2024-09-11T00:10:31.369 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.gmgsay smithi111 running (6m) 19s ago 6m 15.3M - 18.2.0 dc2bc1663786 795e4ff0075c 2024-09-11T00:10:31.369 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.rucaba smithi111 running (6m) 19s ago 6m 15.3M - 18.2.0 dc2bc1663786 02885adac62c 2024-09-11T00:10:31.369 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.tcrqop smithi203 running (6m) 48s ago 6m 152M - 18.2.0 dc2bc1663786 4df492159bb4 2024-09-11T00:10:31.369 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.uqkbkn smithi203 running (6m) 48s ago 6m 15.2M - 18.2.0 dc2bc1663786 619aa58ea314 2024-09-11T00:10:31.369 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.ypucji smithi111 *:8443,9283,8765 running (2m) 19s ago 15m 510M - 19.3.0-4854-g8f219c47 589dd18248e4 07fa31f49618 2024-09-11T00:10:31.370 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi203.smuspl smithi203 *:8443,9283,8765 running (80s) 48s ago 12m 451M - 19.3.0-4854-g8f219c47 589dd18248e4 7e5a93a5ffa7 2024-09-11T00:10:31.370 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (15m) 19s ago 15m 57.3M 2048M 18.2.0 dc2bc1663786 2596322539fb 2024-09-11T00:10:31.370 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi203 smithi203 running (12m) 48s ago 12m 48.1M 2048M 18.2.0 dc2bc1663786 ff8eb7ca85ea 2024-09-11T00:10:31.370 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (60s) 19s ago 13m 7512k - 1.7.0 72c9c2088986 ec478ea14488 2024-09-11T00:10:31.370 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi203 smithi203 *:9100 running (52s) 48s ago 12m 2655k - 1.7.0 72c9c2088986 54d461cde1bc 2024-09-11T00:10:31.370 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (10m) 19s ago 10m 210M 1216M 18.2.0 dc2bc1663786 162b7249a591 2024-09-11T00:10:31.370 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (10m) 19s ago 10m 223M 1216M 18.2.0 dc2bc1663786 3614d95b1425 2024-09-11T00:10:31.370 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (9m) 19s ago 9m 182M 1216M 18.2.0 dc2bc1663786 db175d4b09b9 2024-09-11T00:10:31.370 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi203 running (9m) 48s ago 9m 242M 2240M 18.2.0 dc2bc1663786 60b1cef7a70d 2024-09-11T00:10:31.370 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi203 running (8m) 48s ago 8m 207M 2240M 18.2.0 dc2bc1663786 769c7942c42b 2024-09-11T00:10:31.370 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi203 running (8m) 48s ago 8m 190M 2240M 18.2.0 dc2bc1663786 6d824001d40c 2024-09-11T00:10:31.370 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (26s) 19s ago 13m 41.7M - 2.51.0 1d3b7f56885b 3e72ac10983d 2024-09-11T00:10:31.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.369+0000 7f4c9aa00700 1 -- 172.21.15.111:0/1985634480 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f4c7807a370 msgr2=0x7f4c7807c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:31.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.369+0000 7f4c9aa00700 1 --2- 172.21.15.111:0/1985634480 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f4c7807a370 0x7f4c7807c820 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4c84006010 tx=0x7f4c84005280 comp rx=0 tx=0).stop 2024-09-11T00:10:31.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.369+0000 7f4c9aa00700 1 -- 172.21.15.111:0/1985634480 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c94101350 msgr2=0x7f4c94073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:31.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.369+0000 7f4c9aa00700 1 --2- 172.21.15.111:0/1985634480 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c94101350 0x7f4c94073140 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4c8000c930 tx=0x7f4c8000cc40 comp rx=0 tx=0).stop 2024-09-11T00:10:31.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.369+0000 7f4c9aa00700 1 -- 172.21.15.111:0/1985634480 shutdown_connections 2024-09-11T00:10:31.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.369+0000 7f4c9aa00700 1 --2- 172.21.15.111:0/1985634480 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f4c7807a370 0x7f4c7807c820 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.369+0000 7f4c9aa00700 1 --2- 172.21.15.111:0/1985634480 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4c94100150 0x7f4c94074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.369+0000 7f4c9aa00700 1 --2- 172.21.15.111:0/1985634480 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c94101350 0x7f4c94073140 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.369+0000 7f4c9aa00700 1 -- 172.21.15.111:0/1985634480 >> 172.21.15.111:0/1985634480 conn(0x7f4c940fb6e0 msgr2=0x7f4c94104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:31.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.369+0000 7f4c9aa00700 1 -- 172.21.15.111:0/1985634480 shutdown_connections 2024-09-11T00:10:31.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.369+0000 7f4c9aa00700 1 -- 172.21.15.111:0/1985634480 wait complete. 2024-09-11T00:10:31.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.506+0000 7f7f5f600700 1 -- 172.21.15.111:0/870319110 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f58100150 msgr2=0x7f7f58100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:31.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.506+0000 7f7f5f600700 1 --2- 172.21.15.111:0/870319110 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f58100150 0x7f7f58100560 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c009910 tx=0x7f7f4c009c20 comp rx=0 tx=0).stop 2024-09-11T00:10:31.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.506+0000 7f7f5f600700 1 -- 172.21.15.111:0/870319110 shutdown_connections 2024-09-11T00:10:31.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.506+0000 7f7f5f600700 1 --2- 172.21.15.111:0/870319110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f58101350 0x7f7f581017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.506+0000 7f7f5f600700 1 --2- 172.21.15.111:0/870319110 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f58100150 0x7f7f58100560 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.506+0000 7f7f5f600700 1 -- 172.21.15.111:0/870319110 >> 172.21.15.111:0/870319110 conn(0x7f7f580fb6e0 msgr2=0x7f7f580fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:31.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.506+0000 7f7f5f600700 1 -- 172.21.15.111:0/870319110 shutdown_connections 2024-09-11T00:10:31.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.506+0000 7f7f5f600700 1 -- 172.21.15.111:0/870319110 wait complete. 2024-09-11T00:10:31.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.507+0000 7f7f5f600700 1 Processor -- start 2024-09-11T00:10:31.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.507+0000 7f7f5f600700 1 -- start start 2024-09-11T00:10:31.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.508+0000 7f7f5f600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f58100150 0x7f7f58074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:31.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.508+0000 7f7f5f600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f58101350 0x7f7f58073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:31.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.508+0000 7f7f5f600700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f58073680 con 0x7f7f58100150 2024-09-11T00:10:31.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.508+0000 7f7f5f600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f580737c0 con 0x7f7f58101350 2024-09-11T00:10:31.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.508+0000 7f7f5cc00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f58100150 0x7f7f58074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:31.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.508+0000 7f7f5cc00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f58100150 0x7f7f58074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50366/0 (socket says 172.21.15.111:50366) 2024-09-11T00:10:31.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.508+0000 7f7f5cc00700 1 -- 172.21.15.111:0/4178079885 learned_addr learned my addr 172.21.15.111:0/4178079885 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:10:31.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.508+0000 7f7f57e00700 1 --2- 172.21.15.111:0/4178079885 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f58101350 0x7f7f58073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:31.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.508+0000 7f7f5cc00700 1 -- 172.21.15.111:0/4178079885 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f58101350 msgr2=0x7f7f58073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:31.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.508+0000 7f7f5cc00700 1 --2- 172.21.15.111:0/4178079885 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f58101350 0x7f7f58073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.508+0000 7f7f5cc00700 1 -- 172.21.15.111:0/4178079885 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f4c0095f0 con 0x7f7f58100150 2024-09-11T00:10:31.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.509+0000 7f7f57e00700 1 --2- 172.21.15.111:0/4178079885 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f58101350 0x7f7f58073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:10:31.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.509+0000 7f7f5cc00700 1 --2- 172.21.15.111:0/4178079885 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f58100150 0x7f7f58074af0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c00bd70 tx=0x7f7f4c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:31.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.509+0000 7f7f55600700 1 -- 172.21.15.111:0/4178079885 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f4c01d070 con 0x7f7f58100150 2024-09-11T00:10:31.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.509+0000 7f7f55600700 1 -- 172.21.15.111:0/4178079885 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7f4c00f460 con 0x7f7f58100150 2024-09-11T00:10:31.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.509+0000 7f7f5f600700 1 -- 172.21.15.111:0/4178079885 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f58073a40 con 0x7f7f58100150 2024-09-11T00:10:31.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.509+0000 7f7f55600700 1 -- 172.21.15.111:0/4178079885 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f4c021640 con 0x7f7f58100150 2024-09-11T00:10:31.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.509+0000 7f7f5f600700 1 -- 172.21.15.111:0/4178079885 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f58073f30 con 0x7f7f58100150 2024-09-11T00:10:31.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.511+0000 7f7f5f600700 1 -- 172.21.15.111:0/4178079885 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f58108d20 con 0x7f7f58100150 2024-09-11T00:10:31.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.512+0000 7f7f55600700 1 -- 172.21.15.111:0/4178079885 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 34) v1 ==== 102331+0+0 (secure 0 0 0) 0x7f7f4c00fab0 con 0x7f7f58100150 2024-09-11T00:10:31.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.514+0000 7f7f55600700 1 --2- 172.21.15.111:0/4178079885 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f7f4007a370 0x7f7f4007c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:31.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.514+0000 7f7f55600700 1 -- 172.21.15.111:0/4178079885 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f7f4c09e170 con 0x7f7f58100150 2024-09-11T00:10:31.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.514+0000 7f7f57e00700 1 --2- 172.21.15.111:0/4178079885 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f7f4007a370 0x7f7f4007c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:31.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.515+0000 7f7f57e00700 1 --2- 172.21.15.111:0/4178079885 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f7f4007a370 0x7f7f4007c820 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7f44007900 tx=0x7f7f44008040 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:31.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.518+0000 7f7f55600700 1 -- 172.21.15.111:0/4178079885 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f7f4c061d70 con 0x7f7f58100150 2024-09-11T00:10:31.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.851+0000 7f7f5f600700 1 -- 172.21.15.111:0/4178079885 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7f5819e420 con 0x7f7f58100150 2024-09-11T00:10:31.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.852+0000 7f7f55600700 1 -- 172.21.15.111:0/4178079885 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f7f4c064e90 con 0x7f7f58100150 2024-09-11T00:10:31.854 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:10:31.854 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-11T00:10:31.854 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-11T00:10:31.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:10:31.854 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-11T00:10:31.855 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:10:31.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:10:31.855 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-11T00:10:31.855 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-11T00:10:31.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:10:31.855 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-11T00:10:31.855 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-11T00:10:31.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:10:31.855 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-11T00:10:31.855 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-11T00:10:31.855 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:10:31.855 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-11T00:10:31.855 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:10:31.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.855+0000 7f7f5f600700 1 -- 172.21.15.111:0/4178079885 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f7f4007a370 msgr2=0x7f7f4007c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:31.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.855+0000 7f7f5f600700 1 --2- 172.21.15.111:0/4178079885 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f7f4007a370 0x7f7f4007c820 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7f44007900 tx=0x7f7f44008040 comp rx=0 tx=0).stop 2024-09-11T00:10:31.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.855+0000 7f7f5f600700 1 -- 172.21.15.111:0/4178079885 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f58100150 msgr2=0x7f7f58074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:31.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.855+0000 7f7f5f600700 1 --2- 172.21.15.111:0/4178079885 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f58100150 0x7f7f58074af0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c00bd70 tx=0x7f7f4c00be50 comp rx=0 tx=0).stop 2024-09-11T00:10:31.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.855+0000 7f7f5f600700 1 -- 172.21.15.111:0/4178079885 shutdown_connections 2024-09-11T00:10:31.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.855+0000 7f7f5f600700 1 --2- 172.21.15.111:0/4178079885 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f7f4007a370 0x7f7f4007c820 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.855+0000 7f7f5f600700 1 --2- 172.21.15.111:0/4178079885 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f58100150 0x7f7f58074af0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.855+0000 7f7f5f600700 1 --2- 172.21.15.111:0/4178079885 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f58101350 0x7f7f58073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.855+0000 7f7f5f600700 1 -- 172.21.15.111:0/4178079885 >> 172.21.15.111:0/4178079885 conn(0x7f7f580fb6e0 msgr2=0x7f7f58104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:31.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.855+0000 7f7f5f600700 1 -- 172.21.15.111:0/4178079885 shutdown_connections 2024-09-11T00:10:31.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.855+0000 7f7f5f600700 1 -- 172.21.15.111:0/4178079885 wait complete. 2024-09-11T00:10:31.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.991+0000 7fafc9c00700 1 -- 172.21.15.111:0/3613475474 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fafc4101350 msgr2=0x7fafc41017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:31.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.991+0000 7fafc9c00700 1 --2- 172.21.15.111:0/3613475474 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fafc4101350 0x7fafc41017a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fafb0009910 tx=0x7fafb0009c20 comp rx=0 tx=0).stop 2024-09-11T00:10:31.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.991+0000 7fafc9c00700 1 -- 172.21.15.111:0/3613475474 shutdown_connections 2024-09-11T00:10:31.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.991+0000 7fafc9c00700 1 --2- 172.21.15.111:0/3613475474 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fafc4101350 0x7fafc41017a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.991+0000 7fafc9c00700 1 --2- 172.21.15.111:0/3613475474 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafc4100150 0x7fafc4100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.991+0000 7fafc9c00700 1 -- 172.21.15.111:0/3613475474 >> 172.21.15.111:0/3613475474 conn(0x7fafc40fb6e0 msgr2=0x7fafc40fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:31.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.991+0000 7fafc9c00700 1 -- 172.21.15.111:0/3613475474 shutdown_connections 2024-09-11T00:10:31.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.991+0000 7fafc9c00700 1 -- 172.21.15.111:0/3613475474 wait complete. 2024-09-11T00:10:31.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.992+0000 7fafc9c00700 1 Processor -- start 2024-09-11T00:10:31.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.992+0000 7fafc9c00700 1 -- start start 2024-09-11T00:10:31.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.992+0000 7fafc9c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafc4100150 0x7fafc4197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:31.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.992+0000 7fafc9c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fafc4101350 0x7fafc41980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:31.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.992+0000 7fafc9c00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc41986d0 con 0x7fafc4101350 2024-09-11T00:10:31.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.992+0000 7fafc9c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc4198810 con 0x7fafc4100150 2024-09-11T00:10:31.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.993+0000 7fafc2000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fafc4101350 0x7fafc41980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:31.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.993+0000 7fafc2000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fafc4101350 0x7fafc41980b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50378/0 (socket says 172.21.15.111:50378) 2024-09-11T00:10:31.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.993+0000 7fafc2000700 1 -- 172.21.15.111:0/996350523 learned_addr learned my addr 172.21.15.111:0/996350523 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:10:31.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.993+0000 7fafc2a00700 1 --2- 172.21.15.111:0/996350523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafc4100150 0x7fafc4197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:31.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.993+0000 7fafc2000700 1 -- 172.21.15.111:0/996350523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafc4100150 msgr2=0x7fafc4197b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:31.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.993+0000 7fafc2000700 1 --2- 172.21.15.111:0/996350523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafc4100150 0x7fafc4197b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:31.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.993+0000 7fafc2000700 1 -- 172.21.15.111:0/996350523 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb00095f0 con 0x7fafc4101350 2024-09-11T00:10:31.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.993+0000 7fafc2a00700 1 --2- 172.21.15.111:0/996350523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafc4100150 0x7fafc4197b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:10:31.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.993+0000 7fafc2000700 1 --2- 172.21.15.111:0/996350523 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fafc4101350 0x7fafc41980b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fafb0005b40 tx=0x7fafb000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:31.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.994+0000 7fafbb400700 1 -- 172.21.15.111:0/996350523 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafb001d070 con 0x7fafc4101350 2024-09-11T00:10:31.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.994+0000 7fafbb400700 1 -- 172.21.15.111:0/996350523 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fafb000f460 con 0x7fafc4101350 2024-09-11T00:10:31.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.994+0000 7fafc9c00700 1 -- 172.21.15.111:0/996350523 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc419d260 con 0x7fafc4101350 2024-09-11T00:10:31.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.994+0000 7fafbb400700 1 -- 172.21.15.111:0/996350523 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafb0021640 con 0x7fafc4101350 2024-09-11T00:10:31.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.994+0000 7fafc9c00700 1 -- 172.21.15.111:0/996350523 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc419d750 con 0x7fafc4101350 2024-09-11T00:10:31.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.995+0000 7fafc9c00700 1 -- 172.21.15.111:0/996350523 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc4105430 con 0x7fafc4101350 2024-09-11T00:10:31.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.996+0000 7fafbb400700 1 -- 172.21.15.111:0/996350523 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 34) v1 ==== 102331+0+0 (secure 0 0 0) 0x7fafb000fa90 con 0x7fafc4101350 2024-09-11T00:10:31.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.997+0000 7fafbb400700 1 --2- 172.21.15.111:0/996350523 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fafa807a370 0x7fafa807c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:31.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.997+0000 7fafbb400700 1 -- 172.21.15.111:0/996350523 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fafb009e0a0 con 0x7fafc4101350 2024-09-11T00:10:31.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.998+0000 7fafc2a00700 1 --2- 172.21.15.111:0/996350523 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fafa807a370 0x7fafa807c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:32.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:31.998+0000 7fafc2a00700 1 --2- 172.21.15.111:0/996350523 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fafa807a370 0x7fafa807c820 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fafb4005950 tx=0x7fafb40058e0 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:32.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:32.002+0000 7fafbb400700 1 -- 172.21.15.111:0/996350523 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7fafb0061ca0 con 0x7fafc4101350 2024-09-11T00:10:32.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:32.248+0000 7fafc9c00700 1 -- 172.21.15.111:0/996350523 --> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fafc4061190 con 0x7fafa807a370 2024-09-11T00:10:32.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:32.250+0000 7fafbb400700 1 -- 172.21.15.111:0/996350523 <== mgr.14744 v2:172.21.15.111:6800/3952658086 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fafc4061190 con 0x7fafa807a370 2024-09-11T00:10:32.252 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:10:32.252 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e", 2024-09-11T00:10:32.252 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-11T00:10:32.252 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-11T00:10:32.252 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-11T00:10:32.252 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr" 2024-09-11T00:10:32.252 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-11T00:10:32.252 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "2/2 daemons upgraded", 2024-09-11T00:10:32.252 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading alertmanager daemons", 2024-09-11T00:10:32.252 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-11T00:10:32.252 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:10:32.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:32.252+0000 7fafc9c00700 1 -- 172.21.15.111:0/996350523 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fafa807a370 msgr2=0x7fafa807c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:32.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:32.252+0000 7fafc9c00700 1 --2- 172.21.15.111:0/996350523 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fafa807a370 0x7fafa807c820 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fafb4005950 tx=0x7fafb40058e0 comp rx=0 tx=0).stop 2024-09-11T00:10:32.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:32.252+0000 7fafc9c00700 1 -- 172.21.15.111:0/996350523 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fafc4101350 msgr2=0x7fafc41980b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:32.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:32.252+0000 7fafc9c00700 1 --2- 172.21.15.111:0/996350523 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fafc4101350 0x7fafc41980b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fafb0005b40 tx=0x7fafb000be20 comp rx=0 tx=0).stop 2024-09-11T00:10:32.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:32.252+0000 7fafc9c00700 1 -- 172.21.15.111:0/996350523 shutdown_connections 2024-09-11T00:10:32.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:32.252+0000 7fafc9c00700 1 --2- 172.21.15.111:0/996350523 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fafa807a370 0x7fafa807c820 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:32.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:32.252+0000 7fafc9c00700 1 --2- 172.21.15.111:0/996350523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafc4100150 0x7fafc4197b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:32.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:32.252+0000 7fafc9c00700 1 --2- 172.21.15.111:0/996350523 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fafc4101350 0x7fafc41980b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:32.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:32.252+0000 7fafc9c00700 1 -- 172.21.15.111:0/996350523 >> 172.21.15.111:0/996350523 conn(0x7fafc40fb6e0 msgr2=0x7fafc4102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:32.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:32.253+0000 7fafc9c00700 1 -- 172.21.15.111:0/996350523 shutdown_connections 2024-09-11T00:10:32.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:10:32.253+0000 7fafc9c00700 1 -- 172.21.15.111:0/996350523 wait complete. 2024-09-11T00:10:32.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:32 smithi111 ceph-mon[27539]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:10:32.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:32 smithi111 ceph-mon[27539]: from='client.14860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:10:32.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:32 smithi111 ceph-mon[27539]: pgmap v61: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:32.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:32 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/4178079885' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:32.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:32 smithi203 ceph-mon[33225]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:10:32.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:32 smithi203 ceph-mon[33225]: from='client.14860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:10:32.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:32 smithi203 ceph-mon[33225]: pgmap v61: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:32.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:32 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/4178079885' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:33.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:33 smithi111 ceph-mon[27539]: from='client.14864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:10:33.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:33 smithi111 ceph-mon[27539]: from='client.14872 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:10:33.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:33 smithi203 ceph-mon[33225]: from='client.14864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:10:33.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:33 smithi203 ceph-mon[33225]: from='client.14872 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:10:34.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:34 smithi111 ceph-mon[27539]: pgmap v62: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:34.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:34 smithi203 ceph-mon[33225]: pgmap v62: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:35.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:35 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:35.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:35 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:35.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:35 smithi111 ceph-mon[27539]: pgmap v63: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:36.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:35 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:36.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:35 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:36.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:35 smithi203 ceph-mon[33225]: pgmap v63: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:36.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:36 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:36.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:36 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:36.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:36 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:10:37.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:36 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:37.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:36 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:37.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:36 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:10:38.008 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:37 smithi111 ceph-mon[27539]: pgmap v64: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:38.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:37 smithi203 ceph-mon[33225]: pgmap v64: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:40.390 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:40 smithi111 ceph-mon[27539]: pgmap v65: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:40.390 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:40 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:40.390 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:40 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:40.390 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:40 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:10:40.390 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:40 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:10:40.391 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:40 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:40.391 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:40 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-11T00:10:40.391 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:40 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:10:40.391 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:40 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:40.391 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:40 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:40.391 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:40 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:40.391 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:40 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:40.391 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:40 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:40.391 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:40 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:40.391 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:40 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:40.391 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:40 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:40.391 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:40 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:40.391 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:40 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:40.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:40 smithi203 ceph-mon[33225]: pgmap v65: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:40.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:40 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:40.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:40 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:40.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:40 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:10:40.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:40 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:10:40.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:40 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:40.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:40 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-11T00:10:40.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:40 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:10:40.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:40 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:40.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:40 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:40.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:40 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:40.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:40 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:40.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:40 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:40.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:40 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:40.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:40 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:40.797 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:40 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:40.797 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:40 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:40.797 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:40 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:10:41.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:41 smithi111 ceph-mon[27539]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-11T00:10:41.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:41 smithi203 ceph-mon[33225]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-11T00:10:42.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:42 smithi111 ceph-mon[27539]: Upgrade: Updating grafana.smithi111 2024-09-11T00:10:42.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:42 smithi111 ceph-mon[27539]: Deploying daemon grafana.smithi111 on smithi111 2024-09-11T00:10:42.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:42 smithi111 ceph-mon[27539]: pgmap v66: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:42.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:42 smithi203 ceph-mon[33225]: Upgrade: Updating grafana.smithi111 2024-09-11T00:10:42.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:42 smithi203 ceph-mon[33225]: Deploying daemon grafana.smithi111 on smithi111 2024-09-11T00:10:42.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:42 smithi203 ceph-mon[33225]: pgmap v66: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:44.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:44 smithi111 ceph-mon[27539]: pgmap v67: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:44.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:44 smithi203 ceph-mon[33225]: pgmap v67: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:46.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:46 smithi111 ceph-mon[27539]: pgmap v68: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:46.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:46 smithi203 ceph-mon[33225]: pgmap v68: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:48.627 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:48 smithi111 ceph-mon[27539]: pgmap v69: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:48.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:48 smithi203 ceph-mon[33225]: pgmap v69: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:50.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:49 smithi111 ceph-mon[27539]: pgmap v70: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:50.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:49 smithi203 ceph-mon[33225]: pgmap v70: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:51.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:51 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:10:51.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:51 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:10:52.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:52 smithi203 ceph-mon[33225]: pgmap v71: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:52.315 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:52 smithi111 ceph-mon[27539]: pgmap v71: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:54.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:54 smithi111 ceph-mon[27539]: pgmap v72: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:54.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:54 smithi203 ceph-mon[33225]: pgmap v72: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:56.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:56 smithi111 ceph-mon[27539]: pgmap v73: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:56.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:56 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:56.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:56 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:56.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:56 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:10:56.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:56 smithi203 ceph-mon[33225]: pgmap v73: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:56.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:56 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:56.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:56 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:10:56.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:56 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:10:58.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:58 smithi111 ceph-mon[27539]: pgmap v74: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:10:58.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:58 smithi203 ceph-mon[33225]: pgmap v74: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:00.119 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:10:59 smithi111 ceph-mon[27539]: pgmap v75: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:00.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:10:59 smithi203 ceph-mon[33225]: pgmap v75: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:02.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.399+0000 7f37c6200700 1 -- 172.21.15.111:0/4021732118 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37c0074d80 msgr2=0x7f37c00731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:02.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.399+0000 7f37c6200700 1 --2- 172.21.15.111:0/4021732118 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37c0074d80 0x7f37c00731e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f37b0009910 tx=0x7f37b0009c20 comp rx=0 tx=0).stop 2024-09-11T00:11:02.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.399+0000 7f37c6200700 1 -- 172.21.15.111:0/4021732118 shutdown_connections 2024-09-11T00:11:02.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.399+0000 7f37c6200700 1 --2- 172.21.15.111:0/4021732118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37c00737b0 0x7f37c0073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:02.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.399+0000 7f37c6200700 1 --2- 172.21.15.111:0/4021732118 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37c0074d80 0x7f37c00731e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:02.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.399+0000 7f37c6200700 1 -- 172.21.15.111:0/4021732118 >> 172.21.15.111:0/4021732118 conn(0x7f37c00fb6e0 msgr2=0x7f37c00fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:02.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.399+0000 7f37c6200700 1 -- 172.21.15.111:0/4021732118 shutdown_connections 2024-09-11T00:11:02.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.400+0000 7f37c6200700 1 -- 172.21.15.111:0/4021732118 wait complete. 2024-09-11T00:11:02.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.401+0000 7f37c6200700 1 Processor -- start 2024-09-11T00:11:02.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.401+0000 7f37c6200700 1 -- start start 2024-09-11T00:11:02.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.401+0000 7f37c6200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37c00737b0 0x7f37c019bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:02.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.401+0000 7f37c6200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37c0074d80 0x7f37c019c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:02.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.401+0000 7f37c6200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c019cae0 con 0x7f37c0074d80 2024-09-11T00:11:02.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.401+0000 7f37c6200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c019cc20 con 0x7f37c00737b0 2024-09-11T00:11:02.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.401+0000 7f37bea00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37c0074d80 0x7f37c019c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:02.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.401+0000 7f37bea00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37c0074d80 0x7f37c019c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:58712/0 (socket says 172.21.15.111:58712) 2024-09-11T00:11:02.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.401+0000 7f37bea00700 1 -- 172.21.15.111:0/1677361050 learned_addr learned my addr 172.21.15.111:0/1677361050 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:11:02.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.402+0000 7f37bf400700 1 --2- 172.21.15.111:0/1677361050 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37c00737b0 0x7f37c019bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:02.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.402+0000 7f37bea00700 1 -- 172.21.15.111:0/1677361050 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37c00737b0 msgr2=0x7f37c019bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:02.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.402+0000 7f37bea00700 1 --2- 172.21.15.111:0/1677361050 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37c00737b0 0x7f37c019bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:02.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.402+0000 7f37bea00700 1 -- 172.21.15.111:0/1677361050 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b00095f0 con 0x7f37c0074d80 2024-09-11T00:11:02.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.402+0000 7f37bf400700 1 --2- 172.21.15.111:0/1677361050 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37c00737b0 0x7f37c019bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:11:02.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.402+0000 7f37bea00700 1 --2- 172.21.15.111:0/1677361050 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37c0074d80 0x7f37c019c4c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00b4b0 tx=0x7f37ac00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:02.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.402+0000 7f37b7e00700 1 -- 172.21.15.111:0/1677361050 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37ac011800 con 0x7f37c0074d80 2024-09-11T00:11:02.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.403+0000 7f37b7e00700 1 -- 172.21.15.111:0/1677361050 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f37ac011e10 con 0x7f37c0074d80 2024-09-11T00:11:02.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.403+0000 7f37c6200700 1 -- 172.21.15.111:0/1677361050 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c01a16d0 con 0x7f37c0074d80 2024-09-11T00:11:02.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.403+0000 7f37b7e00700 1 -- 172.21.15.111:0/1677361050 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37ac00f2e0 con 0x7f37c0074d80 2024-09-11T00:11:02.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.403+0000 7f37c6200700 1 -- 172.21.15.111:0/1677361050 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c01a1ca0 con 0x7f37c0074d80 2024-09-11T00:11:02.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.404+0000 7f37c6200700 1 -- 172.21.15.111:0/1677361050 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c010f300 con 0x7f37c0074d80 2024-09-11T00:11:02.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.405+0000 7f37b7e00700 1 -- 172.21.15.111:0/1677361050 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 34) v1 ==== 102331+0+0 (secure 0 0 0) 0x7f37ac010380 con 0x7f37c0074d80 2024-09-11T00:11:02.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.406+0000 7f37b7e00700 1 --2- 172.21.15.111:0/1677361050 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f37a407a370 0x7f37a407c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:02.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.406+0000 7f37b7e00700 1 -- 172.21.15.111:0/1677361050 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f37ac09c7c0 con 0x7f37c0074d80 2024-09-11T00:11:02.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.407+0000 7f37bf400700 1 --2- 172.21.15.111:0/1677361050 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f37a407a370 0x7f37a407c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:02.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.408+0000 7f37bf400700 1 --2- 172.21.15.111:0/1677361050 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f37a407a370 0x7f37a407c820 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f37b0006010 tx=0x7f37b000b560 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:02.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.411+0000 7f37b7e00700 1 -- 172.21.15.111:0/1677361050 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f37ac0603c0 con 0x7f37c0074d80 2024-09-11T00:11:02.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:02 smithi203 ceph-mon[33225]: pgmap v76: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:02.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:02 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:11:02.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:02 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:11:02.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:02 smithi111 ceph-mon[27539]: pgmap v76: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:02.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:02 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:11:02.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:02 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:11:02.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.663+0000 7f37c6200700 1 -- 172.21.15.111:0/1677361050 --> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f37c0103200 con 0x7f37a407a370 2024-09-11T00:11:02.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.665+0000 7f37b7e00700 1 -- 172.21.15.111:0/1677361050 <== mgr.14744 v2:172.21.15.111:6800/3952658086 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f37c0103200 con 0x7f37a407a370 2024-09-11T00:11:02.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.667+0000 7f37c6200700 1 -- 172.21.15.111:0/1677361050 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f37a407a370 msgr2=0x7f37a407c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:02.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.667+0000 7f37c6200700 1 --2- 172.21.15.111:0/1677361050 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f37a407a370 0x7f37a407c820 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f37b0006010 tx=0x7f37b000b560 comp rx=0 tx=0).stop 2024-09-11T00:11:02.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.667+0000 7f37c6200700 1 -- 172.21.15.111:0/1677361050 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37c0074d80 msgr2=0x7f37c019c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:02.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.667+0000 7f37c6200700 1 --2- 172.21.15.111:0/1677361050 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37c0074d80 0x7f37c019c4c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00b4b0 tx=0x7f37ac00b870 comp rx=0 tx=0).stop 2024-09-11T00:11:02.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.667+0000 7f37c6200700 1 -- 172.21.15.111:0/1677361050 shutdown_connections 2024-09-11T00:11:02.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.667+0000 7f37c6200700 1 --2- 172.21.15.111:0/1677361050 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f37a407a370 0x7f37a407c820 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:02.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.667+0000 7f37c6200700 1 --2- 172.21.15.111:0/1677361050 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37c00737b0 0x7f37c019bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:02.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.667+0000 7f37c6200700 1 --2- 172.21.15.111:0/1677361050 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37c0074d80 0x7f37c019c4c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:02.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.667+0000 7f37c6200700 1 -- 172.21.15.111:0/1677361050 >> 172.21.15.111:0/1677361050 conn(0x7f37c00fb6e0 msgr2=0x7f37c0101ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:02.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.668+0000 7f37c6200700 1 -- 172.21.15.111:0/1677361050 shutdown_connections 2024-09-11T00:11:02.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.668+0000 7f37c6200700 1 -- 172.21.15.111:0/1677361050 wait complete. 2024-09-11T00:11:02.684 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:11:02.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.842+0000 7faef7c00700 1 -- 172.21.15.111:0/2303466883 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faef0100150 msgr2=0x7faef0100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:02.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.842+0000 7faef7c00700 1 --2- 172.21.15.111:0/2303466883 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faef0100150 0x7faef0100560 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7faee4009910 tx=0x7faee4009c20 comp rx=0 tx=0).stop 2024-09-11T00:11:02.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.843+0000 7faef7c00700 1 -- 172.21.15.111:0/2303466883 shutdown_connections 2024-09-11T00:11:02.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.843+0000 7faef7c00700 1 --2- 172.21.15.111:0/2303466883 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faef0101350 0x7faef01017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:02.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.843+0000 7faef7c00700 1 --2- 172.21.15.111:0/2303466883 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faef0100150 0x7faef0100560 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:02.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.843+0000 7faef7c00700 1 -- 172.21.15.111:0/2303466883 >> 172.21.15.111:0/2303466883 conn(0x7faef00fb6e0 msgr2=0x7faef00fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:02.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.843+0000 7faef7c00700 1 -- 172.21.15.111:0/2303466883 shutdown_connections 2024-09-11T00:11:02.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.843+0000 7faef7c00700 1 -- 172.21.15.111:0/2303466883 wait complete. 2024-09-11T00:11:02.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.844+0000 7faef7c00700 1 Processor -- start 2024-09-11T00:11:02.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.844+0000 7faef7c00700 1 -- start start 2024-09-11T00:11:02.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.844+0000 7faef7c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faef0100150 0x7faef0197ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:02.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.844+0000 7faef7c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faef0101350 0x7faef01980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:02.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.844+0000 7faef7c00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef0198700 con 0x7faef0100150 2024-09-11T00:11:02.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.844+0000 7faef7c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef0198840 con 0x7faef0101350 2024-09-11T00:11:02.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.845+0000 7faef5200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faef0100150 0x7faef0197ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:02.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.845+0000 7faef5200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faef0100150 0x7faef0197ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:58724/0 (socket says 172.21.15.111:58724) 2024-09-11T00:11:02.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.845+0000 7faef5200700 1 -- 172.21.15.111:0/11954301 learned_addr learned my addr 172.21.15.111:0/11954301 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:11:02.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.845+0000 7faeefe00700 1 --2- 172.21.15.111:0/11954301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faef0101350 0x7faef01980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:02.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.845+0000 7faef5200700 1 -- 172.21.15.111:0/11954301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faef0101350 msgr2=0x7faef01980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:02.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.845+0000 7faef5200700 1 --2- 172.21.15.111:0/11954301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faef0101350 0x7faef01980e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:02.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.845+0000 7faef5200700 1 -- 172.21.15.111:0/11954301 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee40095f0 con 0x7faef0100150 2024-09-11T00:11:02.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.845+0000 7faef5200700 1 --2- 172.21.15.111:0/11954301 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faef0100150 0x7faef0197ba0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7faee400bda0 tx=0x7faee400bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:02.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.846+0000 7faeed600700 1 -- 172.21.15.111:0/11954301 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faee401d070 con 0x7faef0100150 2024-09-11T00:11:02.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.846+0000 7faeed600700 1 -- 172.21.15.111:0/11954301 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7faee400f460 con 0x7faef0100150 2024-09-11T00:11:02.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.846+0000 7faeed600700 1 -- 172.21.15.111:0/11954301 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faee4021640 con 0x7faef0100150 2024-09-11T00:11:02.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.846+0000 7faef7c00700 1 -- 172.21.15.111:0/11954301 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faef019d290 con 0x7faef0100150 2024-09-11T00:11:02.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.846+0000 7faef7c00700 1 -- 172.21.15.111:0/11954301 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef019d780 con 0x7faef0100150 2024-09-11T00:11:02.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.847+0000 7faef7c00700 1 -- 172.21.15.111:0/11954301 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faef0105430 con 0x7faef0100150 2024-09-11T00:11:02.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.848+0000 7faeed600700 1 -- 172.21.15.111:0/11954301 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 34) v1 ==== 102331+0+0 (secure 0 0 0) 0x7faee400f5d0 con 0x7faef0100150 2024-09-11T00:11:02.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.849+0000 7faeed600700 1 --2- 172.21.15.111:0/11954301 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7faed807a370 0x7faed807c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:02.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.849+0000 7faeed600700 1 -- 172.21.15.111:0/11954301 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7faee409dfe0 con 0x7faef0100150 2024-09-11T00:11:02.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.850+0000 7faeefe00700 1 --2- 172.21.15.111:0/11954301 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7faed807a370 0x7faed807c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:02.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.850+0000 7faeefe00700 1 --2- 172.21.15.111:0/11954301 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7faed807a370 0x7faed807c820 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faedc005950 tx=0x7faedc00b410 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:02.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:02.854+0000 7faeed600700 1 -- 172.21.15.111:0/11954301 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7faee4061c20 con 0x7faef0100150 2024-09-11T00:11:03.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.100+0000 7faef7c00700 1 -- 172.21.15.111:0/11954301 --> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faef0061190 con 0x7faed807a370 2024-09-11T00:11:03.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.102+0000 7faeed600700 1 -- 172.21.15.111:0/11954301 <== mgr.14744 v2:172.21.15.111:6800/3952658086 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7faef0061190 con 0x7faed807a370 2024-09-11T00:11:03.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.104+0000 7faef7c00700 1 -- 172.21.15.111:0/11954301 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7faed807a370 msgr2=0x7faed807c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:03.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.104+0000 7faef7c00700 1 --2- 172.21.15.111:0/11954301 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7faed807a370 0x7faed807c820 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faedc005950 tx=0x7faedc00b410 comp rx=0 tx=0).stop 2024-09-11T00:11:03.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.104+0000 7faef7c00700 1 -- 172.21.15.111:0/11954301 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faef0100150 msgr2=0x7faef0197ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:03.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.104+0000 7faef7c00700 1 --2- 172.21.15.111:0/11954301 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faef0100150 0x7faef0197ba0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7faee400bda0 tx=0x7faee400bdd0 comp rx=0 tx=0).stop 2024-09-11T00:11:03.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.105+0000 7faef7c00700 1 -- 172.21.15.111:0/11954301 shutdown_connections 2024-09-11T00:11:03.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.105+0000 7faef7c00700 1 --2- 172.21.15.111:0/11954301 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7faed807a370 0x7faed807c820 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:03.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.105+0000 7faef7c00700 1 --2- 172.21.15.111:0/11954301 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faef0100150 0x7faef0197ba0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:03.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.105+0000 7faef7c00700 1 --2- 172.21.15.111:0/11954301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faef0101350 0x7faef01980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:03.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.105+0000 7faef7c00700 1 -- 172.21.15.111:0/11954301 >> 172.21.15.111:0/11954301 conn(0x7faef00fb6e0 msgr2=0x7faef0102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:03.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.105+0000 7faef7c00700 1 -- 172.21.15.111:0/11954301 shutdown_connections 2024-09-11T00:11:03.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.105+0000 7faef7c00700 1 -- 172.21.15.111:0/11954301 wait complete. 2024-09-11T00:11:03.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.258+0000 7fdf62e00700 1 -- 172.21.15.111:0/2396807515 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdf5c100150 msgr2=0x7fdf5c100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:03.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.258+0000 7fdf62e00700 1 --2- 172.21.15.111:0/2396807515 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdf5c100150 0x7fdf5c100560 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c009910 tx=0x7fdf4c009c20 comp rx=0 tx=0).stop 2024-09-11T00:11:03.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.258+0000 7fdf62e00700 1 -- 172.21.15.111:0/2396807515 shutdown_connections 2024-09-11T00:11:03.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.258+0000 7fdf62e00700 1 --2- 172.21.15.111:0/2396807515 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf5c101350 0x7fdf5c1017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:03.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.258+0000 7fdf62e00700 1 --2- 172.21.15.111:0/2396807515 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdf5c100150 0x7fdf5c100560 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:03.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.258+0000 7fdf62e00700 1 -- 172.21.15.111:0/2396807515 >> 172.21.15.111:0/2396807515 conn(0x7fdf5c0fb6e0 msgr2=0x7fdf5c0fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:03.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.258+0000 7fdf62e00700 1 -- 172.21.15.111:0/2396807515 shutdown_connections 2024-09-11T00:11:03.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.258+0000 7fdf62e00700 1 -- 172.21.15.111:0/2396807515 wait complete. 2024-09-11T00:11:03.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.259+0000 7fdf62e00700 1 Processor -- start 2024-09-11T00:11:03.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.259+0000 7fdf62e00700 1 -- start start 2024-09-11T00:11:03.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.260+0000 7fdf62e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdf5c100150 0x7fdf5c197ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:03.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.260+0000 7fdf62e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf5c101350 0x7fdf5c1980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:03.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.260+0000 7fdf62e00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c198700 con 0x7fdf5c100150 2024-09-11T00:11:03.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.260+0000 7fdf62e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c198840 con 0x7fdf5c101350 2024-09-11T00:11:03.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.260+0000 7fdf5be00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdf5c100150 0x7fdf5c197ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:03.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.260+0000 7fdf5be00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdf5c100150 0x7fdf5c197ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:58742/0 (socket says 172.21.15.111:58742) 2024-09-11T00:11:03.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.260+0000 7fdf5be00700 1 -- 172.21.15.111:0/2503279644 learned_addr learned my addr 172.21.15.111:0/2503279644 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:11:03.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.260+0000 7fdf5b400700 1 --2- 172.21.15.111:0/2503279644 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf5c101350 0x7fdf5c1980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:03.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.260+0000 7fdf5be00700 1 -- 172.21.15.111:0/2503279644 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf5c101350 msgr2=0x7fdf5c1980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:03.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.261+0000 7fdf5be00700 1 --2- 172.21.15.111:0/2503279644 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf5c101350 0x7fdf5c1980e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:03.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.261+0000 7fdf5be00700 1 -- 172.21.15.111:0/2503279644 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4c0095f0 con 0x7fdf5c100150 2024-09-11T00:11:03.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.261+0000 7fdf5b400700 1 --2- 172.21.15.111:0/2503279644 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf5c101350 0x7fdf5c1980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:11:03.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.261+0000 7fdf5be00700 1 --2- 172.21.15.111:0/2503279644 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdf5c100150 0x7fdf5c197ba0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c00bd70 tx=0x7fdf4c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:03.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.261+0000 7fdf58c00700 1 -- 172.21.15.111:0/2503279644 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf4c01d070 con 0x7fdf5c100150 2024-09-11T00:11:03.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.261+0000 7fdf58c00700 1 -- 172.21.15.111:0/2503279644 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdf4c00f460 con 0x7fdf5c100150 2024-09-11T00:11:03.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.261+0000 7fdf62e00700 1 -- 172.21.15.111:0/2503279644 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf5c19d290 con 0x7fdf5c100150 2024-09-11T00:11:03.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.261+0000 7fdf62e00700 1 -- 172.21.15.111:0/2503279644 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf5c19d780 con 0x7fdf5c100150 2024-09-11T00:11:03.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.261+0000 7fdf58c00700 1 -- 172.21.15.111:0/2503279644 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf4c021620 con 0x7fdf5c100150 2024-09-11T00:11:03.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.262+0000 7fdf62e00700 1 -- 172.21.15.111:0/2503279644 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf5c105430 con 0x7fdf5c100150 2024-09-11T00:11:03.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.265+0000 7fdf58c00700 1 -- 172.21.15.111:0/2503279644 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 34) v1 ==== 102331+0+0 (secure 0 0 0) 0x7fdf4c00fa40 con 0x7fdf5c100150 2024-09-11T00:11:03.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.265+0000 7fdf58c00700 1 --2- 172.21.15.111:0/2503279644 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fdf4007a370 0x7fdf4007c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:03.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.266+0000 7fdf58c00700 1 -- 172.21.15.111:0/2503279644 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fdf4c09dfd0 con 0x7fdf5c100150 2024-09-11T00:11:03.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.266+0000 7fdf5b400700 1 --2- 172.21.15.111:0/2503279644 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fdf4007a370 0x7fdf4007c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:03.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.266+0000 7fdf5b400700 1 --2- 172.21.15.111:0/2503279644 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fdf4007a370 0x7fdf4007c820 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdf48005950 tx=0x7fdf480058e0 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:03.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.271+0000 7fdf58c00700 1 -- 172.21.15.111:0/2503279644 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7fdf4c061c70 con 0x7fdf5c100150 2024-09-11T00:11:03.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.511+0000 7fdf62e00700 1 -- 172.21.15.111:0/2503279644 --> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf5c061190 con 0x7fdf4007a370 2024-09-11T00:11:03.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.520+0000 7fdf58c00700 1 -- 172.21.15.111:0/2503279644 <== mgr.14744 v2:172.21.15.111:6800/3952658086 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fdf5c061190 con 0x7fdf4007a370 2024-09-11T00:11:03.522 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:11:03.522 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (35s) 1s ago 14m 14.5M - 0.27.0 11f11916f8cd d6d3253e881f 2024-09-11T00:11:03.523 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (3m) 1s ago 14m 7256k - 18.2.0 dc2bc1663786 7c40af85314c 2024-09-11T00:11:03.523 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi203 smithi203 running (2m) 81s ago 13m 7398k - 18.2.0 dc2bc1663786 922e3261ff70 2024-09-11T00:11:03.523 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (14m) 1s ago 14m 6665k - 18.2.0 dc2bc1663786 72a36c166ffa 2024-09-11T00:11:03.523 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi203 smithi203 running (13m) 81s ago 13m 6669k - 18.2.0 dc2bc1663786 9b102b6f6d70 2024-09-11T00:11:03.523 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (8s) 1s ago 13m 45.2M - c8b91775d855 7d3b50b5b59f 2024-09-11T00:11:03.523 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.gmgsay smithi111 running (7m) 1s ago 7m 15.7M - 18.2.0 dc2bc1663786 795e4ff0075c 2024-09-11T00:11:03.523 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.rucaba smithi111 running (7m) 1s ago 7m 15.7M - 18.2.0 dc2bc1663786 02885adac62c 2024-09-11T00:11:03.523 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.tcrqop smithi203 running (7m) 81s ago 7m 152M - 18.2.0 dc2bc1663786 4df492159bb4 2024-09-11T00:11:03.523 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.uqkbkn smithi203 running (7m) 81s ago 7m 15.2M - 18.2.0 dc2bc1663786 619aa58ea314 2024-09-11T00:11:03.523 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.ypucji smithi111 *:8443,9283,8765 running (2m) 1s ago 15m 519M - 19.3.0-4854-g8f219c47 589dd18248e4 07fa31f49618 2024-09-11T00:11:03.523 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi203.smuspl smithi203 *:8443,9283,8765 running (112s) 81s ago 13m 451M - 19.3.0-4854-g8f219c47 589dd18248e4 7e5a93a5ffa7 2024-09-11T00:11:03.523 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (16m) 1s ago 16m 59.1M 2048M 18.2.0 dc2bc1663786 2596322539fb 2024-09-11T00:11:03.523 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi203 smithi203 running (12m) 81s ago 12m 48.1M 2048M 18.2.0 dc2bc1663786 ff8eb7ca85ea 2024-09-11T00:11:03.524 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (92s) 1s ago 14m 7604k - 1.7.0 72c9c2088986 ec478ea14488 2024-09-11T00:11:03.524 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi203 smithi203 *:9100 running (85s) 81s ago 13m 2655k - 1.7.0 72c9c2088986 54d461cde1bc 2024-09-11T00:11:03.524 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (11m) 1s ago 11m 211M 1216M 18.2.0 dc2bc1663786 162b7249a591 2024-09-11T00:11:03.524 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (10m) 1s ago 10m 224M 1216M 18.2.0 dc2bc1663786 3614d95b1425 2024-09-11T00:11:03.524 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (10m) 1s ago 10m 183M 1216M 18.2.0 dc2bc1663786 db175d4b09b9 2024-09-11T00:11:03.524 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi203 running (9m) 81s ago 9m 242M 2240M 18.2.0 dc2bc1663786 60b1cef7a70d 2024-09-11T00:11:03.524 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi203 running (9m) 81s ago 9m 207M 2240M 18.2.0 dc2bc1663786 769c7942c42b 2024-09-11T00:11:03.524 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi203 running (8m) 81s ago 8m 190M 2240M 18.2.0 dc2bc1663786 6d824001d40c 2024-09-11T00:11:03.524 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (58s) 1s ago 13m 48.3M - 2.51.0 1d3b7f56885b 3e72ac10983d 2024-09-11T00:11:03.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.523+0000 7fdf62e00700 1 -- 172.21.15.111:0/2503279644 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fdf4007a370 msgr2=0x7fdf4007c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:03.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.523+0000 7fdf62e00700 1 --2- 172.21.15.111:0/2503279644 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fdf4007a370 0x7fdf4007c820 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdf48005950 tx=0x7fdf480058e0 comp rx=0 tx=0).stop 2024-09-11T00:11:03.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.523+0000 7fdf62e00700 1 -- 172.21.15.111:0/2503279644 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdf5c100150 msgr2=0x7fdf5c197ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:03.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.523+0000 7fdf62e00700 1 --2- 172.21.15.111:0/2503279644 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdf5c100150 0x7fdf5c197ba0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c00bd70 tx=0x7fdf4c00be50 comp rx=0 tx=0).stop 2024-09-11T00:11:03.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.523+0000 7fdf62e00700 1 -- 172.21.15.111:0/2503279644 shutdown_connections 2024-09-11T00:11:03.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.523+0000 7fdf62e00700 1 --2- 172.21.15.111:0/2503279644 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fdf4007a370 0x7fdf4007c820 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:03.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.523+0000 7fdf62e00700 1 --2- 172.21.15.111:0/2503279644 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdf5c100150 0x7fdf5c197ba0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:03.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.523+0000 7fdf62e00700 1 --2- 172.21.15.111:0/2503279644 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf5c101350 0x7fdf5c1980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:03.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.523+0000 7fdf62e00700 1 -- 172.21.15.111:0/2503279644 >> 172.21.15.111:0/2503279644 conn(0x7fdf5c0fb6e0 msgr2=0x7fdf5c102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:03.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.523+0000 7fdf62e00700 1 -- 172.21.15.111:0/2503279644 shutdown_connections 2024-09-11T00:11:03.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.523+0000 7fdf62e00700 1 -- 172.21.15.111:0/2503279644 wait complete. 2024-09-11T00:11:03.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.665+0000 7f3631800700 1 -- 172.21.15.111:0/1801517804 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f362c102380 msgr2=0x7f362c102790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:03.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.665+0000 7f3631800700 1 --2- 172.21.15.111:0/1801517804 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f362c102380 0x7f362c102790 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f361c009870 tx=0x7f361c009b80 comp rx=0 tx=0).stop 2024-09-11T00:11:03.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.665+0000 7f3631800700 1 -- 172.21.15.111:0/1801517804 shutdown_connections 2024-09-11T00:11:03.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.665+0000 7f3631800700 1 --2- 172.21.15.111:0/1801517804 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f362c103580 0x7f362c1039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:03.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.665+0000 7f3631800700 1 --2- 172.21.15.111:0/1801517804 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f362c102380 0x7f362c102790 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:03.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.665+0000 7f3631800700 1 -- 172.21.15.111:0/1801517804 >> 172.21.15.111:0/1801517804 conn(0x7f362c0fd930 msgr2=0x7f362c0ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:03.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.665+0000 7f3631800700 1 -- 172.21.15.111:0/1801517804 shutdown_connections 2024-09-11T00:11:03.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.665+0000 7f3631800700 1 -- 172.21.15.111:0/1801517804 wait complete. 2024-09-11T00:11:03.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.666+0000 7f3631800700 1 Processor -- start 2024-09-11T00:11:03.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.666+0000 7f3631800700 1 -- start start 2024-09-11T00:11:03.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.667+0000 7f3631800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f362c102380 0x7f362c197b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:03.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.667+0000 7f3631800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f362c103580 0x7f362c1980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:03.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.667+0000 7f3631800700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362c1986f0 con 0x7f362c103580 2024-09-11T00:11:03.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.667+0000 7f3631800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362c198830 con 0x7f362c102380 2024-09-11T00:11:03.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.667+0000 7f3623e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f362c103580 0x7f362c1980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:03.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.667+0000 7f3623e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f362c103580 0x7f362c1980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:58758/0 (socket says 172.21.15.111:58758) 2024-09-11T00:11:03.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.667+0000 7f3623e00700 1 -- 172.21.15.111:0/2620570170 learned_addr learned my addr 172.21.15.111:0/2620570170 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:11:03.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.667+0000 7f362aa00700 1 --2- 172.21.15.111:0/2620570170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f362c102380 0x7f362c197b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:03.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.667+0000 7f3623e00700 1 -- 172.21.15.111:0/2620570170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f362c102380 msgr2=0x7f362c197b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:03.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.667+0000 7f3623e00700 1 --2- 172.21.15.111:0/2620570170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f362c102380 0x7f362c197b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:03.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.667+0000 7f3623e00700 1 -- 172.21.15.111:0/2620570170 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361c009520 con 0x7f362c103580 2024-09-11T00:11:03.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.667+0000 7f362aa00700 1 --2- 172.21.15.111:0/2620570170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f362c102380 0x7f362c197b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:11:03.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.668+0000 7f3623e00700 1 --2- 172.21.15.111:0/2620570170 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f362c103580 0x7f362c1980d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f361400e940 tx=0x7f361400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:03.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.668+0000 7f3623400700 1 -- 172.21.15.111:0/2620570170 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f361400eee0 con 0x7f362c103580 2024-09-11T00:11:03.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.668+0000 7f3623400700 1 -- 172.21.15.111:0/2620570170 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3614004ce0 con 0x7f362c103580 2024-09-11T00:11:03.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.668+0000 7f3631800700 1 -- 172.21.15.111:0/2620570170 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f362c19d2e0 con 0x7f362c103580 2024-09-11T00:11:03.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.668+0000 7f3623400700 1 -- 172.21.15.111:0/2620570170 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3614005650 con 0x7f362c103580 2024-09-11T00:11:03.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.668+0000 7f3631800700 1 -- 172.21.15.111:0/2620570170 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f362c19d8b0 con 0x7f362c103580 2024-09-11T00:11:03.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.669+0000 7f3631800700 1 -- 172.21.15.111:0/2620570170 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f362c10aed0 con 0x7f362c103580 2024-09-11T00:11:03.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.671+0000 7f3623400700 1 -- 172.21.15.111:0/2620570170 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 34) v1 ==== 102331+0+0 (secure 0 0 0) 0x7f3614004750 con 0x7f362c103580 2024-09-11T00:11:03.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.672+0000 7f3623400700 1 --2- 172.21.15.111:0/2620570170 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f361007a370 0x7f361007c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:03.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.672+0000 7f3623400700 1 -- 172.21.15.111:0/2620570170 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f3614014070 con 0x7f362c103580 2024-09-11T00:11:03.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.673+0000 7f362aa00700 1 --2- 172.21.15.111:0/2620570170 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f361007a370 0x7f361007c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:03.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.673+0000 7f362aa00700 1 --2- 172.21.15.111:0/2620570170 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f361007a370 0x7f361007c820 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f361c00b6f0 tx=0x7f361c019040 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:03.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.677+0000 7f3623400700 1 -- 172.21.15.111:0/2620570170 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f3614060cf0 con 0x7f362c103580 2024-09-11T00:11:04.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.998+0000 7f3631800700 1 -- 172.21.15.111:0/2620570170 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f362c19df50 con 0x7f362c103580 2024-09-11T00:11:04.001 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:03 smithi111 ceph-mon[27539]: from='client.14876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:11:04.001 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:03 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:11:04.001 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:03 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:11:04.001 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:03 smithi111 ceph-mon[27539]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:11:04.001 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:03 smithi111 ceph-mon[27539]: pgmap v77: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:04.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:03.999+0000 7f3623400700 1 -- 172.21.15.111:0/2620570170 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f3614063e10 con 0x7f362c103580 2024-09-11T00:11:04.001 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:11:04.002 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-11T00:11:04.002 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-11T00:11:04.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:11:04.002 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-11T00:11:04.002 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:11:04.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:11:04.002 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-11T00:11:04.002 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-11T00:11:04.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:11:04.002 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-11T00:11:04.002 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-11T00:11:04.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:11:04.003 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-11T00:11:04.003 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-11T00:11:04.003 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:11:04.003 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-11T00:11:04.003 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:11:04.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.002+0000 7f3631800700 1 -- 172.21.15.111:0/2620570170 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f361007a370 msgr2=0x7f361007c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:04.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.002+0000 7f3631800700 1 --2- 172.21.15.111:0/2620570170 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f361007a370 0x7f361007c820 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f361c00b6f0 tx=0x7f361c019040 comp rx=0 tx=0).stop 2024-09-11T00:11:04.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.002+0000 7f3631800700 1 -- 172.21.15.111:0/2620570170 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f362c103580 msgr2=0x7f362c1980d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:04.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.002+0000 7f3631800700 1 --2- 172.21.15.111:0/2620570170 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f362c103580 0x7f362c1980d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f361400e940 tx=0x7f361400ed00 comp rx=0 tx=0).stop 2024-09-11T00:11:04.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.002+0000 7f3631800700 1 -- 172.21.15.111:0/2620570170 shutdown_connections 2024-09-11T00:11:04.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.002+0000 7f3631800700 1 --2- 172.21.15.111:0/2620570170 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f361007a370 0x7f361007c820 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:04.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.002+0000 7f3631800700 1 --2- 172.21.15.111:0/2620570170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f362c102380 0x7f362c197b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:04.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.002+0000 7f3631800700 1 --2- 172.21.15.111:0/2620570170 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f362c103580 0x7f362c1980d0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:04.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.002+0000 7f3631800700 1 -- 172.21.15.111:0/2620570170 >> 172.21.15.111:0/2620570170 conn(0x7f362c0fd930 msgr2=0x7f362c1067b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:04.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.002+0000 7f3631800700 1 -- 172.21.15.111:0/2620570170 shutdown_connections 2024-09-11T00:11:04.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.002+0000 7f3631800700 1 -- 172.21.15.111:0/2620570170 wait complete. 2024-09-11T00:11:04.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:03 smithi203 ceph-mon[33225]: from='client.14876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:11:04.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:03 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:11:04.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:03 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:11:04.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:03 smithi203 ceph-mon[33225]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:11:04.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:03 smithi203 ceph-mon[33225]: pgmap v77: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:04.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.139+0000 7f41d4200700 1 -- 172.21.15.111:0/148667663 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41cc101350 msgr2=0x7f41cc1017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:04.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.139+0000 7f41d4200700 1 --2- 172.21.15.111:0/148667663 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41cc101350 0x7f41cc1017a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f41b8009910 tx=0x7f41b8009c20 comp rx=0 tx=0).stop 2024-09-11T00:11:04.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.139+0000 7f41d4200700 1 -- 172.21.15.111:0/148667663 shutdown_connections 2024-09-11T00:11:04.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.139+0000 7f41d4200700 1 --2- 172.21.15.111:0/148667663 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41cc101350 0x7f41cc1017a0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:04.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.139+0000 7f41d4200700 1 --2- 172.21.15.111:0/148667663 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41cc100150 0x7f41cc100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:04.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.139+0000 7f41d4200700 1 -- 172.21.15.111:0/148667663 >> 172.21.15.111:0/148667663 conn(0x7f41cc0fb6e0 msgr2=0x7f41cc0fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:04.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.140+0000 7f41d4200700 1 -- 172.21.15.111:0/148667663 shutdown_connections 2024-09-11T00:11:04.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.140+0000 7f41d4200700 1 -- 172.21.15.111:0/148667663 wait complete. 2024-09-11T00:11:04.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.141+0000 7f41d4200700 1 Processor -- start 2024-09-11T00:11:04.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.141+0000 7f41d4200700 1 -- start start 2024-09-11T00:11:04.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.141+0000 7f41d4200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41cc100150 0x7f41cc195960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:04.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.141+0000 7f41d4200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41cc101350 0x7f41cc195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:04.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.141+0000 7f41d4200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc1964c0 con 0x7f41cc100150 2024-09-11T00:11:04.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.141+0000 7f41d4200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc196600 con 0x7f41cc101350 2024-09-11T00:11:04.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.141+0000 7f41d1800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41cc100150 0x7f41cc195960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:04.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.141+0000 7f41d1800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41cc100150 0x7f41cc195960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:58784/0 (socket says 172.21.15.111:58784) 2024-09-11T00:11:04.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.141+0000 7f41d1800700 1 -- 172.21.15.111:0/1766569676 learned_addr learned my addr 172.21.15.111:0/1766569676 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:11:04.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.142+0000 7f41d0e00700 1 --2- 172.21.15.111:0/1766569676 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41cc101350 0x7f41cc195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:04.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.142+0000 7f41d1800700 1 -- 172.21.15.111:0/1766569676 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41cc101350 msgr2=0x7f41cc195ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:04.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.142+0000 7f41d1800700 1 --2- 172.21.15.111:0/1766569676 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41cc101350 0x7f41cc195ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:04.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.142+0000 7f41d1800700 1 -- 172.21.15.111:0/1766569676 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b80095f0 con 0x7f41cc100150 2024-09-11T00:11:04.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.142+0000 7f41d0e00700 1 --2- 172.21.15.111:0/1766569676 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41cc101350 0x7f41cc195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:11:04.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.142+0000 7f41d1800700 1 --2- 172.21.15.111:0/1766569676 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41cc100150 0x7f41cc195960 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f41c000d900 tx=0x7f41c000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:04.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.142+0000 7f41ca000700 1 -- 172.21.15.111:0/1766569676 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41c00041f0 con 0x7f41cc100150 2024-09-11T00:11:04.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.142+0000 7f41ca000700 1 -- 172.21.15.111:0/1766569676 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f41c0004350 con 0x7f41cc100150 2024-09-11T00:11:04.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.142+0000 7f41d4200700 1 -- 172.21.15.111:0/1766569676 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41cc19b0b0 con 0x7f41cc100150 2024-09-11T00:11:04.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.142+0000 7f41ca000700 1 -- 172.21.15.111:0/1766569676 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41c0003da0 con 0x7f41cc100150 2024-09-11T00:11:04.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.142+0000 7f41d4200700 1 -- 172.21.15.111:0/1766569676 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41cc19b600 con 0x7f41cc100150 2024-09-11T00:11:04.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.144+0000 7f41d4200700 1 -- 172.21.15.111:0/1766569676 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41cc108ca0 con 0x7f41cc100150 2024-09-11T00:11:04.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.145+0000 7f41ca000700 1 -- 172.21.15.111:0/1766569676 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 34) v1 ==== 102331+0+0 (secure 0 0 0) 0x7f41c0009730 con 0x7f41cc100150 2024-09-11T00:11:04.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.145+0000 7f41ca000700 1 --2- 172.21.15.111:0/1766569676 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f41b407a370 0x7f41b407c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:04.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.146+0000 7f41ca000700 1 -- 172.21.15.111:0/1766569676 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f41c009cef0 con 0x7f41cc100150 2024-09-11T00:11:04.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.146+0000 7f41d0e00700 1 --2- 172.21.15.111:0/1766569676 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f41b407a370 0x7f41b407c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:04.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.146+0000 7f41d0e00700 1 --2- 172.21.15.111:0/1766569676 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f41b407a370 0x7f41b407c820 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f41b8006010 tx=0x7f41b800b540 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:04.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.152+0000 7f41ca000700 1 -- 172.21.15.111:0/1766569676 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f41c0060a70 con 0x7f41cc100150 2024-09-11T00:11:04.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.401+0000 7f41d4200700 1 -- 172.21.15.111:0/1766569676 --> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f41cc105ca0 con 0x7f41b407a370 2024-09-11T00:11:04.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.402+0000 7f41ca000700 1 -- 172.21.15.111:0/1766569676 <== mgr.14744 v2:172.21.15.111:6800/3952658086 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f41cc105ca0 con 0x7f41b407a370 2024-09-11T00:11:04.404 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:11:04.404 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e", 2024-09-11T00:11:04.404 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-11T00:11:04.404 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-11T00:11:04.404 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-11T00:11:04.404 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr" 2024-09-11T00:11:04.404 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-11T00:11:04.404 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "2/2 daemons upgraded", 2024-09-11T00:11:04.405 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading grafana daemons", 2024-09-11T00:11:04.405 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-11T00:11:04.405 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:11:04.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.405+0000 7f41d4200700 1 -- 172.21.15.111:0/1766569676 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f41b407a370 msgr2=0x7f41b407c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:04.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.405+0000 7f41d4200700 1 --2- 172.21.15.111:0/1766569676 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f41b407a370 0x7f41b407c820 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f41b8006010 tx=0x7f41b800b540 comp rx=0 tx=0).stop 2024-09-11T00:11:04.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.405+0000 7f41d4200700 1 -- 172.21.15.111:0/1766569676 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41cc100150 msgr2=0x7f41cc195960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:04.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.405+0000 7f41d4200700 1 --2- 172.21.15.111:0/1766569676 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41cc100150 0x7f41cc195960 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f41c000d900 tx=0x7f41c000dcc0 comp rx=0 tx=0).stop 2024-09-11T00:11:04.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.405+0000 7f41d4200700 1 -- 172.21.15.111:0/1766569676 shutdown_connections 2024-09-11T00:11:04.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.405+0000 7f41d4200700 1 --2- 172.21.15.111:0/1766569676 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f41b407a370 0x7f41b407c820 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:04.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.405+0000 7f41d4200700 1 --2- 172.21.15.111:0/1766569676 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41cc100150 0x7f41cc195960 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:04.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.405+0000 7f41d4200700 1 --2- 172.21.15.111:0/1766569676 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41cc101350 0x7f41cc195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:04.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.405+0000 7f41d4200700 1 -- 172.21.15.111:0/1766569676 >> 172.21.15.111:0/1766569676 conn(0x7f41cc0fb6e0 msgr2=0x7f41cc104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:04.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.405+0000 7f41d4200700 1 -- 172.21.15.111:0/1766569676 shutdown_connections 2024-09-11T00:11:04.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:04.405+0000 7f41d4200700 1 -- 172.21.15.111:0/1766569676 wait complete. 2024-09-11T00:11:05.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:04 smithi111 ceph-mon[27539]: from='client.14884 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:11:05.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:04 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/2620570170' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:05.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:04 smithi203 ceph-mon[33225]: from='client.14884 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:11:05.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:04 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/2620570170' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:06.122 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:05 smithi111 ceph-mon[27539]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:11:06.122 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:05 smithi111 ceph-mon[27539]: pgmap v78: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:06.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:05 smithi203 ceph-mon[33225]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:11:06.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:05 smithi203 ceph-mon[33225]: pgmap v78: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:06.968 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:06 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:11:07.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:06 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:11:07.824 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:07 smithi111 ceph-mon[27539]: pgmap v79: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:08.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:07 smithi203 ceph-mon[33225]: pgmap v79: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:09.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:11:09.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:11:09.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:11:09.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:11:09.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:11:09.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-11T00:11:09.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:11:09.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:09.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:09.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:09.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:09.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:09.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:09.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:09.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:09.655 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:09.655 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:09.655 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:09.655 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:09.655 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:09.655 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:11:09.655 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-11T00:11:09.655 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-11T00:11:09.655 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-11T00:11:09.655 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-11T00:11:09.655 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-11T00:11:09.655 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-11T00:11:09.656 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-11T00:11:09.656 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-11T00:11:09.656 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-11T00:11:09.656 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-11T00:11:09.656 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-11T00:11:09.656 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-11T00:11:09.656 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-11T00:11:09.656 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-11T00:11:09.656 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-11T00:11:09.656 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-11T00:11:09.656 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-11T00:11:09.656 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-11T00:11:09.656 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-11T00:11:09.657 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-11T00:11:09.657 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-11T00:11:09.657 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-11T00:11:09.657 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-11T00:11:09.657 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-11T00:11:09.657 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-11T00:11:09.657 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-11T00:11:09.657 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-11T00:11:09.657 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:11:09.657 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:11:09.657 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:11:09.657 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:11:09.657 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:11:09.657 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:11:09.658 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:11:09.658 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:09 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:11:09.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:11:09.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:11:09.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:11:09.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:11:09.797 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:11:09.797 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-11T00:11:09.797 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:11:09.797 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:09.797 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:09.797 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:09.797 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:09.797 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:09.797 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:09.797 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:09.797 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:09.797 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:09.798 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:09.798 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:09.798 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:09.798 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:09.798 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:11:09.798 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-11T00:11:09.798 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-11T00:11:09.798 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-11T00:11:09.798 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-11T00:11:09.798 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-11T00:11:09.798 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-11T00:11:09.798 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-11T00:11:09.798 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-11T00:11:09.798 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-11T00:11:09.799 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-11T00:11:09.799 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-11T00:11:09.799 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-11T00:11:09.799 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-11T00:11:09.799 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-11T00:11:09.799 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-11T00:11:09.799 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-11T00:11:09.799 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-11T00:11:09.799 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-11T00:11:09.799 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-11T00:11:09.799 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-11T00:11:09.799 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-11T00:11:09.799 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-11T00:11:09.799 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-11T00:11:09.800 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-11T00:11:09.800 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-11T00:11:09.800 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-11T00:11:09.800 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-11T00:11:09.800 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:11:09.800 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:11:09.800 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:11:09.800 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:11:09.800 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:11:09.800 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:11:09.800 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:11:09.800 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:09 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:11:10.528 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:10 smithi111 ceph-mon[27539]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-11T00:11:10.528 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:10 smithi111 ceph-mon[27539]: Upgrade: Finalizing container_image settings 2024-09-11T00:11:10.528 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:10 smithi111 ceph-mon[27539]: Upgrade: Complete! 2024-09-11T00:11:10.529 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:10 smithi111 ceph-mon[27539]: pgmap v80: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:10.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:10 smithi203 ceph-mon[33225]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-11T00:11:10.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:10 smithi203 ceph-mon[33225]: Upgrade: Finalizing container_image settings 2024-09-11T00:11:10.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:10 smithi203 ceph-mon[33225]: Upgrade: Complete! 2024-09-11T00:11:10.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:10 smithi203 ceph-mon[33225]: pgmap v80: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:12.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:12 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:11:12.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:12 smithi203 ceph-mon[33225]: pgmap v81: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:12.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:12 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:11:12.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:12 smithi111 ceph-mon[27539]: pgmap v81: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:14.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:14 smithi203 ceph-mon[33225]: pgmap v82: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:14.654 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:14 smithi111 ceph-mon[27539]: pgmap v82: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:16.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:16 smithi203 ceph-mon[33225]: pgmap v83: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:16.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:16 smithi111 ceph-mon[27539]: pgmap v83: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:18.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:18 smithi203 ceph-mon[33225]: pgmap v84: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:18.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:18 smithi111 ceph-mon[27539]: pgmap v84: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:20.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:19 smithi111 ceph-mon[27539]: pgmap v85: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:20.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:19 smithi203 ceph-mon[33225]: pgmap v85: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:21.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:21 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:11:21.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:21 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:11:22.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:22 smithi203 ceph-mon[33225]: pgmap v86: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:22.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:22 smithi111 ceph-mon[27539]: pgmap v86: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:24.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:24 smithi111 ceph-mon[27539]: pgmap v87: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:24.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:24 smithi203 ceph-mon[33225]: pgmap v87: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:26.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:26 smithi203 ceph-mon[33225]: pgmap v88: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:26.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:26 smithi111 ceph-mon[27539]: pgmap v88: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:28.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:28 smithi203 ceph-mon[33225]: pgmap v89: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:28.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:28 smithi111 ceph-mon[27539]: pgmap v89: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:30.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:29 smithi111 ceph-mon[27539]: pgmap v90: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:30.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:29 smithi203 ceph-mon[33225]: pgmap v90: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:32.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:32 smithi203 ceph-mon[33225]: pgmap v91: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:32.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:32 smithi111 ceph-mon[27539]: pgmap v91: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:34.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:34 smithi111 ceph-mon[27539]: pgmap v92: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:34.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:34 smithi203 ceph-mon[33225]: pgmap v92: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:34.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.559+0000 7f928c400700 1 -- 172.21.15.111:0/1585041906 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9284073750 msgr2=0x7f9284073bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:34.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.559+0000 7f928c400700 1 --2- 172.21.15.111:0/1585041906 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9284073750 0x7f9284073bc0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9270009910 tx=0x7f9270009c20 comp rx=0 tx=0).stop 2024-09-11T00:11:34.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.559+0000 7f928c400700 1 -- 172.21.15.111:0/1585041906 shutdown_connections 2024-09-11T00:11:34.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.559+0000 7f928c400700 1 --2- 172.21.15.111:0/1585041906 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9284073750 0x7f9284073bc0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.559+0000 7f928c400700 1 --2- 172.21.15.111:0/1585041906 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9284074d20 0x7f9284073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.559+0000 7f928c400700 1 -- 172.21.15.111:0/1585041906 >> 172.21.15.111:0/1585041906 conn(0x7f92840fb6e0 msgr2=0x7f92840fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:34.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.559+0000 7f928c400700 1 -- 172.21.15.111:0/1585041906 shutdown_connections 2024-09-11T00:11:34.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.559+0000 7f928c400700 1 -- 172.21.15.111:0/1585041906 wait complete. 2024-09-11T00:11:34.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.560+0000 7f928c400700 1 Processor -- start 2024-09-11T00:11:34.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.560+0000 7f928c400700 1 -- start start 2024-09-11T00:11:34.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.560+0000 7f928c400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9284073750 0x7f9284197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:34.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.560+0000 7f928c400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9284074d20 0x7f9284198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:34.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.560+0000 7f928c400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92841986a0 con 0x7f9284073750 2024-09-11T00:11:34.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.560+0000 7f928c400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92841987e0 con 0x7f9284074d20 2024-09-11T00:11:34.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.561+0000 7f9289a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9284073750 0x7f9284197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:34.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.561+0000 7f9289a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9284073750 0x7f9284197b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:59496/0 (socket says 172.21.15.111:59496) 2024-09-11T00:11:34.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.561+0000 7f9289a00700 1 -- 172.21.15.111:0/3311693898 learned_addr learned my addr 172.21.15.111:0/3311693898 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:11:34.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.561+0000 7f9289000700 1 --2- 172.21.15.111:0/3311693898 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9284074d20 0x7f9284198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:34.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.561+0000 7f9289a00700 1 -- 172.21.15.111:0/3311693898 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9284074d20 msgr2=0x7f9284198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:34.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.561+0000 7f9289a00700 1 --2- 172.21.15.111:0/3311693898 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9284074d20 0x7f9284198080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.561+0000 7f9289a00700 1 -- 172.21.15.111:0/3311693898 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92700095f0 con 0x7f9284073750 2024-09-11T00:11:34.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.561+0000 7f9289a00700 1 --2- 172.21.15.111:0/3311693898 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9284073750 0x7f9284197b40 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f927800d8d0 tx=0x7f927800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:34.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.562+0000 7f9282000700 1 -- 172.21.15.111:0/3311693898 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9278009940 con 0x7f9284073750 2024-09-11T00:11:34.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.562+0000 7f9282000700 1 -- 172.21.15.111:0/3311693898 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9278010460 con 0x7f9284073750 2024-09-11T00:11:34.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.562+0000 7f928c400700 1 -- 172.21.15.111:0/3311693898 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f928419d290 con 0x7f9284073750 2024-09-11T00:11:34.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.562+0000 7f9282000700 1 -- 172.21.15.111:0/3311693898 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f927800f5f0 con 0x7f9284073750 2024-09-11T00:11:34.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.562+0000 7f928c400700 1 -- 172.21.15.111:0/3311693898 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f928419d860 con 0x7f9284073750 2024-09-11T00:11:34.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.563+0000 7f928c400700 1 -- 172.21.15.111:0/3311693898 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f928410ae90 con 0x7f9284073750 2024-09-11T00:11:34.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.564+0000 7f9282000700 1 -- 172.21.15.111:0/3311693898 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 34) v1 ==== 102331+0+0 (secure 0 0 0) 0x7f92780105d0 con 0x7f9284073750 2024-09-11T00:11:34.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.565+0000 7f9282000700 1 --2- 172.21.15.111:0/3311693898 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f926c07a370 0x7f926c07c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:34.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.565+0000 7f9282000700 1 -- 172.21.15.111:0/3311693898 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f927809cc50 con 0x7f9284073750 2024-09-11T00:11:34.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.566+0000 7f9289000700 1 --2- 172.21.15.111:0/3311693898 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f926c07a370 0x7f926c07c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:34.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.566+0000 7f9289000700 1 --2- 172.21.15.111:0/3311693898 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f926c07a370 0x7f926c07c820 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9270006010 tx=0x7f927000b580 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:34.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.570+0000 7f9282000700 1 -- 172.21.15.111:0/3311693898 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f92780608f0 con 0x7f9284073750 2024-09-11T00:11:34.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.805+0000 7f928c400700 1 -- 172.21.15.111:0/3311693898 --> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f92841076b0 con 0x7f926c07a370 2024-09-11T00:11:34.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.806+0000 7f9282000700 1 -- 172.21.15.111:0/3311693898 <== mgr.14744 v2:172.21.15.111:6800/3952658086 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f92841076b0 con 0x7f926c07a370 2024-09-11T00:11:34.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.808+0000 7f928c400700 1 -- 172.21.15.111:0/3311693898 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f926c07a370 msgr2=0x7f926c07c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:34.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.808+0000 7f928c400700 1 --2- 172.21.15.111:0/3311693898 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f926c07a370 0x7f926c07c820 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9270006010 tx=0x7f927000b580 comp rx=0 tx=0).stop 2024-09-11T00:11:34.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.808+0000 7f928c400700 1 -- 172.21.15.111:0/3311693898 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9284073750 msgr2=0x7f9284197b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:34.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.808+0000 7f928c400700 1 --2- 172.21.15.111:0/3311693898 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9284073750 0x7f9284197b40 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f927800d8d0 tx=0x7f927800dc90 comp rx=0 tx=0).stop 2024-09-11T00:11:34.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.808+0000 7f928c400700 1 -- 172.21.15.111:0/3311693898 shutdown_connections 2024-09-11T00:11:34.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.808+0000 7f928c400700 1 --2- 172.21.15.111:0/3311693898 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f926c07a370 0x7f926c07c820 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.809+0000 7f928c400700 1 --2- 172.21.15.111:0/3311693898 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9284073750 0x7f9284197b40 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.809+0000 7f928c400700 1 --2- 172.21.15.111:0/3311693898 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9284074d20 0x7f9284198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:34.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.809+0000 7f928c400700 1 -- 172.21.15.111:0/3311693898 >> 172.21.15.111:0/3311693898 conn(0x7f92840fb6e0 msgr2=0x7f9284105f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:34.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.809+0000 7f928c400700 1 -- 172.21.15.111:0/3311693898 shutdown_connections 2024-09-11T00:11:34.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:34.809+0000 7f928c400700 1 -- 172.21.15.111:0/3311693898 wait complete. 2024-09-11T00:11:35.481 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -e sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-09-11T00:11:35.846 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:11:36.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:36 smithi203 ceph-mon[33225]: from='client.14896 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:11:36.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:36 smithi203 ceph-mon[33225]: pgmap v93: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:36.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:36 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:11:36.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:36 smithi111 ceph-mon[27539]: from='client.14896 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:11:36.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:36 smithi111 ceph-mon[27539]: pgmap v93: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:36.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:36 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:11:38.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:38 smithi203 ceph-mon[33225]: pgmap v94: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:38.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:38 smithi111 ceph-mon[27539]: pgmap v94: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:40.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:39 smithi111 ceph-mon[27539]: pgmap v95: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:40.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:39 smithi203 ceph-mon[33225]: pgmap v95: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:40.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.668+0000 7fbc0a800700 1 -- 172.21.15.111:0/2232705272 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc04100d50 msgr2=0x7fbc04104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:40.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.668+0000 7fbc0a800700 1 --2- 172.21.15.111:0/2232705272 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc04100d50 0x7fbc04104d20 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0009910 tx=0x7fbbf0009c20 comp rx=0 tx=0).stop 2024-09-11T00:11:40.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.668+0000 7fbc0a800700 1 -- 172.21.15.111:0/2232705272 shutdown_connections 2024-09-11T00:11:40.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.668+0000 7fbc0a800700 1 --2- 172.21.15.111:0/2232705272 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc04100d50 0x7fbc04104d20 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.668+0000 7fbc0a800700 1 --2- 172.21.15.111:0/2232705272 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc041003b0 0x7fbc04100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.668+0000 7fbc0a800700 1 -- 172.21.15.111:0/2232705272 >> 172.21.15.111:0/2232705272 conn(0x7fbc040fbc30 msgr2=0x7fbc040fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:40.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.668+0000 7fbc0a800700 1 -- 172.21.15.111:0/2232705272 shutdown_connections 2024-09-11T00:11:40.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.668+0000 7fbc0a800700 1 -- 172.21.15.111:0/2232705272 wait complete. 2024-09-11T00:11:40.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.669+0000 7fbc0a800700 1 Processor -- start 2024-09-11T00:11:40.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.669+0000 7fbc0a800700 1 -- start start 2024-09-11T00:11:40.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.669+0000 7fbc0a800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc041003b0 0x7fbc04073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:40.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.669+0000 7fbc0a800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc04100d50 0x7fbc04073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:40.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.669+0000 7fbc0a800700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc04073ad0 con 0x7fbc041003b0 2024-09-11T00:11:40.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.669+0000 7fbc0a800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc04073c10 con 0x7fbc04100d50 2024-09-11T00:11:40.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.670+0000 7fbc03400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc041003b0 0x7fbc04073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:40.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.670+0000 7fbc03400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc041003b0 0x7fbc04073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39836/0 (socket says 172.21.15.111:39836) 2024-09-11T00:11:40.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.670+0000 7fbc03400700 1 -- 172.21.15.111:0/2419939295 learned_addr learned my addr 172.21.15.111:0/2419939295 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:11:40.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.670+0000 7fbc02a00700 1 --2- 172.21.15.111:0/2419939295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc04100d50 0x7fbc04073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:40.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.670+0000 7fbc03400700 1 -- 172.21.15.111:0/2419939295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc04100d50 msgr2=0x7fbc04073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:40.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.670+0000 7fbc03400700 1 --2- 172.21.15.111:0/2419939295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc04100d50 0x7fbc04073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:40.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.670+0000 7fbc03400700 1 -- 172.21.15.111:0/2419939295 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf00095f0 con 0x7fbc041003b0 2024-09-11T00:11:40.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.671+0000 7fbc03400700 1 --2- 172.21.15.111:0/2419939295 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc041003b0 0x7fbc04073050 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400d8d0 tx=0x7fbbf400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:40.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.671+0000 7fbbfbe00700 1 -- 172.21.15.111:0/2419939295 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbf4009940 con 0x7fbc041003b0 2024-09-11T00:11:40.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.671+0000 7fbbfbe00700 1 -- 172.21.15.111:0/2419939295 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbbf4010460 con 0x7fbc041003b0 2024-09-11T00:11:40.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.671+0000 7fbc0a800700 1 -- 172.21.15.111:0/2419939295 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc041a1f90 con 0x7fbc041003b0 2024-09-11T00:11:40.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.671+0000 7fbbfbe00700 1 -- 172.21.15.111:0/2419939295 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbf400f5f0 con 0x7fbc041003b0 2024-09-11T00:11:40.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.671+0000 7fbc0a800700 1 -- 172.21.15.111:0/2419939295 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc041a23a0 con 0x7fbc041003b0 2024-09-11T00:11:40.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.672+0000 7fbc0a800700 1 -- 172.21.15.111:0/2419939295 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc04108720 con 0x7fbc041003b0 2024-09-11T00:11:40.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.674+0000 7fbbfbe00700 1 -- 172.21.15.111:0/2419939295 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 34) v1 ==== 102331+0+0 (secure 0 0 0) 0x7fbbf40105d0 con 0x7fbc041003b0 2024-09-11T00:11:40.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.675+0000 7fbbfbe00700 1 --2- 172.21.15.111:0/2419939295 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fbbe807a370 0x7fbbe807c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:40.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.675+0000 7fbbfbe00700 1 -- 172.21.15.111:0/2419939295 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fbbf409cdd0 con 0x7fbc041003b0 2024-09-11T00:11:40.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.675+0000 7fbc02a00700 1 --2- 172.21.15.111:0/2419939295 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fbbe807a370 0x7fbbe807c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:40.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.676+0000 7fbc02a00700 1 --2- 172.21.15.111:0/2419939295 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fbbe807a370 0x7fbbe807c820 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbc04074840 tx=0x7fbbf001a040 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:40.680 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:40.679+0000 7fbbfbe00700 1 -- 172.21.15.111:0/2419939295 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7fbbf4060a80 con 0x7fbc041003b0 2024-09-11T00:11:41.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:41.000+0000 7fbc0a800700 1 -- 172.21.15.111:0/2419939295 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbc0402ccd0 con 0x7fbc041003b0 2024-09-11T00:11:41.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:41.001+0000 7fbbfbe00700 1 -- 172.21.15.111:0/2419939295 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7fbbf4063ba0 con 0x7fbc041003b0 2024-09-11T00:11:41.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:41.005+0000 7fbc0a800700 1 -- 172.21.15.111:0/2419939295 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fbbe807a370 msgr2=0x7fbbe807c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:41.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:41.005+0000 7fbc0a800700 1 --2- 172.21.15.111:0/2419939295 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fbbe807a370 0x7fbbe807c820 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbc04074840 tx=0x7fbbf001a040 comp rx=0 tx=0).stop 2024-09-11T00:11:41.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:41.005+0000 7fbc0a800700 1 -- 172.21.15.111:0/2419939295 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc041003b0 msgr2=0x7fbc04073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:41.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:41.005+0000 7fbc0a800700 1 --2- 172.21.15.111:0/2419939295 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc041003b0 0x7fbc04073050 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400d8d0 tx=0x7fbbf400dc90 comp rx=0 tx=0).stop 2024-09-11T00:11:41.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:41.005+0000 7fbc0a800700 1 -- 172.21.15.111:0/2419939295 shutdown_connections 2024-09-11T00:11:41.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:41.005+0000 7fbc0a800700 1 --2- 172.21.15.111:0/2419939295 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fbbe807a370 0x7fbbe807c820 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:41.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:41.005+0000 7fbc0a800700 1 --2- 172.21.15.111:0/2419939295 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc041003b0 0x7fbc04073050 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:41.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:41.005+0000 7fbc0a800700 1 --2- 172.21.15.111:0/2419939295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc04100d50 0x7fbc04073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:41.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:41.005+0000 7fbc0a800700 1 -- 172.21.15.111:0/2419939295 >> 172.21.15.111:0/2419939295 conn(0x7fbc040fbc30 msgr2=0x7fbc040fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:41.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:41.005+0000 7fbc0a800700 1 -- 172.21.15.111:0/2419939295 shutdown_connections 2024-09-11T00:11:41.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:41.005+0000 7fbc0a800700 1 -- 172.21.15.111:0/2419939295 wait complete. 2024-09-11T00:11:41.021 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:11:41.343 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:41 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/2419939295' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:41.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:41 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/2419939295' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:41.742 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -e sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-09-11T00:11:42.095 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:11:42.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:42 smithi111 ceph-mon[27539]: pgmap v96: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:42.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:42 smithi203 ceph-mon[33225]: pgmap v96: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:43.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.990+0000 7fd079000700 1 -- 172.21.15.111:0/1905736586 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd074102610 msgr2=0x7fd0741029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:43.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.990+0000 7fd079000700 1 --2- 172.21.15.111:0/1905736586 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd074102610 0x7fd0741029e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd064009910 tx=0x7fd064009c20 comp rx=0 tx=0).stop 2024-09-11T00:11:43.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.990+0000 7fd079000700 1 -- 172.21.15.111:0/1905736586 shutdown_connections 2024-09-11T00:11:43.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.990+0000 7fd079000700 1 --2- 172.21.15.111:0/1905736586 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd074102fb0 0x7fd074106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:43.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.990+0000 7fd079000700 1 --2- 172.21.15.111:0/1905736586 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd074102610 0x7fd0741029e0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:43.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.990+0000 7fd079000700 1 -- 172.21.15.111:0/1905736586 >> 172.21.15.111:0/1905736586 conn(0x7fd0740fde90 msgr2=0x7fd0741002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:43.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.990+0000 7fd079000700 1 -- 172.21.15.111:0/1905736586 shutdown_connections 2024-09-11T00:11:43.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.990+0000 7fd079000700 1 -- 172.21.15.111:0/1905736586 wait complete. 2024-09-11T00:11:43.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.991+0000 7fd079000700 1 Processor -- start 2024-09-11T00:11:43.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.991+0000 7fd079000700 1 -- start start 2024-09-11T00:11:43.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.991+0000 7fd079000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd074102610 0x7fd074197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:43.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.991+0000 7fd079000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd074102fb0 0x7fd074198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:43.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.991+0000 7fd079000700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd074198be0 con 0x7fd074102fb0 2024-09-11T00:11:43.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.991+0000 7fd079000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07419c970 con 0x7fd074102610 2024-09-11T00:11:43.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.992+0000 7fd071400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd074102fb0 0x7fd074198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:43.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.992+0000 7fd071400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd074102fb0 0x7fd074198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39854/0 (socket says 172.21.15.111:39854) 2024-09-11T00:11:43.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.992+0000 7fd071400700 1 -- 172.21.15.111:0/640120287 learned_addr learned my addr 172.21.15.111:0/640120287 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:11:43.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.992+0000 7fd071e00700 1 --2- 172.21.15.111:0/640120287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd074102610 0x7fd074197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:43.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.992+0000 7fd071400700 1 -- 172.21.15.111:0/640120287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd074102610 msgr2=0x7fd074197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:43.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.992+0000 7fd071400700 1 --2- 172.21.15.111:0/640120287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd074102610 0x7fd074197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:43.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.992+0000 7fd071400700 1 -- 172.21.15.111:0/640120287 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0640095f0 con 0x7fd074102fb0 2024-09-11T00:11:43.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.992+0000 7fd071400700 1 --2- 172.21.15.111:0/640120287 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd074102fb0 0x7fd074198500 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd06000d900 tx=0x7fd06000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:43.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.993+0000 7fd06aa00700 1 -- 172.21.15.111:0/640120287 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd060009900 con 0x7fd074102fb0 2024-09-11T00:11:43.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.993+0000 7fd079000700 1 -- 172.21.15.111:0/640120287 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd07419cc50 con 0x7fd074102fb0 2024-09-11T00:11:43.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.993+0000 7fd06aa00700 1 -- 172.21.15.111:0/640120287 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd060010460 con 0x7fd074102fb0 2024-09-11T00:11:43.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.993+0000 7fd06aa00700 1 -- 172.21.15.111:0/640120287 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd06000f5f0 con 0x7fd074102fb0 2024-09-11T00:11:43.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.993+0000 7fd079000700 1 -- 172.21.15.111:0/640120287 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd07419d1a0 con 0x7fd074102fb0 2024-09-11T00:11:43.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.994+0000 7fd079000700 1 -- 172.21.15.111:0/640120287 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd07404ea50 con 0x7fd074102fb0 2024-09-11T00:11:43.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.995+0000 7fd06aa00700 1 -- 172.21.15.111:0/640120287 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 34) v1 ==== 102331+0+0 (secure 0 0 0) 0x7fd0600105d0 con 0x7fd074102fb0 2024-09-11T00:11:43.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.996+0000 7fd06aa00700 1 --2- 172.21.15.111:0/640120287 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fd05807a370 0x7fd05807c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:43.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.996+0000 7fd06aa00700 1 -- 172.21.15.111:0/640120287 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fd06009c970 con 0x7fd074102fb0 2024-09-11T00:11:43.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.997+0000 7fd071e00700 1 --2- 172.21.15.111:0/640120287 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fd05807a370 0x7fd05807c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:43.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:43.997+0000 7fd071e00700 1 --2- 172.21.15.111:0/640120287 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fd05807a370 0x7fd05807c820 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd064006010 tx=0x7fd06401a040 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:44.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:44.002+0000 7fd06aa00700 1 -- 172.21.15.111:0/640120287 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7fd0600604f0 con 0x7fd074102fb0 2024-09-11T00:11:44.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:44.316+0000 7fd079000700 1 -- 172.21.15.111:0/640120287 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd074199320 con 0x7fd074102fb0 2024-09-11T00:11:44.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:44.316+0000 7fd06aa00700 1 -- 172.21.15.111:0/640120287 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7fd060063610 con 0x7fd074102fb0 2024-09-11T00:11:44.321 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:44.319+0000 7fd079000700 1 -- 172.21.15.111:0/640120287 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fd05807a370 msgr2=0x7fd05807c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:44.321 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:44.319+0000 7fd079000700 1 --2- 172.21.15.111:0/640120287 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fd05807a370 0x7fd05807c820 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd064006010 tx=0x7fd06401a040 comp rx=0 tx=0).stop 2024-09-11T00:11:44.321 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:44.319+0000 7fd079000700 1 -- 172.21.15.111:0/640120287 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd074102fb0 msgr2=0x7fd074198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:44.321 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:44.319+0000 7fd079000700 1 --2- 172.21.15.111:0/640120287 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd074102fb0 0x7fd074198500 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd06000d900 tx=0x7fd06000dc10 comp rx=0 tx=0).stop 2024-09-11T00:11:44.322 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:44.319+0000 7fd079000700 1 -- 172.21.15.111:0/640120287 shutdown_connections 2024-09-11T00:11:44.322 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:44.319+0000 7fd079000700 1 --2- 172.21.15.111:0/640120287 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fd05807a370 0x7fd05807c820 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.322 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:44.319+0000 7fd079000700 1 --2- 172.21.15.111:0/640120287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd074102610 0x7fd074197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.322 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:44.319+0000 7fd079000700 1 --2- 172.21.15.111:0/640120287 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd074102fb0 0x7fd074198500 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:44.322 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:44.319+0000 7fd079000700 1 -- 172.21.15.111:0/640120287 >> 172.21.15.111:0/640120287 conn(0x7fd0740fde90 msgr2=0x7fd0740ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:44.322 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:44.319+0000 7fd079000700 1 -- 172.21.15.111:0/640120287 shutdown_connections 2024-09-11T00:11:44.322 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:44.319+0000 7fd079000700 1 -- 172.21.15.111:0/640120287 wait complete. 2024-09-11T00:11:44.335 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)" 2024-09-11T00:11:44.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:44 smithi203 ceph-mon[33225]: pgmap v97: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:44.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:44 smithi111 ceph-mon[27539]: pgmap v97: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:45.055 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -e sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-09-11T00:11:45.380 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:11:45.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:45 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/640120287' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:45.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:45 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/640120287' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:46.499 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:46 smithi111 ceph-mon[27539]: pgmap v98: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:46.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:46 smithi203 ceph-mon[33225]: pgmap v98: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:47.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.117+0000 7f1390800700 1 -- 172.21.15.111:0/4114989754 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1388102fa0 msgr2=0x7f1388106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:47.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.117+0000 7f1390800700 1 --2- 172.21.15.111:0/4114989754 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1388102fa0 0x7f1388106f70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1378009910 tx=0x7f1378009c20 comp rx=0 tx=0).stop 2024-09-11T00:11:47.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.117+0000 7f1390800700 1 -- 172.21.15.111:0/4114989754 shutdown_connections 2024-09-11T00:11:47.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.117+0000 7f1390800700 1 --2- 172.21.15.111:0/4114989754 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1388102fa0 0x7f1388106f70 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:47.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.117+0000 7f1390800700 1 --2- 172.21.15.111:0/4114989754 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1388102600 0x7f13881029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:47.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.118+0000 7f1390800700 1 -- 172.21.15.111:0/4114989754 >> 172.21.15.111:0/4114989754 conn(0x7f13880fdec0 msgr2=0x7f13881002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:47.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.118+0000 7f1390800700 1 -- 172.21.15.111:0/4114989754 shutdown_connections 2024-09-11T00:11:47.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.118+0000 7f1390800700 1 -- 172.21.15.111:0/4114989754 wait complete. 2024-09-11T00:11:47.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.119+0000 7f1390800700 1 Processor -- start 2024-09-11T00:11:47.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.119+0000 7f1390800700 1 -- start start 2024-09-11T00:11:47.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.119+0000 7f1390800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1388102600 0x7f1388197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:47.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.119+0000 7f1390800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1388102fa0 0x7f1388198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:47.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.119+0000 7f1390800700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1388198c10 con 0x7f1388102600 2024-09-11T00:11:47.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.119+0000 7f1390800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138819c9a0 con 0x7f1388102fa0 2024-09-11T00:11:47.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.119+0000 7f138de00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1388102600 0x7f1388197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:47.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.120+0000 7f138de00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1388102600 0x7f1388197ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39870/0 (socket says 172.21.15.111:39870) 2024-09-11T00:11:47.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.120+0000 7f138de00700 1 -- 172.21.15.111:0/3460011198 learned_addr learned my addr 172.21.15.111:0/3460011198 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:11:47.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.120+0000 7f138d400700 1 --2- 172.21.15.111:0/3460011198 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1388102fa0 0x7f1388198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:47.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.120+0000 7f138de00700 1 -- 172.21.15.111:0/3460011198 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1388102fa0 msgr2=0x7f1388198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:47.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.120+0000 7f138de00700 1 --2- 172.21.15.111:0/3460011198 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1388102fa0 0x7f1388198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:47.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.120+0000 7f138de00700 1 -- 172.21.15.111:0/3460011198 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13780095f0 con 0x7f1388102600 2024-09-11T00:11:47.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.120+0000 7f138de00700 1 --2- 172.21.15.111:0/3460011198 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1388102600 0x7f1388197ff0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f137c00d8d0 tx=0x7f137c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:47.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.120+0000 7f1382a00700 1 -- 172.21.15.111:0/3460011198 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f137c0098a0 con 0x7f1388102600 2024-09-11T00:11:47.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.121+0000 7f1390800700 1 -- 172.21.15.111:0/3460011198 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f138819cc80 con 0x7f1388102600 2024-09-11T00:11:47.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.121+0000 7f1382a00700 1 -- 172.21.15.111:0/3460011198 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f137c010460 con 0x7f1388102600 2024-09-11T00:11:47.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.121+0000 7f1382a00700 1 -- 172.21.15.111:0/3460011198 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f137c00f5f0 con 0x7f1388102600 2024-09-11T00:11:47.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.121+0000 7f1390800700 1 -- 172.21.15.111:0/3460011198 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f138819d1a0 con 0x7f1388102600 2024-09-11T00:11:47.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.122+0000 7f1390800700 1 -- 172.21.15.111:0/3460011198 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138804ea50 con 0x7f1388102600 2024-09-11T00:11:47.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.123+0000 7f1382a00700 1 -- 172.21.15.111:0/3460011198 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 34) v1 ==== 102331+0+0 (secure 0 0 0) 0x7f137c009a00 con 0x7f1388102600 2024-09-11T00:11:47.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.124+0000 7f1382a00700 1 --2- 172.21.15.111:0/3460011198 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f137007a370 0x7f137007c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:47.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.124+0000 7f1382a00700 1 -- 172.21.15.111:0/3460011198 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f137c09cc70 con 0x7f1388102600 2024-09-11T00:11:47.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.124+0000 7f138d400700 1 --2- 172.21.15.111:0/3460011198 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f137007a370 0x7f137007c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:47.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.125+0000 7f138d400700 1 --2- 172.21.15.111:0/3460011198 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f137007a370 0x7f137007c820 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1378006010 tx=0x7f137801a040 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:47.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.128+0000 7f1382a00700 1 -- 172.21.15.111:0/3460011198 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f137c0a3080 con 0x7f1388102600 2024-09-11T00:11:47.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.438+0000 7f1390800700 1 -- 172.21.15.111:0/3460011198 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f138819d4d0 con 0x7f1388102600 2024-09-11T00:11:47.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.439+0000 7f1382a00700 1 -- 172.21.15.111:0/3460011198 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f137c0607f0 con 0x7f1388102600 2024-09-11T00:11:47.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.441+0000 7f1390800700 1 -- 172.21.15.111:0/3460011198 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f137007a370 msgr2=0x7f137007c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:47.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.441+0000 7f1390800700 1 --2- 172.21.15.111:0/3460011198 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f137007a370 0x7f137007c820 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1378006010 tx=0x7f137801a040 comp rx=0 tx=0).stop 2024-09-11T00:11:47.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.441+0000 7f1390800700 1 -- 172.21.15.111:0/3460011198 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1388102600 msgr2=0x7f1388197ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:47.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.441+0000 7f1390800700 1 --2- 172.21.15.111:0/3460011198 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1388102600 0x7f1388197ff0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f137c00d8d0 tx=0x7f137c00dbe0 comp rx=0 tx=0).stop 2024-09-11T00:11:47.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.441+0000 7f1390800700 1 -- 172.21.15.111:0/3460011198 shutdown_connections 2024-09-11T00:11:47.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.441+0000 7f1390800700 1 --2- 172.21.15.111:0/3460011198 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f137007a370 0x7f137007c820 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:47.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.441+0000 7f1390800700 1 --2- 172.21.15.111:0/3460011198 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1388102600 0x7f1388197ff0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:47.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.441+0000 7f1390800700 1 --2- 172.21.15.111:0/3460011198 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1388102fa0 0x7f1388198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:47.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.441+0000 7f1390800700 1 -- 172.21.15.111:0/3460011198 >> 172.21.15.111:0/3460011198 conn(0x7f13880fdec0 msgr2=0x7f13880ff4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:47.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.442+0000 7f1390800700 1 -- 172.21.15.111:0/3460011198 shutdown_connections 2024-09-11T00:11:47.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:47.442+0000 7f1390800700 1 -- 172.21.15.111:0/3460011198 wait complete. 2024-09-11T00:11:47.458 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:11:48.157 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -e sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-09-11T00:11:48.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:48 smithi111 ceph-mon[27539]: pgmap v99: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:48.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:48 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/3460011198' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:48.480 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:11:48.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:48 smithi203 ceph-mon[33225]: pgmap v99: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:48.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:48 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/3460011198' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:11:49.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:49 smithi111 ceph-mon[27539]: pgmap v100: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:50.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.289+0000 7f5f07400700 1 -- 172.21.15.111:0/4174028765 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5f00075b90 msgr2=0x7f5f00110b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:50.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.289+0000 7f5f07400700 1 --2- 172.21.15.111:0/4174028765 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5f00075b90 0x7f5f00110b00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5eec009910 tx=0x7f5eec009c20 comp rx=0 tx=0).stop 2024-09-11T00:11:50.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.289+0000 7f5f07400700 1 -- 172.21.15.111:0/4174028765 shutdown_connections 2024-09-11T00:11:50.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.289+0000 7f5f07400700 1 --2- 172.21.15.111:0/4174028765 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5f00075b90 0x7f5f00110b00 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:50.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.289+0000 7f5f07400700 1 --2- 172.21.15.111:0/4174028765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f00075280 0x7f5f00075650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:50.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.289+0000 7f5f07400700 1 -- 172.21.15.111:0/4174028765 >> 172.21.15.111:0/4174028765 conn(0x7f5f000fdec0 msgr2=0x7f5f001002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:50.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.289+0000 7f5f07400700 1 -- 172.21.15.111:0/4174028765 shutdown_connections 2024-09-11T00:11:50.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.289+0000 7f5f07400700 1 -- 172.21.15.111:0/4174028765 wait complete. 2024-09-11T00:11:50.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.290+0000 7f5f07400700 1 Processor -- start 2024-09-11T00:11:50.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.290+0000 7f5f07400700 1 -- start start 2024-09-11T00:11:50.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.290+0000 7f5f07400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5f00075280 0x7f5f0019c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:50.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.290+0000 7f5f07400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f00075b90 0x7f5f0019c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:50.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.290+0000 7f5f07400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0019cf60 con 0x7f5f00075280 2024-09-11T00:11:50.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.290+0000 7f5f07400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f001a0cf0 con 0x7f5f00075b90 2024-09-11T00:11:50.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.291+0000 7f5f04a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5f00075280 0x7f5f0019c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:50.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.291+0000 7f5f04a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5f00075280 0x7f5f0019c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:37962/0 (socket says 172.21.15.111:37962) 2024-09-11T00:11:50.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.291+0000 7f5f04a00700 1 -- 172.21.15.111:0/1732461694 learned_addr learned my addr 172.21.15.111:0/1732461694 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:11:50.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.291+0000 7f5effe00700 1 --2- 172.21.15.111:0/1732461694 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f00075b90 0x7f5f0019c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:50.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.291+0000 7f5f04a00700 1 -- 172.21.15.111:0/1732461694 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f00075b90 msgr2=0x7f5f0019c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:50.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.291+0000 7f5f04a00700 1 --2- 172.21.15.111:0/1732461694 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f00075b90 0x7f5f0019c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:50.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.291+0000 7f5f04a00700 1 -- 172.21.15.111:0/1732461694 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eec0095f0 con 0x7f5f00075280 2024-09-11T00:11:50.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.291+0000 7f5f04a00700 1 --2- 172.21.15.111:0/1732461694 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5f00075280 0x7f5f0019c340 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5ef400d8d0 tx=0x7f5ef400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:50.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.292+0000 7f5efd600700 1 -- 172.21.15.111:0/1732461694 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ef4009940 con 0x7f5f00075280 2024-09-11T00:11:50.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.292+0000 7f5efd600700 1 -- 172.21.15.111:0/1732461694 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5ef4010460 con 0x7f5f00075280 2024-09-11T00:11:50.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.292+0000 7f5f07400700 1 -- 172.21.15.111:0/1732461694 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f001a0fd0 con 0x7f5f00075280 2024-09-11T00:11:50.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.292+0000 7f5efd600700 1 -- 172.21.15.111:0/1732461694 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ef400f5f0 con 0x7f5f00075280 2024-09-11T00:11:50.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:49 smithi203 ceph-mon[33225]: pgmap v100: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:50.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.292+0000 7f5f07400700 1 -- 172.21.15.111:0/1732461694 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f001a1520 con 0x7f5f00075280 2024-09-11T00:11:50.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.293+0000 7f5f07400700 1 -- 172.21.15.111:0/1732461694 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f0010e270 con 0x7f5f00075280 2024-09-11T00:11:50.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.294+0000 7f5efd600700 1 -- 172.21.15.111:0/1732461694 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 34) v1 ==== 102331+0+0 (secure 0 0 0) 0x7f5ef40105d0 con 0x7f5f00075280 2024-09-11T00:11:50.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.295+0000 7f5efd600700 1 --2- 172.21.15.111:0/1732461694 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f5ee807a370 0x7f5ee807c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:50.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.295+0000 7f5efd600700 1 -- 172.21.15.111:0/1732461694 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f5ef409cdb0 con 0x7f5f00075280 2024-09-11T00:11:50.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.295+0000 7f5effe00700 1 --2- 172.21.15.111:0/1732461694 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f5ee807a370 0x7f5ee807c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:50.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.296+0000 7f5effe00700 1 --2- 172.21.15.111:0/1732461694 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f5ee807a370 0x7f5ee807c820 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00b5c0 tx=0x7f5eec005fd0 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:50.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.300+0000 7f5efd600700 1 -- 172.21.15.111:0/1732461694 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f5ef4060930 con 0x7f5f00075280 2024-09-11T00:11:50.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:50.533+0000 7f5f07400700 1 -- 172.21.15.111:0/1732461694 --> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f001a18b0 con 0x7f5ee807a370 2024-09-11T00:11:51.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:51 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:11:51.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:51 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:11:52.060 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:52 smithi111 ceph-mon[27539]: from='client.14912 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:11:52.060 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:52 smithi111 ceph-mon[27539]: pgmap v101: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:52.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:52 smithi203 ceph-mon[33225]: from='client.14912 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:11:52.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:52 smithi203 ceph-mon[33225]: pgmap v101: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:52.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:52.766+0000 7f5efd600700 1 -- 172.21.15.111:0/1732461694 <== mgr.14744 v2:172.21.15.111:6800/3952658086 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5391 (secure 0 0 0) 0x7f5f001a18b0 con 0x7f5ee807a370 2024-09-11T00:11:52.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:52.769+0000 7f5f07400700 1 -- 172.21.15.111:0/1732461694 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f5ee807a370 msgr2=0x7f5ee807c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:52.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:52.769+0000 7f5f07400700 1 --2- 172.21.15.111:0/1732461694 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f5ee807a370 0x7f5ee807c820 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00b5c0 tx=0x7f5eec005fd0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:52.769+0000 7f5f07400700 1 -- 172.21.15.111:0/1732461694 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5f00075280 msgr2=0x7f5f0019c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:52.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:52.769+0000 7f5f07400700 1 --2- 172.21.15.111:0/1732461694 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5f00075280 0x7f5f0019c340 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5ef400d8d0 tx=0x7f5ef400dc90 comp rx=0 tx=0).stop 2024-09-11T00:11:52.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:52.769+0000 7f5f07400700 1 -- 172.21.15.111:0/1732461694 shutdown_connections 2024-09-11T00:11:52.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:52.769+0000 7f5f07400700 1 --2- 172.21.15.111:0/1732461694 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f5ee807a370 0x7f5ee807c820 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:52.769+0000 7f5f07400700 1 --2- 172.21.15.111:0/1732461694 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5f00075280 0x7f5f0019c340 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:52.769+0000 7f5f07400700 1 --2- 172.21.15.111:0/1732461694 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f00075b90 0x7f5f0019c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:52.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:52.769+0000 7f5f07400700 1 -- 172.21.15.111:0/1732461694 >> 172.21.15.111:0/1732461694 conn(0x7f5f000fdec0 msgr2=0x7f5f000feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:52.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:52.769+0000 7f5f07400700 1 -- 172.21.15.111:0/1732461694 shutdown_connections 2024-09-11T00:11:52.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:52.769+0000 7f5f07400700 1 -- 172.21.15.111:0/1732461694 wait complete. 2024-09-11T00:11:52.787 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:11:53.465 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -e sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 -- bash -c 'ceph orch ps' 2024-09-11T00:11:53.786 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:11:54.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:54 smithi203 ceph-mon[33225]: pgmap v102: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:54.547 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:54 smithi111 ceph-mon[27539]: pgmap v102: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:55.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.515+0000 7f39b2e00700 1 -- 172.21.15.111:0/2276186105 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39ac102600 msgr2=0x7f39ac1029d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:55.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.515+0000 7f39b2e00700 1 --2- 172.21.15.111:0/2276186105 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39ac102600 0x7f39ac1029d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f399c009910 tx=0x7f399c009c20 comp rx=0 tx=0).stop 2024-09-11T00:11:55.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.515+0000 7f39b2e00700 1 -- 172.21.15.111:0/2276186105 shutdown_connections 2024-09-11T00:11:55.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.515+0000 7f39b2e00700 1 --2- 172.21.15.111:0/2276186105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39ac102fa0 0x7f39ac106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:55.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.515+0000 7f39b2e00700 1 --2- 172.21.15.111:0/2276186105 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39ac102600 0x7f39ac1029d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:55.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.515+0000 7f39b2e00700 1 -- 172.21.15.111:0/2276186105 >> 172.21.15.111:0/2276186105 conn(0x7f39ac0fdec0 msgr2=0x7f39ac1002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:55.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.515+0000 7f39b2e00700 1 -- 172.21.15.111:0/2276186105 shutdown_connections 2024-09-11T00:11:55.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.515+0000 7f39b2e00700 1 -- 172.21.15.111:0/2276186105 wait complete. 2024-09-11T00:11:55.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.517+0000 7f39b2e00700 1 Processor -- start 2024-09-11T00:11:55.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.517+0000 7f39b2e00700 1 -- start start 2024-09-11T00:11:55.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.517+0000 7f39b2e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39ac102600 0x7f39ac197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:55.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.517+0000 7f39b2e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39ac102fa0 0x7f39ac1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:55.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.517+0000 7f39b2e00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac198bd0 con 0x7f39ac102fa0 2024-09-11T00:11:55.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.517+0000 7f39b2e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac19c960 con 0x7f39ac102600 2024-09-11T00:11:55.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.518+0000 7f39ab400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39ac102fa0 0x7f39ac1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:55.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.518+0000 7f39ab400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39ac102fa0 0x7f39ac1984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:37970/0 (socket says 172.21.15.111:37970) 2024-09-11T00:11:55.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.518+0000 7f39ab400700 1 -- 172.21.15.111:0/3865926508 learned_addr learned my addr 172.21.15.111:0/3865926508 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:11:55.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.518+0000 7f39abe00700 1 --2- 172.21.15.111:0/3865926508 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39ac102600 0x7f39ac197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:55.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.518+0000 7f39ab400700 1 -- 172.21.15.111:0/3865926508 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39ac102600 msgr2=0x7f39ac197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:55.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.518+0000 7f39ab400700 1 --2- 172.21.15.111:0/3865926508 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39ac102600 0x7f39ac197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:55.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.518+0000 7f39ab400700 1 -- 172.21.15.111:0/3865926508 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399c0095f0 con 0x7f39ac102fa0 2024-09-11T00:11:55.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.518+0000 7f39ab400700 1 --2- 172.21.15.111:0/3865926508 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39ac102fa0 0x7f39ac1984f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f399800d900 tx=0x7f399800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:55.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.519+0000 7f39a8c00700 1 -- 172.21.15.111:0/3865926508 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3998009900 con 0x7f39ac102fa0 2024-09-11T00:11:55.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.519+0000 7f39a8c00700 1 -- 172.21.15.111:0/3865926508 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3998010460 con 0x7f39ac102fa0 2024-09-11T00:11:55.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.519+0000 7f39a8c00700 1 -- 172.21.15.111:0/3865926508 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f399800f5f0 con 0x7f39ac102fa0 2024-09-11T00:11:55.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.519+0000 7f39b2e00700 1 -- 172.21.15.111:0/3865926508 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39ac19cc40 con 0x7f39ac102fa0 2024-09-11T00:11:55.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.519+0000 7f39b2e00700 1 -- 172.21.15.111:0/3865926508 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39ac19d190 con 0x7f39ac102fa0 2024-09-11T00:11:55.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.520+0000 7f39b2e00700 1 -- 172.21.15.111:0/3865926508 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39ac04ea50 con 0x7f39ac102fa0 2024-09-11T00:11:55.523 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.521+0000 7f39a8c00700 1 -- 172.21.15.111:0/3865926508 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 34) v1 ==== 102331+0+0 (secure 0 0 0) 0x7f39980105d0 con 0x7f39ac102fa0 2024-09-11T00:11:55.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.522+0000 7f39a8c00700 1 --2- 172.21.15.111:0/3865926508 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f399007a370 0x7f399007c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:55.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.522+0000 7f39a8c00700 1 -- 172.21.15.111:0/3865926508 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f399809c880 con 0x7f39ac102fa0 2024-09-11T00:11:55.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.523+0000 7f39abe00700 1 --2- 172.21.15.111:0/3865926508 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f399007a370 0x7f399007c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:55.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.523+0000 7f39abe00700 1 --2- 172.21.15.111:0/3865926508 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f399007a370 0x7f399007c820 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f399c006010 tx=0x7f399c01a040 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:55.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.527+0000 7f39a8c00700 1 -- 172.21.15.111:0/3865926508 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f3998060480 con 0x7f39ac102fa0 2024-09-11T00:11:55.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.754+0000 7f39b2e00700 1 -- 172.21.15.111:0/3865926508 --> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f39ac19d6c0 con 0x7f399007a370 2024-09-11T00:11:55.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.764+0000 7f39a8c00700 1 -- 172.21.15.111:0/3865926508 <== mgr.14744 v2:172.21.15.111:6800/3952658086 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f39ac19d6c0 con 0x7f399007a370 2024-09-11T00:11:55.766 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:11:55.766 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (88s) 54s ago 15m 14.5M - 0.27.0 11f11916f8cd d6d3253e881f 2024-09-11T00:11:55.766 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (4m) 54s ago 15m 7256k - 18.2.0 dc2bc1663786 7c40af85314c 2024-09-11T00:11:55.767 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi203 smithi203 running (3m) 2m ago 14m 7398k - 18.2.0 dc2bc1663786 922e3261ff70 2024-09-11T00:11:55.767 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (15m) 54s ago 15m 6665k - 18.2.0 dc2bc1663786 72a36c166ffa 2024-09-11T00:11:55.767 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi203 smithi203 running (14m) 2m ago 14m 6669k - 18.2.0 dc2bc1663786 9b102b6f6d70 2024-09-11T00:11:55.767 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (60s) 54s ago 14m 45.2M - c8b91775d855 7d3b50b5b59f 2024-09-11T00:11:55.767 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.gmgsay smithi111 running (8m) 54s ago 8m 15.7M - 18.2.0 dc2bc1663786 795e4ff0075c 2024-09-11T00:11:55.767 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.rucaba smithi111 running (7m) 54s ago 7m 15.7M - 18.2.0 dc2bc1663786 02885adac62c 2024-09-11T00:11:55.767 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.tcrqop smithi203 running (8m) 2m ago 8m 152M - 18.2.0 dc2bc1663786 4df492159bb4 2024-09-11T00:11:55.767 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.uqkbkn smithi203 running (7m) 2m ago 7m 15.2M - 18.2.0 dc2bc1663786 619aa58ea314 2024-09-11T00:11:55.767 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.ypucji smithi111 *:8443,9283,8765 running (3m) 54s ago 16m 519M - 19.3.0-4854-g8f219c47 589dd18248e4 07fa31f49618 2024-09-11T00:11:55.767 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi203.smuspl smithi203 *:8443,9283,8765 running (2m) 2m ago 13m 451M - 19.3.0-4854-g8f219c47 589dd18248e4 7e5a93a5ffa7 2024-09-11T00:11:55.767 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (16m) 54s ago 16m 59.1M 2048M 18.2.0 dc2bc1663786 2596322539fb 2024-09-11T00:11:55.767 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi203 smithi203 running (13m) 2m ago 13m 48.1M 2048M 18.2.0 dc2bc1663786 ff8eb7ca85ea 2024-09-11T00:11:55.767 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (2m) 54s ago 15m 7604k - 1.7.0 72c9c2088986 ec478ea14488 2024-09-11T00:11:55.768 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi203 smithi203 *:9100 running (2m) 2m ago 13m 2655k - 1.7.0 72c9c2088986 54d461cde1bc 2024-09-11T00:11:55.768 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (12m) 54s ago 12m 211M 1216M 18.2.0 dc2bc1663786 162b7249a591 2024-09-11T00:11:55.768 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (11m) 54s ago 11m 224M 1216M 18.2.0 dc2bc1663786 3614d95b1425 2024-09-11T00:11:55.768 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (11m) 54s ago 11m 183M 1216M 18.2.0 dc2bc1663786 db175d4b09b9 2024-09-11T00:11:55.768 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi203 running (10m) 2m ago 10m 242M 2240M 18.2.0 dc2bc1663786 60b1cef7a70d 2024-09-11T00:11:55.768 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi203 running (10m) 2m ago 10m 207M 2240M 18.2.0 dc2bc1663786 769c7942c42b 2024-09-11T00:11:55.768 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi203 running (9m) 2m ago 9m 190M 2240M 18.2.0 dc2bc1663786 6d824001d40c 2024-09-11T00:11:55.768 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (110s) 54s ago 14m 48.3M - 2.51.0 1d3b7f56885b 3e72ac10983d 2024-09-11T00:11:55.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.767+0000 7f39b2e00700 1 -- 172.21.15.111:0/3865926508 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f399007a370 msgr2=0x7f399007c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:55.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.767+0000 7f39b2e00700 1 --2- 172.21.15.111:0/3865926508 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f399007a370 0x7f399007c820 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f399c006010 tx=0x7f399c01a040 comp rx=0 tx=0).stop 2024-09-11T00:11:55.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.767+0000 7f39b2e00700 1 -- 172.21.15.111:0/3865926508 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39ac102fa0 msgr2=0x7f39ac1984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:55.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.767+0000 7f39b2e00700 1 --2- 172.21.15.111:0/3865926508 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39ac102fa0 0x7f39ac1984f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f399800d900 tx=0x7f399800dc10 comp rx=0 tx=0).stop 2024-09-11T00:11:55.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.767+0000 7f39b2e00700 1 -- 172.21.15.111:0/3865926508 shutdown_connections 2024-09-11T00:11:55.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.767+0000 7f39b2e00700 1 --2- 172.21.15.111:0/3865926508 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f399007a370 0x7f399007c820 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:55.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.767+0000 7f39b2e00700 1 --2- 172.21.15.111:0/3865926508 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39ac102600 0x7f39ac197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:55.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.767+0000 7f39b2e00700 1 --2- 172.21.15.111:0/3865926508 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39ac102fa0 0x7f39ac1984f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:55.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.767+0000 7f39b2e00700 1 -- 172.21.15.111:0/3865926508 >> 172.21.15.111:0/3865926508 conn(0x7f39ac0fdec0 msgr2=0x7f39ac0ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:55.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.767+0000 7f39b2e00700 1 -- 172.21.15.111:0/3865926508 shutdown_connections 2024-09-11T00:11:55.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:55.767+0000 7f39b2e00700 1 -- 172.21.15.111:0/3865926508 wait complete. 2024-09-11T00:11:56.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:56 smithi111 ceph-mon[27539]: pgmap v103: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:56.480 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-11T00:11:56.482 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi111.front.sepia.ceph.com 2024-09-11T00:11:56.482 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -e sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-09-11T00:11:56.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:56 smithi203 ceph-mon[33225]: pgmap v103: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:56.802 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:11:57.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:57 smithi203 ceph-mon[33225]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:11:57.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:57 smithi111 ceph-mon[27539]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:11:58.298 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:58 smithi111 ceph-mon[27539]: pgmap v104: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:58.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:58 smithi203 ceph-mon[33225]: pgmap v104: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:11:58.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.719+0000 7f788ba00700 1 -- 172.21.15.111:0/2673158560 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7884100d70 msgr2=0x7f7884104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:58.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.719+0000 7f788ba00700 1 --2- 172.21.15.111:0/2673158560 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7884100d70 0x7f7884104d40 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7870009910 tx=0x7f7870009c20 comp rx=0 tx=0).stop 2024-09-11T00:11:58.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.719+0000 7f788ba00700 1 -- 172.21.15.111:0/2673158560 shutdown_connections 2024-09-11T00:11:58.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.719+0000 7f788ba00700 1 --2- 172.21.15.111:0/2673158560 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7884100d70 0x7f7884104d40 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:58.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.719+0000 7f788ba00700 1 --2- 172.21.15.111:0/2673158560 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f78841003d0 0x7f78841007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:58.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.719+0000 7f788ba00700 1 -- 172.21.15.111:0/2673158560 >> 172.21.15.111:0/2673158560 conn(0x7f78840fbc90 msgr2=0x7f78840fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:58.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.719+0000 7f788ba00700 1 -- 172.21.15.111:0/2673158560 shutdown_connections 2024-09-11T00:11:58.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.719+0000 7f788ba00700 1 -- 172.21.15.111:0/2673158560 wait complete. 2024-09-11T00:11:58.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.720+0000 7f788ba00700 1 Processor -- start 2024-09-11T00:11:58.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.720+0000 7f788ba00700 1 -- start start 2024-09-11T00:11:58.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.720+0000 7f788ba00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78841003d0 0x7f7884073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:58.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.720+0000 7f788ba00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7884100d70 0x7f7884073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:58.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.720+0000 7f788ba00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7884073ad0 con 0x7f78841003d0 2024-09-11T00:11:58.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.720+0000 7f788ba00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7884073c10 con 0x7f7884100d70 2024-09-11T00:11:58.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.721+0000 7f7889000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78841003d0 0x7f7884073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:58.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.721+0000 7f7889000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78841003d0 0x7f7884073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:33180/0 (socket says 172.21.15.111:33180) 2024-09-11T00:11:58.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.721+0000 7f7889000700 1 -- 172.21.15.111:0/1065152789 learned_addr learned my addr 172.21.15.111:0/1065152789 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:11:58.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.721+0000 7f7883e00700 1 --2- 172.21.15.111:0/1065152789 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7884100d70 0x7f7884073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:58.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.721+0000 7f7889000700 1 -- 172.21.15.111:0/1065152789 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7884100d70 msgr2=0x7f7884073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:58.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.721+0000 7f7889000700 1 --2- 172.21.15.111:0/1065152789 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7884100d70 0x7f7884073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:58.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.721+0000 7f7889000700 1 -- 172.21.15.111:0/1065152789 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78700095f0 con 0x7f78841003d0 2024-09-11T00:11:58.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.721+0000 7f7883e00700 1 --2- 172.21.15.111:0/1065152789 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7884100d70 0x7f7884073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:11:58.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.721+0000 7f7889000700 1 --2- 172.21.15.111:0/1065152789 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78841003d0 0x7f7884073050 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f787800d8d0 tx=0x7f787800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:58.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.722+0000 7f7881600700 1 -- 172.21.15.111:0/1065152789 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7878009940 con 0x7f78841003d0 2024-09-11T00:11:58.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.722+0000 7f7881600700 1 -- 172.21.15.111:0/1065152789 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7878010460 con 0x7f78841003d0 2024-09-11T00:11:58.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.722+0000 7f7881600700 1 -- 172.21.15.111:0/1065152789 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f787800f5f0 con 0x7f78841003d0 2024-09-11T00:11:58.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.722+0000 7f788ba00700 1 -- 172.21.15.111:0/1065152789 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78841a1f20 con 0x7f78841003d0 2024-09-11T00:11:58.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.722+0000 7f788ba00700 1 -- 172.21.15.111:0/1065152789 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78841a2280 con 0x7f78841003d0 2024-09-11T00:11:58.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.723+0000 7f788ba00700 1 -- 172.21.15.111:0/1065152789 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7884108740 con 0x7f78841003d0 2024-09-11T00:11:58.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.724+0000 7f7881600700 1 -- 172.21.15.111:0/1065152789 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 34) v1 ==== 102331+0+0 (secure 0 0 0) 0x7f78780105d0 con 0x7f78841003d0 2024-09-11T00:11:58.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.725+0000 7f7881600700 1 --2- 172.21.15.111:0/1065152789 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f786c07a370 0x7f786c07c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:58.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.726+0000 7f7881600700 1 -- 172.21.15.111:0/1065152789 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f787809cd30 con 0x7f78841003d0 2024-09-11T00:11:58.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.726+0000 7f7883e00700 1 --2- 172.21.15.111:0/1065152789 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f786c07a370 0x7f786c07c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:58.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.726+0000 7f7883e00700 1 --2- 172.21.15.111:0/1065152789 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f786c07a370 0x7f786c07c820 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7870006010 tx=0x7f787000b540 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:58.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.730+0000 7f7881600700 1 -- 172.21.15.111:0/1065152789 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f7878060930 con 0x7f78841003d0 2024-09-11T00:11:58.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.949+0000 7f788ba00700 1 -- 172.21.15.111:0/1065152789 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f78840745b0 con 0x7f78841003d0 2024-09-11T00:11:58.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.955+0000 7f7881600700 1 -- 172.21.15.111:0/1065152789 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v64)=0 v64) v1 ==== 125+0+0 (secure 0 0 0) 0x7f7878063a50 con 0x7f78841003d0 2024-09-11T00:11:58.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.958+0000 7f788ba00700 1 -- 172.21.15.111:0/1065152789 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f786c07a370 msgr2=0x7f786c07c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:58.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.958+0000 7f788ba00700 1 --2- 172.21.15.111:0/1065152789 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f786c07a370 0x7f786c07c820 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7870006010 tx=0x7f787000b540 comp rx=0 tx=0).stop 2024-09-11T00:11:58.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.958+0000 7f788ba00700 1 -- 172.21.15.111:0/1065152789 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78841003d0 msgr2=0x7f7884073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:58.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.958+0000 7f788ba00700 1 --2- 172.21.15.111:0/1065152789 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78841003d0 0x7f7884073050 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f787800d8d0 tx=0x7f787800dc90 comp rx=0 tx=0).stop 2024-09-11T00:11:58.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.958+0000 7f788ba00700 1 -- 172.21.15.111:0/1065152789 shutdown_connections 2024-09-11T00:11:58.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.958+0000 7f788ba00700 1 --2- 172.21.15.111:0/1065152789 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f786c07a370 0x7f786c07c820 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:58.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.958+0000 7f788ba00700 1 --2- 172.21.15.111:0/1065152789 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78841003d0 0x7f7884073050 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:58.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.958+0000 7f788ba00700 1 --2- 172.21.15.111:0/1065152789 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7884100d70 0x7f7884073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:58.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.958+0000 7f788ba00700 1 -- 172.21.15.111:0/1065152789 >> 172.21.15.111:0/1065152789 conn(0x7f78840fbc90 msgr2=0x7f78840fd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:58.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.958+0000 7f788ba00700 1 -- 172.21.15.111:0/1065152789 shutdown_connections 2024-09-11T00:11:58.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:11:58.958+0000 7f788ba00700 1 -- 172.21.15.111:0/1065152789 wait complete. 2024-09-11T00:11:59.648 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-11T00:11:59.649 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi111.front.sepia.ceph.com 2024-09-11T00:11:59.649 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -e sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-11T00:11:59.982 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:12:00.265 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:59 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/1065152789' entity='client.admin' 2024-09-11T00:12:00.265 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:59 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:12:00.265 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:59 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-11T00:12:00.265 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:59 smithi111 ceph-mon[27539]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-11T00:12:00.265 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:59 smithi111 ceph-mon[27539]: pgmap v105: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:00.265 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:59 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:12:00.266 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:59 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:12:00.266 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:11:59 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:00.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:59 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/1065152789' entity='client.admin' 2024-09-11T00:12:00.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:59 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:12:00.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:59 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-11T00:12:00.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:59 smithi203 ceph-mon[33225]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-11T00:12:00.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:59 smithi203 ceph-mon[33225]: pgmap v105: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:00.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:59 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:12:00.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:59 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:12:00.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:11:59 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:01.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.806+0000 7f9e1a200700 1 -- 172.21.15.111:0/1708976904 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e141003d0 msgr2=0x7f9e141007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:01.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.806+0000 7f9e1a200700 1 --2- 172.21.15.111:0/1708976904 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e141003d0 0x7f9e141007a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9e04009910 tx=0x7f9e04009c20 comp rx=0 tx=0).stop 2024-09-11T00:12:01.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.806+0000 7f9e1a200700 1 -- 172.21.15.111:0/1708976904 shutdown_connections 2024-09-11T00:12:01.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.806+0000 7f9e1a200700 1 --2- 172.21.15.111:0/1708976904 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e14100d70 0x7f9e14104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:01.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.806+0000 7f9e1a200700 1 --2- 172.21.15.111:0/1708976904 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e141003d0 0x7f9e141007a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:01.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.806+0000 7f9e1a200700 1 -- 172.21.15.111:0/1708976904 >> 172.21.15.111:0/1708976904 conn(0x7f9e140fbc90 msgr2=0x7f9e140fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:01.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.806+0000 7f9e1a200700 1 -- 172.21.15.111:0/1708976904 shutdown_connections 2024-09-11T00:12:01.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.806+0000 7f9e1a200700 1 -- 172.21.15.111:0/1708976904 wait complete. 2024-09-11T00:12:01.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.807+0000 7f9e1a200700 1 Processor -- start 2024-09-11T00:12:01.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.807+0000 7f9e1a200700 1 -- start start 2024-09-11T00:12:01.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.807+0000 7f9e1a200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e141003d0 0x7f9e14197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:01.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.807+0000 7f9e1a200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e14100d70 0x7f9e14198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:01.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.807+0000 7f9e1a200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e14198ae0 con 0x7f9e141003d0 2024-09-11T00:12:01.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.807+0000 7f9e1a200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e14198c20 con 0x7f9e14100d70 2024-09-11T00:12:01.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.808+0000 7f9e13400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e141003d0 0x7f9e14197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:01.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.808+0000 7f9e13400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e141003d0 0x7f9e14197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:33202/0 (socket says 172.21.15.111:33202) 2024-09-11T00:12:01.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.808+0000 7f9e13400700 1 -- 172.21.15.111:0/1320137972 learned_addr learned my addr 172.21.15.111:0/1320137972 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:12:01.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.808+0000 7f9e12a00700 1 --2- 172.21.15.111:0/1320137972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e14100d70 0x7f9e14198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:01.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.808+0000 7f9e13400700 1 -- 172.21.15.111:0/1320137972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e14100d70 msgr2=0x7f9e14198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:01.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.808+0000 7f9e13400700 1 --2- 172.21.15.111:0/1320137972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e14100d70 0x7f9e14198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:01.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.808+0000 7f9e13400700 1 -- 172.21.15.111:0/1320137972 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e040095f0 con 0x7f9e141003d0 2024-09-11T00:12:01.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.809+0000 7f9e13400700 1 --2- 172.21.15.111:0/1320137972 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e141003d0 0x7f9e14197f50 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9e04006010 tx=0x7f9e0400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:01.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.809+0000 7f9e0be00700 1 -- 172.21.15.111:0/1320137972 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e0401d070 con 0x7f9e141003d0 2024-09-11T00:12:01.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.809+0000 7f9e1a200700 1 -- 172.21.15.111:0/1320137972 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e1419ca10 con 0x7f9e141003d0 2024-09-11T00:12:01.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.809+0000 7f9e0be00700 1 -- 172.21.15.111:0/1320137972 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e04004fb0 con 0x7f9e141003d0 2024-09-11T00:12:01.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.809+0000 7f9e0be00700 1 -- 172.21.15.111:0/1320137972 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e04022ea0 con 0x7f9e141003d0 2024-09-11T00:12:01.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.809+0000 7f9e1a200700 1 -- 172.21.15.111:0/1320137972 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e1419cf00 con 0x7f9e141003d0 2024-09-11T00:12:01.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.810+0000 7f9e1a200700 1 -- 172.21.15.111:0/1320137972 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e1404ea50 con 0x7f9e141003d0 2024-09-11T00:12:01.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.811+0000 7f9e0be00700 1 -- 172.21.15.111:0/1320137972 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 34) v1 ==== 102331+0+0 (secure 0 0 0) 0x7f9e04022470 con 0x7f9e141003d0 2024-09-11T00:12:01.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.812+0000 7f9e0be00700 1 --2- 172.21.15.111:0/1320137972 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f9df807a370 0x7f9df807c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:01.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.812+0000 7f9e0be00700 1 -- 172.21.15.111:0/1320137972 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f9e0409e340 con 0x7f9e141003d0 2024-09-11T00:12:01.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.812+0000 7f9e12a00700 1 --2- 172.21.15.111:0/1320137972 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f9df807a370 0x7f9df807c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:01.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.813+0000 7f9e12a00700 1 --2- 172.21.15.111:0/1320137972 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f9df807a370 0x7f9df807c820 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9e00005ea0 tx=0x7f9e00005e30 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:01.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:01.817+0000 7f9e0be00700 1 -- 172.21.15.111:0/1320137972 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f9e04061f70 con 0x7f9e141003d0 2024-09-11T00:12:02.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:02.035+0000 7f9e1a200700 1 -- 172.21.15.111:0/1320137972 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f9e141992b0 con 0x7f9e141003d0 2024-09-11T00:12:02.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:02.035+0000 7f9e0be00700 1 -- 172.21.15.111:0/1320137972 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v64)=0 v64) v1 ==== 155+0+0 (secure 0 0 0) 0x7f9e04022720 con 0x7f9e141003d0 2024-09-11T00:12:02.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:02.038+0000 7f9e1a200700 1 -- 172.21.15.111:0/1320137972 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f9df807a370 msgr2=0x7f9df807c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:02.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:02.038+0000 7f9e1a200700 1 --2- 172.21.15.111:0/1320137972 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f9df807a370 0x7f9df807c820 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9e00005ea0 tx=0x7f9e00005e30 comp rx=0 tx=0).stop 2024-09-11T00:12:02.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:02.038+0000 7f9e1a200700 1 -- 172.21.15.111:0/1320137972 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e141003d0 msgr2=0x7f9e14197f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:02.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:02.038+0000 7f9e1a200700 1 --2- 172.21.15.111:0/1320137972 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e141003d0 0x7f9e14197f50 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9e04006010 tx=0x7f9e0400be20 comp rx=0 tx=0).stop 2024-09-11T00:12:02.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:02.038+0000 7f9e1a200700 1 -- 172.21.15.111:0/1320137972 shutdown_connections 2024-09-11T00:12:02.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:02.038+0000 7f9e1a200700 1 --2- 172.21.15.111:0/1320137972 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f9df807a370 0x7f9df807c820 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:02.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:02.038+0000 7f9e1a200700 1 --2- 172.21.15.111:0/1320137972 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e141003d0 0x7f9e14197f50 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:02.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:02.038+0000 7f9e1a200700 1 --2- 172.21.15.111:0/1320137972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e14100d70 0x7f9e14198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:02.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:02.038+0000 7f9e1a200700 1 -- 172.21.15.111:0/1320137972 >> 172.21.15.111:0/1320137972 conn(0x7f9e140fbc90 msgr2=0x7f9e140fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:02.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:02.039+0000 7f9e1a200700 1 -- 172.21.15.111:0/1320137972 shutdown_connections 2024-09-11T00:12:02.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:02.039+0000 7f9e1a200700 1 -- 172.21.15.111:0/1320137972 wait complete. 2024-09-11T00:12:02.380 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:02 smithi111 ceph-mon[27539]: pgmap v106: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:02.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:02 smithi203 ceph-mon[33225]: pgmap v106: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:02.709 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -e sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-11T00:12:03.029 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:12:04.449 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:04 smithi111 ceph-mon[27539]: pgmap v107: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:04.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:04 smithi203 ceph-mon[33225]: pgmap v107: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:04.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.820+0000 7f3b83a00700 1 -- 172.21.15.111:0/2572804652 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b7c102fb0 msgr2=0x7f3b7c106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:04.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.820+0000 7f3b83a00700 1 --2- 172.21.15.111:0/2572804652 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b7c102fb0 0x7f3b7c106f80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3b68009910 tx=0x7f3b68009c20 comp rx=0 tx=0).stop 2024-09-11T00:12:04.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.820+0000 7f3b83a00700 1 -- 172.21.15.111:0/2572804652 shutdown_connections 2024-09-11T00:12:04.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.820+0000 7f3b83a00700 1 --2- 172.21.15.111:0/2572804652 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b7c102fb0 0x7f3b7c106f80 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:04.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.820+0000 7f3b83a00700 1 --2- 172.21.15.111:0/2572804652 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b7c102610 0x7f3b7c1029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:04.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.820+0000 7f3b83a00700 1 -- 172.21.15.111:0/2572804652 >> 172.21.15.111:0/2572804652 conn(0x7f3b7c0fde90 msgr2=0x7f3b7c1002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:04.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.820+0000 7f3b83a00700 1 -- 172.21.15.111:0/2572804652 shutdown_connections 2024-09-11T00:12:04.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.820+0000 7f3b83a00700 1 -- 172.21.15.111:0/2572804652 wait complete. 2024-09-11T00:12:04.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.822+0000 7f3b83a00700 1 Processor -- start 2024-09-11T00:12:04.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.822+0000 7f3b83a00700 1 -- start start 2024-09-11T00:12:04.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.822+0000 7f3b83a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b7c102610 0x7f3b7c197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:04.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.822+0000 7f3b83a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b7c102fb0 0x7f3b7c198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:04.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.822+0000 7f3b83a00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c198c00 con 0x7f3b7c102610 2024-09-11T00:12:04.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.822+0000 7f3b83a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c19c920 con 0x7f3b7c102fb0 2024-09-11T00:12:04.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.823+0000 7f3b81000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b7c102610 0x7f3b7c197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:04.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.823+0000 7f3b81000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b7c102610 0x7f3b7c197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:33212/0 (socket says 172.21.15.111:33212) 2024-09-11T00:12:04.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.823+0000 7f3b81000700 1 -- 172.21.15.111:0/3715368084 learned_addr learned my addr 172.21.15.111:0/3715368084 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:12:04.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.823+0000 7f3b7be00700 1 --2- 172.21.15.111:0/3715368084 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b7c102fb0 0x7f3b7c198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:04.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.823+0000 7f3b81000700 1 -- 172.21.15.111:0/3715368084 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b7c102fb0 msgr2=0x7f3b7c198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:04.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.823+0000 7f3b81000700 1 --2- 172.21.15.111:0/3715368084 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b7c102fb0 0x7f3b7c198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:04.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.823+0000 7f3b81000700 1 -- 172.21.15.111:0/3715368084 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b680095f0 con 0x7f3b7c102610 2024-09-11T00:12:04.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.823+0000 7f3b81000700 1 --2- 172.21.15.111:0/3715368084 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b7c102610 0x7f3b7c197fe0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000c8a0 tx=0x7f3b7000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:04.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.824+0000 7f3b79600700 1 -- 172.21.15.111:0/3715368084 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b7000cea0 con 0x7f3b7c102610 2024-09-11T00:12:04.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.824+0000 7f3b79600700 1 -- 172.21.15.111:0/3715368084 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b70004830 con 0x7f3b7c102610 2024-09-11T00:12:04.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.824+0000 7f3b83a00700 1 -- 172.21.15.111:0/3715368084 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b7c19cc00 con 0x7f3b7c102610 2024-09-11T00:12:04.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.824+0000 7f3b79600700 1 -- 172.21.15.111:0/3715368084 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b700055b0 con 0x7f3b7c102610 2024-09-11T00:12:04.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.824+0000 7f3b83a00700 1 -- 172.21.15.111:0/3715368084 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7c19d150 con 0x7f3b7c102610 2024-09-11T00:12:04.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.825+0000 7f3b83a00700 1 -- 172.21.15.111:0/3715368084 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b7c04ea50 con 0x7f3b7c102610 2024-09-11T00:12:04.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.826+0000 7f3b79600700 1 -- 172.21.15.111:0/3715368084 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 34) v1 ==== 102331+0+0 (secure 0 0 0) 0x7f3b700049a0 con 0x7f3b7c102610 2024-09-11T00:12:04.829 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.827+0000 7f3b79600700 1 --2- 172.21.15.111:0/3715368084 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f3b6407a370 0x7f3b6407c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:04.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.828+0000 7f3b79600700 1 -- 172.21.15.111:0/3715368084 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f3b7009c9b0 con 0x7f3b7c102610 2024-09-11T00:12:04.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.828+0000 7f3b7be00700 1 --2- 172.21.15.111:0/3715368084 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f3b6407a370 0x7f3b6407c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:04.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.828+0000 7f3b7be00700 1 --2- 172.21.15.111:0/3715368084 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f3b6407a370 0x7f3b6407c820 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c199590 tx=0x7f3b6801a040 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:04.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:04.833+0000 7f3b79600700 1 -- 172.21.15.111:0/3715368084 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f3b700605b0 con 0x7f3b7c102610 2024-09-11T00:12:05.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:05.060+0000 7f3b83a00700 1 -- 172.21.15.111:0/3715368084 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f3b7c199340 con 0x7f3b7c102610 2024-09-11T00:12:05.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:05.061+0000 7f3b79600700 1 -- 172.21.15.111:0/3715368084 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v64)=0 v64) v1 ==== 163+0+0 (secure 0 0 0) 0x7f3b70004c50 con 0x7f3b7c102610 2024-09-11T00:12:05.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:05.064+0000 7f3b83a00700 1 -- 172.21.15.111:0/3715368084 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f3b6407a370 msgr2=0x7f3b6407c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:05.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:05.064+0000 7f3b83a00700 1 --2- 172.21.15.111:0/3715368084 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f3b6407a370 0x7f3b6407c820 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c199590 tx=0x7f3b6801a040 comp rx=0 tx=0).stop 2024-09-11T00:12:05.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:05.064+0000 7f3b83a00700 1 -- 172.21.15.111:0/3715368084 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b7c102610 msgr2=0x7f3b7c197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:05.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:05.064+0000 7f3b83a00700 1 --2- 172.21.15.111:0/3715368084 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b7c102610 0x7f3b7c197fe0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000c8a0 tx=0x7f3b7000cc60 comp rx=0 tx=0).stop 2024-09-11T00:12:05.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:05.064+0000 7f3b83a00700 1 -- 172.21.15.111:0/3715368084 shutdown_connections 2024-09-11T00:12:05.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:05.064+0000 7f3b83a00700 1 --2- 172.21.15.111:0/3715368084 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f3b6407a370 0x7f3b6407c820 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:05.064+0000 7f3b83a00700 1 --2- 172.21.15.111:0/3715368084 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b7c102610 0x7f3b7c197fe0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:05.064+0000 7f3b83a00700 1 --2- 172.21.15.111:0/3715368084 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b7c102fb0 0x7f3b7c198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:05.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:05.064+0000 7f3b83a00700 1 -- 172.21.15.111:0/3715368084 >> 172.21.15.111:0/3715368084 conn(0x7f3b7c0fde90 msgr2=0x7f3b7c0ff460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:05.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:05.064+0000 7f3b83a00700 1 -- 172.21.15.111:0/3715368084 shutdown_connections 2024-09-11T00:12:05.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:05.064+0000 7f3b83a00700 1 -- 172.21.15.111:0/3715368084 wait complete. 2024-09-11T00:12:05.740 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -e sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-11T00:12:06.060 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:12:06.486 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:06 smithi111 ceph-mon[27539]: pgmap v108: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:06.486 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:06 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:12:06.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:06 smithi203 ceph-mon[33225]: pgmap v108: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:06.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:06 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:12:07.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.801+0000 7f0ad6000700 1 -- 172.21.15.111:0/3607858205 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ad0068630 msgr2=0x7f0ad0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:07.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.801+0000 7f0ad6000700 1 --2- 172.21.15.111:0/3607858205 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ad0068630 0x7f0ad0068a00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0009910 tx=0x7f0ac0009c20 comp rx=0 tx=0).stop 2024-09-11T00:12:07.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.801+0000 7f0ad6000700 1 -- 172.21.15.111:0/3607858205 shutdown_connections 2024-09-11T00:12:07.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.801+0000 7f0ad6000700 1 --2- 172.21.15.111:0/3607858205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ad0068fd0 0x7f0ad0104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:07.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.801+0000 7f0ad6000700 1 --2- 172.21.15.111:0/3607858205 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ad0068630 0x7f0ad0068a00 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:07.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.801+0000 7f0ad6000700 1 -- 172.21.15.111:0/3607858205 >> 172.21.15.111:0/3607858205 conn(0x7f0ad0074f50 msgr2=0x7f0ad0075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:07.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.801+0000 7f0ad6000700 1 -- 172.21.15.111:0/3607858205 shutdown_connections 2024-09-11T00:12:07.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.801+0000 7f0ad6000700 1 -- 172.21.15.111:0/3607858205 wait complete. 2024-09-11T00:12:07.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.802+0000 7f0ad6000700 1 Processor -- start 2024-09-11T00:12:07.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.803+0000 7f0ad6000700 1 -- start start 2024-09-11T00:12:07.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.803+0000 7f0ad6000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ad0068630 0x7f0ad0198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:07.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.803+0000 7f0ad6000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ad0068fd0 0x7f0ad0198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:07.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.803+0000 7f0ad6000700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad0198c40 con 0x7f0ad0068630 2024-09-11T00:12:07.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.803+0000 7f0ad6000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad019c9d0 con 0x7f0ad0068fd0 2024-09-11T00:12:07.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.803+0000 7f0acf400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ad0068630 0x7f0ad0198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:07.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.803+0000 7f0acf400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ad0068630 0x7f0ad0198020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53454/0 (socket says 172.21.15.111:53454) 2024-09-11T00:12:07.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.803+0000 7f0acf400700 1 -- 172.21.15.111:0/2863313144 learned_addr learned my addr 172.21.15.111:0/2863313144 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:12:07.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.803+0000 7f0acea00700 1 --2- 172.21.15.111:0/2863313144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ad0068fd0 0x7f0ad0198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:07.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.804+0000 7f0acf400700 1 -- 172.21.15.111:0/2863313144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ad0068fd0 msgr2=0x7f0ad0198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:07.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.804+0000 7f0acf400700 1 --2- 172.21.15.111:0/2863313144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ad0068fd0 0x7f0ad0198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:07.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.804+0000 7f0acf400700 1 -- 172.21.15.111:0/2863313144 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac00095f0 con 0x7f0ad0068630 2024-09-11T00:12:07.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.804+0000 7f0acf400700 1 --2- 172.21.15.111:0/2863313144 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ad0068630 0x7f0ad0198020 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0006010 tx=0x7f0ac000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:07.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.804+0000 7f0ac7e00700 1 -- 172.21.15.111:0/2863313144 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ac001d070 con 0x7f0ad0068630 2024-09-11T00:12:07.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.804+0000 7f0ac7e00700 1 -- 172.21.15.111:0/2863313144 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0ac0004fb0 con 0x7f0ad0068630 2024-09-11T00:12:07.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.804+0000 7f0ac7e00700 1 -- 172.21.15.111:0/2863313144 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ac0022ea0 con 0x7f0ad0068630 2024-09-11T00:12:07.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.804+0000 7f0ad6000700 1 -- 172.21.15.111:0/2863313144 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad019cc50 con 0x7f0ad0068630 2024-09-11T00:12:07.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.805+0000 7f0ad6000700 1 -- 172.21.15.111:0/2863313144 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad019d0f0 con 0x7f0ad0068630 2024-09-11T00:12:07.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.806+0000 7f0ad6000700 1 -- 172.21.15.111:0/2863313144 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad0104570 con 0x7f0ad0068630 2024-09-11T00:12:07.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.807+0000 7f0ac7e00700 1 -- 172.21.15.111:0/2863313144 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 34) v1 ==== 102331+0+0 (secure 0 0 0) 0x7f0ac0022470 con 0x7f0ad0068630 2024-09-11T00:12:07.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.808+0000 7f0ac7e00700 1 --2- 172.21.15.111:0/2863313144 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f0ab407a370 0x7f0ab407c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:07.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.808+0000 7f0ac7e00700 1 -- 172.21.15.111:0/2863313144 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f0ac009e340 con 0x7f0ad0068630 2024-09-11T00:12:07.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.808+0000 7f0acea00700 1 --2- 172.21.15.111:0/2863313144 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f0ab407a370 0x7f0ab407c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:07.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.809+0000 7f0acea00700 1 --2- 172.21.15.111:0/2863313144 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f0ab407a370 0x7f0ab407c820 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0abc006fd0 tx=0x7f0abc008040 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:07.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:07.813+0000 7f0ac7e00700 1 -- 172.21.15.111:0/2863313144 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f0ac0061f70 con 0x7f0ad0068630 2024-09-11T00:12:08.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:08.030+0000 7f0ad6000700 1 -- 172.21.15.111:0/2863313144 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f0ad004ea50 con 0x7f0ad0068630 2024-09-11T00:12:08.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:08.030+0000 7f0ac7e00700 1 -- 172.21.15.111:0/2863313144 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v64)=0 v64) v1 ==== 135+0+0 (secure 0 0 0) 0x7f0ac0022720 con 0x7f0ad0068630 2024-09-11T00:12:08.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:08.033+0000 7f0ad6000700 1 -- 172.21.15.111:0/2863313144 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f0ab407a370 msgr2=0x7f0ab407c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:08.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:08.033+0000 7f0ad6000700 1 --2- 172.21.15.111:0/2863313144 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f0ab407a370 0x7f0ab407c820 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0abc006fd0 tx=0x7f0abc008040 comp rx=0 tx=0).stop 2024-09-11T00:12:08.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:08.033+0000 7f0ad6000700 1 -- 172.21.15.111:0/2863313144 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ad0068630 msgr2=0x7f0ad0198020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:08.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:08.033+0000 7f0ad6000700 1 --2- 172.21.15.111:0/2863313144 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ad0068630 0x7f0ad0198020 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0006010 tx=0x7f0ac000be20 comp rx=0 tx=0).stop 2024-09-11T00:12:08.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:08.033+0000 7f0ad6000700 1 -- 172.21.15.111:0/2863313144 shutdown_connections 2024-09-11T00:12:08.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:08.033+0000 7f0ad6000700 1 --2- 172.21.15.111:0/2863313144 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f0ab407a370 0x7f0ab407c820 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:08.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:08.033+0000 7f0ad6000700 1 --2- 172.21.15.111:0/2863313144 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ad0068630 0x7f0ad0198020 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:08.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:08.033+0000 7f0ad6000700 1 --2- 172.21.15.111:0/2863313144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ad0068fd0 0x7f0ad0198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:08.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:08.033+0000 7f0ad6000700 1 -- 172.21.15.111:0/2863313144 >> 172.21.15.111:0/2863313144 conn(0x7f0ad0074f50 msgr2=0x7f0ad00fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:08.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:08.033+0000 7f0ad6000700 1 -- 172.21.15.111:0/2863313144 shutdown_connections 2024-09-11T00:12:08.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:08.033+0000 7f0ad6000700 1 -- 172.21.15.111:0/2863313144 wait complete. 2024-09-11T00:12:08.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:08 smithi111 ceph-mon[27539]: pgmap v109: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:08.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:08 smithi203 ceph-mon[33225]: pgmap v109: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:08.731 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -e sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-11T00:12:09.054 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:12:10.094 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:09 smithi111 ceph-mon[27539]: pgmap v110: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:10.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:09 smithi203 ceph-mon[33225]: pgmap v110: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:11.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.022+0000 7f35cea00700 1 -- 172.21.15.111:0/2655498836 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35c8100200 msgr2=0x7f35c81005d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:11.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.022+0000 7f35cea00700 1 --2- 172.21.15.111:0/2655498836 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35c8100200 0x7f35c81005d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f35bc009910 tx=0x7f35bc009c20 comp rx=0 tx=0).stop 2024-09-11T00:12:11.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.022+0000 7f35cea00700 1 -- 172.21.15.111:0/2655498836 shutdown_connections 2024-09-11T00:12:11.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.022+0000 7f35cea00700 1 --2- 172.21.15.111:0/2655498836 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f35c8100ba0 0x7f35c8104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:11.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.022+0000 7f35cea00700 1 --2- 172.21.15.111:0/2655498836 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35c8100200 0x7f35c81005d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:11.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.022+0000 7f35cea00700 1 -- 172.21.15.111:0/2655498836 >> 172.21.15.111:0/2655498836 conn(0x7f35c80fba80 msgr2=0x7f35c80fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:11.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.023+0000 7f35cea00700 1 -- 172.21.15.111:0/2655498836 shutdown_connections 2024-09-11T00:12:11.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.023+0000 7f35cea00700 1 -- 172.21.15.111:0/2655498836 wait complete. 2024-09-11T00:12:11.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.024+0000 7f35cea00700 1 Processor -- start 2024-09-11T00:12:11.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.024+0000 7f35cea00700 1 -- start start 2024-09-11T00:12:11.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.025+0000 7f35cea00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35c8100200 0x7f35c8197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:11.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.025+0000 7f35cea00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f35c8100ba0 0x7f35c8198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:11.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.025+0000 7f35cea00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c8198980 con 0x7f35c8100200 2024-09-11T00:12:11.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.025+0000 7f35cea00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c8198ac0 con 0x7f35c8100ba0 2024-09-11T00:12:11.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.025+0000 7f35cd600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35c8100200 0x7f35c8197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:11.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.025+0000 7f35cd600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35c8100200 0x7f35c8197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53472/0 (socket says 172.21.15.111:53472) 2024-09-11T00:12:11.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.025+0000 7f35cd600700 1 -- 172.21.15.111:0/494427765 learned_addr learned my addr 172.21.15.111:0/494427765 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:12:11.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.025+0000 7f35ccc00700 1 --2- 172.21.15.111:0/494427765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f35c8100ba0 0x7f35c8198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:11.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.025+0000 7f35cd600700 1 -- 172.21.15.111:0/494427765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f35c8100ba0 msgr2=0x7f35c8198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:11.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.025+0000 7f35cd600700 1 --2- 172.21.15.111:0/494427765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f35c8100ba0 0x7f35c8198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:11.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.025+0000 7f35cd600700 1 -- 172.21.15.111:0/494427765 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35bc0095f0 con 0x7f35c8100200 2024-09-11T00:12:11.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.026+0000 7f35cd600700 1 --2- 172.21.15.111:0/494427765 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35c8100200 0x7f35c8197df0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00b5c0 tx=0x7f35bc00be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:11.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.026+0000 7f35c6000700 1 -- 172.21.15.111:0/494427765 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35bc01d070 con 0x7f35c8100200 2024-09-11T00:12:11.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.026+0000 7f35cea00700 1 -- 172.21.15.111:0/494427765 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c819c8b0 con 0x7f35c8100200 2024-09-11T00:12:11.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.026+0000 7f35c6000700 1 -- 172.21.15.111:0/494427765 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f35bc00f460 con 0x7f35c8100200 2024-09-11T00:12:11.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.026+0000 7f35c6000700 1 -- 172.21.15.111:0/494427765 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35bc017610 con 0x7f35c8100200 2024-09-11T00:12:11.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.026+0000 7f35cea00700 1 -- 172.21.15.111:0/494427765 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c819cda0 con 0x7f35c8100200 2024-09-11T00:12:11.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.027+0000 7f35cea00700 1 -- 172.21.15.111:0/494427765 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c804f2a0 con 0x7f35c8100200 2024-09-11T00:12:11.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.028+0000 7f35c6000700 1 -- 172.21.15.111:0/494427765 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 34) v1 ==== 102331+0+0 (secure 0 0 0) 0x7f35bc00f5d0 con 0x7f35c8100200 2024-09-11T00:12:11.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.029+0000 7f35c6000700 1 --2- 172.21.15.111:0/494427765 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f35b007a370 0x7f35b007c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:11.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.029+0000 7f35c6000700 1 -- 172.21.15.111:0/494427765 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f35bc09e3c0 con 0x7f35c8100200 2024-09-11T00:12:11.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.030+0000 7f35ccc00700 1 --2- 172.21.15.111:0/494427765 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f35b007a370 0x7f35b007c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:11.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.030+0000 7f35ccc00700 1 --2- 172.21.15.111:0/494427765 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f35b007a370 0x7f35b007c820 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f35b4005ea0 tx=0x7f35b4005e30 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:11.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.034+0000 7f35c6000700 1 -- 172.21.15.111:0/494427765 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f35bc061f40 con 0x7f35c8100200 2024-09-11T00:12:11.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.274+0000 7f35cea00700 1 -- 172.21.15.111:0/494427765 --> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30", "target": ["mon-mgr", ""]}) v1 -- 0x7f35c8103f30 con 0x7f35b007a370 2024-09-11T00:12:11.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.280+0000 7f35c6000700 1 -- 172.21.15.111:0/494427765 <== mgr.14744 v2:172.21.15.111:6800/3952658086 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f35c8103f30 con 0x7f35b007a370 2024-09-11T00:12:11.282 INFO:teuthology.orchestra.run.smithi111.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:12:11.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.283+0000 7f35cea00700 1 -- 172.21.15.111:0/494427765 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f35b007a370 msgr2=0x7f35b007c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:11.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.283+0000 7f35cea00700 1 --2- 172.21.15.111:0/494427765 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f35b007a370 0x7f35b007c820 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f35b4005ea0 tx=0x7f35b4005e30 comp rx=0 tx=0).stop 2024-09-11T00:12:11.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.283+0000 7f35cea00700 1 -- 172.21.15.111:0/494427765 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35c8100200 msgr2=0x7f35c8197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:11.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.283+0000 7f35cea00700 1 --2- 172.21.15.111:0/494427765 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35c8100200 0x7f35c8197df0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00b5c0 tx=0x7f35bc00be00 comp rx=0 tx=0).stop 2024-09-11T00:12:11.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.283+0000 7f35cea00700 1 -- 172.21.15.111:0/494427765 shutdown_connections 2024-09-11T00:12:11.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.283+0000 7f35cea00700 1 --2- 172.21.15.111:0/494427765 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f35b007a370 0x7f35b007c820 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:11.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.283+0000 7f35cea00700 1 --2- 172.21.15.111:0/494427765 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35c8100200 0x7f35c8197df0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:11.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.283+0000 7f35cea00700 1 --2- 172.21.15.111:0/494427765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f35c8100ba0 0x7f35c8198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:11.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.283+0000 7f35cea00700 1 -- 172.21.15.111:0/494427765 >> 172.21.15.111:0/494427765 conn(0x7f35c80fba80 msgr2=0x7f35c80fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:11.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.283+0000 7f35cea00700 1 -- 172.21.15.111:0/494427765 shutdown_connections 2024-09-11T00:12:11.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:11.283+0000 7f35cea00700 1 -- 172.21.15.111:0/494427765 wait complete. 2024-09-11T00:12:12.081 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-11T00:12:12.082 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi111.front.sepia.ceph.com 2024-09-11T00:12:12.082 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -e sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-11T00:12:12.443 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:12:12.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:12 smithi203 ceph-mon[33225]: pgmap v111: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:12.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:12 smithi203 ceph-mon[33225]: from='client.14936 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:12:12.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:12 smithi203 ceph-mon[33225]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:12:12.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:12 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:12.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:12 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:12:12.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:12 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:12:12.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:12 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:12:12.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:12 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:12.586 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:12 smithi111 ceph-mon[27539]: pgmap v111: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:12.587 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:12 smithi111 ceph-mon[27539]: from='client.14936 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:12:12.587 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:12 smithi111 ceph-mon[27539]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:12:12.587 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:12 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:12.587 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:12 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:12:12.587 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:12 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:12:12.587 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:12 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T00:12:12.587 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:12 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:14.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:14 smithi203 ceph-mon[33225]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:12:14.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:14 smithi203 ceph-mon[33225]: pgmap v112: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:14.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:14 smithi111 ceph-mon[27539]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:12:14.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:14 smithi111 ceph-mon[27539]: pgmap v112: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:14.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.860+0000 7f0991000700 1 -- 172.21.15.111:0/215220237 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f098c073070 msgr2=0x7f098c073440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:14.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.860+0000 7f0991000700 1 --2- 172.21.15.111:0/215220237 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f098c073070 0x7f098c073440 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f097c009940 tx=0x7f097c009c50 comp rx=0 tx=0).stop 2024-09-11T00:12:14.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.860+0000 7f0991000700 1 -- 172.21.15.111:0/215220237 shutdown_connections 2024-09-11T00:12:14.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.860+0000 7f0991000700 1 --2- 172.21.15.111:0/215220237 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f098c073980 0x7f098c10c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.860+0000 7f0991000700 1 --2- 172.21.15.111:0/215220237 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f098c073070 0x7f098c073440 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.860+0000 7f0991000700 1 -- 172.21.15.111:0/215220237 >> 172.21.15.111:0/215220237 conn(0x7f098c0fbc50 msgr2=0x7f098c0fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:14.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.860+0000 7f0991000700 1 -- 172.21.15.111:0/215220237 shutdown_connections 2024-09-11T00:12:14.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.860+0000 7f0991000700 1 -- 172.21.15.111:0/215220237 wait complete. 2024-09-11T00:12:14.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.861+0000 7f0991000700 1 Processor -- start 2024-09-11T00:12:14.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.861+0000 7f0991000700 1 -- start start 2024-09-11T00:12:14.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.861+0000 7f0991000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f098c073070 0x7f098c197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:14.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.861+0000 7f0991000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f098c073980 0x7f098c1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:14.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.861+0000 7f0991000700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098c198b80 con 0x7f098c073070 2024-09-11T00:12:14.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.861+0000 7f0991000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098c19c8c0 con 0x7f098c073980 2024-09-11T00:12:14.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.862+0000 7f0989e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f098c073070 0x7f098c197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:14.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.862+0000 7f0989e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f098c073070 0x7f098c197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53492/0 (socket says 172.21.15.111:53492) 2024-09-11T00:12:14.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.862+0000 7f0989e00700 1 -- 172.21.15.111:0/2024651671 learned_addr learned my addr 172.21.15.111:0/2024651671 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:12:14.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.862+0000 7f0989400700 1 --2- 172.21.15.111:0/2024651671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f098c073980 0x7f098c1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:14.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.862+0000 7f0989e00700 1 -- 172.21.15.111:0/2024651671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f098c073980 msgr2=0x7f098c1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:14.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.862+0000 7f0989e00700 1 --2- 172.21.15.111:0/2024651671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f098c073980 0x7f098c1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.862+0000 7f0989e00700 1 -- 172.21.15.111:0/2024651671 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c0095f0 con 0x7f098c073070 2024-09-11T00:12:14.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.862+0000 7f0989e00700 1 --2- 172.21.15.111:0/2024651671 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f098c073070 0x7f098c197f60 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f097c0055f0 tx=0x7f097c0056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:14.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.863+0000 7f0982a00700 1 -- 172.21.15.111:0/2024651671 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f097c01d070 con 0x7f098c073070 2024-09-11T00:12:14.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.863+0000 7f0982a00700 1 -- 172.21.15.111:0/2024651671 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f097c00f460 con 0x7f098c073070 2024-09-11T00:12:14.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.863+0000 7f0982a00700 1 -- 172.21.15.111:0/2024651671 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f097c021640 con 0x7f098c073070 2024-09-11T00:12:14.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.863+0000 7f0991000700 1 -- 172.21.15.111:0/2024651671 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f098c19cb40 con 0x7f098c073070 2024-09-11T00:12:14.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.863+0000 7f0991000700 1 -- 172.21.15.111:0/2024651671 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098c19cfe0 con 0x7f098c073070 2024-09-11T00:12:14.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.864+0000 7f0991000700 1 -- 172.21.15.111:0/2024651671 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f098c109bf0 con 0x7f098c073070 2024-09-11T00:12:14.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.865+0000 7f0982a00700 1 -- 172.21.15.111:0/2024651671 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 34) v1 ==== 102331+0+0 (secure 0 0 0) 0x7f097c00fa20 con 0x7f098c073070 2024-09-11T00:12:14.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.866+0000 7f0982a00700 1 --2- 172.21.15.111:0/2024651671 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f097007a370 0x7f097007c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:14.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.866+0000 7f0982a00700 1 -- 172.21.15.111:0/2024651671 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f097c09e070 con 0x7f098c073070 2024-09-11T00:12:14.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.866+0000 7f0989400700 1 --2- 172.21.15.111:0/2024651671 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f097007a370 0x7f097007c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:14.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.867+0000 7f0989400700 1 --2- 172.21.15.111:0/2024651671 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f097007a370 0x7f097007c820 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0978005950 tx=0x7f09780058e0 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:14.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:14.871+0000 7f0982a00700 1 -- 172.21.15.111:0/2024651671 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f097c061bf0 con 0x7f098c073070 2024-09-11T00:12:15.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.128+0000 7f0991000700 1 -- 172.21.15.111:0/2024651671 --> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f098c19d330 con 0x7f097007a370 2024-09-11T00:12:15.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.129+0000 7f0982a00700 1 -- 172.21.15.111:0/2024651671 <== mgr.14744 v2:172.21.15.111:6800/3952658086 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f098c19d330 con 0x7f097007a370 2024-09-11T00:12:15.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.132+0000 7f0991000700 1 -- 172.21.15.111:0/2024651671 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f097007a370 msgr2=0x7f097007c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:15.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.132+0000 7f0991000700 1 --2- 172.21.15.111:0/2024651671 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f097007a370 0x7f097007c820 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0978005950 tx=0x7f09780058e0 comp rx=0 tx=0).stop 2024-09-11T00:12:15.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.132+0000 7f0991000700 1 -- 172.21.15.111:0/2024651671 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f098c073070 msgr2=0x7f098c197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:15.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.132+0000 7f0991000700 1 --2- 172.21.15.111:0/2024651671 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f098c073070 0x7f098c197f60 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f097c0055f0 tx=0x7f097c0056d0 comp rx=0 tx=0).stop 2024-09-11T00:12:15.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.132+0000 7f0991000700 1 -- 172.21.15.111:0/2024651671 shutdown_connections 2024-09-11T00:12:15.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.132+0000 7f0991000700 1 --2- 172.21.15.111:0/2024651671 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f097007a370 0x7f097007c820 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:15.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.132+0000 7f0991000700 1 --2- 172.21.15.111:0/2024651671 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f098c073070 0x7f098c197f60 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:15.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.132+0000 7f0991000700 1 --2- 172.21.15.111:0/2024651671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f098c073980 0x7f098c1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:15.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.132+0000 7f0991000700 1 -- 172.21.15.111:0/2024651671 >> 172.21.15.111:0/2024651671 conn(0x7f098c0fbc50 msgr2=0x7f098c106d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:15.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.132+0000 7f0991000700 1 -- 172.21.15.111:0/2024651671 shutdown_connections 2024-09-11T00:12:15.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.132+0000 7f0991000700 1 -- 172.21.15.111:0/2024651671 wait complete. 2024-09-11T00:12:15.149 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:12:15.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.270+0000 7ff2db000700 1 -- 172.21.15.111:0/3844725491 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2d4100d70 msgr2=0x7ff2d4104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:15.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.270+0000 7ff2db000700 1 --2- 172.21.15.111:0/3844725491 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2d4100d70 0x7ff2d4104d40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0009910 tx=0x7ff2c0009c20 comp rx=0 tx=0).stop 2024-09-11T00:12:15.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.271+0000 7ff2db000700 1 -- 172.21.15.111:0/3844725491 shutdown_connections 2024-09-11T00:12:15.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.271+0000 7ff2db000700 1 --2- 172.21.15.111:0/3844725491 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2d4100d70 0x7ff2d4104d40 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:15.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.271+0000 7ff2db000700 1 --2- 172.21.15.111:0/3844725491 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2d41003d0 0x7ff2d41007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:15.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.271+0000 7ff2db000700 1 -- 172.21.15.111:0/3844725491 >> 172.21.15.111:0/3844725491 conn(0x7ff2d40fbc90 msgr2=0x7ff2d40fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:15.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.271+0000 7ff2db000700 1 -- 172.21.15.111:0/3844725491 shutdown_connections 2024-09-11T00:12:15.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.271+0000 7ff2db000700 1 -- 172.21.15.111:0/3844725491 wait complete. 2024-09-11T00:12:15.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.272+0000 7ff2db000700 1 Processor -- start 2024-09-11T00:12:15.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.272+0000 7ff2db000700 1 -- start start 2024-09-11T00:12:15.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.272+0000 7ff2db000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2d41003d0 0x7ff2d4195d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:15.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.272+0000 7ff2db000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2d4100d70 0x7ff2d4196280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:15.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.272+0000 7ff2db000700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d4196960 con 0x7ff2d41003d0 2024-09-11T00:12:15.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.272+0000 7ff2db000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d419a6f0 con 0x7ff2d4100d70 2024-09-11T00:12:15.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.273+0000 7ff2d3e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2d41003d0 0x7ff2d4195d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:15.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.273+0000 7ff2d3e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2d41003d0 0x7ff2d4195d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53512/0 (socket says 172.21.15.111:53512) 2024-09-11T00:12:15.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.273+0000 7ff2d3e00700 1 -- 172.21.15.111:0/1984146209 learned_addr learned my addr 172.21.15.111:0/1984146209 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:12:15.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.273+0000 7ff2d3400700 1 --2- 172.21.15.111:0/1984146209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2d4100d70 0x7ff2d4196280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:15.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.273+0000 7ff2d3e00700 1 -- 172.21.15.111:0/1984146209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2d4100d70 msgr2=0x7ff2d4196280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:15.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.273+0000 7ff2d3e00700 1 --2- 172.21.15.111:0/1984146209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2d4100d70 0x7ff2d4196280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:15.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.273+0000 7ff2d3e00700 1 -- 172.21.15.111:0/1984146209 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c00095f0 con 0x7ff2d41003d0 2024-09-11T00:12:15.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.273+0000 7ff2d3400700 1 --2- 172.21.15.111:0/1984146209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2d4100d70 0x7ff2d4196280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:12:15.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.273+0000 7ff2d3e00700 1 --2- 172.21.15.111:0/1984146209 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2d41003d0 0x7ff2d4195d40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400d8d0 tx=0x7ff2c400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:15.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.274+0000 7ff2d0c00700 1 -- 172.21.15.111:0/1984146209 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2c4009940 con 0x7ff2d41003d0 2024-09-11T00:12:15.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.274+0000 7ff2d0c00700 1 -- 172.21.15.111:0/1984146209 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff2c4010460 con 0x7ff2d41003d0 2024-09-11T00:12:15.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.274+0000 7ff2d0c00700 1 -- 172.21.15.111:0/1984146209 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2c400f5f0 con 0x7ff2d41003d0 2024-09-11T00:12:15.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.274+0000 7ff2db000700 1 -- 172.21.15.111:0/1984146209 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d419a9d0 con 0x7ff2d41003d0 2024-09-11T00:12:15.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.274+0000 7ff2db000700 1 -- 172.21.15.111:0/1984146209 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d419af20 con 0x7ff2d41003d0 2024-09-11T00:12:15.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.275+0000 7ff2db000700 1 -- 172.21.15.111:0/1984146209 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d4108740 con 0x7ff2d41003d0 2024-09-11T00:12:15.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.278+0000 7ff2d0c00700 1 -- 172.21.15.111:0/1984146209 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 34) v1 ==== 102331+0+0 (secure 0 0 0) 0x7ff2c40105d0 con 0x7ff2d41003d0 2024-09-11T00:12:15.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.279+0000 7ff2d0c00700 1 --2- 172.21.15.111:0/1984146209 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7ff2b807a370 0x7ff2b807c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:15.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.279+0000 7ff2d0c00700 1 -- 172.21.15.111:0/1984146209 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7ff2c409d550 con 0x7ff2d41003d0 2024-09-11T00:12:15.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.279+0000 7ff2d3400700 1 --2- 172.21.15.111:0/1984146209 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7ff2b807a370 0x7ff2b807c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:15.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.280+0000 7ff2d3400700 1 --2- 172.21.15.111:0/1984146209 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7ff2b807a370 0x7ff2b807c820 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0006010 tx=0x7ff2c0005960 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:15.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.281+0000 7ff2d0c00700 1 -- 172.21.15.111:0/1984146209 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7ff2c40611d0 con 0x7ff2d41003d0 2024-09-11T00:12:15.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.522+0000 7ff2db000700 1 -- 172.21.15.111:0/1984146209 --> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2d419b2a0 con 0x7ff2b807a370 2024-09-11T00:12:15.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.524+0000 7ff2d0c00700 1 -- 172.21.15.111:0/1984146209 <== mgr.14744 v2:172.21.15.111:6800/3952658086 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7ff2d419b2a0 con 0x7ff2b807a370 2024-09-11T00:12:15.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.526+0000 7ff2db000700 1 -- 172.21.15.111:0/1984146209 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7ff2b807a370 msgr2=0x7ff2b807c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:15.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.526+0000 7ff2db000700 1 --2- 172.21.15.111:0/1984146209 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7ff2b807a370 0x7ff2b807c820 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0006010 tx=0x7ff2c0005960 comp rx=0 tx=0).stop 2024-09-11T00:12:15.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.526+0000 7ff2db000700 1 -- 172.21.15.111:0/1984146209 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2d41003d0 msgr2=0x7ff2d4195d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:15.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.526+0000 7ff2db000700 1 --2- 172.21.15.111:0/1984146209 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2d41003d0 0x7ff2d4195d40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400d8d0 tx=0x7ff2c400dc90 comp rx=0 tx=0).stop 2024-09-11T00:12:15.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.526+0000 7ff2db000700 1 -- 172.21.15.111:0/1984146209 shutdown_connections 2024-09-11T00:12:15.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.526+0000 7ff2db000700 1 --2- 172.21.15.111:0/1984146209 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7ff2b807a370 0x7ff2b807c820 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:15.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.526+0000 7ff2db000700 1 --2- 172.21.15.111:0/1984146209 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2d41003d0 0x7ff2d4195d40 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:15.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.526+0000 7ff2db000700 1 --2- 172.21.15.111:0/1984146209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2d4100d70 0x7ff2d4196280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:15.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.526+0000 7ff2db000700 1 -- 172.21.15.111:0/1984146209 >> 172.21.15.111:0/1984146209 conn(0x7ff2d40fbc90 msgr2=0x7ff2d40fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:15.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.527+0000 7ff2db000700 1 -- 172.21.15.111:0/1984146209 shutdown_connections 2024-09-11T00:12:15.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.527+0000 7ff2db000700 1 -- 172.21.15.111:0/1984146209 wait complete. 2024-09-11T00:12:15.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.666+0000 7fb6be400700 1 -- 172.21.15.111:0/3575673725 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb6b8101c40 msgr2=0x7fb6b810a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:15.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.666+0000 7fb6be400700 1 --2- 172.21.15.111:0/3575673725 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb6b8101c40 0x7fb6b810a140 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4009940 tx=0x7fb6a4009c50 comp rx=0 tx=0).stop 2024-09-11T00:12:15.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.666+0000 7fb6be400700 1 -- 172.21.15.111:0/3575673725 shutdown_connections 2024-09-11T00:12:15.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.666+0000 7fb6be400700 1 --2- 172.21.15.111:0/3575673725 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb6b8101c40 0x7fb6b810a140 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:15.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.666+0000 7fb6be400700 1 --2- 172.21.15.111:0/3575673725 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb6b8101330 0x7fb6b8101700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:15.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.666+0000 7fb6be400700 1 -- 172.21.15.111:0/3575673725 >> 172.21.15.111:0/3575673725 conn(0x7fb6b80fabb0 msgr2=0x7fb6b80fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:15.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.666+0000 7fb6be400700 1 -- 172.21.15.111:0/3575673725 shutdown_connections 2024-09-11T00:12:15.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.666+0000 7fb6be400700 1 -- 172.21.15.111:0/3575673725 wait complete. 2024-09-11T00:12:15.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.667+0000 7fb6be400700 1 Processor -- start 2024-09-11T00:12:15.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.667+0000 7fb6be400700 1 -- start start 2024-09-11T00:12:15.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.668+0000 7fb6be400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb6b8101330 0x7fb6b80fef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:15.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.668+0000 7fb6be400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb6b8101c40 0x7fb6b80ff4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:15.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.668+0000 7fb6be400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b80ffa10 con 0x7fb6b8101330 2024-09-11T00:12:15.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.668+0000 7fb6be400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b80ffb50 con 0x7fb6b8101c40 2024-09-11T00:12:15.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.668+0000 7fb6b7400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb6b8101330 0x7fb6b80fef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:15.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.668+0000 7fb6b7400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb6b8101330 0x7fb6b80fef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53528/0 (socket says 172.21.15.111:53528) 2024-09-11T00:12:15.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.668+0000 7fb6b7400700 1 -- 172.21.15.111:0/2143397125 learned_addr learned my addr 172.21.15.111:0/2143397125 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:12:15.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.668+0000 7fb6b6a00700 1 --2- 172.21.15.111:0/2143397125 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb6b8101c40 0x7fb6b80ff4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:15.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.668+0000 7fb6b7400700 1 -- 172.21.15.111:0/2143397125 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb6b8101c40 msgr2=0x7fb6b80ff4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:15.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.668+0000 7fb6b7400700 1 --2- 172.21.15.111:0/2143397125 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb6b8101c40 0x7fb6b80ff4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:15.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.668+0000 7fb6b7400700 1 -- 172.21.15.111:0/2143397125 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a40095f0 con 0x7fb6b8101330 2024-09-11T00:12:15.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.668+0000 7fb6b6a00700 1 --2- 172.21.15.111:0/2143397125 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb6b8101c40 0x7fb6b80ff4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:12:15.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.669+0000 7fb6b7400700 1 --2- 172.21.15.111:0/2143397125 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb6b8101330 0x7fb6b80fef90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb6a800d8d0 tx=0x7fb6a800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:15.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.669+0000 7fb6afe00700 1 -- 172.21.15.111:0/2143397125 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6a8009940 con 0x7fb6b8101330 2024-09-11T00:12:15.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.669+0000 7fb6afe00700 1 -- 172.21.15.111:0/2143397125 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb6a8010460 con 0x7fb6b8101330 2024-09-11T00:12:15.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.669+0000 7fb6be400700 1 -- 172.21.15.111:0/2143397125 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6b81a1ec0 con 0x7fb6b8101330 2024-09-11T00:12:15.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.669+0000 7fb6afe00700 1 -- 172.21.15.111:0/2143397125 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6a800f5f0 con 0x7fb6b8101330 2024-09-11T00:12:15.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.669+0000 7fb6be400700 1 -- 172.21.15.111:0/2143397125 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b81a22d0 con 0x7fb6b8101330 2024-09-11T00:12:15.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.670+0000 7fb6be400700 1 -- 172.21.15.111:0/2143397125 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6b81077b0 con 0x7fb6b8101330 2024-09-11T00:12:15.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.671+0000 7fb6afe00700 1 -- 172.21.15.111:0/2143397125 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 34) v1 ==== 102331+0+0 (secure 0 0 0) 0x7fb6a80105d0 con 0x7fb6b8101330 2024-09-11T00:12:15.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.672+0000 7fb6afe00700 1 --2- 172.21.15.111:0/2143397125 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fb69c07a370 0x7fb69c07c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:15.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.672+0000 7fb6afe00700 1 -- 172.21.15.111:0/2143397125 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fb6a809cdb0 con 0x7fb6b8101330 2024-09-11T00:12:15.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.673+0000 7fb6b6a00700 1 --2- 172.21.15.111:0/2143397125 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fb69c07a370 0x7fb69c07c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:15.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.673+0000 7fb6b6a00700 1 --2- 172.21.15.111:0/2143397125 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fb69c07a370 0x7fb69c07c820 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4005b40 tx=0x7fb6a4005ad0 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:15.679 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.677+0000 7fb6afe00700 1 -- 172.21.15.111:0/2143397125 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7fb6a8060930 con 0x7fb6b8101330 2024-09-11T00:12:15.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.919+0000 7fb6be400700 1 -- 172.21.15.111:0/2143397125 --> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6b802cd90 con 0x7fb69c07a370 2024-09-11T00:12:15.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.929+0000 7fb6afe00700 1 -- 172.21.15.111:0/2143397125 <== mgr.14744 v2:172.21.15.111:6800/3952658086 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fb6b802cd90 con 0x7fb69c07a370 2024-09-11T00:12:15.931 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:12:15.932 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (108s) 74s ago 15m 14.5M - 0.27.0 11f11916f8cd d6d3253e881f 2024-09-11T00:12:15.932 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (4m) 74s ago 15m 7256k - 18.2.0 dc2bc1663786 7c40af85314c 2024-09-11T00:12:15.932 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi203 smithi203 running (4m) 2m ago 14m 7398k - 18.2.0 dc2bc1663786 922e3261ff70 2024-09-11T00:12:15.932 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (15m) 74s ago 15m 6665k - 18.2.0 dc2bc1663786 72a36c166ffa 2024-09-11T00:12:15.932 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi203 smithi203 running (14m) 2m ago 14m 6669k - 18.2.0 dc2bc1663786 9b102b6f6d70 2024-09-11T00:12:15.932 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (81s) 74s ago 15m 45.2M - c8b91775d855 7d3b50b5b59f 2024-09-11T00:12:15.932 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.gmgsay smithi111 running (8m) 74s ago 8m 15.7M - 18.2.0 dc2bc1663786 795e4ff0075c 2024-09-11T00:12:15.932 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.rucaba smithi111 running (8m) 74s ago 8m 15.7M - 18.2.0 dc2bc1663786 02885adac62c 2024-09-11T00:12:15.932 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.tcrqop smithi203 running (8m) 2m ago 8m 152M - 18.2.0 dc2bc1663786 4df492159bb4 2024-09-11T00:12:15.932 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.uqkbkn smithi203 running (8m) 2m ago 8m 15.2M - 18.2.0 dc2bc1663786 619aa58ea314 2024-09-11T00:12:15.932 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.ypucji smithi111 *:8443,9283,8765 running (4m) 74s ago 17m 519M - 19.3.0-4854-g8f219c47 589dd18248e4 07fa31f49618 2024-09-11T00:12:15.933 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi203.smuspl smithi203 *:8443,9283,8765 running (3m) 2m ago 14m 451M - 19.3.0-4854-g8f219c47 589dd18248e4 7e5a93a5ffa7 2024-09-11T00:12:15.933 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (17m) 74s ago 17m 59.1M 2048M 18.2.0 dc2bc1663786 2596322539fb 2024-09-11T00:12:15.933 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi203 smithi203 running (14m) 2m ago 14m 48.1M 2048M 18.2.0 dc2bc1663786 ff8eb7ca85ea 2024-09-11T00:12:15.933 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (2m) 74s ago 15m 7604k - 1.7.0 72c9c2088986 ec478ea14488 2024-09-11T00:12:15.933 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi203 smithi203 *:9100 running (2m) 2m ago 14m 2655k - 1.7.0 72c9c2088986 54d461cde1bc 2024-09-11T00:12:15.933 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (12m) 74s ago 12m 211M 1216M 18.2.0 dc2bc1663786 162b7249a591 2024-09-11T00:12:15.933 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (12m) 74s ago 12m 224M 1216M 18.2.0 dc2bc1663786 3614d95b1425 2024-09-11T00:12:15.933 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (11m) 74s ago 11m 183M 1216M 18.2.0 dc2bc1663786 db175d4b09b9 2024-09-11T00:12:15.933 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi203 running (11m) 2m ago 11m 242M 2240M 18.2.0 dc2bc1663786 60b1cef7a70d 2024-09-11T00:12:15.933 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi203 running (10m) 2m ago 10m 207M 2240M 18.2.0 dc2bc1663786 769c7942c42b 2024-09-11T00:12:15.933 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi203 running (10m) 2m ago 10m 190M 2240M 18.2.0 dc2bc1663786 6d824001d40c 2024-09-11T00:12:15.933 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (2m) 74s ago 14m 48.3M - 2.51.0 1d3b7f56885b 3e72ac10983d 2024-09-11T00:12:15.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.933+0000 7fb6be400700 1 -- 172.21.15.111:0/2143397125 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fb69c07a370 msgr2=0x7fb69c07c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:15.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.933+0000 7fb6be400700 1 --2- 172.21.15.111:0/2143397125 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fb69c07a370 0x7fb69c07c820 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4005b40 tx=0x7fb6a4005ad0 comp rx=0 tx=0).stop 2024-09-11T00:12:15.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.933+0000 7fb6be400700 1 -- 172.21.15.111:0/2143397125 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb6b8101330 msgr2=0x7fb6b80fef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:15.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.933+0000 7fb6be400700 1 --2- 172.21.15.111:0/2143397125 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb6b8101330 0x7fb6b80fef90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb6a800d8d0 tx=0x7fb6a800dc90 comp rx=0 tx=0).stop 2024-09-11T00:12:15.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.933+0000 7fb6be400700 1 -- 172.21.15.111:0/2143397125 shutdown_connections 2024-09-11T00:12:15.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.933+0000 7fb6be400700 1 --2- 172.21.15.111:0/2143397125 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fb69c07a370 0x7fb69c07c820 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:15.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.933+0000 7fb6be400700 1 --2- 172.21.15.111:0/2143397125 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb6b8101330 0x7fb6b80fef90 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:15.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.933+0000 7fb6be400700 1 --2- 172.21.15.111:0/2143397125 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb6b8101c40 0x7fb6b80ff4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:15.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.933+0000 7fb6be400700 1 -- 172.21.15.111:0/2143397125 >> 172.21.15.111:0/2143397125 conn(0x7fb6b80fabb0 msgr2=0x7fb6b81048f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:15.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.933+0000 7fb6be400700 1 -- 172.21.15.111:0/2143397125 shutdown_connections 2024-09-11T00:12:15.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:15.933+0000 7fb6be400700 1 -- 172.21.15.111:0/2143397125 wait complete. 2024-09-11T00:12:16.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.072+0000 7fd903200700 1 -- 172.21.15.111:0/3289935338 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd904100bb0 msgr2=0x7fd904104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:16.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.072+0000 7fd903200700 1 --2- 172.21.15.111:0/3289935338 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd904100bb0 0x7fd904104b80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009910 tx=0x7fd8f0009c20 comp rx=0 tx=0).stop 2024-09-11T00:12:16.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.072+0000 7fd903200700 1 -- 172.21.15.111:0/3289935338 shutdown_connections 2024-09-11T00:12:16.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.072+0000 7fd903200700 1 --2- 172.21.15.111:0/3289935338 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd904100bb0 0x7fd904104b80 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:16.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.072+0000 7fd903200700 1 --2- 172.21.15.111:0/3289935338 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd904100210 0x7fd9041005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:16.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.072+0000 7fd903200700 1 -- 172.21.15.111:0/3289935338 >> 172.21.15.111:0/3289935338 conn(0x7fd9040fbab0 msgr2=0x7fd9040fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:16.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.072+0000 7fd903200700 1 -- 172.21.15.111:0/3289935338 shutdown_connections 2024-09-11T00:12:16.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.072+0000 7fd903200700 1 -- 172.21.15.111:0/3289935338 wait complete. 2024-09-11T00:12:16.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.073+0000 7fd903200700 1 Processor -- start 2024-09-11T00:12:16.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.073+0000 7fd903200700 1 -- start start 2024-09-11T00:12:16.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.074+0000 7fd903200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd904100210 0x7fd904197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:16.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.074+0000 7fd903200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd904100bb0 0x7fd904198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:16.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.074+0000 7fd903200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd904198a40 con 0x7fd904100bb0 2024-09-11T00:12:16.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.074+0000 7fd903200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90419c7d0 con 0x7fd904100210 2024-09-11T00:12:16.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.074+0000 7fd901400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd904100bb0 0x7fd904198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:16.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.074+0000 7fd901400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd904100bb0 0x7fd904198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53552/0 (socket says 172.21.15.111:53552) 2024-09-11T00:12:16.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.074+0000 7fd901400700 1 -- 172.21.15.111:0/3872985861 learned_addr learned my addr 172.21.15.111:0/3872985861 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:12:16.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.074+0000 7fd901e00700 1 --2- 172.21.15.111:0/3872985861 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd904100210 0x7fd904197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:16.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.075+0000 7fd901400700 1 -- 172.21.15.111:0/3872985861 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd904100210 msgr2=0x7fd904197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:16.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.075+0000 7fd901400700 1 --2- 172.21.15.111:0/3872985861 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd904100210 0x7fd904197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:16.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.075+0000 7fd901400700 1 -- 172.21.15.111:0/3872985861 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f00095f0 con 0x7fd904100bb0 2024-09-11T00:12:16.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.075+0000 7fd901400700 1 --2- 172.21.15.111:0/3872985861 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd904100bb0 0x7fd904198360 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0005b40 tx=0x7fd8f000f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:16.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.075+0000 7fd8faa00700 1 -- 172.21.15.111:0/3872985861 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8f001d070 con 0x7fd904100bb0 2024-09-11T00:12:16.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.075+0000 7fd8faa00700 1 -- 172.21.15.111:0/3872985861 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd8f000bed0 con 0x7fd904100bb0 2024-09-11T00:12:16.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.075+0000 7fd903200700 1 -- 172.21.15.111:0/3872985861 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd90419ca50 con 0x7fd904100bb0 2024-09-11T00:12:16.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.075+0000 7fd8faa00700 1 -- 172.21.15.111:0/3872985861 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8f0017400 con 0x7fd904100bb0 2024-09-11T00:12:16.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.075+0000 7fd903200700 1 -- 172.21.15.111:0/3872985861 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd90419cf40 con 0x7fd904100bb0 2024-09-11T00:12:16.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.077+0000 7fd903200700 1 -- 172.21.15.111:0/3872985861 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd904104300 con 0x7fd904100bb0 2024-09-11T00:12:16.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.078+0000 7fd8faa00700 1 -- 172.21.15.111:0/3872985861 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 34) v1 ==== 102331+0+0 (secure 0 0 0) 0x7fd8f00050d0 con 0x7fd904100bb0 2024-09-11T00:12:16.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.079+0000 7fd8faa00700 1 --2- 172.21.15.111:0/3872985861 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fd8e807a370 0x7fd8e807c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:16.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.079+0000 7fd8faa00700 1 -- 172.21.15.111:0/3872985861 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fd8f009e080 con 0x7fd904100bb0 2024-09-11T00:12:16.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.079+0000 7fd901e00700 1 --2- 172.21.15.111:0/3872985861 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fd8e807a370 0x7fd8e807c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:16.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.080+0000 7fd901e00700 1 --2- 172.21.15.111:0/3872985861 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fd8e807a370 0x7fd8e807c820 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4009bf0 tx=0x7fd8f4009260 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:16.086 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.084+0000 7fd8faa00700 1 -- 172.21.15.111:0/3872985861 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7fd8f0061ca0 con 0x7fd904100bb0 2024-09-11T00:12:16.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.421+0000 7fd903200700 1 -- 172.21.15.111:0/3872985861 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd90404f2a0 con 0x7fd904100bb0 2024-09-11T00:12:16.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.422+0000 7fd8faa00700 1 -- 172.21.15.111:0/3872985861 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7fd8f0064dc0 con 0x7fd904100bb0 2024-09-11T00:12:16.424 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:12:16.424 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-11T00:12:16.424 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-11T00:12:16.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:12:16.424 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-11T00:12:16.425 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:12:16.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:12:16.425 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-11T00:12:16.425 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-11T00:12:16.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:12:16.425 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-11T00:12:16.425 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-11T00:12:16.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:12:16.426 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-11T00:12:16.426 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-11T00:12:16.426 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:12:16.426 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-11T00:12:16.426 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:12:16.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.424+0000 7fd903200700 1 -- 172.21.15.111:0/3872985861 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fd8e807a370 msgr2=0x7fd8e807c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:16.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.424+0000 7fd903200700 1 --2- 172.21.15.111:0/3872985861 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fd8e807a370 0x7fd8e807c820 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4009bf0 tx=0x7fd8f4009260 comp rx=0 tx=0).stop 2024-09-11T00:12:16.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.424+0000 7fd903200700 1 -- 172.21.15.111:0/3872985861 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd904100bb0 msgr2=0x7fd904198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:16.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.424+0000 7fd903200700 1 --2- 172.21.15.111:0/3872985861 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd904100bb0 0x7fd904198360 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0005b40 tx=0x7fd8f000f740 comp rx=0 tx=0).stop 2024-09-11T00:12:16.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.424+0000 7fd903200700 1 -- 172.21.15.111:0/3872985861 shutdown_connections 2024-09-11T00:12:16.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.424+0000 7fd903200700 1 --2- 172.21.15.111:0/3872985861 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fd8e807a370 0x7fd8e807c820 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:16.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.424+0000 7fd903200700 1 --2- 172.21.15.111:0/3872985861 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd904100210 0x7fd904197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:16.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.424+0000 7fd903200700 1 --2- 172.21.15.111:0/3872985861 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd904100bb0 0x7fd904198360 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:16.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.424+0000 7fd903200700 1 -- 172.21.15.111:0/3872985861 >> 172.21.15.111:0/3872985861 conn(0x7fd9040fbab0 msgr2=0x7fd9040fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:16.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.424+0000 7fd903200700 1 -- 172.21.15.111:0/3872985861 shutdown_connections 2024-09-11T00:12:16.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.424+0000 7fd903200700 1 -- 172.21.15.111:0/3872985861 wait complete. 2024-09-11T00:12:16.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:16 smithi203 ceph-mon[33225]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:12:16.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:16 smithi203 ceph-mon[33225]: pgmap v113: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:16.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:16 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:16.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:16 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:12:16.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:16 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:12:16.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:16 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:16.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:16 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-11T00:12:16.555 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:16 smithi111 ceph-mon[27539]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:12:16.555 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:16 smithi111 ceph-mon[27539]: pgmap v113: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:16.555 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:16 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:16.555 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:16 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T00:12:16.555 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:16 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:12:16.555 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:16 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:16.555 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:16 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-11T00:12:16.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.564+0000 7f4a6d600700 1 -- 172.21.15.111:0/3523493048 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a680730f0 msgr2=0x7f4a680734c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:16.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.564+0000 7f4a6d600700 1 --2- 172.21.15.111:0/3523493048 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a680730f0 0x7f4a680734c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4a58009910 tx=0x7f4a58009c20 comp rx=0 tx=0).stop 2024-09-11T00:12:16.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.564+0000 7f4a6d600700 1 -- 172.21.15.111:0/3523493048 shutdown_connections 2024-09-11T00:12:16.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.564+0000 7f4a6d600700 1 --2- 172.21.15.111:0/3523493048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a68073a00 0x7f4a68110c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:16.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.564+0000 7f4a6d600700 1 --2- 172.21.15.111:0/3523493048 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a680730f0 0x7f4a680734c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:16.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.564+0000 7f4a6d600700 1 -- 172.21.15.111:0/3523493048 >> 172.21.15.111:0/3523493048 conn(0x7f4a680fbc30 msgr2=0x7f4a680fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:16.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.564+0000 7f4a6d600700 1 -- 172.21.15.111:0/3523493048 shutdown_connections 2024-09-11T00:12:16.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.564+0000 7f4a6d600700 1 -- 172.21.15.111:0/3523493048 wait complete. 2024-09-11T00:12:16.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.565+0000 7f4a6d600700 1 Processor -- start 2024-09-11T00:12:16.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.565+0000 7f4a6d600700 1 -- start start 2024-09-11T00:12:16.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.566+0000 7f4a6d600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a680730f0 0x7f4a6819c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:16.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.566+0000 7f4a6d600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a68073a00 0x7f4a6819c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:16.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.566+0000 7f4a6d600700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6819cea0 con 0x7f4a680730f0 2024-09-11T00:12:16.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.566+0000 7f4a6d600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a681a0c30 con 0x7f4a68073a00 2024-09-11T00:12:16.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.566+0000 7f4a66a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a680730f0 0x7f4a6819c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:16.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.566+0000 7f4a66a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a680730f0 0x7f4a6819c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53566/0 (socket says 172.21.15.111:53566) 2024-09-11T00:12:16.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.566+0000 7f4a66a00700 1 -- 172.21.15.111:0/970490487 learned_addr learned my addr 172.21.15.111:0/970490487 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:12:16.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.566+0000 7f4a66000700 1 --2- 172.21.15.111:0/970490487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a68073a00 0x7f4a6819c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:16.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.566+0000 7f4a66a00700 1 -- 172.21.15.111:0/970490487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a68073a00 msgr2=0x7f4a6819c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:16.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.566+0000 7f4a66a00700 1 --2- 172.21.15.111:0/970490487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a68073a00 0x7f4a6819c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:16.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.566+0000 7f4a66a00700 1 -- 172.21.15.111:0/970490487 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a580095f0 con 0x7f4a680730f0 2024-09-11T00:12:16.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.567+0000 7f4a66a00700 1 --2- 172.21.15.111:0/970490487 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a680730f0 0x7f4a6819c280 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4a580092e0 tx=0x7f4a5800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:16.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.567+0000 7f4a5f400700 1 -- 172.21.15.111:0/970490487 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a5801d070 con 0x7f4a680730f0 2024-09-11T00:12:16.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.567+0000 7f4a6d600700 1 -- 172.21.15.111:0/970490487 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a681a0f10 con 0x7f4a680730f0 2024-09-11T00:12:16.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.567+0000 7f4a5f400700 1 -- 172.21.15.111:0/970490487 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4a58005e00 con 0x7f4a680730f0 2024-09-11T00:12:16.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.567+0000 7f4a5f400700 1 -- 172.21.15.111:0/970490487 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a58017400 con 0x7f4a680730f0 2024-09-11T00:12:16.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.567+0000 7f4a6d600700 1 -- 172.21.15.111:0/970490487 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a681a1460 con 0x7f4a680730f0 2024-09-11T00:12:16.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.569+0000 7f4a6d600700 1 -- 172.21.15.111:0/970490487 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a6810e3a0 con 0x7f4a680730f0 2024-09-11T00:12:16.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.569+0000 7f4a5f400700 1 -- 172.21.15.111:0/970490487 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 34) v1 ==== 102331+0+0 (secure 0 0 0) 0x7f4a5800f460 con 0x7f4a680730f0 2024-09-11T00:12:16.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.570+0000 7f4a5f400700 1 --2- 172.21.15.111:0/970490487 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f4a4c07a370 0x7f4a4c07c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:16.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.571+0000 7f4a5f400700 1 -- 172.21.15.111:0/970490487 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f4a5809e280 con 0x7f4a680730f0 2024-09-11T00:12:16.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.571+0000 7f4a66000700 1 --2- 172.21.15.111:0/970490487 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f4a4c07a370 0x7f4a4c07c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:16.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.571+0000 7f4a66000700 1 --2- 172.21.15.111:0/970490487 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f4a4c07a370 0x7f4a4c07c820 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4a54005950 tx=0x7f4a540058e0 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:16.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.575+0000 7f4a5f400700 1 -- 172.21.15.111:0/970490487 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7f4a58061e00 con 0x7f4a680730f0 2024-09-11T00:12:16.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.854+0000 7f4a6d600700 1 -- 172.21.15.111:0/970490487 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4a681a1740 con 0x7f4a680730f0 2024-09-11T00:12:16.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.854+0000 7f4a5f400700 1 -- 172.21.15.111:0/970490487 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1830 (secure 0 0 0) 0x7f4a58064f20 con 0x7f4a680730f0 2024-09-11T00:12:16.857 INFO:teuthology.orchestra.run.smithi111.stdout:e15 2024-09-11T00:12:16.857 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T00:12:16.857 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:12:16.857 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-11T00:12:16.857 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:12:16.857 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-11T00:12:16.857 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-11T00:12:16.857 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 14 2024-09-11T00:12:16.857 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-11T00:12:16.857 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-11T00:03:47.950356+0000 2024-09-11T00:12:16.858 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-11T00:04:06.275905+0000 2024-09-11T00:12:16.858 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-11T00:12:16.858 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-11T00:12:16.858 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-11T00:12:16.858 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-11T00:12:16.858 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-11T00:12:16.858 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-11T00:12:16.858 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-11T00:12:16.858 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 47 2024-09-11T00:12:16.858 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:12:16.858 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-11T00:12:16.858 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-11T00:12:16.858 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=24363} 2024-09-11T00:12:16.858 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-11T00:12:16.859 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-11T00:12:16.859 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-11T00:12:16.859 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-11T00:12:16.859 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-11T00:12:16.859 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data enabled 2024-09-11T00:12:16.859 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-11T00:12:16.859 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-11T00:12:16.859 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 1 2024-09-11T00:12:16.859 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.tcrqop{0:24363} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.203:6824/3082736449,v1:172.21.15.203:6825/3082736449] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:12:16.859 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:12:16.859 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:12:16.859 INFO:teuthology.orchestra.run.smithi111.stdout:Standby daemons: 2024-09-11T00:12:16.860 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:12:16.860 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.rucaba{-1:14554} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6828/2045133285,v1:172.21.15.111:6829/2045133285] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:12:16.860 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.gmgsay{-1:14566} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.111:6826/1122545830,v1:172.21.15.111:6827/1122545830] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:12:16.860 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.uqkbkn{-1:24379} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.203:6826/695613114,v1:172.21.15.203:6827/695613114] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:12:16.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.858+0000 7f4a6d600700 1 -- 172.21.15.111:0/970490487 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f4a4c07a370 msgr2=0x7f4a4c07c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:16.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.858+0000 7f4a6d600700 1 --2- 172.21.15.111:0/970490487 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f4a4c07a370 0x7f4a4c07c820 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4a54005950 tx=0x7f4a540058e0 comp rx=0 tx=0).stop 2024-09-11T00:12:16.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.858+0000 7f4a6d600700 1 -- 172.21.15.111:0/970490487 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a680730f0 msgr2=0x7f4a6819c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:16.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.858+0000 7f4a6d600700 1 --2- 172.21.15.111:0/970490487 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a680730f0 0x7f4a6819c280 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4a580092e0 tx=0x7f4a5800be20 comp rx=0 tx=0).stop 2024-09-11T00:12:16.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.858+0000 7f4a6d600700 1 -- 172.21.15.111:0/970490487 shutdown_connections 2024-09-11T00:12:16.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.858+0000 7f4a6d600700 1 --2- 172.21.15.111:0/970490487 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7f4a4c07a370 0x7f4a4c07c820 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:16.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.858+0000 7f4a6d600700 1 --2- 172.21.15.111:0/970490487 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a680730f0 0x7f4a6819c280 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:16.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.858+0000 7f4a6d600700 1 --2- 172.21.15.111:0/970490487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a68073a00 0x7f4a6819c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:16.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.858+0000 7f4a6d600700 1 -- 172.21.15.111:0/970490487 >> 172.21.15.111:0/970490487 conn(0x7f4a680fbc30 msgr2=0x7f4a68102730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:16.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.859+0000 7f4a6d600700 1 -- 172.21.15.111:0/970490487 shutdown_connections 2024-09-11T00:12:16.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.859+0000 7f4a6d600700 1 -- 172.21.15.111:0/970490487 wait complete. 2024-09-11T00:12:16.862 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 15 2024-09-11T00:12:17.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.999+0000 7ff132400700 1 -- 172.21.15.111:0/1843867753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff12c102fb0 msgr2=0x7ff12c106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:17.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.999+0000 7ff132400700 1 --2- 172.21.15.111:0/1843867753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff12c102fb0 0x7ff12c106f80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff114009910 tx=0x7ff114009c20 comp rx=0 tx=0).stop 2024-09-11T00:12:17.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.999+0000 7ff132400700 1 -- 172.21.15.111:0/1843867753 shutdown_connections 2024-09-11T00:12:17.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.999+0000 7ff132400700 1 --2- 172.21.15.111:0/1843867753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff12c102fb0 0x7ff12c106f80 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:17.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.999+0000 7ff132400700 1 --2- 172.21.15.111:0/1843867753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff12c102610 0x7ff12c1029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:17.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.999+0000 7ff132400700 1 -- 172.21.15.111:0/1843867753 >> 172.21.15.111:0/1843867753 conn(0x7ff12c0fde90 msgr2=0x7ff12c1002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:17.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.999+0000 7ff132400700 1 -- 172.21.15.111:0/1843867753 shutdown_connections 2024-09-11T00:12:17.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:16.999+0000 7ff132400700 1 -- 172.21.15.111:0/1843867753 wait complete. 2024-09-11T00:12:17.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.000+0000 7ff132400700 1 Processor -- start 2024-09-11T00:12:17.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.000+0000 7ff132400700 1 -- start start 2024-09-11T00:12:17.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.000+0000 7ff132400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff12c102610 0x7ff12c197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:17.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.000+0000 7ff132400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff12c102fb0 0x7ff12c198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:17.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.000+0000 7ff132400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c198c00 con 0x7ff12c102610 2024-09-11T00:12:17.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.000+0000 7ff132400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c19c990 con 0x7ff12c102fb0 2024-09-11T00:12:17.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.001+0000 7ff12b400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff12c102610 0x7ff12c197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:17.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.001+0000 7ff12b400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff12c102610 0x7ff12c197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53588/0 (socket says 172.21.15.111:53588) 2024-09-11T00:12:17.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.001+0000 7ff12b400700 1 -- 172.21.15.111:0/26032729 learned_addr learned my addr 172.21.15.111:0/26032729 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:12:17.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.001+0000 7ff12b400700 1 -- 172.21.15.111:0/26032729 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff12c102fb0 msgr2=0x7ff12c198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:17.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.001+0000 7ff12b400700 1 --2- 172.21.15.111:0/26032729 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff12c102fb0 0x7ff12c198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:17.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.001+0000 7ff12b400700 1 -- 172.21.15.111:0/26032729 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1140095f0 con 0x7ff12c102610 2024-09-11T00:12:17.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.001+0000 7ff12b400700 1 --2- 172.21.15.111:0/26032729 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff12c102610 0x7ff12c197fe0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff11c00d8d0 tx=0x7ff11c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:17.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.002+0000 7ff128c00700 1 -- 172.21.15.111:0/26032729 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff11c009940 con 0x7ff12c102610 2024-09-11T00:12:17.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.002+0000 7ff128c00700 1 -- 172.21.15.111:0/26032729 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff11c010460 con 0x7ff12c102610 2024-09-11T00:12:17.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.002+0000 7ff132400700 1 -- 172.21.15.111:0/26032729 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff12c19cc70 con 0x7ff12c102610 2024-09-11T00:12:17.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.002+0000 7ff128c00700 1 -- 172.21.15.111:0/26032729 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff11c00f5f0 con 0x7ff12c102610 2024-09-11T00:12:17.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.002+0000 7ff132400700 1 -- 172.21.15.111:0/26032729 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff12c19d1c0 con 0x7ff12c102610 2024-09-11T00:12:17.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.003+0000 7ff132400700 1 -- 172.21.15.111:0/26032729 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff12c04ea50 con 0x7ff12c102610 2024-09-11T00:12:17.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.004+0000 7ff128c00700 1 -- 172.21.15.111:0/26032729 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 34) v1 ==== 102331+0+0 (secure 0 0 0) 0x7ff11c0105d0 con 0x7ff12c102610 2024-09-11T00:12:17.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.005+0000 7ff128c00700 1 --2- 172.21.15.111:0/26032729 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7ff11007a370 0x7ff11007c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:17.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.006+0000 7ff128c00700 1 -- 172.21.15.111:0/26032729 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7ff11c09ccf0 con 0x7ff12c102610 2024-09-11T00:12:17.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.006+0000 7ff123e00700 1 --2- 172.21.15.111:0/26032729 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7ff11007a370 0x7ff11007c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:17.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.006+0000 7ff123e00700 1 --2- 172.21.15.111:0/26032729 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7ff11007a370 0x7ff11007c820 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff11400b5c0 tx=0x7ff114005960 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:17.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.010+0000 7ff128c00700 1 -- 172.21.15.111:0/26032729 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7ff11c0608f0 con 0x7ff12c102610 2024-09-11T00:12:17.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.250+0000 7ff132400700 1 -- 172.21.15.111:0/26032729 --> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff12c19d6d0 con 0x7ff11007a370 2024-09-11T00:12:17.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.251+0000 7ff128c00700 1 -- 172.21.15.111:0/26032729 <== mgr.14744 v2:172.21.15.111:6800/3952658086 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7ff12c19d6d0 con 0x7ff11007a370 2024-09-11T00:12:17.253 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:12:17.253 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e", 2024-09-11T00:12:17.253 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-11T00:12:17.253 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-11T00:12:17.253 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-11T00:12:17.254 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr" 2024-09-11T00:12:17.254 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-11T00:12:17.254 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "2/23 daemons upgraded", 2024-09-11T00:12:17.254 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading mon daemons", 2024-09-11T00:12:17.254 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-11T00:12:17.254 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:12:17.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.254+0000 7ff132400700 1 -- 172.21.15.111:0/26032729 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7ff11007a370 msgr2=0x7ff11007c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:17.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.254+0000 7ff132400700 1 --2- 172.21.15.111:0/26032729 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7ff11007a370 0x7ff11007c820 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff11400b5c0 tx=0x7ff114005960 comp rx=0 tx=0).stop 2024-09-11T00:12:17.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.254+0000 7ff132400700 1 -- 172.21.15.111:0/26032729 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff12c102610 msgr2=0x7ff12c197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:17.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.254+0000 7ff132400700 1 --2- 172.21.15.111:0/26032729 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff12c102610 0x7ff12c197fe0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff11c00d8d0 tx=0x7ff11c00dc90 comp rx=0 tx=0).stop 2024-09-11T00:12:17.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.254+0000 7ff132400700 1 -- 172.21.15.111:0/26032729 shutdown_connections 2024-09-11T00:12:17.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.254+0000 7ff132400700 1 --2- 172.21.15.111:0/26032729 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7ff11007a370 0x7ff11007c820 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:17.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.254+0000 7ff132400700 1 --2- 172.21.15.111:0/26032729 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff12c102610 0x7ff12c197fe0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:17.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.254+0000 7ff132400700 1 --2- 172.21.15.111:0/26032729 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff12c102fb0 0x7ff12c198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:17.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.254+0000 7ff132400700 1 -- 172.21.15.111:0/26032729 >> 172.21.15.111:0/26032729 conn(0x7ff12c0fde90 msgr2=0x7ff12c0ff460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:17.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.254+0000 7ff132400700 1 -- 172.21.15.111:0/26032729 shutdown_connections 2024-09-11T00:12:17.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.254+0000 7ff132400700 1 -- 172.21.15.111:0/26032729 wait complete. 2024-09-11T00:12:17.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.400+0000 7fb4dbc00700 1 -- 172.21.15.111:0/2501094206 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb4d4073070 msgr2=0x7fb4d4073440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:17.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.400+0000 7fb4dbc00700 1 --2- 172.21.15.111:0/2501094206 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb4d4073070 0x7fb4d4073440 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8009940 tx=0x7fb4c8009c50 comp rx=0 tx=0).stop 2024-09-11T00:12:17.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.400+0000 7fb4dbc00700 1 -- 172.21.15.111:0/2501094206 shutdown_connections 2024-09-11T00:12:17.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.400+0000 7fb4dbc00700 1 --2- 172.21.15.111:0/2501094206 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb4d4073980 0x7fb4d410c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:17.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.400+0000 7fb4dbc00700 1 --2- 172.21.15.111:0/2501094206 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb4d4073070 0x7fb4d4073440 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:17.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.401+0000 7fb4dbc00700 1 -- 172.21.15.111:0/2501094206 >> 172.21.15.111:0/2501094206 conn(0x7fb4d40fbc90 msgr2=0x7fb4d40fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:17.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.401+0000 7fb4dbc00700 1 -- 172.21.15.111:0/2501094206 shutdown_connections 2024-09-11T00:12:17.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.401+0000 7fb4dbc00700 1 -- 172.21.15.111:0/2501094206 wait complete. 2024-09-11T00:12:17.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.402+0000 7fb4dbc00700 1 Processor -- start 2024-09-11T00:12:17.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.402+0000 7fb4dbc00700 1 -- start start 2024-09-11T00:12:17.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.402+0000 7fb4dbc00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb4d4073070 0x7fb4d4197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:17.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.402+0000 7fb4dbc00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb4d4073980 0x7fb4d41984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:17.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.402+0000 7fb4dbc00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d4198af0 con 0x7fb4d4073070 2024-09-11T00:12:17.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.402+0000 7fb4dbc00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d4198c30 con 0x7fb4d4073980 2024-09-11T00:12:17.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.402+0000 7fb4d9200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb4d4073070 0x7fb4d4197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:17.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.402+0000 7fb4d9200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb4d4073070 0x7fb4d4197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53604/0 (socket says 172.21.15.111:53604) 2024-09-11T00:12:17.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.402+0000 7fb4d9200700 1 -- 172.21.15.111:0/85687097 learned_addr learned my addr 172.21.15.111:0/85687097 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:12:17.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.403+0000 7fb4d3e00700 1 --2- 172.21.15.111:0/85687097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb4d4073980 0x7fb4d41984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:17.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.403+0000 7fb4d9200700 1 -- 172.21.15.111:0/85687097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb4d4073980 msgr2=0x7fb4d41984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:17.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.403+0000 7fb4d9200700 1 --2- 172.21.15.111:0/85687097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb4d4073980 0x7fb4d41984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:17.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.403+0000 7fb4d9200700 1 -- 172.21.15.111:0/85687097 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c80095f0 con 0x7fb4d4073070 2024-09-11T00:12:17.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.403+0000 7fb4d9200700 1 --2- 172.21.15.111:0/85687097 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb4d4073070 0x7fb4d4197f60 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb4c800b870 tx=0x7fb4c80055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:17.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.403+0000 7fb4d1600700 1 -- 172.21.15.111:0/85687097 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4c801d070 con 0x7fb4d4073070 2024-09-11T00:12:17.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.404+0000 7fb4dbc00700 1 -- 172.21.15.111:0/85687097 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d419ca20 con 0x7fb4d4073070 2024-09-11T00:12:17.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.404+0000 7fb4d1600700 1 -- 172.21.15.111:0/85687097 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb4c8005e00 con 0x7fb4d4073070 2024-09-11T00:12:17.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.404+0000 7fb4d1600700 1 -- 172.21.15.111:0/85687097 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4c8021410 con 0x7fb4d4073070 2024-09-11T00:12:17.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.404+0000 7fb4dbc00700 1 -- 172.21.15.111:0/85687097 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d419cf10 con 0x7fb4d4073070 2024-09-11T00:12:17.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.405+0000 7fb4dbc00700 1 -- 172.21.15.111:0/85687097 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4d404ea50 con 0x7fb4d4073070 2024-09-11T00:12:17.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.406+0000 7fb4d1600700 1 -- 172.21.15.111:0/85687097 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 34) v1 ==== 102331+0+0 (secure 0 0 0) 0x7fb4c800f880 con 0x7fb4d4073070 2024-09-11T00:12:17.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.407+0000 7fb4d1600700 1 --2- 172.21.15.111:0/85687097 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fb4bc07a370 0x7fb4bc07c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:17.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.407+0000 7fb4d1600700 1 -- 172.21.15.111:0/85687097 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fb4c809df70 con 0x7fb4d4073070 2024-09-11T00:12:17.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.407+0000 7fb4d3e00700 1 --2- 172.21.15.111:0/85687097 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fb4bc07a370 0x7fb4bc07c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:17.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.408+0000 7fb4d3e00700 1 --2- 172.21.15.111:0/85687097 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fb4bc07a370 0x7fb4bc07c820 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4199580 tx=0x7fb4c000a380 comp rx=0 tx=0).ready entity=mgr.14744 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:17.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.412+0000 7fb4d1600700 1 -- 172.21.15.111:0/85687097 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+193461 (secure 0 0 0) 0x7fb4c80d43d0 con 0x7fb4d4073070 2024-09-11T00:12:17.586 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:17 smithi111 ceph-mon[27539]: from='client.14944 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:12:17.586 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:17 smithi111 ceph-mon[27539]: Upgrade: Target is version 19.3.0-4854-g8f219c47 (squid) 2024-09-11T00:12:17.586 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:17 smithi111 ceph-mon[27539]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, digests ['quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e'] 2024-09-11T00:12:17.586 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:17 smithi111 ceph-mon[27539]: Upgrade: Setting container_image for all mgr 2024-09-11T00:12:17.586 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:17 smithi111 ceph-mon[27539]: from='client.14948 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:12:17.586 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:17 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/3872985861' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:12:17.586 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:17 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/970490487' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-11T00:12:17.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.733+0000 7fb4dbc00700 1 -- 172.21.15.111:0/85687097 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb4d41992c0 con 0x7fb4d4073070 2024-09-11T00:12:17.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.733+0000 7fb4d1600700 1 -- 172.21.15.111:0/85687097 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fb4c8061b90 con 0x7fb4d4073070 2024-09-11T00:12:17.736 INFO:teuthology.orchestra.run.smithi111.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-11T00:12:17.736 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-11T00:12:17.736 INFO:teuthology.orchestra.run.smithi111.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-11T00:12:17.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.736+0000 7fb4dbc00700 1 -- 172.21.15.111:0/85687097 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fb4bc07a370 msgr2=0x7fb4bc07c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:17.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.736+0000 7fb4dbc00700 1 --2- 172.21.15.111:0/85687097 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fb4bc07a370 0x7fb4bc07c820 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4199580 tx=0x7fb4c000a380 comp rx=0 tx=0).stop 2024-09-11T00:12:17.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.736+0000 7fb4dbc00700 1 -- 172.21.15.111:0/85687097 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb4d4073070 msgr2=0x7fb4d4197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:17.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.736+0000 7fb4dbc00700 1 --2- 172.21.15.111:0/85687097 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb4d4073070 0x7fb4d4197f60 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb4c800b870 tx=0x7fb4c80055f0 comp rx=0 tx=0).stop 2024-09-11T00:12:17.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.736+0000 7fb4dbc00700 1 -- 172.21.15.111:0/85687097 shutdown_connections 2024-09-11T00:12:17.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.736+0000 7fb4dbc00700 1 --2- 172.21.15.111:0/85687097 >> [v2:172.21.15.111:6800/3952658086,v1:172.21.15.111:6801/3952658086] conn(0x7fb4bc07a370 0x7fb4bc07c820 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:17.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.736+0000 7fb4dbc00700 1 --2- 172.21.15.111:0/85687097 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb4d4073070 0x7fb4d4197f60 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:17.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.736+0000 7fb4dbc00700 1 --2- 172.21.15.111:0/85687097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb4d4073980 0x7fb4d41984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:17.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.736+0000 7fb4dbc00700 1 -- 172.21.15.111:0/85687097 >> 172.21.15.111:0/85687097 conn(0x7fb4d40fbc90 msgr2=0x7fb4d4106d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:17.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.736+0000 7fb4dbc00700 1 -- 172.21.15.111:0/85687097 shutdown_connections 2024-09-11T00:12:17.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:17.736+0000 7fb4dbc00700 1 -- 172.21.15.111:0/85687097 wait complete. 2024-09-11T00:12:17.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:17 smithi203 ceph-mon[33225]: from='client.14944 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:12:17.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:17 smithi203 ceph-mon[33225]: Upgrade: Target is version 19.3.0-4854-g8f219c47 (squid) 2024-09-11T00:12:17.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:17 smithi203 ceph-mon[33225]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, digests ['quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e'] 2024-09-11T00:12:17.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:17 smithi203 ceph-mon[33225]: Upgrade: Setting container_image for all mgr 2024-09-11T00:12:17.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:17 smithi203 ceph-mon[33225]: from='client.14948 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:12:17.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:17 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/3872985861' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-11T00:12:17.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:17 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/970490487' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-11T00:12:18.472 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:18 smithi111 ceph-mon[27539]: pgmap v114: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:18.473 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:18 smithi111 ceph-mon[27539]: from='client.14960 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:12:18.473 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:18 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:18.473 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:18 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T00:12:18.473 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:18 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T00:12:18.473 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:18 smithi111 ceph-mon[27539]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:12:18.473 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:18 smithi111 ceph-mon[27539]: from='client.? 172.21.15.111:0/85687097' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-11T00:12:18.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:18 smithi203 ceph-mon[33225]: pgmap v114: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:18.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:18 smithi203 ceph-mon[33225]: from='client.14960 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:12:18.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:18 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:18.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:18 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T00:12:18.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:18 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T00:12:18.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:18 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T00:12:18.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:18 smithi203 ceph-mon[33225]: from='client.? 172.21.15.111:0/85687097' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-11T00:12:19.527 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:19 smithi111 ceph-mon[27539]: Upgrade: Updating mon.smithi111 2024-09-11T00:12:19.527 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:19 smithi111 ceph-mon[27539]: Deploying daemon mon.smithi111 on smithi111 2024-09-11T00:12:19.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:19 smithi203 ceph-mon[33225]: Upgrade: Updating mon.smithi111 2024-09-11T00:12:19.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:19 smithi203 ceph-mon[33225]: Deploying daemon mon.smithi111 on smithi111 2024-09-11T00:12:19.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:19 smithi111 systemd[1]: Stopping Ceph mon.smithi111 for 03107fbe-6fd0-11ef-bcea-c7b262605968... 2024-09-11T00:12:20.242 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:19 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi111[27535]: 2024-09-11T00:12:19.974+0000 7fbe0d600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi111 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:12:20.242 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:19 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi111[27535]: 2024-09-11T00:12:19.974+0000 7fbe0d600700 -1 mon.smithi111@0(leader) e2 *** Got Signal Terminated *** 2024-09-11T00:12:20.493 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:20 smithi111 podman[90673]: 2024-09-11 00:12:20.24151657 +0000 UTC m=+0.388634037 container died 2596322539fbebec35395882f8c23c49273317b131e36ae9e25152fddf6858a9 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi111, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0, RELEASE=HEAD) 2024-09-11T00:12:20.890 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:20 smithi111 podman[90673]: 2024-09-11 00:12:20.671094421 +0000 UTC m=+0.818211875 container cleanup 2596322539fbebec35395882f8c23c49273317b131e36ae9e25152fddf6858a9 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi111, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, RELEASE=HEAD, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux ) 2024-09-11T00:12:20.890 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:20 smithi111 bash[90673]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi111 2024-09-11T00:12:21.141 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:20 smithi111 podman[90684]: 2024-09-11 00:12:20.888992307 +0000 UTC m=+0.636399790 container remove 2596322539fbebec35395882f8c23c49273317b131e36ae9e25152fddf6858a9 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi111, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.0, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, RELEASE=HEAD) 2024-09-11T00:12:21.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:21 smithi111 systemd[1]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@mon.smithi111.service: Deactivated successfully. 2024-09-11T00:12:21.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:21 smithi111 systemd[1]: Stopped Ceph mon.smithi111 for 03107fbe-6fd0-11ef-bcea-c7b262605968. 2024-09-11T00:12:21.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:21 smithi111 systemd[1]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@mon.smithi111.service: Consumed 20.746s CPU time. 2024-09-11T00:12:21.785 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:21 smithi111 systemd[1]: Starting Ceph mon.smithi111 for 03107fbe-6fd0-11ef-bcea-c7b262605968... 2024-09-11T00:12:22.044 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:21 smithi111 podman[90823]: 2024-09-11 00:12:21.687983497 +0000 UTC m=+0.026500400 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:12:22.044 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:21 smithi111 podman[90823]: 2024-09-11 00:12:21.831946533 +0000 UTC m=+0.170463406 container create 3c29c070a612fa5bacaa84d5b13e4acaba33e812f503dab77fd20141913f5a6a (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi111, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-11T00:12:22.044 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 podman[90823]: 2024-09-11 00:12:22.043001582 +0000 UTC m=+0.381518476 container init 3c29c070a612fa5bacaa84d5b13e4acaba33e812f503dab77fd20141913f5a6a (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi111, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True) 2024-09-11T00:12:22.304 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 podman[90823]: 2024-09-11 00:12:22.049767947 +0000 UTC m=+0.388284820 container start 3c29c070a612fa5bacaa84d5b13e4acaba33e812f503dab77fd20141913f5a6a (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi111, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:12:22.304 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: set uid:gid to 167:167 (ceph:ceph) 2024-09-11T00:12:22.304 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev), process ceph-mon, pid 2 2024-09-11T00:12:22.304 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: pidfile_write: ignore empty --pid-file 2024-09-11T00:12:22.305 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: load: jerasure load: lrc 2024-09-11T00:12:22.305 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: RocksDB version: 7.9.2 2024-09-11T00:12:22.305 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Git sha 0 2024-09-11T00:12:22.305 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Compile date 2024-09-10 08:02:51 2024-09-11T00:12:22.305 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: DB SUMMARY 2024-09-11T00:12:22.305 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: DB Session ID: LRQD6FY8GCVB5AMG8VXY 2024-09-11T00:12:22.305 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: CURRENT file: CURRENT 2024-09-11T00:12:22.305 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: IDENTITY file: IDENTITY 2024-09-11T00:12:22.305 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1746 Bytes 2024-09-11T00:12:22.305 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi111/store.db dir, Total Num: 1, files: 000035.sst 2024-09-11T00:12:22.305 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi111/store.db: 000033.log size: 718010 ; 2024-09-11T00:12:22.305 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.error_if_exists: 0 2024-09-11T00:12:22.305 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.create_if_missing: 0 2024-09-11T00:12:22.306 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.paranoid_checks: 1 2024-09-11T00:12:22.306 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-11T00:12:22.306 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-11T00:12:22.306 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-11T00:12:22.306 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.env: 0x55e92c5bd180 2024-09-11T00:12:22.306 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.fs: PosixFileSystem 2024-09-11T00:12:22.306 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.info_log: 0x55e944f978c0 2024-09-11T00:12:22.306 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.max_file_opening_threads: 16 2024-09-11T00:12:22.306 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.statistics: (nil) 2024-09-11T00:12:22.306 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.use_fsync: 0 2024-09-11T00:12:22.306 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.max_log_file_size: 0 2024-09-11T00:12:22.306 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-11T00:12:22.306 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-11T00:12:22.307 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.keep_log_file_num: 1000 2024-09-11T00:12:22.307 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.recycle_log_file_num: 0 2024-09-11T00:12:22.307 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.allow_fallocate: 1 2024-09-11T00:12:22.308 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.allow_mmap_reads: 0 2024-09-11T00:12:22.308 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.allow_mmap_writes: 0 2024-09-11T00:12:22.309 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.use_direct_reads: 0 2024-09-11T00:12:22.309 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-11T00:12:22.309 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.create_missing_column_families: 0 2024-09-11T00:12:22.309 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.db_log_dir: 2024-09-11T00:12:22.309 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.wal_dir: 2024-09-11T00:12:22.309 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-11T00:12:22.309 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-11T00:12:22.309 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-11T00:12:22.309 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-11T00:12:22.309 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-11T00:12:22.309 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-11T00:12:22.310 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.advise_random_on_open: 1 2024-09-11T00:12:22.310 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.db_write_buffer_size: 0 2024-09-11T00:12:22.310 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.write_buffer_manager: 0x55e944f9bb80 2024-09-11T00:12:22.310 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-11T00:12:22.310 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-11T00:12:22.310 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-11T00:12:22.310 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.rate_limiter: (nil) 2024-09-11T00:12:22.310 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-11T00:12:22.310 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.wal_recovery_mode: 2 2024-09-11T00:12:22.310 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.enable_thread_tracking: 0 2024-09-11T00:12:22.310 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.enable_pipelined_write: 0 2024-09-11T00:12:22.311 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.unordered_write: 0 2024-09-11T00:12:22.311 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-11T00:12:22.311 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-11T00:12:22.311 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-11T00:12:22.311 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-11T00:12:22.311 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.row_cache: None 2024-09-11T00:12:22.311 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.wal_filter: None 2024-09-11T00:12:22.311 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-11T00:12:22.311 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.allow_ingest_behind: 0 2024-09-11T00:12:22.311 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.two_write_queues: 0 2024-09-11T00:12:22.311 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.manual_wal_flush: 0 2024-09-11T00:12:22.312 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.wal_compression: 0 2024-09-11T00:12:22.312 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.atomic_flush: 0 2024-09-11T00:12:22.312 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-11T00:12:22.312 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-11T00:12:22.312 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-11T00:12:22.312 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.log_readahead_size: 0 2024-09-11T00:12:22.312 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-11T00:12:22.312 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.best_efforts_recovery: 0 2024-09-11T00:12:22.312 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-11T00:12:22.312 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-11T00:12:22.312 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.allow_data_in_errors: 0 2024-09-11T00:12:22.312 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.db_host_id: __hostname__ 2024-09-11T00:12:22.312 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-11T00:12:22.313 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.max_background_jobs: 2 2024-09-11T00:12:22.313 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.max_background_compactions: -1 2024-09-11T00:12:22.313 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.max_subcompactions: 1 2024-09-11T00:12:22.313 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-11T00:12:22.313 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-11T00:12:22.313 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-11T00:12:22.313 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.max_total_wal_size: 0 2024-09-11T00:12:22.313 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-11T00:12:22.313 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-11T00:12:22.313 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-11T00:12:22.313 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-11T00:12:22.313 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.max_open_files: -1 2024-09-11T00:12:22.313 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.bytes_per_sync: 0 2024-09-11T00:12:22.314 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-11T00:12:22.314 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-11T00:12:22.314 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.compaction_readahead_size: 0 2024-09-11T00:12:22.314 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.max_background_flushes: -1 2024-09-11T00:12:22.314 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Compression algorithms supported: 2024-09-11T00:12:22.314 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: kZSTD supported: 0 2024-09-11T00:12:22.314 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: kXpressCompression supported: 0 2024-09-11T00:12:22.314 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: kBZip2Compression supported: 0 2024-09-11T00:12:22.314 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-11T00:12:22.314 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: kLZ4Compression supported: 1 2024-09-11T00:12:22.314 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: kZlibCompression supported: 1 2024-09-11T00:12:22.314 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: kLZ4HCCompression supported: 1 2024-09-11T00:12:22.314 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: kSnappyCompression supported: 1 2024-09-11T00:12:22.314 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-11T00:12:22.315 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-11T00:12:22.315 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi111/store.db/MANIFEST-000015 2024-09-11T00:12:22.315 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-11T00:12:22.315 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-11T00:12:22.315 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.merge_operator: 2024-09-11T00:12:22.315 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.compaction_filter: None 2024-09-11T00:12:22.315 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.compaction_filter_factory: None 2024-09-11T00:12:22.315 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.sst_partitioner_factory: None 2024-09-11T00:12:22.315 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-11T00:12:22.315 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-11T00:12:22.315 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e944f97500) 2024-09-11T00:12:22.315 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: cache_index_and_filter_blocks: 1 2024-09-11T00:12:22.316 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-11T00:12:22.316 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-11T00:12:22.316 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: pin_top_level_index_and_filter: 1 2024-09-11T00:12:22.316 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: index_type: 0 2024-09-11T00:12:22.316 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: data_block_index_type: 0 2024-09-11T00:12:22.316 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: index_shortening: 1 2024-09-11T00:12:22.316 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-11T00:12:22.316 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: checksum: 4 2024-09-11T00:12:22.316 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: no_block_cache: 0 2024-09-11T00:12:22.316 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_cache: 0x55e944f8b610 2024-09-11T00:12:22.316 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_cache_name: BinnedLRUCache 2024-09-11T00:12:22.316 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_cache_options: 2024-09-11T00:12:22.316 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: capacity : 536870912 2024-09-11T00:12:22.316 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: num_shard_bits : 4 2024-09-11T00:12:22.317 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: strict_capacity_limit : 0 2024-09-11T00:12:22.317 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: high_pri_pool_ratio: 0.000 2024-09-11T00:12:22.317 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_cache_compressed: (nil) 2024-09-11T00:12:22.317 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: persistent_cache: (nil) 2024-09-11T00:12:22.317 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_size: 4096 2024-09-11T00:12:22.317 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_size_deviation: 10 2024-09-11T00:12:22.317 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_restart_interval: 16 2024-09-11T00:12:22.317 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: index_block_restart_interval: 1 2024-09-11T00:12:22.317 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: metadata_block_size: 4096 2024-09-11T00:12:22.317 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: partition_filters: 0 2024-09-11T00:12:22.317 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: use_delta_encoding: 1 2024-09-11T00:12:22.317 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: filter_policy: bloomfilter 2024-09-11T00:12:22.318 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: whole_key_filtering: 1 2024-09-11T00:12:22.318 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: verify_compression: 0 2024-09-11T00:12:22.318 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: read_amp_bytes_per_bit: 0 2024-09-11T00:12:22.318 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: format_version: 5 2024-09-11T00:12:22.318 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: enable_index_compression: 1 2024-09-11T00:12:22.318 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_align: 0 2024-09-11T00:12:22.318 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: max_auto_readahead_size: 262144 2024-09-11T00:12:22.318 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: prepopulate_block_cache: 0 2024-09-11T00:12:22.318 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: initial_auto_readahead_size: 8192 2024-09-11T00:12:22.318 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: num_file_reads_for_auto_readahead: 2 2024-09-11T00:12:22.318 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.write_buffer_size: 33554432 2024-09-11T00:12:22.318 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.max_write_buffer_number: 2 2024-09-11T00:12:22.318 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.compression: NoCompression 2024-09-11T00:12:22.319 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.bottommost_compression: Disabled 2024-09-11T00:12:22.319 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.prefix_extractor: nullptr 2024-09-11T00:12:22.319 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-11T00:12:22.319 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.num_levels: 7 2024-09-11T00:12:22.319 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-11T00:12:22.319 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-11T00:12:22.319 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-11T00:12:22.319 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-11T00:12:22.319 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-11T00:12:22.319 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-11T00:12:22.319 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-11T00:12:22.319 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-11T00:12:22.319 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-11T00:12:22.320 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-11T00:12:22.320 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-11T00:12:22.320 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-11T00:12:22.320 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-11T00:12:22.320 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.compression_opts.level: 32767 2024-09-11T00:12:22.320 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.compression_opts.strategy: 0 2024-09-11T00:12:22.320 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-11T00:12:22.320 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-11T00:12:22.320 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-11T00:12:22.320 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-11T00:12:22.320 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.compression_opts.enabled: false 2024-09-11T00:12:22.320 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-11T00:12:22.321 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-11T00:12:22.321 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-11T00:12:22.321 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-11T00:12:22.321 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.target_file_size_base: 67108864 2024-09-11T00:12:22.321 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-11T00:12:22.321 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-11T00:12:22.321 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-11T00:12:22.321 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-11T00:12:22.321 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-11T00:12:22.321 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-11T00:12:22.321 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-11T00:12:22.321 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-11T00:12:22.321 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-11T00:12:22.321 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-11T00:12:22.322 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-11T00:12:22.322 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-11T00:12:22.322 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-11T00:12:22.322 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-11T00:12:22.322 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.arena_block_size: 1048576 2024-09-11T00:12:22.322 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-11T00:12:22.322 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-11T00:12:22.322 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.disable_auto_compactions: 0 2024-09-11T00:12:22.322 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-11T00:12:22.322 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-11T00:12:22.322 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-11T00:12:22.322 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-11T00:12:22.322 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-11T00:12:22.323 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-11T00:12:22.323 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-11T00:12:22.323 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-11T00:12:22.323 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-11T00:12:22.323 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-11T00:12:22.323 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-11T00:12:22.323 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.inplace_update_support: 0 2024-09-11T00:12:22.323 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-11T00:12:22.323 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-11T00:12:22.323 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-11T00:12:22.323 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-11T00:12:22.323 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.bloom_locality: 0 2024-09-11T00:12:22.324 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.max_successive_merges: 0 2024-09-11T00:12:22.324 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-11T00:12:22.324 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.paranoid_file_checks: 0 2024-09-11T00:12:22.324 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.force_consistency_checks: 1 2024-09-11T00:12:22.324 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.report_bg_io_stats: 0 2024-09-11T00:12:22.324 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.ttl: 2592000 2024-09-11T00:12:22.324 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-11T00:12:22.324 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-11T00:12:22.324 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-11T00:12:22.324 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.enable_blob_files: false 2024-09-11T00:12:22.324 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.min_blob_size: 0 2024-09-11T00:12:22.324 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.blob_file_size: 268435456 2024-09-11T00:12:22.325 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-11T00:12:22.325 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-11T00:12:22.325 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-11T00:12:22.325 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-11T00:12:22.325 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-11T00:12:22.325 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.blob_file_starting_level: 0 2024-09-11T00:12:22.325 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-11T00:12:22.325 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-11T00:12:22.325 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi111/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 37, last_sequence is 16577, log_number is 33,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 33 2024-09-11T00:12:22.325 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 33 2024-09-11T00:12:22.325 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 0f834ef2-4257-44fa-a3e6-aac58d62ef12 2024-09-11T00:12:22.325 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726013542092581, "job": 1, "event": "recovery_started", "wal_files": [33]} 2024-09-11T00:12:22.326 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #33 mode 2 2024-09-11T00:12:22.326 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726013542097847, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 38, "file_size": 683121, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 16578, "largest_seqno": 17646, "table_properties": {"data_size": 678418, "index_size": 2511, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1157, "raw_key_size": 10795, "raw_average_key_size": 24, "raw_value_size": 669086, "raw_average_value_size": 1506, "num_data_blocks": 113, "num_entries": 444, "num_filter_entries": 444, "num_deletions": 6, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726013542, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "0f834ef2-4257-44fa-a3e6-aac58d62ef12", "db_session_id": "LRQD6FY8GCVB5AMG8VXY", "orig_file_number": 38, "seqno_to_time_mapping": "N/A"}} 2024-09-11T00:12:22.326 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726013542098099, "job": 1, "event": "recovery_finished"} 2024-09-11T00:12:22.326 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: [db/version_set.cc:5047] Creating manifest 40 2024-09-11T00:12:22.326 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-11T00:12:22.326 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi111/store.db/000033.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-11T00:12:22.326 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e944fbce00 2024-09-11T00:12:22.326 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: DB pointer 0x55e9450bc000 2024-09-11T00:12:22.326 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-11T00:12:22.326 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-11T00:12:22.326 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ** DB Stats ** 2024-09-11T00:12:22.326 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T00:12:22.326 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-11T00:12:22.327 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T00:12:22.327 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T00:12:22.327 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-11T00:12:22.327 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T00:12:22.327 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T00:12:22.327 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-11T00:12:22.327 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ** Compaction Stats [default] ** 2024-09-11T00:12:22.327 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T00:12:22.327 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-11T00:12:22.327 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: L0 1/0 667.11 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 211.4 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-11T00:12:22.327 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: L6 1/0 8.43 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-11T00:12:22.327 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Sum 2/0 9.08 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 211.4 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-11T00:12:22.327 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 211.4 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-11T00:12:22.328 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-11T00:12:22.328 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ** Compaction Stats [default] ** 2024-09-11T00:12:22.328 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T00:12:22.328 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-11T00:12:22.328 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 211.4 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-11T00:12:22.328 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-11T00:12:22.328 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-11T00:12:22.328 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-11T00:12:22.328 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T00:12:22.328 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-09-11T00:12:22.328 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-11T00:12:22.328 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-11T00:12:22.328 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-11T00:12:22.329 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-11T00:12:22.329 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Cumulative compaction: 0.00 GB write, 68.19 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T00:12:22.329 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Interval compaction: 0.00 GB write, 68.19 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T00:12:22.329 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-11T00:12:22.329 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Block cache BinnedLRUCache@0x55e944f8b610#2 capacity: 512.00 MB usage: 3.86 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-11T00:12:22.329 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.28 KB,0.000244379%) IndexBlock(1,2.58 KB,0.000491738%) Misc(1,0.00 KB,0%) 2024-09-11T00:12:22.329 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-11T00:12:22.329 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-11T00:12:22.329 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: starting mon.smithi111 rank 0 at public addrs [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] at bind addrs [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi111 fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 2024-09-11T00:12:22.329 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: mon.smithi111@-1(???) e2 preinit fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 2024-09-11T00:12:22.329 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: mon.smithi111@-1(???).mds e15 new map 2024-09-11T00:12:22.329 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: mon.smithi111@-1(???).mds e15 print_map 2024-09-11T00:12:22.330 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: e15 2024-09-11T00:12:22.330 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-11T00:12:22.330 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T00:12:22.330 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:12:22.330 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: legacy client fscid: 1 2024-09-11T00:12:22.330 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-11T00:12:22.330 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Filesystem 'cephfs' (1) 2024-09-11T00:12:22.330 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: fs_name cephfs 2024-09-11T00:12:22.330 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: epoch 14 2024-09-11T00:12:22.330 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-11T00:12:22.330 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: created 2024-09-11T00:03:47.950356+0000 2024-09-11T00:12:22.330 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: modified 2024-09-11T00:04:06.275905+0000 2024-09-11T00:12:22.330 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: tableserver 0 2024-09-11T00:12:22.331 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: root 0 2024-09-11T00:12:22.331 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: session_timeout 60 2024-09-11T00:12:22.331 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: session_autoclose 300 2024-09-11T00:12:22.331 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: max_file_size 1099511627776 2024-09-11T00:12:22.331 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: max_xattr_size 65536 2024-09-11T00:12:22.331 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: required_client_features {} 2024-09-11T00:12:22.331 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: last_failure 0 2024-09-11T00:12:22.331 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: last_failure_osd_epoch 47 2024-09-11T00:12:22.331 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:12:22.331 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: max_mds 1 2024-09-11T00:12:22.331 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: in 0 2024-09-11T00:12:22.331 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: up {0=24363} 2024-09-11T00:12:22.331 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: failed 2024-09-11T00:12:22.331 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: damaged 2024-09-11T00:12:22.332 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: stopped 2024-09-11T00:12:22.332 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: data_pools [3] 2024-09-11T00:12:22.332 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: metadata_pool 2 2024-09-11T00:12:22.332 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: inline_data enabled 2024-09-11T00:12:22.332 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: balancer 2024-09-11T00:12:22.332 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: bal_rank_mask -1 2024-09-11T00:12:22.332 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: standby_count_wanted 1 2024-09-11T00:12:22.332 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: qdb_cluster leader: 0 members: 2024-09-11T00:12:22.332 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: [mds.cephfs.smithi203.tcrqop{0:24363} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.203:6824/3082736449,v1:172.21.15.203:6825/3082736449] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:12:22.332 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-11T00:12:22.332 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-11T00:12:22.332 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Standby daemons: 2024-09-11T00:12:22.332 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-11T00:12:22.333 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: [mds.cephfs.smithi111.rucaba{-1:14554} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6828/2045133285,v1:172.21.15.111:6829/2045133285] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:12:22.333 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: [mds.cephfs.smithi111.gmgsay{-1:14566} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.111:6826/1122545830,v1:172.21.15.111:6827/1122545830] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:12:22.333 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: [mds.cephfs.smithi203.uqkbkn{-1:24379} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.203:6826/695613114,v1:172.21.15.203:6827/695613114] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:12:22.333 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: mon.smithi111@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-11T00:12:22.333 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: mon.smithi111@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-11T00:12:22.333 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: mon.smithi111@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-11T00:12:22.333 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: mon.smithi111@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-11T00:12:22.333 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 ceph-mon[90842]: mon.smithi111@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-09-11T00:12:22.333 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 bash[90823]: 3c29c070a612fa5bacaa84d5b13e4acaba33e812f503dab77fd20141913f5a6a 2024-09-11T00:12:22.333 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:22 smithi111 systemd[1]: Started Ceph mon.smithi111 for 03107fbe-6fd0-11ef-bcea-c7b262605968. 2024-09-11T00:12:23.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:23 smithi111 ceph-mon[90842]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-11T00:12:23.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:23 smithi111 ceph-mon[90842]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-09-11T00:12:23.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:23 smithi111 ceph-mon[90842]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-11T00:12:23.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:23 smithi111 ceph-mon[90842]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-11T00:12:23.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:23 smithi111 ceph-mon[90842]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:12:23.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:23 smithi111 ceph-mon[90842]: pgmap v116: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:23.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:23 smithi111 ceph-mon[90842]: pgmap v117: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:23.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:23 smithi111 ceph-mon[90842]: mon.smithi111 calling monitor election 2024-09-11T00:12:23.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:23 smithi111 ceph-mon[90842]: mon.smithi111 is new leader, mons smithi111,smithi203 in quorum (ranks 0,1) 2024-09-11T00:12:23.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:23 smithi111 ceph-mon[90842]: monmap epoch 2 2024-09-11T00:12:23.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:23 smithi111 ceph-mon[90842]: fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 2024-09-11T00:12:23.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:23 smithi111 ceph-mon[90842]: last_changed 2024-09-10T23:58:08.159111+0000 2024-09-11T00:12:23.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:23 smithi111 ceph-mon[90842]: created 2024-09-10T23:54:53.955794+0000 2024-09-11T00:12:23.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:23 smithi111 ceph-mon[90842]: min_mon_release 18 (reef) 2024-09-11T00:12:23.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:23 smithi111 ceph-mon[90842]: election_strategy: 1 2024-09-11T00:12:23.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:23 smithi111 ceph-mon[90842]: 0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.smithi111 2024-09-11T00:12:23.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:23 smithi111 ceph-mon[90842]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.smithi203 2024-09-11T00:12:23.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:23 smithi111 ceph-mon[90842]: fsmap cephfs:1 {0=cephfs.smithi203.tcrqop=up:active} 3 up:standby 2024-09-11T00:12:23.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:23 smithi111 ceph-mon[90842]: osdmap e49: 6 total, 6 up, 6 in 2024-09-11T00:12:23.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:23 smithi111 ceph-mon[90842]: mgrmap e34: smithi111.ypucji(active, since 3m), standbys: smithi203.smuspl 2024-09-11T00:12:23.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:23 smithi111 ceph-mon[90842]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-11T00:12:23.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:23 smithi111 ceph-mon[90842]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-11T00:12:23.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:23 smithi111 ceph-mon[90842]: fs cephfs has deprecated feature inline_data enabled. 2024-09-11T00:12:23.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:23 smithi111 ceph-mon[90842]: from='mgr.14744 ' entity='' 2024-09-11T00:12:23.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:23 smithi111 ceph-mon[90842]: mgrmap e35: smithi111.ypucji(active, since 3m), standbys: smithi203.smuspl 2024-09-11T00:12:24.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:23 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-11T00:12:24.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:23 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-09-11T00:12:24.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:23 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-11T00:12:24.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:23 smithi203 ceph-mon[33225]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-11T00:12:24.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:23 smithi203 ceph-mon[33225]: from='mgr.14744 172.21.15.111:0/3894223946' entity='mgr.smithi111.ypucji' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-11T00:12:24.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:23 smithi203 ceph-mon[33225]: pgmap v116: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:24.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:23 smithi203 ceph-mon[33225]: pgmap v117: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:24.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:23 smithi203 ceph-mon[33225]: mon.smithi111 calling monitor election 2024-09-11T00:12:24.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:23 smithi203 ceph-mon[33225]: mon.smithi111 is new leader, mons smithi111,smithi203 in quorum (ranks 0,1) 2024-09-11T00:12:24.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:23 smithi203 ceph-mon[33225]: monmap epoch 2 2024-09-11T00:12:24.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:23 smithi203 ceph-mon[33225]: fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 2024-09-11T00:12:24.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:23 smithi203 ceph-mon[33225]: last_changed 2024-09-10T23:58:08.159111+0000 2024-09-11T00:12:24.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:23 smithi203 ceph-mon[33225]: created 2024-09-10T23:54:53.955794+0000 2024-09-11T00:12:24.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:23 smithi203 ceph-mon[33225]: min_mon_release 18 (reef) 2024-09-11T00:12:24.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:23 smithi203 ceph-mon[33225]: election_strategy: 1 2024-09-11T00:12:24.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:23 smithi203 ceph-mon[33225]: 0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.smithi111 2024-09-11T00:12:24.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:23 smithi203 ceph-mon[33225]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.smithi203 2024-09-11T00:12:24.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:23 smithi203 ceph-mon[33225]: fsmap cephfs:1 {0=cephfs.smithi203.tcrqop=up:active} 3 up:standby 2024-09-11T00:12:24.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:23 smithi203 ceph-mon[33225]: osdmap e49: 6 total, 6 up, 6 in 2024-09-11T00:12:24.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:23 smithi203 ceph-mon[33225]: mgrmap e34: smithi111.ypucji(active, since 3m), standbys: smithi203.smuspl 2024-09-11T00:12:24.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:23 smithi203 ceph-mon[33225]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-11T00:12:24.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:23 smithi203 ceph-mon[33225]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-11T00:12:24.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:23 smithi203 ceph-mon[33225]: fs cephfs has deprecated feature inline_data enabled. 2024-09-11T00:12:24.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:23 smithi203 ceph-mon[33225]: from='mgr.14744 ' entity='' 2024-09-11T00:12:24.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:23 smithi203 ceph-mon[33225]: mgrmap e35: smithi111.ypucji(active, since 3m), standbys: smithi203.smuspl 2024-09-11T00:12:29.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:29 smithi203 ceph-mon[33225]: Standby manager daemon smithi203.smuspl restarted 2024-09-11T00:12:29.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:29 smithi203 ceph-mon[33225]: Standby manager daemon smithi203.smuspl started 2024-09-11T00:12:29.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:29 smithi203 ceph-mon[33225]: from='mgr.? 172.21.15.203:0/1893192947' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.smuspl/crt"}]: dispatch 2024-09-11T00:12:29.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:29 smithi203 ceph-mon[33225]: from='mgr.? 172.21.15.203:0/1893192947' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T00:12:29.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:29 smithi203 ceph-mon[33225]: from='mgr.? 172.21.15.203:0/1893192947' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.smuspl/key"}]: dispatch 2024-09-11T00:12:29.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:29 smithi203 ceph-mon[33225]: from='mgr.? 172.21.15.203:0/1893192947' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T00:12:29.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:29 smithi111 ceph-mon[90842]: Standby manager daemon smithi203.smuspl restarted 2024-09-11T00:12:29.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:29 smithi111 ceph-mon[90842]: Standby manager daemon smithi203.smuspl started 2024-09-11T00:12:29.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:29 smithi111 ceph-mon[90842]: from='mgr.? 172.21.15.203:0/1893192947' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.smuspl/crt"}]: dispatch 2024-09-11T00:12:29.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:29 smithi111 ceph-mon[90842]: from='mgr.? 172.21.15.203:0/1893192947' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T00:12:29.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:29 smithi111 ceph-mon[90842]: from='mgr.? 172.21.15.203:0/1893192947' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.smuspl/key"}]: dispatch 2024-09-11T00:12:29.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:29 smithi111 ceph-mon[90842]: from='mgr.? 172.21.15.203:0/1893192947' entity='mgr.smithi203.smuspl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T00:12:30.898 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:30 smithi203 ceph-mon[33225]: mgrmap e36: smithi111.ypucji(active, since 3m), standbys: smithi203.smuspl 2024-09-11T00:12:30.898 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:30 smithi203 ceph-mon[33225]: Active manager daemon smithi111.ypucji restarted 2024-09-11T00:12:30.899 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:30 smithi203 ceph-mon[33225]: Activating manager daemon smithi111.ypucji 2024-09-11T00:12:30.899 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:30 smithi203 ceph-mon[33225]: osdmap e50: 6 total, 6 up, 6 in 2024-09-11T00:12:30.899 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:30 smithi203 ceph-mon[33225]: mgrmap e37: smithi111.ypucji(active, starting, since 0.00911855s), standbys: smithi203.smuspl 2024-09-11T00:12:30.899 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:30 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mon metadata", "id": "smithi111"} : dispatch 2024-09-11T00:12:30.899 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:30 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mon metadata", "id": "smithi203"} : dispatch 2024-09-11T00:12:30.899 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:30 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mds metadata", "who": "cephfs.smithi111.rucaba"} : dispatch 2024-09-11T00:12:30.899 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:30 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mds metadata", "who": "cephfs.smithi111.gmgsay"} : dispatch 2024-09-11T00:12:30.899 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:30 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mds metadata", "who": "cephfs.smithi203.tcrqop"} : dispatch 2024-09-11T00:12:30.899 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:30 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mds metadata", "who": "cephfs.smithi203.uqkbkn"} : dispatch 2024-09-11T00:12:30.899 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:30 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mgr metadata", "who": "smithi111.ypucji", "id": "smithi111.ypucji"} : dispatch 2024-09-11T00:12:30.899 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:30 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mgr metadata", "who": "smithi203.smuspl", "id": "smithi203.smuspl"} : dispatch 2024-09-11T00:12:30.899 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:30 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:12:30.900 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:30 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T00:12:30.900 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:30 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T00:12:30.900 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:30 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T00:12:30.900 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:30 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T00:12:30.900 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:30 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T00:12:30.900 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:30 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mds metadata"} : dispatch 2024-09-11T00:12:30.900 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:30 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd metadata"} : dispatch 2024-09-11T00:12:30.900 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:30 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mon metadata"} : dispatch 2024-09-11T00:12:30.900 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:30 smithi203 ceph-mon[33225]: Manager daemon smithi111.ypucji is now available 2024-09-11T00:12:30.900 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:30 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:12:30.900 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:30 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:12:30.900 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:30 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-11T00:12:30.900 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:30 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.ypucji/mirror_snapshot_schedule"} : dispatch 2024-09-11T00:12:30.901 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:30 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.ypucji/trash_purge_schedule"} : dispatch 2024-09-11T00:12:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:30 smithi111 ceph-mon[90842]: mgrmap e36: smithi111.ypucji(active, since 3m), standbys: smithi203.smuspl 2024-09-11T00:12:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:30 smithi111 ceph-mon[90842]: Active manager daemon smithi111.ypucji restarted 2024-09-11T00:12:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:30 smithi111 ceph-mon[90842]: Activating manager daemon smithi111.ypucji 2024-09-11T00:12:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:30 smithi111 ceph-mon[90842]: osdmap e50: 6 total, 6 up, 6 in 2024-09-11T00:12:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:30 smithi111 ceph-mon[90842]: mgrmap e37: smithi111.ypucji(active, starting, since 0.00911855s), standbys: smithi203.smuspl 2024-09-11T00:12:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mon metadata", "id": "smithi111"} : dispatch 2024-09-11T00:12:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mon metadata", "id": "smithi203"} : dispatch 2024-09-11T00:12:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mds metadata", "who": "cephfs.smithi111.rucaba"} : dispatch 2024-09-11T00:12:30.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mds metadata", "who": "cephfs.smithi111.gmgsay"} : dispatch 2024-09-11T00:12:30.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mds metadata", "who": "cephfs.smithi203.tcrqop"} : dispatch 2024-09-11T00:12:30.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mds metadata", "who": "cephfs.smithi203.uqkbkn"} : dispatch 2024-09-11T00:12:30.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mgr metadata", "who": "smithi111.ypucji", "id": "smithi111.ypucji"} : dispatch 2024-09-11T00:12:30.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mgr metadata", "who": "smithi203.smuspl", "id": "smithi203.smuspl"} : dispatch 2024-09-11T00:12:30.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:12:30.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T00:12:30.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T00:12:30.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T00:12:30.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T00:12:30.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T00:12:30.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mds metadata"} : dispatch 2024-09-11T00:12:30.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd metadata"} : dispatch 2024-09-11T00:12:30.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mon metadata"} : dispatch 2024-09-11T00:12:30.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:30 smithi111 ceph-mon[90842]: Manager daemon smithi111.ypucji is now available 2024-09-11T00:12:30.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:12:30.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:12:30.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-11T00:12:30.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.ypucji/mirror_snapshot_schedule"} : dispatch 2024-09-11T00:12:30.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.ypucji/trash_purge_schedule"} : dispatch 2024-09-11T00:12:31.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:31 smithi111 ceph-mon[90842]: mgrmap e38: smithi111.ypucji(active, since 1.01598s), standbys: smithi203.smuspl 2024-09-11T00:12:31.981 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:31 smithi111 ceph-mon[90842]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-11T00:12:31.982 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:31 smithi111 ceph-mon[90842]: pgmap v3: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:32.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:31 smithi203 ceph-mon[33225]: mgrmap e38: smithi111.ypucji(active, since 1.01598s), standbys: smithi203.smuspl 2024-09-11T00:12:32.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:31 smithi203 ceph-mon[33225]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-11T00:12:32.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:31 smithi203 ceph-mon[33225]: pgmap v3: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:32.895 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:32 smithi203 ceph-mon[33225]: [11/Sep/2024:00:12:31] ENGINE Bus STARTING 2024-09-11T00:12:32.895 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:32 smithi203 ceph-mon[33225]: [11/Sep/2024:00:12:31] ENGINE Serving on http://172.21.15.111:8765 2024-09-11T00:12:32.895 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:32 smithi203 ceph-mon[33225]: [11/Sep/2024:00:12:31] ENGINE Serving on https://172.21.15.111:7150 2024-09-11T00:12:32.895 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:32 smithi203 ceph-mon[33225]: [11/Sep/2024:00:12:31] ENGINE Bus STARTED 2024-09-11T00:12:32.895 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:32 smithi203 ceph-mon[33225]: [11/Sep/2024:00:12:31] ENGINE Error in HTTPServer.serve 2024-09-11T00:12:32.895 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Traceback (most recent call last): 2024-09-11T00:12:32.896 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T00:12:32.896 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: self._connections.run(self.expiration_interval) 2024-09-11T00:12:32.896 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T00:12:32.896 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: self._run(expiration_interval) 2024-09-11T00:12:32.896 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T00:12:32.896 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T00:12:32.896 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T00:12:32.896 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T00:12:32.896 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T00:12:32.896 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: s = self.context.wrap_socket( 2024-09-11T00:12:32.896 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T00:12:32.896 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: return self.sslsocket_class._create( 2024-09-11T00:12:32.896 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T00:12:32.897 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: self.do_handshake() 2024-09-11T00:12:32.897 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T00:12:32.897 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: self._sslobj.do_handshake() 2024-09-11T00:12:32.897 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T00:12:32.897 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:32 smithi203 ceph-mon[33225]: pgmap v4: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:32.897 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:32 smithi203 ceph-mon[33225]: mgrmap e39: smithi111.ypucji(active, since 2s), standbys: smithi203.smuspl 2024-09-11T00:12:32.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:32 smithi111 ceph-mon[90842]: [11/Sep/2024:00:12:31] ENGINE Bus STARTING 2024-09-11T00:12:32.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:32 smithi111 ceph-mon[90842]: [11/Sep/2024:00:12:31] ENGINE Serving on http://172.21.15.111:8765 2024-09-11T00:12:32.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:32 smithi111 ceph-mon[90842]: [11/Sep/2024:00:12:31] ENGINE Serving on https://172.21.15.111:7150 2024-09-11T00:12:32.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:32 smithi111 ceph-mon[90842]: [11/Sep/2024:00:12:31] ENGINE Bus STARTED 2024-09-11T00:12:32.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:32 smithi111 ceph-mon[90842]: [11/Sep/2024:00:12:31] ENGINE Error in HTTPServer.serve 2024-09-11T00:12:32.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Traceback (most recent call last): 2024-09-11T00:12:32.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T00:12:32.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self._connections.run(self.expiration_interval) 2024-09-11T00:12:32.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T00:12:32.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self._run(expiration_interval) 2024-09-11T00:12:32.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T00:12:32.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T00:12:32.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T00:12:32.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T00:12:32.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T00:12:32.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: s = self.context.wrap_socket( 2024-09-11T00:12:32.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T00:12:32.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: return self.sslsocket_class._create( 2024-09-11T00:12:32.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T00:12:32.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self.do_handshake() 2024-09-11T00:12:32.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T00:12:32.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self._sslobj.do_handshake() 2024-09-11T00:12:32.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T00:12:32.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:32 smithi111 ceph-mon[90842]: pgmap v4: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:32.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:32 smithi111 ceph-mon[90842]: mgrmap e39: smithi111.ypucji(active, since 2s), standbys: smithi203.smuspl 2024-09-11T00:12:34.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:34 smithi111 ceph-mon[90842]: pgmap v5: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:34.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:34 smithi111 ceph-mon[90842]: mgrmap e40: smithi111.ypucji(active, since 4s), standbys: smithi203.smuspl 2024-09-11T00:12:34.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:34 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:34.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:34 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:35.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:34 smithi203 ceph-mon[33225]: pgmap v5: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:35.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:34 smithi203 ceph-mon[33225]: mgrmap e40: smithi111.ypucji(active, since 4s), standbys: smithi203.smuspl 2024-09-11T00:12:35.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:34 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:35.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:34 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:36.266 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:35 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:36.266 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:35 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:36.267 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:35 smithi203 ceph-mon[33225]: pgmap v6: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:36.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:35 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:36.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:35 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:36.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:35 smithi111 ceph-mon[90842]: pgmap v6: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:37.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:37 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:37.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:37 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:37.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:37 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:37.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:37 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:38.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:38 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:38.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:38 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:38.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:38 smithi203 ceph-mon[33225]: pgmap v7: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-11T00:12:38.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:38 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:38.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:38 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:38.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:38 smithi111 ceph-mon[90842]: pgmap v7: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-11T00:12:40.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:40 smithi111 ceph-mon[90842]: Detected new or changed devices on smithi203 2024-09-11T00:12:40.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:40 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:40.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:40 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:40.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:40 smithi111 ceph-mon[90842]: pgmap v8: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-11T00:12:40.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:40 smithi203 ceph-mon[33225]: Detected new or changed devices on smithi203 2024-09-11T00:12:40.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:40 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:40.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:40 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:40.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:40 smithi203 ceph-mon[33225]: pgmap v8: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-11T00:12:42.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:42 smithi111 ceph-mon[90842]: Detected new or changed devices on smithi111 2024-09-11T00:12:42.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:42 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:42.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:42 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:42.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:42 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:42.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:42 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:12:42.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:42 smithi111 ceph-mon[90842]: Updating smithi111:/etc/ceph/ceph.conf 2024-09-11T00:12:42.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:42 smithi111 ceph-mon[90842]: Updating smithi203:/etc/ceph/ceph.conf 2024-09-11T00:12:42.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:42 smithi111 ceph-mon[90842]: pgmap v9: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 16 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-11T00:12:42.711 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:42 smithi203 ceph-mon[33225]: Detected new or changed devices on smithi111 2024-09-11T00:12:42.711 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:42 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:42.711 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:42 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:42.711 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:42 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:42.711 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:42 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:12:42.711 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:42 smithi203 ceph-mon[33225]: Updating smithi111:/etc/ceph/ceph.conf 2024-09-11T00:12:42.711 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:42 smithi203 ceph-mon[33225]: Updating smithi203:/etc/ceph/ceph.conf 2024-09-11T00:12:42.712 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:42 smithi203 ceph-mon[33225]: pgmap v9: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 16 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-11T00:12:43.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:43 smithi111 ceph-mon[90842]: Updating smithi111:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:12:43.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:43 smithi111 ceph-mon[90842]: Updating smithi203:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:12:43.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:43 smithi111 ceph-mon[90842]: Updating smithi111:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:12:43.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:43 smithi111 ceph-mon[90842]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:12:43.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:43 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:43.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:43 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:43.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:43 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:43.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:43 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:43.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:43 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:43.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:43 smithi203 ceph-mon[33225]: Updating smithi111:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:12:43.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:43 smithi203 ceph-mon[33225]: Updating smithi203:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:12:43.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:43 smithi203 ceph-mon[33225]: Updating smithi111:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:12:43.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:43 smithi203 ceph-mon[33225]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:12:43.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:43 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:43.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:43 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:43.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:43 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:43.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:43 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:43.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:43 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:44.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:44 smithi203 ceph-mon[33225]: Updating smithi111:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:12:44.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:44 smithi203 ceph-mon[33225]: Updating smithi203:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:12:44.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:44 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:12:44.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:44 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:12:44.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:44 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "quorum_status"} : dispatch 2024-09-11T00:12:44.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:44 smithi203 ceph-mon[33225]: pgmap v10: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-11T00:12:44.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:44 smithi111 ceph-mon[90842]: Updating smithi111:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:12:44.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:44 smithi111 ceph-mon[90842]: Updating smithi203:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:12:44.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:44 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:12:44.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:44 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:12:44.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:44 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "quorum_status"} : dispatch 2024-09-11T00:12:44.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:44 smithi111 ceph-mon[90842]: pgmap v10: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-11T00:12:45.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:45 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:12:45.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:45 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:12:46.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:46 smithi203 ceph-mon[33225]: Upgrade: Updating mon.smithi203 2024-09-11T00:12:46.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:46 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:46.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:46 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:12:46.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:46 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-11T00:12:46.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:46 smithi203 ceph-mon[33225]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:46.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:46 smithi203 ceph-mon[33225]: Deploying daemon mon.smithi203 on smithi203 2024-09-11T00:12:46.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:46 smithi203 ceph-mon[33225]: pgmap v11: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-11T00:12:46.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:46 smithi111 ceph-mon[90842]: Upgrade: Updating mon.smithi203 2024-09-11T00:12:46.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:46 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:46.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:46 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:12:46.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:46 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-11T00:12:46.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:46 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:46.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:46 smithi111 ceph-mon[90842]: Deploying daemon mon.smithi203 on smithi203 2024-09-11T00:12:46.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:46 smithi111 ceph-mon[90842]: pgmap v11: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-11T00:12:47.656 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:47 smithi203 systemd[1]: Stopping Ceph mon.smithi203 for 03107fbe-6fd0-11ef-bcea-c7b262605968... 2024-09-11T00:12:47.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.892+0000 7fccd4400700 1 -- 172.21.15.111:0/326706289 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcccc102fa0 msgr2=0x7fcccc106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:47.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.892+0000 7fccd4400700 1 --2- 172.21.15.111:0/326706289 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcccc102fa0 0x7fcccc106f70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fccb8009910 tx=0x7fccb8009c20 comp rx=0 tx=0).stop 2024-09-11T00:12:47.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.892+0000 7fccd4400700 1 -- 172.21.15.111:0/326706289 shutdown_connections 2024-09-11T00:12:47.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.892+0000 7fccd4400700 1 --2- 172.21.15.111:0/326706289 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcccc102fa0 0x7fcccc106f70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:47.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.892+0000 7fccd4400700 1 --2- 172.21.15.111:0/326706289 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcccc102600 0x7fcccc1029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:47.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.892+0000 7fccd4400700 1 -- 172.21.15.111:0/326706289 >> 172.21.15.111:0/326706289 conn(0x7fcccc0fdec0 msgr2=0x7fcccc1002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:47.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.892+0000 7fccd4400700 1 -- 172.21.15.111:0/326706289 shutdown_connections 2024-09-11T00:12:47.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.892+0000 7fccd4400700 1 -- 172.21.15.111:0/326706289 wait complete. 2024-09-11T00:12:47.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.893+0000 7fccd4400700 1 Processor -- start 2024-09-11T00:12:47.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.893+0000 7fccd4400700 1 -- start start 2024-09-11T00:12:47.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.894+0000 7fccd4400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcccc102600 0x7fcccc198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:47.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.894+0000 7fccd4400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcccc102fa0 0x7fcccc198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:47.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.894+0000 7fccd4400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcccc198c50 con 0x7fcccc102fa0 2024-09-11T00:12:47.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.894+0000 7fccd4400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcccc19c9e0 con 0x7fcccc102600 2024-09-11T00:12:47.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.894+0000 7fccd1a00700 1 -- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcccc102600 msgr2=0x7fcccc198030 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.203:3300/0 2024-09-11T00:12:47.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.894+0000 7fccd1a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcccc102600 0x7fcccc198030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T00:12:47.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.894+0000 7fccd1000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcccc102fa0 0x7fcccc198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:47.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.894+0000 7fccd1000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcccc102fa0 0x7fcccc198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44274/0 (socket says 172.21.15.111:44274) 2024-09-11T00:12:47.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.894+0000 7fccd1000700 1 -- 172.21.15.111:0/2067040505 learned_addr learned my addr 172.21.15.111:0/2067040505 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:12:47.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.894+0000 7fccd1000700 1 -- 172.21.15.111:0/2067040505 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcccc102600 msgr2=0x7fcccc198030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:12:47.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.894+0000 7fccd1000700 1 --2- 172.21.15.111:0/2067040505 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcccc102600 0x7fcccc198030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:47.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.894+0000 7fccd1000700 1 -- 172.21.15.111:0/2067040505 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb80095f0 con 0x7fcccc102fa0 2024-09-11T00:12:47.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.895+0000 7fccd1000700 1 --2- 172.21.15.111:0/2067040505 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcccc102fa0 0x7fcccc198570 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fccb8000c00 tx=0x7fccb800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:47.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.895+0000 7fccca000700 1 -- 172.21.15.111:0/2067040505 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccb801d070 con 0x7fcccc102fa0 2024-09-11T00:12:47.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.895+0000 7fccca000700 1 -- 172.21.15.111:0/2067040505 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fccb8004f70 con 0x7fcccc102fa0 2024-09-11T00:12:47.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.895+0000 7fccd4400700 1 -- 172.21.15.111:0/2067040505 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcccc19cc60 con 0x7fcccc102fa0 2024-09-11T00:12:47.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.895+0000 7fccca000700 1 -- 172.21.15.111:0/2067040505 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccb800f460 con 0x7fcccc102fa0 2024-09-11T00:12:47.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.895+0000 7fccd4400700 1 -- 172.21.15.111:0/2067040505 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcccc19d150 con 0x7fcccc102fa0 2024-09-11T00:12:47.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.896+0000 7fccd4400700 1 -- 172.21.15.111:0/2067040505 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcccc10a970 con 0x7fcccc102fa0 2024-09-11T00:12:47.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.897+0000 7fccca000700 1 -- 172.21.15.111:0/2067040505 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 40) v1 ==== 102584+0+0 (secure 0 0 0) 0x7fccb8022470 con 0x7fcccc102fa0 2024-09-11T00:12:47.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.898+0000 7fccca000700 1 --2- 172.21.15.111:0/2067040505 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fccb407a7b0 0x7fccb407cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:47.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.898+0000 7fccca000700 1 -- 172.21.15.111:0/2067040505 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fccb809ea30 con 0x7fcccc102fa0 2024-09-11T00:12:47.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.899+0000 7fccd1a00700 1 --2- 172.21.15.111:0/2067040505 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fccb407a7b0 0x7fccb407cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:47.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.899+0000 7fccd1a00700 1 --2- 172.21.15.111:0/2067040505 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fccb407a7b0 0x7fccb407cc60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fccc0001050 tx=0x7fccc0006df0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:47.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:47.904+0000 7fccca000700 1 -- 172.21.15.111:0/2067040505 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fccb8061fc0 con 0x7fcccc102fa0 2024-09-11T00:12:48.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:47 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi203[33220]: 2024-09-11T00:12:47.651+0000 7fe1e9800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi203 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:12:48.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:47 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi203[33220]: 2024-09-11T00:12:47.651+0000 7fe1e9800700 -1 mon.smithi203@1(peon) e2 *** Got Signal Terminated *** 2024-09-11T00:12:48.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:47 smithi203 podman[68845]: 2024-09-11 00:12:47.889286015 +0000 UTC m=+0.341866460 container died ff8eb7ca85eafd04498a9e408b270389595b792e4184a3f36eac8a4a7b36c3c6 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi203, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.29.1) 2024-09-11T00:12:48.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.148+0000 7fccd4400700 1 -- 172.21.15.111:0/2067040505 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcccc02cd10 con 0x7fccb407a7b0 2024-09-11T00:12:48.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.150+0000 7fccca000700 1 -- 172.21.15.111:0/2067040505 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fcccc02cd10 con 0x7fccb407a7b0 2024-09-11T00:12:48.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.153+0000 7fccd4400700 1 -- 172.21.15.111:0/2067040505 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fccb407a7b0 msgr2=0x7fccb407cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:48.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.153+0000 7fccd4400700 1 --2- 172.21.15.111:0/2067040505 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fccb407a7b0 0x7fccb407cc60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fccc0001050 tx=0x7fccc0006df0 comp rx=0 tx=0).stop 2024-09-11T00:12:48.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.153+0000 7fccd4400700 1 -- 172.21.15.111:0/2067040505 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcccc102fa0 msgr2=0x7fcccc198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:48.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.153+0000 7fccd4400700 1 --2- 172.21.15.111:0/2067040505 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcccc102fa0 0x7fcccc198570 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fccb8000c00 tx=0x7fccb800be20 comp rx=0 tx=0).stop 2024-09-11T00:12:48.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.153+0000 7fccd4400700 1 -- 172.21.15.111:0/2067040505 shutdown_connections 2024-09-11T00:12:48.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.153+0000 7fccd4400700 1 --2- 172.21.15.111:0/2067040505 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fccb407a7b0 0x7fccb407cc60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:48.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.153+0000 7fccd4400700 1 --2- 172.21.15.111:0/2067040505 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcccc102600 0x7fcccc198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:48.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.153+0000 7fccd4400700 1 --2- 172.21.15.111:0/2067040505 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcccc102fa0 0x7fcccc198570 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:48.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.153+0000 7fccd4400700 1 -- 172.21.15.111:0/2067040505 >> 172.21.15.111:0/2067040505 conn(0x7fcccc0fdec0 msgr2=0x7fcccc0ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:48.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.153+0000 7fccd4400700 1 -- 172.21.15.111:0/2067040505 shutdown_connections 2024-09-11T00:12:48.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.153+0000 7fccd4400700 1 -- 172.21.15.111:0/2067040505 wait complete. 2024-09-11T00:12:48.170 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:12:48.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.292+0000 7f7e21400700 1 -- 172.21.15.111:0/3269314432 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e1c100bf0 msgr2=0x7f7e1c104bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:48.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.292+0000 7f7e21400700 1 --2- 172.21.15.111:0/3269314432 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e1c100bf0 0x7f7e1c104bc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009910 tx=0x7f7e04009c20 comp rx=0 tx=0).stop 2024-09-11T00:12:48.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.292+0000 7f7e21400700 1 -- 172.21.15.111:0/3269314432 shutdown_connections 2024-09-11T00:12:48.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.292+0000 7f7e21400700 1 --2- 172.21.15.111:0/3269314432 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e1c100bf0 0x7f7e1c104bc0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:48.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.292+0000 7f7e21400700 1 --2- 172.21.15.111:0/3269314432 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e1c100250 0x7f7e1c100620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:48.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.292+0000 7f7e21400700 1 -- 172.21.15.111:0/3269314432 >> 172.21.15.111:0/3269314432 conn(0x7f7e1c0fbb10 msgr2=0x7f7e1c0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:48.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.292+0000 7f7e21400700 1 -- 172.21.15.111:0/3269314432 shutdown_connections 2024-09-11T00:12:48.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.292+0000 7f7e21400700 1 -- 172.21.15.111:0/3269314432 wait complete. 2024-09-11T00:12:48.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.293+0000 7f7e21400700 1 Processor -- start 2024-09-11T00:12:48.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.293+0000 7f7e21400700 1 -- start start 2024-09-11T00:12:48.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.293+0000 7f7e21400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e1c100250 0x7f7e1c197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:48.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.293+0000 7f7e21400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e1c100bf0 0x7f7e1c198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:48.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.293+0000 7f7e21400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c198b20 con 0x7f7e1c100bf0 2024-09-11T00:12:48.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.293+0000 7f7e21400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c19c8b0 con 0x7f7e1c100250 2024-09-11T00:12:48.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.294+0000 7f7e1be00700 1 -- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e1c100250 msgr2=0x7f7e1c197f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.203:3300/0 2024-09-11T00:12:48.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.294+0000 7f7e1be00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e1c100250 0x7f7e1c197f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T00:12:48.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.294+0000 7f7e13e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e1c100bf0 0x7f7e1c198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:48.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.294+0000 7f7e13e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e1c100bf0 0x7f7e1c198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44292/0 (socket says 172.21.15.111:44292) 2024-09-11T00:12:48.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.294+0000 7f7e13e00700 1 -- 172.21.15.111:0/3706150395 learned_addr learned my addr 172.21.15.111:0/3706150395 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:12:48.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.294+0000 7f7e13e00700 1 -- 172.21.15.111:0/3706150395 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e1c100250 msgr2=0x7f7e1c197f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:12:48.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.294+0000 7f7e13e00700 1 --2- 172.21.15.111:0/3706150395 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e1c100250 0x7f7e1c197f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:48.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.294+0000 7f7e13e00700 1 -- 172.21.15.111:0/3706150395 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e040095f0 con 0x7f7e1c100bf0 2024-09-11T00:12:48.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.294+0000 7f7e13e00700 1 --2- 172.21.15.111:0/3706150395 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e1c100bf0 0x7f7e1c198440 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7e04000c00 tx=0x7f7e0400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:48.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.295+0000 7f7e19600700 1 -- 172.21.15.111:0/3706150395 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e0401d070 con 0x7f7e1c100bf0 2024-09-11T00:12:48.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.295+0000 7f7e19600700 1 -- 172.21.15.111:0/3706150395 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7e04004f70 con 0x7f7e1c100bf0 2024-09-11T00:12:48.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.295+0000 7f7e19600700 1 -- 172.21.15.111:0/3706150395 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e0400f460 con 0x7f7e1c100bf0 2024-09-11T00:12:48.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.295+0000 7f7e21400700 1 -- 172.21.15.111:0/3706150395 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e1c19cb30 con 0x7f7e1c100bf0 2024-09-11T00:12:48.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.295+0000 7f7e21400700 1 -- 172.21.15.111:0/3706150395 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1c19cfd0 con 0x7f7e1c100bf0 2024-09-11T00:12:48.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.296+0000 7f7e21400700 1 -- 172.21.15.111:0/3706150395 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e1c104340 con 0x7f7e1c100bf0 2024-09-11T00:12:48.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.297+0000 7f7e19600700 1 -- 172.21.15.111:0/3706150395 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 40) v1 ==== 102584+0+0 (secure 0 0 0) 0x7f7e04022470 con 0x7f7e1c100bf0 2024-09-11T00:12:48.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.298+0000 7f7e19600700 1 --2- 172.21.15.111:0/3706150395 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f7e0007a7b0 0x7f7e0007cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:48.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.298+0000 7f7e19600700 1 -- 172.21.15.111:0/3706150395 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f7e0409eb00 con 0x7f7e1c100bf0 2024-09-11T00:12:48.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.298+0000 7f7e1be00700 1 --2- 172.21.15.111:0/3706150395 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f7e0007a7b0 0x7f7e0007cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:48.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.299+0000 7f7e1be00700 1 --2- 172.21.15.111:0/3706150395 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f7e0007a7b0 0x7f7e0007cc60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c001050 tx=0x7f7e0c006df0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:48.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.302+0000 7f7e19600700 1 -- 172.21.15.111:0/3706150395 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f7e04062090 con 0x7f7e1c100bf0 2024-09-11T00:12:48.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:48 smithi203 podman[68845]: 2024-09-11 00:12:48.283259989 +0000 UTC m=+0.735840434 container cleanup ff8eb7ca85eafd04498a9e408b270389595b792e4184a3f36eac8a4a7b36c3c6 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi203, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, RELEASE=HEAD) 2024-09-11T00:12:48.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:48 smithi203 bash[68845]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi203 2024-09-11T00:12:48.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.545+0000 7f7e21400700 1 -- 172.21.15.111:0/3706150395 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e1c02cd10 con 0x7f7e0007a7b0 2024-09-11T00:12:48.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.546+0000 7f7e19600700 1 -- 172.21.15.111:0/3706150395 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f7e1c02cd10 con 0x7f7e0007a7b0 2024-09-11T00:12:48.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.549+0000 7f7e21400700 1 -- 172.21.15.111:0/3706150395 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f7e0007a7b0 msgr2=0x7f7e0007cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:48.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.549+0000 7f7e21400700 1 --2- 172.21.15.111:0/3706150395 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f7e0007a7b0 0x7f7e0007cc60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c001050 tx=0x7f7e0c006df0 comp rx=0 tx=0).stop 2024-09-11T00:12:48.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.549+0000 7f7e21400700 1 -- 172.21.15.111:0/3706150395 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e1c100bf0 msgr2=0x7f7e1c198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:48.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.549+0000 7f7e21400700 1 --2- 172.21.15.111:0/3706150395 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e1c100bf0 0x7f7e1c198440 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7e04000c00 tx=0x7f7e0400be20 comp rx=0 tx=0).stop 2024-09-11T00:12:48.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.549+0000 7f7e21400700 1 -- 172.21.15.111:0/3706150395 shutdown_connections 2024-09-11T00:12:48.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.549+0000 7f7e21400700 1 --2- 172.21.15.111:0/3706150395 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f7e0007a7b0 0x7f7e0007cc60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:48.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.549+0000 7f7e21400700 1 --2- 172.21.15.111:0/3706150395 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e1c100250 0x7f7e1c197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:48.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.549+0000 7f7e21400700 1 --2- 172.21.15.111:0/3706150395 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e1c100bf0 0x7f7e1c198440 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:48.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.549+0000 7f7e21400700 1 -- 172.21.15.111:0/3706150395 >> 172.21.15.111:0/3706150395 conn(0x7f7e1c0fbb10 msgr2=0x7f7e1c0fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:48.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.549+0000 7f7e21400700 1 -- 172.21.15.111:0/3706150395 shutdown_connections 2024-09-11T00:12:48.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.549+0000 7f7e21400700 1 -- 172.21.15.111:0/3706150395 wait complete. 2024-09-11T00:12:48.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.685+0000 7fa8bc600700 1 -- 172.21.15.111:0/2664567463 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa8b4100d70 msgr2=0x7fa8b4104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:48.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.685+0000 7fa8bc600700 1 --2- 172.21.15.111:0/2664567463 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa8b4100d70 0x7fa8b4104d40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0009910 tx=0x7fa8a0009c20 comp rx=0 tx=0).stop 2024-09-11T00:12:48.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.685+0000 7fa8bc600700 1 -- 172.21.15.111:0/2664567463 shutdown_connections 2024-09-11T00:12:48.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.685+0000 7fa8bc600700 1 --2- 172.21.15.111:0/2664567463 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa8b4100d70 0x7fa8b4104d40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:48.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.685+0000 7fa8bc600700 1 --2- 172.21.15.111:0/2664567463 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa8b41003d0 0x7fa8b41007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:48.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.685+0000 7fa8bc600700 1 -- 172.21.15.111:0/2664567463 >> 172.21.15.111:0/2664567463 conn(0x7fa8b40fbc90 msgr2=0x7fa8b40fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:48.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.686+0000 7fa8bc600700 1 -- 172.21.15.111:0/2664567463 shutdown_connections 2024-09-11T00:12:48.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.686+0000 7fa8bc600700 1 -- 172.21.15.111:0/2664567463 wait complete. 2024-09-11T00:12:48.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.687+0000 7fa8bc600700 1 Processor -- start 2024-09-11T00:12:48.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.687+0000 7fa8bc600700 1 -- start start 2024-09-11T00:12:48.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.687+0000 7fa8bc600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa8b41003d0 0x7fa8b4197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:48.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.687+0000 7fa8bc600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa8b4100d70 0x7fa8b4198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:48.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.687+0000 7fa8bc600700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b4198bf0 con 0x7fa8b41003d0 2024-09-11T00:12:48.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.687+0000 7fa8bc600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b419c980 con 0x7fa8b4100d70 2024-09-11T00:12:48.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.687+0000 7fa8b9200700 1 -- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa8b4100d70 msgr2=0x7fa8b4198510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.203:3300/0 2024-09-11T00:12:48.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.687+0000 7fa8b9200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa8b4100d70 0x7fa8b4198510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T00:12:48.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.687+0000 7fa8b9c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa8b41003d0 0x7fa8b4197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:48.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.687+0000 7fa8b9c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa8b41003d0 0x7fa8b4197fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44310/0 (socket says 172.21.15.111:44310) 2024-09-11T00:12:48.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.687+0000 7fa8b9c00700 1 -- 172.21.15.111:0/63981004 learned_addr learned my addr 172.21.15.111:0/63981004 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:12:48.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.688+0000 7fa8b9c00700 1 -- 172.21.15.111:0/63981004 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa8b4100d70 msgr2=0x7fa8b4198510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:12:48.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.688+0000 7fa8b9c00700 1 --2- 172.21.15.111:0/63981004 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa8b4100d70 0x7fa8b4198510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:48.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.688+0000 7fa8b9c00700 1 -- 172.21.15.111:0/63981004 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a00095f0 con 0x7fa8b41003d0 2024-09-11T00:12:48.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.688+0000 7fa8b9c00700 1 --2- 172.21.15.111:0/63981004 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa8b41003d0 0x7fa8b4197fd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800b700 tx=0x7fa8a800bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:48.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.688+0000 7fa8b2000700 1 -- 172.21.15.111:0/63981004 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8a8011800 con 0x7fa8b41003d0 2024-09-11T00:12:48.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.688+0000 7fa8b2000700 1 -- 172.21.15.111:0/63981004 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa8a8011e20 con 0x7fa8b41003d0 2024-09-11T00:12:48.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.688+0000 7fa8bc600700 1 -- 172.21.15.111:0/63981004 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b419cc60 con 0x7fa8b41003d0 2024-09-11T00:12:48.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.688+0000 7fa8b2000700 1 -- 172.21.15.111:0/63981004 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8a800f2e0 con 0x7fa8b41003d0 2024-09-11T00:12:48.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.689+0000 7fa8bc600700 1 -- 172.21.15.111:0/63981004 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b419d1b0 con 0x7fa8b41003d0 2024-09-11T00:12:48.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.690+0000 7fa8bc600700 1 -- 172.21.15.111:0/63981004 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b41044c0 con 0x7fa8b41003d0 2024-09-11T00:12:48.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.691+0000 7fa8b2000700 1 -- 172.21.15.111:0/63981004 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 40) v1 ==== 102584+0+0 (secure 0 0 0) 0x7fa8a8010380 con 0x7fa8b41003d0 2024-09-11T00:12:48.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.691+0000 7fa8b2000700 1 --2- 172.21.15.111:0/63981004 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa89c07a7b0 0x7fa89c07cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:48.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.692+0000 7fa8b2000700 1 -- 172.21.15.111:0/63981004 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fa8a809d070 con 0x7fa8b41003d0 2024-09-11T00:12:48.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.692+0000 7fa8b9200700 1 --2- 172.21.15.111:0/63981004 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa89c07a7b0 0x7fa89c07cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:48.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.692+0000 7fa8b9200700 1 --2- 172.21.15.111:0/63981004 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa89c07a7b0 0x7fa89c07cc60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000b540 tx=0x7fa8a0009fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:48.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.696+0000 7fa8b2000700 1 -- 172.21.15.111:0/63981004 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fa8a8060550 con 0x7fa8b41003d0 2024-09-11T00:12:48.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.931+0000 7fa8bc600700 1 -- 172.21.15.111:0/63981004 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8b419d540 con 0x7fa89c07a7b0 2024-09-11T00:12:48.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.941+0000 7fa8b2000700 1 -- 172.21.15.111:0/63981004 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fa8b419d540 con 0x7fa89c07a7b0 2024-09-11T00:12:48.943 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:12:48.943 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (2m) 12s ago 15m 14.5M - 0.27.0 11f11916f8cd d6d3253e881f 2024-09-11T00:12:48.943 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (4m) 12s ago 16m 7386k - 18.2.0 dc2bc1663786 7c40af85314c 2024-09-11T00:12:48.943 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi203 smithi203 running (4m) 15s ago 15m 7638k - 18.2.0 dc2bc1663786 922e3261ff70 2024-09-11T00:12:48.944 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (16m) 12s ago 16m 6665k - 18.2.0 dc2bc1663786 72a36c166ffa 2024-09-11T00:12:48.944 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi203 smithi203 running (14m) 15s ago 14m 6669k - 18.2.0 dc2bc1663786 9b102b6f6d70 2024-09-11T00:12:48.944 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (114s) 12s ago 15m 68.3M - c8b91775d855 7d3b50b5b59f 2024-09-11T00:12:48.944 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.gmgsay smithi111 running (8m) 12s ago 8m 16.8M - 18.2.0 dc2bc1663786 795e4ff0075c 2024-09-11T00:12:48.944 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.rucaba smithi111 running (8m) 12s ago 8m 16.6M - 18.2.0 dc2bc1663786 02885adac62c 2024-09-11T00:12:48.944 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.tcrqop smithi203 running (8m) 15s ago 8m 150M - 18.2.0 dc2bc1663786 4df492159bb4 2024-09-11T00:12:48.944 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.uqkbkn smithi203 running (8m) 15s ago 8m 16.6M - 18.2.0 dc2bc1663786 619aa58ea314 2024-09-11T00:12:48.944 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.ypucji smithi111 *:8443,9283,8765 running (4m) 12s ago 17m 487M - 19.3.0-4854-g8f219c47 589dd18248e4 07fa31f49618 2024-09-11T00:12:48.944 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi203.smuspl smithi203 *:8443,9283,8765 running (3m) 15s ago 14m 451M - 19.3.0-4854-g8f219c47 589dd18248e4 7e5a93a5ffa7 2024-09-11T00:12:48.944 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (27s) 12s ago 17m 29.3M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 3c29c070a612 2024-09-11T00:12:48.944 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi203 smithi203 running (14m) 15s ago 14m 49.0M 2048M 18.2.0 dc2bc1663786 ff8eb7ca85ea 2024-09-11T00:12:48.944 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (3m) 12s ago 16m 7549k - 1.7.0 72c9c2088986 ec478ea14488 2024-09-11T00:12:48.944 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi203 smithi203 *:9100 running (3m) 15s ago 14m 7306k - 1.7.0 72c9c2088986 54d461cde1bc 2024-09-11T00:12:48.945 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (13m) 12s ago 13m 212M 1216M 18.2.0 dc2bc1663786 162b7249a591 2024-09-11T00:12:48.945 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (12m) 12s ago 12m 226M 1216M 18.2.0 dc2bc1663786 3614d95b1425 2024-09-11T00:12:48.945 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (12m) 12s ago 12m 184M 1216M 18.2.0 dc2bc1663786 db175d4b09b9 2024-09-11T00:12:48.945 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi203 running (11m) 15s ago 11m 245M 2240M 18.2.0 dc2bc1663786 60b1cef7a70d 2024-09-11T00:12:48.945 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi203 running (11m) 15s ago 11m 208M 2240M 18.2.0 dc2bc1663786 769c7942c42b 2024-09-11T00:12:48.945 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi203 running (10m) 15s ago 10m 193M 2240M 18.2.0 dc2bc1663786 6d824001d40c 2024-09-11T00:12:48.945 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (2m) 12s ago 15m 52.9M - 2.51.0 1d3b7f56885b 3e72ac10983d 2024-09-11T00:12:48.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.943+0000 7fa8bc600700 1 -- 172.21.15.111:0/63981004 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa89c07a7b0 msgr2=0x7fa89c07cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:48.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.943+0000 7fa8bc600700 1 --2- 172.21.15.111:0/63981004 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa89c07a7b0 0x7fa89c07cc60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000b540 tx=0x7fa8a0009fd0 comp rx=0 tx=0).stop 2024-09-11T00:12:48.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.944+0000 7fa8bc600700 1 -- 172.21.15.111:0/63981004 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa8b41003d0 msgr2=0x7fa8b4197fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:48.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.944+0000 7fa8bc600700 1 --2- 172.21.15.111:0/63981004 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa8b41003d0 0x7fa8b4197fd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800b700 tx=0x7fa8a800bac0 comp rx=0 tx=0).stop 2024-09-11T00:12:48.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.944+0000 7fa8bc600700 1 -- 172.21.15.111:0/63981004 shutdown_connections 2024-09-11T00:12:48.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.944+0000 7fa8bc600700 1 --2- 172.21.15.111:0/63981004 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa89c07a7b0 0x7fa89c07cc60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:48.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.944+0000 7fa8bc600700 1 --2- 172.21.15.111:0/63981004 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa8b41003d0 0x7fa8b4197fd0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:48.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.944+0000 7fa8bc600700 1 --2- 172.21.15.111:0/63981004 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa8b4100d70 0x7fa8b4198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:48.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.944+0000 7fa8bc600700 1 -- 172.21.15.111:0/63981004 >> 172.21.15.111:0/63981004 conn(0x7fa8b40fbc90 msgr2=0x7fa8b40fd300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:48.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.944+0000 7fa8bc600700 1 -- 172.21.15.111:0/63981004 shutdown_connections 2024-09-11T00:12:48.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:48.944+0000 7fa8bc600700 1 -- 172.21.15.111:0/63981004 wait complete. 2024-09-11T00:12:49.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:48 smithi203 podman[68858]: 2024-09-11 00:12:48.569594922 +0000 UTC m=+0.665712522 container remove ff8eb7ca85eafd04498a9e408b270389595b792e4184a3f36eac8a4a7b36c3c6 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi203, CEPH_POINT_RELEASE=-18.2.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212) 2024-09-11T00:12:49.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:48 smithi203 systemd[1]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@mon.smithi203.service: Deactivated successfully. 2024-09-11T00:12:49.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:48 smithi203 systemd[1]: Stopped Ceph mon.smithi203 for 03107fbe-6fd0-11ef-bcea-c7b262605968. 2024-09-11T00:12:49.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:48 smithi203 systemd[1]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@mon.smithi203.service: Consumed 12.184s CPU time. 2024-09-11T00:12:49.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.077+0000 7fd920c00700 1 -- 172.21.15.111:0/3885216945 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd91c075280 msgr2=0x7fd91c075650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:49.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.077+0000 7fd920c00700 1 --2- 172.21.15.111:0/3885216945 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd91c075280 0x7fd91c075650 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd90c009910 tx=0x7fd90c009c20 comp rx=0 tx=0).stop 2024-09-11T00:12:49.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.077+0000 7fd920c00700 1 -- 172.21.15.111:0/3885216945 shutdown_connections 2024-09-11T00:12:49.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.077+0000 7fd920c00700 1 --2- 172.21.15.111:0/3885216945 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd91c075b90 0x7fd91c110b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:49.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.077+0000 7fd920c00700 1 --2- 172.21.15.111:0/3885216945 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd91c075280 0x7fd91c075650 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:49.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.077+0000 7fd920c00700 1 -- 172.21.15.111:0/3885216945 >> 172.21.15.111:0/3885216945 conn(0x7fd91c0fdec0 msgr2=0x7fd91c1002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:49.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.078+0000 7fd920c00700 1 -- 172.21.15.111:0/3885216945 shutdown_connections 2024-09-11T00:12:49.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.078+0000 7fd920c00700 1 -- 172.21.15.111:0/3885216945 wait complete. 2024-09-11T00:12:49.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.079+0000 7fd920c00700 1 Processor -- start 2024-09-11T00:12:49.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.079+0000 7fd920c00700 1 -- start start 2024-09-11T00:12:49.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.079+0000 7fd920c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd91c075280 0x7fd91c19c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:49.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.079+0000 7fd920c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd91c075b90 0x7fd91c19c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:49.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.079+0000 7fd920c00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c19cfe0 con 0x7fd91c075280 2024-09-11T00:12:49.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.079+0000 7fd920c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c1a0d70 con 0x7fd91c075b90 2024-09-11T00:12:49.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.079+0000 7fd919400700 1 -- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd91c075b90 msgr2=0x7fd91c19c900 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.203:3300/0 2024-09-11T00:12:49.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.079+0000 7fd919400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd91c075b90 0x7fd91c19c900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T00:12:49.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.079+0000 7fd919e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd91c075280 0x7fd91c19c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:49.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.079+0000 7fd919e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd91c075280 0x7fd91c19c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44320/0 (socket says 172.21.15.111:44320) 2024-09-11T00:12:49.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.079+0000 7fd919e00700 1 -- 172.21.15.111:0/3080871396 learned_addr learned my addr 172.21.15.111:0/3080871396 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:12:49.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.080+0000 7fd919e00700 1 -- 172.21.15.111:0/3080871396 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd91c075b90 msgr2=0x7fd91c19c900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:12:49.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.080+0000 7fd919e00700 1 --2- 172.21.15.111:0/3080871396 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd91c075b90 0x7fd91c19c900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:49.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.080+0000 7fd919e00700 1 -- 172.21.15.111:0/3080871396 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90c0095f0 con 0x7fd91c075280 2024-09-11T00:12:49.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.080+0000 7fd919e00700 1 --2- 172.21.15.111:0/3080871396 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd91c075280 0x7fd91c19c3c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00b850 tx=0x7fd90c005690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:49.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.080+0000 7fd912a00700 1 -- 172.21.15.111:0/3080871396 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd90c01d070 con 0x7fd91c075280 2024-09-11T00:12:49.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.080+0000 7fd912a00700 1 -- 172.21.15.111:0/3080871396 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd90c005dc0 con 0x7fd91c075280 2024-09-11T00:12:49.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.080+0000 7fd920c00700 1 -- 172.21.15.111:0/3080871396 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91c1a0ff0 con 0x7fd91c075280 2024-09-11T00:12:49.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.080+0000 7fd912a00700 1 -- 172.21.15.111:0/3080871396 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd90c017400 con 0x7fd91c075280 2024-09-11T00:12:49.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.080+0000 7fd920c00700 1 -- 172.21.15.111:0/3080871396 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd91c1a1540 con 0x7fd91c075280 2024-09-11T00:12:49.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.082+0000 7fd920c00700 1 -- 172.21.15.111:0/3080871396 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91c10e270 con 0x7fd91c075280 2024-09-11T00:12:49.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.082+0000 7fd912a00700 1 -- 172.21.15.111:0/3080871396 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 40) v1 ==== 102584+0+0 (secure 0 0 0) 0x7fd90c003a60 con 0x7fd91c075280 2024-09-11T00:12:49.085 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.083+0000 7fd912a00700 1 --2- 172.21.15.111:0/3080871396 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd90007a7b0 0x7fd90007cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:49.085 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.083+0000 7fd912a00700 1 -- 172.21.15.111:0/3080871396 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd90c09e9b0 con 0x7fd91c075280 2024-09-11T00:12:49.086 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.084+0000 7fd919400700 1 --2- 172.21.15.111:0/3080871396 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd90007a7b0 0x7fd90007cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:49.086 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.084+0000 7fd919400700 1 --2- 172.21.15.111:0/3080871396 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd90007a7b0 0x7fd90007cc60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd91c19d9e0 tx=0x7fd908006df0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:49.089 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.088+0000 7fd912a00700 1 -- 172.21.15.111:0/3080871396 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fd90c061e90 con 0x7fd91c075280 2024-09-11T00:12:49.363 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 systemd[1]: Starting Ceph mon.smithi203 for 03107fbe-6fd0-11ef-bcea-c7b262605968... 2024-09-11T00:12:49.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.399+0000 7fd920c00700 1 -- 172.21.15.111:0/3080871396 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd91c1a1910 con 0x7fd91c075280 2024-09-11T00:12:49.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.400+0000 7fd912a00700 1 -- 172.21.15.111:0/3080871396 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+779 (secure 0 0 0) 0x7fd90c005c00 con 0x7fd91c075280 2024-09-11T00:12:49.402 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:12:49.402 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-11T00:12:49.402 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-09-11T00:12:49.402 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 1 2024-09-11T00:12:49.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:12:49.402 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-11T00:12:49.402 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:12:49.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:12:49.403 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-11T00:12:49.403 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-11T00:12:49.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:12:49.403 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-11T00:12:49.403 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-11T00:12:49.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:12:49.403 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-11T00:12:49.403 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 11, 2024-09-11T00:12:49.403 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 3 2024-09-11T00:12:49.403 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-11T00:12:49.403 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:12:49.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.402+0000 7fd920c00700 1 -- 172.21.15.111:0/3080871396 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd90007a7b0 msgr2=0x7fd90007cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:49.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.402+0000 7fd920c00700 1 --2- 172.21.15.111:0/3080871396 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd90007a7b0 0x7fd90007cc60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd91c19d9e0 tx=0x7fd908006df0 comp rx=0 tx=0).stop 2024-09-11T00:12:49.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.402+0000 7fd920c00700 1 -- 172.21.15.111:0/3080871396 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd91c075280 msgr2=0x7fd91c19c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:49.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.402+0000 7fd920c00700 1 --2- 172.21.15.111:0/3080871396 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd91c075280 0x7fd91c19c3c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00b850 tx=0x7fd90c005690 comp rx=0 tx=0).stop 2024-09-11T00:12:49.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.402+0000 7fd920c00700 1 -- 172.21.15.111:0/3080871396 shutdown_connections 2024-09-11T00:12:49.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.402+0000 7fd920c00700 1 --2- 172.21.15.111:0/3080871396 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd90007a7b0 0x7fd90007cc60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:49.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.402+0000 7fd920c00700 1 --2- 172.21.15.111:0/3080871396 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd91c075280 0x7fd91c19c3c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:49.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.402+0000 7fd920c00700 1 --2- 172.21.15.111:0/3080871396 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd91c075b90 0x7fd91c19c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:49.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.402+0000 7fd920c00700 1 -- 172.21.15.111:0/3080871396 >> 172.21.15.111:0/3080871396 conn(0x7fd91c0fdec0 msgr2=0x7fd91c0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:49.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.403+0000 7fd920c00700 1 -- 172.21.15.111:0/3080871396 shutdown_connections 2024-09-11T00:12:49.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.403+0000 7fd920c00700 1 -- 172.21.15.111:0/3080871396 wait complete. 2024-09-11T00:12:49.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.540+0000 7f8456400700 1 -- 172.21.15.111:0/2924423306 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8450075280 msgr2=0x7f8450075650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:49.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.540+0000 7f8456400700 1 --2- 172.21.15.111:0/2924423306 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8450075280 0x7f8450075650 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8440009910 tx=0x7f8440009c20 comp rx=0 tx=0).stop 2024-09-11T00:12:49.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.540+0000 7f8456400700 1 -- 172.21.15.111:0/2924423306 shutdown_connections 2024-09-11T00:12:49.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.540+0000 7f8456400700 1 --2- 172.21.15.111:0/2924423306 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8450075b90 0x7f8450110b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:49.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.540+0000 7f8456400700 1 --2- 172.21.15.111:0/2924423306 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8450075280 0x7f8450075650 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:49.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.540+0000 7f8456400700 1 -- 172.21.15.111:0/2924423306 >> 172.21.15.111:0/2924423306 conn(0x7f84500fde90 msgr2=0x7f84501002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:49.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.540+0000 7f8456400700 1 -- 172.21.15.111:0/2924423306 shutdown_connections 2024-09-11T00:12:49.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.540+0000 7f8456400700 1 -- 172.21.15.111:0/2924423306 wait complete. 2024-09-11T00:12:49.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.541+0000 7f8456400700 1 Processor -- start 2024-09-11T00:12:49.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.541+0000 7f8456400700 1 -- start start 2024-09-11T00:12:49.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.541+0000 7f8456400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8450075280 0x7f845019c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:49.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.541+0000 7f8456400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8450075b90 0x7f845019c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:49.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.541+0000 7f8456400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845019cfd0 con 0x7f8450075280 2024-09-11T00:12:49.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.541+0000 7f8456400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84501a0d60 con 0x7f8450075b90 2024-09-11T00:12:49.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.541+0000 7f844ea00700 1 -- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8450075b90 msgr2=0x7f845019c8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.203:3300/0 2024-09-11T00:12:49.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.541+0000 7f844f400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8450075280 0x7f845019c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:49.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.541+0000 7f844ea00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8450075b90 0x7f845019c8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T00:12:49.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.542+0000 7f844f400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8450075280 0x7f845019c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44342/0 (socket says 172.21.15.111:44342) 2024-09-11T00:12:49.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.542+0000 7f844f400700 1 -- 172.21.15.111:0/2738275930 learned_addr learned my addr 172.21.15.111:0/2738275930 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:12:49.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.542+0000 7f844f400700 1 -- 172.21.15.111:0/2738275930 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8450075b90 msgr2=0x7f845019c8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:12:49.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.542+0000 7f844f400700 1 --2- 172.21.15.111:0/2738275930 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8450075b90 0x7f845019c8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:49.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.542+0000 7f844f400700 1 -- 172.21.15.111:0/2738275930 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84400095f0 con 0x7f8450075280 2024-09-11T00:12:49.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.542+0000 7f844f400700 1 --2- 172.21.15.111:0/2738275930 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8450075280 0x7f845019c3b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f844000b850 tx=0x7f8440005690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:49.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.542+0000 7f8447e00700 1 -- 172.21.15.111:0/2738275930 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f844001d070 con 0x7f8450075280 2024-09-11T00:12:49.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.542+0000 7f8447e00700 1 -- 172.21.15.111:0/2738275930 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8440005dc0 con 0x7f8450075280 2024-09-11T00:12:49.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.542+0000 7f8456400700 1 -- 172.21.15.111:0/2738275930 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84501a0fe0 con 0x7f8450075280 2024-09-11T00:12:49.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.543+0000 7f8447e00700 1 -- 172.21.15.111:0/2738275930 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8440017400 con 0x7f8450075280 2024-09-11T00:12:49.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.543+0000 7f8456400700 1 -- 172.21.15.111:0/2738275930 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84501a1530 con 0x7f8450075280 2024-09-11T00:12:49.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.544+0000 7f8456400700 1 -- 172.21.15.111:0/2738275930 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845010e280 con 0x7f8450075280 2024-09-11T00:12:49.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.545+0000 7f8447e00700 1 -- 172.21.15.111:0/2738275930 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 40) v1 ==== 102584+0+0 (secure 0 0 0) 0x7f8440003a60 con 0x7f8450075280 2024-09-11T00:12:49.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.546+0000 7f8447e00700 1 --2- 172.21.15.111:0/2738275930 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f843407a7b0 0x7f843407cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:49.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.546+0000 7f8447e00700 1 -- 172.21.15.111:0/2738275930 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f844009eac0 con 0x7f8450075280 2024-09-11T00:12:49.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.546+0000 7f844ea00700 1 --2- 172.21.15.111:0/2738275930 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f843407a7b0 0x7f843407cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:49.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.547+0000 7f844ea00700 1 --2- 172.21.15.111:0/2738275930 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f843407a7b0 0x7f843407cc60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f845019d9d0 tx=0x7f843c006df0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:49.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.550+0000 7f8447e00700 1 -- 172.21.15.111:0/2738275930 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f8440061fa0 con 0x7f8450075280 2024-09-11T00:12:49.623 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 podman[68983]: 2024-09-11 00:12:49.266338303 +0000 UTC m=+0.027236986 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:12:49.624 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 podman[68983]: 2024-09-11 00:12:49.370576803 +0000 UTC m=+0.131475512 container create 45e8285e4b4dbc8497c2c1a054aea33a8768d4b88f3a0afc76880c3338fc12cc (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi203, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-11T00:12:49.624 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 podman[68983]: 2024-09-11 00:12:49.581453169 +0000 UTC m=+0.342351848 container init 45e8285e4b4dbc8497c2c1a054aea33a8768d4b88f3a0afc76880c3338fc12cc (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi203, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:12:49.624 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 podman[68983]: 2024-09-11 00:12:49.588445229 +0000 UTC m=+0.349343901 container start 45e8285e4b4dbc8497c2c1a054aea33a8768d4b88f3a0afc76880c3338fc12cc (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi203, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:12:49.638 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: set uid:gid to 167:167 (ceph:ceph) 2024-09-11T00:12:49.638 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev), process ceph-mon, pid 2 2024-09-11T00:12:49.638 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: pidfile_write: ignore empty --pid-file 2024-09-11T00:12:49.638 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: load: jerasure load: lrc 2024-09-11T00:12:49.638 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: RocksDB version: 7.9.2 2024-09-11T00:12:49.638 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Git sha 0 2024-09-11T00:12:49.638 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Compile date 2024-09-10 08:02:51 2024-09-11T00:12:49.638 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: DB SUMMARY 2024-09-11T00:12:49.638 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: DB Session ID: 1X1V8ZIUTK1971N61MNO 2024-09-11T00:12:49.638 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: CURRENT file: CURRENT 2024-09-11T00:12:49.638 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: IDENTITY file: IDENTITY 2024-09-11T00:12:49.638 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1640 Bytes 2024-09-11T00:12:49.639 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi203/store.db dir, Total Num: 1, files: 000030.sst 2024-09-11T00:12:49.639 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi203/store.db: 000028.log size: 4321360 ; 2024-09-11T00:12:49.639 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.error_if_exists: 0 2024-09-11T00:12:49.639 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.create_if_missing: 0 2024-09-11T00:12:49.639 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.paranoid_checks: 1 2024-09-11T00:12:49.639 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-11T00:12:49.639 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-11T00:12:49.639 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-11T00:12:49.639 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.env: 0x55c2481df180 2024-09-11T00:12:49.639 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.fs: PosixFileSystem 2024-09-11T00:12:49.639 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.info_log: 0x55c26cda98c0 2024-09-11T00:12:49.639 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.max_file_opening_threads: 16 2024-09-11T00:12:49.639 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.statistics: (nil) 2024-09-11T00:12:49.639 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.use_fsync: 0 2024-09-11T00:12:49.640 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.max_log_file_size: 0 2024-09-11T00:12:49.640 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-11T00:12:49.640 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-11T00:12:49.640 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.keep_log_file_num: 1000 2024-09-11T00:12:49.640 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.recycle_log_file_num: 0 2024-09-11T00:12:49.640 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.allow_fallocate: 1 2024-09-11T00:12:49.640 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.allow_mmap_reads: 0 2024-09-11T00:12:49.640 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.allow_mmap_writes: 0 2024-09-11T00:12:49.640 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.use_direct_reads: 0 2024-09-11T00:12:49.640 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-11T00:12:49.640 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.create_missing_column_families: 0 2024-09-11T00:12:49.640 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.db_log_dir: 2024-09-11T00:12:49.640 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.wal_dir: 2024-09-11T00:12:49.640 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-11T00:12:49.640 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-11T00:12:49.641 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-11T00:12:49.641 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-11T00:12:49.641 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-11T00:12:49.641 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-11T00:12:49.641 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.advise_random_on_open: 1 2024-09-11T00:12:49.641 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.db_write_buffer_size: 0 2024-09-11T00:12:49.641 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.write_buffer_manager: 0x55c26cdadb80 2024-09-11T00:12:49.641 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-11T00:12:49.641 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-11T00:12:49.641 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-11T00:12:49.641 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.rate_limiter: (nil) 2024-09-11T00:12:49.641 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-11T00:12:49.641 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.wal_recovery_mode: 2 2024-09-11T00:12:49.642 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.enable_thread_tracking: 0 2024-09-11T00:12:49.642 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.enable_pipelined_write: 0 2024-09-11T00:12:49.642 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.unordered_write: 0 2024-09-11T00:12:49.642 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-11T00:12:49.642 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-11T00:12:49.642 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-11T00:12:49.642 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-11T00:12:49.642 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.row_cache: None 2024-09-11T00:12:49.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.816+0000 7f8456400700 1 -- 172.21.15.111:0/2738275930 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f845002cd30 con 0x7f8450075280 2024-09-11T00:12:49.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.817+0000 7f8447e00700 1 -- 172.21.15.111:0/2738275930 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1921 (secure 0 0 0) 0x7f8440005c00 con 0x7f8450075280 2024-09-11T00:12:49.819 INFO:teuthology.orchestra.run.smithi111.stdout:e15 2024-09-11T00:12:49.819 INFO:teuthology.orchestra.run.smithi111.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-11T00:12:49.819 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T00:12:49.820 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:12:49.820 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-11T00:12:49.820 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:12:49.820 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-11T00:12:49.820 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-11T00:12:49.820 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 14 2024-09-11T00:12:49.820 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-11T00:12:49.820 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-11T00:03:47.950356+0000 2024-09-11T00:12:49.820 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-11T00:04:06.275905+0000 2024-09-11T00:12:49.820 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-11T00:12:49.820 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-11T00:12:49.820 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-11T00:12:49.820 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-11T00:12:49.821 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-11T00:12:49.821 INFO:teuthology.orchestra.run.smithi111.stdout:max_xattr_size 65536 2024-09-11T00:12:49.821 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-11T00:12:49.821 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-11T00:12:49.821 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 47 2024-09-11T00:12:49.821 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:12:49.821 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-11T00:12:49.821 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-11T00:12:49.821 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=24363} 2024-09-11T00:12:49.821 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-11T00:12:49.821 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-11T00:12:49.821 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-11T00:12:49.821 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-11T00:12:49.821 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-11T00:12:49.821 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data enabled 2024-09-11T00:12:49.822 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-11T00:12:49.822 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-11T00:12:49.822 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 1 2024-09-11T00:12:49.822 INFO:teuthology.orchestra.run.smithi111.stdout:qdb_cluster leader: 0 members: 2024-09-11T00:12:49.822 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.tcrqop{0:24363} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.203:6824/3082736449,v1:172.21.15.203:6825/3082736449] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:12:49.822 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:12:49.822 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:12:49.822 INFO:teuthology.orchestra.run.smithi111.stdout:Standby daemons: 2024-09-11T00:12:49.822 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:12:49.822 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.rucaba{-1:14554} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6828/2045133285,v1:172.21.15.111:6829/2045133285] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:12:49.822 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.gmgsay{-1:14566} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.111:6826/1122545830,v1:172.21.15.111:6827/1122545830] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:12:49.822 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.uqkbkn{-1:24379} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.203:6826/695613114,v1:172.21.15.203:6827/695613114] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:12:49.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.820+0000 7f8456400700 1 -- 172.21.15.111:0/2738275930 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f843407a7b0 msgr2=0x7f843407cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:49.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.820+0000 7f8456400700 1 --2- 172.21.15.111:0/2738275930 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f843407a7b0 0x7f843407cc60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f845019d9d0 tx=0x7f843c006df0 comp rx=0 tx=0).stop 2024-09-11T00:12:49.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.820+0000 7f8456400700 1 -- 172.21.15.111:0/2738275930 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8450075280 msgr2=0x7f845019c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:49.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.820+0000 7f8456400700 1 --2- 172.21.15.111:0/2738275930 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8450075280 0x7f845019c3b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f844000b850 tx=0x7f8440005690 comp rx=0 tx=0).stop 2024-09-11T00:12:49.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.820+0000 7f8456400700 1 -- 172.21.15.111:0/2738275930 shutdown_connections 2024-09-11T00:12:49.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.820+0000 7f8456400700 1 --2- 172.21.15.111:0/2738275930 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f843407a7b0 0x7f843407cc60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:49.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.820+0000 7f8456400700 1 --2- 172.21.15.111:0/2738275930 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8450075280 0x7f845019c3b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:49.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.820+0000 7f8456400700 1 --2- 172.21.15.111:0/2738275930 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8450075b90 0x7f845019c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:49.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.820+0000 7f8456400700 1 -- 172.21.15.111:0/2738275930 >> 172.21.15.111:0/2738275930 conn(0x7f84500fde90 msgr2=0x7f84500feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:49.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.820+0000 7f8456400700 1 -- 172.21.15.111:0/2738275930 shutdown_connections 2024-09-11T00:12:49.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:49.820+0000 7f8456400700 1 -- 172.21.15.111:0/2738275930 wait complete. 2024-09-11T00:12:49.824 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 15 2024-09-11T00:12:49.952 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.wal_filter: None 2024-09-11T00:12:49.952 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-11T00:12:49.952 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.allow_ingest_behind: 0 2024-09-11T00:12:49.952 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.two_write_queues: 0 2024-09-11T00:12:49.953 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.manual_wal_flush: 0 2024-09-11T00:12:49.953 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.wal_compression: 0 2024-09-11T00:12:49.953 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.atomic_flush: 0 2024-09-11T00:12:49.953 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-11T00:12:49.953 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-11T00:12:49.953 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-11T00:12:49.953 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.log_readahead_size: 0 2024-09-11T00:12:49.953 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-11T00:12:49.953 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.best_efforts_recovery: 0 2024-09-11T00:12:49.953 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-11T00:12:49.953 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-11T00:12:49.953 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.allow_data_in_errors: 0 2024-09-11T00:12:49.953 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.db_host_id: __hostname__ 2024-09-11T00:12:49.954 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-11T00:12:49.954 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.max_background_jobs: 2 2024-09-11T00:12:49.954 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.max_background_compactions: -1 2024-09-11T00:12:49.954 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.max_subcompactions: 1 2024-09-11T00:12:49.954 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-11T00:12:49.954 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-11T00:12:49.954 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-11T00:12:49.954 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.max_total_wal_size: 0 2024-09-11T00:12:49.954 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-11T00:12:49.954 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-11T00:12:49.954 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-11T00:12:49.954 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-11T00:12:49.954 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.max_open_files: -1 2024-09-11T00:12:49.955 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.bytes_per_sync: 0 2024-09-11T00:12:49.955 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-11T00:12:49.955 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-11T00:12:49.955 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.compaction_readahead_size: 0 2024-09-11T00:12:49.955 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.max_background_flushes: -1 2024-09-11T00:12:49.955 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Compression algorithms supported: 2024-09-11T00:12:49.955 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: kZSTD supported: 0 2024-09-11T00:12:49.955 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: kXpressCompression supported: 0 2024-09-11T00:12:49.955 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: kBZip2Compression supported: 0 2024-09-11T00:12:49.955 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-11T00:12:49.955 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: kLZ4Compression supported: 1 2024-09-11T00:12:49.955 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: kZlibCompression supported: 1 2024-09-11T00:12:49.955 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: kLZ4HCCompression supported: 1 2024-09-11T00:12:49.955 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: kSnappyCompression supported: 1 2024-09-11T00:12:49.956 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-11T00:12:49.956 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-11T00:12:49.956 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi203/store.db/MANIFEST-000010 2024-09-11T00:12:49.956 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-11T00:12:49.956 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-11T00:12:49.956 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.merge_operator: 2024-09-11T00:12:49.956 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.compaction_filter: None 2024-09-11T00:12:49.956 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.compaction_filter_factory: None 2024-09-11T00:12:49.956 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.sst_partitioner_factory: None 2024-09-11T00:12:49.956 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-11T00:12:49.956 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-11T00:12:49.956 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c26cda9500) 2024-09-11T00:12:49.956 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: cache_index_and_filter_blocks: 1 2024-09-11T00:12:49.957 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-11T00:12:49.957 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-11T00:12:49.957 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: pin_top_level_index_and_filter: 1 2024-09-11T00:12:49.957 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: index_type: 0 2024-09-11T00:12:49.957 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: data_block_index_type: 0 2024-09-11T00:12:49.957 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: index_shortening: 1 2024-09-11T00:12:49.957 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-11T00:12:49.957 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: checksum: 4 2024-09-11T00:12:49.957 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: no_block_cache: 0 2024-09-11T00:12:49.957 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_cache: 0x55c26cd9d610 2024-09-11T00:12:49.957 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_cache_name: BinnedLRUCache 2024-09-11T00:12:49.957 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_cache_options: 2024-09-11T00:12:49.957 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: capacity : 536870912 2024-09-11T00:12:49.957 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: num_shard_bits : 4 2024-09-11T00:12:49.958 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: strict_capacity_limit : 0 2024-09-11T00:12:49.958 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: high_pri_pool_ratio: 0.000 2024-09-11T00:12:49.958 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_cache_compressed: (nil) 2024-09-11T00:12:49.958 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: persistent_cache: (nil) 2024-09-11T00:12:49.958 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_size: 4096 2024-09-11T00:12:49.958 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_size_deviation: 10 2024-09-11T00:12:49.958 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_restart_interval: 16 2024-09-11T00:12:49.958 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: index_block_restart_interval: 1 2024-09-11T00:12:49.958 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: metadata_block_size: 4096 2024-09-11T00:12:49.958 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: partition_filters: 0 2024-09-11T00:12:49.958 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: use_delta_encoding: 1 2024-09-11T00:12:49.958 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: filter_policy: bloomfilter 2024-09-11T00:12:49.958 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: whole_key_filtering: 1 2024-09-11T00:12:49.958 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: verify_compression: 0 2024-09-11T00:12:49.959 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: read_amp_bytes_per_bit: 0 2024-09-11T00:12:49.959 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: format_version: 5 2024-09-11T00:12:49.959 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: enable_index_compression: 1 2024-09-11T00:12:49.959 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_align: 0 2024-09-11T00:12:49.959 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: max_auto_readahead_size: 262144 2024-09-11T00:12:49.959 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: prepopulate_block_cache: 0 2024-09-11T00:12:49.960 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: initial_auto_readahead_size: 8192 2024-09-11T00:12:49.960 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: num_file_reads_for_auto_readahead: 2 2024-09-11T00:12:49.961 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.write_buffer_size: 33554432 2024-09-11T00:12:49.961 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.max_write_buffer_number: 2 2024-09-11T00:12:49.961 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.compression: NoCompression 2024-09-11T00:12:49.961 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.bottommost_compression: Disabled 2024-09-11T00:12:49.961 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.prefix_extractor: nullptr 2024-09-11T00:12:49.961 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-11T00:12:49.963 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.num_levels: 7 2024-09-11T00:12:49.963 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-11T00:12:49.963 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-11T00:12:49.963 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-11T00:12:49.963 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-11T00:12:49.963 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-11T00:12:49.963 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-11T00:12:49.963 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-11T00:12:49.963 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-11T00:12:49.963 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-11T00:12:49.964 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-11T00:12:49.964 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-11T00:12:49.964 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-11T00:12:49.965 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-11T00:12:49.965 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.compression_opts.level: 32767 2024-09-11T00:12:49.965 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.compression_opts.strategy: 0 2024-09-11T00:12:49.965 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-11T00:12:49.965 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-11T00:12:49.965 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-11T00:12:49.965 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-11T00:12:49.965 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.compression_opts.enabled: false 2024-09-11T00:12:49.965 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-11T00:12:49.965 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-11T00:12:49.965 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-11T00:12:49.966 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-11T00:12:49.966 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.target_file_size_base: 67108864 2024-09-11T00:12:49.966 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-11T00:12:49.966 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-11T00:12:49.966 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-11T00:12:49.966 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-11T00:12:49.966 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-11T00:12:49.966 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-11T00:12:49.966 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-11T00:12:49.966 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-11T00:12:49.966 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-11T00:12:49.966 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-11T00:12:49.966 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-11T00:12:49.967 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-11T00:12:49.967 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-11T00:12:49.967 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-11T00:12:49.967 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.arena_block_size: 1048576 2024-09-11T00:12:49.967 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-11T00:12:49.967 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-11T00:12:49.967 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.disable_auto_compactions: 0 2024-09-11T00:12:49.967 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-11T00:12:49.967 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-11T00:12:49.967 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-11T00:12:49.967 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-11T00:12:49.967 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-11T00:12:49.967 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-11T00:12:49.968 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-11T00:12:49.968 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-11T00:12:49.968 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-11T00:12:49.968 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-11T00:12:49.968 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-11T00:12:49.968 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.inplace_update_support: 0 2024-09-11T00:12:49.968 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-11T00:12:49.968 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-11T00:12:49.968 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-11T00:12:49.968 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-11T00:12:49.968 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.bloom_locality: 0 2024-09-11T00:12:49.968 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.max_successive_merges: 0 2024-09-11T00:12:49.968 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-11T00:12:49.968 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.paranoid_file_checks: 0 2024-09-11T00:12:49.969 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.force_consistency_checks: 1 2024-09-11T00:12:49.969 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.report_bg_io_stats: 0 2024-09-11T00:12:49.969 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.ttl: 2592000 2024-09-11T00:12:49.969 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-11T00:12:49.969 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-11T00:12:49.969 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-11T00:12:49.969 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.enable_blob_files: false 2024-09-11T00:12:49.969 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.min_blob_size: 0 2024-09-11T00:12:49.969 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.blob_file_size: 268435456 2024-09-11T00:12:49.969 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-11T00:12:49.969 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-11T00:12:49.969 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-11T00:12:49.970 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-11T00:12:49.970 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-11T00:12:49.970 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.blob_file_starting_level: 0 2024-09-11T00:12:49.970 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-11T00:12:49.970 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-11T00:12:49.970 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi203/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 32, last_sequence is 17041, log_number is 28,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 28 2024-09-11T00:12:49.970 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 28 2024-09-11T00:12:49.970 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d29fcba7-47d2-4735-8a81-a3f61f0aa350 2024-09-11T00:12:49.970 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726013569631219, "job": 1, "event": "recovery_started", "wal_files": [28]} 2024-09-11T00:12:49.970 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #28 mode 2 2024-09-11T00:12:49.970 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726013569647097, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 33, "file_size": 2735959, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 17046, "largest_seqno": 18774, "table_properties": {"data_size": 2729005, "index_size": 4180, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1733, "raw_key_size": 16598, "raw_average_key_size": 24, "raw_value_size": 2714410, "raw_average_value_size": 3945, "num_data_blocks": 189, "num_entries": 688, "num_filter_entries": 688, "num_deletions": 6, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726013569, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d29fcba7-47d2-4735-8a81-a3f61f0aa350", "db_session_id": "1X1V8ZIUTK1971N61MNO", "orig_file_number": 33, "seqno_to_time_mapping": "N/A"}} 2024-09-11T00:12:49.970 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726013569647331, "job": 1, "event": "recovery_finished"} 2024-09-11T00:12:49.970 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: [db/version_set.cc:5047] Creating manifest 35 2024-09-11T00:12:49.971 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-11T00:12:49.971 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi203/store.db/000028.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-11T00:12:49.971 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c26cdcee00 2024-09-11T00:12:49.971 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: DB pointer 0x55c26cece000 2024-09-11T00:12:49.971 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-11T00:12:49.971 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-11T00:12:49.971 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: ** DB Stats ** 2024-09-11T00:12:49.971 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T00:12:49.971 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-11T00:12:49.971 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T00:12:49.971 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T00:12:49.971 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-11T00:12:49.971 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T00:12:49.971 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T00:12:49.972 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-09-11T00:12:49.972 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: ** Compaction Stats [default] ** 2024-09-11T00:12:49.972 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T00:12:49.972 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-11T00:12:49.972 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: L0 1/0 2.61 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 548.5 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-09-11T00:12:49.972 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: L6 1/0 8.43 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-11T00:12:49.972 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Sum 2/0 11.04 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 548.5 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-09-11T00:12:49.972 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 548.5 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-09-11T00:12:49.972 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-09-11T00:12:49.972 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: ** Compaction Stats [default] ** 2024-09-11T00:12:49.972 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T00:12:49.972 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-11T00:12:49.972 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 548.5 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-09-11T00:12:49.972 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-09-11T00:12:49.973 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-11T00:12:49.973 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-09-11T00:12:49.973 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T00:12:49.973 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-09-11T00:12:49.973 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-11T00:12:49.973 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-11T00:12:49.973 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-11T00:12:49.973 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-11T00:12:49.973 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Cumulative compaction: 0.00 GB write, 123.09 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T00:12:49.973 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Interval compaction: 0.00 GB write, 123.09 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T00:12:49.973 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-11T00:12:49.973 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Block cache BinnedLRUCache@0x55c26cd9d610#2 capacity: 512.00 MB usage: 6.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-09-11T00:12:49.973 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.78 KB,0.000339746%) IndexBlock(1,4.58 KB,0.000873208%) Misc(1,0.00 KB,0%) 2024-09-11T00:12:49.974 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-09-11T00:12:49.974 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-11T00:12:49.974 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: starting mon.smithi203 rank 1 at public addrs [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] at bind addrs [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi203 fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 2024-09-11T00:12:49.974 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: mon.smithi203@-1(???) e2 preinit fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 2024-09-11T00:12:49.974 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: mon.smithi203@-1(???).mds e15 new map 2024-09-11T00:12:49.974 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: mon.smithi203@-1(???).mds e15 print_map 2024-09-11T00:12:49.974 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: e15 2024-09-11T00:12:49.974 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-11T00:12:49.974 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T00:12:49.974 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:12:49.974 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: legacy client fscid: 1 2024-09-11T00:12:49.974 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-09-11T00:12:49.974 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Filesystem 'cephfs' (1) 2024-09-11T00:12:49.975 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: fs_name cephfs 2024-09-11T00:12:49.975 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: epoch 14 2024-09-11T00:12:49.975 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-11T00:12:49.975 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: created 2024-09-11T00:03:47.950356+0000 2024-09-11T00:12:49.975 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: modified 2024-09-11T00:04:06.275905+0000 2024-09-11T00:12:49.975 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: tableserver 0 2024-09-11T00:12:49.975 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: root 0 2024-09-11T00:12:49.975 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: session_timeout 60 2024-09-11T00:12:49.975 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: session_autoclose 300 2024-09-11T00:12:49.975 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: max_file_size 1099511627776 2024-09-11T00:12:49.975 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: max_xattr_size 65536 2024-09-11T00:12:49.975 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: required_client_features {} 2024-09-11T00:12:49.975 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: last_failure 0 2024-09-11T00:12:49.975 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: last_failure_osd_epoch 47 2024-09-11T00:12:49.976 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:12:49.976 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: max_mds 1 2024-09-11T00:12:49.976 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: in 0 2024-09-11T00:12:49.976 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: up {0=24363} 2024-09-11T00:12:49.976 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: failed 2024-09-11T00:12:49.976 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: damaged 2024-09-11T00:12:49.976 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: stopped 2024-09-11T00:12:49.976 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: data_pools [3] 2024-09-11T00:12:49.976 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: metadata_pool 2 2024-09-11T00:12:49.976 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: inline_data enabled 2024-09-11T00:12:49.976 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: balancer 2024-09-11T00:12:49.976 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: bal_rank_mask -1 2024-09-11T00:12:49.976 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: standby_count_wanted 1 2024-09-11T00:12:49.977 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: qdb_cluster leader: 0 members: 2024-09-11T00:12:49.977 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: [mds.cephfs.smithi203.tcrqop{0:24363} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.203:6824/3082736449,v1:172.21.15.203:6825/3082736449] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:12:49.977 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-09-11T00:12:49.977 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-09-11T00:12:49.977 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Standby daemons: 2024-09-11T00:12:49.977 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-09-11T00:12:49.977 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: [mds.cephfs.smithi111.rucaba{-1:14554} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6828/2045133285,v1:172.21.15.111:6829/2045133285] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:12:49.977 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: [mds.cephfs.smithi111.gmgsay{-1:14566} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.111:6826/1122545830,v1:172.21.15.111:6827/1122545830] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:12:49.977 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: [mds.cephfs.smithi203.uqkbkn{-1:24379} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.203:6826/695613114,v1:172.21.15.203:6827/695613114] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:12:49.977 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: mon.smithi203@-1(???).osd e50 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-11T00:12:49.977 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: mon.smithi203@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-09-11T00:12:49.977 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: mon.smithi203@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-09-11T00:12:49.977 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: mon.smithi203@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-09-11T00:12:49.977 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: mon.smithi203@-1(???).paxosservice(auth 1..25) refresh upgraded, format 0 -> 3 2024-09-11T00:12:49.978 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 bash[68983]: 45e8285e4b4dbc8497c2c1a054aea33a8768d4b88f3a0afc76880c3338fc12cc 2024-09-11T00:12:49.978 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 systemd[1]: Started Ceph mon.smithi203 for 03107fbe-6fd0-11ef-bcea-c7b262605968. 2024-09-11T00:12:49.978 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:49 smithi203 ceph-mon[69002]: pgmap v12: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-11T00:12:50.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:49 smithi111 ceph-mon[90842]: pgmap v12: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-11T00:12:50.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.166+0000 7ff2f8c00700 1 -- 172.21.15.111:0/482526544 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2f41003b0 msgr2=0x7ff2f4100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:50.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.166+0000 7ff2f8c00700 1 --2- 172.21.15.111:0/482526544 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2f41003b0 0x7ff2f4100780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400ba60 tx=0x7ff2e400bd70 comp rx=0 tx=0).stop 2024-09-11T00:12:50.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.166+0000 7ff2f8c00700 1 -- 172.21.15.111:0/482526544 shutdown_connections 2024-09-11T00:12:50.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.166+0000 7ff2f8c00700 1 --2- 172.21.15.111:0/482526544 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2f4100d50 0x7ff2f4104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:50.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.166+0000 7ff2f8c00700 1 --2- 172.21.15.111:0/482526544 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2f41003b0 0x7ff2f4100780 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:50.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.166+0000 7ff2f8c00700 1 -- 172.21.15.111:0/482526544 >> 172.21.15.111:0/482526544 conn(0x7ff2f40fbc30 msgr2=0x7ff2f40fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:50.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.166+0000 7ff2f8c00700 1 -- 172.21.15.111:0/482526544 shutdown_connections 2024-09-11T00:12:50.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.166+0000 7ff2f8c00700 1 -- 172.21.15.111:0/482526544 wait complete. 2024-09-11T00:12:50.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.167+0000 7ff2f8c00700 1 Processor -- start 2024-09-11T00:12:50.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.167+0000 7ff2f8c00700 1 -- start start 2024-09-11T00:12:50.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.167+0000 7ff2f8c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2f41003b0 0x7ff2f4197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:50.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.167+0000 7ff2f8c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2f4100d50 0x7ff2f4198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:50.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.167+0000 7ff2f8c00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f4198b00 con 0x7ff2f41003b0 2024-09-11T00:12:50.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.167+0000 7ff2f8c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f419c890 con 0x7ff2f4100d50 2024-09-11T00:12:50.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.168+0000 7ff2f1e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2f41003b0 0x7ff2f4197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:50.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.168+0000 7ff2f1e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2f41003b0 0x7ff2f4197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44390/0 (socket says 172.21.15.111:44390) 2024-09-11T00:12:50.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.168+0000 7ff2f1e00700 1 -- 172.21.15.111:0/2653356134 learned_addr learned my addr 172.21.15.111:0/2653356134 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:12:50.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.168+0000 7ff2f1400700 1 --2- 172.21.15.111:0/2653356134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2f4100d50 0x7ff2f4198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:50.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.168+0000 7ff2f1400700 1 -- 172.21.15.111:0/2653356134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2f4100d50 msgr2=0x7ff2f4198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-11T00:12:50.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.168+0000 7ff2f1400700 1 -- 172.21.15.111:0/2653356134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2f4100d50 msgr2=0x7ff2f4198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T00:12:50.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.168+0000 7ff2f1400700 1 --2- 172.21.15.111:0/2653356134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2f4100d50 0x7ff2f4198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T00:12:50.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.168+0000 7ff2f1400700 1 --2- 172.21.15.111:0/2653356134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2f4100d50 0x7ff2f4198420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T00:12:50.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.168+0000 7ff2f1e00700 1 -- 172.21.15.111:0/2653356134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2f4100d50 msgr2=0x7ff2f4198420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:12:50.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.168+0000 7ff2f1e00700 1 --2- 172.21.15.111:0/2653356134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2f4100d50 0x7ff2f4198420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:50.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.168+0000 7ff2f1e00700 1 -- 172.21.15.111:0/2653356134 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e400b740 con 0x7ff2f41003b0 2024-09-11T00:12:50.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.168+0000 7ff2f1e00700 1 --2- 172.21.15.111:0/2653356134 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2f41003b0 0x7ff2f4197ee0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4000c00 tx=0x7ff2e4005440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:50.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.169+0000 7ff2eaa00700 1 -- 172.21.15.111:0/2653356134 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2e4003850 con 0x7ff2f41003b0 2024-09-11T00:12:50.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.169+0000 7ff2eaa00700 1 -- 172.21.15.111:0/2653356134 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff2e4003e70 con 0x7ff2f41003b0 2024-09-11T00:12:50.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.169+0000 7ff2f8c00700 1 -- 172.21.15.111:0/2653356134 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f419cb10 con 0x7ff2f41003b0 2024-09-11T00:12:50.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.169+0000 7ff2eaa00700 1 -- 172.21.15.111:0/2653356134 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2e401c450 con 0x7ff2f41003b0 2024-09-11T00:12:50.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.169+0000 7ff2f8c00700 1 -- 172.21.15.111:0/2653356134 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f419d000 con 0x7ff2f41003b0 2024-09-11T00:12:50.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.170+0000 7ff2f8c00700 1 -- 172.21.15.111:0/2653356134 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f41044a0 con 0x7ff2f41003b0 2024-09-11T00:12:50.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.171+0000 7ff2eaa00700 1 -- 172.21.15.111:0/2653356134 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 40) v1 ==== 102584+0+0 (secure 0 0 0) 0x7ff2e4022020 con 0x7ff2f41003b0 2024-09-11T00:12:50.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.173+0000 7ff2eaa00700 1 --2- 172.21.15.111:0/2653356134 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7ff2d807a800 0x7ff2d807ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:50.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.173+0000 7ff2eaa00700 1 -- 172.21.15.111:0/2653356134 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ff2e409ef60 con 0x7ff2f41003b0 2024-09-11T00:12:50.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.173+0000 7ff2f1400700 1 --2- 172.21.15.111:0/2653356134 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7ff2d807a800 0x7ff2d807ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:50.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.174+0000 7ff2f1400700 1 --2- 172.21.15.111:0/2653356134 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7ff2d807a800 0x7ff2d807ccb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0005d90 tx=0x7ff2e0005ce0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:50.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.177+0000 7ff2eaa00700 1 -- 172.21.15.111:0/2653356134 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7ff2e40d6220 con 0x7ff2f41003b0 2024-09-11T00:12:50.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.417+0000 7ff2f8c00700 1 -- 172.21.15.111:0/2653356134 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2f402cd90 con 0x7ff2d807a800 2024-09-11T00:12:50.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.419+0000 7ff2eaa00700 1 -- 172.21.15.111:0/2653356134 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7ff2f402cd90 con 0x7ff2d807a800 2024-09-11T00:12:50.421 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:12:50.421 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e", 2024-09-11T00:12:50.421 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-11T00:12:50.421 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-11T00:12:50.421 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-11T00:12:50.421 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr" 2024-09-11T00:12:50.421 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-11T00:12:50.421 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "3/23 daemons upgraded", 2024-09-11T00:12:50.422 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading mon daemons", 2024-09-11T00:12:50.422 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-11T00:12:50.422 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:12:50.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.421+0000 7ff2f8c00700 1 -- 172.21.15.111:0/2653356134 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7ff2d807a800 msgr2=0x7ff2d807ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:50.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.421+0000 7ff2f8c00700 1 --2- 172.21.15.111:0/2653356134 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7ff2d807a800 0x7ff2d807ccb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0005d90 tx=0x7ff2e0005ce0 comp rx=0 tx=0).stop 2024-09-11T00:12:50.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.421+0000 7ff2f8c00700 1 -- 172.21.15.111:0/2653356134 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2f41003b0 msgr2=0x7ff2f4197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:50.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.421+0000 7ff2f8c00700 1 --2- 172.21.15.111:0/2653356134 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2f41003b0 0x7ff2f4197ee0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4000c00 tx=0x7ff2e4005440 comp rx=0 tx=0).stop 2024-09-11T00:12:50.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.421+0000 7ff2f8c00700 1 -- 172.21.15.111:0/2653356134 shutdown_connections 2024-09-11T00:12:50.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.421+0000 7ff2f8c00700 1 --2- 172.21.15.111:0/2653356134 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7ff2d807a800 0x7ff2d807ccb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:50.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.421+0000 7ff2f8c00700 1 --2- 172.21.15.111:0/2653356134 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2f41003b0 0x7ff2f4197ee0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:50.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.421+0000 7ff2f8c00700 1 --2- 172.21.15.111:0/2653356134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2f4100d50 0x7ff2f4198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:50.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.421+0000 7ff2f8c00700 1 -- 172.21.15.111:0/2653356134 >> 172.21.15.111:0/2653356134 conn(0x7ff2f40fbc30 msgr2=0x7ff2f40fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:50.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.422+0000 7ff2f8c00700 1 -- 172.21.15.111:0/2653356134 shutdown_connections 2024-09-11T00:12:50.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.422+0000 7ff2f8c00700 1 -- 172.21.15.111:0/2653356134 wait complete. 2024-09-11T00:12:50.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.557+0000 7f4f3c000700 1 -- 172.21.15.111:0/876552055 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4f34102600 msgr2=0x7f4f341029d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:50.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.557+0000 7f4f3c000700 1 --2- 172.21.15.111:0/876552055 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4f34102600 0x7f4f341029d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4f28009910 tx=0x7f4f28009c20 comp rx=0 tx=0).stop 2024-09-11T00:12:50.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.557+0000 7f4f3c000700 1 -- 172.21.15.111:0/876552055 shutdown_connections 2024-09-11T00:12:50.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.557+0000 7f4f3c000700 1 --2- 172.21.15.111:0/876552055 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f34102fa0 0x7f4f34106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:50.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.557+0000 7f4f3c000700 1 --2- 172.21.15.111:0/876552055 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4f34102600 0x7f4f341029d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:50.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.557+0000 7f4f3c000700 1 -- 172.21.15.111:0/876552055 >> 172.21.15.111:0/876552055 conn(0x7f4f340fdec0 msgr2=0x7f4f341002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:50.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.557+0000 7f4f3c000700 1 -- 172.21.15.111:0/876552055 shutdown_connections 2024-09-11T00:12:50.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.557+0000 7f4f3c000700 1 -- 172.21.15.111:0/876552055 wait complete. 2024-09-11T00:12:50.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.558+0000 7f4f3c000700 1 Processor -- start 2024-09-11T00:12:50.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.558+0000 7f4f3c000700 1 -- start start 2024-09-11T00:12:50.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.558+0000 7f4f3c000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f34102600 0x7f4f34197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:50.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.558+0000 7f4f3c000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4f34102fa0 0x7f4f34198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:50.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.558+0000 7f4f3c000700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f34198bf0 con 0x7f4f34102fa0 2024-09-11T00:12:50.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.558+0000 7f4f3c000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3419c980 con 0x7f4f34102600 2024-09-11T00:12:50.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.559+0000 7f4f38c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4f34102fa0 0x7f4f34198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:50.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.559+0000 7f4f39600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f34102600 0x7f4f34197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:50.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.559+0000 7f4f39600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f34102600 0x7f4f34197fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.111:38008/0 (socket says 172.21.15.111:38008) 2024-09-11T00:12:50.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.559+0000 7f4f39600700 1 -- 172.21.15.111:0/2493157391 learned_addr learned my addr 172.21.15.111:0/2493157391 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:12:50.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.559+0000 7f4f39600700 1 -- 172.21.15.111:0/2493157391 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f34102600 msgr2=0x7f4f34197fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-11T00:12:50.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.559+0000 7f4f39600700 1 -- 172.21.15.111:0/2493157391 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f34102600 msgr2=0x7f4f34197fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T00:12:50.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.559+0000 7f4f39600700 1 --2- 172.21.15.111:0/2493157391 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f34102600 0x7f4f34197fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T00:12:50.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.559+0000 7f4f39600700 1 --2- 172.21.15.111:0/2493157391 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f34102600 0x7f4f34197fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T00:12:50.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.559+0000 7f4f38c00700 1 -- 172.21.15.111:0/2493157391 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f34102600 msgr2=0x7f4f34197fd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T00:12:50.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.559+0000 7f4f38c00700 1 --2- 172.21.15.111:0/2493157391 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f34102600 0x7f4f34197fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:50.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.559+0000 7f4f38c00700 1 -- 172.21.15.111:0/2493157391 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f280095f0 con 0x7f4f34102fa0 2024-09-11T00:12:50.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.559+0000 7f4f38c00700 1 --2- 172.21.15.111:0/2493157391 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4f34102fa0 0x7f4f34198510 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4f20005ee0 tx=0x7f4f2000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:50.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.560+0000 7f4f32000700 1 -- 172.21.15.111:0/2493157391 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f20004a00 con 0x7f4f34102fa0 2024-09-11T00:12:50.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.560+0000 7f4f32000700 1 -- 172.21.15.111:0/2493157391 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f2000b5c0 con 0x7f4f34102fa0 2024-09-11T00:12:50.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.560+0000 7f4f3c000700 1 -- 172.21.15.111:0/2493157391 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3419cc60 con 0x7f4f34102fa0 2024-09-11T00:12:50.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.560+0000 7f4f32000700 1 -- 172.21.15.111:0/2493157391 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f20009b20 con 0x7f4f34102fa0 2024-09-11T00:12:50.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.560+0000 7f4f3c000700 1 -- 172.21.15.111:0/2493157391 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3419d1b0 con 0x7f4f34102fa0 2024-09-11T00:12:50.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.561+0000 7f4f3c000700 1 -- 172.21.15.111:0/2493157391 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f3404ea50 con 0x7f4f34102fa0 2024-09-11T00:12:50.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.562+0000 7f4f32000700 1 -- 172.21.15.111:0/2493157391 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 40) v1 ==== 102584+0+0 (secure 0 0 0) 0x7f4f20004bf0 con 0x7f4f34102fa0 2024-09-11T00:12:50.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.563+0000 7f4f32000700 1 --2- 172.21.15.111:0/2493157391 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4f1c07a850 0x7f4f1c07cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:50.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.563+0000 7f4f32000700 1 -- 172.21.15.111:0/2493157391 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f4f2009cd20 con 0x7f4f34102fa0 2024-09-11T00:12:50.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.563+0000 7f4f39600700 1 --2- 172.21.15.111:0/2493157391 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4f1c07a850 0x7f4f1c07cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:50.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.564+0000 7f4f39600700 1 --2- 172.21.15.111:0/2493157391 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4f1c07a850 0x7f4f1c07cd00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4f28005b40 tx=0x7f4f2801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:50.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.567+0000 7f4f32000700 1 -- 172.21.15.111:0/2493157391 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f4f200a2020 con 0x7f4f34102fa0 2024-09-11T00:12:50.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.876+0000 7f4f3c000700 1 -- 172.21.15.111:0/2493157391 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4f3419d670 con 0x7f4f34102fa0 2024-09-11T00:12:50.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.876+0000 7f4f32000700 1 -- 172.21.15.111:0/2493157391 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f4f200200e0 con 0x7f4f34102fa0 2024-09-11T00:12:50.881 INFO:teuthology.orchestra.run.smithi111.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-11T00:12:50.881 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-11T00:12:50.881 INFO:teuthology.orchestra.run.smithi111.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-11T00:12:50.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.879+0000 7f4f3c000700 1 -- 172.21.15.111:0/2493157391 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4f1c07a850 msgr2=0x7f4f1c07cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:50.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.879+0000 7f4f3c000700 1 --2- 172.21.15.111:0/2493157391 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4f1c07a850 0x7f4f1c07cd00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4f28005b40 tx=0x7f4f2801a040 comp rx=0 tx=0).stop 2024-09-11T00:12:50.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.879+0000 7f4f3c000700 1 -- 172.21.15.111:0/2493157391 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4f34102fa0 msgr2=0x7f4f34198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:50.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.879+0000 7f4f3c000700 1 --2- 172.21.15.111:0/2493157391 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4f34102fa0 0x7f4f34198510 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4f20005ee0 tx=0x7f4f2000dc60 comp rx=0 tx=0).stop 2024-09-11T00:12:50.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.879+0000 7f4f3c000700 1 -- 172.21.15.111:0/2493157391 shutdown_connections 2024-09-11T00:12:50.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.879+0000 7f4f3c000700 1 --2- 172.21.15.111:0/2493157391 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4f1c07a850 0x7f4f1c07cd00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:50.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.879+0000 7f4f3c000700 1 --2- 172.21.15.111:0/2493157391 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f34102600 0x7f4f34197fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:50.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.879+0000 7f4f3c000700 1 --2- 172.21.15.111:0/2493157391 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4f34102fa0 0x7f4f34198510 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:50.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.879+0000 7f4f3c000700 1 -- 172.21.15.111:0/2493157391 >> 172.21.15.111:0/2493157391 conn(0x7f4f340fdec0 msgr2=0x7f4f340ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:50.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.879+0000 7f4f3c000700 1 -- 172.21.15.111:0/2493157391 shutdown_connections 2024-09-11T00:12:50.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:12:50.879+0000 7f4f3c000700 1 -- 172.21.15.111:0/2493157391 wait complete. 2024-09-11T00:12:51.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:50 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mon metadata", "id": "smithi111"} : dispatch 2024-09-11T00:12:51.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:50 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mon metadata", "id": "smithi203"} : dispatch 2024-09-11T00:12:51.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:50 smithi111 ceph-mon[90842]: mon.smithi111 calling monitor election 2024-09-11T00:12:51.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:50 smithi111 ceph-mon[90842]: mon.smithi203 calling monitor election 2024-09-11T00:12:51.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:50 smithi111 ceph-mon[90842]: mon.smithi111 is new leader, mons smithi111,smithi203 in quorum (ranks 0,1) 2024-09-11T00:12:51.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:50 smithi111 ceph-mon[90842]: monmap epoch 3 2024-09-11T00:12:51.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:50 smithi111 ceph-mon[90842]: fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 2024-09-11T00:12:51.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:50 smithi111 ceph-mon[90842]: last_changed 2024-09-11T00:12:49.951346+0000 2024-09-11T00:12:51.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:50 smithi111 ceph-mon[90842]: created 2024-09-10T23:54:53.955794+0000 2024-09-11T00:12:51.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:50 smithi111 ceph-mon[90842]: min_mon_release 19 (squid) 2024-09-11T00:12:51.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:50 smithi111 ceph-mon[90842]: election_strategy: 1 2024-09-11T00:12:51.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:50 smithi111 ceph-mon[90842]: 0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.smithi111 2024-09-11T00:12:51.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:50 smithi111 ceph-mon[90842]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.smithi203 2024-09-11T00:12:51.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:50 smithi111 ceph-mon[90842]: fsmap cephfs:1 {0=cephfs.smithi203.tcrqop=up:active} 3 up:standby 2024-09-11T00:12:51.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:50 smithi111 ceph-mon[90842]: osdmap e50: 6 total, 6 up, 6 in 2024-09-11T00:12:51.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:50 smithi111 ceph-mon[90842]: mgrmap e40: smithi111.ypucji(active, since 20s), standbys: smithi203.smuspl 2024-09-11T00:12:51.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:50 smithi111 ceph-mon[90842]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-11T00:12:51.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:50 smithi111 ceph-mon[90842]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-11T00:12:51.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:50 smithi111 ceph-mon[90842]: fs cephfs has deprecated feature inline_data enabled. 2024-09-11T00:12:51.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:50 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:51.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:50 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:51.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:50 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:12:51.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:50 smithi111 ceph-mon[90842]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:12:51.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:50 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/2493157391' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-11T00:12:51.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:50 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mon metadata", "id": "smithi111"} : dispatch 2024-09-11T00:12:51.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:50 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mon metadata", "id": "smithi203"} : dispatch 2024-09-11T00:12:51.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:50 smithi203 ceph-mon[69002]: mon.smithi111 calling monitor election 2024-09-11T00:12:51.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:50 smithi203 ceph-mon[69002]: mon.smithi203 calling monitor election 2024-09-11T00:12:51.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:50 smithi203 ceph-mon[69002]: mon.smithi111 is new leader, mons smithi111,smithi203 in quorum (ranks 0,1) 2024-09-11T00:12:51.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:50 smithi203 ceph-mon[69002]: monmap epoch 3 2024-09-11T00:12:51.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:50 smithi203 ceph-mon[69002]: fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 2024-09-11T00:12:51.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:50 smithi203 ceph-mon[69002]: last_changed 2024-09-11T00:12:49.951346+0000 2024-09-11T00:12:51.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:50 smithi203 ceph-mon[69002]: created 2024-09-10T23:54:53.955794+0000 2024-09-11T00:12:51.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:50 smithi203 ceph-mon[69002]: min_mon_release 19 (squid) 2024-09-11T00:12:51.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:50 smithi203 ceph-mon[69002]: election_strategy: 1 2024-09-11T00:12:51.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:50 smithi203 ceph-mon[69002]: 0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.smithi111 2024-09-11T00:12:51.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:50 smithi203 ceph-mon[69002]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.smithi203 2024-09-11T00:12:51.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:50 smithi203 ceph-mon[69002]: fsmap cephfs:1 {0=cephfs.smithi203.tcrqop=up:active} 3 up:standby 2024-09-11T00:12:51.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:50 smithi203 ceph-mon[69002]: osdmap e50: 6 total, 6 up, 6 in 2024-09-11T00:12:51.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:50 smithi203 ceph-mon[69002]: mgrmap e40: smithi111.ypucji(active, since 20s), standbys: smithi203.smuspl 2024-09-11T00:12:51.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:50 smithi203 ceph-mon[69002]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-11T00:12:51.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:50 smithi203 ceph-mon[69002]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-11T00:12:51.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:50 smithi203 ceph-mon[69002]: fs cephfs has deprecated feature inline_data enabled. 2024-09-11T00:12:51.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:50 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:51.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:50 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:51.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:50 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:12:51.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:50 smithi203 ceph-mon[69002]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:12:51.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:50 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/2493157391' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-11T00:12:52.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:51 smithi203 ceph-mon[69002]: pgmap v14: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:52.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:51 smithi111 ceph-mon[90842]: pgmap v14: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:54.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:54 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:54.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:54 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:54.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:54 smithi203 ceph-mon[69002]: pgmap v15: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:54.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:54 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:54.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:54 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:54.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:54 smithi111 ceph-mon[90842]: pgmap v15: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:55.782 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:55 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:55.782 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:55 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:55.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:55 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:55.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:55 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:12:56.762 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:56 smithi203 ceph-mon[69002]: pgmap v16: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:57.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:56 smithi111 ceph-mon[90842]: pgmap v16: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:58.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:58 smithi203 ceph-mon[69002]: pgmap v17: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:12:58.955 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:58 smithi111 ceph-mon[90842]: pgmap v17: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:00.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:59 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:00.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:59 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:00.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:59 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:00.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:59 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:13:00.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:59 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:00.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:59 smithi111 ceph-mon[90842]: Reconfiguring mon.smithi111 (monmap changed)... 2024-09-11T00:13:00.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:59 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:13:00.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:59 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-11T00:13:00.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:59 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:00.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:59 smithi111 ceph-mon[90842]: Reconfiguring daemon mon.smithi111 on smithi111 2024-09-11T00:13:00.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:12:59 smithi111 ceph-mon[90842]: pgmap v18: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:00.197 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:59 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:00.197 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:59 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:00.197 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:59 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:00.197 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:59 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:13:00.198 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:59 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:00.198 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:59 smithi203 ceph-mon[69002]: Reconfiguring mon.smithi111 (monmap changed)... 2024-09-11T00:13:00.198 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:59 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:13:00.198 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:59 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-11T00:13:00.198 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:59 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:00.198 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:59 smithi203 ceph-mon[69002]: Reconfiguring daemon mon.smithi111 on smithi111 2024-09-11T00:13:00.199 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:12:59 smithi203 ceph-mon[69002]: pgmap v18: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:01.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:00 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:13:01.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:00 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:01.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:00 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:01.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:00 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "mgr.smithi111.ypucji", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-11T00:13:01.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:00 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mgr services"} : dispatch 2024-09-11T00:13:01.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:00 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:01.222 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:00 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:13:01.222 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:00 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:01.222 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:00 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:01.222 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:00 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "mgr.smithi111.ypucji", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-11T00:13:01.222 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:00 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mgr services"} : dispatch 2024-09-11T00:13:01.222 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:00 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:01.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:01 smithi111 ceph-mon[90842]: Reconfiguring mgr.smithi111.ypucji (monmap changed)... 2024-09-11T00:13:01.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:01 smithi111 ceph-mon[90842]: Reconfiguring daemon mgr.smithi111.ypucji on smithi111 2024-09-11T00:13:01.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:01 smithi111 ceph-mon[90842]: pgmap v19: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:02.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:01 smithi203 ceph-mon[69002]: Reconfiguring mgr.smithi111.ypucji (monmap changed)... 2024-09-11T00:13:02.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:01 smithi203 ceph-mon[69002]: Reconfiguring daemon mgr.smithi111.ypucji on smithi111 2024-09-11T00:13:02.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:01 smithi203 ceph-mon[69002]: pgmap v19: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:03.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:03 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:03.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:03 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:03.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:03 smithi111 ceph-mon[90842]: Reconfiguring ceph-exporter.smithi111 (monmap changed)... 2024-09-11T00:13:03.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:03 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi111", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-11T00:13:03.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:03 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth caps", "entity": "client.ceph-exporter.smithi111", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-11T00:13:03.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:03 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi111", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-11T00:13:03.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:03 smithi111 ceph-mon[90842]: Unable to update caps for client.ceph-exporter.smithi111 2024-09-11T00:13:03.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:03 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.ceph-exporter.smithi111"} : dispatch 2024-09-11T00:13:03.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:03 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:03.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:03 smithi111 ceph-mon[90842]: Reconfiguring daemon ceph-exporter.smithi111 on smithi111 2024-09-11T00:13:03.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:03 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:03.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:03 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:03.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:03 smithi203 ceph-mon[69002]: Reconfiguring ceph-exporter.smithi111 (monmap changed)... 2024-09-11T00:13:03.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:03 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi111", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-11T00:13:03.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:03 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth caps", "entity": "client.ceph-exporter.smithi111", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-11T00:13:03.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:03 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi111", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-11T00:13:03.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:03 smithi203 ceph-mon[69002]: Unable to update caps for client.ceph-exporter.smithi111 2024-09-11T00:13:03.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:03 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.ceph-exporter.smithi111"} : dispatch 2024-09-11T00:13:03.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:03 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:03.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:03 smithi203 ceph-mon[69002]: Reconfiguring daemon ceph-exporter.smithi111 on smithi111 2024-09-11T00:13:04.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:04 smithi111 ceph-mon[90842]: pgmap v20: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:04.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:04 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:04.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:04 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:04.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:04 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi111", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-11T00:13:04.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:04 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:04.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:04 smithi203 ceph-mon[69002]: pgmap v20: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:04.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:04 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:04.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:04 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:04.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:04 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi111", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-11T00:13:04.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:04 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:05.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:05 smithi111 ceph-mon[90842]: Reconfiguring crash.smithi111 (monmap changed)... 2024-09-11T00:13:05.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:05 smithi111 ceph-mon[90842]: Reconfiguring daemon crash.smithi111 on smithi111 2024-09-11T00:13:05.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:05 smithi203 ceph-mon[69002]: Reconfiguring crash.smithi111 (monmap changed)... 2024-09-11T00:13:05.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:05 smithi203 ceph-mon[69002]: Reconfiguring daemon crash.smithi111 on smithi111 2024-09-11T00:13:06.585 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:06 smithi111 ceph-mon[90842]: pgmap v21: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:06.585 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:06 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:06.585 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:06 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:06.586 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:06 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-11T00:13:06.586 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:06 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:06.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:06 smithi203 ceph-mon[69002]: pgmap v21: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:06.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:06 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:06.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:06 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:06.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:06 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-11T00:13:06.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:06 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:07.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:07 smithi111 ceph-mon[90842]: Reconfiguring osd.0 (monmap changed)... 2024-09-11T00:13:07.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:07 smithi111 ceph-mon[90842]: Reconfiguring daemon osd.0 on smithi111 2024-09-11T00:13:07.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:07 smithi203 ceph-mon[69002]: Reconfiguring osd.0 (monmap changed)... 2024-09-11T00:13:07.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:07 smithi203 ceph-mon[69002]: Reconfiguring daemon osd.0 on smithi111 2024-09-11T00:13:08.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:08 smithi111 ceph-mon[90842]: pgmap v22: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:08.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:08 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:08.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:08 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:08.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:08 smithi111 ceph-mon[90842]: Reconfiguring osd.1 (monmap changed)... 2024-09-11T00:13:08.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:08 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-11T00:13:08.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:08 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:08.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:08 smithi111 ceph-mon[90842]: Reconfiguring daemon osd.1 on smithi111 2024-09-11T00:13:09.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:08 smithi203 ceph-mon[69002]: pgmap v22: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:09.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:08 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:09.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:08 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:09.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:08 smithi203 ceph-mon[69002]: Reconfiguring osd.1 (monmap changed)... 2024-09-11T00:13:09.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:08 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-11T00:13:09.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:08 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:09.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:08 smithi203 ceph-mon[69002]: Reconfiguring daemon osd.1 on smithi111 2024-09-11T00:13:10.960 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:10 smithi111 ceph-mon[90842]: pgmap v23: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:10.961 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:10 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:10.961 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:10 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:10.961 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:10 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-11T00:13:10.961 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:10 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:11.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:10 smithi203 ceph-mon[69002]: pgmap v23: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:11.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:10 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:11.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:10 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:11.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:10 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-11T00:13:11.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:10 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:11.938 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:11 smithi111 ceph-mon[90842]: Reconfiguring osd.2 (monmap changed)... 2024-09-11T00:13:11.938 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:11 smithi111 ceph-mon[90842]: Reconfiguring daemon osd.2 on smithi111 2024-09-11T00:13:11.938 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:11 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:11.939 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:11 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:11.939 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:11 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.gmgsay", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:13:11.939 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:11 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:12.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:11 smithi203 ceph-mon[69002]: Reconfiguring osd.2 (monmap changed)... 2024-09-11T00:13:12.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:11 smithi203 ceph-mon[69002]: Reconfiguring daemon osd.2 on smithi111 2024-09-11T00:13:12.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:11 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:12.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:11 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:12.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:11 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.gmgsay", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:13:12.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:11 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:12.844 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:12 smithi111 ceph-mon[90842]: Reconfiguring mds.cephfs.smithi111.gmgsay (monmap changed)... 2024-09-11T00:13:12.844 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:12 smithi111 ceph-mon[90842]: Reconfiguring daemon mds.cephfs.smithi111.gmgsay on smithi111 2024-09-11T00:13:12.844 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:12 smithi111 ceph-mon[90842]: pgmap v24: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:13.019 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:12 smithi203 ceph-mon[69002]: Reconfiguring mds.cephfs.smithi111.gmgsay (monmap changed)... 2024-09-11T00:13:13.019 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:12 smithi203 ceph-mon[69002]: Reconfiguring daemon mds.cephfs.smithi111.gmgsay on smithi111 2024-09-11T00:13:13.019 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:12 smithi203 ceph-mon[69002]: pgmap v24: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:14.039 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:13 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:14.040 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:13 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:14.040 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:13 smithi111 ceph-mon[90842]: Reconfiguring mds.cephfs.smithi111.rucaba (monmap changed)... 2024-09-11T00:13:14.040 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:13 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.rucaba", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:13:14.040 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:13 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:14.040 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:13 smithi111 ceph-mon[90842]: Reconfiguring daemon mds.cephfs.smithi111.rucaba on smithi111 2024-09-11T00:13:14.040 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:13 smithi111 ceph-mon[90842]: pgmap v25: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:14.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:13 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:14.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:13 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:14.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:13 smithi203 ceph-mon[69002]: Reconfiguring mds.cephfs.smithi111.rucaba (monmap changed)... 2024-09-11T00:13:14.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:13 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.rucaba", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:13:14.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:13 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:14.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:13 smithi203 ceph-mon[69002]: Reconfiguring daemon mds.cephfs.smithi111.rucaba on smithi111 2024-09-11T00:13:14.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:13 smithi203 ceph-mon[69002]: pgmap v25: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:16.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:15 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:16.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:15 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:16.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:15 smithi203 ceph-mon[69002]: Reconfiguring ceph-exporter.smithi203 (monmap changed)... 2024-09-11T00:13:16.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:15 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi203", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-11T00:13:16.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:15 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth caps", "entity": "client.ceph-exporter.smithi203", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-11T00:13:16.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:15 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi203", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-11T00:13:16.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:15 smithi203 ceph-mon[69002]: Unable to update caps for client.ceph-exporter.smithi203 2024-09-11T00:13:16.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:15 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.ceph-exporter.smithi203"} : dispatch 2024-09-11T00:13:16.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:15 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:16.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:15 smithi203 ceph-mon[69002]: Reconfiguring daemon ceph-exporter.smithi203 on smithi203 2024-09-11T00:13:16.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:15 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:13:16.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:15 smithi203 ceph-mon[69002]: pgmap v26: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:15 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:15 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:15 smithi111 ceph-mon[90842]: Reconfiguring ceph-exporter.smithi203 (monmap changed)... 2024-09-11T00:13:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:15 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi203", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-11T00:13:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:15 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth caps", "entity": "client.ceph-exporter.smithi203", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-11T00:13:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:15 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi203", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-11T00:13:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:15 smithi111 ceph-mon[90842]: Unable to update caps for client.ceph-exporter.smithi203 2024-09-11T00:13:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:15 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.ceph-exporter.smithi203"} : dispatch 2024-09-11T00:13:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:15 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:16.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:15 smithi111 ceph-mon[90842]: Reconfiguring daemon ceph-exporter.smithi203 on smithi203 2024-09-11T00:13:16.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:15 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:13:16.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:15 smithi111 ceph-mon[90842]: pgmap v26: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:17.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:17 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:17.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:17 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:17.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:17 smithi203 ceph-mon[69002]: Reconfiguring crash.smithi203 (monmap changed)... 2024-09-11T00:13:17.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:17 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi203", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-11T00:13:17.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:17 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:17.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:17 smithi203 ceph-mon[69002]: Reconfiguring daemon crash.smithi203 on smithi203 2024-09-11T00:13:17.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:17 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:17.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:17 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:17.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:17 smithi111 ceph-mon[90842]: Reconfiguring crash.smithi203 (monmap changed)... 2024-09-11T00:13:17.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:17 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi203", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-11T00:13:17.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:17 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:17.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:17 smithi111 ceph-mon[90842]: Reconfiguring daemon crash.smithi203 on smithi203 2024-09-11T00:13:18.896 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:18 smithi203 ceph-mon[69002]: pgmap v27: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:18.896 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:18 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:18.896 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:18 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:18.896 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:18 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "mgr.smithi203.smuspl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-11T00:13:18.896 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:18 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mgr services"} : dispatch 2024-09-11T00:13:18.896 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:18 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:18.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:18 smithi111 ceph-mon[90842]: pgmap v27: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:18.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:18 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:18.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:18 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:18.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:18 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "mgr.smithi203.smuspl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-11T00:13:18.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:18 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mgr services"} : dispatch 2024-09-11T00:13:18.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:18 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:19.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:19 smithi111 ceph-mon[90842]: Reconfiguring mgr.smithi203.smuspl (monmap changed)... 2024-09-11T00:13:19.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:19 smithi111 ceph-mon[90842]: Reconfiguring daemon mgr.smithi203.smuspl on smithi203 2024-09-11T00:13:19.959 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:19 smithi203 ceph-mon[69002]: Reconfiguring mgr.smithi203.smuspl (monmap changed)... 2024-09-11T00:13:19.959 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:19 smithi203 ceph-mon[69002]: Reconfiguring daemon mgr.smithi203.smuspl on smithi203 2024-09-11T00:13:20.956 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:20 smithi203 ceph-mon[69002]: pgmap v28: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:20.957 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:20 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:20.957 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:20 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:20.957 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:20 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:13:20.957 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:20 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-11T00:13:20.957 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:20 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:21.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.033+0000 7f4a90a00700 1 -- 172.21.15.111:0/4111444022 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a8c068fd0 msgr2=0x7f4a8c104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:21.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.033+0000 7f4a90a00700 1 --2- 172.21.15.111:0/4111444022 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a8c068fd0 0x7f4a8c104df0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4a78009910 tx=0x7f4a78009c20 comp rx=0 tx=0).stop 2024-09-11T00:13:21.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.033+0000 7f4a90a00700 1 -- 172.21.15.111:0/4111444022 shutdown_connections 2024-09-11T00:13:21.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.033+0000 7f4a90a00700 1 --2- 172.21.15.111:0/4111444022 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a8c068fd0 0x7f4a8c104df0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:21.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.033+0000 7f4a90a00700 1 --2- 172.21.15.111:0/4111444022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a8c068630 0x7f4a8c068a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:21.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.033+0000 7f4a90a00700 1 -- 172.21.15.111:0/4111444022 >> 172.21.15.111:0/4111444022 conn(0x7f4a8c074f50 msgr2=0x7f4a8c075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:21.036 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:20 smithi111 ceph-mon[90842]: pgmap v28: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:21.036 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:20 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:21.036 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:20 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:21.036 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:20 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:13:21.036 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:20 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-11T00:13:21.036 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:20 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:21.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.033+0000 7f4a90a00700 1 -- 172.21.15.111:0/4111444022 shutdown_connections 2024-09-11T00:13:21.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.033+0000 7f4a90a00700 1 -- 172.21.15.111:0/4111444022 wait complete. 2024-09-11T00:13:21.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.034+0000 7f4a90a00700 1 Processor -- start 2024-09-11T00:13:21.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.034+0000 7f4a90a00700 1 -- start start 2024-09-11T00:13:21.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.034+0000 7f4a90a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a8c068630 0x7f4a8c195e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:21.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.035+0000 7f4a90a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a8c068fd0 0x7f4a8c196360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:21.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.035+0000 7f4a90a00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8c196a40 con 0x7f4a8c068630 2024-09-11T00:13:21.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.035+0000 7f4a90a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8c19a7d0 con 0x7f4a8c068fd0 2024-09-11T00:13:21.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.035+0000 7f4a89e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a8c068630 0x7f4a8c195e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:21.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.035+0000 7f4a89e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a8c068630 0x7f4a8c195e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:47968/0 (socket says 172.21.15.111:47968) 2024-09-11T00:13:21.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.035+0000 7f4a89e00700 1 -- 172.21.15.111:0/1901190266 learned_addr learned my addr 172.21.15.111:0/1901190266 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:13:21.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.035+0000 7f4a89400700 1 --2- 172.21.15.111:0/1901190266 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a8c068fd0 0x7f4a8c196360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:21.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.035+0000 7f4a89e00700 1 -- 172.21.15.111:0/1901190266 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a8c068fd0 msgr2=0x7f4a8c196360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:21.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.035+0000 7f4a89e00700 1 --2- 172.21.15.111:0/1901190266 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a8c068fd0 0x7f4a8c196360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:21.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.035+0000 7f4a89e00700 1 -- 172.21.15.111:0/1901190266 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a780095f0 con 0x7f4a8c068630 2024-09-11T00:13:21.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.036+0000 7f4a89e00700 1 --2- 172.21.15.111:0/1901190266 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a8c068630 0x7f4a8c195e20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00d8d0 tx=0x7f4a7c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:21.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.036+0000 7f4a82a00700 1 -- 172.21.15.111:0/1901190266 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a7c0098a0 con 0x7f4a8c068630 2024-09-11T00:13:21.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.036+0000 7f4a90a00700 1 -- 172.21.15.111:0/1901190266 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a8c19aab0 con 0x7f4a8c068630 2024-09-11T00:13:21.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.036+0000 7f4a82a00700 1 -- 172.21.15.111:0/1901190266 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4a7c010460 con 0x7f4a8c068630 2024-09-11T00:13:21.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.036+0000 7f4a82a00700 1 -- 172.21.15.111:0/1901190266 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a7c00f5f0 con 0x7f4a8c068630 2024-09-11T00:13:21.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.036+0000 7f4a90a00700 1 -- 172.21.15.111:0/1901190266 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a8c19afd0 con 0x7f4a8c068630 2024-09-11T00:13:21.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.037+0000 7f4a90a00700 1 -- 172.21.15.111:0/1901190266 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a8c1086d0 con 0x7f4a8c068630 2024-09-11T00:13:21.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.038+0000 7f4a82a00700 1 -- 172.21.15.111:0/1901190266 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 40) v1 ==== 102584+0+0 (secure 0 0 0) 0x7f4a7c009a00 con 0x7f4a8c068630 2024-09-11T00:13:21.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.039+0000 7f4a82a00700 1 --2- 172.21.15.111:0/1901190266 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4a7007a800 0x7f4a7007ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:21.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.039+0000 7f4a82a00700 1 -- 172.21.15.111:0/1901190266 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f4a7c09d350 con 0x7f4a8c068630 2024-09-11T00:13:21.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.040+0000 7f4a89400700 1 --2- 172.21.15.111:0/1901190266 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4a7007a800 0x7f4a7007ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:21.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.040+0000 7f4a89400700 1 --2- 172.21.15.111:0/1901190266 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4a7007a800 0x7f4a7007ccb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4a78006010 tx=0x7f4a7801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:21.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.044+0000 7f4a82a00700 1 -- 172.21.15.111:0/1901190266 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f4a7c0608b0 con 0x7f4a8c068630 2024-09-11T00:13:21.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.286+0000 7f4a90a00700 1 -- 172.21.15.111:0/1901190266 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a8c19b2b0 con 0x7f4a7007a800 2024-09-11T00:13:21.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.288+0000 7f4a82a00700 1 -- 172.21.15.111:0/1901190266 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f4a8c19b2b0 con 0x7f4a7007a800 2024-09-11T00:13:21.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.290+0000 7f4a90a00700 1 -- 172.21.15.111:0/1901190266 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4a7007a800 msgr2=0x7f4a7007ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:21.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.290+0000 7f4a90a00700 1 --2- 172.21.15.111:0/1901190266 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4a7007a800 0x7f4a7007ccb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4a78006010 tx=0x7f4a7801a040 comp rx=0 tx=0).stop 2024-09-11T00:13:21.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.290+0000 7f4a90a00700 1 -- 172.21.15.111:0/1901190266 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a8c068630 msgr2=0x7f4a8c195e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:21.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.290+0000 7f4a90a00700 1 --2- 172.21.15.111:0/1901190266 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a8c068630 0x7f4a8c195e20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00d8d0 tx=0x7f4a7c00dbe0 comp rx=0 tx=0).stop 2024-09-11T00:13:21.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.290+0000 7f4a90a00700 1 -- 172.21.15.111:0/1901190266 shutdown_connections 2024-09-11T00:13:21.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.290+0000 7f4a90a00700 1 --2- 172.21.15.111:0/1901190266 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4a7007a800 0x7f4a7007ccb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:21.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.290+0000 7f4a90a00700 1 --2- 172.21.15.111:0/1901190266 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a8c068630 0x7f4a8c195e20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:21.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.290+0000 7f4a90a00700 1 --2- 172.21.15.111:0/1901190266 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a8c068fd0 0x7f4a8c196360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:21.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.290+0000 7f4a90a00700 1 -- 172.21.15.111:0/1901190266 >> 172.21.15.111:0/1901190266 conn(0x7f4a8c074f50 msgr2=0x7f4a8c0fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:21.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.291+0000 7f4a90a00700 1 -- 172.21.15.111:0/1901190266 shutdown_connections 2024-09-11T00:13:21.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.291+0000 7f4a90a00700 1 -- 172.21.15.111:0/1901190266 wait complete. 2024-09-11T00:13:21.307 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:13:21.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.428+0000 7f8c60a00700 1 -- 172.21.15.111:0/3795935182 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8c5c102df0 msgr2=0x7f8c5c106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:21.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.428+0000 7f8c60a00700 1 --2- 172.21.15.111:0/3795935182 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8c5c102df0 0x7f8c5c106dc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8c44009910 tx=0x7f8c44009c20 comp rx=0 tx=0).stop 2024-09-11T00:13:21.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.428+0000 7f8c60a00700 1 -- 172.21.15.111:0/3795935182 shutdown_connections 2024-09-11T00:13:21.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.428+0000 7f8c60a00700 1 --2- 172.21.15.111:0/3795935182 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8c5c102df0 0x7f8c5c106dc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:21.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.428+0000 7f8c60a00700 1 --2- 172.21.15.111:0/3795935182 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c5c102450 0x7f8c5c102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:21.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.428+0000 7f8c60a00700 1 -- 172.21.15.111:0/3795935182 >> 172.21.15.111:0/3795935182 conn(0x7f8c5c0fdd30 msgr2=0x7f8c5c100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:21.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.428+0000 7f8c60a00700 1 -- 172.21.15.111:0/3795935182 shutdown_connections 2024-09-11T00:13:21.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.428+0000 7f8c60a00700 1 -- 172.21.15.111:0/3795935182 wait complete. 2024-09-11T00:13:21.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.429+0000 7f8c60a00700 1 Processor -- start 2024-09-11T00:13:21.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.429+0000 7f8c60a00700 1 -- start start 2024-09-11T00:13:21.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.429+0000 7f8c60a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c5c102450 0x7f8c5c197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:21.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.430+0000 7f8c60a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8c5c102df0 0x7f8c5c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:21.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.430+0000 7f8c60a00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c198ab0 con 0x7f8c5c102df0 2024-09-11T00:13:21.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.430+0000 7f8c60a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c19c840 con 0x7f8c5c102450 2024-09-11T00:13:21.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.430+0000 7f8c53e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8c5c102df0 0x7f8c5c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:21.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.430+0000 7f8c53e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8c5c102df0 0x7f8c5c1983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:47990/0 (socket says 172.21.15.111:47990) 2024-09-11T00:13:21.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.430+0000 7f8c53e00700 1 -- 172.21.15.111:0/3675414115 learned_addr learned my addr 172.21.15.111:0/3675414115 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:13:21.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.430+0000 7f8c5a800700 1 --2- 172.21.15.111:0/3675414115 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c5c102450 0x7f8c5c197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:21.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.430+0000 7f8c53e00700 1 -- 172.21.15.111:0/3675414115 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c5c102450 msgr2=0x7f8c5c197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:21.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.430+0000 7f8c53e00700 1 --2- 172.21.15.111:0/3675414115 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c5c102450 0x7f8c5c197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:21.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.430+0000 7f8c53e00700 1 -- 172.21.15.111:0/3675414115 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c440095f0 con 0x7f8c5c102df0 2024-09-11T00:13:21.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.431+0000 7f8c53e00700 1 --2- 172.21.15.111:0/3675414115 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8c5c102df0 0x7f8c5c1983d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8c4400bda0 tx=0x7f8c4400bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:21.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.431+0000 7f8c53400700 1 -- 172.21.15.111:0/3675414115 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c4401d070 con 0x7f8c5c102df0 2024-09-11T00:13:21.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.431+0000 7f8c53400700 1 -- 172.21.15.111:0/3675414115 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8c4400f460 con 0x7f8c5c102df0 2024-09-11T00:13:21.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.431+0000 7f8c53400700 1 -- 172.21.15.111:0/3675414115 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c44017630 con 0x7f8c5c102df0 2024-09-11T00:13:21.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.431+0000 7f8c60a00700 1 -- 172.21.15.111:0/3675414115 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c5c19cac0 con 0x7f8c5c102df0 2024-09-11T00:13:21.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.431+0000 7f8c60a00700 1 -- 172.21.15.111:0/3675414115 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c5c19cfb0 con 0x7f8c5c102df0 2024-09-11T00:13:21.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.432+0000 7f8c60a00700 1 -- 172.21.15.111:0/3675414115 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c5c10a710 con 0x7f8c5c102df0 2024-09-11T00:13:21.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.433+0000 7f8c53400700 1 -- 172.21.15.111:0/3675414115 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 40) v1 ==== 102584+0+0 (secure 0 0 0) 0x7f8c4400fab0 con 0x7f8c5c102df0 2024-09-11T00:13:21.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.434+0000 7f8c53400700 1 --2- 172.21.15.111:0/3675414115 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f8c4007a800 0x7f8c4007ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:21.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.434+0000 7f8c53400700 1 -- 172.21.15.111:0/3675414115 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f8c4409e930 con 0x7f8c5c102df0 2024-09-11T00:13:21.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.435+0000 7f8c5a800700 1 --2- 172.21.15.111:0/3675414115 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f8c4007a800 0x7f8c4007ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:21.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.435+0000 7f8c5a800700 1 --2- 172.21.15.111:0/3675414115 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f8c4007a800 0x7f8c4007ccb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c009a10 tx=0x7f8c4c009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:21.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.438+0000 7f8c53400700 1 -- 172.21.15.111:0/3675414115 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f8c44061eb0 con 0x7f8c5c102df0 2024-09-11T00:13:21.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.680+0000 7f8c60a00700 1 -- 172.21.15.111:0/3675414115 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c5c02cd10 con 0x7f8c4007a800 2024-09-11T00:13:21.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.681+0000 7f8c53400700 1 -- 172.21.15.111:0/3675414115 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f8c5c02cd10 con 0x7f8c4007a800 2024-09-11T00:13:21.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.683+0000 7f8c60a00700 1 -- 172.21.15.111:0/3675414115 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f8c4007a800 msgr2=0x7f8c4007ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:21.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.683+0000 7f8c60a00700 1 --2- 172.21.15.111:0/3675414115 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f8c4007a800 0x7f8c4007ccb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c009a10 tx=0x7f8c4c009190 comp rx=0 tx=0).stop 2024-09-11T00:13:21.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.683+0000 7f8c60a00700 1 -- 172.21.15.111:0/3675414115 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8c5c102df0 msgr2=0x7f8c5c1983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:21.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.683+0000 7f8c60a00700 1 --2- 172.21.15.111:0/3675414115 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8c5c102df0 0x7f8c5c1983d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8c4400bda0 tx=0x7f8c4400bdd0 comp rx=0 tx=0).stop 2024-09-11T00:13:21.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.683+0000 7f8c60a00700 1 -- 172.21.15.111:0/3675414115 shutdown_connections 2024-09-11T00:13:21.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.684+0000 7f8c60a00700 1 --2- 172.21.15.111:0/3675414115 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f8c4007a800 0x7f8c4007ccb0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:21.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.684+0000 7f8c60a00700 1 --2- 172.21.15.111:0/3675414115 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c5c102450 0x7f8c5c197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:21.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.684+0000 7f8c60a00700 1 --2- 172.21.15.111:0/3675414115 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8c5c102df0 0x7f8c5c1983d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:21.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.684+0000 7f8c60a00700 1 -- 172.21.15.111:0/3675414115 >> 172.21.15.111:0/3675414115 conn(0x7f8c5c0fdd30 msgr2=0x7f8c5c0ff460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:21.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.684+0000 7f8c60a00700 1 -- 172.21.15.111:0/3675414115 shutdown_connections 2024-09-11T00:13:21.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.684+0000 7f8c60a00700 1 -- 172.21.15.111:0/3675414115 wait complete. 2024-09-11T00:13:21.776 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:21 smithi203 ceph-mon[69002]: Reconfiguring mon.smithi203 (monmap changed)... 2024-09-11T00:13:21.777 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:21 smithi203 ceph-mon[69002]: Reconfiguring daemon mon.smithi203 on smithi203 2024-09-11T00:13:21.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.819+0000 7f989ee00700 1 -- 172.21.15.111:0/1046088927 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f98981003b0 msgr2=0x7f9898100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:21.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.819+0000 7f989ee00700 1 --2- 172.21.15.111:0/1046088927 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f98981003b0 0x7f9898100780 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9888009910 tx=0x7f9888009c20 comp rx=0 tx=0).stop 2024-09-11T00:13:21.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.819+0000 7f989ee00700 1 -- 172.21.15.111:0/1046088927 shutdown_connections 2024-09-11T00:13:21.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.819+0000 7f989ee00700 1 --2- 172.21.15.111:0/1046088927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9898100d50 0x7f9898104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:21.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.819+0000 7f989ee00700 1 --2- 172.21.15.111:0/1046088927 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f98981003b0 0x7f9898100780 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:21.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.819+0000 7f989ee00700 1 -- 172.21.15.111:0/1046088927 >> 172.21.15.111:0/1046088927 conn(0x7f98980fbc30 msgr2=0x7f98980fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:21.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.819+0000 7f989ee00700 1 -- 172.21.15.111:0/1046088927 shutdown_connections 2024-09-11T00:13:21.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.819+0000 7f989ee00700 1 -- 172.21.15.111:0/1046088927 wait complete. 2024-09-11T00:13:21.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.820+0000 7f989ee00700 1 Processor -- start 2024-09-11T00:13:21.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.820+0000 7f989ee00700 1 -- start start 2024-09-11T00:13:21.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.821+0000 7f989ee00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98981003b0 0x7f9898197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:21.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.821+0000 7f989ee00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9898100d50 0x7f9898198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:21.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.821+0000 7f989ee00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9898198b40 con 0x7f9898100d50 2024-09-11T00:13:21.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.821+0000 7f989ee00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989819c8d0 con 0x7f98981003b0 2024-09-11T00:13:21.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.821+0000 7f9897400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9898100d50 0x7f9898198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:21.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.821+0000 7f9897400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9898100d50 0x7f9898198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48012/0 (socket says 172.21.15.111:48012) 2024-09-11T00:13:21.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.821+0000 7f9897400700 1 -- 172.21.15.111:0/2153602605 learned_addr learned my addr 172.21.15.111:0/2153602605 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:13:21.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.821+0000 7f9897e00700 1 --2- 172.21.15.111:0/2153602605 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98981003b0 0x7f9898197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:21.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.821+0000 7f9897400700 1 -- 172.21.15.111:0/2153602605 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98981003b0 msgr2=0x7f9898197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:21.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.821+0000 7f9897400700 1 --2- 172.21.15.111:0/2153602605 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98981003b0 0x7f9898197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:21.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.821+0000 7f9897400700 1 -- 172.21.15.111:0/2153602605 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98880095f0 con 0x7f9898100d50 2024-09-11T00:13:21.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.821+0000 7f9897e00700 1 --2- 172.21.15.111:0/2153602605 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98981003b0 0x7f9898197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:21.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.822+0000 7f9897400700 1 --2- 172.21.15.111:0/2153602605 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9898100d50 0x7f9898198460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f988400d8d0 tx=0x7f988400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:21.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.822+0000 7f9894c00700 1 -- 172.21.15.111:0/2153602605 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98840041f0 con 0x7f9898100d50 2024-09-11T00:13:21.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.822+0000 7f9894c00700 1 -- 172.21.15.111:0/2153602605 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9884007620 con 0x7f9898100d50 2024-09-11T00:13:21.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.822+0000 7f989ee00700 1 -- 172.21.15.111:0/2153602605 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f989819cbb0 con 0x7f9898100d50 2024-09-11T00:13:21.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.822+0000 7f9894c00700 1 -- 172.21.15.111:0/2153602605 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9884003c50 con 0x7f9898100d50 2024-09-11T00:13:21.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.822+0000 7f989ee00700 1 -- 172.21.15.111:0/2153602605 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f989819d100 con 0x7f9898100d50 2024-09-11T00:13:21.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.823+0000 7f989ee00700 1 -- 172.21.15.111:0/2153602605 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98981044a0 con 0x7f9898100d50 2024-09-11T00:13:21.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.824+0000 7f9894c00700 1 -- 172.21.15.111:0/2153602605 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 40) v1 ==== 102584+0+0 (secure 0 0 0) 0x7f9884004350 con 0x7f9898100d50 2024-09-11T00:13:21.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.825+0000 7f9894c00700 1 --2- 172.21.15.111:0/2153602605 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f987c07a800 0x7f987c07ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:21.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.825+0000 7f9894c00700 1 -- 172.21.15.111:0/2153602605 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f988409cfa0 con 0x7f9898100d50 2024-09-11T00:13:21.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.826+0000 7f9897e00700 1 --2- 172.21.15.111:0/2153602605 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f987c07a800 0x7f987c07ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:21.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.826+0000 7f9897e00700 1 --2- 172.21.15.111:0/2153602605 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f987c07a800 0x7f987c07ccb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f988800b5c0 tx=0x7f988801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:21.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:21.830+0000 7f9894c00700 1 -- 172.21.15.111:0/2153602605 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f98840605a0 con 0x7f9898100d50 2024-09-11T00:13:22.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.066+0000 7f989ee00700 1 -- 172.21.15.111:0/2153602605 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f989819d480 con 0x7f987c07a800 2024-09-11T00:13:22.068 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:21 smithi111 ceph-mon[90842]: Reconfiguring mon.smithi203 (monmap changed)... 2024-09-11T00:13:22.068 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:21 smithi111 ceph-mon[90842]: Reconfiguring daemon mon.smithi203 on smithi203 2024-09-11T00:13:22.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.076+0000 7f9894c00700 1 -- 172.21.15.111:0/2153602605 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f989819d480 con 0x7f987c07a800 2024-09-11T00:13:22.078 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:13:22.078 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (2m) 45s ago 16m 14.5M - 0.27.0 11f11916f8cd d6d3253e881f 2024-09-11T00:13:22.078 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (5m) 45s ago 16m 7386k - 18.2.0 dc2bc1663786 7c40af85314c 2024-09-11T00:13:22.078 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi203 smithi203 running (5m) 28s ago 15m 7662k - 18.2.0 dc2bc1663786 922e3261ff70 2024-09-11T00:13:22.078 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (16m) 45s ago 16m 6665k - 18.2.0 dc2bc1663786 72a36c166ffa 2024-09-11T00:13:22.078 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi203 smithi203 running (15m) 28s ago 15m 6669k - 18.2.0 dc2bc1663786 9b102b6f6d70 2024-09-11T00:13:22.079 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (2m) 45s ago 16m 68.3M - c8b91775d855 7d3b50b5b59f 2024-09-11T00:13:22.079 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.gmgsay smithi111 running (9m) 45s ago 9m 16.8M - 18.2.0 dc2bc1663786 795e4ff0075c 2024-09-11T00:13:22.079 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.rucaba smithi111 running (9m) 45s ago 9m 16.6M - 18.2.0 dc2bc1663786 02885adac62c 2024-09-11T00:13:22.079 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.tcrqop smithi203 running (9m) 28s ago 9m 150M - 18.2.0 dc2bc1663786 4df492159bb4 2024-09-11T00:13:22.079 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.uqkbkn smithi203 running (9m) 28s ago 9m 17.2M - 18.2.0 dc2bc1663786 619aa58ea314 2024-09-11T00:13:22.079 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.ypucji smithi111 *:8443,9283,8765 running (5m) 45s ago 18m 487M - 19.3.0-4854-g8f219c47 589dd18248e4 07fa31f49618 2024-09-11T00:13:22.079 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi203.smuspl smithi203 *:8443,9283,8765 running (4m) 28s ago 15m 452M - 19.3.0-4854-g8f219c47 589dd18248e4 7e5a93a5ffa7 2024-09-11T00:13:22.079 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (60s) 45s ago 18m 29.3M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 3c29c070a612 2024-09-11T00:13:22.079 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi203 smithi203 running (32s) 28s ago 15m 20.8M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 45e8285e4b4d 2024-09-11T00:13:22.079 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (3m) 45s ago 16m 7549k - 1.7.0 72c9c2088986 ec478ea14488 2024-09-11T00:13:22.079 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi203 smithi203 *:9100 running (3m) 28s ago 15m 7910k - 1.7.0 72c9c2088986 54d461cde1bc 2024-09-11T00:13:22.079 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (13m) 45s ago 13m 212M 1216M 18.2.0 dc2bc1663786 162b7249a591 2024-09-11T00:13:22.079 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (13m) 45s ago 13m 226M 1216M 18.2.0 dc2bc1663786 3614d95b1425 2024-09-11T00:13:22.080 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (12m) 45s ago 12m 184M 1216M 18.2.0 dc2bc1663786 db175d4b09b9 2024-09-11T00:13:22.080 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi203 running (12m) 28s ago 12m 245M 2240M 18.2.0 dc2bc1663786 60b1cef7a70d 2024-09-11T00:13:22.080 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi203 running (11m) 28s ago 11m 209M 2240M 18.2.0 dc2bc1663786 769c7942c42b 2024-09-11T00:13:22.080 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi203 running (11m) 28s ago 11m 194M 2240M 18.2.0 dc2bc1663786 6d824001d40c 2024-09-11T00:13:22.080 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (3m) 45s ago 16m 52.9M - 2.51.0 1d3b7f56885b 3e72ac10983d 2024-09-11T00:13:22.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.078+0000 7f989ee00700 1 -- 172.21.15.111:0/2153602605 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f987c07a800 msgr2=0x7f987c07ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:22.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.078+0000 7f989ee00700 1 --2- 172.21.15.111:0/2153602605 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f987c07a800 0x7f987c07ccb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f988800b5c0 tx=0x7f988801a040 comp rx=0 tx=0).stop 2024-09-11T00:13:22.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.078+0000 7f989ee00700 1 -- 172.21.15.111:0/2153602605 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9898100d50 msgr2=0x7f9898198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:22.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.078+0000 7f989ee00700 1 --2- 172.21.15.111:0/2153602605 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9898100d50 0x7f9898198460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f988400d8d0 tx=0x7f988400dc90 comp rx=0 tx=0).stop 2024-09-11T00:13:22.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.078+0000 7f989ee00700 1 -- 172.21.15.111:0/2153602605 shutdown_connections 2024-09-11T00:13:22.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.078+0000 7f989ee00700 1 --2- 172.21.15.111:0/2153602605 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f987c07a800 0x7f987c07ccb0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:22.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.078+0000 7f989ee00700 1 --2- 172.21.15.111:0/2153602605 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98981003b0 0x7f9898197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:22.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.078+0000 7f989ee00700 1 --2- 172.21.15.111:0/2153602605 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9898100d50 0x7f9898198460 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:22.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.078+0000 7f989ee00700 1 -- 172.21.15.111:0/2153602605 >> 172.21.15.111:0/2153602605 conn(0x7f98980fbc30 msgr2=0x7f98980fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:22.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.079+0000 7f989ee00700 1 -- 172.21.15.111:0/2153602605 shutdown_connections 2024-09-11T00:13:22.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.079+0000 7f989ee00700 1 -- 172.21.15.111:0/2153602605 wait complete. 2024-09-11T00:13:22.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.213+0000 7fd038400700 1 -- 172.21.15.111:0/3821457191 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd030100d70 msgr2=0x7fd030104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:22.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.213+0000 7fd038400700 1 --2- 172.21.15.111:0/3821457191 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd030100d70 0x7fd030104d40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd01c009910 tx=0x7fd01c009c20 comp rx=0 tx=0).stop 2024-09-11T00:13:22.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.214+0000 7fd038400700 1 -- 172.21.15.111:0/3821457191 shutdown_connections 2024-09-11T00:13:22.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.214+0000 7fd038400700 1 --2- 172.21.15.111:0/3821457191 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd030100d70 0x7fd030104d40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:22.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.214+0000 7fd038400700 1 --2- 172.21.15.111:0/3821457191 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd0301003d0 0x7fd0301007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:22.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.214+0000 7fd038400700 1 -- 172.21.15.111:0/3821457191 >> 172.21.15.111:0/3821457191 conn(0x7fd0300fbc50 msgr2=0x7fd0300fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:22.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.214+0000 7fd038400700 1 -- 172.21.15.111:0/3821457191 shutdown_connections 2024-09-11T00:13:22.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.214+0000 7fd038400700 1 -- 172.21.15.111:0/3821457191 wait complete. 2024-09-11T00:13:22.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.215+0000 7fd038400700 1 Processor -- start 2024-09-11T00:13:22.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.215+0000 7fd038400700 1 -- start start 2024-09-11T00:13:22.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.215+0000 7fd038400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd0301003d0 0x7fd030073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:22.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.215+0000 7fd038400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd030100d70 0x7fd030073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:22.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.215+0000 7fd038400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd030073ad0 con 0x7fd030100d70 2024-09-11T00:13:22.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.215+0000 7fd038400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd030073c10 con 0x7fd0301003d0 2024-09-11T00:13:22.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.216+0000 7fd035a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd0301003d0 0x7fd030073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:22.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.216+0000 7fd035000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd030100d70 0x7fd030073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:22.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.216+0000 7fd035a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd0301003d0 0x7fd030073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.111:51582/0 (socket says 172.21.15.111:51582) 2024-09-11T00:13:22.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.216+0000 7fd035a00700 1 -- 172.21.15.111:0/80874973 learned_addr learned my addr 172.21.15.111:0/80874973 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:13:22.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.216+0000 7fd035a00700 1 -- 172.21.15.111:0/80874973 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd030100d70 msgr2=0x7fd030073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:22.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.216+0000 7fd035a00700 1 --2- 172.21.15.111:0/80874973 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd030100d70 0x7fd030073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:22.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.216+0000 7fd035a00700 1 -- 172.21.15.111:0/80874973 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01c0095f0 con 0x7fd0301003d0 2024-09-11T00:13:22.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.216+0000 7fd035a00700 1 --2- 172.21.15.111:0/80874973 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd0301003d0 0x7fd030073050 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd02400e920 tx=0x7fd02400ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:22.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.217+0000 7fd02e000700 1 -- 172.21.15.111:0/80874973 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd02400c9d0 con 0x7fd0301003d0 2024-09-11T00:13:22.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.217+0000 7fd02e000700 1 -- 172.21.15.111:0/80874973 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd024010430 con 0x7fd0301003d0 2024-09-11T00:13:22.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.217+0000 7fd038400700 1 -- 172.21.15.111:0/80874973 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0301a1fd0 con 0x7fd0301003d0 2024-09-11T00:13:22.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.217+0000 7fd02e000700 1 -- 172.21.15.111:0/80874973 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd024018630 con 0x7fd0301003d0 2024-09-11T00:13:22.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.217+0000 7fd038400700 1 -- 172.21.15.111:0/80874973 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0301a2380 con 0x7fd0301003d0 2024-09-11T00:13:22.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.218+0000 7fd038400700 1 -- 172.21.15.111:0/80874973 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd030108740 con 0x7fd0301003d0 2024-09-11T00:13:22.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.219+0000 7fd02e000700 1 -- 172.21.15.111:0/80874973 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 40) v1 ==== 102584+0+0 (secure 0 0 0) 0x7fd0240105a0 con 0x7fd0301003d0 2024-09-11T00:13:22.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.220+0000 7fd02e000700 1 --2- 172.21.15.111:0/80874973 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd01807a800 0x7fd01807ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:22.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.220+0000 7fd02e000700 1 -- 172.21.15.111:0/80874973 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd024014070 con 0x7fd0301003d0 2024-09-11T00:13:22.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.220+0000 7fd035000700 1 --2- 172.21.15.111:0/80874973 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd01807a800 0x7fd01807ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:22.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.221+0000 7fd035000700 1 --2- 172.21.15.111:0/80874973 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd01807a800 0x7fd01807ccb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd01c005b40 tx=0x7fd01c005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:22.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.224+0000 7fd02e000700 1 -- 172.21.15.111:0/80874973 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fd024060c70 con 0x7fd0301003d0 2024-09-11T00:13:22.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.536+0000 7fd038400700 1 -- 172.21.15.111:0/80874973 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd03002ccd0 con 0x7fd0301003d0 2024-09-11T00:13:22.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.537+0000 7fd02e000700 1 -- 172.21.15.111:0/80874973 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+688 (secure 0 0 0) 0x7fd024063d90 con 0x7fd0301003d0 2024-09-11T00:13:22.539 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:13:22.539 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-11T00:13:22.539 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:13:22.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:13:22.540 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-11T00:13:22.540 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:13:22.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:13:22.540 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-11T00:13:22.540 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-11T00:13:22.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:13:22.540 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-11T00:13:22.540 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-11T00:13:22.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:13:22.540 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-11T00:13:22.540 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 10, 2024-09-11T00:13:22.540 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 4 2024-09-11T00:13:22.540 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-11T00:13:22.541 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:13:22.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.540+0000 7fd038400700 1 -- 172.21.15.111:0/80874973 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd01807a800 msgr2=0x7fd01807ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:22.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.540+0000 7fd038400700 1 --2- 172.21.15.111:0/80874973 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd01807a800 0x7fd01807ccb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd01c005b40 tx=0x7fd01c005a90 comp rx=0 tx=0).stop 2024-09-11T00:13:22.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.540+0000 7fd038400700 1 -- 172.21.15.111:0/80874973 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd0301003d0 msgr2=0x7fd030073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:22.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.540+0000 7fd038400700 1 --2- 172.21.15.111:0/80874973 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd0301003d0 0x7fd030073050 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd02400e920 tx=0x7fd02400ec30 comp rx=0 tx=0).stop 2024-09-11T00:13:22.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.540+0000 7fd038400700 1 -- 172.21.15.111:0/80874973 shutdown_connections 2024-09-11T00:13:22.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.540+0000 7fd038400700 1 --2- 172.21.15.111:0/80874973 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd01807a800 0x7fd01807ccb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:22.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.540+0000 7fd038400700 1 --2- 172.21.15.111:0/80874973 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd0301003d0 0x7fd030073050 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:22.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.540+0000 7fd038400700 1 --2- 172.21.15.111:0/80874973 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd030100d70 0x7fd030073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:22.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.540+0000 7fd038400700 1 -- 172.21.15.111:0/80874973 >> 172.21.15.111:0/80874973 conn(0x7fd0300fbc50 msgr2=0x7fd0300fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:22.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.540+0000 7fd038400700 1 -- 172.21.15.111:0/80874973 shutdown_connections 2024-09-11T00:13:22.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.541+0000 7fd038400700 1 -- 172.21.15.111:0/80874973 wait complete. 2024-09-11T00:13:22.679 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.676+0000 7efe71200700 1 -- 172.21.15.111:0/4208690209 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe6c100d70 msgr2=0x7efe6c104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:22.679 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.676+0000 7efe71200700 1 --2- 172.21.15.111:0/4208690209 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe6c100d70 0x7efe6c104d40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efe58009910 tx=0x7efe58009c20 comp rx=0 tx=0).stop 2024-09-11T00:13:22.679 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.676+0000 7efe71200700 1 -- 172.21.15.111:0/4208690209 shutdown_connections 2024-09-11T00:13:22.680 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.676+0000 7efe71200700 1 --2- 172.21.15.111:0/4208690209 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe6c100d70 0x7efe6c104d40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:22.680 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.676+0000 7efe71200700 1 --2- 172.21.15.111:0/4208690209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe6c1003d0 0x7efe6c1007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:22.680 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.676+0000 7efe71200700 1 -- 172.21.15.111:0/4208690209 >> 172.21.15.111:0/4208690209 conn(0x7efe6c0fbc90 msgr2=0x7efe6c0fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:22.680 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.676+0000 7efe71200700 1 -- 172.21.15.111:0/4208690209 shutdown_connections 2024-09-11T00:13:22.680 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.677+0000 7efe71200700 1 -- 172.21.15.111:0/4208690209 wait complete. 2024-09-11T00:13:22.680 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.677+0000 7efe71200700 1 Processor -- start 2024-09-11T00:13:22.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.678+0000 7efe71200700 1 -- start start 2024-09-11T00:13:22.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.678+0000 7efe71200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe6c1003d0 0x7efe6c073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:22.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.678+0000 7efe71200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe6c100d70 0x7efe6c073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:22.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.678+0000 7efe71200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c073ad0 con 0x7efe6c100d70 2024-09-11T00:13:22.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.678+0000 7efe71200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c073c10 con 0x7efe6c1003d0 2024-09-11T00:13:22.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.678+0000 7efe69400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe6c100d70 0x7efe6c073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:22.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.678+0000 7efe69400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe6c100d70 0x7efe6c073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48036/0 (socket says 172.21.15.111:48036) 2024-09-11T00:13:22.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.678+0000 7efe69400700 1 -- 172.21.15.111:0/2889834722 learned_addr learned my addr 172.21.15.111:0/2889834722 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:13:22.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.678+0000 7efe69e00700 1 --2- 172.21.15.111:0/2889834722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe6c1003d0 0x7efe6c073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:22.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.679+0000 7efe69400700 1 -- 172.21.15.111:0/2889834722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe6c1003d0 msgr2=0x7efe6c073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:22.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.679+0000 7efe69400700 1 --2- 172.21.15.111:0/2889834722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe6c1003d0 0x7efe6c073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:22.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.679+0000 7efe69400700 1 -- 172.21.15.111:0/2889834722 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe580095f0 con 0x7efe6c100d70 2024-09-11T00:13:22.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.679+0000 7efe69400700 1 --2- 172.21.15.111:0/2889834722 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe6c100d70 0x7efe6c073590 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efe5800bda0 tx=0x7efe5800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:22.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.679+0000 7efe62a00700 1 -- 172.21.15.111:0/2889834722 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe5801d070 con 0x7efe6c100d70 2024-09-11T00:13:22.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.679+0000 7efe62a00700 1 -- 172.21.15.111:0/2889834722 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe58005dc0 con 0x7efe6c100d70 2024-09-11T00:13:22.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.679+0000 7efe71200700 1 -- 172.21.15.111:0/2889834722 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe6c073e90 con 0x7efe6c100d70 2024-09-11T00:13:22.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.679+0000 7efe62a00700 1 -- 172.21.15.111:0/2889834722 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe58017400 con 0x7efe6c100d70 2024-09-11T00:13:22.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.679+0000 7efe71200700 1 -- 172.21.15.111:0/2889834722 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe6c1a2240 con 0x7efe6c100d70 2024-09-11T00:13:22.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.680+0000 7efe71200700 1 -- 172.21.15.111:0/2889834722 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe6c108740 con 0x7efe6c100d70 2024-09-11T00:13:22.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.682+0000 7efe62a00700 1 -- 172.21.15.111:0/2889834722 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 40) v1 ==== 102584+0+0 (secure 0 0 0) 0x7efe5800f6f0 con 0x7efe6c100d70 2024-09-11T00:13:22.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.683+0000 7efe62a00700 1 --2- 172.21.15.111:0/2889834722 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7efe5007a800 0x7efe5007ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:22.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.683+0000 7efe62a00700 1 -- 172.21.15.111:0/2889834722 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7efe5809e8d0 con 0x7efe6c100d70 2024-09-11T00:13:22.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.683+0000 7efe69e00700 1 --2- 172.21.15.111:0/2889834722 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7efe5007a800 0x7efe5007ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:22.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.683+0000 7efe69e00700 1 --2- 172.21.15.111:0/2889834722 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7efe5007a800 0x7efe5007ccb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efe5c005950 tx=0x7efe5c00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:22.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.687+0000 7efe62a00700 1 -- 172.21.15.111:0/2889834722 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7efe58061db0 con 0x7efe6c100d70 2024-09-11T00:13:22.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:22 smithi111 ceph-mon[90842]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:13:22.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:22 smithi111 ceph-mon[90842]: pgmap v29: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:22.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:22 smithi111 ceph-mon[90842]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:13:22.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:22 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:22.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:22 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:22.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:22 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-11T00:13:22.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:22 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:22.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:22 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/80874973' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:13:22.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.952+0000 7efe71200700 1 -- 172.21.15.111:0/2889834722 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efe6c04ea50 con 0x7efe6c100d70 2024-09-11T00:13:22.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.952+0000 7efe62a00700 1 -- 172.21.15.111:0/2889834722 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1921 (secure 0 0 0) 0x7efe5805fe60 con 0x7efe6c100d70 2024-09-11T00:13:22.955 INFO:teuthology.orchestra.run.smithi111.stdout:e15 2024-09-11T00:13:22.955 INFO:teuthology.orchestra.run.smithi111.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-11T00:13:22.955 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T00:13:22.955 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:13:22.955 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-11T00:13:22.955 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:13:22.955 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-11T00:13:22.956 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-11T00:13:22.956 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 14 2024-09-11T00:13:22.956 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-11T00:13:22.956 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-11T00:03:47.950356+0000 2024-09-11T00:13:22.956 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-11T00:04:06.275905+0000 2024-09-11T00:13:22.956 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-11T00:13:22.956 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-11T00:13:22.956 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-11T00:13:22.956 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-11T00:13:22.956 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-11T00:13:22.956 INFO:teuthology.orchestra.run.smithi111.stdout:max_xattr_size 65536 2024-09-11T00:13:22.956 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-11T00:13:22.956 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-11T00:13:22.956 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 47 2024-09-11T00:13:22.957 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:13:22.957 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-11T00:13:22.957 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-11T00:13:22.957 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=24363} 2024-09-11T00:13:22.957 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-11T00:13:22.957 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-11T00:13:22.957 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-11T00:13:22.957 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-11T00:13:22.957 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-11T00:13:22.957 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data enabled 2024-09-11T00:13:22.957 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-11T00:13:22.957 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-11T00:13:22.957 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 1 2024-09-11T00:13:22.957 INFO:teuthology.orchestra.run.smithi111.stdout:qdb_cluster leader: 0 members: 2024-09-11T00:13:22.958 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.tcrqop{0:24363} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.203:6824/3082736449,v1:172.21.15.203:6825/3082736449] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:13:22.958 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:13:22.958 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:13:22.958 INFO:teuthology.orchestra.run.smithi111.stdout:Standby daemons: 2024-09-11T00:13:22.958 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:13:22.958 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.rucaba{-1:14554} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6828/2045133285,v1:172.21.15.111:6829/2045133285] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:13:22.958 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.gmgsay{-1:14566} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.111:6826/1122545830,v1:172.21.15.111:6827/1122545830] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:13:22.958 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.uqkbkn{-1:24379} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.203:6826/695613114,v1:172.21.15.203:6827/695613114] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:13:22.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.955+0000 7efe71200700 1 -- 172.21.15.111:0/2889834722 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7efe5007a800 msgr2=0x7efe5007ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:22.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.955+0000 7efe71200700 1 --2- 172.21.15.111:0/2889834722 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7efe5007a800 0x7efe5007ccb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efe5c005950 tx=0x7efe5c00b410 comp rx=0 tx=0).stop 2024-09-11T00:13:22.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.955+0000 7efe71200700 1 -- 172.21.15.111:0/2889834722 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe6c100d70 msgr2=0x7efe6c073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:22.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.955+0000 7efe71200700 1 --2- 172.21.15.111:0/2889834722 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe6c100d70 0x7efe6c073590 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efe5800bda0 tx=0x7efe5800bdd0 comp rx=0 tx=0).stop 2024-09-11T00:13:22.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.955+0000 7efe71200700 1 -- 172.21.15.111:0/2889834722 shutdown_connections 2024-09-11T00:13:22.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.955+0000 7efe71200700 1 --2- 172.21.15.111:0/2889834722 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7efe5007a800 0x7efe5007ccb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:22.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.955+0000 7efe71200700 1 --2- 172.21.15.111:0/2889834722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe6c1003d0 0x7efe6c073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:22.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.955+0000 7efe71200700 1 --2- 172.21.15.111:0/2889834722 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe6c100d70 0x7efe6c073590 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:22.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.955+0000 7efe71200700 1 -- 172.21.15.111:0/2889834722 >> 172.21.15.111:0/2889834722 conn(0x7efe6c0fbc90 msgr2=0x7efe6c0fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:22.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.955+0000 7efe71200700 1 -- 172.21.15.111:0/2889834722 shutdown_connections 2024-09-11T00:13:22.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:22.955+0000 7efe71200700 1 -- 172.21.15.111:0/2889834722 wait complete. 2024-09-11T00:13:22.960 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 15 2024-09-11T00:13:23.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:22 smithi203 ceph-mon[69002]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:13:23.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:22 smithi203 ceph-mon[69002]: pgmap v29: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:23.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:22 smithi203 ceph-mon[69002]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:13:23.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:22 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:23.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:22 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:23.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:22 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-11T00:13:23.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:22 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:23.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:22 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/80874973' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:13:23.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.095+0000 7f7bbc800700 1 -- 172.21.15.111:0/3377619202 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7bb41003d0 msgr2=0x7f7bb41007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:23.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.095+0000 7f7bbc800700 1 --2- 172.21.15.111:0/3377619202 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7bb41003d0 0x7f7bb41007a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8009910 tx=0x7f7ba8009c20 comp rx=0 tx=0).stop 2024-09-11T00:13:23.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.095+0000 7f7bbc800700 1 -- 172.21.15.111:0/3377619202 shutdown_connections 2024-09-11T00:13:23.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.095+0000 7f7bbc800700 1 --2- 172.21.15.111:0/3377619202 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7bb4100d70 0x7f7bb4104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:23.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.095+0000 7f7bbc800700 1 --2- 172.21.15.111:0/3377619202 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7bb41003d0 0x7f7bb41007a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:23.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.095+0000 7f7bbc800700 1 -- 172.21.15.111:0/3377619202 >> 172.21.15.111:0/3377619202 conn(0x7f7bb40fbc90 msgr2=0x7f7bb40fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:23.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.096+0000 7f7bbc800700 1 -- 172.21.15.111:0/3377619202 shutdown_connections 2024-09-11T00:13:23.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.096+0000 7f7bbc800700 1 -- 172.21.15.111:0/3377619202 wait complete. 2024-09-11T00:13:23.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.097+0000 7f7bbc800700 1 Processor -- start 2024-09-11T00:13:23.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.097+0000 7f7bbc800700 1 -- start start 2024-09-11T00:13:23.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.097+0000 7f7bbc800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7bb41003d0 0x7f7bb4197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:23.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.097+0000 7f7bbc800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7bb4100d70 0x7f7bb4198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:23.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.097+0000 7f7bbc800700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb4198b40 con 0x7f7bb41003d0 2024-09-11T00:13:23.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.097+0000 7f7bbc800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb419c8d0 con 0x7f7bb4100d70 2024-09-11T00:13:23.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.097+0000 7f7bb9e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7bb41003d0 0x7f7bb4197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:23.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.097+0000 7f7bb9e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7bb41003d0 0x7f7bb4197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48056/0 (socket says 172.21.15.111:48056) 2024-09-11T00:13:23.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.097+0000 7f7bb9e00700 1 -- 172.21.15.111:0/2244681302 learned_addr learned my addr 172.21.15.111:0/2244681302 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:13:23.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.098+0000 7f7bb9400700 1 --2- 172.21.15.111:0/2244681302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7bb4100d70 0x7f7bb4198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:23.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.098+0000 7f7bb9e00700 1 -- 172.21.15.111:0/2244681302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7bb4100d70 msgr2=0x7f7bb4198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:23.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.098+0000 7f7bb9e00700 1 --2- 172.21.15.111:0/2244681302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7bb4100d70 0x7f7bb4198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:23.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.098+0000 7f7bb9e00700 1 -- 172.21.15.111:0/2244681302 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba80095f0 con 0x7f7bb41003d0 2024-09-11T00:13:23.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.098+0000 7f7bb9e00700 1 --2- 172.21.15.111:0/2244681302 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7bb41003d0 0x7f7bb4197f20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8006010 tx=0x7f7ba800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:23.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.098+0000 7f7baea00700 1 -- 172.21.15.111:0/2244681302 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ba801d070 con 0x7f7bb41003d0 2024-09-11T00:13:23.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.098+0000 7f7baea00700 1 -- 172.21.15.111:0/2244681302 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ba8005dc0 con 0x7f7bb41003d0 2024-09-11T00:13:23.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.098+0000 7f7bbc800700 1 -- 172.21.15.111:0/2244681302 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb419cb50 con 0x7f7bb41003d0 2024-09-11T00:13:23.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.099+0000 7f7baea00700 1 -- 172.21.15.111:0/2244681302 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ba8017400 con 0x7f7bb41003d0 2024-09-11T00:13:23.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.099+0000 7f7bbc800700 1 -- 172.21.15.111:0/2244681302 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb419d040 con 0x7f7bb41003d0 2024-09-11T00:13:23.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.100+0000 7f7bbc800700 1 -- 172.21.15.111:0/2244681302 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb41044c0 con 0x7f7bb41003d0 2024-09-11T00:13:23.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.101+0000 7f7baea00700 1 -- 172.21.15.111:0/2244681302 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 40) v1 ==== 102584+0+0 (secure 0 0 0) 0x7f7ba8003a60 con 0x7f7bb41003d0 2024-09-11T00:13:23.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.102+0000 7f7baea00700 1 --2- 172.21.15.111:0/2244681302 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f7b9c07a810 0x7f7b9c07ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:23.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.102+0000 7f7baea00700 1 -- 172.21.15.111:0/2244681302 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f7ba809e8b0 con 0x7f7bb41003d0 2024-09-11T00:13:23.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.102+0000 7f7bb9400700 1 --2- 172.21.15.111:0/2244681302 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f7b9c07a810 0x7f7b9c07ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:23.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.103+0000 7f7bb9400700 1 --2- 172.21.15.111:0/2244681302 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f7b9c07a810 0x7f7b9c07ccc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4199540 tx=0x7f7ba400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:23.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.106+0000 7f7baea00700 1 -- 172.21.15.111:0/2244681302 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f7ba8061e10 con 0x7f7bb41003d0 2024-09-11T00:13:23.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.346+0000 7f7bbc800700 1 -- 172.21.15.111:0/2244681302 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7bb402cd10 con 0x7f7b9c07a810 2024-09-11T00:13:23.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.347+0000 7f7baea00700 1 -- 172.21.15.111:0/2244681302 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f7bb402cd10 con 0x7f7b9c07a810 2024-09-11T00:13:23.349 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:13:23.349 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e", 2024-09-11T00:13:23.349 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-11T00:13:23.349 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-11T00:13:23.349 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-11T00:13:23.350 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr", 2024-09-11T00:13:23.350 INFO:teuthology.orchestra.run.smithi111.stdout: "mon" 2024-09-11T00:13:23.350 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-11T00:13:23.350 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "4/23 daemons upgraded", 2024-09-11T00:13:23.350 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading mon daemons", 2024-09-11T00:13:23.350 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-11T00:13:23.350 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:13:23.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.350+0000 7f7bbc800700 1 -- 172.21.15.111:0/2244681302 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f7b9c07a810 msgr2=0x7f7b9c07ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:23.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.350+0000 7f7bbc800700 1 --2- 172.21.15.111:0/2244681302 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f7b9c07a810 0x7f7b9c07ccc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4199540 tx=0x7f7ba400b410 comp rx=0 tx=0).stop 2024-09-11T00:13:23.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.350+0000 7f7bbc800700 1 -- 172.21.15.111:0/2244681302 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7bb41003d0 msgr2=0x7f7bb4197f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:23.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.350+0000 7f7bbc800700 1 --2- 172.21.15.111:0/2244681302 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7bb41003d0 0x7f7bb4197f20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8006010 tx=0x7f7ba800bd70 comp rx=0 tx=0).stop 2024-09-11T00:13:23.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.350+0000 7f7bbc800700 1 -- 172.21.15.111:0/2244681302 shutdown_connections 2024-09-11T00:13:23.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.350+0000 7f7bbc800700 1 --2- 172.21.15.111:0/2244681302 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f7b9c07a810 0x7f7b9c07ccc0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:23.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.350+0000 7f7bbc800700 1 --2- 172.21.15.111:0/2244681302 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7bb41003d0 0x7f7bb4197f20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:23.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.350+0000 7f7bbc800700 1 --2- 172.21.15.111:0/2244681302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7bb4100d70 0x7f7bb4198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:23.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.350+0000 7f7bbc800700 1 -- 172.21.15.111:0/2244681302 >> 172.21.15.111:0/2244681302 conn(0x7f7bb40fbc90 msgr2=0x7f7bb40fd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:23.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.350+0000 7f7bbc800700 1 -- 172.21.15.111:0/2244681302 shutdown_connections 2024-09-11T00:13:23.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.350+0000 7f7bbc800700 1 -- 172.21.15.111:0/2244681302 wait complete. 2024-09-11T00:13:23.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.486+0000 7fca11c00700 1 -- 172.21.15.111:0/3814912828 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fca0c1003b0 msgr2=0x7fca0c100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:23.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.486+0000 7fca11c00700 1 --2- 172.21.15.111:0/3814912828 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fca0c1003b0 0x7fca0c100780 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009910 tx=0x7fc9fc009c20 comp rx=0 tx=0).stop 2024-09-11T00:13:23.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.486+0000 7fca11c00700 1 -- 172.21.15.111:0/3814912828 shutdown_connections 2024-09-11T00:13:23.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.486+0000 7fca11c00700 1 --2- 172.21.15.111:0/3814912828 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca0c100d50 0x7fca0c104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:23.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.486+0000 7fca11c00700 1 --2- 172.21.15.111:0/3814912828 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fca0c1003b0 0x7fca0c100780 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:23.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.486+0000 7fca11c00700 1 -- 172.21.15.111:0/3814912828 >> 172.21.15.111:0/3814912828 conn(0x7fca0c0fbc30 msgr2=0x7fca0c0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:23.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.486+0000 7fca11c00700 1 -- 172.21.15.111:0/3814912828 shutdown_connections 2024-09-11T00:13:23.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.486+0000 7fca11c00700 1 -- 172.21.15.111:0/3814912828 wait complete. 2024-09-11T00:13:23.490 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.487+0000 7fca11c00700 1 Processor -- start 2024-09-11T00:13:23.490 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.487+0000 7fca11c00700 1 -- start start 2024-09-11T00:13:23.490 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.488+0000 7fca11c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca0c1003b0 0x7fca0c197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:23.490 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.488+0000 7fca11c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fca0c100d50 0x7fca0c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:23.490 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.488+0000 7fca11c00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c198b00 con 0x7fca0c100d50 2024-09-11T00:13:23.490 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.488+0000 7fca11c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c19c890 con 0x7fca0c1003b0 2024-09-11T00:13:23.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.488+0000 7fca03e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fca0c100d50 0x7fca0c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:23.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.488+0000 7fca03e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fca0c100d50 0x7fca0c198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48062/0 (socket says 172.21.15.111:48062) 2024-09-11T00:13:23.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.488+0000 7fca03e00700 1 -- 172.21.15.111:0/2589896661 learned_addr learned my addr 172.21.15.111:0/2589896661 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:13:23.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.488+0000 7fca0aa00700 1 --2- 172.21.15.111:0/2589896661 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca0c1003b0 0x7fca0c197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:23.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.488+0000 7fca03e00700 1 -- 172.21.15.111:0/2589896661 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca0c1003b0 msgr2=0x7fca0c197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:23.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.488+0000 7fca03e00700 1 --2- 172.21.15.111:0/2589896661 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca0c1003b0 0x7fca0c197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:23.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.488+0000 7fca03e00700 1 -- 172.21.15.111:0/2589896661 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9fc0095f0 con 0x7fca0c100d50 2024-09-11T00:13:23.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.489+0000 7fca03e00700 1 --2- 172.21.15.111:0/2589896661 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fca0c100d50 0x7fca0c198420 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400d8d0 tx=0x7fc9f400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:23.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.489+0000 7fca03400700 1 -- 172.21.15.111:0/2589896661 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9f40041f0 con 0x7fca0c100d50 2024-09-11T00:13:23.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.489+0000 7fca03400700 1 -- 172.21.15.111:0/2589896661 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc9f4007620 con 0x7fca0c100d50 2024-09-11T00:13:23.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.489+0000 7fca11c00700 1 -- 172.21.15.111:0/2589896661 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca0c19cb70 con 0x7fca0c100d50 2024-09-11T00:13:23.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.489+0000 7fca03400700 1 -- 172.21.15.111:0/2589896661 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9f40056b0 con 0x7fca0c100d50 2024-09-11T00:13:23.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.489+0000 7fca11c00700 1 -- 172.21.15.111:0/2589896661 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca0c19d0c0 con 0x7fca0c100d50 2024-09-11T00:13:23.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.490+0000 7fca11c00700 1 -- 172.21.15.111:0/2589896661 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca0c1044a0 con 0x7fca0c100d50 2024-09-11T00:13:23.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.491+0000 7fca03400700 1 -- 172.21.15.111:0/2589896661 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 40) v1 ==== 102584+0+0 (secure 0 0 0) 0x7fc9f4004750 con 0x7fca0c100d50 2024-09-11T00:13:23.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.492+0000 7fca03400700 1 --2- 172.21.15.111:0/2589896661 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc9f007a800 0x7fc9f007ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:23.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.492+0000 7fca03400700 1 -- 172.21.15.111:0/2589896661 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fc9f409d2d0 con 0x7fca0c100d50 2024-09-11T00:13:23.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.492+0000 7fca0aa00700 1 --2- 172.21.15.111:0/2589896661 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc9f007a800 0x7fc9f007ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:23.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.493+0000 7fca0aa00700 1 --2- 172.21.15.111:0/2589896661 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc9f007a800 0x7fc9f007ccb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc006010 tx=0x7fc9fc01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:23.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.496+0000 7fca03400700 1 -- 172.21.15.111:0/2589896661 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fc9f40608e0 con 0x7fca0c100d50 2024-09-11T00:13:23.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.818+0000 7fca11c00700 1 -- 172.21.15.111:0/2589896661 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fca0c199240 con 0x7fca0c100d50 2024-09-11T00:13:23.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.819+0000 7fca03400700 1 -- 172.21.15.111:0/2589896661 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fc9f4063a00 con 0x7fca0c100d50 2024-09-11T00:13:23.821 INFO:teuthology.orchestra.run.smithi111.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-11T00:13:23.821 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-11T00:13:23.821 INFO:teuthology.orchestra.run.smithi111.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-11T00:13:23.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.821+0000 7fca11c00700 1 -- 172.21.15.111:0/2589896661 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc9f007a800 msgr2=0x7fc9f007ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:23.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.821+0000 7fca11c00700 1 --2- 172.21.15.111:0/2589896661 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc9f007a800 0x7fc9f007ccb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc006010 tx=0x7fc9fc01a040 comp rx=0 tx=0).stop 2024-09-11T00:13:23.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.821+0000 7fca11c00700 1 -- 172.21.15.111:0/2589896661 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fca0c100d50 msgr2=0x7fca0c198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:23.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.821+0000 7fca11c00700 1 --2- 172.21.15.111:0/2589896661 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fca0c100d50 0x7fca0c198420 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400d8d0 tx=0x7fc9f400dbe0 comp rx=0 tx=0).stop 2024-09-11T00:13:23.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.821+0000 7fca11c00700 1 -- 172.21.15.111:0/2589896661 shutdown_connections 2024-09-11T00:13:23.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.821+0000 7fca11c00700 1 --2- 172.21.15.111:0/2589896661 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc9f007a800 0x7fc9f007ccb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:23.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.821+0000 7fca11c00700 1 --2- 172.21.15.111:0/2589896661 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca0c1003b0 0x7fca0c197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:23.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.821+0000 7fca11c00700 1 --2- 172.21.15.111:0/2589896661 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fca0c100d50 0x7fca0c198420 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:23.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.821+0000 7fca11c00700 1 -- 172.21.15.111:0/2589896661 >> 172.21.15.111:0/2589896661 conn(0x7fca0c0fbc30 msgr2=0x7fca0c0fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:23.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.822+0000 7fca11c00700 1 -- 172.21.15.111:0/2589896661 shutdown_connections 2024-09-11T00:13:23.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:23.822+0000 7fca11c00700 1 -- 172.21.15.111:0/2589896661 wait complete. 2024-09-11T00:13:24.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:23 smithi203 ceph-mon[69002]: Reconfiguring osd.3 (monmap changed)... 2024-09-11T00:13:24.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:23 smithi203 ceph-mon[69002]: Reconfiguring daemon osd.3 on smithi203 2024-09-11T00:13:24.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:23 smithi203 ceph-mon[69002]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:13:24.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:23 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/2889834722' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:13:24.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:23 smithi111 ceph-mon[90842]: Reconfiguring osd.3 (monmap changed)... 2024-09-11T00:13:24.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:23 smithi111 ceph-mon[90842]: Reconfiguring daemon osd.3 on smithi203 2024-09-11T00:13:24.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:23 smithi111 ceph-mon[90842]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:13:24.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:23 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/2889834722' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:13:24.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:24 smithi203 ceph-mon[69002]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:13:24.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:24 smithi203 ceph-mon[69002]: pgmap v30: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:24.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:24 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:24.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:24 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:24.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:24 smithi203 ceph-mon[69002]: Reconfiguring osd.4 (monmap changed)... 2024-09-11T00:13:24.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:24 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-11T00:13:24.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:24 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:24.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:24 smithi203 ceph-mon[69002]: Reconfiguring daemon osd.4 on smithi203 2024-09-11T00:13:24.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:24 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/2589896661' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-11T00:13:25.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:24 smithi111 ceph-mon[90842]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:13:25.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:24 smithi111 ceph-mon[90842]: pgmap v30: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:25.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:24 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:25.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:24 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:25.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:24 smithi111 ceph-mon[90842]: Reconfiguring osd.4 (monmap changed)... 2024-09-11T00:13:25.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:24 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-11T00:13:25.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:24 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:25.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:24 smithi111 ceph-mon[90842]: Reconfiguring daemon osd.4 on smithi203 2024-09-11T00:13:25.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:24 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/2589896661' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-11T00:13:26.479 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:26 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:26.479 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:26 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:26.479 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:26 smithi203 ceph-mon[69002]: Reconfiguring osd.5 (monmap changed)... 2024-09-11T00:13:26.479 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:26 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-11T00:13:26.479 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:26 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:26.479 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:26 smithi203 ceph-mon[69002]: Reconfiguring daemon osd.5 on smithi203 2024-09-11T00:13:26.479 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:26 smithi203 ceph-mon[69002]: pgmap v31: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:26.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:26 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:26.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:26 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:26.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:26 smithi111 ceph-mon[90842]: Reconfiguring osd.5 (monmap changed)... 2024-09-11T00:13:26.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:26 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-11T00:13:26.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:26 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:26.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:26 smithi111 ceph-mon[90842]: Reconfiguring daemon osd.5 on smithi203 2024-09-11T00:13:26.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:26 smithi111 ceph-mon[90842]: pgmap v31: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:28.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:28.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:28.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:28 smithi203 ceph-mon[69002]: Reconfiguring mds.cephfs.smithi203.tcrqop (monmap changed)... 2024-09-11T00:13:28.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.tcrqop", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:13:28.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:28.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:28 smithi203 ceph-mon[69002]: Reconfiguring daemon mds.cephfs.smithi203.tcrqop on smithi203 2024-09-11T00:13:28.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:28 smithi203 ceph-mon[69002]: pgmap v32: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:28.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:28.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:28.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:28 smithi111 ceph-mon[90842]: Reconfiguring mds.cephfs.smithi203.tcrqop (monmap changed)... 2024-09-11T00:13:28.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.tcrqop", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:13:28.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:28.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:28 smithi111 ceph-mon[90842]: Reconfiguring daemon mds.cephfs.smithi203.tcrqop on smithi203 2024-09-11T00:13:28.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:28 smithi111 ceph-mon[90842]: pgmap v32: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:30.220 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:29 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:30.220 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:29 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:30.221 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:29 smithi111 ceph-mon[90842]: Reconfiguring mds.cephfs.smithi203.uqkbkn (monmap changed)... 2024-09-11T00:13:30.221 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:29 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.uqkbkn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:13:30.221 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:29 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:30.221 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:29 smithi111 ceph-mon[90842]: Reconfiguring daemon mds.cephfs.smithi203.uqkbkn on smithi203 2024-09-11T00:13:30.221 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:29 smithi111 ceph-mon[90842]: pgmap v33: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:30.221 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:29 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:13:30.240 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:29 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:30.240 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:29 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:30.240 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:29 smithi203 ceph-mon[69002]: Reconfiguring mds.cephfs.smithi203.uqkbkn (monmap changed)... 2024-09-11T00:13:30.240 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:29 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.uqkbkn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:13:30.240 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:29 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:30.241 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:29 smithi203 ceph-mon[69002]: Reconfiguring daemon mds.cephfs.smithi203.uqkbkn on smithi203 2024-09-11T00:13:30.241 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:29 smithi203 ceph-mon[69002]: pgmap v33: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:30.241 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:29 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:13:31.874 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:31 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:31.874 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:31 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:31.874 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:31 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:13:31.874 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:31 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:13:31.874 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:31 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:13:31.874 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:31 smithi111 ceph-mon[90842]: Upgrade: Setting container_image for all mon 2024-09-11T00:13:31.874 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:31 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:31.874 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:31 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi111"} : dispatch 2024-09-11T00:13:31.874 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:31 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi111"}]': finished 2024-09-11T00:13:31.874 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:31 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi203"} : dispatch 2024-09-11T00:13:31.874 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:31 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi203"}]': finished 2024-09-11T00:13:31.934 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:31 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:31.934 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:31 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:31.934 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:31 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:13:31.934 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:31 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:13:31.935 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:31 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:13:31.935 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:31 smithi203 ceph-mon[69002]: Upgrade: Setting container_image for all mon 2024-09-11T00:13:31.935 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:31 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:31.935 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:31 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi111"} : dispatch 2024-09-11T00:13:31.935 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:31 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi111"}]': finished 2024-09-11T00:13:31.935 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:31 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi203"} : dispatch 2024-09-11T00:13:31.935 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:31 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi203"}]': finished 2024-09-11T00:13:32.926 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:32 smithi111 ceph-mon[90842]: pgmap v34: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:32.926 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:32 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:32.926 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:32 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi111", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-11T00:13:32.927 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:32 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:33.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:32 smithi203 ceph-mon[69002]: pgmap v34: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:33.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:32 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:33.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:32 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi111", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-11T00:13:33.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:32 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:33.757 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:33 smithi111 ceph-mon[90842]: Upgrade: Updating crash.smithi111 (1/2) 2024-09-11T00:13:33.757 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:33 smithi111 ceph-mon[90842]: Deploying daemon crash.smithi111 on smithi111 2024-09-11T00:13:34.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:33 smithi203 ceph-mon[69002]: Upgrade: Updating crash.smithi111 (1/2) 2024-09-11T00:13:34.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:33 smithi203 ceph-mon[69002]: Deploying daemon crash.smithi111 on smithi111 2024-09-11T00:13:34.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:34 smithi111 ceph-mon[90842]: pgmap v35: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:35.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:34 smithi203 ceph-mon[69002]: pgmap v35: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:36.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:36 smithi111 ceph-mon[90842]: pgmap v36: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:36.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:36 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:36.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:36 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:37.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:36 smithi203 ceph-mon[69002]: pgmap v36: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:37.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:36 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:37.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:36 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:39.006 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:38 smithi203 ceph-mon[69002]: pgmap v37: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:39.007 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:38 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:39.007 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:38 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi203", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-11T00:13:39.007 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:38 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:39.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:38 smithi111 ceph-mon[90842]: pgmap v37: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:39.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:38 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:39.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:38 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi203", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-11T00:13:39.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:38 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:39.996 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:39 smithi203 ceph-mon[69002]: Upgrade: Updating crash.smithi203 (2/2) 2024-09-11T00:13:39.996 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:39 smithi203 ceph-mon[69002]: Deploying daemon crash.smithi203 on smithi203 2024-09-11T00:13:40.002 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:39 smithi111 ceph-mon[90842]: Upgrade: Updating crash.smithi203 (2/2) 2024-09-11T00:13:40.002 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:39 smithi111 ceph-mon[90842]: Deploying daemon crash.smithi203 on smithi203 2024-09-11T00:13:41.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:40 smithi203 ceph-mon[69002]: pgmap v38: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:41.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:40 smithi111 ceph-mon[90842]: pgmap v38: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:41.914 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:41 smithi203 ceph-mon[69002]: pgmap v39: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:42.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:41 smithi111 ceph-mon[90842]: pgmap v39: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:43.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:43 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:43.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:43 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:43.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:43 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:13:43.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:43 smithi111 ceph-mon[90842]: pgmap v40: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:44.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:43 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:44.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:43 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:44.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:43 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:13:44.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:43 smithi203 ceph-mon[69002]: pgmap v40: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:45.224 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:44 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:13:45.358 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:44 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:13:46.245 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:45 smithi111 ceph-mon[90842]: pgmap v41: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:46.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:45 smithi203 ceph-mon[69002]: pgmap v41: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:47.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:47 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:47.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:47 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:47.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:47 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:47.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:47 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:48.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:48 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:48.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:48 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:48.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:48 smithi203 ceph-mon[69002]: pgmap v42: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:48.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:48 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:48.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:48 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:48.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:48 smithi111 ceph-mon[90842]: pgmap v42: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:49.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:49 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:49.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:49 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:50.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:49 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:50.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:49 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:50.763 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:50 smithi203 ceph-mon[69002]: pgmap v43: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:50.763 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:50 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:50.763 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:50 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:51.007 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:50 smithi111 ceph-mon[90842]: pgmap v43: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:51.007 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:50 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:51.007 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:50 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:52.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:52 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:52.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:52 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:52.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:52 smithi111 ceph-mon[90842]: pgmap v44: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:52.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:52 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:52.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:52 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:52.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:52 smithi203 ceph-mon[69002]: pgmap v44: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:53.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.967+0000 7fb5c8200700 1 -- 172.21.15.111:0/2969601428 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb5c0100d50 msgr2=0x7fb5c0104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:53.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.967+0000 7fb5c8200700 1 --2- 172.21.15.111:0/2969601428 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb5c0100d50 0x7fb5c0104d20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac009910 tx=0x7fb5ac009c20 comp rx=0 tx=0).stop 2024-09-11T00:13:53.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.968+0000 7fb5c8200700 1 -- 172.21.15.111:0/2969601428 shutdown_connections 2024-09-11T00:13:53.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.968+0000 7fb5c8200700 1 --2- 172.21.15.111:0/2969601428 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb5c0100d50 0x7fb5c0104d20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:53.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.968+0000 7fb5c8200700 1 --2- 172.21.15.111:0/2969601428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5c01003b0 0x7fb5c0100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:53.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.968+0000 7fb5c8200700 1 -- 172.21.15.111:0/2969601428 >> 172.21.15.111:0/2969601428 conn(0x7fb5c00fbc30 msgr2=0x7fb5c00fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:53.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.968+0000 7fb5c8200700 1 -- 172.21.15.111:0/2969601428 shutdown_connections 2024-09-11T00:13:53.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.968+0000 7fb5c8200700 1 -- 172.21.15.111:0/2969601428 wait complete. 2024-09-11T00:13:53.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.969+0000 7fb5c8200700 1 Processor -- start 2024-09-11T00:13:53.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.969+0000 7fb5c8200700 1 -- start start 2024-09-11T00:13:53.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.969+0000 7fb5c8200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb5c01003b0 0x7fb5c0195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:53.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.969+0000 7fb5c8200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5c0100d50 0x7fb5c0196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:53.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.969+0000 7fb5c8200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c01969e0 con 0x7fb5c01003b0 2024-09-11T00:13:53.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.969+0000 7fb5c8200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c019a770 con 0x7fb5c0100d50 2024-09-11T00:13:53.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.969+0000 7fb5c5800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb5c01003b0 0x7fb5c0195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:53.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.969+0000 7fb5c5800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb5c01003b0 0x7fb5c0195dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49686/0 (socket says 172.21.15.111:49686) 2024-09-11T00:13:53.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.969+0000 7fb5c5800700 1 -- 172.21.15.111:0/41412473 learned_addr learned my addr 172.21.15.111:0/41412473 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:13:53.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.970+0000 7fb5c4e00700 1 --2- 172.21.15.111:0/41412473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5c0100d50 0x7fb5c0196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:53.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.970+0000 7fb5c5800700 1 -- 172.21.15.111:0/41412473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5c0100d50 msgr2=0x7fb5c0196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:53.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.970+0000 7fb5c5800700 1 --2- 172.21.15.111:0/41412473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5c0100d50 0x7fb5c0196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:53.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.970+0000 7fb5c5800700 1 -- 172.21.15.111:0/41412473 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac0095f0 con 0x7fb5c01003b0 2024-09-11T00:13:53.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.970+0000 7fb5c5800700 1 --2- 172.21.15.111:0/41412473 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb5c01003b0 0x7fb5c0195dc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb5b400c8a0 tx=0x7fb5b400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:53.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.970+0000 7fb5be000700 1 -- 172.21.15.111:0/41412473 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5b400cea0 con 0x7fb5c01003b0 2024-09-11T00:13:53.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.970+0000 7fb5be000700 1 -- 172.21.15.111:0/41412473 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb5b4004830 con 0x7fb5c01003b0 2024-09-11T00:13:53.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.970+0000 7fb5be000700 1 -- 172.21.15.111:0/41412473 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5b40055b0 con 0x7fb5c01003b0 2024-09-11T00:13:53.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.970+0000 7fb5c8200700 1 -- 172.21.15.111:0/41412473 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c019aa50 con 0x7fb5c01003b0 2024-09-11T00:13:53.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.971+0000 7fb5c8200700 1 -- 172.21.15.111:0/41412473 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c019afa0 con 0x7fb5c01003b0 2024-09-11T00:13:53.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.972+0000 7fb5c8200700 1 -- 172.21.15.111:0/41412473 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c0108720 con 0x7fb5c01003b0 2024-09-11T00:13:53.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.973+0000 7fb5be000700 1 -- 172.21.15.111:0/41412473 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 40) v1 ==== 102584+0+0 (secure 0 0 0) 0x7fb5b40049a0 con 0x7fb5c01003b0 2024-09-11T00:13:53.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.974+0000 7fb5be000700 1 --2- 172.21.15.111:0/41412473 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb5a807a800 0x7fb5a807ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:53.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.974+0000 7fb5be000700 1 -- 172.21.15.111:0/41412473 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb5b409d120 con 0x7fb5c01003b0 2024-09-11T00:13:53.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.974+0000 7fb5c4e00700 1 --2- 172.21.15.111:0/41412473 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb5a807a800 0x7fb5a807ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:53.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.975+0000 7fb5c4e00700 1 --2- 172.21.15.111:0/41412473 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb5a807a800 0x7fb5a807ccb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb5c01973e0 tx=0x7fb5ac01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:53.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:53.978+0000 7fb5be000700 1 -- 172.21.15.111:0/41412473 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fb5b4060680 con 0x7fb5c01003b0 2024-09-11T00:13:54.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.236+0000 7fb5c8200700 1 -- 172.21.15.111:0/41412473 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5c019b270 con 0x7fb5a807a800 2024-09-11T00:13:54.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.237+0000 7fb5be000700 1 -- 172.21.15.111:0/41412473 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7fb5c019b270 con 0x7fb5a807a800 2024-09-11T00:13:54.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.240+0000 7fb5c8200700 1 -- 172.21.15.111:0/41412473 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb5a807a800 msgr2=0x7fb5a807ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.240+0000 7fb5c8200700 1 --2- 172.21.15.111:0/41412473 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb5a807a800 0x7fb5a807ccb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb5c01973e0 tx=0x7fb5ac01a040 comp rx=0 tx=0).stop 2024-09-11T00:13:54.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.240+0000 7fb5c8200700 1 -- 172.21.15.111:0/41412473 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb5c01003b0 msgr2=0x7fb5c0195dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.240+0000 7fb5c8200700 1 --2- 172.21.15.111:0/41412473 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb5c01003b0 0x7fb5c0195dc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb5b400c8a0 tx=0x7fb5b400cc60 comp rx=0 tx=0).stop 2024-09-11T00:13:54.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.240+0000 7fb5c8200700 1 -- 172.21.15.111:0/41412473 shutdown_connections 2024-09-11T00:13:54.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.240+0000 7fb5c8200700 1 --2- 172.21.15.111:0/41412473 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb5a807a800 0x7fb5a807ccb0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.240+0000 7fb5c8200700 1 --2- 172.21.15.111:0/41412473 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb5c01003b0 0x7fb5c0195dc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.240+0000 7fb5c8200700 1 --2- 172.21.15.111:0/41412473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5c0100d50 0x7fb5c0196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.240+0000 7fb5c8200700 1 -- 172.21.15.111:0/41412473 >> 172.21.15.111:0/41412473 conn(0x7fb5c00fbc30 msgr2=0x7fb5c00fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:54.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.240+0000 7fb5c8200700 1 -- 172.21.15.111:0/41412473 shutdown_connections 2024-09-11T00:13:54.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.240+0000 7fb5c8200700 1 -- 172.21.15.111:0/41412473 wait complete. 2024-09-11T00:13:54.257 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:13:54.388 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.386+0000 7f1afbc00700 1 -- 172.21.15.111:0/4030037721 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1af41003b0 msgr2=0x7f1af4100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.388 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.386+0000 7f1afbc00700 1 --2- 172.21.15.111:0/4030037721 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1af41003b0 0x7f1af4100780 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8009910 tx=0x7f1ae8009c20 comp rx=0 tx=0).stop 2024-09-11T00:13:54.388 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.386+0000 7f1afbc00700 1 -- 172.21.15.111:0/4030037721 shutdown_connections 2024-09-11T00:13:54.388 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.386+0000 7f1afbc00700 1 --2- 172.21.15.111:0/4030037721 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1af4100d50 0x7f1af4104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.386+0000 7f1afbc00700 1 --2- 172.21.15.111:0/4030037721 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1af41003b0 0x7f1af4100780 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.386+0000 7f1afbc00700 1 -- 172.21.15.111:0/4030037721 >> 172.21.15.111:0/4030037721 conn(0x7f1af40fbc30 msgr2=0x7f1af40fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:54.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.386+0000 7f1afbc00700 1 -- 172.21.15.111:0/4030037721 shutdown_connections 2024-09-11T00:13:54.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.386+0000 7f1afbc00700 1 -- 172.21.15.111:0/4030037721 wait complete. 2024-09-11T00:13:54.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.387+0000 7f1afbc00700 1 Processor -- start 2024-09-11T00:13:54.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.387+0000 7f1afbc00700 1 -- start start 2024-09-11T00:13:54.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.388+0000 7f1afbc00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1af41003b0 0x7f1af4073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.388+0000 7f1afbc00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1af4100d50 0x7f1af4073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.388+0000 7f1afbc00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af4073ad0 con 0x7f1af4100d50 2024-09-11T00:13:54.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.388+0000 7f1afbc00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af4073c10 con 0x7f1af41003b0 2024-09-11T00:13:54.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.388+0000 7f1af3e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1af4100d50 0x7f1af4073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:54.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.388+0000 7f1af3e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1af4100d50 0x7f1af4073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49700/0 (socket says 172.21.15.111:49700) 2024-09-11T00:13:54.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.388+0000 7f1af3e00700 1 -- 172.21.15.111:0/3365275593 learned_addr learned my addr 172.21.15.111:0/3365275593 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:13:54.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.388+0000 7f1af9200700 1 --2- 172.21.15.111:0/3365275593 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1af41003b0 0x7f1af4073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:54.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.389+0000 7f1af3e00700 1 -- 172.21.15.111:0/3365275593 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1af41003b0 msgr2=0x7f1af4073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.389+0000 7f1af3e00700 1 --2- 172.21.15.111:0/3365275593 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1af41003b0 0x7f1af4073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.389+0000 7f1af3e00700 1 -- 172.21.15.111:0/3365275593 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae80095f0 con 0x7f1af4100d50 2024-09-11T00:13:54.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.389+0000 7f1af3e00700 1 --2- 172.21.15.111:0/3365275593 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1af4100d50 0x7f1af4073590 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1ae000d900 tx=0x7f1ae000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:54.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.389+0000 7f1af1600700 1 -- 172.21.15.111:0/3365275593 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ae0009900 con 0x7f1af4100d50 2024-09-11T00:13:54.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.389+0000 7f1af1600700 1 -- 172.21.15.111:0/3365275593 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1ae0010460 con 0x7f1af4100d50 2024-09-11T00:13:54.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.389+0000 7f1afbc00700 1 -- 172.21.15.111:0/3365275593 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af41a1ee0 con 0x7f1af4100d50 2024-09-11T00:13:54.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.389+0000 7f1af1600700 1 -- 172.21.15.111:0/3365275593 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ae000f5f0 con 0x7f1af4100d50 2024-09-11T00:13:54.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.389+0000 7f1afbc00700 1 -- 172.21.15.111:0/3365275593 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af41a22f0 con 0x7f1af4100d50 2024-09-11T00:13:54.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.391+0000 7f1afbc00700 1 -- 172.21.15.111:0/3365275593 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af41086c0 con 0x7f1af4100d50 2024-09-11T00:13:54.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.392+0000 7f1af1600700 1 -- 172.21.15.111:0/3365275593 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 40) v1 ==== 102584+0+0 (secure 0 0 0) 0x7f1ae00105d0 con 0x7f1af4100d50 2024-09-11T00:13:54.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.393+0000 7f1af1600700 1 --2- 172.21.15.111:0/3365275593 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f1adc07a800 0x7f1adc07ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.393+0000 7f1af1600700 1 -- 172.21.15.111:0/3365275593 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f1ae009cfe0 con 0x7f1af4100d50 2024-09-11T00:13:54.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.393+0000 7f1af9200700 1 --2- 172.21.15.111:0/3365275593 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f1adc07a800 0x7f1adc07ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:54.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.394+0000 7f1af9200700 1 --2- 172.21.15.111:0/3365275593 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f1adc07a800 0x7f1adc07ccb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8006010 tx=0x7f1ae801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:54.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.397+0000 7f1af1600700 1 -- 172.21.15.111:0/3365275593 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f1ae0060580 con 0x7f1af4100d50 2024-09-11T00:13:54.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.644+0000 7f1afbc00700 1 -- 172.21.15.111:0/3365275593 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1af402cd40 con 0x7f1adc07a800 2024-09-11T00:13:54.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.646+0000 7f1af1600700 1 -- 172.21.15.111:0/3365275593 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f1af402cd40 con 0x7f1adc07a800 2024-09-11T00:13:54.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.649+0000 7f1afbc00700 1 -- 172.21.15.111:0/3365275593 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f1adc07a800 msgr2=0x7f1adc07ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.650+0000 7f1afbc00700 1 --2- 172.21.15.111:0/3365275593 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f1adc07a800 0x7f1adc07ccb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8006010 tx=0x7f1ae801a040 comp rx=0 tx=0).stop 2024-09-11T00:13:54.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.650+0000 7f1afbc00700 1 -- 172.21.15.111:0/3365275593 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1af4100d50 msgr2=0x7f1af4073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.650+0000 7f1afbc00700 1 --2- 172.21.15.111:0/3365275593 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1af4100d50 0x7f1af4073590 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1ae000d900 tx=0x7f1ae000dc10 comp rx=0 tx=0).stop 2024-09-11T00:13:54.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.650+0000 7f1afbc00700 1 -- 172.21.15.111:0/3365275593 shutdown_connections 2024-09-11T00:13:54.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.650+0000 7f1afbc00700 1 --2- 172.21.15.111:0/3365275593 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f1adc07a800 0x7f1adc07ccb0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.650+0000 7f1afbc00700 1 --2- 172.21.15.111:0/3365275593 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1af41003b0 0x7f1af4073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.650+0000 7f1afbc00700 1 --2- 172.21.15.111:0/3365275593 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1af4100d50 0x7f1af4073590 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1ae000d900 tx=0x7f1ae000dc10 comp rx=0 tx=0).stop 2024-09-11T00:13:54.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.650+0000 7f1afbc00700 1 -- 172.21.15.111:0/3365275593 >> 172.21.15.111:0/3365275593 conn(0x7f1af40fbc30 msgr2=0x7f1af40fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:54.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.650+0000 7f1afbc00700 1 -- 172.21.15.111:0/3365275593 shutdown_connections 2024-09-11T00:13:54.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.650+0000 7f1afbc00700 1 -- 172.21.15.111:0/3365275593 wait complete. 2024-09-11T00:13:54.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.812+0000 7f3489200700 1 -- 172.21.15.111:0/2217359018 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f34840739a0 msgr2=0x7f348410c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.812+0000 7f3489200700 1 --2- 172.21.15.111:0/2217359018 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f34840739a0 0x7f348410c350 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3470009940 tx=0x7f3470009c50 comp rx=0 tx=0).stop 2024-09-11T00:13:54.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.812+0000 7f3489200700 1 -- 172.21.15.111:0/2217359018 shutdown_connections 2024-09-11T00:13:54.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.812+0000 7f3489200700 1 --2- 172.21.15.111:0/2217359018 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f34840739a0 0x7f348410c350 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.812+0000 7f3489200700 1 --2- 172.21.15.111:0/2217359018 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3484073090 0x7f3484073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.812+0000 7f3489200700 1 -- 172.21.15.111:0/2217359018 >> 172.21.15.111:0/2217359018 conn(0x7f34840fbb10 msgr2=0x7f34840fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:54.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.812+0000 7f3489200700 1 -- 172.21.15.111:0/2217359018 shutdown_connections 2024-09-11T00:13:54.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.812+0000 7f3489200700 1 -- 172.21.15.111:0/2217359018 wait complete. 2024-09-11T00:13:54.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.813+0000 7f3489200700 1 Processor -- start 2024-09-11T00:13:54.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.813+0000 7f3489200700 1 -- start start 2024-09-11T00:13:54.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.814+0000 7f3489200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3484073090 0x7f3484197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.814+0000 7f3489200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f34840739a0 0x7f34841983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.814+0000 7f3489200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3484198ac0 con 0x7f34840739a0 2024-09-11T00:13:54.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.814+0000 7f3489200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348419c850 con 0x7f3484073090 2024-09-11T00:13:54.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.814+0000 7f3482a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f34840739a0 0x7f34841983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:54.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.814+0000 7f3482a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f34840739a0 0x7f34841983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49722/0 (socket says 172.21.15.111:49722) 2024-09-11T00:13:54.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.814+0000 7f3482a00700 1 -- 172.21.15.111:0/1517716548 learned_addr learned my addr 172.21.15.111:0/1517716548 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:13:54.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.814+0000 7f3483400700 1 --2- 172.21.15.111:0/1517716548 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3484073090 0x7f3484197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:54.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.815+0000 7f3482a00700 1 -- 172.21.15.111:0/1517716548 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3484073090 msgr2=0x7f3484197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:54.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.815+0000 7f3482a00700 1 --2- 172.21.15.111:0/1517716548 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3484073090 0x7f3484197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:54.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.815+0000 7f3482a00700 1 -- 172.21.15.111:0/1517716548 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34700095f0 con 0x7f34840739a0 2024-09-11T00:13:54.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.815+0000 7f3482a00700 1 --2- 172.21.15.111:0/1517716548 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f34840739a0 0x7f34841983e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f34700055f0 tx=0x7f3470005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:54.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.815+0000 7f347be00700 1 -- 172.21.15.111:0/1517716548 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f347001d070 con 0x7f34840739a0 2024-09-11T00:13:54.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.815+0000 7f347be00700 1 -- 172.21.15.111:0/1517716548 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f347000f460 con 0x7f34840739a0 2024-09-11T00:13:54.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.815+0000 7f3489200700 1 -- 172.21.15.111:0/1517716548 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f348419cad0 con 0x7f34840739a0 2024-09-11T00:13:54.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.815+0000 7f347be00700 1 -- 172.21.15.111:0/1517716548 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3470021640 con 0x7f34840739a0 2024-09-11T00:13:54.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.815+0000 7f3489200700 1 -- 172.21.15.111:0/1517716548 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348419cfc0 con 0x7f34840739a0 2024-09-11T00:13:54.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.817+0000 7f3489200700 1 -- 172.21.15.111:0/1517716548 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3484109a50 con 0x7f34840739a0 2024-09-11T00:13:54.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.818+0000 7f347be00700 1 -- 172.21.15.111:0/1517716548 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 40) v1 ==== 102584+0+0 (secure 0 0 0) 0x7f347000fab0 con 0x7f34840739a0 2024-09-11T00:13:54.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.818+0000 7f347be00700 1 --2- 172.21.15.111:0/1517716548 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f346807a810 0x7f346807ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:54.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.819+0000 7f347be00700 1 -- 172.21.15.111:0/1517716548 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f347009e800 con 0x7f34840739a0 2024-09-11T00:13:54.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.819+0000 7f3483400700 1 --2- 172.21.15.111:0/1517716548 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f346807a810 0x7f346807ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:54.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.819+0000 7f3483400700 1 --2- 172.21.15.111:0/1517716548 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f346807a810 0x7f346807ccc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3474009a10 tx=0x7f3474009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:54.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:54.823+0000 7f347be00700 1 -- 172.21.15.111:0/1517716548 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f3470061ce0 con 0x7f34840739a0 2024-09-11T00:13:54.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:54 smithi111 ceph-mon[90842]: pgmap v45: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:54.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:54 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:54.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:54 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:54.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:54 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:54.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:54 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:13:54.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:54 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:54.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:54 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:13:54.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:54 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:13:54.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:54 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:13:54.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:54 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:13:54.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:54 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:54.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:54 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi111"} : dispatch 2024-09-11T00:13:54.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:54 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi111"}]': finished 2024-09-11T00:13:54.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:54 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi203"} : dispatch 2024-09-11T00:13:54.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:54 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi203"}]': finished 2024-09-11T00:13:54.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:54 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-11T00:13:55.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:54 smithi203 ceph-mon[69002]: pgmap v45: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:55.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:54 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:55.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:54 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:55.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:54 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:55.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:54 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:13:55.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:54 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:55.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:54 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:13:55.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:54 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:13:55.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:54 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:13:55.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:54 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:13:55.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:54 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:55.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:54 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi111"} : dispatch 2024-09-11T00:13:55.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:54 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi111"}]': finished 2024-09-11T00:13:55.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:54 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi203"} : dispatch 2024-09-11T00:13:55.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:54 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi203"}]': finished 2024-09-11T00:13:55.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:54 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-11T00:13:55.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.067+0000 7f3489200700 1 -- 172.21.15.111:0/1517716548 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f348402cd70 con 0x7f346807a810 2024-09-11T00:13:55.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.077+0000 7f347be00700 1 -- 172.21.15.111:0/1517716548 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f348402cd70 con 0x7f346807a810 2024-09-11T00:13:55.079 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:13:55.079 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (3m) 6s ago 17m 14.6M - 0.27.0 11f11916f8cd d6d3253e881f 2024-09-11T00:13:55.079 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (6m) 6s ago 17m 7490k - 18.2.0 dc2bc1663786 7c40af85314c 2024-09-11T00:13:55.080 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi203 smithi203 running (5m) 8s ago 16m 7730k - 18.2.0 dc2bc1663786 922e3261ff70 2024-09-11T00:13:55.080 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (18s) 6s ago 17m 6899k - 19.3.0-4854-g8f219c47 589dd18248e4 a9cacdb9a638 2024-09-11T00:13:55.080 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi203 smithi203 running (12s) 8s ago 16m 6899k - 19.3.0-4854-g8f219c47 589dd18248e4 d452d9dfa04b 2024-09-11T00:13:55.080 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (3m) 6s ago 16m 67.5M - c8b91775d855 7d3b50b5b59f 2024-09-11T00:13:55.080 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.gmgsay smithi111 running (10m) 6s ago 10m 17.5M - 18.2.0 dc2bc1663786 795e4ff0075c 2024-09-11T00:13:55.080 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.rucaba smithi111 running (9m) 6s ago 9m 17.6M - 18.2.0 dc2bc1663786 02885adac62c 2024-09-11T00:13:55.080 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.tcrqop smithi203 running (10m) 8s ago 9m 150M - 18.2.0 dc2bc1663786 4df492159bb4 2024-09-11T00:13:55.080 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.uqkbkn smithi203 running (9m) 8s ago 9m 17.6M - 18.2.0 dc2bc1663786 619aa58ea314 2024-09-11T00:13:55.080 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.ypucji smithi111 *:8443,9283,8765 running (5m) 6s ago 18m 509M - 19.3.0-4854-g8f219c47 589dd18248e4 07fa31f49618 2024-09-11T00:13:55.080 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi203.smuspl smithi203 *:8443,9283,8765 running (4m) 8s ago 15m 454M - 19.3.0-4854-g8f219c47 589dd18248e4 7e5a93a5ffa7 2024-09-11T00:13:55.080 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (93s) 6s ago 18m 42.7M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 3c29c070a612 2024-09-11T00:13:55.081 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi203 smithi203 running (65s) 8s ago 15m 36.1M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 45e8285e4b4d 2024-09-11T00:13:55.081 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (4m) 6s ago 17m 7448k - 1.7.0 72c9c2088986 ec478ea14488 2024-09-11T00:13:55.081 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi203 smithi203 *:9100 running (4m) 8s ago 15m 7209k - 1.7.0 72c9c2088986 54d461cde1bc 2024-09-11T00:13:55.081 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (14m) 6s ago 14m 212M 1216M 18.2.0 dc2bc1663786 162b7249a591 2024-09-11T00:13:55.081 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (13m) 6s ago 13m 226M 1216M 18.2.0 dc2bc1663786 3614d95b1425 2024-09-11T00:13:55.081 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (13m) 6s ago 13m 184M 1216M 18.2.0 dc2bc1663786 db175d4b09b9 2024-09-11T00:13:55.081 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi203 running (12m) 8s ago 12m 246M 2240M 18.2.0 dc2bc1663786 60b1cef7a70d 2024-09-11T00:13:55.081 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi203 running (12m) 8s ago 12m 209M 2240M 18.2.0 dc2bc1663786 769c7942c42b 2024-09-11T00:13:55.081 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi203 running (11m) 8s ago 11m 194M 2240M 18.2.0 dc2bc1663786 6d824001d40c 2024-09-11T00:13:55.081 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (3m) 6s ago 16m 56.2M - 2.51.0 1d3b7f56885b 3e72ac10983d 2024-09-11T00:13:55.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.079+0000 7f3489200700 1 -- 172.21.15.111:0/1517716548 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f346807a810 msgr2=0x7f346807ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.079+0000 7f3489200700 1 --2- 172.21.15.111:0/1517716548 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f346807a810 0x7f346807ccc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3474009a10 tx=0x7f3474009190 comp rx=0 tx=0).stop 2024-09-11T00:13:55.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.079+0000 7f3489200700 1 -- 172.21.15.111:0/1517716548 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f34840739a0 msgr2=0x7f34841983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.079+0000 7f3489200700 1 --2- 172.21.15.111:0/1517716548 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f34840739a0 0x7f34841983e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f34700055f0 tx=0x7f3470005620 comp rx=0 tx=0).stop 2024-09-11T00:13:55.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.080+0000 7f3489200700 1 -- 172.21.15.111:0/1517716548 shutdown_connections 2024-09-11T00:13:55.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.080+0000 7f3489200700 1 --2- 172.21.15.111:0/1517716548 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f346807a810 0x7f346807ccc0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.080+0000 7f3489200700 1 --2- 172.21.15.111:0/1517716548 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3484073090 0x7f3484197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.080+0000 7f3489200700 1 --2- 172.21.15.111:0/1517716548 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f34840739a0 0x7f34841983e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.080+0000 7f3489200700 1 -- 172.21.15.111:0/1517716548 >> 172.21.15.111:0/1517716548 conn(0x7f34840fbb10 msgr2=0x7f3484106b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:55.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.080+0000 7f3489200700 1 -- 172.21.15.111:0/1517716548 shutdown_connections 2024-09-11T00:13:55.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.080+0000 7f3489200700 1 -- 172.21.15.111:0/1517716548 wait complete. 2024-09-11T00:13:55.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.218+0000 7f7942e00700 1 -- 172.21.15.111:0/2609725577 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f793c100d50 msgr2=0x7f793c104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.218+0000 7f7942e00700 1 --2- 172.21.15.111:0/2609725577 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f793c100d50 0x7f793c104d20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7928009910 tx=0x7f7928009c20 comp rx=0 tx=0).stop 2024-09-11T00:13:55.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.218+0000 7f7942e00700 1 -- 172.21.15.111:0/2609725577 shutdown_connections 2024-09-11T00:13:55.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.218+0000 7f7942e00700 1 --2- 172.21.15.111:0/2609725577 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f793c100d50 0x7f793c104d20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.218+0000 7f7942e00700 1 --2- 172.21.15.111:0/2609725577 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f793c1003b0 0x7f793c100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.218+0000 7f7942e00700 1 -- 172.21.15.111:0/2609725577 >> 172.21.15.111:0/2609725577 conn(0x7f793c0fbc30 msgr2=0x7f793c0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:55.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.218+0000 7f7942e00700 1 -- 172.21.15.111:0/2609725577 shutdown_connections 2024-09-11T00:13:55.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.218+0000 7f7942e00700 1 -- 172.21.15.111:0/2609725577 wait complete. 2024-09-11T00:13:55.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.219+0000 7f7942e00700 1 Processor -- start 2024-09-11T00:13:55.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.219+0000 7f7942e00700 1 -- start start 2024-09-11T00:13:55.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.220+0000 7f7942e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f793c1003b0 0x7f793c195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.220+0000 7f7942e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f793c100d50 0x7f793c196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.220+0000 7f7942e00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793c1969e0 con 0x7f793c100d50 2024-09-11T00:13:55.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.220+0000 7f7942e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793c19a770 con 0x7f793c1003b0 2024-09-11T00:13:55.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.220+0000 7f793b400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f793c100d50 0x7f793c196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.220+0000 7f793b400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f793c100d50 0x7f793c196300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49752/0 (socket says 172.21.15.111:49752) 2024-09-11T00:13:55.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.220+0000 7f793b400700 1 -- 172.21.15.111:0/2540232704 learned_addr learned my addr 172.21.15.111:0/2540232704 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:13:55.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.220+0000 7f793be00700 1 --2- 172.21.15.111:0/2540232704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f793c1003b0 0x7f793c195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.220+0000 7f793b400700 1 -- 172.21.15.111:0/2540232704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f793c1003b0 msgr2=0x7f793c195dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.220+0000 7f793b400700 1 --2- 172.21.15.111:0/2540232704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f793c1003b0 0x7f793c195dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.220+0000 7f793b400700 1 -- 172.21.15.111:0/2540232704 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79280095f0 con 0x7f793c100d50 2024-09-11T00:13:55.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.221+0000 7f793b400700 1 --2- 172.21.15.111:0/2540232704 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f793c100d50 0x7f793c196300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f792800bda0 tx=0x7f792800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:55.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.221+0000 7f7938c00700 1 -- 172.21.15.111:0/2540232704 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f792801d070 con 0x7f793c100d50 2024-09-11T00:13:55.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.221+0000 7f7938c00700 1 -- 172.21.15.111:0/2540232704 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f792800f460 con 0x7f793c100d50 2024-09-11T00:13:55.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.221+0000 7f7938c00700 1 -- 172.21.15.111:0/2540232704 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7928017630 con 0x7f793c100d50 2024-09-11T00:13:55.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.221+0000 7f7942e00700 1 -- 172.21.15.111:0/2540232704 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f793c19a9f0 con 0x7f793c100d50 2024-09-11T00:13:55.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.221+0000 7f7942e00700 1 -- 172.21.15.111:0/2540232704 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f793c19aee0 con 0x7f793c100d50 2024-09-11T00:13:55.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.222+0000 7f7942e00700 1 -- 172.21.15.111:0/2540232704 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f793c108720 con 0x7f793c100d50 2024-09-11T00:13:55.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.224+0000 7f7938c00700 1 -- 172.21.15.111:0/2540232704 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 40) v1 ==== 102584+0+0 (secure 0 0 0) 0x7f792800fa40 con 0x7f793c100d50 2024-09-11T00:13:55.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.225+0000 7f7938c00700 1 --2- 172.21.15.111:0/2540232704 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f792007a810 0x7f792007ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.225+0000 7f7938c00700 1 -- 172.21.15.111:0/2540232704 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f792809e900 con 0x7f793c100d50 2024-09-11T00:13:55.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.225+0000 7f793be00700 1 --2- 172.21.15.111:0/2540232704 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f792007a810 0x7f792007ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.226+0000 7f793be00700 1 --2- 172.21.15.111:0/2540232704 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f792007a810 0x7f792007ccc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f792c005fd0 tx=0x7f792c005f60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:55.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.229+0000 7f7938c00700 1 -- 172.21.15.111:0/2540232704 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f7928061e60 con 0x7f793c100d50 2024-09-11T00:13:55.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.575+0000 7f7942e00700 1 -- 172.21.15.111:0/2540232704 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f793c04ea50 con 0x7f793c100d50 2024-09-11T00:13:55.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.576+0000 7f7938c00700 1 -- 172.21.15.111:0/2540232704 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+688 (secure 0 0 0) 0x7f7928064f80 con 0x7f793c100d50 2024-09-11T00:13:55.578 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:13:55.578 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-11T00:13:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:13:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:13:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-11T00:13:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:13:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:13:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-11T00:13:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-11T00:13:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:13:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-11T00:13:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-11T00:13:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:13:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-11T00:13:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 10, 2024-09-11T00:13:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 4 2024-09-11T00:13:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-11T00:13:55.580 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:13:55.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.579+0000 7f7942e00700 1 -- 172.21.15.111:0/2540232704 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f792007a810 msgr2=0x7f792007ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.579+0000 7f7942e00700 1 --2- 172.21.15.111:0/2540232704 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f792007a810 0x7f792007ccc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f792c005fd0 tx=0x7f792c005f60 comp rx=0 tx=0).stop 2024-09-11T00:13:55.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.579+0000 7f7942e00700 1 -- 172.21.15.111:0/2540232704 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f793c100d50 msgr2=0x7f793c196300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.579+0000 7f7942e00700 1 --2- 172.21.15.111:0/2540232704 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f793c100d50 0x7f793c196300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f792800bda0 tx=0x7f792800be80 comp rx=0 tx=0).stop 2024-09-11T00:13:55.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.579+0000 7f7942e00700 1 -- 172.21.15.111:0/2540232704 shutdown_connections 2024-09-11T00:13:55.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.579+0000 7f7942e00700 1 --2- 172.21.15.111:0/2540232704 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f792007a810 0x7f792007ccc0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.579+0000 7f7942e00700 1 --2- 172.21.15.111:0/2540232704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f793c1003b0 0x7f793c195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.579+0000 7f7942e00700 1 --2- 172.21.15.111:0/2540232704 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f793c100d50 0x7f793c196300 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.579+0000 7f7942e00700 1 -- 172.21.15.111:0/2540232704 >> 172.21.15.111:0/2540232704 conn(0x7f793c0fbc30 msgr2=0x7f793c0fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:55.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.579+0000 7f7942e00700 1 -- 172.21.15.111:0/2540232704 shutdown_connections 2024-09-11T00:13:55.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.579+0000 7f7942e00700 1 -- 172.21.15.111:0/2540232704 wait complete. 2024-09-11T00:13:55.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.718+0000 7fb39ea00700 1 -- 172.21.15.111:0/3418153667 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb398100200 msgr2=0x7fb3981005d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.718+0000 7fb39ea00700 1 --2- 172.21.15.111:0/3418153667 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb398100200 0x7fb3981005d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb38c009910 tx=0x7fb38c009c20 comp rx=0 tx=0).stop 2024-09-11T00:13:55.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.718+0000 7fb39ea00700 1 -- 172.21.15.111:0/3418153667 shutdown_connections 2024-09-11T00:13:55.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.718+0000 7fb39ea00700 1 --2- 172.21.15.111:0/3418153667 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb398100ba0 0x7fb398104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.718+0000 7fb39ea00700 1 --2- 172.21.15.111:0/3418153667 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb398100200 0x7fb3981005d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.718+0000 7fb39ea00700 1 -- 172.21.15.111:0/3418153667 >> 172.21.15.111:0/3418153667 conn(0x7fb3980fba80 msgr2=0x7fb3980fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:55.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.718+0000 7fb39ea00700 1 -- 172.21.15.111:0/3418153667 shutdown_connections 2024-09-11T00:13:55.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.718+0000 7fb39ea00700 1 -- 172.21.15.111:0/3418153667 wait complete. 2024-09-11T00:13:55.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.719+0000 7fb39ea00700 1 Processor -- start 2024-09-11T00:13:55.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.719+0000 7fb39ea00700 1 -- start start 2024-09-11T00:13:55.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.720+0000 7fb39ea00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb398100200 0x7fb398197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.720+0000 7fb39ea00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb398100ba0 0x7fb398198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.720+0000 7fb39ea00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb398198a10 con 0x7fb398100ba0 2024-09-11T00:13:55.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.720+0000 7fb39ea00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39819c7a0 con 0x7fb398100200 2024-09-11T00:13:55.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.720+0000 7fb39cc00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb398100ba0 0x7fb398198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.720+0000 7fb39cc00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb398100ba0 0x7fb398198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49780/0 (socket says 172.21.15.111:49780) 2024-09-11T00:13:55.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.720+0000 7fb39cc00700 1 -- 172.21.15.111:0/3862046299 learned_addr learned my addr 172.21.15.111:0/3862046299 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:13:55.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.720+0000 7fb39d600700 1 --2- 172.21.15.111:0/3862046299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb398100200 0x7fb398197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.720+0000 7fb39cc00700 1 -- 172.21.15.111:0/3862046299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb398100200 msgr2=0x7fb398197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.720+0000 7fb39cc00700 1 --2- 172.21.15.111:0/3862046299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb398100200 0x7fb398197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.720+0000 7fb39cc00700 1 -- 172.21.15.111:0/3862046299 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb38c0095f0 con 0x7fb398100ba0 2024-09-11T00:13:55.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.721+0000 7fb39cc00700 1 --2- 172.21.15.111:0/3862046299 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb398100ba0 0x7fb398198330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb38400d900 tx=0x7fb38400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:55.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.721+0000 7fb396000700 1 -- 172.21.15.111:0/3862046299 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb384009900 con 0x7fb398100ba0 2024-09-11T00:13:55.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.721+0000 7fb39ea00700 1 -- 172.21.15.111:0/3862046299 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb39819ca80 con 0x7fb398100ba0 2024-09-11T00:13:55.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.721+0000 7fb396000700 1 -- 172.21.15.111:0/3862046299 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb384010460 con 0x7fb398100ba0 2024-09-11T00:13:55.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.721+0000 7fb396000700 1 -- 172.21.15.111:0/3862046299 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb38400f5f0 con 0x7fb398100ba0 2024-09-11T00:13:55.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.721+0000 7fb39ea00700 1 -- 172.21.15.111:0/3862046299 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb39819cfd0 con 0x7fb398100ba0 2024-09-11T00:13:55.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.722+0000 7fb39ea00700 1 -- 172.21.15.111:0/3862046299 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3981042f0 con 0x7fb398100ba0 2024-09-11T00:13:55.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.723+0000 7fb396000700 1 -- 172.21.15.111:0/3862046299 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 40) v1 ==== 102584+0+0 (secure 0 0 0) 0x7fb3840105d0 con 0x7fb398100ba0 2024-09-11T00:13:55.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.724+0000 7fb396000700 1 --2- 172.21.15.111:0/3862046299 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb38007a800 0x7fb38007ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.724+0000 7fb396000700 1 -- 172.21.15.111:0/3862046299 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb38409d320 con 0x7fb398100ba0 2024-09-11T00:13:55.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.725+0000 7fb39d600700 1 --2- 172.21.15.111:0/3862046299 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb38007a800 0x7fb38007ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.725+0000 7fb39d600700 1 --2- 172.21.15.111:0/3862046299 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb38007a800 0x7fb38007ccb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb38c006010 tx=0x7fb38c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:55.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:55.728+0000 7fb396000700 1 -- 172.21.15.111:0/3862046299 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fb3840608a0 con 0x7fb398100ba0 2024-09-11T00:13:55.891 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:55 smithi111 ceph-mon[90842]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:13:55.891 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:55 smithi111 ceph-mon[90842]: Upgrade: Setting container_image for all crash 2024-09-11T00:13:55.892 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:55 smithi111 ceph-mon[90842]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-11T00:13:55.892 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:55 smithi111 ceph-mon[90842]: Upgrade: osd.0 is safe to restart 2024-09-11T00:13:55.892 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:55 smithi111 ceph-mon[90842]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:13:55.892 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:55 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/2540232704' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:13:56.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.001+0000 7fb39ea00700 1 -- 172.21.15.111:0/3862046299 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb39804f2a0 con 0x7fb398100ba0 2024-09-11T00:13:56.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.002+0000 7fb396000700 1 -- 172.21.15.111:0/3862046299 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1921 (secure 0 0 0) 0x7fb3840639c0 con 0x7fb398100ba0 2024-09-11T00:13:56.004 INFO:teuthology.orchestra.run.smithi111.stdout:e15 2024-09-11T00:13:56.004 INFO:teuthology.orchestra.run.smithi111.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-11T00:13:56.005 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T00:13:56.005 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:13:56.005 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-11T00:13:56.005 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:13:56.005 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-11T00:13:56.005 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-11T00:13:56.005 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 14 2024-09-11T00:13:56.005 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-11T00:13:56.005 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-11T00:03:47.950356+0000 2024-09-11T00:13:56.005 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-11T00:04:06.275905+0000 2024-09-11T00:13:56.005 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-11T00:13:56.005 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-11T00:13:56.005 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-11T00:13:56.006 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-11T00:13:56.006 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-11T00:13:56.006 INFO:teuthology.orchestra.run.smithi111.stdout:max_xattr_size 65536 2024-09-11T00:13:56.006 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-11T00:13:56.006 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-11T00:13:56.006 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 47 2024-09-11T00:13:56.006 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:13:56.006 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-11T00:13:56.006 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-11T00:13:56.006 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=24363} 2024-09-11T00:13:56.006 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-11T00:13:56.006 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-11T00:13:56.006 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-11T00:13:56.006 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-11T00:13:56.006 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-11T00:13:56.007 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data enabled 2024-09-11T00:13:56.007 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-11T00:13:56.007 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-11T00:13:56.007 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 1 2024-09-11T00:13:56.007 INFO:teuthology.orchestra.run.smithi111.stdout:qdb_cluster leader: 0 members: 2024-09-11T00:13:56.007 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.tcrqop{0:24363} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.203:6824/3082736449,v1:172.21.15.203:6825/3082736449] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:13:56.007 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:13:56.007 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:13:56.007 INFO:teuthology.orchestra.run.smithi111.stdout:Standby daemons: 2024-09-11T00:13:56.007 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:13:56.007 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.rucaba{-1:14554} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6828/2045133285,v1:172.21.15.111:6829/2045133285] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:13:56.007 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.gmgsay{-1:14566} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.111:6826/1122545830,v1:172.21.15.111:6827/1122545830] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:13:56.007 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.uqkbkn{-1:24379} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.203:6826/695613114,v1:172.21.15.203:6827/695613114] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:13:56.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.005+0000 7fb39ea00700 1 -- 172.21.15.111:0/3862046299 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb38007a800 msgr2=0x7fb38007ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.005+0000 7fb39ea00700 1 --2- 172.21.15.111:0/3862046299 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb38007a800 0x7fb38007ccb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb38c006010 tx=0x7fb38c01a040 comp rx=0 tx=0).stop 2024-09-11T00:13:56.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.005+0000 7fb39ea00700 1 -- 172.21.15.111:0/3862046299 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb398100ba0 msgr2=0x7fb398198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.005+0000 7fb39ea00700 1 --2- 172.21.15.111:0/3862046299 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb398100ba0 0x7fb398198330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb38400d900 tx=0x7fb38400dcc0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.005+0000 7fb39ea00700 1 -- 172.21.15.111:0/3862046299 shutdown_connections 2024-09-11T00:13:56.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.005+0000 7fb39ea00700 1 --2- 172.21.15.111:0/3862046299 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb38007a800 0x7fb38007ccb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.005+0000 7fb39ea00700 1 --2- 172.21.15.111:0/3862046299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb398100200 0x7fb398197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.005+0000 7fb39ea00700 1 --2- 172.21.15.111:0/3862046299 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb398100ba0 0x7fb398198330 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.005+0000 7fb39ea00700 1 -- 172.21.15.111:0/3862046299 >> 172.21.15.111:0/3862046299 conn(0x7fb3980fba80 msgr2=0x7fb3980fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:56.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.005+0000 7fb39ea00700 1 -- 172.21.15.111:0/3862046299 shutdown_connections 2024-09-11T00:13:56.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.005+0000 7fb39ea00700 1 -- 172.21.15.111:0/3862046299 wait complete. 2024-09-11T00:13:56.009 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 15 2024-09-11T00:13:56.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:55 smithi203 ceph-mon[69002]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:13:56.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:55 smithi203 ceph-mon[69002]: Upgrade: Setting container_image for all crash 2024-09-11T00:13:56.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:55 smithi203 ceph-mon[69002]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-11T00:13:56.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:55 smithi203 ceph-mon[69002]: Upgrade: osd.0 is safe to restart 2024-09-11T00:13:56.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:55 smithi203 ceph-mon[69002]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:13:56.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:55 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/2540232704' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:13:56.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.151+0000 7f27b1a00700 1 -- 172.21.15.111:0/3290177276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f27ac1003b0 msgr2=0x7f27ac100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.151+0000 7f27b1a00700 1 --2- 172.21.15.111:0/3290177276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f27ac1003b0 0x7f27ac100780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f279c009910 tx=0x7f279c009c20 comp rx=0 tx=0).stop 2024-09-11T00:13:56.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.151+0000 7f27b1a00700 1 -- 172.21.15.111:0/3290177276 shutdown_connections 2024-09-11T00:13:56.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.151+0000 7f27b1a00700 1 --2- 172.21.15.111:0/3290177276 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27ac100d50 0x7f27ac104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.151+0000 7f27b1a00700 1 --2- 172.21.15.111:0/3290177276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f27ac1003b0 0x7f27ac100780 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.151+0000 7f27b1a00700 1 -- 172.21.15.111:0/3290177276 >> 172.21.15.111:0/3290177276 conn(0x7f27ac0fbc30 msgr2=0x7f27ac0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:56.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.151+0000 7f27b1a00700 1 -- 172.21.15.111:0/3290177276 shutdown_connections 2024-09-11T00:13:56.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.151+0000 7f27b1a00700 1 -- 172.21.15.111:0/3290177276 wait complete. 2024-09-11T00:13:56.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.153+0000 7f27b1a00700 1 Processor -- start 2024-09-11T00:13:56.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.153+0000 7f27b1a00700 1 -- start start 2024-09-11T00:13:56.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.154+0000 7f27b1a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f27ac1003b0 0x7f27ac195d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:56.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.154+0000 7f27b1a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27ac100d50 0x7f27ac196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:56.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.154+0000 7f27b1a00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ac1968a0 con 0x7f27ac1003b0 2024-09-11T00:13:56.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.154+0000 7f27b1a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ac1969e0 con 0x7f27ac100d50 2024-09-11T00:13:56.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.154+0000 7f27aaa00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f27ac1003b0 0x7f27ac195d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:56.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.154+0000 7f27aaa00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f27ac1003b0 0x7f27ac195d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49806/0 (socket says 172.21.15.111:49806) 2024-09-11T00:13:56.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.154+0000 7f27aaa00700 1 -- 172.21.15.111:0/3529374134 learned_addr learned my addr 172.21.15.111:0/3529374134 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:13:56.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.154+0000 7f27aa000700 1 --2- 172.21.15.111:0/3529374134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27ac100d50 0x7f27ac196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:56.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.154+0000 7f27aaa00700 1 -- 172.21.15.111:0/3529374134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27ac100d50 msgr2=0x7f27ac196250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.154+0000 7f27aaa00700 1 --2- 172.21.15.111:0/3529374134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27ac100d50 0x7f27ac196250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.154+0000 7f27aaa00700 1 -- 172.21.15.111:0/3529374134 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279c0095f0 con 0x7f27ac1003b0 2024-09-11T00:13:56.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.154+0000 7f27aa000700 1 --2- 172.21.15.111:0/3529374134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27ac100d50 0x7f27ac196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:56.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.155+0000 7f27aaa00700 1 --2- 172.21.15.111:0/3529374134 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f27ac1003b0 0x7f27ac195d10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f279c006010 tx=0x7f279c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:56.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.155+0000 7f27a3400700 1 -- 172.21.15.111:0/3529374134 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f279c01d070 con 0x7f27ac1003b0 2024-09-11T00:13:56.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.155+0000 7f27a3400700 1 -- 172.21.15.111:0/3529374134 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f279c004fb0 con 0x7f27ac1003b0 2024-09-11T00:13:56.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.155+0000 7f27b1a00700 1 -- 172.21.15.111:0/3529374134 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27ac19a7d0 con 0x7f27ac1003b0 2024-09-11T00:13:56.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.155+0000 7f27b1a00700 1 -- 172.21.15.111:0/3529374134 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27ac19acc0 con 0x7f27ac1003b0 2024-09-11T00:13:56.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.156+0000 7f27a3400700 1 -- 172.21.15.111:0/3529374134 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f279c022ea0 con 0x7f27ac1003b0 2024-09-11T00:13:56.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.157+0000 7f27b1a00700 1 -- 172.21.15.111:0/3529374134 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f278c005320 con 0x7f27ac1003b0 2024-09-11T00:13:56.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.158+0000 7f27a3400700 1 -- 172.21.15.111:0/3529374134 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 40) v1 ==== 102584+0+0 (secure 0 0 0) 0x7f279c004af0 con 0x7f27ac1003b0 2024-09-11T00:13:56.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.159+0000 7f27a3400700 1 --2- 172.21.15.111:0/3529374134 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f279007a810 0x7f279007ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:56.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.160+0000 7f27a3400700 1 -- 172.21.15.111:0/3529374134 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f279c09ea10 con 0x7f27ac1003b0 2024-09-11T00:13:56.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.160+0000 7f27aa000700 1 --2- 172.21.15.111:0/3529374134 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f279007a810 0x7f279007ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:56.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.161+0000 7f27aa000700 1 --2- 172.21.15.111:0/3529374134 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f279007a810 0x7f279007ccc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2798005fd0 tx=0x7f2798005e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:56.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.164+0000 7f27a3400700 1 -- 172.21.15.111:0/3529374134 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f279c062020 con 0x7f27ac1003b0 2024-09-11T00:13:56.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.422+0000 7f27b1a00700 1 -- 172.21.15.111:0/3529374134 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f278c000bf0 con 0x7f279007a810 2024-09-11T00:13:56.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.424+0000 7f27a3400700 1 -- 172.21.15.111:0/3529374134 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f278c000bf0 con 0x7f279007a810 2024-09-11T00:13:56.426 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:13:56.426 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e", 2024-09-11T00:13:56.426 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-11T00:13:56.426 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-11T00:13:56.426 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-11T00:13:56.426 INFO:teuthology.orchestra.run.smithi111.stdout: "crash", 2024-09-11T00:13:56.427 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr", 2024-09-11T00:13:56.427 INFO:teuthology.orchestra.run.smithi111.stdout: "mon" 2024-09-11T00:13:56.427 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-11T00:13:56.427 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "6/23 daemons upgraded", 2024-09-11T00:13:56.427 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading osd daemons", 2024-09-11T00:13:56.427 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-11T00:13:56.427 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:13:56.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.427+0000 7f27b1a00700 1 -- 172.21.15.111:0/3529374134 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f279007a810 msgr2=0x7f279007ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.427+0000 7f27b1a00700 1 --2- 172.21.15.111:0/3529374134 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f279007a810 0x7f279007ccc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2798005fd0 tx=0x7f2798005e30 comp rx=0 tx=0).stop 2024-09-11T00:13:56.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.427+0000 7f27b1a00700 1 -- 172.21.15.111:0/3529374134 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f27ac1003b0 msgr2=0x7f27ac195d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.427+0000 7f27b1a00700 1 --2- 172.21.15.111:0/3529374134 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f27ac1003b0 0x7f27ac195d10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f279c006010 tx=0x7f279c00be20 comp rx=0 tx=0).stop 2024-09-11T00:13:56.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.427+0000 7f27b1a00700 1 -- 172.21.15.111:0/3529374134 shutdown_connections 2024-09-11T00:13:56.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.427+0000 7f27b1a00700 1 --2- 172.21.15.111:0/3529374134 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f279007a810 0x7f279007ccc0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.427+0000 7f27b1a00700 1 --2- 172.21.15.111:0/3529374134 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f27ac1003b0 0x7f27ac195d10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.427+0000 7f27b1a00700 1 --2- 172.21.15.111:0/3529374134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27ac100d50 0x7f27ac196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.427+0000 7f27b1a00700 1 -- 172.21.15.111:0/3529374134 >> 172.21.15.111:0/3529374134 conn(0x7f27ac0fbc30 msgr2=0x7f27ac0fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:56.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.427+0000 7f27b1a00700 1 -- 172.21.15.111:0/3529374134 shutdown_connections 2024-09-11T00:13:56.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.427+0000 7f27b1a00700 1 -- 172.21.15.111:0/3529374134 wait complete. 2024-09-11T00:13:56.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.572+0000 7f57aa200700 1 -- 172.21.15.111:0/3947972519 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57a41003b0 msgr2=0x7f57a4100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.572+0000 7f57aa200700 1 --2- 172.21.15.111:0/3947972519 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57a41003b0 0x7f57a4100780 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5794009910 tx=0x7f5794009c20 comp rx=0 tx=0).stop 2024-09-11T00:13:56.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.572+0000 7f57aa200700 1 -- 172.21.15.111:0/3947972519 shutdown_connections 2024-09-11T00:13:56.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.572+0000 7f57aa200700 1 --2- 172.21.15.111:0/3947972519 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f57a4100d50 0x7f57a4104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.573+0000 7f57aa200700 1 --2- 172.21.15.111:0/3947972519 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57a41003b0 0x7f57a4100780 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.573+0000 7f57aa200700 1 -- 172.21.15.111:0/3947972519 >> 172.21.15.111:0/3947972519 conn(0x7f57a40fbc30 msgr2=0x7f57a40fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:56.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.573+0000 7f57aa200700 1 -- 172.21.15.111:0/3947972519 shutdown_connections 2024-09-11T00:13:56.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.573+0000 7f57aa200700 1 -- 172.21.15.111:0/3947972519 wait complete. 2024-09-11T00:13:56.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.574+0000 7f57aa200700 1 Processor -- start 2024-09-11T00:13:56.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.574+0000 7f57aa200700 1 -- start start 2024-09-11T00:13:56.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.575+0000 7f57aa200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57a41003b0 0x7f57a4195d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:56.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.575+0000 7f57aa200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f57a4100d50 0x7f57a41962b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:56.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.575+0000 7f57aa200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a4196990 con 0x7f57a41003b0 2024-09-11T00:13:56.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.575+0000 7f57aa200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a419a720 con 0x7f57a4100d50 2024-09-11T00:13:56.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.575+0000 7f57a3400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57a41003b0 0x7f57a4195d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:56.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.575+0000 7f57a3400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57a41003b0 0x7f57a4195d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49822/0 (socket says 172.21.15.111:49822) 2024-09-11T00:13:56.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.575+0000 7f57a3400700 1 -- 172.21.15.111:0/2285018868 learned_addr learned my addr 172.21.15.111:0/2285018868 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:13:56.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.575+0000 7f57a2a00700 1 --2- 172.21.15.111:0/2285018868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f57a4100d50 0x7f57a41962b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:56.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.576+0000 7f57a3400700 1 -- 172.21.15.111:0/2285018868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f57a4100d50 msgr2=0x7f57a41962b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.576+0000 7f57a3400700 1 --2- 172.21.15.111:0/2285018868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f57a4100d50 0x7f57a41962b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.576+0000 7f57a3400700 1 -- 172.21.15.111:0/2285018868 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57940095f0 con 0x7f57a41003b0 2024-09-11T00:13:56.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.576+0000 7f57a3400700 1 --2- 172.21.15.111:0/2285018868 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57a41003b0 0x7f57a4195d70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f57940098e0 tx=0x7f579400f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:56.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.576+0000 7f579be00700 1 -- 172.21.15.111:0/2285018868 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f579401d070 con 0x7f57a41003b0 2024-09-11T00:13:56.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.576+0000 7f579be00700 1 -- 172.21.15.111:0/2285018868 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f57940052a0 con 0x7f57a41003b0 2024-09-11T00:13:56.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.576+0000 7f57aa200700 1 -- 172.21.15.111:0/2285018868 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a419a9a0 con 0x7f57a41003b0 2024-09-11T00:13:56.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.576+0000 7f579be00700 1 -- 172.21.15.111:0/2285018868 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5794017400 con 0x7f57a41003b0 2024-09-11T00:13:56.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.577+0000 7f57aa200700 1 -- 172.21.15.111:0/2285018868 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a419ae90 con 0x7f57a41003b0 2024-09-11T00:13:56.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.578+0000 7f57aa200700 1 -- 172.21.15.111:0/2285018868 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57a4108670 con 0x7f57a41003b0 2024-09-11T00:13:56.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.579+0000 7f579be00700 1 -- 172.21.15.111:0/2285018868 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 40) v1 ==== 102584+0+0 (secure 0 0 0) 0x7f579400f900 con 0x7f57a41003b0 2024-09-11T00:13:56.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.580+0000 7f579be00700 1 --2- 172.21.15.111:0/2285018868 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f578807a850 0x7f578807cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:56.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.580+0000 7f579be00700 1 -- 172.21.15.111:0/2285018868 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f579409e8f0 con 0x7f57a41003b0 2024-09-11T00:13:56.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.580+0000 7f57a2a00700 1 --2- 172.21.15.111:0/2285018868 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f578807a850 0x7f578807cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:56.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.581+0000 7f57a2a00700 1 --2- 172.21.15.111:0/2285018868 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f578807a850 0x7f578807cd00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f57a4197390 tx=0x7f5790009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:56.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.584+0000 7f579be00700 1 -- 172.21.15.111:0/2285018868 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f5794061e50 con 0x7f57a41003b0 2024-09-11T00:13:56.678 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:56 smithi111 ceph-mon[90842]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:13:56.678 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:56 smithi111 ceph-mon[90842]: pgmap v46: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:56.678 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:56 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/3862046299' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:13:56.679 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:56 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:56.679 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:56 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-11T00:13:56.679 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:56 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:56.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.913+0000 7f57aa200700 1 -- 172.21.15.111:0/2285018868 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f57a404ea50 con 0x7f57a41003b0 2024-09-11T00:13:56.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.913+0000 7f579be00700 1 -- 172.21.15.111:0/2285018868 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f5794064f70 con 0x7f57a41003b0 2024-09-11T00:13:56.915 INFO:teuthology.orchestra.run.smithi111.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-11T00:13:56.915 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-11T00:13:56.915 INFO:teuthology.orchestra.run.smithi111.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-11T00:13:56.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.916+0000 7f57aa200700 1 -- 172.21.15.111:0/2285018868 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f578807a850 msgr2=0x7f578807cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.916+0000 7f57aa200700 1 --2- 172.21.15.111:0/2285018868 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f578807a850 0x7f578807cd00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f57a4197390 tx=0x7f5790009260 comp rx=0 tx=0).stop 2024-09-11T00:13:56.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.916+0000 7f57aa200700 1 -- 172.21.15.111:0/2285018868 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57a41003b0 msgr2=0x7f57a4195d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:56.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.916+0000 7f57aa200700 1 --2- 172.21.15.111:0/2285018868 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57a41003b0 0x7f57a4195d70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f57940098e0 tx=0x7f579400f460 comp rx=0 tx=0).stop 2024-09-11T00:13:56.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.916+0000 7f57aa200700 1 -- 172.21.15.111:0/2285018868 shutdown_connections 2024-09-11T00:13:56.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.916+0000 7f57aa200700 1 --2- 172.21.15.111:0/2285018868 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f578807a850 0x7f578807cd00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.916+0000 7f57aa200700 1 --2- 172.21.15.111:0/2285018868 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57a41003b0 0x7f57a4195d70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.916+0000 7f57aa200700 1 --2- 172.21.15.111:0/2285018868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f57a4100d50 0x7f57a41962b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:56.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.916+0000 7f57aa200700 1 -- 172.21.15.111:0/2285018868 >> 172.21.15.111:0/2285018868 conn(0x7f57a40fbc30 msgr2=0x7f57a40fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:56.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.916+0000 7f57aa200700 1 -- 172.21.15.111:0/2285018868 shutdown_connections 2024-09-11T00:13:56.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:13:56.916+0000 7f57aa200700 1 -- 172.21.15.111:0/2285018868 wait complete. 2024-09-11T00:13:57.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:56 smithi203 ceph-mon[69002]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:13:57.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:56 smithi203 ceph-mon[69002]: pgmap v46: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:57.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:56 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/3862046299' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:13:57.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:56 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:13:57.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:56 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-11T00:13:57.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:56 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:58.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:57 smithi203 ceph-mon[69002]: Upgrade: Updating osd.0 2024-09-11T00:13:58.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:57 smithi203 ceph-mon[69002]: Deploying daemon osd.0 on smithi111 2024-09-11T00:13:58.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:57 smithi203 ceph-mon[69002]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:13:58.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:57 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/2285018868' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-11T00:13:58.070 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:57 smithi111 ceph-mon[90842]: Upgrade: Updating osd.0 2024-09-11T00:13:58.070 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:57 smithi111 ceph-mon[90842]: Deploying daemon osd.0 on smithi111 2024-09-11T00:13:58.070 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:57 smithi111 ceph-mon[90842]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:13:58.070 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:57 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/2285018868' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-11T00:13:58.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:13:58 smithi203 ceph-mon[69002]: pgmap v47: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:13:59.074 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:13:58 smithi111 ceph-mon[90842]: pgmap v47: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:14:00.152 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:13:59 smithi111 systemd[1]: Stopping Ceph osd.0 for 03107fbe-6fd0-11ef-bcea-c7b262605968... 2024-09-11T00:14:00.402 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:00 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0[45321]: 2024-09-11T00:14:00.149+0000 7fe7aac00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:14:00.403 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:00 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0[45321]: 2024-09-11T00:14:00.149+0000 7fe7aac00700 -1 osd.0 50 *** Got signal Terminated *** 2024-09-11T00:14:00.403 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:00 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0[45321]: 2024-09-11T00:14:00.149+0000 7fe7aac00700 -1 osd.0 50 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:14:00.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:00 smithi111 ceph-mon[90842]: pgmap v48: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:14:00.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:00 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:14:00.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:00 smithi111 ceph-mon[90842]: osd.0 marked itself down and dead 2024-09-11T00:14:01.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:00 smithi203 ceph-mon[69002]: pgmap v48: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:14:01.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:00 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:14:01.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:00 smithi203 ceph-mon[69002]: osd.0 marked itself down and dead 2024-09-11T00:14:01.350 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:01 smithi111 podman[101898]: 2024-09-11 00:14:01.060572183 +0000 UTC m=+1.017600458 container died 162b7249a5910fbcf30a054b76c890ed4112ff81fc7ebeb60cdb100a26bbaf91 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.0, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.29.1, org.label-schema.build-date=20231212) 2024-09-11T00:14:01.652 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:01 smithi111 podman[101898]: 2024-09-11 00:14:01.496574946 +0000 UTC m=+1.453603206 container cleanup 162b7249a5910fbcf30a054b76c890ed4112ff81fc7ebeb60cdb100a26bbaf91 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True) 2024-09-11T00:14:01.653 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:01 smithi111 bash[101898]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0 2024-09-11T00:14:02.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:01 smithi203 ceph-mon[69002]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-11T00:14:02.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:01 smithi203 ceph-mon[69002]: osdmap e51: 6 total, 5 up, 6 in 2024-09-11T00:14:02.152 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:01 smithi111 podman[101916]: 2024-09-11 00:14:01.739937641 +0000 UTC m=+0.666019392 container remove 162b7249a5910fbcf30a054b76c890ed4112ff81fc7ebeb60cdb100a26bbaf91 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0, GIT_CLEAN=True, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.0, RELEASE=HEAD, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux ) 2024-09-11T00:14:02.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:01 smithi111 ceph-mon[90842]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-11T00:14:02.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:01 smithi111 ceph-mon[90842]: osdmap e51: 6 total, 5 up, 6 in 2024-09-11T00:14:02.602 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:02 smithi111 podman[102002]: 2024-09-11 00:14:02.209524313 +0000 UTC m=+0.027649281 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:14:02.603 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:02 smithi111 podman[102002]: 2024-09-11 00:14:02.307368747 +0000 UTC m=+0.125493685 container create e846bedca71582dca32851521d9a13ec578541eee21fdd60ffd58bcb4ea4edf5 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:14:02.603 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:02 smithi111 podman[102002]: 2024-09-11 00:14:02.493772907 +0000 UTC m=+0.311897877 container init e846bedca71582dca32851521d9a13ec578541eee21fdd60ffd58bcb4ea4edf5 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.schema-version=1.0) 2024-09-11T00:14:02.603 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:02 smithi111 podman[102002]: 2024-09-11 00:14:02.50075567 +0000 UTC m=+0.318880611 container start e846bedca71582dca32851521d9a13ec578541eee21fdd60ffd58bcb4ea4edf5 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-11T00:14:02.603 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:02 smithi111 podman[102002]: 2024-09-11 00:14:02.601605882 +0000 UTC m=+0.419730825 container attach e846bedca71582dca32851521d9a13ec578541eee21fdd60ffd58bcb4ea4edf5 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:14:02.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:02 smithi111 ceph-mon[90842]: pgmap v50: 65 pgs: 9 stale+active+clean, 56 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 307 B/s wr, 0 op/s 2024-09-11T00:14:02.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:02 smithi111 ceph-mon[90842]: mgrmap e41: smithi111.ypucji(active, since 92s), standbys: smithi203.smuspl 2024-09-11T00:14:02.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:02 smithi111 ceph-mon[90842]: osdmap e52: 6 total, 5 up, 6 in 2024-09-11T00:14:02.903 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:02 smithi111 podman[102025]: 2024-09-11 00:14:02.798099517 +0000 UTC m=+0.027439035 container died e846bedca71582dca32851521d9a13ec578541eee21fdd60ffd58bcb4ea4edf5 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:14:03.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:02 smithi203 ceph-mon[69002]: pgmap v50: 65 pgs: 9 stale+active+clean, 56 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 307 B/s wr, 0 op/s 2024-09-11T00:14:03.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:02 smithi203 ceph-mon[69002]: mgrmap e41: smithi111.ypucji(active, since 92s), standbys: smithi203.smuspl 2024-09-11T00:14:03.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:02 smithi203 ceph-mon[69002]: osdmap e52: 6 total, 5 up, 6 in 2024-09-11T00:14:03.652 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:03 smithi111 podman[102025]: 2024-09-11 00:14:03.388309045 +0000 UTC m=+0.617648563 container remove e846bedca71582dca32851521d9a13ec578541eee21fdd60ffd58bcb4ea4edf5 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-11T00:14:03.653 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:03 smithi111 systemd[1]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-11T00:14:03.653 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:03 smithi111 systemd[1]: Stopped Ceph osd.0 for 03107fbe-6fd0-11ef-bcea-c7b262605968. 2024-09-11T00:14:03.653 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:03 smithi111 systemd[1]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.0.service: Consumed 1min 13.148s CPU time. 2024-09-11T00:14:04.060 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:03 smithi111 systemd[1]: Starting Ceph osd.0 for 03107fbe-6fd0-11ef-bcea-c7b262605968... 2024-09-11T00:14:04.385 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:04 smithi111 podman[102121]: 2024-09-11 00:14:03.963370636 +0000 UTC m=+0.026877984 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:14:04.385 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:04 smithi111 podman[102121]: 2024-09-11 00:14:04.081079201 +0000 UTC m=+0.144586533 container create 6d405a8687f02de577216a9be22823d960b4e00fb4525141d7a1ea15729ff6e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:14:04.385 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:04 smithi111 podman[102121]: 2024-09-11 00:14:04.292591241 +0000 UTC m=+0.356098582 container init 6d405a8687f02de577216a9be22823d960b4e00fb4525141d7a1ea15729ff6e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0-activate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-11T00:14:04.385 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:04 smithi111 podman[102121]: 2024-09-11 00:14:04.300377736 +0000 UTC m=+0.363885070 container start 6d405a8687f02de577216a9be22823d960b4e00fb4525141d7a1ea15729ff6e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0) 2024-09-11T00:14:04.385 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:04 smithi111 podman[102121]: 2024-09-11 00:14:04.383700975 +0000 UTC m=+0.447208312 container attach 6d405a8687f02de577216a9be22823d960b4e00fb4525141d7a1ea15729ff6e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0-activate, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-11T00:14:04.653 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:04 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0-activate[102136]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-11T00:14:04.653 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:04 smithi111 bash[102121]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-11T00:14:04.653 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:04 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0-activate[102136]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-11T00:14:04.653 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:04 smithi111 bash[102121]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-11T00:14:05.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:04 smithi203 ceph-mon[69002]: pgmap v52: 65 pgs: 9 stale+active+clean, 56 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2024-09-11T00:14:05.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:04 smithi111 ceph-mon[90842]: pgmap v52: 65 pgs: 9 stale+active+clean, 56 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2024-09-11T00:14:05.725 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:05 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0-activate[102136]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-11T00:14:05.725 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:05 smithi111 bash[102121]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-11T00:14:05.726 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:05 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0-activate[102136]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-11T00:14:05.726 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:05 smithi111 bash[102121]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-11T00:14:06.032 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:05 smithi111 ceph-mon[90842]: pgmap v53: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 383 B/s wr, 0 op/s; 50/264 objects degraded (18.939%) 2024-09-11T00:14:06.032 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:05 smithi111 ceph-mon[90842]: Health check failed: Degraded data redundancy: 50/264 objects degraded (18.939%), 19 pgs degraded (PG_DEGRADED) 2024-09-11T00:14:06.032 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:05 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0-activate[102136]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-11T00:14:06.032 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:05 smithi111 bash[102121]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-11T00:14:06.032 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:05 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0-activate[102136]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-11T00:14:06.032 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:05 smithi111 bash[102121]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-11T00:14:06.032 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:05 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0-activate[102136]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-11T00:14:06.033 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:05 smithi111 bash[102121]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-11T00:14:06.033 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:05 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0-activate[102136]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-11T00:14:06.033 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:05 smithi111 bash[102121]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-11T00:14:06.033 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:05 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0-activate[102136]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-11T00:14:06.033 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:05 smithi111 bash[102121]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-11T00:14:06.033 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:05 smithi111 podman[102121]: 2024-09-11 00:14:05.777509522 +0000 UTC m=+1.841016855 container died 6d405a8687f02de577216a9be22823d960b4e00fb4525141d7a1ea15729ff6e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:14:06.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:05 smithi203 ceph-mon[69002]: pgmap v53: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 383 B/s wr, 0 op/s; 50/264 objects degraded (18.939%) 2024-09-11T00:14:06.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:05 smithi203 ceph-mon[69002]: Health check failed: Degraded data redundancy: 50/264 objects degraded (18.939%), 19 pgs degraded (PG_DEGRADED) 2024-09-11T00:14:06.610 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:06 smithi111 podman[102276]: 2024-09-11 00:14:06.312027853 +0000 UTC m=+0.521053883 container remove 6d405a8687f02de577216a9be22823d960b4e00fb4525141d7a1ea15729ff6e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0-activate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-11T00:14:06.869 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:06 smithi111 podman[102336]: 2024-09-11 00:14:06.513888939 +0000 UTC m=+0.027392143 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:14:06.869 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:06 smithi111 podman[102336]: 2024-09-11 00:14:06.638071097 +0000 UTC m=+0.151574300 container create d2f1a23127364f27a720063e69704fa78afee83f8722b15bc7c924739f65d817 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-11T00:14:06.869 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:06 smithi111 podman[102336]: 2024-09-11 00:14:06.82387956 +0000 UTC m=+0.337382765 container init d2f1a23127364f27a720063e69704fa78afee83f8722b15bc7c924739f65d817 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:14:06.869 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:06 smithi111 podman[102336]: 2024-09-11 00:14:06.830605688 +0000 UTC m=+0.344108899 container start d2f1a23127364f27a720063e69704fa78afee83f8722b15bc7c924739f65d817 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-11T00:14:07.152 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:06 smithi111 ceph-osd[102355]: -- 172.21.15.111:0/1948437658 <== mon.0 v2:172.21.15.111:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5588caec81e0 con 0x5588caec2000 2024-09-11T00:14:07.153 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:06 smithi111 bash[102336]: d2f1a23127364f27a720063e69704fa78afee83f8722b15bc7c924739f65d817 2024-09-11T00:14:07.153 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:06 smithi111 systemd[1]: Started Ceph osd.0 for 03107fbe-6fd0-11ef-bcea-c7b262605968. 2024-09-11T00:14:08.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:07 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:08.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:07 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:08.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:07 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:14:08.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:07 smithi111 ceph-mon[90842]: pgmap v54: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 383 B/s wr, 0 op/s; 50/264 objects degraded (18.939%) 2024-09-11T00:14:08.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:07 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:08.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:07 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:08.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:07 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:14:08.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:07 smithi203 ceph-mon[69002]: pgmap v54: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 383 B/s wr, 0 op/s; 50/264 objects degraded (18.939%) 2024-09-11T00:14:08.807 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:08 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0[102351]: 2024-09-11T00:14:08.535+0000 7f426b08a640 -1 Falling back to public interface 2024-09-11T00:14:10.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:10 smithi111 ceph-mon[90842]: pgmap v55: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-09-11T00:14:11.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:10 smithi203 ceph-mon[69002]: pgmap v55: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-09-11T00:14:13.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:12 smithi203 ceph-mon[69002]: pgmap v56: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-09-11T00:14:13.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:12 smithi111 ceph-mon[90842]: pgmap v56: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-09-11T00:14:14.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:13 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:14.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:13 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:14.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:13 smithi203 ceph-mon[69002]: pgmap v57: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-09-11T00:14:14.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:13 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:14.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:13 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:14.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:13 smithi111 ceph-mon[90842]: pgmap v57: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-09-11T00:14:14.511 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:14 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0[102351]: 2024-09-11T00:14:14.174+0000 7f426b08a640 -1 osd.0 0 read_superblock omap replica is missing. 2024-09-11T00:14:14.511 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:14 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0[102351]: 2024-09-11T00:14:14.509+0000 7f426b08a640 -1 osd.0 50 log_to_monitors true 2024-09-11T00:14:15.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:14 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:15.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:14 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:15.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:14 smithi111 ceph-mon[90842]: from='osd.0 [v2:172.21.15.111:6802/4283853217,v1:172.21.15.111:6803/4283853217]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-11T00:14:15.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:14 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:15.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:14 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:15.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:14 smithi203 ceph-mon[69002]: from='osd.0 [v2:172.21.15.111:6802/4283853217,v1:172.21.15.111:6803/4283853217]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-11T00:14:16.152 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:14:15 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0[102351]: 2024-09-11T00:14:15.917+0000 7f425bc00640 -1 osd.0 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:14:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:15 smithi111 ceph-mon[90842]: from='osd.0 [v2:172.21.15.111:6802/4283853217,v1:172.21.15.111:6803/4283853217]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T00:14:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:15 smithi111 ceph-mon[90842]: osdmap e53: 6 total, 5 up, 6 in 2024-09-11T00:14:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:15 smithi111 ceph-mon[90842]: from='osd.0 [v2:172.21.15.111:6802/4283853217,v1:172.21.15.111:6803/4283853217]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi111", "root=default"]} : dispatch 2024-09-11T00:14:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:15 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:15 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:14:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:15 smithi111 ceph-mon[90842]: pgmap v59: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-09-11T00:14:16.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:15 smithi203 ceph-mon[69002]: from='osd.0 [v2:172.21.15.111:6802/4283853217,v1:172.21.15.111:6803/4283853217]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T00:14:16.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:15 smithi203 ceph-mon[69002]: osdmap e53: 6 total, 5 up, 6 in 2024-09-11T00:14:16.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:15 smithi203 ceph-mon[69002]: from='osd.0 [v2:172.21.15.111:6802/4283853217,v1:172.21.15.111:6803/4283853217]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi111", "root=default"]} : dispatch 2024-09-11T00:14:16.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:15 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:16.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:15 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:14:16.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:15 smithi203 ceph-mon[69002]: pgmap v59: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-09-11T00:14:17.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:16 smithi203 ceph-mon[69002]: from='osd.0 [v2:172.21.15.111:6802/4283853217,v1:172.21.15.111:6803/4283853217]' entity='osd.0' 2024-09-11T00:14:17.301 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:16 smithi111 ceph-mon[90842]: from='osd.0 [v2:172.21.15.111:6802/4283853217,v1:172.21.15.111:6803/4283853217]' entity='osd.0' 2024-09-11T00:14:18.136 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:17 smithi111 ceph-mon[90842]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-11T00:14:18.136 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:17 smithi111 ceph-mon[90842]: osd.0 [v2:172.21.15.111:6802/4283853217,v1:172.21.15.111:6803/4283853217] boot 2024-09-11T00:14:18.136 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:17 smithi111 ceph-mon[90842]: osdmap e54: 6 total, 6 up, 6 in 2024-09-11T00:14:18.136 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:17 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:14:18.137 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:17 smithi111 ceph-mon[90842]: pgmap v61: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-09-11T00:14:18.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:17 smithi203 ceph-mon[69002]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-11T00:14:18.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:17 smithi203 ceph-mon[69002]: osd.0 [v2:172.21.15.111:6802/4283853217,v1:172.21.15.111:6803/4283853217] boot 2024-09-11T00:14:18.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:17 smithi203 ceph-mon[69002]: osdmap e54: 6 total, 6 up, 6 in 2024-09-11T00:14:18.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:17 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:14:18.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:17 smithi203 ceph-mon[69002]: pgmap v61: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-09-11T00:14:19.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:18 smithi203 ceph-mon[69002]: osdmap e55: 6 total, 6 up, 6 in 2024-09-11T00:14:19.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:18 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:19.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:18 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:19.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:18 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:19.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:18 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:14:19.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:18 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:19.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:18 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:14:19.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:18 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:14:19.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:18 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:14:19.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:18 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:14:19.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:18 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-11T00:14:19.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:18 smithi203 ceph-mon[69002]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-11T00:14:19.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:18 smithi203 ceph-mon[69002]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-11T00:14:19.404 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:18 smithi111 ceph-mon[90842]: osdmap e55: 6 total, 6 up, 6 in 2024-09-11T00:14:19.405 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:18 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:19.405 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:18 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:19.405 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:18 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:19.405 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:18 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:14:19.405 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:18 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:19.405 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:18 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:14:19.405 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:18 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:14:19.405 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:18 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:14:19.405 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:18 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:14:19.405 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:18 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-11T00:14:19.405 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:18 smithi111 ceph-mon[90842]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-11T00:14:19.406 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:18 smithi111 ceph-mon[90842]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-11T00:14:20.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:19 smithi203 ceph-mon[69002]: pgmap v63: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-09-11T00:14:20.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:19 smithi111 ceph-mon[90842]: pgmap v63: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-09-11T00:14:22.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:21 smithi203 ceph-mon[69002]: pgmap v64: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:14:22.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:21 smithi203 ceph-mon[69002]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 50/264 objects degraded (18.939%), 19 pgs degraded) 2024-09-11T00:14:22.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:21 smithi111 ceph-mon[90842]: pgmap v64: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:14:22.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:21 smithi111 ceph-mon[90842]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 50/264 objects degraded (18.939%), 19 pgs degraded) 2024-09-11T00:14:25.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:24 smithi203 ceph-mon[69002]: pgmap v65: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:14:25.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:24 smithi111 ceph-mon[90842]: pgmap v65: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:14:27.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:26 smithi203 ceph-mon[69002]: pgmap v66: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:14:27.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.071+0000 7f398ca00700 1 -- 172.21.15.111:0/3847554869 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39881003d0 msgr2=0x7f39881007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:27.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.071+0000 7f398ca00700 1 --2- 172.21.15.111:0/3847554869 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39881003d0 0x7f39881007a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3978009910 tx=0x7f3978009c20 comp rx=0 tx=0).stop 2024-09-11T00:14:27.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.071+0000 7f398ca00700 1 -- 172.21.15.111:0/3847554869 shutdown_connections 2024-09-11T00:14:27.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.071+0000 7f398ca00700 1 --2- 172.21.15.111:0/3847554869 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3988100d70 0x7f3988104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:27.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.072+0000 7f398ca00700 1 --2- 172.21.15.111:0/3847554869 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39881003d0 0x7f39881007a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:27.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.072+0000 7f398ca00700 1 -- 172.21.15.111:0/3847554869 >> 172.21.15.111:0/3847554869 conn(0x7f39880fbc50 msgr2=0x7f39880fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:27.073 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:26 smithi111 ceph-mon[90842]: pgmap v66: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:14:27.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.072+0000 7f398ca00700 1 -- 172.21.15.111:0/3847554869 shutdown_connections 2024-09-11T00:14:27.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.072+0000 7f398ca00700 1 -- 172.21.15.111:0/3847554869 wait complete. 2024-09-11T00:14:27.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.073+0000 7f398ca00700 1 Processor -- start 2024-09-11T00:14:27.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.073+0000 7f398ca00700 1 -- start start 2024-09-11T00:14:27.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.073+0000 7f398ca00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39881003d0 0x7f3988197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:27.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.073+0000 7f398ca00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3988100d70 0x7f39881984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:27.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.073+0000 7f398ca00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3988198bd0 con 0x7f39881003d0 2024-09-11T00:14:27.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.073+0000 7f398ca00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398819c960 con 0x7f3988100d70 2024-09-11T00:14:27.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.073+0000 7f3985e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39881003d0 0x7f3988197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:27.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.074+0000 7f3985e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39881003d0 0x7f3988197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:35526/0 (socket says 172.21.15.111:35526) 2024-09-11T00:14:27.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.074+0000 7f3985e00700 1 -- 172.21.15.111:0/467725580 learned_addr learned my addr 172.21.15.111:0/467725580 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:14:27.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.074+0000 7f3985400700 1 --2- 172.21.15.111:0/467725580 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3988100d70 0x7f39881984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:27.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.074+0000 7f3985e00700 1 -- 172.21.15.111:0/467725580 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3988100d70 msgr2=0x7f39881984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:27.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.074+0000 7f3985e00700 1 --2- 172.21.15.111:0/467725580 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3988100d70 0x7f39881984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:27.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.074+0000 7f3985e00700 1 -- 172.21.15.111:0/467725580 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39780095f0 con 0x7f39881003d0 2024-09-11T00:14:27.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.074+0000 7f3985e00700 1 --2- 172.21.15.111:0/467725580 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39881003d0 0x7f3988197fb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f39780092e0 tx=0x7f397800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:27.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.075+0000 7f397ea00700 1 -- 172.21.15.111:0/467725580 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f397801d070 con 0x7f39881003d0 2024-09-11T00:14:27.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.075+0000 7f397ea00700 1 -- 172.21.15.111:0/467725580 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3978005e00 con 0x7f39881003d0 2024-09-11T00:14:27.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.075+0000 7f398ca00700 1 -- 172.21.15.111:0/467725580 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398819cbe0 con 0x7f39881003d0 2024-09-11T00:14:27.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.075+0000 7f397ea00700 1 -- 172.21.15.111:0/467725580 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3978017400 con 0x7f39881003d0 2024-09-11T00:14:27.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.075+0000 7f398ca00700 1 -- 172.21.15.111:0/467725580 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f398819d0d0 con 0x7f39881003d0 2024-09-11T00:14:27.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.076+0000 7f398ca00700 1 -- 172.21.15.111:0/467725580 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39881044c0 con 0x7f39881003d0 2024-09-11T00:14:27.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.077+0000 7f397ea00700 1 -- 172.21.15.111:0/467725580 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f397800f460 con 0x7f39881003d0 2024-09-11T00:14:27.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.078+0000 7f397ea00700 1 --2- 172.21.15.111:0/467725580 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f396c07a6f0 0x7f396c07cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:27.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.078+0000 7f397ea00700 1 -- 172.21.15.111:0/467725580 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f397809e810 con 0x7f39881003d0 2024-09-11T00:14:27.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.078+0000 7f3985400700 1 --2- 172.21.15.111:0/467725580 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f396c07a6f0 0x7f396c07cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:27.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.079+0000 7f3985400700 1 --2- 172.21.15.111:0/467725580 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f396c07a6f0 0x7f396c07cba0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3974005950 tx=0x7f39740058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:27.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.083+0000 7f397ea00700 1 -- 172.21.15.111:0/467725580 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f3978061f10 con 0x7f39881003d0 2024-09-11T00:14:27.324 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.322+0000 7f398ca00700 1 -- 172.21.15.111:0/467725580 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f398802cca0 con 0x7f396c07a6f0 2024-09-11T00:14:27.325 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.324+0000 7f397ea00700 1 -- 172.21.15.111:0/467725580 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f398802cca0 con 0x7f396c07a6f0 2024-09-11T00:14:27.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.327+0000 7f398ca00700 1 -- 172.21.15.111:0/467725580 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f396c07a6f0 msgr2=0x7f396c07cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:27.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.327+0000 7f398ca00700 1 --2- 172.21.15.111:0/467725580 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f396c07a6f0 0x7f396c07cba0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3974005950 tx=0x7f39740058e0 comp rx=0 tx=0).stop 2024-09-11T00:14:27.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.327+0000 7f398ca00700 1 -- 172.21.15.111:0/467725580 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39881003d0 msgr2=0x7f3988197fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:27.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.327+0000 7f398ca00700 1 --2- 172.21.15.111:0/467725580 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39881003d0 0x7f3988197fb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f39780092e0 tx=0x7f397800be20 comp rx=0 tx=0).stop 2024-09-11T00:14:27.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.327+0000 7f398ca00700 1 -- 172.21.15.111:0/467725580 shutdown_connections 2024-09-11T00:14:27.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.327+0000 7f398ca00700 1 --2- 172.21.15.111:0/467725580 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f396c07a6f0 0x7f396c07cba0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:27.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.327+0000 7f398ca00700 1 --2- 172.21.15.111:0/467725580 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39881003d0 0x7f3988197fb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:27.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.327+0000 7f398ca00700 1 --2- 172.21.15.111:0/467725580 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3988100d70 0x7f39881984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:27.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.327+0000 7f398ca00700 1 -- 172.21.15.111:0/467725580 >> 172.21.15.111:0/467725580 conn(0x7f39880fbc50 msgr2=0x7f39880fd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:27.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.327+0000 7f398ca00700 1 -- 172.21.15.111:0/467725580 shutdown_connections 2024-09-11T00:14:27.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.327+0000 7f398ca00700 1 -- 172.21.15.111:0/467725580 wait complete. 2024-09-11T00:14:27.343 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:14:27.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.464+0000 7f79f8200700 1 -- 172.21.15.111:0/898768529 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79f0075280 msgr2=0x7f79f0075650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:27.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.464+0000 7f79f8200700 1 --2- 172.21.15.111:0/898768529 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79f0075280 0x7f79f0075650 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009910 tx=0x7f79e4009c20 comp rx=0 tx=0).stop 2024-09-11T00:14:27.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.464+0000 7f79f8200700 1 -- 172.21.15.111:0/898768529 shutdown_connections 2024-09-11T00:14:27.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.464+0000 7f79f8200700 1 --2- 172.21.15.111:0/898768529 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79f0075b90 0x7f79f0110b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:27.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.464+0000 7f79f8200700 1 --2- 172.21.15.111:0/898768529 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79f0075280 0x7f79f0075650 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:27.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.464+0000 7f79f8200700 1 -- 172.21.15.111:0/898768529 >> 172.21.15.111:0/898768529 conn(0x7f79f00fdec0 msgr2=0x7f79f01002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:27.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.464+0000 7f79f8200700 1 -- 172.21.15.111:0/898768529 shutdown_connections 2024-09-11T00:14:27.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.464+0000 7f79f8200700 1 -- 172.21.15.111:0/898768529 wait complete. 2024-09-11T00:14:27.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.465+0000 7f79f8200700 1 Processor -- start 2024-09-11T00:14:27.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.465+0000 7f79f8200700 1 -- start start 2024-09-11T00:14:27.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.465+0000 7f79f8200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79f0075280 0x7f79f019c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:27.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.465+0000 7f79f8200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79f0075b90 0x7f79f019c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:27.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.465+0000 7f79f8200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f019cf20 con 0x7f79f0075b90 2024-09-11T00:14:27.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.465+0000 7f79f8200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f01a0cb0 con 0x7f79f0075280 2024-09-11T00:14:27.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.466+0000 7f79f4e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79f0075b90 0x7f79f019c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:27.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.466+0000 7f79f4e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79f0075b90 0x7f79f019c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:35556/0 (socket says 172.21.15.111:35556) 2024-09-11T00:14:27.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.466+0000 7f79f4e00700 1 -- 172.21.15.111:0/2742852374 learned_addr learned my addr 172.21.15.111:0/2742852374 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:14:27.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.466+0000 7f79f5800700 1 --2- 172.21.15.111:0/2742852374 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79f0075280 0x7f79f019c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:27.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.466+0000 7f79f4e00700 1 -- 172.21.15.111:0/2742852374 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79f0075280 msgr2=0x7f79f019c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:27.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.466+0000 7f79f4e00700 1 --2- 172.21.15.111:0/2742852374 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79f0075280 0x7f79f019c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:27.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.466+0000 7f79f4e00700 1 -- 172.21.15.111:0/2742852374 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e40095f0 con 0x7f79f0075b90 2024-09-11T00:14:27.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.466+0000 7f79f5800700 1 --2- 172.21.15.111:0/2742852374 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79f0075280 0x7f79f019c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:27.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.467+0000 7f79f4e00700 1 --2- 172.21.15.111:0/2742852374 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79f0075b90 0x7f79f019c840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00e920 tx=0x7f79dc00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:27.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.467+0000 7f79ee000700 1 -- 172.21.15.111:0/2742852374 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79dc009790 con 0x7f79f0075b90 2024-09-11T00:14:27.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.467+0000 7f79ee000700 1 -- 172.21.15.111:0/2742852374 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f79dc00cba0 con 0x7f79f0075b90 2024-09-11T00:14:27.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.467+0000 7f79f8200700 1 -- 172.21.15.111:0/2742852374 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f01a0f90 con 0x7f79f0075b90 2024-09-11T00:14:27.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.467+0000 7f79ee000700 1 -- 172.21.15.111:0/2742852374 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79dc018650 con 0x7f79f0075b90 2024-09-11T00:14:27.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.467+0000 7f79f8200700 1 -- 172.21.15.111:0/2742852374 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f01a14e0 con 0x7f79f0075b90 2024-09-11T00:14:27.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.468+0000 7f79f8200700 1 -- 172.21.15.111:0/2742852374 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f010e270 con 0x7f79f0075b90 2024-09-11T00:14:27.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.469+0000 7f79ee000700 1 -- 172.21.15.111:0/2742852374 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f79dc00cd10 con 0x7f79f0075b90 2024-09-11T00:14:27.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.471+0000 7f79ee000700 1 --2- 172.21.15.111:0/2742852374 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f79d807a6f0 0x7f79d807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:27.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.471+0000 7f79ee000700 1 -- 172.21.15.111:0/2742852374 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f79dc014070 con 0x7f79f0075b90 2024-09-11T00:14:27.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.471+0000 7f79f5800700 1 --2- 172.21.15.111:0/2742852374 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f79d807a6f0 0x7f79d807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:27.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.471+0000 7f79f5800700 1 --2- 172.21.15.111:0/2742852374 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f79d807a6f0 0x7f79d807cba0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f79e400b700 tx=0x7f79e4005fb0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:27.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.475+0000 7f79ee000700 1 -- 172.21.15.111:0/2742852374 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f79dc064550 con 0x7f79f0075b90 2024-09-11T00:14:27.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.721+0000 7f79f8200700 1 -- 172.21.15.111:0/2742852374 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f79f01a17e0 con 0x7f79d807a6f0 2024-09-11T00:14:27.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.722+0000 7f79ee000700 1 -- 172.21.15.111:0/2742852374 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f79f01a17e0 con 0x7f79d807a6f0 2024-09-11T00:14:27.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.725+0000 7f79f8200700 1 -- 172.21.15.111:0/2742852374 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f79d807a6f0 msgr2=0x7f79d807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:27.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.725+0000 7f79f8200700 1 --2- 172.21.15.111:0/2742852374 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f79d807a6f0 0x7f79d807cba0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f79e400b700 tx=0x7f79e4005fb0 comp rx=0 tx=0).stop 2024-09-11T00:14:27.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.725+0000 7f79f8200700 1 -- 172.21.15.111:0/2742852374 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79f0075b90 msgr2=0x7f79f019c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:27.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.725+0000 7f79f8200700 1 --2- 172.21.15.111:0/2742852374 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79f0075b90 0x7f79f019c840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00e920 tx=0x7f79dc00ece0 comp rx=0 tx=0).stop 2024-09-11T00:14:27.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.725+0000 7f79f8200700 1 -- 172.21.15.111:0/2742852374 shutdown_connections 2024-09-11T00:14:27.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.725+0000 7f79f8200700 1 --2- 172.21.15.111:0/2742852374 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f79d807a6f0 0x7f79d807cba0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:27.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.725+0000 7f79f8200700 1 --2- 172.21.15.111:0/2742852374 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79f0075280 0x7f79f019c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:27.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.725+0000 7f79f8200700 1 --2- 172.21.15.111:0/2742852374 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79f0075b90 0x7f79f019c840 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:27.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.725+0000 7f79f8200700 1 -- 172.21.15.111:0/2742852374 >> 172.21.15.111:0/2742852374 conn(0x7f79f00fdec0 msgr2=0x7f79f00feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:27.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.725+0000 7f79f8200700 1 -- 172.21.15.111:0/2742852374 shutdown_connections 2024-09-11T00:14:27.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.725+0000 7f79f8200700 1 -- 172.21.15.111:0/2742852374 wait complete. 2024-09-11T00:14:27.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.862+0000 7f716b000700 1 -- 172.21.15.111:0/3656855563 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7164102610 msgr2=0x7f71641029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:27.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.862+0000 7f716b000700 1 --2- 172.21.15.111:0/3656855563 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7164102610 0x7f71641029e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7154009910 tx=0x7f7154009c20 comp rx=0 tx=0).stop 2024-09-11T00:14:27.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.863+0000 7f716b000700 1 -- 172.21.15.111:0/3656855563 shutdown_connections 2024-09-11T00:14:27.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.863+0000 7f716b000700 1 --2- 172.21.15.111:0/3656855563 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7164102fb0 0x7f7164106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:27.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.863+0000 7f716b000700 1 --2- 172.21.15.111:0/3656855563 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7164102610 0x7f71641029e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:27.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.863+0000 7f716b000700 1 -- 172.21.15.111:0/3656855563 >> 172.21.15.111:0/3656855563 conn(0x7f71640fde90 msgr2=0x7f71641002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:27.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.863+0000 7f716b000700 1 -- 172.21.15.111:0/3656855563 shutdown_connections 2024-09-11T00:14:27.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.863+0000 7f716b000700 1 -- 172.21.15.111:0/3656855563 wait complete. 2024-09-11T00:14:27.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.864+0000 7f716b000700 1 Processor -- start 2024-09-11T00:14:27.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.864+0000 7f716b000700 1 -- start start 2024-09-11T00:14:27.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.864+0000 7f716b000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7164102610 0x7f7164198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:27.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.864+0000 7f716b000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7164102fb0 0x7f71641985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:27.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.864+0000 7f716b000700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7164198c80 con 0x7f7164102fb0 2024-09-11T00:14:27.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.864+0000 7f716b000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716419ca10 con 0x7f7164102610 2024-09-11T00:14:27.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.864+0000 7f7163400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7164102fb0 0x7f71641985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:27.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.864+0000 7f7163400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7164102fb0 0x7f71641985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:36524/0 (socket says 172.21.15.111:36524) 2024-09-11T00:14:27.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.864+0000 7f7163400700 1 -- 172.21.15.111:0/3890444670 learned_addr learned my addr 172.21.15.111:0/3890444670 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:14:27.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.864+0000 7f7163e00700 1 --2- 172.21.15.111:0/3890444670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7164102610 0x7f7164198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:27.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.865+0000 7f7163400700 1 -- 172.21.15.111:0/3890444670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7164102610 msgr2=0x7f7164198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:27.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.865+0000 7f7163400700 1 --2- 172.21.15.111:0/3890444670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7164102610 0x7f7164198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:27.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.865+0000 7f7163400700 1 -- 172.21.15.111:0/3890444670 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71540095f0 con 0x7f7164102fb0 2024-09-11T00:14:27.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.865+0000 7f7163400700 1 --2- 172.21.15.111:0/3890444670 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7164102fb0 0x7f71641985a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f715000b480 tx=0x7f715000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:27.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.865+0000 7f7160c00700 1 -- 172.21.15.111:0/3890444670 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7150011800 con 0x7f7164102fb0 2024-09-11T00:14:27.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.865+0000 7f7160c00700 1 -- 172.21.15.111:0/3890444670 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7150011e20 con 0x7f7164102fb0 2024-09-11T00:14:27.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.865+0000 7f716b000700 1 -- 172.21.15.111:0/3890444670 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f716419ccf0 con 0x7f7164102fb0 2024-09-11T00:14:27.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.866+0000 7f7160c00700 1 -- 172.21.15.111:0/3890444670 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7150010ea0 con 0x7f7164102fb0 2024-09-11T00:14:27.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.866+0000 7f716b000700 1 -- 172.21.15.111:0/3890444670 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f716419d240 con 0x7f7164102fb0 2024-09-11T00:14:27.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.867+0000 7f716b000700 1 -- 172.21.15.111:0/3890444670 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f716410a920 con 0x7f7164102fb0 2024-09-11T00:14:27.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.868+0000 7f7160c00700 1 -- 172.21.15.111:0/3890444670 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f7150010380 con 0x7f7164102fb0 2024-09-11T00:14:27.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.869+0000 7f7160c00700 1 --2- 172.21.15.111:0/3890444670 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f714807a6f0 0x7f714807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:27.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.869+0000 7f7160c00700 1 -- 172.21.15.111:0/3890444670 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f715009cca0 con 0x7f7164102fb0 2024-09-11T00:14:27.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.869+0000 7f7163e00700 1 --2- 172.21.15.111:0/3890444670 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f714807a6f0 0x7f714807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:27.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.870+0000 7f7163e00700 1 --2- 172.21.15.111:0/3890444670 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f714807a6f0 0x7f714807cba0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7154005f50 tx=0x7f715401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:27.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:27.873+0000 7f7160c00700 1 -- 172.21.15.111:0/3890444670 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f71500603a0 con 0x7f7164102fb0 2024-09-11T00:14:28.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.103+0000 7f716b000700 1 -- 172.21.15.111:0/3890444670 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f716419d5a0 con 0x7f714807a6f0 2024-09-11T00:14:28.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.114+0000 7f7160c00700 1 -- 172.21.15.111:0/3890444670 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f716419d5a0 con 0x7f714807a6f0 2024-09-11T00:14:28.115 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:14:28.115 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (4m) 15s ago 17m 14.6M - 0.27.0 11f11916f8cd d6d3253e881f 2024-09-11T00:14:28.116 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (6m) 15s ago 17m 7524k - 18.2.0 dc2bc1663786 7c40af85314c 2024-09-11T00:14:28.116 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi203 smithi203 running (6m) 41s ago 16m 7730k - 18.2.0 dc2bc1663786 922e3261ff70 2024-09-11T00:14:28.116 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (52s) 15s ago 17m 6899k - 19.3.0-4854-g8f219c47 589dd18248e4 a9cacdb9a638 2024-09-11T00:14:28.116 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi203 smithi203 running (45s) 41s ago 16m 6899k - 19.3.0-4854-g8f219c47 589dd18248e4 d452d9dfa04b 2024-09-11T00:14:28.116 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (3m) 15s ago 17m 67.6M - c8b91775d855 7d3b50b5b59f 2024-09-11T00:14:28.116 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.gmgsay smithi111 running (10m) 15s ago 10m 17.8M - 18.2.0 dc2bc1663786 795e4ff0075c 2024-09-11T00:14:28.116 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.rucaba smithi111 running (10m) 15s ago 10m 17.7M - 18.2.0 dc2bc1663786 02885adac62c 2024-09-11T00:14:28.116 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.tcrqop smithi203 running (10m) 41s ago 10m 150M - 18.2.0 dc2bc1663786 4df492159bb4 2024-09-11T00:14:28.116 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.uqkbkn smithi203 running (10m) 41s ago 10m 17.6M - 18.2.0 dc2bc1663786 619aa58ea314 2024-09-11T00:14:28.116 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.ypucji smithi111 *:8443,9283,8765 running (6m) 15s ago 19m 511M - 19.3.0-4854-g8f219c47 589dd18248e4 07fa31f49618 2024-09-11T00:14:28.116 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi203.smuspl smithi203 *:8443,9283,8765 running (5m) 41s ago 16m 454M - 19.3.0-4854-g8f219c47 589dd18248e4 7e5a93a5ffa7 2024-09-11T00:14:28.116 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (2m) 15s ago 19m 45.1M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 3c29c070a612 2024-09-11T00:14:28.117 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi203 smithi203 running (98s) 41s ago 16m 36.1M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 45e8285e4b4d 2024-09-11T00:14:28.117 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (4m) 15s ago 17m 7331k - 1.7.0 72c9c2088986 ec478ea14488 2024-09-11T00:14:28.117 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi203 smithi203 *:9100 running (4m) 41s ago 16m 7209k - 1.7.0 72c9c2088986 54d461cde1bc 2024-09-11T00:14:28.117 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (21s) 15s ago 14m 10.4M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 d2f1a2312736 2024-09-11T00:14:28.117 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (14m) 15s ago 14m 225M 1216M 18.2.0 dc2bc1663786 3614d95b1425 2024-09-11T00:14:28.117 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (13m) 15s ago 13m 184M 1216M 18.2.0 dc2bc1663786 db175d4b09b9 2024-09-11T00:14:28.117 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi203 running (13m) 41s ago 13m 246M 2240M 18.2.0 dc2bc1663786 60b1cef7a70d 2024-09-11T00:14:28.117 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi203 running (12m) 41s ago 12m 209M 2240M 18.2.0 dc2bc1663786 769c7942c42b 2024-09-11T00:14:28.117 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi203 running (12m) 41s ago 12m 194M 2240M 18.2.0 dc2bc1663786 6d824001d40c 2024-09-11T00:14:28.117 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (4m) 15s ago 17m 57.9M - 2.51.0 1d3b7f56885b 3e72ac10983d 2024-09-11T00:14:28.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.117+0000 7f716b000700 1 -- 172.21.15.111:0/3890444670 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f714807a6f0 msgr2=0x7f714807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:28.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.117+0000 7f716b000700 1 --2- 172.21.15.111:0/3890444670 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f714807a6f0 0x7f714807cba0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7154005f50 tx=0x7f715401a040 comp rx=0 tx=0).stop 2024-09-11T00:14:28.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.117+0000 7f716b000700 1 -- 172.21.15.111:0/3890444670 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7164102fb0 msgr2=0x7f71641985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:28.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.117+0000 7f716b000700 1 --2- 172.21.15.111:0/3890444670 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7164102fb0 0x7f71641985a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f715000b480 tx=0x7f715000b790 comp rx=0 tx=0).stop 2024-09-11T00:14:28.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.117+0000 7f716b000700 1 -- 172.21.15.111:0/3890444670 shutdown_connections 2024-09-11T00:14:28.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.117+0000 7f716b000700 1 --2- 172.21.15.111:0/3890444670 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f714807a6f0 0x7f714807cba0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.117+0000 7f716b000700 1 --2- 172.21.15.111:0/3890444670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7164102610 0x7f7164198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.117+0000 7f716b000700 1 --2- 172.21.15.111:0/3890444670 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7164102fb0 0x7f71641985a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.117+0000 7f716b000700 1 -- 172.21.15.111:0/3890444670 >> 172.21.15.111:0/3890444670 conn(0x7f71640fde90 msgr2=0x7f71640ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:28.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.117+0000 7f716b000700 1 -- 172.21.15.111:0/3890444670 shutdown_connections 2024-09-11T00:14:28.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.117+0000 7f716b000700 1 -- 172.21.15.111:0/3890444670 wait complete. 2024-09-11T00:14:28.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.251+0000 7f61d5600700 1 -- 172.21.15.111:0/4265398903 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f61d0075280 msgr2=0x7f61d0075650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:28.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.251+0000 7f61d5600700 1 --2- 172.21.15.111:0/4265398903 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f61d0075280 0x7f61d0075650 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f61c0009910 tx=0x7f61c0009c20 comp rx=0 tx=0).stop 2024-09-11T00:14:28.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.252+0000 7f61d5600700 1 -- 172.21.15.111:0/4265398903 shutdown_connections 2024-09-11T00:14:28.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.252+0000 7f61d5600700 1 --2- 172.21.15.111:0/4265398903 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61d0075b90 0x7f61d0110b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.252+0000 7f61d5600700 1 --2- 172.21.15.111:0/4265398903 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f61d0075280 0x7f61d0075650 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.252+0000 7f61d5600700 1 -- 172.21.15.111:0/4265398903 >> 172.21.15.111:0/4265398903 conn(0x7f61d00fdec0 msgr2=0x7f61d01002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:28.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.252+0000 7f61d5600700 1 -- 172.21.15.111:0/4265398903 shutdown_connections 2024-09-11T00:14:28.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.252+0000 7f61d5600700 1 -- 172.21.15.111:0/4265398903 wait complete. 2024-09-11T00:14:28.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.253+0000 7f61d5600700 1 Processor -- start 2024-09-11T00:14:28.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.253+0000 7f61d5600700 1 -- start start 2024-09-11T00:14:28.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.253+0000 7f61d5600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61d0075280 0x7f61d019c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:28.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.253+0000 7f61d5600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f61d0075b90 0x7f61d019c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:28.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.253+0000 7f61d5600700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d019cf20 con 0x7f61d0075b90 2024-09-11T00:14:28.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.253+0000 7f61d5600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d01a0cb0 con 0x7f61d0075280 2024-09-11T00:14:28.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.254+0000 7f61ce000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f61d0075b90 0x7f61d019c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:28.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.254+0000 7f61ce000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f61d0075b90 0x7f61d019c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:36534/0 (socket says 172.21.15.111:36534) 2024-09-11T00:14:28.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.254+0000 7f61ce000700 1 -- 172.21.15.111:0/2940409753 learned_addr learned my addr 172.21.15.111:0/2940409753 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:14:28.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.254+0000 7f61cea00700 1 --2- 172.21.15.111:0/2940409753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61d0075280 0x7f61d019c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:28.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.254+0000 7f61ce000700 1 -- 172.21.15.111:0/2940409753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61d0075280 msgr2=0x7f61d019c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:28.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.254+0000 7f61ce000700 1 --2- 172.21.15.111:0/2940409753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61d0075280 0x7f61d019c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.254+0000 7f61ce000700 1 -- 172.21.15.111:0/2940409753 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c00095f0 con 0x7f61d0075b90 2024-09-11T00:14:28.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.254+0000 7f61ce000700 1 --2- 172.21.15.111:0/2940409753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f61d0075b90 0x7f61d019c840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00e920 tx=0x7f61bc00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:28.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.255+0000 7f61c7400700 1 -- 172.21.15.111:0/2940409753 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61bc00c9d0 con 0x7f61d0075b90 2024-09-11T00:14:28.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.255+0000 7f61c7400700 1 -- 172.21.15.111:0/2940409753 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f61bc010430 con 0x7f61d0075b90 2024-09-11T00:14:28.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.255+0000 7f61d5600700 1 -- 172.21.15.111:0/2940409753 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d01a0f90 con 0x7f61d0075b90 2024-09-11T00:14:28.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.255+0000 7f61c7400700 1 -- 172.21.15.111:0/2940409753 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61bc018630 con 0x7f61d0075b90 2024-09-11T00:14:28.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.255+0000 7f61d5600700 1 -- 172.21.15.111:0/2940409753 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d01a14e0 con 0x7f61d0075b90 2024-09-11T00:14:28.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.256+0000 7f61d5600700 1 -- 172.21.15.111:0/2940409753 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d010e270 con 0x7f61d0075b90 2024-09-11T00:14:28.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.258+0000 7f61c7400700 1 -- 172.21.15.111:0/2940409753 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f61bc0105a0 con 0x7f61d0075b90 2024-09-11T00:14:28.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.258+0000 7f61c7400700 1 --2- 172.21.15.111:0/2940409753 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f61b407a6f0 0x7f61b407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:28.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.259+0000 7f61c7400700 1 -- 172.21.15.111:0/2940409753 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f61bc014070 con 0x7f61d0075b90 2024-09-11T00:14:28.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.259+0000 7f61cea00700 1 --2- 172.21.15.111:0/2940409753 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f61b407a6f0 0x7f61b407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:28.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.260+0000 7f61cea00700 1 --2- 172.21.15.111:0/2940409753 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f61b407a6f0 0x7f61b407cba0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f61c00059d0 tx=0x7f61c0005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:28.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.261+0000 7f61c7400700 1 -- 172.21.15.111:0/2940409753 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f61bc061180 con 0x7f61d0075b90 2024-09-11T00:14:28.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.571+0000 7f61d5600700 1 -- 172.21.15.111:0/2940409753 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f61d004ea50 con 0x7f61d0075b90 2024-09-11T00:14:28.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.572+0000 7f61c7400700 1 -- 172.21.15.111:0/2940409753 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7f61bc0642a0 con 0x7f61d0075b90 2024-09-11T00:14:28.573 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:14:28.573 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-11T00:14:28.573 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:14:28.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:14:28.573 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-11T00:14:28.573 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:14:28.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:14:28.574 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-11T00:14:28.574 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 5, 2024-09-11T00:14:28.574 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 1 2024-09-11T00:14:28.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:14:28.574 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-11T00:14:28.574 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-11T00:14:28.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:14:28.574 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-11T00:14:28.574 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 9, 2024-09-11T00:14:28.574 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 5 2024-09-11T00:14:28.574 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-11T00:14:28.574 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:14:28.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.574+0000 7f61d5600700 1 -- 172.21.15.111:0/2940409753 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f61b407a6f0 msgr2=0x7f61b407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:28.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.574+0000 7f61d5600700 1 --2- 172.21.15.111:0/2940409753 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f61b407a6f0 0x7f61b407cba0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f61c00059d0 tx=0x7f61c0005940 comp rx=0 tx=0).stop 2024-09-11T00:14:28.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.575+0000 7f61d5600700 1 -- 172.21.15.111:0/2940409753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f61d0075b90 msgr2=0x7f61d019c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:28.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.575+0000 7f61d5600700 1 --2- 172.21.15.111:0/2940409753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f61d0075b90 0x7f61d019c840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00e920 tx=0x7f61bc00ec30 comp rx=0 tx=0).stop 2024-09-11T00:14:28.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.575+0000 7f61d5600700 1 -- 172.21.15.111:0/2940409753 shutdown_connections 2024-09-11T00:14:28.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.575+0000 7f61d5600700 1 --2- 172.21.15.111:0/2940409753 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f61b407a6f0 0x7f61b407cba0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.575+0000 7f61d5600700 1 --2- 172.21.15.111:0/2940409753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61d0075280 0x7f61d019c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.575+0000 7f61d5600700 1 --2- 172.21.15.111:0/2940409753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f61d0075b90 0x7f61d019c840 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.575+0000 7f61d5600700 1 -- 172.21.15.111:0/2940409753 >> 172.21.15.111:0/2940409753 conn(0x7f61d00fdec0 msgr2=0x7f61d00feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:28.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.575+0000 7f61d5600700 1 -- 172.21.15.111:0/2940409753 shutdown_connections 2024-09-11T00:14:28.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.575+0000 7f61d5600700 1 -- 172.21.15.111:0/2940409753 wait complete. 2024-09-11T00:14:28.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.712+0000 7f4571a00700 1 -- 172.21.15.111:0/1612440263 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f456c100ba0 msgr2=0x7f456c104b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:28.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.712+0000 7f4571a00700 1 --2- 172.21.15.111:0/1612440263 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f456c100ba0 0x7f456c104b70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4558009910 tx=0x7f4558009c20 comp rx=0 tx=0).stop 2024-09-11T00:14:28.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.712+0000 7f4571a00700 1 -- 172.21.15.111:0/1612440263 shutdown_connections 2024-09-11T00:14:28.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.712+0000 7f4571a00700 1 --2- 172.21.15.111:0/1612440263 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f456c100ba0 0x7f456c104b70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.712+0000 7f4571a00700 1 --2- 172.21.15.111:0/1612440263 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f456c100200 0x7f456c1005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.712+0000 7f4571a00700 1 -- 172.21.15.111:0/1612440263 >> 172.21.15.111:0/1612440263 conn(0x7f456c0fba80 msgr2=0x7f456c0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:28.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.712+0000 7f4571a00700 1 -- 172.21.15.111:0/1612440263 shutdown_connections 2024-09-11T00:14:28.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.712+0000 7f4571a00700 1 -- 172.21.15.111:0/1612440263 wait complete. 2024-09-11T00:14:28.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.713+0000 7f4571a00700 1 Processor -- start 2024-09-11T00:14:28.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.713+0000 7f4571a00700 1 -- start start 2024-09-11T00:14:28.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.714+0000 7f4571a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f456c100200 0x7f456c197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:28.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.714+0000 7f4571a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f456c100ba0 0x7f456c198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:28.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.714+0000 7f4571a00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c198a00 con 0x7f456c100200 2024-09-11T00:14:28.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.714+0000 7f4571a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c19c790 con 0x7f456c100ba0 2024-09-11T00:14:28.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.714+0000 7f456be00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f456c100200 0x7f456c197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:28.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.714+0000 7f456be00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f456c100200 0x7f456c197de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:36552/0 (socket says 172.21.15.111:36552) 2024-09-11T00:14:28.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.714+0000 7f456be00700 1 -- 172.21.15.111:0/4055106040 learned_addr learned my addr 172.21.15.111:0/4055106040 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:14:28.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.714+0000 7f456b400700 1 --2- 172.21.15.111:0/4055106040 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f456c100ba0 0x7f456c198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:28.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.714+0000 7f456be00700 1 -- 172.21.15.111:0/4055106040 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f456c100ba0 msgr2=0x7f456c198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:28.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.714+0000 7f456be00700 1 --2- 172.21.15.111:0/4055106040 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f456c100ba0 0x7f456c198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.714+0000 7f456be00700 1 -- 172.21.15.111:0/4055106040 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45580095f0 con 0x7f456c100200 2024-09-11T00:14:28.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.714+0000 7f456b400700 1 --2- 172.21.15.111:0/4055106040 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f456c100ba0 0x7f456c198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:28.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.715+0000 7f456be00700 1 --2- 172.21.15.111:0/4055106040 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f456c100200 0x7f456c197de0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f455c00d8d0 tx=0x7f455c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:28.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.715+0000 7f4568c00700 1 -- 172.21.15.111:0/4055106040 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f455c009940 con 0x7f456c100200 2024-09-11T00:14:28.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.715+0000 7f4568c00700 1 -- 172.21.15.111:0/4055106040 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f455c010460 con 0x7f456c100200 2024-09-11T00:14:28.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.715+0000 7f4571a00700 1 -- 172.21.15.111:0/4055106040 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f456c19ca70 con 0x7f456c100200 2024-09-11T00:14:28.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.715+0000 7f4568c00700 1 -- 172.21.15.111:0/4055106040 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f455c00f5f0 con 0x7f456c100200 2024-09-11T00:14:28.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.715+0000 7f4571a00700 1 -- 172.21.15.111:0/4055106040 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f456c19cfc0 con 0x7f456c100200 2024-09-11T00:14:28.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.716+0000 7f4571a00700 1 -- 172.21.15.111:0/4055106040 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f456c04f2a0 con 0x7f456c100200 2024-09-11T00:14:28.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.717+0000 7f4568c00700 1 -- 172.21.15.111:0/4055106040 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f455c0105d0 con 0x7f456c100200 2024-09-11T00:14:28.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.718+0000 7f4568c00700 1 --2- 172.21.15.111:0/4055106040 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f455007a6f0 0x7f455007cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:28.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.718+0000 7f4568c00700 1 -- 172.21.15.111:0/4055106040 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f455c09cd40 con 0x7f456c100200 2024-09-11T00:14:28.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.719+0000 7f456b400700 1 --2- 172.21.15.111:0/4055106040 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f455007a6f0 0x7f455007cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:28.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.719+0000 7f456b400700 1 --2- 172.21.15.111:0/4055106040 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f455007a6f0 0x7f455007cba0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f456c199400 tx=0x7f455801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:28.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.722+0000 7f4568c00700 1 -- 172.21.15.111:0/4055106040 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f455c060440 con 0x7f456c100200 2024-09-11T00:14:28.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:28 smithi111 ceph-mon[90842]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:14:28.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:28 smithi111 ceph-mon[90842]: pgmap v67: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:14:28.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:28 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/2940409753' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:14:28.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.991+0000 7f4571a00700 1 -- 172.21.15.111:0/4055106040 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f456c19d450 con 0x7f456c100200 2024-09-11T00:14:28.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.992+0000 7f4568c00700 1 -- 172.21.15.111:0/4055106040 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1921 (secure 0 0 0) 0x7f455c063560 con 0x7f456c100200 2024-09-11T00:14:28.993 INFO:teuthology.orchestra.run.smithi111.stdout:e15 2024-09-11T00:14:28.993 INFO:teuthology.orchestra.run.smithi111.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-11T00:14:28.993 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T00:14:28.993 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:14:28.993 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-11T00:14:28.994 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:14:28.994 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-11T00:14:28.994 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-11T00:14:28.994 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 14 2024-09-11T00:14:28.994 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-11T00:14:28.994 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-11T00:03:47.950356+0000 2024-09-11T00:14:28.994 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-11T00:04:06.275905+0000 2024-09-11T00:14:28.994 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-11T00:14:28.994 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-11T00:14:28.994 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-11T00:14:28.994 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-11T00:14:28.994 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-11T00:14:28.994 INFO:teuthology.orchestra.run.smithi111.stdout:max_xattr_size 65536 2024-09-11T00:14:28.994 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-11T00:14:28.995 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-11T00:14:28.995 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 47 2024-09-11T00:14:28.995 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:14:28.995 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-11T00:14:28.995 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-11T00:14:28.995 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=24363} 2024-09-11T00:14:28.995 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-11T00:14:28.995 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-11T00:14:28.995 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-11T00:14:28.995 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-11T00:14:28.995 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-11T00:14:28.995 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data enabled 2024-09-11T00:14:28.995 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-11T00:14:28.995 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-11T00:14:28.996 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 1 2024-09-11T00:14:28.996 INFO:teuthology.orchestra.run.smithi111.stdout:qdb_cluster leader: 0 members: 2024-09-11T00:14:28.996 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.tcrqop{0:24363} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.203:6824/3082736449,v1:172.21.15.203:6825/3082736449] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:14:28.996 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:14:28.996 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:14:28.996 INFO:teuthology.orchestra.run.smithi111.stdout:Standby daemons: 2024-09-11T00:14:28.996 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:14:28.996 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.rucaba{-1:14554} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6828/2045133285,v1:172.21.15.111:6829/2045133285] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:14:28.996 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.gmgsay{-1:14566} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.111:6826/1122545830,v1:172.21.15.111:6827/1122545830] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:14:28.996 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.uqkbkn{-1:24379} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.203:6826/695613114,v1:172.21.15.203:6827/695613114] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:14:28.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.996+0000 7f4571a00700 1 -- 172.21.15.111:0/4055106040 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f455007a6f0 msgr2=0x7f455007cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:28.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.996+0000 7f4571a00700 1 --2- 172.21.15.111:0/4055106040 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f455007a6f0 0x7f455007cba0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f456c199400 tx=0x7f455801a040 comp rx=0 tx=0).stop 2024-09-11T00:14:28.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.996+0000 7f4571a00700 1 -- 172.21.15.111:0/4055106040 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f456c100200 msgr2=0x7f456c197de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:28.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.996+0000 7f4571a00700 1 --2- 172.21.15.111:0/4055106040 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f456c100200 0x7f456c197de0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f455c00d8d0 tx=0x7f455c00dc90 comp rx=0 tx=0).stop 2024-09-11T00:14:28.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.996+0000 7f4571a00700 1 -- 172.21.15.111:0/4055106040 shutdown_connections 2024-09-11T00:14:28.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.996+0000 7f4571a00700 1 --2- 172.21.15.111:0/4055106040 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f455007a6f0 0x7f455007cba0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.996+0000 7f4571a00700 1 --2- 172.21.15.111:0/4055106040 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f456c100200 0x7f456c197de0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.996+0000 7f4571a00700 1 --2- 172.21.15.111:0/4055106040 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f456c100ba0 0x7f456c198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.996+0000 7f4571a00700 1 -- 172.21.15.111:0/4055106040 >> 172.21.15.111:0/4055106040 conn(0x7f456c0fba80 msgr2=0x7f456c0fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:28.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.996+0000 7f4571a00700 1 -- 172.21.15.111:0/4055106040 shutdown_connections 2024-09-11T00:14:28.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:28.996+0000 7f4571a00700 1 -- 172.21.15.111:0/4055106040 wait complete. 2024-09-11T00:14:28.999 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 15 2024-09-11T00:14:29.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:28 smithi203 ceph-mon[69002]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:14:29.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:28 smithi203 ceph-mon[69002]: pgmap v67: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:14:29.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:28 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/2940409753' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:14:29.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.135+0000 7fd209000700 1 -- 172.21.15.111:0/2464181782 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd204100ba0 msgr2=0x7fd204104b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:29.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.135+0000 7fd209000700 1 --2- 172.21.15.111:0/2464181782 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd204100ba0 0x7fd204104b70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec009910 tx=0x7fd1ec009c20 comp rx=0 tx=0).stop 2024-09-11T00:14:29.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.135+0000 7fd209000700 1 -- 172.21.15.111:0/2464181782 shutdown_connections 2024-09-11T00:14:29.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.135+0000 7fd209000700 1 --2- 172.21.15.111:0/2464181782 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd204100ba0 0x7fd204104b70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:29.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.135+0000 7fd209000700 1 --2- 172.21.15.111:0/2464181782 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd204100200 0x7fd2041005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:29.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.135+0000 7fd209000700 1 -- 172.21.15.111:0/2464181782 >> 172.21.15.111:0/2464181782 conn(0x7fd2040fba80 msgr2=0x7fd2040fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:29.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.135+0000 7fd209000700 1 -- 172.21.15.111:0/2464181782 shutdown_connections 2024-09-11T00:14:29.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.135+0000 7fd209000700 1 -- 172.21.15.111:0/2464181782 wait complete. 2024-09-11T00:14:29.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.136+0000 7fd209000700 1 Processor -- start 2024-09-11T00:14:29.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.136+0000 7fd209000700 1 -- start start 2024-09-11T00:14:29.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.137+0000 7fd209000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd204100200 0x7fd204073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:29.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.137+0000 7fd209000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd204100ba0 0x7fd204073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:29.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.137+0000 7fd209000700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd204073ad0 con 0x7fd204100200 2024-09-11T00:14:29.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.137+0000 7fd209000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd204073c10 con 0x7fd204100ba0 2024-09-11T00:14:29.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.137+0000 7fd203400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd204100200 0x7fd204073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:29.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.137+0000 7fd203400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd204100200 0x7fd204073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:36564/0 (socket says 172.21.15.111:36564) 2024-09-11T00:14:29.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.137+0000 7fd203400700 1 -- 172.21.15.111:0/3772627591 learned_addr learned my addr 172.21.15.111:0/3772627591 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:14:29.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.137+0000 7fd1faa00700 1 --2- 172.21.15.111:0/3772627591 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd204100ba0 0x7fd204073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:29.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.137+0000 7fd203400700 1 -- 172.21.15.111:0/3772627591 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd204100ba0 msgr2=0x7fd204073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:29.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.137+0000 7fd203400700 1 --2- 172.21.15.111:0/3772627591 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd204100ba0 0x7fd204073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:29.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.137+0000 7fd203400700 1 -- 172.21.15.111:0/3772627591 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec0095f0 con 0x7fd204100200 2024-09-11T00:14:29.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.138+0000 7fd203400700 1 --2- 172.21.15.111:0/3772627591 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd204100200 0x7fd204073050 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd1f400d900 tx=0x7fd1f400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:29.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.138+0000 7fd200c00700 1 -- 172.21.15.111:0/3772627591 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1f4004a00 con 0x7fd204100200 2024-09-11T00:14:29.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.138+0000 7fd200c00700 1 -- 172.21.15.111:0/3772627591 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd1f40054e0 con 0x7fd204100200 2024-09-11T00:14:29.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.138+0000 7fd209000700 1 -- 172.21.15.111:0/3772627591 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2041a1d60 con 0x7fd204100200 2024-09-11T00:14:29.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.138+0000 7fd200c00700 1 -- 172.21.15.111:0/3772627591 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1f4009d60 con 0x7fd204100200 2024-09-11T00:14:29.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.138+0000 7fd209000700 1 -- 172.21.15.111:0/3772627591 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2041a2170 con 0x7fd204100200 2024-09-11T00:14:29.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.140+0000 7fd209000700 1 -- 172.21.15.111:0/3772627591 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd204108480 con 0x7fd204100200 2024-09-11T00:14:29.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.140+0000 7fd200c00700 1 -- 172.21.15.111:0/3772627591 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fd1f4005020 con 0x7fd204100200 2024-09-11T00:14:29.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.141+0000 7fd200c00700 1 --2- 172.21.15.111:0/3772627591 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd1e807a6f0 0x7fd1e807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:29.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.141+0000 7fd200c00700 1 -- 172.21.15.111:0/3772627591 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd1f409d4a0 con 0x7fd204100200 2024-09-11T00:14:29.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.142+0000 7fd1faa00700 1 --2- 172.21.15.111:0/3772627591 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd1e807a6f0 0x7fd1e807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:29.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.142+0000 7fd1faa00700 1 --2- 172.21.15.111:0/3772627591 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd1e807a6f0 0x7fd1e807cba0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd204074840 tx=0x7fd1ec01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:29.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.149+0000 7fd200c00700 1 -- 172.21.15.111:0/3772627591 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fd1f4060ba0 con 0x7fd204100200 2024-09-11T00:14:29.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.417+0000 7fd209000700 1 -- 172.21.15.111:0/3772627591 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd20402cd40 con 0x7fd1e807a6f0 2024-09-11T00:14:29.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.418+0000 7fd200c00700 1 -- 172.21.15.111:0/3772627591 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd20402cd40 con 0x7fd1e807a6f0 2024-09-11T00:14:29.420 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:14:29.420 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e", 2024-09-11T00:14:29.420 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-11T00:14:29.420 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-11T00:14:29.420 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-11T00:14:29.420 INFO:teuthology.orchestra.run.smithi111.stdout: "crash", 2024-09-11T00:14:29.420 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr", 2024-09-11T00:14:29.420 INFO:teuthology.orchestra.run.smithi111.stdout: "mon" 2024-09-11T00:14:29.420 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-11T00:14:29.420 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "7/23 daemons upgraded", 2024-09-11T00:14:29.420 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading osd daemons", 2024-09-11T00:14:29.420 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-11T00:14:29.421 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:14:29.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.421+0000 7fd209000700 1 -- 172.21.15.111:0/3772627591 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd1e807a6f0 msgr2=0x7fd1e807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:29.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.421+0000 7fd209000700 1 --2- 172.21.15.111:0/3772627591 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd1e807a6f0 0x7fd1e807cba0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd204074840 tx=0x7fd1ec01a040 comp rx=0 tx=0).stop 2024-09-11T00:14:29.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.421+0000 7fd209000700 1 -- 172.21.15.111:0/3772627591 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd204100200 msgr2=0x7fd204073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:29.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.421+0000 7fd209000700 1 --2- 172.21.15.111:0/3772627591 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd204100200 0x7fd204073050 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd1f400d900 tx=0x7fd1f400dcc0 comp rx=0 tx=0).stop 2024-09-11T00:14:29.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.421+0000 7fd209000700 1 -- 172.21.15.111:0/3772627591 shutdown_connections 2024-09-11T00:14:29.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.421+0000 7fd209000700 1 --2- 172.21.15.111:0/3772627591 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd1e807a6f0 0x7fd1e807cba0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:29.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.421+0000 7fd209000700 1 --2- 172.21.15.111:0/3772627591 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd204100200 0x7fd204073050 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:29.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.421+0000 7fd209000700 1 --2- 172.21.15.111:0/3772627591 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd204100ba0 0x7fd204073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:29.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.421+0000 7fd209000700 1 -- 172.21.15.111:0/3772627591 >> 172.21.15.111:0/3772627591 conn(0x7fd2040fba80 msgr2=0x7fd2041043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:29.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.421+0000 7fd209000700 1 -- 172.21.15.111:0/3772627591 shutdown_connections 2024-09-11T00:14:29.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.421+0000 7fd209000700 1 -- 172.21.15.111:0/3772627591 wait complete. 2024-09-11T00:14:29.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.563+0000 7f8824400700 1 -- 172.21.15.111:0/3704306708 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f881c102fb0 msgr2=0x7f881c106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:29.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.563+0000 7f8824400700 1 --2- 172.21.15.111:0/3704306708 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f881c102fb0 0x7f881c106f80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8808009910 tx=0x7f8808009c20 comp rx=0 tx=0).stop 2024-09-11T00:14:29.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.563+0000 7f8824400700 1 -- 172.21.15.111:0/3704306708 shutdown_connections 2024-09-11T00:14:29.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.563+0000 7f8824400700 1 --2- 172.21.15.111:0/3704306708 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f881c102fb0 0x7f881c106f80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:29.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.563+0000 7f8824400700 1 --2- 172.21.15.111:0/3704306708 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f881c102610 0x7f881c1029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:29.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.563+0000 7f8824400700 1 -- 172.21.15.111:0/3704306708 >> 172.21.15.111:0/3704306708 conn(0x7f881c0fdef0 msgr2=0x7f881c100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:29.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.563+0000 7f8824400700 1 -- 172.21.15.111:0/3704306708 shutdown_connections 2024-09-11T00:14:29.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.563+0000 7f8824400700 1 -- 172.21.15.111:0/3704306708 wait complete. 2024-09-11T00:14:29.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.564+0000 7f8824400700 1 Processor -- start 2024-09-11T00:14:29.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.564+0000 7f8824400700 1 -- start start 2024-09-11T00:14:29.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.565+0000 7f8824400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f881c102610 0x7f881c197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:29.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.565+0000 7f8824400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f881c102fb0 0x7f881c1984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:29.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.565+0000 7f8824400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c198ba0 con 0x7f881c102fb0 2024-09-11T00:14:29.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.565+0000 7f8824400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c19c930 con 0x7f881c102610 2024-09-11T00:14:29.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.565+0000 7f8821000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f881c102fb0 0x7f881c1984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:29.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.565+0000 7f8821000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f881c102fb0 0x7f881c1984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:36570/0 (socket says 172.21.15.111:36570) 2024-09-11T00:14:29.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.565+0000 7f8821000700 1 -- 172.21.15.111:0/1112133933 learned_addr learned my addr 172.21.15.111:0/1112133933 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:14:29.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.565+0000 7f8821a00700 1 --2- 172.21.15.111:0/1112133933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f881c102610 0x7f881c197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:29.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.565+0000 7f8821000700 1 -- 172.21.15.111:0/1112133933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f881c102610 msgr2=0x7f881c197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:29.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.565+0000 7f8821000700 1 --2- 172.21.15.111:0/1112133933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f881c102610 0x7f881c197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:29.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.565+0000 7f8821000700 1 -- 172.21.15.111:0/1112133933 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88080095f0 con 0x7f881c102fb0 2024-09-11T00:14:29.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.565+0000 7f8821a00700 1 --2- 172.21.15.111:0/1112133933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f881c102610 0x7f881c197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:29.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.566+0000 7f8821000700 1 --2- 172.21.15.111:0/1112133933 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f881c102fb0 0x7f881c1984c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8808009fd0 tx=0x7f880800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:29.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.566+0000 7f881a000700 1 -- 172.21.15.111:0/1112133933 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f880801d070 con 0x7f881c102fb0 2024-09-11T00:14:29.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.566+0000 7f881a000700 1 -- 172.21.15.111:0/1112133933 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8808022470 con 0x7f881c102fb0 2024-09-11T00:14:29.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.566+0000 7f8824400700 1 -- 172.21.15.111:0/1112133933 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f881c19cbb0 con 0x7f881c102fb0 2024-09-11T00:14:29.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.566+0000 7f881a000700 1 -- 172.21.15.111:0/1112133933 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8808017610 con 0x7f881c102fb0 2024-09-11T00:14:29.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.566+0000 7f8824400700 1 -- 172.21.15.111:0/1112133933 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881c19d040 con 0x7f881c102fb0 2024-09-11T00:14:29.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.567+0000 7f8824400700 1 -- 172.21.15.111:0/1112133933 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f881c10a980 con 0x7f881c102fb0 2024-09-11T00:14:29.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.569+0000 7f881a000700 1 -- 172.21.15.111:0/1112133933 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f88080225e0 con 0x7f881c102fb0 2024-09-11T00:14:29.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.569+0000 7f881a000700 1 --2- 172.21.15.111:0/1112133933 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f880407a6f0 0x7f880407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:29.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.570+0000 7f881a000700 1 -- 172.21.15.111:0/1112133933 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f880809e850 con 0x7f881c102fb0 2024-09-11T00:14:29.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.570+0000 7f8821a00700 1 --2- 172.21.15.111:0/1112133933 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f880407a6f0 0x7f880407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:29.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.571+0000 7f8821a00700 1 --2- 172.21.15.111:0/1112133933 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f880407a6f0 0x7f880407cba0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8810009cb0 tx=0x7f8810009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:29.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.574+0000 7f881a000700 1 -- 172.21.15.111:0/1112133933 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f8808061fd0 con 0x7f881c102fb0 2024-09-11T00:14:29.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.899+0000 7f8824400700 1 -- 172.21.15.111:0/1112133933 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f881c04ea50 con 0x7f881c102fb0 2024-09-11T00:14:29.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.900+0000 7f881a000700 1 -- 172.21.15.111:0/1112133933 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f88080650f0 con 0x7f881c102fb0 2024-09-11T00:14:29.902 INFO:teuthology.orchestra.run.smithi111.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-11T00:14:29.902 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-11T00:14:29.902 INFO:teuthology.orchestra.run.smithi111.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-11T00:14:29.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.903+0000 7f8824400700 1 -- 172.21.15.111:0/1112133933 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f880407a6f0 msgr2=0x7f880407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:29.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.903+0000 7f8824400700 1 --2- 172.21.15.111:0/1112133933 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f880407a6f0 0x7f880407cba0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8810009cb0 tx=0x7f8810009260 comp rx=0 tx=0).stop 2024-09-11T00:14:29.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.903+0000 7f8824400700 1 -- 172.21.15.111:0/1112133933 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f881c102fb0 msgr2=0x7f881c1984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:29.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.903+0000 7f8824400700 1 --2- 172.21.15.111:0/1112133933 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f881c102fb0 0x7f881c1984c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8808009fd0 tx=0x7f880800f690 comp rx=0 tx=0).stop 2024-09-11T00:14:29.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.903+0000 7f8824400700 1 -- 172.21.15.111:0/1112133933 shutdown_connections 2024-09-11T00:14:29.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.903+0000 7f8824400700 1 --2- 172.21.15.111:0/1112133933 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f880407a6f0 0x7f880407cba0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:29.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.903+0000 7f8824400700 1 --2- 172.21.15.111:0/1112133933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f881c102610 0x7f881c197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:29.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.903+0000 7f8824400700 1 --2- 172.21.15.111:0/1112133933 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f881c102fb0 0x7f881c1984c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:29.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.903+0000 7f8824400700 1 -- 172.21.15.111:0/1112133933 >> 172.21.15.111:0/1112133933 conn(0x7f881c0fdef0 msgr2=0x7f881c100290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:29.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.903+0000 7f8824400700 1 -- 172.21.15.111:0/1112133933 shutdown_connections 2024-09-11T00:14:29.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:14:29.903+0000 7f8824400700 1 -- 172.21.15.111:0/1112133933 wait complete. 2024-09-11T00:14:30.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:29 smithi203 ceph-mon[69002]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:14:30.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:29 smithi203 ceph-mon[69002]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:14:30.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:29 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/4055106040' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:14:30.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:29 smithi111 ceph-mon[90842]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:14:30.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:29 smithi111 ceph-mon[90842]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:14:30.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:29 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/4055106040' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:14:30.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:30 smithi111 ceph-mon[90842]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:14:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:30 smithi111 ceph-mon[90842]: pgmap v68: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:14:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:30 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/1112133933' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-11T00:14:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:14:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:31.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:30 smithi203 ceph-mon[69002]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:14:31.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:30 smithi203 ceph-mon[69002]: pgmap v68: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:14:31.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:30 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/1112133933' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-11T00:14:31.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:31.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:14:31.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:33.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:32 smithi203 ceph-mon[69002]: pgmap v69: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:14:33.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:32 smithi111 ceph-mon[90842]: pgmap v69: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:14:33.939 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:33 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-11T00:14:34.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:33 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-11T00:14:34.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:34 smithi111 ceph-mon[90842]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-11T00:14:34.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:34 smithi111 ceph-mon[90842]: Upgrade: osd.1 is safe to restart 2024-09-11T00:14:34.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:34 smithi111 ceph-mon[90842]: pgmap v70: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:14:35.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:34 smithi203 ceph-mon[69002]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-11T00:14:35.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:34 smithi203 ceph-mon[69002]: Upgrade: osd.1 is safe to restart 2024-09-11T00:14:35.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:34 smithi203 ceph-mon[69002]: pgmap v70: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:14:36.268 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:36 smithi111 ceph-mon[90842]: Upgrade: Updating osd.1 2024-09-11T00:14:36.268 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:36 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:36.268 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:36 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-11T00:14:36.268 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:36 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:36.268 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:36 smithi111 ceph-mon[90842]: Deploying daemon osd.1 on smithi111 2024-09-11T00:14:36.268 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:36 smithi111 ceph-mon[90842]: pgmap v71: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:14:36.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:36 smithi203 ceph-mon[69002]: Upgrade: Updating osd.1 2024-09-11T00:14:36.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:36 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:36.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:36 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-11T00:14:36.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:36 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:36.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:36 smithi203 ceph-mon[69002]: Deploying daemon osd.1 on smithi111 2024-09-11T00:14:36.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:36 smithi203 ceph-mon[69002]: pgmap v71: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:14:39.024 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:38 smithi111 ceph-mon[90842]: pgmap v72: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:14:39.024 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:38 smithi111 systemd[1]: Stopping Ceph osd.1 for 03107fbe-6fd0-11ef-bcea-c7b262605968... 2024-09-11T00:14:39.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:38 smithi203 ceph-mon[69002]: pgmap v72: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:14:39.402 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:39 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1[50714]: 2024-09-11T00:14:39.021+0000 7f9d25200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:14:39.403 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:39 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1[50714]: 2024-09-11T00:14:39.021+0000 7f9d25200700 -1 osd.1 55 *** Got signal Terminated *** 2024-09-11T00:14:39.403 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:39 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1[50714]: 2024-09-11T00:14:39.021+0000 7f9d25200700 -1 osd.1 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:14:39.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:39 smithi111 ceph-mon[90842]: osd.1 marked itself down and dead 2024-09-11T00:14:40.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:39 smithi203 ceph-mon[69002]: osd.1 marked itself down and dead 2024-09-11T00:14:40.581 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:40 smithi111 podman[107731]: 2024-09-11 00:14:40.273650842 +0000 UTC m=+1.387043159 container died 3614d95b1425fe37c7a069a919081c6634d5007623bf911175124c4507dd736c (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1, io.buildah.version=1.29.1, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, GIT_CLEAN=True, RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0) 2024-09-11T00:14:40.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:40 smithi111 ceph-mon[90842]: pgmap v73: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:14:40.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:40 smithi111 ceph-mon[90842]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-11T00:14:40.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:40 smithi111 ceph-mon[90842]: osdmap e56: 6 total, 5 up, 6 in 2024-09-11T00:14:40.903 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:40 smithi111 podman[107731]: 2024-09-11 00:14:40.69359452 +0000 UTC m=+1.806986836 container cleanup 3614d95b1425fe37c7a069a919081c6634d5007623bf911175124c4507dd736c (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.license=GPLv2, RELEASE=HEAD, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2024-09-11T00:14:40.903 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:40 smithi111 bash[107731]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1 2024-09-11T00:14:41.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:40 smithi203 ceph-mon[69002]: pgmap v73: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:14:41.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:40 smithi203 ceph-mon[69002]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-11T00:14:41.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:40 smithi203 ceph-mon[69002]: osdmap e56: 6 total, 5 up, 6 in 2024-09-11T00:14:41.402 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:40 smithi111 podman[107750]: 2024-09-11 00:14:40.928295099 +0000 UTC m=+0.644616280 container remove 3614d95b1425fe37c7a069a919081c6634d5007623bf911175124c4507dd736c (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212) 2024-09-11T00:14:41.766 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:41 smithi111 ceph-mon[90842]: osdmap e57: 6 total, 5 up, 6 in 2024-09-11T00:14:41.767 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:41 smithi111 podman[107837]: 2024-09-11 00:14:41.400588373 +0000 UTC m=+0.027154488 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:14:41.767 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:41 smithi111 podman[107837]: 2024-09-11 00:14:41.495638855 +0000 UTC m=+0.122204958 container create ba2e1c066cffeec47d7ae45e4108541de8a5226dd7de62777cb288e61ee7d3c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-11T00:14:41.767 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:41 smithi111 podman[107837]: 2024-09-11 00:14:41.765527952 +0000 UTC m=+0.392094055 container init ba2e1c066cffeec47d7ae45e4108541de8a5226dd7de62777cb288e61ee7d3c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:14:42.038 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:41 smithi111 podman[107837]: 2024-09-11 00:14:41.772782844 +0000 UTC m=+0.399348959 container start ba2e1c066cffeec47d7ae45e4108541de8a5226dd7de62777cb288e61ee7d3c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-11T00:14:42.039 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:41 smithi111 podman[107837]: 2024-09-11 00:14:41.865222726 +0000 UTC m=+0.491788833 container attach ba2e1c066cffeec47d7ae45e4108541de8a5226dd7de62777cb288e61ee7d3c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-11T00:14:42.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:41 smithi203 ceph-mon[69002]: osdmap e57: 6 total, 5 up, 6 in 2024-09-11T00:14:42.362 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:42 smithi111 podman[107837]: 2024-09-11 00:14:42.038216564 +0000 UTC m=+0.664782675 container died ba2e1c066cffeec47d7ae45e4108541de8a5226dd7de62777cb288e61ee7d3c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-11T00:14:42.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:42 smithi111 ceph-mon[90842]: pgmap v76: 65 pgs: 34 peering, 31 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:14:42.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:42 smithi111 ceph-mon[90842]: Health check failed: Reduced data availability: 12 pgs peering (PG_AVAILABILITY) 2024-09-11T00:14:42.903 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:42 smithi111 podman[107860]: 2024-09-11 00:14:42.62677175 +0000 UTC m=+0.575571626 container remove ba2e1c066cffeec47d7ae45e4108541de8a5226dd7de62777cb288e61ee7d3c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:14:42.903 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:42 smithi111 systemd[1]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-11T00:14:42.903 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:42 smithi111 systemd[1]: Stopped Ceph osd.1 for 03107fbe-6fd0-11ef-bcea-c7b262605968. 2024-09-11T00:14:42.903 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:42 smithi111 systemd[1]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.1.service: Consumed 1min 20.988s CPU time. 2024-09-11T00:14:43.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:42 smithi203 ceph-mon[69002]: pgmap v76: 65 pgs: 34 peering, 31 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:14:43.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:42 smithi203 ceph-mon[69002]: Health check failed: Reduced data availability: 12 pgs peering (PG_AVAILABILITY) 2024-09-11T00:14:43.279 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:42 smithi111 systemd[1]: Starting Ceph osd.1 for 03107fbe-6fd0-11ef-bcea-c7b262605968... 2024-09-11T00:14:43.606 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:43 smithi111 podman[107955]: 2024-09-11 00:14:43.277927548 +0000 UTC m=+0.117266313 container create 1d886f2dca68ff71f3c8cdedea32b282f9650761bf49cffbb34b45da12a2ccc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1-activate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:14:43.607 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:43 smithi111 podman[107955]: 2024-09-11 00:14:43.187991365 +0000 UTC m=+0.027330132 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:14:43.607 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:43 smithi111 podman[107955]: 2024-09-11 00:14:43.497598615 +0000 UTC m=+0.336937381 container init 1d886f2dca68ff71f3c8cdedea32b282f9650761bf49cffbb34b45da12a2ccc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1-activate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-11T00:14:43.607 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:43 smithi111 podman[107955]: 2024-09-11 00:14:43.504571795 +0000 UTC m=+0.343910563 container start 1d886f2dca68ff71f3c8cdedea32b282f9650761bf49cffbb34b45da12a2ccc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1-activate, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-11T00:14:43.607 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:43 smithi111 podman[107955]: 2024-09-11 00:14:43.605489198 +0000 UTC m=+0.444827973 container attach 1d886f2dca68ff71f3c8cdedea32b282f9650761bf49cffbb34b45da12a2ccc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1-activate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-11T00:14:43.902 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:43 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1-activate[107970]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-11T00:14:43.903 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:43 smithi111 bash[107955]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-11T00:14:43.903 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:43 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1-activate[107970]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-11T00:14:43.903 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:43 smithi111 bash[107955]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-11T00:14:44.899 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:44 smithi111 ceph-mon[90842]: pgmap v77: 65 pgs: 34 peering, 31 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:14:44.899 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:44 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1-activate[107970]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-11T00:14:44.899 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:44 smithi111 bash[107955]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-11T00:14:44.899 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:44 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1-activate[107970]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-11T00:14:44.900 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:44 smithi111 bash[107955]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-11T00:14:45.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:44 smithi203 ceph-mon[69002]: pgmap v77: 65 pgs: 34 peering, 31 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:14:45.153 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:44 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1-activate[107970]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-11T00:14:45.153 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:44 smithi111 bash[107955]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-11T00:14:45.153 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:44 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1-activate[107970]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-11T00:14:45.153 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:44 smithi111 bash[107955]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-11T00:14:45.153 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:44 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1-activate[107970]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-11T00:14:45.153 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:44 smithi111 bash[107955]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-11T00:14:45.153 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:44 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1-activate[107970]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-11T00:14:45.153 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:44 smithi111 bash[107955]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-11T00:14:45.153 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:44 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1-activate[107970]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-11T00:14:45.153 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:44 smithi111 bash[107955]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-11T00:14:45.153 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:44 smithi111 podman[107955]: 2024-09-11 00:14:44.956722085 +0000 UTC m=+1.796060863 container died 1d886f2dca68ff71f3c8cdedea32b282f9650761bf49cffbb34b45da12a2ccc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1-activate, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-11T00:14:45.940 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:45 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:45.941 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:45 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:14:45.941 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:45 smithi111 ceph-mon[90842]: pgmap v78: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-09-11T00:14:45.941 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:45 smithi111 podman[108108]: 2024-09-11 00:14:45.675881005 +0000 UTC m=+0.705917113 container remove 1d886f2dca68ff71f3c8cdedea32b282f9650761bf49cffbb34b45da12a2ccc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:14:46.214 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:45 smithi111 podman[108166]: 2024-09-11 00:14:45.876800413 +0000 UTC m=+0.026825312 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:14:46.214 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:45 smithi111 podman[108166]: 2024-09-11 00:14:45.985290953 +0000 UTC m=+0.135315843 container create 19cf95ecca7d1f063b47c18bb705fa974976936bae6fb0831d19d8bf49f74a96 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-11T00:14:46.214 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:46 smithi111 podman[108166]: 2024-09-11 00:14:46.21292445 +0000 UTC m=+0.362949370 container init 19cf95ecca7d1f063b47c18bb705fa974976936bae6fb0831d19d8bf49f74a96 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True) 2024-09-11T00:14:46.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:45 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:46.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:45 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:14:46.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:45 smithi203 ceph-mon[69002]: pgmap v78: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-09-11T00:14:46.652 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:46 smithi111 podman[108166]: 2024-09-11 00:14:46.219651122 +0000 UTC m=+0.369676014 container start 19cf95ecca7d1f063b47c18bb705fa974976936bae6fb0831d19d8bf49f74a96 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:14:46.653 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:46 smithi111 ceph-osd[108185]: -- 172.21.15.111:0/2225130013 <== mon.0 v2:172.21.15.111:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55db439aa1e0 con 0x55db42bb5c00 2024-09-11T00:14:46.653 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:46 smithi111 bash[108166]: 19cf95ecca7d1f063b47c18bb705fa974976936bae6fb0831d19d8bf49f74a96 2024-09-11T00:14:46.653 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:46 smithi111 systemd[1]: Started Ceph osd.1 for 03107fbe-6fd0-11ef-bcea-c7b262605968. 2024-09-11T00:14:47.245 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:46 smithi111 ceph-mon[90842]: Health check failed: Degraded data redundancy: 34/264 objects degraded (12.879%), 13 pgs degraded (PG_DEGRADED) 2024-09-11T00:14:47.245 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:46 smithi111 ceph-mon[90842]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 12 pgs peering) 2024-09-11T00:14:47.246 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:46 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:47.246 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:46 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:47.246 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:46 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:14:47.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:46 smithi203 ceph-mon[69002]: Health check failed: Degraded data redundancy: 34/264 objects degraded (12.879%), 13 pgs degraded (PG_DEGRADED) 2024-09-11T00:14:47.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:46 smithi203 ceph-mon[69002]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 12 pgs peering) 2024-09-11T00:14:47.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:46 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:47.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:46 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:47.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:46 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:14:48.215 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:47 smithi111 ceph-mon[90842]: pgmap v79: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-09-11T00:14:48.215 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:48 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1[108181]: 2024-09-11T00:14:48.137+0000 7f5151e3b640 -1 Falling back to public interface 2024-09-11T00:14:48.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:47 smithi203 ceph-mon[69002]: pgmap v79: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-09-11T00:14:50.977 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:50 smithi111 ceph-mon[90842]: pgmap v80: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-09-11T00:14:51.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:50 smithi203 ceph-mon[69002]: pgmap v80: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-09-11T00:14:53.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:52 smithi203 ceph-mon[69002]: pgmap v81: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-09-11T00:14:53.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:52 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:53.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:52 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:53.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:52 smithi111 ceph-mon[90842]: pgmap v81: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-09-11T00:14:53.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:52 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:53.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:52 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:54.402 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:54 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1[108181]: 2024-09-11T00:14:54.142+0000 7f5151e3b640 -1 osd.1 0 read_superblock omap replica is missing. 2024-09-11T00:14:54.739 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:54 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1[108181]: 2024-09-11T00:14:54.499+0000 7f5151e3b640 -1 osd.1 55 log_to_monitors true 2024-09-11T00:14:54.740 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:54 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:54.740 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:54 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:54.740 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:54 smithi111 ceph-mon[90842]: pgmap v82: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-09-11T00:14:54.740 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:54 smithi111 ceph-mon[90842]: from='osd.1 [v2:172.21.15.111:6810/1761428291,v1:172.21.15.111:6811/1761428291]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-11T00:14:54.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:54 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:54.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:54 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:54.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:54 smithi203 ceph-mon[69002]: pgmap v82: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-09-11T00:14:54.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:54 smithi203 ceph-mon[69002]: from='osd.1 [v2:172.21.15.111:6810/1761428291,v1:172.21.15.111:6811/1761428291]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-11T00:14:55.714 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:55 smithi111 ceph-mon[90842]: from='osd.1 [v2:172.21.15.111:6810/1761428291,v1:172.21.15.111:6811/1761428291]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T00:14:55.714 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:55 smithi111 ceph-mon[90842]: osdmap e58: 6 total, 5 up, 6 in 2024-09-11T00:14:55.714 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:55 smithi111 ceph-mon[90842]: from='osd.1 [v2:172.21.15.111:6810/1761428291,v1:172.21.15.111:6811/1761428291]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi111", "root=default"]} : dispatch 2024-09-11T00:14:55.714 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:55 smithi111 ceph-mon[90842]: from='osd.1 [v2:172.21.15.111:6810/1761428291,v1:172.21.15.111:6811/1761428291]' entity='osd.1' 2024-09-11T00:14:55.714 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:14:55 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1[108181]: 2024-09-11T00:14:55.538+0000 7f5142a00640 -1 osd.1 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:14:55.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:55 smithi203 ceph-mon[69002]: from='osd.1 [v2:172.21.15.111:6810/1761428291,v1:172.21.15.111:6811/1761428291]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T00:14:55.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:55 smithi203 ceph-mon[69002]: osdmap e58: 6 total, 5 up, 6 in 2024-09-11T00:14:55.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:55 smithi203 ceph-mon[69002]: from='osd.1 [v2:172.21.15.111:6810/1761428291,v1:172.21.15.111:6811/1761428291]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi111", "root=default"]} : dispatch 2024-09-11T00:14:55.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:55 smithi203 ceph-mon[69002]: from='osd.1 [v2:172.21.15.111:6810/1761428291,v1:172.21.15.111:6811/1761428291]' entity='osd.1' 2024-09-11T00:14:56.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:56 smithi111 ceph-mon[90842]: pgmap v84: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-09-11T00:14:57.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:56 smithi203 ceph-mon[69002]: pgmap v84: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-09-11T00:14:57.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:57 smithi111 ceph-mon[90842]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-11T00:14:57.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:57 smithi111 ceph-mon[90842]: osd.1 [v2:172.21.15.111:6810/1761428291,v1:172.21.15.111:6811/1761428291] boot 2024-09-11T00:14:57.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:57 smithi111 ceph-mon[90842]: osdmap e59: 6 total, 6 up, 6 in 2024-09-11T00:14:57.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:57 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T00:14:58.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:57 smithi203 ceph-mon[69002]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-11T00:14:58.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:57 smithi203 ceph-mon[69002]: osd.1 [v2:172.21.15.111:6810/1761428291,v1:172.21.15.111:6811/1761428291] boot 2024-09-11T00:14:58.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:57 smithi203 ceph-mon[69002]: osdmap e59: 6 total, 6 up, 6 in 2024-09-11T00:14:58.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:57 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T00:14:58.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:58 smithi111 ceph-mon[90842]: osdmap e60: 6 total, 6 up, 6 in 2024-09-11T00:14:58.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:58 smithi111 ceph-mon[90842]: pgmap v87: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-09-11T00:14:58.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:58 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:58.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:58 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:58.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:58 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:58.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:58 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:14:58.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:58 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:58.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:58 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:14:58.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:58 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:14:58.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:58 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:14:58.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:58 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:14:58.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:58 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-11T00:14:59.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:58 smithi203 ceph-mon[69002]: osdmap e60: 6 total, 6 up, 6 in 2024-09-11T00:14:59.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:58 smithi203 ceph-mon[69002]: pgmap v87: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-09-11T00:14:59.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:58 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:59.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:58 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:59.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:58 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:59.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:58 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:14:59.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:58 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:14:59.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:58 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:14:59.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:58 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:14:59.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:58 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:14:59.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:58 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:14:59.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:58 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-11T00:14:59.736 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:59 smithi111 ceph-mon[90842]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-11T00:14:59.736 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:14:59 smithi111 ceph-mon[90842]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-11T00:15:00.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:59 smithi203 ceph-mon[69002]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-11T00:15:00.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:14:59 smithi203 ceph-mon[69002]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-11T00:15:00.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.053+0000 7f082f200700 1 -- 172.21.15.111:0/4152803435 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0828068630 msgr2=0x7f0828068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:00.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.053+0000 7f082f200700 1 --2- 172.21.15.111:0/4152803435 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0828068630 0x7f0828068a00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0818009910 tx=0x7f0818009c20 comp rx=0 tx=0).stop 2024-09-11T00:15:00.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.053+0000 7f082f200700 1 -- 172.21.15.111:0/4152803435 shutdown_connections 2024-09-11T00:15:00.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.053+0000 7f082f200700 1 --2- 172.21.15.111:0/4152803435 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0828068fd0 0x7f0828104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.053+0000 7f082f200700 1 --2- 172.21.15.111:0/4152803435 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0828068630 0x7f0828068a00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.053+0000 7f082f200700 1 -- 172.21.15.111:0/4152803435 >> 172.21.15.111:0/4152803435 conn(0x7f0828074f50 msgr2=0x7f0828075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:00.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.053+0000 7f082f200700 1 -- 172.21.15.111:0/4152803435 shutdown_connections 2024-09-11T00:15:00.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.053+0000 7f082f200700 1 -- 172.21.15.111:0/4152803435 wait complete. 2024-09-11T00:15:00.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.054+0000 7f082f200700 1 Processor -- start 2024-09-11T00:15:00.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.055+0000 7f082f200700 1 -- start start 2024-09-11T00:15:00.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.055+0000 7f082f200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0828068630 0x7f0828197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:00.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.055+0000 7f082f200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0828068fd0 0x7f0828198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:00.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.055+0000 7f082f200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0828198b60 con 0x7f0828068630 2024-09-11T00:15:00.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.055+0000 7f082f200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082819c8f0 con 0x7f0828068fd0 2024-09-11T00:15:00.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.055+0000 7f0827e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0828068630 0x7f0828197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:00.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.055+0000 7f0827e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0828068630 0x7f0828197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:35222/0 (socket says 172.21.15.111:35222) 2024-09-11T00:15:00.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.055+0000 7f0827e00700 1 -- 172.21.15.111:0/3113095163 learned_addr learned my addr 172.21.15.111:0/3113095163 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:15:00.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.056+0000 7f0827400700 1 --2- 172.21.15.111:0/3113095163 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0828068fd0 0x7f0828198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:00.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.056+0000 7f0827e00700 1 -- 172.21.15.111:0/3113095163 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0828068fd0 msgr2=0x7f0828198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:00.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.056+0000 7f0827e00700 1 --2- 172.21.15.111:0/3113095163 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0828068fd0 0x7f0828198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.056+0000 7f0827e00700 1 -- 172.21.15.111:0/3113095163 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08180095f0 con 0x7f0828068630 2024-09-11T00:15:00.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.056+0000 7f0827400700 1 --2- 172.21.15.111:0/3113095163 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0828068fd0 0x7f0828198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:00.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.056+0000 7f0827e00700 1 --2- 172.21.15.111:0/3113095163 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0828068630 0x7f0828197f40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f081800b5c0 tx=0x7f081800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:00.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.056+0000 7f0824c00700 1 -- 172.21.15.111:0/3113095163 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f081801d070 con 0x7f0828068630 2024-09-11T00:15:00.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.057+0000 7f0824c00700 1 -- 172.21.15.111:0/3113095163 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0818005e00 con 0x7f0828068630 2024-09-11T00:15:00.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.057+0000 7f082f200700 1 -- 172.21.15.111:0/3113095163 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f082819cb70 con 0x7f0828068630 2024-09-11T00:15:00.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.057+0000 7f0824c00700 1 -- 172.21.15.111:0/3113095163 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0818017400 con 0x7f0828068630 2024-09-11T00:15:00.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.057+0000 7f082f200700 1 -- 172.21.15.111:0/3113095163 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f082819d060 con 0x7f0828068630 2024-09-11T00:15:00.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.058+0000 7f082f200700 1 -- 172.21.15.111:0/3113095163 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0828104570 con 0x7f0828068630 2024-09-11T00:15:00.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.059+0000 7f0824c00700 1 -- 172.21.15.111:0/3113095163 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f081800f460 con 0x7f0828068630 2024-09-11T00:15:00.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.060+0000 7f0824c00700 1 --2- 172.21.15.111:0/3113095163 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f080c07a6f0 0x7f080c07cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:00.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.060+0000 7f0824c00700 1 -- 172.21.15.111:0/3113095163 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f081809e740 con 0x7f0828068630 2024-09-11T00:15:00.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.060+0000 7f0827400700 1 --2- 172.21.15.111:0/3113095163 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f080c07a6f0 0x7f080c07cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:00.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.061+0000 7f0827400700 1 --2- 172.21.15.111:0/3113095163 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f080c07a6f0 0x7f080c07cba0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0814005950 tx=0x7f08140058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:00.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.064+0000 7f0824c00700 1 -- 172.21.15.111:0/3113095163 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f0818061ec0 con 0x7f0828068630 2024-09-11T00:15:00.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.308+0000 7f082f200700 1 -- 172.21.15.111:0/3113095163 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f082802cd40 con 0x7f080c07a6f0 2024-09-11T00:15:00.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.309+0000 7f0824c00700 1 -- 172.21.15.111:0/3113095163 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f082802cd40 con 0x7f080c07a6f0 2024-09-11T00:15:00.314 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.312+0000 7f082f200700 1 -- 172.21.15.111:0/3113095163 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f080c07a6f0 msgr2=0x7f080c07cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:00.314 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.312+0000 7f082f200700 1 --2- 172.21.15.111:0/3113095163 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f080c07a6f0 0x7f080c07cba0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0814005950 tx=0x7f08140058e0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.312+0000 7f082f200700 1 -- 172.21.15.111:0/3113095163 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0828068630 msgr2=0x7f0828197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:00.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.312+0000 7f082f200700 1 --2- 172.21.15.111:0/3113095163 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0828068630 0x7f0828197f40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f081800b5c0 tx=0x7f081800be20 comp rx=0 tx=0).stop 2024-09-11T00:15:00.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.313+0000 7f082f200700 1 -- 172.21.15.111:0/3113095163 shutdown_connections 2024-09-11T00:15:00.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.313+0000 7f082f200700 1 --2- 172.21.15.111:0/3113095163 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f080c07a6f0 0x7f080c07cba0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.313+0000 7f082f200700 1 --2- 172.21.15.111:0/3113095163 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0828068630 0x7f0828197f40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.313+0000 7f082f200700 1 --2- 172.21.15.111:0/3113095163 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0828068fd0 0x7f0828198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.313+0000 7f082f200700 1 -- 172.21.15.111:0/3113095163 >> 172.21.15.111:0/3113095163 conn(0x7f0828074f50 msgr2=0x7f08280fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:00.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.313+0000 7f082f200700 1 -- 172.21.15.111:0/3113095163 shutdown_connections 2024-09-11T00:15:00.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.313+0000 7f082f200700 1 -- 172.21.15.111:0/3113095163 wait complete. 2024-09-11T00:15:00.331 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:15:00.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.451+0000 7f2d91a00700 1 -- 172.21.15.111:0/490352013 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d8c100d50 msgr2=0x7f2d8c104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:00.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.451+0000 7f2d91a00700 1 --2- 172.21.15.111:0/490352013 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d8c100d50 0x7f2d8c104d20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2d78009910 tx=0x7f2d78009c20 comp rx=0 tx=0).stop 2024-09-11T00:15:00.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.452+0000 7f2d91a00700 1 -- 172.21.15.111:0/490352013 shutdown_connections 2024-09-11T00:15:00.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.452+0000 7f2d91a00700 1 --2- 172.21.15.111:0/490352013 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d8c100d50 0x7f2d8c104d20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.452+0000 7f2d91a00700 1 --2- 172.21.15.111:0/490352013 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d8c1003b0 0x7f2d8c100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.452+0000 7f2d91a00700 1 -- 172.21.15.111:0/490352013 >> 172.21.15.111:0/490352013 conn(0x7f2d8c0fbc30 msgr2=0x7f2d8c0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:00.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.452+0000 7f2d91a00700 1 -- 172.21.15.111:0/490352013 shutdown_connections 2024-09-11T00:15:00.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.452+0000 7f2d91a00700 1 -- 172.21.15.111:0/490352013 wait complete. 2024-09-11T00:15:00.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.453+0000 7f2d91a00700 1 Processor -- start 2024-09-11T00:15:00.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.453+0000 7f2d91a00700 1 -- start start 2024-09-11T00:15:00.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.453+0000 7f2d91a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d8c1003b0 0x7f2d8c198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:00.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.453+0000 7f2d91a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d8c100d50 0x7f2d8c198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:00.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.453+0000 7f2d91a00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c198c70 con 0x7f2d8c100d50 2024-09-11T00:15:00.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.453+0000 7f2d91a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c19ca00 con 0x7f2d8c1003b0 2024-09-11T00:15:00.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.453+0000 7f2d8a000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d8c100d50 0x7f2d8c198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:00.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.453+0000 7f2d8a000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d8c100d50 0x7f2d8c198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:35242/0 (socket says 172.21.15.111:35242) 2024-09-11T00:15:00.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.453+0000 7f2d8a000700 1 -- 172.21.15.111:0/4281699093 learned_addr learned my addr 172.21.15.111:0/4281699093 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:15:00.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.454+0000 7f2d8aa00700 1 --2- 172.21.15.111:0/4281699093 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d8c1003b0 0x7f2d8c198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:00.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.454+0000 7f2d8a000700 1 -- 172.21.15.111:0/4281699093 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d8c1003b0 msgr2=0x7f2d8c198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:00.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.454+0000 7f2d8a000700 1 --2- 172.21.15.111:0/4281699093 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d8c1003b0 0x7f2d8c198050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.454+0000 7f2d8a000700 1 -- 172.21.15.111:0/4281699093 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d780095f0 con 0x7f2d8c100d50 2024-09-11T00:15:00.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.454+0000 7f2d8aa00700 1 --2- 172.21.15.111:0/4281699093 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d8c1003b0 0x7f2d8c198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:15:00.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.454+0000 7f2d8a000700 1 --2- 172.21.15.111:0/4281699093 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d8c100d50 0x7f2d8c198590 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2d7800bda0 tx=0x7f2d7800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:00.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.454+0000 7f2d83400700 1 -- 172.21.15.111:0/4281699093 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d7801d070 con 0x7f2d8c100d50 2024-09-11T00:15:00.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.455+0000 7f2d83400700 1 -- 172.21.15.111:0/4281699093 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2d78004fb0 con 0x7f2d8c100d50 2024-09-11T00:15:00.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.455+0000 7f2d91a00700 1 -- 172.21.15.111:0/4281699093 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d8c19cc80 con 0x7f2d8c100d50 2024-09-11T00:15:00.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.455+0000 7f2d83400700 1 -- 172.21.15.111:0/4281699093 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d7800f460 con 0x7f2d8c100d50 2024-09-11T00:15:00.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.455+0000 7f2d91a00700 1 -- 172.21.15.111:0/4281699093 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d8c19d170 con 0x7f2d8c100d50 2024-09-11T00:15:00.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.456+0000 7f2d91a00700 1 -- 172.21.15.111:0/4281699093 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d8c1044a0 con 0x7f2d8c100d50 2024-09-11T00:15:00.459 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.457+0000 7f2d83400700 1 -- 172.21.15.111:0/4281699093 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f2d78022800 con 0x7f2d8c100d50 2024-09-11T00:15:00.460 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.458+0000 7f2d83400700 1 --2- 172.21.15.111:0/4281699093 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f2d7007a6f0 0x7f2d7007cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:00.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.458+0000 7f2d83400700 1 -- 172.21.15.111:0/4281699093 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f2d7809e850 con 0x7f2d8c100d50 2024-09-11T00:15:00.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.459+0000 7f2d8aa00700 1 --2- 172.21.15.111:0/4281699093 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f2d7007a6f0 0x7f2d7007cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:00.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.459+0000 7f2d8aa00700 1 --2- 172.21.15.111:0/4281699093 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f2d7007a6f0 0x7f2d7007cba0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c007900 tx=0x7f2d7c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:00.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.463+0000 7f2d83400700 1 -- 172.21.15.111:0/4281699093 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f2d78062000 con 0x7f2d8c100d50 2024-09-11T00:15:00.711 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.709+0000 7f2d91a00700 1 -- 172.21.15.111:0/4281699093 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d8c19d510 con 0x7f2d7007a6f0 2024-09-11T00:15:00.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.710+0000 7f2d83400700 1 -- 172.21.15.111:0/4281699093 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2d8c19d510 con 0x7f2d7007a6f0 2024-09-11T00:15:00.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.713+0000 7f2d91a00700 1 -- 172.21.15.111:0/4281699093 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f2d7007a6f0 msgr2=0x7f2d7007cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:00.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.713+0000 7f2d91a00700 1 --2- 172.21.15.111:0/4281699093 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f2d7007a6f0 0x7f2d7007cba0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c007900 tx=0x7f2d7c008040 comp rx=0 tx=0).stop 2024-09-11T00:15:00.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.713+0000 7f2d91a00700 1 -- 172.21.15.111:0/4281699093 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d8c100d50 msgr2=0x7f2d8c198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:00.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.713+0000 7f2d91a00700 1 --2- 172.21.15.111:0/4281699093 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d8c100d50 0x7f2d8c198590 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2d7800bda0 tx=0x7f2d7800be80 comp rx=0 tx=0).stop 2024-09-11T00:15:00.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.713+0000 7f2d91a00700 1 -- 172.21.15.111:0/4281699093 shutdown_connections 2024-09-11T00:15:00.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.713+0000 7f2d91a00700 1 --2- 172.21.15.111:0/4281699093 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f2d7007a6f0 0x7f2d7007cba0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.713+0000 7f2d91a00700 1 --2- 172.21.15.111:0/4281699093 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d8c1003b0 0x7f2d8c198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.713+0000 7f2d91a00700 1 --2- 172.21.15.111:0/4281699093 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d8c100d50 0x7f2d8c198590 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.713+0000 7f2d91a00700 1 -- 172.21.15.111:0/4281699093 >> 172.21.15.111:0/4281699093 conn(0x7f2d8c0fbc30 msgr2=0x7f2d8c0fd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:00.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.714+0000 7f2d91a00700 1 -- 172.21.15.111:0/4281699093 shutdown_connections 2024-09-11T00:15:00.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.714+0000 7f2d91a00700 1 -- 172.21.15.111:0/4281699093 wait complete. 2024-09-11T00:15:00.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.852+0000 7f7a84600700 1 -- 172.21.15.111:0/64973759 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7a7c0730f0 msgr2=0x7f7a7c0734c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:00.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.852+0000 7f7a84600700 1 --2- 172.21.15.111:0/64973759 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7a7c0730f0 0x7f7a7c0734c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7a70009910 tx=0x7f7a70009c20 comp rx=0 tx=0).stop 2024-09-11T00:15:00.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.852+0000 7f7a84600700 1 -- 172.21.15.111:0/64973759 shutdown_connections 2024-09-11T00:15:00.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.852+0000 7f7a84600700 1 --2- 172.21.15.111:0/64973759 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a7c073a00 0x7f7a7c110c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.855 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:00 smithi111 ceph-mon[90842]: pgmap v88: 65 pgs: 16 active+undersized, 6 active+undersized+degraded, 43 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 16/264 objects degraded (6.061%) 2024-09-11T00:15:00.855 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:00 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:00.855 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:00 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:15:00.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.852+0000 7f7a84600700 1 --2- 172.21.15.111:0/64973759 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7a7c0730f0 0x7f7a7c0734c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.852+0000 7f7a84600700 1 -- 172.21.15.111:0/64973759 >> 172.21.15.111:0/64973759 conn(0x7f7a7c0fbc30 msgr2=0x7f7a7c0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:00.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.852+0000 7f7a84600700 1 -- 172.21.15.111:0/64973759 shutdown_connections 2024-09-11T00:15:00.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.852+0000 7f7a84600700 1 -- 172.21.15.111:0/64973759 wait complete. 2024-09-11T00:15:00.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.853+0000 7f7a84600700 1 Processor -- start 2024-09-11T00:15:00.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.854+0000 7f7a84600700 1 -- start start 2024-09-11T00:15:00.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.854+0000 7f7a84600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7a7c0730f0 0x7f7a7c19c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:00.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.854+0000 7f7a84600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a7c073a00 0x7f7a7c19c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:00.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.854+0000 7f7a84600700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c19cea0 con 0x7f7a7c0730f0 2024-09-11T00:15:00.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.854+0000 7f7a84600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c1a0c30 con 0x7f7a7c073a00 2024-09-11T00:15:00.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.854+0000 7f7a81c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7a7c0730f0 0x7f7a7c19c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:00.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.854+0000 7f7a81c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7a7c0730f0 0x7f7a7c19c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:35256/0 (socket says 172.21.15.111:35256) 2024-09-11T00:15:00.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.854+0000 7f7a81c00700 1 -- 172.21.15.111:0/3337075408 learned_addr learned my addr 172.21.15.111:0/3337075408 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:15:00.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.855+0000 7f7a81200700 1 --2- 172.21.15.111:0/3337075408 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a7c073a00 0x7f7a7c19c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:00.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.855+0000 7f7a81c00700 1 -- 172.21.15.111:0/3337075408 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a7c073a00 msgr2=0x7f7a7c19c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:00.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.855+0000 7f7a81c00700 1 --2- 172.21.15.111:0/3337075408 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a7c073a00 0x7f7a7c19c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:00.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.855+0000 7f7a81c00700 1 -- 172.21.15.111:0/3337075408 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a700095f0 con 0x7f7a7c0730f0 2024-09-11T00:15:00.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.855+0000 7f7a81c00700 1 --2- 172.21.15.111:0/3337075408 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7a7c0730f0 0x7f7a7c19c280 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7a70005f50 tx=0x7f7a7000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:00.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.856+0000 7f7a7a000700 1 -- 172.21.15.111:0/3337075408 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a7001d070 con 0x7f7a7c0730f0 2024-09-11T00:15:00.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.856+0000 7f7a7a000700 1 -- 172.21.15.111:0/3337075408 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7a7000b610 con 0x7f7a7c0730f0 2024-09-11T00:15:00.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.856+0000 7f7a84600700 1 -- 172.21.15.111:0/3337075408 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a7c1a0eb0 con 0x7f7a7c0730f0 2024-09-11T00:15:00.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.856+0000 7f7a7a000700 1 -- 172.21.15.111:0/3337075408 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a70022470 con 0x7f7a7c0730f0 2024-09-11T00:15:00.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.856+0000 7f7a84600700 1 -- 172.21.15.111:0/3337075408 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a7c1a1400 con 0x7f7a7c0730f0 2024-09-11T00:15:00.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.857+0000 7f7a84600700 1 -- 172.21.15.111:0/3337075408 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a5c005320 con 0x7f7a7c0730f0 2024-09-11T00:15:00.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.858+0000 7f7a7a000700 1 -- 172.21.15.111:0/3337075408 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f7a70003680 con 0x7f7a7c0730f0 2024-09-11T00:15:00.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.859+0000 7f7a7a000700 1 --2- 172.21.15.111:0/3337075408 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f7a6407a6f0 0x7f7a6407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:00.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.859+0000 7f7a7a000700 1 -- 172.21.15.111:0/3337075408 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f7a7009e5d0 con 0x7f7a7c0730f0 2024-09-11T00:15:00.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.860+0000 7f7a81200700 1 --2- 172.21.15.111:0/3337075408 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f7a6407a6f0 0x7f7a6407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:00.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.860+0000 7f7a81200700 1 --2- 172.21.15.111:0/3337075408 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f7a6407a6f0 0x7f7a6407cba0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c19d8a0 tx=0x7f7a68009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:00.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:00.863+0000 7f7a7a000700 1 -- 172.21.15.111:0/3337075408 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f7a70061d50 con 0x7f7a7c0730f0 2024-09-11T00:15:01.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:00 smithi203 ceph-mon[69002]: pgmap v88: 65 pgs: 16 active+undersized, 6 active+undersized+degraded, 43 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 16/264 objects degraded (6.061%) 2024-09-11T00:15:01.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:00 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:01.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:00 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:15:01.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.132+0000 7f7a84600700 1 -- 172.21.15.111:0/3337075408 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a5c000bf0 con 0x7f7a6407a6f0 2024-09-11T00:15:01.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.142+0000 7f7a7a000700 1 -- 172.21.15.111:0/3337075408 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f7a5c000bf0 con 0x7f7a6407a6f0 2024-09-11T00:15:01.144 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:15:01.144 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (4m) 8s ago 18m 14.7M - 0.27.0 11f11916f8cd d6d3253e881f 2024-09-11T00:15:01.144 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (7m) 8s ago 18m 7982k - 18.2.0 dc2bc1663786 7c40af85314c 2024-09-11T00:15:01.145 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi203 smithi203 running (6m) 74s ago 17m 7730k - 18.2.0 dc2bc1663786 922e3261ff70 2024-09-11T00:15:01.145 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (85s) 8s ago 18m 6899k - 19.3.0-4854-g8f219c47 589dd18248e4 a9cacdb9a638 2024-09-11T00:15:01.145 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi203 smithi203 running (79s) 74s ago 17m 6899k - 19.3.0-4854-g8f219c47 589dd18248e4 d452d9dfa04b 2024-09-11T00:15:01.145 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (4m) 8s ago 17m 67.6M - c8b91775d855 7d3b50b5b59f 2024-09-11T00:15:01.145 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.gmgsay smithi111 running (11m) 8s ago 11m 18.0M - 18.2.0 dc2bc1663786 795e4ff0075c 2024-09-11T00:15:01.145 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.rucaba smithi111 running (11m) 8s ago 11m 18.0M - 18.2.0 dc2bc1663786 02885adac62c 2024-09-11T00:15:01.145 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.tcrqop smithi203 running (11m) 74s ago 11m 150M - 18.2.0 dc2bc1663786 4df492159bb4 2024-09-11T00:15:01.145 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.uqkbkn smithi203 running (10m) 74s ago 10m 17.6M - 18.2.0 dc2bc1663786 619aa58ea314 2024-09-11T00:15:01.145 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.ypucji smithi111 *:8443,9283,8765 running (6m) 8s ago 19m 513M - 19.3.0-4854-g8f219c47 589dd18248e4 07fa31f49618 2024-09-11T00:15:01.145 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi203.smuspl smithi203 *:8443,9283,8765 running (5m) 74s ago 16m 454M - 19.3.0-4854-g8f219c47 589dd18248e4 7e5a93a5ffa7 2024-09-11T00:15:01.145 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (2m) 8s ago 20m 47.0M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 3c29c070a612 2024-09-11T00:15:01.145 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi203 smithi203 running (2m) 74s ago 16m 36.1M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 45e8285e4b4d 2024-09-11T00:15:01.145 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (5m) 8s ago 18m 7658k - 1.7.0 72c9c2088986 ec478ea14488 2024-09-11T00:15:01.145 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi203 smithi203 *:9100 running (5m) 74s ago 17m 7209k - 1.7.0 72c9c2088986 54d461cde1bc 2024-09-11T00:15:01.146 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (54s) 8s ago 15m 87.5M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 d2f1a2312736 2024-09-11T00:15:01.146 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (15s) 8s ago 14m 10.4M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 19cf95ecca7d 2024-09-11T00:15:01.146 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (14m) 8s ago 14m 183M 1216M 18.2.0 dc2bc1663786 db175d4b09b9 2024-09-11T00:15:01.146 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi203 running (13m) 74s ago 13m 246M 2240M 18.2.0 dc2bc1663786 60b1cef7a70d 2024-09-11T00:15:01.146 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi203 running (13m) 74s ago 13m 209M 2240M 18.2.0 dc2bc1663786 769c7942c42b 2024-09-11T00:15:01.146 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi203 running (12m) 74s ago 12m 194M 2240M 18.2.0 dc2bc1663786 6d824001d40c 2024-09-11T00:15:01.146 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (4m) 8s ago 17m 58.0M - 2.51.0 1d3b7f56885b 3e72ac10983d 2024-09-11T00:15:01.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.144+0000 7f7a84600700 1 -- 172.21.15.111:0/3337075408 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f7a6407a6f0 msgr2=0x7f7a6407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:01.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.144+0000 7f7a84600700 1 --2- 172.21.15.111:0/3337075408 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f7a6407a6f0 0x7f7a6407cba0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c19d8a0 tx=0x7f7a68009260 comp rx=0 tx=0).stop 2024-09-11T00:15:01.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.144+0000 7f7a84600700 1 -- 172.21.15.111:0/3337075408 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7a7c0730f0 msgr2=0x7f7a7c19c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:01.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.144+0000 7f7a84600700 1 --2- 172.21.15.111:0/3337075408 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7a7c0730f0 0x7f7a7c19c280 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7a70005f50 tx=0x7f7a7000f690 comp rx=0 tx=0).stop 2024-09-11T00:15:01.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.145+0000 7f7a84600700 1 -- 172.21.15.111:0/3337075408 shutdown_connections 2024-09-11T00:15:01.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.145+0000 7f7a84600700 1 --2- 172.21.15.111:0/3337075408 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f7a6407a6f0 0x7f7a6407cba0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.145+0000 7f7a84600700 1 --2- 172.21.15.111:0/3337075408 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7a7c0730f0 0x7f7a7c19c280 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.145+0000 7f7a84600700 1 --2- 172.21.15.111:0/3337075408 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a7c073a00 0x7f7a7c19c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.145+0000 7f7a84600700 1 -- 172.21.15.111:0/3337075408 >> 172.21.15.111:0/3337075408 conn(0x7f7a7c0fbc30 msgr2=0x7f7a7c102730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:01.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.145+0000 7f7a84600700 1 -- 172.21.15.111:0/3337075408 shutdown_connections 2024-09-11T00:15:01.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.145+0000 7f7a84600700 1 -- 172.21.15.111:0/3337075408 wait complete. 2024-09-11T00:15:01.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.281+0000 7f8039000700 1 -- 172.21.15.111:0/1259487417 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80341003b0 msgr2=0x7f8034100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:01.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.281+0000 7f8039000700 1 --2- 172.21.15.111:0/1259487417 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80341003b0 0x7f8034100780 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8024009910 tx=0x7f8024009c20 comp rx=0 tx=0).stop 2024-09-11T00:15:01.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.281+0000 7f8039000700 1 -- 172.21.15.111:0/1259487417 shutdown_connections 2024-09-11T00:15:01.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.281+0000 7f8039000700 1 --2- 172.21.15.111:0/1259487417 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8034100d50 0x7f8034104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.281+0000 7f8039000700 1 --2- 172.21.15.111:0/1259487417 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80341003b0 0x7f8034100780 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.281+0000 7f8039000700 1 -- 172.21.15.111:0/1259487417 >> 172.21.15.111:0/1259487417 conn(0x7f80340fbc30 msgr2=0x7f80340fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:01.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.281+0000 7f8039000700 1 -- 172.21.15.111:0/1259487417 shutdown_connections 2024-09-11T00:15:01.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.281+0000 7f8039000700 1 -- 172.21.15.111:0/1259487417 wait complete. 2024-09-11T00:15:01.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.282+0000 7f8039000700 1 Processor -- start 2024-09-11T00:15:01.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.282+0000 7f8039000700 1 -- start start 2024-09-11T00:15:01.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.283+0000 7f8039000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f80341003b0 0x7f8034073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:01.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.283+0000 7f8039000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8034100d50 0x7f8034073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:01.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.283+0000 7f8039000700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8034073ad0 con 0x7f8034100d50 2024-09-11T00:15:01.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.283+0000 7f8039000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8034073c10 con 0x7f80341003b0 2024-09-11T00:15:01.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.283+0000 7f8031400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8034100d50 0x7f8034073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:01.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.283+0000 7f8031400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8034100d50 0x7f8034073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:35270/0 (socket says 172.21.15.111:35270) 2024-09-11T00:15:01.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.283+0000 7f8031400700 1 -- 172.21.15.111:0/1599550114 learned_addr learned my addr 172.21.15.111:0/1599550114 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:15:01.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.283+0000 7f8031e00700 1 --2- 172.21.15.111:0/1599550114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f80341003b0 0x7f8034073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:01.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.283+0000 7f8031400700 1 -- 172.21.15.111:0/1599550114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f80341003b0 msgr2=0x7f8034073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:01.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.283+0000 7f8031400700 1 --2- 172.21.15.111:0/1599550114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f80341003b0 0x7f8034073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.283+0000 7f8031400700 1 -- 172.21.15.111:0/1599550114 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80240095f0 con 0x7f8034100d50 2024-09-11T00:15:01.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.284+0000 7f8031400700 1 --2- 172.21.15.111:0/1599550114 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8034100d50 0x7f8034073590 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f802000d900 tx=0x7f802000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:01.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.284+0000 7f802aa00700 1 -- 172.21.15.111:0/1599550114 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8020009900 con 0x7f8034100d50 2024-09-11T00:15:01.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.284+0000 7f802aa00700 1 -- 172.21.15.111:0/1599550114 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8020010460 con 0x7f8034100d50 2024-09-11T00:15:01.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.284+0000 7f802aa00700 1 -- 172.21.15.111:0/1599550114 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f802000f5f0 con 0x7f8034100d50 2024-09-11T00:15:01.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.284+0000 7f8039000700 1 -- 172.21.15.111:0/1599550114 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80341a1ee0 con 0x7f8034100d50 2024-09-11T00:15:01.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.284+0000 7f8039000700 1 -- 172.21.15.111:0/1599550114 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80341a22f0 con 0x7f8034100d50 2024-09-11T00:15:01.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.285+0000 7f8039000700 1 -- 172.21.15.111:0/1599550114 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80341086c0 con 0x7f8034100d50 2024-09-11T00:15:01.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.287+0000 7f802aa00700 1 -- 172.21.15.111:0/1599550114 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f80200105d0 con 0x7f8034100d50 2024-09-11T00:15:01.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.287+0000 7f802aa00700 1 --2- 172.21.15.111:0/1599550114 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f801807a6f0 0x7f801807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:01.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.288+0000 7f802aa00700 1 -- 172.21.15.111:0/1599550114 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f802009ca00 con 0x7f8034100d50 2024-09-11T00:15:01.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.288+0000 7f8031e00700 1 --2- 172.21.15.111:0/1599550114 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f801807a6f0 0x7f801807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:01.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.288+0000 7f8031e00700 1 --2- 172.21.15.111:0/1599550114 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f801807a6f0 0x7f801807cba0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8024006010 tx=0x7f802401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:01.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.292+0000 7f802aa00700 1 -- 172.21.15.111:0/1599550114 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f8020060200 con 0x7f8034100d50 2024-09-11T00:15:01.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.608+0000 7f8039000700 1 -- 172.21.15.111:0/1599550114 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f803404ea50 con 0x7f8034100d50 2024-09-11T00:15:01.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.608+0000 7f802aa00700 1 -- 172.21.15.111:0/1599550114 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7f802009ae60 con 0x7f8034100d50 2024-09-11T00:15:01.610 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:15:01.610 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-11T00:15:01.611 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:15:01.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:15:01.611 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-11T00:15:01.611 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:15:01.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:15:01.611 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-11T00:15:01.611 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4, 2024-09-11T00:15:01.611 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:15:01.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:15:01.611 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-11T00:15:01.611 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-11T00:15:01.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:15:01.611 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-11T00:15:01.611 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 8, 2024-09-11T00:15:01.611 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 6 2024-09-11T00:15:01.612 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-11T00:15:01.612 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:15:01.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.611+0000 7f8039000700 1 -- 172.21.15.111:0/1599550114 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f801807a6f0 msgr2=0x7f801807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:01.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.611+0000 7f8039000700 1 --2- 172.21.15.111:0/1599550114 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f801807a6f0 0x7f801807cba0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8024006010 tx=0x7f802401a040 comp rx=0 tx=0).stop 2024-09-11T00:15:01.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.611+0000 7f8039000700 1 -- 172.21.15.111:0/1599550114 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8034100d50 msgr2=0x7f8034073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:01.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.611+0000 7f8039000700 1 --2- 172.21.15.111:0/1599550114 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8034100d50 0x7f8034073590 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f802000d900 tx=0x7f802000dc10 comp rx=0 tx=0).stop 2024-09-11T00:15:01.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.611+0000 7f8039000700 1 -- 172.21.15.111:0/1599550114 shutdown_connections 2024-09-11T00:15:01.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.611+0000 7f8039000700 1 --2- 172.21.15.111:0/1599550114 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f801807a6f0 0x7f801807cba0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.611+0000 7f8039000700 1 --2- 172.21.15.111:0/1599550114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f80341003b0 0x7f8034073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.611+0000 7f8039000700 1 --2- 172.21.15.111:0/1599550114 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8034100d50 0x7f8034073590 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.611+0000 7f8039000700 1 -- 172.21.15.111:0/1599550114 >> 172.21.15.111:0/1599550114 conn(0x7f80340fbc30 msgr2=0x7f80340fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:01.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.611+0000 7f8039000700 1 -- 172.21.15.111:0/1599550114 shutdown_connections 2024-09-11T00:15:01.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.611+0000 7f8039000700 1 -- 172.21.15.111:0/1599550114 wait complete. 2024-09-11T00:15:01.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.748+0000 7fb68ee00700 1 -- 172.21.15.111:0/1227522748 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb688100200 msgr2=0x7fb6881005d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:01.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.748+0000 7fb68ee00700 1 --2- 172.21.15.111:0/1227522748 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb688100200 0x7fb6881005d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb67c009910 tx=0x7fb67c009c20 comp rx=0 tx=0).stop 2024-09-11T00:15:01.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.748+0000 7fb68ee00700 1 -- 172.21.15.111:0/1227522748 shutdown_connections 2024-09-11T00:15:01.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.748+0000 7fb68ee00700 1 --2- 172.21.15.111:0/1227522748 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb688100ba0 0x7fb688104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.748+0000 7fb68ee00700 1 --2- 172.21.15.111:0/1227522748 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb688100200 0x7fb6881005d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.748+0000 7fb68ee00700 1 -- 172.21.15.111:0/1227522748 >> 172.21.15.111:0/1227522748 conn(0x7fb6880fba80 msgr2=0x7fb6880fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:01.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.748+0000 7fb68ee00700 1 -- 172.21.15.111:0/1227522748 shutdown_connections 2024-09-11T00:15:01.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.748+0000 7fb68ee00700 1 -- 172.21.15.111:0/1227522748 wait complete. 2024-09-11T00:15:01.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.749+0000 7fb68ee00700 1 Processor -- start 2024-09-11T00:15:01.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.749+0000 7fb68ee00700 1 -- start start 2024-09-11T00:15:01.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.749+0000 7fb68ee00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb688100200 0x7fb68819b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:01.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.749+0000 7fb68ee00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb688100ba0 0x7fb68819bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:01.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.749+0000 7fb68ee00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68819c5a0 con 0x7fb688100200 2024-09-11T00:15:01.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.749+0000 7fb68ee00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb688195a50 con 0x7fb688100ba0 2024-09-11T00:15:01.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.750+0000 7fb68da00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb688100200 0x7fb68819b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:01.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.750+0000 7fb68da00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb688100200 0x7fb68819b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:35290/0 (socket says 172.21.15.111:35290) 2024-09-11T00:15:01.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.750+0000 7fb68da00700 1 -- 172.21.15.111:0/4280067915 learned_addr learned my addr 172.21.15.111:0/4280067915 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:15:01.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.750+0000 7fb68da00700 1 -- 172.21.15.111:0/4280067915 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb688100ba0 msgr2=0x7fb68819bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:01.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.750+0000 7fb68da00700 1 --2- 172.21.15.111:0/4280067915 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb688100ba0 0x7fb68819bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.750+0000 7fb68da00700 1 -- 172.21.15.111:0/4280067915 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67c0095f0 con 0x7fb688100200 2024-09-11T00:15:01.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.750+0000 7fb68da00700 1 --2- 172.21.15.111:0/4280067915 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb688100200 0x7fb68819b9d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb67c0092e0 tx=0x7fb67c00f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:01.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.751+0000 7fb686000700 1 -- 172.21.15.111:0/4280067915 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb67c01d070 con 0x7fb688100200 2024-09-11T00:15:01.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.751+0000 7fb686000700 1 -- 172.21.15.111:0/4280067915 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb67c0052a0 con 0x7fb688100200 2024-09-11T00:15:01.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.751+0000 7fb68ee00700 1 -- 172.21.15.111:0/4280067915 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb688195cd0 con 0x7fb688100200 2024-09-11T00:15:01.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.751+0000 7fb686000700 1 -- 172.21.15.111:0/4280067915 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb67c017630 con 0x7fb688100200 2024-09-11T00:15:01.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.751+0000 7fb68ee00700 1 -- 172.21.15.111:0/4280067915 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6881961c0 con 0x7fb688100200 2024-09-11T00:15:01.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.752+0000 7fb68ee00700 1 -- 172.21.15.111:0/4280067915 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb688108510 con 0x7fb688100200 2024-09-11T00:15:01.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.753+0000 7fb686000700 1 -- 172.21.15.111:0/4280067915 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fb67c0178f0 con 0x7fb688100200 2024-09-11T00:15:01.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.754+0000 7fb686000700 1 --2- 172.21.15.111:0/4280067915 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb67007a6f0 0x7fb67007cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:01.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.754+0000 7fb686000700 1 -- 172.21.15.111:0/4280067915 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb67c09e6a0 con 0x7fb688100200 2024-09-11T00:15:01.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.754+0000 7fb68d000700 1 --2- 172.21.15.111:0/4280067915 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb67007a6f0 0x7fb67007cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:01.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.755+0000 7fb68d000700 1 --2- 172.21.15.111:0/4280067915 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb67007a6f0 0x7fb67007cba0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb674005950 tx=0x7fb6740058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:01.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:01.758+0000 7fb686000700 1 -- 172.21.15.111:0/4280067915 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fb67c061da0 con 0x7fb688100200 2024-09-11T00:15:01.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:01 smithi111 ceph-mon[90842]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:01.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:01 smithi111 ceph-mon[90842]: Health check update: Degraded data redundancy: 16/264 objects degraded (6.061%), 6 pgs degraded (PG_DEGRADED) 2024-09-11T00:15:02.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.028+0000 7fb68ee00700 1 -- 172.21.15.111:0/4280067915 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb68802cc30 con 0x7fb688100200 2024-09-11T00:15:02.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.028+0000 7fb686000700 1 -- 172.21.15.111:0/4280067915 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1921 (secure 0 0 0) 0x7fb67c003e60 con 0x7fb688100200 2024-09-11T00:15:02.031 INFO:teuthology.orchestra.run.smithi111.stdout:e15 2024-09-11T00:15:02.031 INFO:teuthology.orchestra.run.smithi111.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-11T00:15:02.031 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T00:15:02.031 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:15:02.031 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-11T00:15:02.031 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:15:02.031 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-11T00:15:02.031 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-11T00:15:02.031 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 14 2024-09-11T00:15:02.032 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-11T00:15:02.032 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-11T00:03:47.950356+0000 2024-09-11T00:15:02.032 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-11T00:04:06.275905+0000 2024-09-11T00:15:02.032 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-11T00:15:02.032 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-11T00:15:02.032 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-11T00:15:02.032 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-11T00:15:02.032 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-11T00:15:02.032 INFO:teuthology.orchestra.run.smithi111.stdout:max_xattr_size 65536 2024-09-11T00:15:02.032 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-11T00:15:02.032 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-11T00:15:02.032 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 47 2024-09-11T00:15:02.032 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:15:02.032 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-11T00:15:02.033 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-11T00:15:02.033 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=24363} 2024-09-11T00:15:02.033 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-11T00:15:02.033 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-11T00:15:02.033 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-11T00:15:02.033 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-11T00:15:02.033 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-11T00:15:02.033 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data enabled 2024-09-11T00:15:02.033 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-11T00:15:02.033 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-11T00:15:02.033 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 1 2024-09-11T00:15:02.033 INFO:teuthology.orchestra.run.smithi111.stdout:qdb_cluster leader: 0 members: 2024-09-11T00:15:02.034 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.tcrqop{0:24363} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.203:6824/3082736449,v1:172.21.15.203:6825/3082736449] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:15:02.034 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:15:02.034 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:15:02.034 INFO:teuthology.orchestra.run.smithi111.stdout:Standby daemons: 2024-09-11T00:15:02.034 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:15:02.034 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.rucaba{-1:14554} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6828/2045133285,v1:172.21.15.111:6829/2045133285] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:15:02.034 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.gmgsay{-1:14566} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.111:6826/1122545830,v1:172.21.15.111:6827/1122545830] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:15:02.034 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.uqkbkn{-1:24379} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.203:6826/695613114,v1:172.21.15.203:6827/695613114] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:15:02.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.031+0000 7fb68ee00700 1 -- 172.21.15.111:0/4280067915 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb67007a6f0 msgr2=0x7fb67007cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.031+0000 7fb68ee00700 1 --2- 172.21.15.111:0/4280067915 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb67007a6f0 0x7fb67007cba0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb674005950 tx=0x7fb6740058e0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.031+0000 7fb68ee00700 1 -- 172.21.15.111:0/4280067915 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb688100200 msgr2=0x7fb68819b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.031+0000 7fb68ee00700 1 --2- 172.21.15.111:0/4280067915 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb688100200 0x7fb68819b9d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb67c0092e0 tx=0x7fb67c00f460 comp rx=0 tx=0).stop 2024-09-11T00:15:02.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.031+0000 7fb68ee00700 1 -- 172.21.15.111:0/4280067915 shutdown_connections 2024-09-11T00:15:02.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.031+0000 7fb68ee00700 1 --2- 172.21.15.111:0/4280067915 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb67007a6f0 0x7fb67007cba0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.031+0000 7fb68ee00700 1 --2- 172.21.15.111:0/4280067915 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb688100200 0x7fb68819b9d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.031+0000 7fb68ee00700 1 --2- 172.21.15.111:0/4280067915 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb688100ba0 0x7fb68819bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.031+0000 7fb68ee00700 1 -- 172.21.15.111:0/4280067915 >> 172.21.15.111:0/4280067915 conn(0x7fb6880fba80 msgr2=0x7fb6880fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:02.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.031+0000 7fb68ee00700 1 -- 172.21.15.111:0/4280067915 shutdown_connections 2024-09-11T00:15:02.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.031+0000 7fb68ee00700 1 -- 172.21.15.111:0/4280067915 wait complete. 2024-09-11T00:15:02.036 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 15 2024-09-11T00:15:02.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:01 smithi203 ceph-mon[69002]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:02.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:01 smithi203 ceph-mon[69002]: Health check update: Degraded data redundancy: 16/264 objects degraded (6.061%), 6 pgs degraded (PG_DEGRADED) 2024-09-11T00:15:02.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.172+0000 7fc7fb200700 1 -- 172.21.15.111:0/1708756187 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc7fc100ba0 msgr2=0x7fc7fc104b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.172+0000 7fc7fb200700 1 --2- 172.21.15.111:0/1708756187 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc7fc100ba0 0x7fc7fc104b70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8009910 tx=0x7fc7e8009c20 comp rx=0 tx=0).stop 2024-09-11T00:15:02.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.172+0000 7fc7fb200700 1 -- 172.21.15.111:0/1708756187 shutdown_connections 2024-09-11T00:15:02.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.172+0000 7fc7fb200700 1 --2- 172.21.15.111:0/1708756187 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc7fc100ba0 0x7fc7fc104b70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.172+0000 7fc7fb200700 1 --2- 172.21.15.111:0/1708756187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7fc100200 0x7fc7fc1005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.172+0000 7fc7fb200700 1 -- 172.21.15.111:0/1708756187 >> 172.21.15.111:0/1708756187 conn(0x7fc7fc0fba80 msgr2=0x7fc7fc0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:02.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.172+0000 7fc7fb200700 1 -- 172.21.15.111:0/1708756187 shutdown_connections 2024-09-11T00:15:02.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.172+0000 7fc7fb200700 1 -- 172.21.15.111:0/1708756187 wait complete. 2024-09-11T00:15:02.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.173+0000 7fc7fb200700 1 Processor -- start 2024-09-11T00:15:02.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.173+0000 7fc7fb200700 1 -- start start 2024-09-11T00:15:02.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.174+0000 7fc7fb200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7fc100200 0x7fc7fc073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.174+0000 7fc7fb200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc7fc100ba0 0x7fc7fc073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.174+0000 7fc7fb200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc073ad0 con 0x7fc7fc100ba0 2024-09-11T00:15:02.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.174+0000 7fc7fb200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc073c10 con 0x7fc7fc100200 2024-09-11T00:15:02.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.174+0000 7fc7f9400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc7fc100ba0 0x7fc7fc073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.174+0000 7fc7f9400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc7fc100ba0 0x7fc7fc073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:35306/0 (socket says 172.21.15.111:35306) 2024-09-11T00:15:02.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.174+0000 7fc7f9400700 1 -- 172.21.15.111:0/3069981127 learned_addr learned my addr 172.21.15.111:0/3069981127 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:15:02.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.174+0000 7fc7f9e00700 1 --2- 172.21.15.111:0/3069981127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7fc100200 0x7fc7fc073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.175+0000 7fc7f9400700 1 -- 172.21.15.111:0/3069981127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7fc100200 msgr2=0x7fc7fc073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.175+0000 7fc7f9400700 1 --2- 172.21.15.111:0/3069981127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7fc100200 0x7fc7fc073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.175+0000 7fc7f9400700 1 -- 172.21.15.111:0/3069981127 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e80095f0 con 0x7fc7fc100ba0 2024-09-11T00:15:02.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.175+0000 7fc7f9400700 1 --2- 172.21.15.111:0/3069981127 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc7fc100ba0 0x7fc7fc073590 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800bda0 tx=0x7fc7e800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:02.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.175+0000 7fc7f2a00700 1 -- 172.21.15.111:0/3069981127 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7e801d070 con 0x7fc7fc100ba0 2024-09-11T00:15:02.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.175+0000 7fc7f2a00700 1 -- 172.21.15.111:0/3069981127 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc7e800f460 con 0x7fc7fc100ba0 2024-09-11T00:15:02.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.175+0000 7fc7f2a00700 1 -- 172.21.15.111:0/3069981127 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7e8017630 con 0x7fc7fc100ba0 2024-09-11T00:15:02.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.175+0000 7fc7fb200700 1 -- 172.21.15.111:0/3069981127 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7fc073e90 con 0x7fc7fc100ba0 2024-09-11T00:15:02.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.175+0000 7fc7fb200700 1 -- 172.21.15.111:0/3069981127 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7fc1a20f0 con 0x7fc7fc100ba0 2024-09-11T00:15:02.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.176+0000 7fc7fb200700 1 -- 172.21.15.111:0/3069981127 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7fc04f2a0 con 0x7fc7fc100ba0 2024-09-11T00:15:02.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.177+0000 7fc7f2a00700 1 -- 172.21.15.111:0/3069981127 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fc7e800fab0 con 0x7fc7fc100ba0 2024-09-11T00:15:02.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.178+0000 7fc7f2a00700 1 --2- 172.21.15.111:0/3069981127 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc7e007a6f0 0x7fc7e007cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.181 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.179+0000 7fc7f2a00700 1 -- 172.21.15.111:0/3069981127 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fc7e809e730 con 0x7fc7fc100ba0 2024-09-11T00:15:02.181 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.179+0000 7fc7f9e00700 1 --2- 172.21.15.111:0/3069981127 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc7e007a6f0 0x7fc7e007cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.181 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.179+0000 7fc7f9e00700 1 --2- 172.21.15.111:0/3069981127 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc7e007a6f0 0x7fc7e007cba0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec005950 tx=0x7fc7ec00a300 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:02.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.183+0000 7fc7f2a00700 1 -- 172.21.15.111:0/3069981127 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fc7e8061e30 con 0x7fc7fc100ba0 2024-09-11T00:15:02.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.426+0000 7fc7fb200700 1 -- 172.21.15.111:0/3069981127 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7fc0fddd0 con 0x7fc7e007a6f0 2024-09-11T00:15:02.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.427+0000 7fc7f2a00700 1 -- 172.21.15.111:0/3069981127 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc7fc0fddd0 con 0x7fc7e007a6f0 2024-09-11T00:15:02.429 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:15:02.429 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e", 2024-09-11T00:15:02.430 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-11T00:15:02.430 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-11T00:15:02.430 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-11T00:15:02.430 INFO:teuthology.orchestra.run.smithi111.stdout: "crash", 2024-09-11T00:15:02.430 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr", 2024-09-11T00:15:02.430 INFO:teuthology.orchestra.run.smithi111.stdout: "mon" 2024-09-11T00:15:02.430 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-11T00:15:02.430 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "8/23 daemons upgraded", 2024-09-11T00:15:02.430 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading osd daemons", 2024-09-11T00:15:02.430 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-11T00:15:02.430 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:15:02.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.430+0000 7fc7fb200700 1 -- 172.21.15.111:0/3069981127 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc7e007a6f0 msgr2=0x7fc7e007cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.430+0000 7fc7fb200700 1 --2- 172.21.15.111:0/3069981127 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc7e007a6f0 0x7fc7e007cba0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec005950 tx=0x7fc7ec00a300 comp rx=0 tx=0).stop 2024-09-11T00:15:02.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.430+0000 7fc7fb200700 1 -- 172.21.15.111:0/3069981127 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc7fc100ba0 msgr2=0x7fc7fc073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.430+0000 7fc7fb200700 1 --2- 172.21.15.111:0/3069981127 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc7fc100ba0 0x7fc7fc073590 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800bda0 tx=0x7fc7e800bdd0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.430+0000 7fc7fb200700 1 -- 172.21.15.111:0/3069981127 shutdown_connections 2024-09-11T00:15:02.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.430+0000 7fc7fb200700 1 --2- 172.21.15.111:0/3069981127 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc7e007a6f0 0x7fc7e007cba0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.430+0000 7fc7fb200700 1 --2- 172.21.15.111:0/3069981127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7fc100200 0x7fc7fc073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.430+0000 7fc7fb200700 1 --2- 172.21.15.111:0/3069981127 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc7fc100ba0 0x7fc7fc073590 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.430+0000 7fc7fb200700 1 -- 172.21.15.111:0/3069981127 >> 172.21.15.111:0/3069981127 conn(0x7fc7fc0fba80 msgr2=0x7fc7fc0fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:02.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.430+0000 7fc7fb200700 1 -- 172.21.15.111:0/3069981127 shutdown_connections 2024-09-11T00:15:02.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.430+0000 7fc7fb200700 1 -- 172.21.15.111:0/3069981127 wait complete. 2024-09-11T00:15:02.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.568+0000 7fcfc1400700 1 -- 172.21.15.111:0/360789820 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcfbc102fa0 msgr2=0x7fcfbc106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.568+0000 7fcfc1400700 1 --2- 172.21.15.111:0/360789820 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcfbc102fa0 0x7fcfbc106f70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4009910 tx=0x7fcfa4009c20 comp rx=0 tx=0).stop 2024-09-11T00:15:02.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.568+0000 7fcfc1400700 1 -- 172.21.15.111:0/360789820 shutdown_connections 2024-09-11T00:15:02.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.568+0000 7fcfc1400700 1 --2- 172.21.15.111:0/360789820 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcfbc102fa0 0x7fcfbc106f70 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.568+0000 7fcfc1400700 1 --2- 172.21.15.111:0/360789820 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcfbc102600 0x7fcfbc1029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.568+0000 7fcfc1400700 1 -- 172.21.15.111:0/360789820 >> 172.21.15.111:0/360789820 conn(0x7fcfbc0fdec0 msgr2=0x7fcfbc1002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:02.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.568+0000 7fcfc1400700 1 -- 172.21.15.111:0/360789820 shutdown_connections 2024-09-11T00:15:02.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.568+0000 7fcfc1400700 1 -- 172.21.15.111:0/360789820 wait complete. 2024-09-11T00:15:02.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.569+0000 7fcfc1400700 1 Processor -- start 2024-09-11T00:15:02.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.570+0000 7fcfc1400700 1 -- start start 2024-09-11T00:15:02.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.570+0000 7fcfc1400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcfbc102600 0x7fcfbc197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.570+0000 7fcfc1400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcfbc102fa0 0x7fcfbc198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.570+0000 7fcfc1400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc198c10 con 0x7fcfbc102600 2024-09-11T00:15:02.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.570+0000 7fcfc1400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc19c9a0 con 0x7fcfbc102fa0 2024-09-11T00:15:02.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.570+0000 7fcfba800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcfbc102600 0x7fcfbc197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.570+0000 7fcfba800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcfbc102600 0x7fcfbc197ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:35330/0 (socket says 172.21.15.111:35330) 2024-09-11T00:15:02.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.571+0000 7fcfba800700 1 -- 172.21.15.111:0/2974995314 learned_addr learned my addr 172.21.15.111:0/2974995314 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:15:02.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.571+0000 7fcfb3e00700 1 --2- 172.21.15.111:0/2974995314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcfbc102fa0 0x7fcfbc198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.571+0000 7fcfba800700 1 -- 172.21.15.111:0/2974995314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcfbc102fa0 msgr2=0x7fcfbc198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.571+0000 7fcfba800700 1 --2- 172.21.15.111:0/2974995314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcfbc102fa0 0x7fcfbc198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.571+0000 7fcfba800700 1 -- 172.21.15.111:0/2974995314 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa40095f0 con 0x7fcfbc102600 2024-09-11T00:15:02.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.571+0000 7fcfba800700 1 --2- 172.21.15.111:0/2974995314 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcfbc102600 0x7fcfbc197ff0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00e920 tx=0x7fcfac00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:02.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.571+0000 7fcfb3400700 1 -- 172.21.15.111:0/2974995314 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfac00c9d0 con 0x7fcfbc102600 2024-09-11T00:15:02.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.572+0000 7fcfb3400700 1 -- 172.21.15.111:0/2974995314 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcfac010430 con 0x7fcfbc102600 2024-09-11T00:15:02.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.572+0000 7fcfb3400700 1 -- 172.21.15.111:0/2974995314 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfac018630 con 0x7fcfbc102600 2024-09-11T00:15:02.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.572+0000 7fcfc1400700 1 -- 172.21.15.111:0/2974995314 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfbc19cc80 con 0x7fcfbc102600 2024-09-11T00:15:02.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.572+0000 7fcfc1400700 1 -- 172.21.15.111:0/2974995314 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfbc19d1a0 con 0x7fcfbc102600 2024-09-11T00:15:02.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.573+0000 7fcfc1400700 1 -- 172.21.15.111:0/2974995314 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfbc04ea50 con 0x7fcfbc102600 2024-09-11T00:15:02.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.574+0000 7fcfb3400700 1 -- 172.21.15.111:0/2974995314 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fcfac0105a0 con 0x7fcfbc102600 2024-09-11T00:15:02.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.575+0000 7fcfb3400700 1 --2- 172.21.15.111:0/2974995314 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fcfa007a6f0 0x7fcfa007cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:02.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.575+0000 7fcfb3400700 1 -- 172.21.15.111:0/2974995314 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fcfac014070 con 0x7fcfbc102600 2024-09-11T00:15:02.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.575+0000 7fcfb3e00700 1 --2- 172.21.15.111:0/2974995314 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fcfa007a6f0 0x7fcfa007cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:02.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.576+0000 7fcfb3e00700 1 --2- 172.21.15.111:0/2974995314 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fcfa007a6f0 0x7fcfa007cba0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4009fd0 tx=0x7fcfa4005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:02.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.581+0000 7fcfb3400700 1 -- 172.21.15.111:0/2974995314 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fcfac060c70 con 0x7fcfbc102600 2024-09-11T00:15:02.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.891+0000 7fcfc1400700 1 -- 172.21.15.111:0/2974995314 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcfbc199350 con 0x7fcfbc102600 2024-09-11T00:15:02.893 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:02 smithi111 ceph-mon[90842]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:02.893 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:02 smithi111 ceph-mon[90842]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:02.894 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:02 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/1599550114' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:15:02.894 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:02 smithi111 ceph-mon[90842]: pgmap v89: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:02.894 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:02 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/4280067915' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:15:02.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.891+0000 7fcfb3400700 1 -- 172.21.15.111:0/2974995314 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fcfac063d90 con 0x7fcfbc102600 2024-09-11T00:15:02.894 INFO:teuthology.orchestra.run.smithi111.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-11T00:15:02.894 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-11T00:15:02.894 INFO:teuthology.orchestra.run.smithi111.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-11T00:15:02.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.895+0000 7fcfc1400700 1 -- 172.21.15.111:0/2974995314 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fcfa007a6f0 msgr2=0x7fcfa007cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.895+0000 7fcfc1400700 1 --2- 172.21.15.111:0/2974995314 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fcfa007a6f0 0x7fcfa007cba0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4009fd0 tx=0x7fcfa4005a90 comp rx=0 tx=0).stop 2024-09-11T00:15:02.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.895+0000 7fcfc1400700 1 -- 172.21.15.111:0/2974995314 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcfbc102600 msgr2=0x7fcfbc197ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:02.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.895+0000 7fcfc1400700 1 --2- 172.21.15.111:0/2974995314 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcfbc102600 0x7fcfbc197ff0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00e920 tx=0x7fcfac00ec30 comp rx=0 tx=0).stop 2024-09-11T00:15:02.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.895+0000 7fcfc1400700 1 -- 172.21.15.111:0/2974995314 shutdown_connections 2024-09-11T00:15:02.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.895+0000 7fcfc1400700 1 --2- 172.21.15.111:0/2974995314 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fcfa007a6f0 0x7fcfa007cba0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.895+0000 7fcfc1400700 1 --2- 172.21.15.111:0/2974995314 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcfbc102600 0x7fcfbc197ff0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.895+0000 7fcfc1400700 1 --2- 172.21.15.111:0/2974995314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcfbc102fa0 0x7fcfbc198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:02.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.895+0000 7fcfc1400700 1 -- 172.21.15.111:0/2974995314 >> 172.21.15.111:0/2974995314 conn(0x7fcfbc0fdec0 msgr2=0x7fcfbc0ff4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:02.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.895+0000 7fcfc1400700 1 -- 172.21.15.111:0/2974995314 shutdown_connections 2024-09-11T00:15:02.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:02.895+0000 7fcfc1400700 1 -- 172.21.15.111:0/2974995314 wait complete. 2024-09-11T00:15:02.946 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:02 smithi203 ceph-mon[69002]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:02.946 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:02 smithi203 ceph-mon[69002]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:02.946 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:02 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/1599550114' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:15:02.946 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:02 smithi203 ceph-mon[69002]: pgmap v89: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:02.947 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:02 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/4280067915' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:15:03.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:03 smithi111 ceph-mon[90842]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:03.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:03 smithi111 ceph-mon[90842]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/264 objects degraded (6.061%), 6 pgs degraded) 2024-09-11T00:15:03.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:03 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/2974995314' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-11T00:15:04.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:03 smithi203 ceph-mon[69002]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:04.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:03 smithi203 ceph-mon[69002]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/264 objects degraded (6.061%), 6 pgs degraded) 2024-09-11T00:15:04.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:03 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/2974995314' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-11T00:15:04.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:04 smithi111 ceph-mon[90842]: pgmap v90: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:05.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:04 smithi203 ceph-mon[69002]: pgmap v90: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:06.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:05 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:06.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:05 smithi203 ceph-mon[69002]: pgmap v91: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:06.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:05 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:06.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:05 smithi111 ceph-mon[90842]: pgmap v91: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:09.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:08 smithi203 ceph-mon[69002]: pgmap v92: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:09.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:08 smithi111 ceph-mon[90842]: pgmap v92: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:11.007 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:10 smithi111 ceph-mon[90842]: pgmap v93: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:11.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:10 smithi203 ceph-mon[69002]: pgmap v93: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:13.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:12 smithi203 ceph-mon[69002]: pgmap v94: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:13.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:12 smithi111 ceph-mon[90842]: pgmap v94: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:13.771 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:13 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-11T00:15:14.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:13 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-11T00:15:14.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:14 smithi111 ceph-mon[90842]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-11T00:15:14.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:14 smithi111 ceph-mon[90842]: Upgrade: osd.2 is safe to restart 2024-09-11T00:15:14.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:14 smithi111 ceph-mon[90842]: pgmap v95: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:14.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:14 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:14.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:14 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-11T00:15:14.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:14 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:15:15.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:14 smithi203 ceph-mon[69002]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-11T00:15:15.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:14 smithi203 ceph-mon[69002]: Upgrade: osd.2 is safe to restart 2024-09-11T00:15:15.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:14 smithi203 ceph-mon[69002]: pgmap v95: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:15.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:14 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:15.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:14 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-11T00:15:15.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:14 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:15:15.823 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:15 smithi111 ceph-mon[90842]: Upgrade: Updating osd.2 2024-09-11T00:15:15.824 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:15 smithi111 ceph-mon[90842]: Deploying daemon osd.2 on smithi111 2024-09-11T00:15:15.824 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:15 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:15.824 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:15 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:15:16.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:15 smithi203 ceph-mon[69002]: Upgrade: Updating osd.2 2024-09-11T00:15:16.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:15 smithi203 ceph-mon[69002]: Deploying daemon osd.2 on smithi111 2024-09-11T00:15:16.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:15 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:16.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:15 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:15:16.851 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:16 smithi111 ceph-mon[90842]: pgmap v96: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:17.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:16 smithi203 ceph-mon[69002]: pgmap v96: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:18.653 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:18 smithi111 systemd[1]: Stopping Ceph osd.2 for 03107fbe-6fd0-11ef-bcea-c7b262605968... 2024-09-11T00:15:19.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:18 smithi203 ceph-mon[69002]: pgmap v97: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:19.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:18 smithi203 ceph-mon[69002]: osd.2 marked itself down and dead 2024-09-11T00:15:19.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:18 smithi111 ceph-mon[90842]: pgmap v97: 65 pgs: 65 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:19.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:18 smithi111 ceph-mon[90842]: osd.2 marked itself down and dead 2024-09-11T00:15:19.153 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:18 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2[56116]: 2024-09-11T00:15:18.677+0000 7fcb28e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:15:19.153 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:18 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2[56116]: 2024-09-11T00:15:18.677+0000 7fcb28e00700 -1 osd.2 60 *** Got signal Terminated *** 2024-09-11T00:15:19.153 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:18 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2[56116]: 2024-09-11T00:15:18.677+0000 7fcb28e00700 -1 osd.2 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:15:19.484 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:19 smithi111 podman[113117]: 2024-09-11 00:15:19.219988911 +0000 UTC m=+0.647664585 container died db175d4b09b974c3163e205c3c8def1a2b2a11f185758b864f1db5b9733682ee (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=HEAD, GIT_BRANCH=HEAD) 2024-09-11T00:15:19.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:19 smithi111 ceph-mon[90842]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-11T00:15:19.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:19 smithi111 ceph-mon[90842]: osdmap e61: 6 total, 5 up, 6 in 2024-09-11T00:15:19.903 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:19 smithi111 podman[113117]: 2024-09-11 00:15:19.68293366 +0000 UTC m=+1.110609319 container cleanup db175d4b09b974c3163e205c3c8def1a2b2a11f185758b864f1db5b9733682ee (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.build-date=20231212, ceph=True, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-09-11T00:15:19.903 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:19 smithi111 bash[113117]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2 2024-09-11T00:15:20.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:19 smithi203 ceph-mon[69002]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-11T00:15:20.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:19 smithi203 ceph-mon[69002]: osdmap e61: 6 total, 5 up, 6 in 2024-09-11T00:15:20.402 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:19 smithi111 podman[113136]: 2024-09-11 00:15:19.951587794 +0000 UTC m=+0.722787916 container remove db175d4b09b974c3163e205c3c8def1a2b2a11f185758b864f1db5b9733682ee (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-11T00:15:20.806 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:20 smithi111 ceph-mon[90842]: pgmap v99: 65 pgs: 7 peering, 5 stale+active+clean, 53 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:20.806 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:20 smithi111 ceph-mon[90842]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-09-11T00:15:20.806 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:20 smithi111 ceph-mon[90842]: osdmap e62: 6 total, 5 up, 6 in 2024-09-11T00:15:20.806 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:20 smithi111 podman[113224]: 2024-09-11 00:15:20.398664252 +0000 UTC m=+0.027175301 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:15:20.807 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:20 smithi111 podman[113224]: 2024-09-11 00:15:20.510628935 +0000 UTC m=+0.139139977 container create 66bd74cd956bec2004ece37761fc32fbed728d8481e54a2aa509ab86c5031af3 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-11T00:15:20.807 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:20 smithi111 podman[113224]: 2024-09-11 00:15:20.805144666 +0000 UTC m=+0.433655729 container init 66bd74cd956bec2004ece37761fc32fbed728d8481e54a2aa509ab86c5031af3 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True) 2024-09-11T00:15:21.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:20 smithi203 ceph-mon[69002]: pgmap v99: 65 pgs: 7 peering, 5 stale+active+clean, 53 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:21.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:20 smithi203 ceph-mon[69002]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-09-11T00:15:21.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:20 smithi203 ceph-mon[69002]: osdmap e62: 6 total, 5 up, 6 in 2024-09-11T00:15:21.074 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:20 smithi111 podman[113224]: 2024-09-11 00:15:20.812163501 +0000 UTC m=+0.440674547 container start 66bd74cd956bec2004ece37761fc32fbed728d8481e54a2aa509ab86c5031af3 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:15:21.074 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:20 smithi111 podman[113224]: 2024-09-11 00:15:20.888266528 +0000 UTC m=+0.516777580 container attach 66bd74cd956bec2004ece37761fc32fbed728d8481e54a2aa509ab86c5031af3 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-11T00:15:21.402 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:21 smithi111 podman[113224]: 2024-09-11 00:15:21.073745815 +0000 UTC m=+0.702256866 container died 66bd74cd956bec2004ece37761fc32fbed728d8481e54a2aa509ab86c5031af3 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True) 2024-09-11T00:15:22.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:21 smithi203 ceph-mon[69002]: pgmap v101: 65 pgs: 11 active+undersized, 7 peering, 9 active+undersized+degraded, 38 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 20/264 objects degraded (7.576%) 2024-09-11T00:15:22.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:21 smithi203 ceph-mon[69002]: Health check failed: Degraded data redundancy: 20/264 objects degraded (7.576%), 9 pgs degraded (PG_DEGRADED) 2024-09-11T00:15:22.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:21 smithi111 ceph-mon[90842]: pgmap v101: 65 pgs: 11 active+undersized, 7 peering, 9 active+undersized+degraded, 38 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 20/264 objects degraded (7.576%) 2024-09-11T00:15:22.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:21 smithi111 ceph-mon[90842]: Health check failed: Degraded data redundancy: 20/264 objects degraded (7.576%), 9 pgs degraded (PG_DEGRADED) 2024-09-11T00:15:22.153 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:21 smithi111 podman[113247]: 2024-09-11 00:15:21.825816641 +0000 UTC m=+0.738798651 container remove 66bd74cd956bec2004ece37761fc32fbed728d8481e54a2aa509ab86c5031af3 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-11T00:15:22.153 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:21 smithi111 systemd[1]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-11T00:15:22.153 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:21 smithi111 systemd[1]: Stopped Ceph osd.2 for 03107fbe-6fd0-11ef-bcea-c7b262605968. 2024-09-11T00:15:22.153 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:21 smithi111 systemd[1]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.2.service: Consumed 1min 5.719s CPU time. 2024-09-11T00:15:22.494 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:22 smithi111 systemd[1]: Starting Ceph osd.2 for 03107fbe-6fd0-11ef-bcea-c7b262605968... 2024-09-11T00:15:22.805 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:22 smithi111 podman[113346]: 2024-09-11 00:15:22.492721557 +0000 UTC m=+0.117847516 container create 92f948a53ec53b5bccd8754b9935a76efcb13f3c6317894a93f3929371422e57 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True) 2024-09-11T00:15:22.805 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:22 smithi111 podman[113346]: 2024-09-11 00:15:22.401844529 +0000 UTC m=+0.026970489 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:15:22.805 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:22 smithi111 podman[113346]: 2024-09-11 00:15:22.720990985 +0000 UTC m=+0.346116945 container init 92f948a53ec53b5bccd8754b9935a76efcb13f3c6317894a93f3929371422e57 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2-activate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-11T00:15:22.805 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:22 smithi111 podman[113346]: 2024-09-11 00:15:22.727746575 +0000 UTC m=+0.352872536 container start 92f948a53ec53b5bccd8754b9935a76efcb13f3c6317894a93f3929371422e57 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-11T00:15:22.805 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:22 smithi111 podman[113346]: 2024-09-11 00:15:22.803835174 +0000 UTC m=+0.428961144 container attach 92f948a53ec53b5bccd8754b9935a76efcb13f3c6317894a93f3929371422e57 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2-activate, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-09-11T00:15:23.153 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:22 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2-activate[113361]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-11T00:15:23.153 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:22 smithi111 bash[113346]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-11T00:15:23.153 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:22 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2-activate[113361]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-11T00:15:23.153 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:22 smithi111 bash[113346]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-11T00:15:24.127 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:23 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2-activate[113361]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-11T00:15:24.127 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:23 smithi111 bash[113346]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-11T00:15:24.127 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:23 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2-activate[113361]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-11T00:15:24.127 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:23 smithi111 bash[113346]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-11T00:15:24.403 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:24 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2-activate[113361]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-11T00:15:24.403 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:24 smithi111 bash[113346]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-11T00:15:24.403 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:24 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2-activate[113361]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-11T00:15:24.403 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:24 smithi111 bash[113346]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-11T00:15:24.403 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:24 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2-activate[113361]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-11T00:15:24.403 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:24 smithi111 bash[113346]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-11T00:15:24.403 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:24 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2-activate[113361]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-11T00:15:24.403 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:24 smithi111 bash[113346]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-11T00:15:24.403 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:24 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2-activate[113361]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-11T00:15:24.403 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:24 smithi111 bash[113346]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-11T00:15:24.404 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:24 smithi111 podman[113346]: 2024-09-11 00:15:24.179333651 +0000 UTC m=+1.804459612 container died 92f948a53ec53b5bccd8754b9935a76efcb13f3c6317894a93f3929371422e57 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2-activate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-11T00:15:24.833 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:24 smithi111 ceph-mon[90842]: pgmap v102: 65 pgs: 11 active+undersized, 7 peering, 9 active+undersized+degraded, 38 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 20/264 objects degraded (7.576%) 2024-09-11T00:15:25.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:24 smithi203 ceph-mon[69002]: pgmap v102: 65 pgs: 11 active+undersized, 7 peering, 9 active+undersized+degraded, 38 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 20/264 objects degraded (7.576%) 2024-09-11T00:15:25.134 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:24 smithi111 podman[113506]: 2024-09-11 00:15:24.832442874 +0000 UTC m=+0.639815181 container remove 92f948a53ec53b5bccd8754b9935a76efcb13f3c6317894a93f3929371422e57 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2-activate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-11T00:15:25.403 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:25 smithi111 podman[113565]: 2024-09-11 00:15:25.037722886 +0000 UTC m=+0.027087401 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:15:25.403 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:25 smithi111 podman[113565]: 2024-09-11 00:15:25.133328127 +0000 UTC m=+0.122692648 container create 3a3b318b337a827490ba55dcbccbc66e31c82fabb28fd615a7325eec49d524b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-11T00:15:25.403 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:25 smithi111 podman[113565]: 2024-09-11 00:15:25.336900686 +0000 UTC m=+0.326265201 container init 3a3b318b337a827490ba55dcbccbc66e31c82fabb28fd615a7325eec49d524b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-09-11T00:15:25.403 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:25 smithi111 podman[113565]: 2024-09-11 00:15:25.343529228 +0000 UTC m=+0.332893749 container start 3a3b318b337a827490ba55dcbccbc66e31c82fabb28fd615a7325eec49d524b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:15:25.403 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:25 smithi111 ceph-osd[113584]: -- 172.21.15.111:0/3637509170 <== mon.0 v2:172.21.15.111:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558f3f1101e0 con 0x558f3e2afc00 2024-09-11T00:15:25.902 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:25 smithi111 bash[113565]: 3a3b318b337a827490ba55dcbccbc66e31c82fabb28fd615a7325eec49d524b3 2024-09-11T00:15:25.903 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:25 smithi111 systemd[1]: Started Ceph osd.2 for 03107fbe-6fd0-11ef-bcea-c7b262605968. 2024-09-11T00:15:26.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:26 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:26.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:26 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:26.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:26 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:15:26.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:26 smithi203 ceph-mon[69002]: pgmap v103: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-09-11T00:15:26.843 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:26 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:26.843 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:26 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:26.843 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:26 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:15:26.843 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:26 smithi111 ceph-mon[90842]: pgmap v103: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-09-11T00:15:27.152 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:27 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2[113580]: 2024-09-11T00:15:27.057+0000 7fdd58237640 -1 Falling back to public interface 2024-09-11T00:15:27.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:27 smithi111 ceph-mon[90842]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-09-11T00:15:27.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:27 smithi111 ceph-mon[90842]: Health check update: Degraded data redundancy: 34/264 objects degraded (12.879%), 12 pgs degraded (PG_DEGRADED) 2024-09-11T00:15:27.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:27 smithi203 ceph-mon[69002]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-09-11T00:15:27.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:27 smithi203 ceph-mon[69002]: Health check update: Degraded data redundancy: 34/264 objects degraded (12.879%), 12 pgs degraded (PG_DEGRADED) 2024-09-11T00:15:28.736 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:28 smithi111 ceph-mon[90842]: pgmap v104: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-09-11T00:15:28.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:28 smithi203 ceph-mon[69002]: pgmap v104: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-09-11T00:15:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:30 smithi111 ceph-mon[90842]: pgmap v105: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-09-11T00:15:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:15:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:31.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:30 smithi203 ceph-mon[69002]: pgmap v105: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-09-11T00:15:31.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:31.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:15:31.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:32.733 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:32 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2[113580]: 2024-09-11T00:15:32.441+0000 7fdd58237640 -1 osd.2 0 read_superblock omap replica is missing. 2024-09-11T00:15:32.734 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:32 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2[113580]: 2024-09-11T00:15:32.731+0000 7fdd58237640 -1 osd.2 60 log_to_monitors true 2024-09-11T00:15:32.734 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:32 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:32.734 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:32 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:32.734 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:32 smithi111 ceph-mon[90842]: pgmap v106: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-09-11T00:15:32.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:32 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:32.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:32 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:32.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:32 smithi203 ceph-mon[69002]: pgmap v106: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-09-11T00:15:33.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.049+0000 7f8aea600700 1 -- 172.21.15.111:0/828283449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8ae4100d50 msgr2=0x7f8ae4104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:33.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.049+0000 7f8aea600700 1 --2- 172.21.15.111:0/828283449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8ae4100d50 0x7f8ae4104d20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0009910 tx=0x7f8ad0009c20 comp rx=0 tx=0).stop 2024-09-11T00:15:33.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.049+0000 7f8aea600700 1 -- 172.21.15.111:0/828283449 shutdown_connections 2024-09-11T00:15:33.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.049+0000 7f8aea600700 1 --2- 172.21.15.111:0/828283449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8ae4100d50 0x7f8ae4104d20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:33.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.049+0000 7f8aea600700 1 --2- 172.21.15.111:0/828283449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8ae41003b0 0x7f8ae4100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:33.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.049+0000 7f8aea600700 1 -- 172.21.15.111:0/828283449 >> 172.21.15.111:0/828283449 conn(0x7f8ae40fbc30 msgr2=0x7f8ae40fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:33.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.049+0000 7f8aea600700 1 -- 172.21.15.111:0/828283449 shutdown_connections 2024-09-11T00:15:33.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.049+0000 7f8aea600700 1 -- 172.21.15.111:0/828283449 wait complete. 2024-09-11T00:15:33.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.050+0000 7f8aea600700 1 Processor -- start 2024-09-11T00:15:33.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.050+0000 7f8aea600700 1 -- start start 2024-09-11T00:15:33.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.050+0000 7f8aea600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8ae41003b0 0x7f8ae4197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:33.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.050+0000 7f8aea600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8ae4100d50 0x7f8ae4198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:33.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.050+0000 7f8aea600700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae4198be0 con 0x7f8ae4100d50 2024-09-11T00:15:33.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.050+0000 7f8aea600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae419c970 con 0x7f8ae41003b0 2024-09-11T00:15:33.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.051+0000 7f8ae2a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8ae4100d50 0x7f8ae4198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:33.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.051+0000 7f8ae2a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8ae4100d50 0x7f8ae4198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42260/0 (socket says 172.21.15.111:42260) 2024-09-11T00:15:33.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.051+0000 7f8ae2a00700 1 -- 172.21.15.111:0/1754121430 learned_addr learned my addr 172.21.15.111:0/1754121430 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:15:33.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.051+0000 7f8ae3400700 1 --2- 172.21.15.111:0/1754121430 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8ae41003b0 0x7f8ae4197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:33.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.051+0000 7f8ae2a00700 1 -- 172.21.15.111:0/1754121430 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8ae41003b0 msgr2=0x7f8ae4197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:33.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.051+0000 7f8ae2a00700 1 --2- 172.21.15.111:0/1754121430 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8ae41003b0 0x7f8ae4197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:33.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.051+0000 7f8ae2a00700 1 -- 172.21.15.111:0/1754121430 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad00095f0 con 0x7f8ae4100d50 2024-09-11T00:15:33.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.052+0000 7f8ae2a00700 1 --2- 172.21.15.111:0/1754121430 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8ae4100d50 0x7f8ae4198500 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0005b40 tx=0x7f8ad000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:33.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.052+0000 7f8adbe00700 1 -- 172.21.15.111:0/1754121430 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ad001d070 con 0x7f8ae4100d50 2024-09-11T00:15:33.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.052+0000 7f8adbe00700 1 -- 172.21.15.111:0/1754121430 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ad000bed0 con 0x7f8ae4100d50 2024-09-11T00:15:33.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.052+0000 7f8aea600700 1 -- 172.21.15.111:0/1754121430 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae419cbf0 con 0x7f8ae4100d50 2024-09-11T00:15:33.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.052+0000 7f8adbe00700 1 -- 172.21.15.111:0/1754121430 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ad0003e70 con 0x7f8ae4100d50 2024-09-11T00:15:33.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.052+0000 7f8aea600700 1 -- 172.21.15.111:0/1754121430 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae419d0e0 con 0x7f8ae4100d50 2024-09-11T00:15:33.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.053+0000 7f8aea600700 1 -- 172.21.15.111:0/1754121430 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae41044a0 con 0x7f8ae4100d50 2024-09-11T00:15:33.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.054+0000 7f8adbe00700 1 -- 172.21.15.111:0/1754121430 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f8ad00050d0 con 0x7f8ae4100d50 2024-09-11T00:15:33.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.055+0000 7f8adbe00700 1 --2- 172.21.15.111:0/1754121430 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f8ac807a6f0 0x7f8ac807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:33.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.055+0000 7f8adbe00700 1 -- 172.21.15.111:0/1754121430 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f8ad009e580 con 0x7f8ae4100d50 2024-09-11T00:15:33.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.056+0000 7f8ae3400700 1 --2- 172.21.15.111:0/1754121430 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f8ac807a6f0 0x7f8ac807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:33.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.056+0000 7f8ae3400700 1 --2- 172.21.15.111:0/1754121430 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f8ac807a6f0 0x7f8ac807cba0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4009c60 tx=0x7f8ad4009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:33.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.060+0000 7f8adbe00700 1 -- 172.21.15.111:0/1754121430 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f8ad0061d20 con 0x7f8ae4100d50 2024-09-11T00:15:33.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.313+0000 7f8aea600700 1 -- 172.21.15.111:0/1754121430 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ae402cd10 con 0x7f8ac807a6f0 2024-09-11T00:15:33.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.315+0000 7f8adbe00700 1 -- 172.21.15.111:0/1754121430 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f8ae402cd10 con 0x7f8ac807a6f0 2024-09-11T00:15:33.321 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.318+0000 7f8aea600700 1 -- 172.21.15.111:0/1754121430 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f8ac807a6f0 msgr2=0x7f8ac807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:33.321 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.318+0000 7f8aea600700 1 --2- 172.21.15.111:0/1754121430 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f8ac807a6f0 0x7f8ac807cba0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4009c60 tx=0x7f8ad4009260 comp rx=0 tx=0).stop 2024-09-11T00:15:33.321 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.318+0000 7f8aea600700 1 -- 172.21.15.111:0/1754121430 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8ae4100d50 msgr2=0x7f8ae4198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:33.321 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.318+0000 7f8aea600700 1 --2- 172.21.15.111:0/1754121430 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8ae4100d50 0x7f8ae4198500 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0005b40 tx=0x7f8ad000f690 comp rx=0 tx=0).stop 2024-09-11T00:15:33.321 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.318+0000 7f8aea600700 1 -- 172.21.15.111:0/1754121430 shutdown_connections 2024-09-11T00:15:33.321 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.318+0000 7f8aea600700 1 --2- 172.21.15.111:0/1754121430 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f8ac807a6f0 0x7f8ac807cba0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:33.321 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.318+0000 7f8aea600700 1 --2- 172.21.15.111:0/1754121430 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8ae41003b0 0x7f8ae4197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:33.321 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.318+0000 7f8aea600700 1 --2- 172.21.15.111:0/1754121430 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8ae4100d50 0x7f8ae4198500 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:33.321 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.318+0000 7f8aea600700 1 -- 172.21.15.111:0/1754121430 >> 172.21.15.111:0/1754121430 conn(0x7f8ae40fbc30 msgr2=0x7f8ae40fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:33.321 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.318+0000 7f8aea600700 1 -- 172.21.15.111:0/1754121430 shutdown_connections 2024-09-11T00:15:33.321 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.319+0000 7f8aea600700 1 -- 172.21.15.111:0/1754121430 wait complete. 2024-09-11T00:15:33.337 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:15:33.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.463+0000 7f4939000700 1 -- 172.21.15.111:0/2278648306 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4934102600 msgr2=0x7f49341029d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:33.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.463+0000 7f4939000700 1 --2- 172.21.15.111:0/2278648306 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4934102600 0x7f49341029d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4924009910 tx=0x7f4924009c20 comp rx=0 tx=0).stop 2024-09-11T00:15:33.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.463+0000 7f4939000700 1 -- 172.21.15.111:0/2278648306 shutdown_connections 2024-09-11T00:15:33.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.463+0000 7f4939000700 1 --2- 172.21.15.111:0/2278648306 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4934102fa0 0x7f4934106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:33.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.463+0000 7f4939000700 1 --2- 172.21.15.111:0/2278648306 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4934102600 0x7f49341029d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:33.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.463+0000 7f4939000700 1 -- 172.21.15.111:0/2278648306 >> 172.21.15.111:0/2278648306 conn(0x7f49340fdec0 msgr2=0x7f49341002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:33.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.463+0000 7f4939000700 1 -- 172.21.15.111:0/2278648306 shutdown_connections 2024-09-11T00:15:33.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.463+0000 7f4939000700 1 -- 172.21.15.111:0/2278648306 wait complete. 2024-09-11T00:15:33.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.464+0000 7f4939000700 1 Processor -- start 2024-09-11T00:15:33.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.464+0000 7f4939000700 1 -- start start 2024-09-11T00:15:33.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.464+0000 7f4939000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4934102600 0x7f4934197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:33.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.464+0000 7f4939000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4934102fa0 0x7f49341984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:33.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.464+0000 7f4939000700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4934198b40 con 0x7f4934102fa0 2024-09-11T00:15:33.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.464+0000 7f4939000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4934198c80 con 0x7f4934102600 2024-09-11T00:15:33.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.464+0000 7f4931400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4934102fa0 0x7f49341984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:33.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.465+0000 7f4931400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4934102fa0 0x7f49341984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42274/0 (socket says 172.21.15.111:42274) 2024-09-11T00:15:33.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.465+0000 7f4931400700 1 -- 172.21.15.111:0/1864538609 learned_addr learned my addr 172.21.15.111:0/1864538609 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:15:33.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.465+0000 7f4931e00700 1 --2- 172.21.15.111:0/1864538609 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4934102600 0x7f4934197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:33.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.465+0000 7f4931400700 1 -- 172.21.15.111:0/1864538609 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4934102600 msgr2=0x7f4934197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:33.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.465+0000 7f4931400700 1 --2- 172.21.15.111:0/1864538609 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4934102600 0x7f4934197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:33.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.465+0000 7f4931400700 1 -- 172.21.15.111:0/1864538609 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49240095f0 con 0x7f4934102fa0 2024-09-11T00:15:33.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.465+0000 7f4931400700 1 --2- 172.21.15.111:0/1864538609 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4934102fa0 0x7f49341984f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f492000c960 tx=0x7f492000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:33.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.465+0000 7f492aa00700 1 -- 172.21.15.111:0/1864538609 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4920007a70 con 0x7f4934102fa0 2024-09-11T00:15:33.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.465+0000 7f492aa00700 1 -- 172.21.15.111:0/1864538609 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4920007bd0 con 0x7f4934102fa0 2024-09-11T00:15:33.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.465+0000 7f492aa00700 1 -- 172.21.15.111:0/1864538609 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4920018630 con 0x7f4934102fa0 2024-09-11T00:15:33.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.465+0000 7f4939000700 1 -- 172.21.15.111:0/1864538609 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f493419cad0 con 0x7f4934102fa0 2024-09-11T00:15:33.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.466+0000 7f4939000700 1 -- 172.21.15.111:0/1864538609 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f493419d020 con 0x7f4934102fa0 2024-09-11T00:15:33.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.467+0000 7f4939000700 1 -- 172.21.15.111:0/1864538609 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f493404ea50 con 0x7f4934102fa0 2024-09-11T00:15:33.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.469+0000 7f492aa00700 1 -- 172.21.15.111:0/1864538609 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f492000f450 con 0x7f4934102fa0 2024-09-11T00:15:33.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.470+0000 7f492aa00700 1 --2- 172.21.15.111:0/1864538609 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f491807a6f0 0x7f491807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:33.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.470+0000 7f492aa00700 1 -- 172.21.15.111:0/1864538609 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f492009d190 con 0x7f4934102fa0 2024-09-11T00:15:33.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.470+0000 7f4931e00700 1 --2- 172.21.15.111:0/1864538609 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f491807a6f0 0x7f491807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:33.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.471+0000 7f4931e00700 1 --2- 172.21.15.111:0/1864538609 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f491807a6f0 0x7f491807cba0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4924006010 tx=0x7f492401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:33.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.476+0000 7f492aa00700 1 -- 172.21.15.111:0/1864538609 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f4920060910 con 0x7f4934102fa0 2024-09-11T00:15:33.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.741+0000 7f4939000700 1 -- 172.21.15.111:0/1864538609 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f493419d5b0 con 0x7f491807a6f0 2024-09-11T00:15:33.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.743+0000 7f492aa00700 1 -- 172.21.15.111:0/1864538609 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f493419d5b0 con 0x7f491807a6f0 2024-09-11T00:15:33.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.745+0000 7f4939000700 1 -- 172.21.15.111:0/1864538609 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f491807a6f0 msgr2=0x7f491807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:33.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.745+0000 7f4939000700 1 --2- 172.21.15.111:0/1864538609 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f491807a6f0 0x7f491807cba0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4924006010 tx=0x7f492401a040 comp rx=0 tx=0).stop 2024-09-11T00:15:33.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.745+0000 7f4939000700 1 -- 172.21.15.111:0/1864538609 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4934102fa0 msgr2=0x7f49341984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:33.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.745+0000 7f4939000700 1 --2- 172.21.15.111:0/1864538609 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4934102fa0 0x7f49341984f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f492000c960 tx=0x7f492000cc70 comp rx=0 tx=0).stop 2024-09-11T00:15:33.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.745+0000 7f4939000700 1 -- 172.21.15.111:0/1864538609 shutdown_connections 2024-09-11T00:15:33.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.745+0000 7f4939000700 1 --2- 172.21.15.111:0/1864538609 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f491807a6f0 0x7f491807cba0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:33.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.745+0000 7f4939000700 1 --2- 172.21.15.111:0/1864538609 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4934102600 0x7f4934197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:33.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.745+0000 7f4939000700 1 --2- 172.21.15.111:0/1864538609 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4934102fa0 0x7f49341984f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:33.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.745+0000 7f4939000700 1 -- 172.21.15.111:0/1864538609 >> 172.21.15.111:0/1864538609 conn(0x7f49340fdec0 msgr2=0x7f49340ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:33.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.746+0000 7f4939000700 1 -- 172.21.15.111:0/1864538609 shutdown_connections 2024-09-11T00:15:33.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.746+0000 7f4939000700 1 -- 172.21.15.111:0/1864538609 wait complete. 2024-09-11T00:15:33.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.888+0000 7fe69a000700 1 -- 172.21.15.111:0/1479218331 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe694102fb0 msgr2=0x7fe694106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:33.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.888+0000 7fe69a000700 1 --2- 172.21.15.111:0/1479218331 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe694102fb0 0x7fe694106f80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe67c009910 tx=0x7fe67c009c20 comp rx=0 tx=0).stop 2024-09-11T00:15:33.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.888+0000 7fe69a000700 1 -- 172.21.15.111:0/1479218331 shutdown_connections 2024-09-11T00:15:33.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.888+0000 7fe69a000700 1 --2- 172.21.15.111:0/1479218331 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe694102fb0 0x7fe694106f80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:33.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.888+0000 7fe69a000700 1 --2- 172.21.15.111:0/1479218331 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe694102610 0x7fe6941029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:33.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.888+0000 7fe69a000700 1 -- 172.21.15.111:0/1479218331 >> 172.21.15.111:0/1479218331 conn(0x7fe6940fde90 msgr2=0x7fe6941002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:33.891 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:33 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:33.891 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:33 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:33.891 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:33 smithi111 ceph-mon[90842]: from='osd.2 [v2:172.21.15.111:6818/2305494096,v1:172.21.15.111:6819/2305494096]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-11T00:15:33.891 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:15:33 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2[113580]: 2024-09-11T00:15:33.635+0000 7fdd4da00640 -1 osd.2 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:15:33.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.888+0000 7fe69a000700 1 -- 172.21.15.111:0/1479218331 shutdown_connections 2024-09-11T00:15:33.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.888+0000 7fe69a000700 1 -- 172.21.15.111:0/1479218331 wait complete. 2024-09-11T00:15:33.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.889+0000 7fe69a000700 1 Processor -- start 2024-09-11T00:15:33.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.889+0000 7fe69a000700 1 -- start start 2024-09-11T00:15:33.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.890+0000 7fe69a000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe694102610 0x7fe694197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:33.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.890+0000 7fe69a000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe694102fb0 0x7fe694198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:33.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.890+0000 7fe69a000700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe694198c00 con 0x7fe694102610 2024-09-11T00:15:33.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.890+0000 7fe69a000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69419c990 con 0x7fe694102fb0 2024-09-11T00:15:33.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.890+0000 7fe693400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe694102610 0x7fe694197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:33.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.890+0000 7fe693400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe694102610 0x7fe694197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42290/0 (socket says 172.21.15.111:42290) 2024-09-11T00:15:33.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.890+0000 7fe693400700 1 -- 172.21.15.111:0/29162392 learned_addr learned my addr 172.21.15.111:0/29162392 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:15:33.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.890+0000 7fe68aa00700 1 --2- 172.21.15.111:0/29162392 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe694102fb0 0x7fe694198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:33.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.890+0000 7fe693400700 1 -- 172.21.15.111:0/29162392 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe694102fb0 msgr2=0x7fe694198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:33.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.890+0000 7fe693400700 1 --2- 172.21.15.111:0/29162392 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe694102fb0 0x7fe694198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:33.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.890+0000 7fe693400700 1 -- 172.21.15.111:0/29162392 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67c0095f0 con 0x7fe694102610 2024-09-11T00:15:33.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.891+0000 7fe693400700 1 --2- 172.21.15.111:0/29162392 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe694102610 0x7fe694197fe0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe68400ef10 tx=0x7fe68400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:33.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.891+0000 7fe690c00700 1 -- 172.21.15.111:0/29162392 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe68400ca50 con 0x7fe694102610 2024-09-11T00:15:33.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.891+0000 7fe690c00700 1 -- 172.21.15.111:0/29162392 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe68400f040 con 0x7fe694102610 2024-09-11T00:15:33.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.891+0000 7fe690c00700 1 -- 172.21.15.111:0/29162392 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6840146b0 con 0x7fe694102610 2024-09-11T00:15:33.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.891+0000 7fe69a000700 1 -- 172.21.15.111:0/29162392 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe69419cc10 con 0x7fe694102610 2024-09-11T00:15:33.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.891+0000 7fe69a000700 1 -- 172.21.15.111:0/29162392 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe69419d160 con 0x7fe694102610 2024-09-11T00:15:33.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.892+0000 7fe69a000700 1 -- 172.21.15.111:0/29162392 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe69404ea50 con 0x7fe694102610 2024-09-11T00:15:33.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.893+0000 7fe690c00700 1 -- 172.21.15.111:0/29162392 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fe68400cbb0 con 0x7fe694102610 2024-09-11T00:15:33.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.894+0000 7fe690c00700 1 --2- 172.21.15.111:0/29162392 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe67807a6f0 0x7fe67807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:33.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.895+0000 7fe690c00700 1 -- 172.21.15.111:0/29162392 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fe68409d6d0 con 0x7fe694102610 2024-09-11T00:15:33.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.895+0000 7fe68aa00700 1 --2- 172.21.15.111:0/29162392 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe67807a6f0 0x7fe67807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:33.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.895+0000 7fe68aa00700 1 --2- 172.21.15.111:0/29162392 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe67807a6f0 0x7fe67807cba0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe67c00b760 tx=0x7fe67c009f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:33.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:33.899+0000 7fe690c00700 1 -- 172.21.15.111:0/29162392 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fe684060dd0 con 0x7fe694102610 2024-09-11T00:15:34.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:33 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:34.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:33 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:34.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:33 smithi203 ceph-mon[69002]: from='osd.2 [v2:172.21.15.111:6818/2305494096,v1:172.21.15.111:6819/2305494096]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-11T00:15:34.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.136+0000 7fe69a000700 1 -- 172.21.15.111:0/29162392 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe69419d620 con 0x7fe67807a6f0 2024-09-11T00:15:34.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.146+0000 7fe690c00700 1 -- 172.21.15.111:0/29162392 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fe69419d620 con 0x7fe67807a6f0 2024-09-11T00:15:34.148 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:15:34.148 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (5m) 2s ago 18m 14.7M - 0.27.0 11f11916f8cd d6d3253e881f 2024-09-11T00:15:34.148 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (7m) 2s ago 18m 8186k - 18.2.0 dc2bc1663786 7c40af85314c 2024-09-11T00:15:34.149 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi203 smithi203 running (7m) 108s ago 17m 7730k - 18.2.0 dc2bc1663786 922e3261ff70 2024-09-11T00:15:34.149 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (118s) 2s ago 18m 6899k - 19.3.0-4854-g8f219c47 589dd18248e4 a9cacdb9a638 2024-09-11T00:15:34.149 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi203 smithi203 running (112s) 108s ago 17m 6899k - 19.3.0-4854-g8f219c47 589dd18248e4 d452d9dfa04b 2024-09-11T00:15:34.149 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (4m) 2s ago 18m 67.6M - c8b91775d855 7d3b50b5b59f 2024-09-11T00:15:34.149 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.gmgsay smithi111 running (11m) 2s ago 11m 18.3M - 18.2.0 dc2bc1663786 795e4ff0075c 2024-09-11T00:15:34.149 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.rucaba smithi111 running (11m) 2s ago 11m 18.2M - 18.2.0 dc2bc1663786 02885adac62c 2024-09-11T00:15:34.149 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.tcrqop smithi203 running (11m) 108s ago 11m 150M - 18.2.0 dc2bc1663786 4df492159bb4 2024-09-11T00:15:34.149 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.uqkbkn smithi203 running (11m) 108s ago 11m 17.6M - 18.2.0 dc2bc1663786 619aa58ea314 2024-09-11T00:15:34.149 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.ypucji smithi111 *:8443,9283,8765 running (7m) 2s ago 20m 514M - 19.3.0-4854-g8f219c47 589dd18248e4 07fa31f49618 2024-09-11T00:15:34.149 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi203.smuspl smithi203 *:8443,9283,8765 running (6m) 108s ago 17m 454M - 19.3.0-4854-g8f219c47 589dd18248e4 7e5a93a5ffa7 2024-09-11T00:15:34.149 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (3m) 2s ago 20m 48.4M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 3c29c070a612 2024-09-11T00:15:34.149 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi203 smithi203 running (2m) 108s ago 17m 36.1M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 45e8285e4b4d 2024-09-11T00:15:34.149 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (6m) 2s ago 18m 7792k - 1.7.0 72c9c2088986 ec478ea14488 2024-09-11T00:15:34.150 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi203 smithi203 *:9100 running (5m) 108s ago 17m 7209k - 1.7.0 72c9c2088986 54d461cde1bc 2024-09-11T00:15:34.150 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (87s) 2s ago 15m 88.9M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 d2f1a2312736 2024-09-11T00:15:34.150 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (48s) 2s ago 15m 90.1M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 19cf95ecca7d 2024-09-11T00:15:34.150 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (9s) 2s ago 14m 10.4M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 3a3b318b337a 2024-09-11T00:15:34.150 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi203 running (14m) 108s ago 14m 246M 2240M 18.2.0 dc2bc1663786 60b1cef7a70d 2024-09-11T00:15:34.150 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi203 running (13m) 108s ago 13m 209M 2240M 18.2.0 dc2bc1663786 769c7942c42b 2024-09-11T00:15:34.150 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi203 running (13m) 108s ago 13m 194M 2240M 18.2.0 dc2bc1663786 6d824001d40c 2024-09-11T00:15:34.150 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (5m) 2s ago 18m 60.1M - 2.51.0 1d3b7f56885b 3e72ac10983d 2024-09-11T00:15:34.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.149+0000 7fe69a000700 1 -- 172.21.15.111:0/29162392 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe67807a6f0 msgr2=0x7fe67807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:34.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.149+0000 7fe69a000700 1 --2- 172.21.15.111:0/29162392 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe67807a6f0 0x7fe67807cba0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe67c00b760 tx=0x7fe67c009f90 comp rx=0 tx=0).stop 2024-09-11T00:15:34.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.149+0000 7fe69a000700 1 -- 172.21.15.111:0/29162392 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe694102610 msgr2=0x7fe694197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:34.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.149+0000 7fe69a000700 1 --2- 172.21.15.111:0/29162392 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe694102610 0x7fe694197fe0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe68400ef10 tx=0x7fe68400c3a0 comp rx=0 tx=0).stop 2024-09-11T00:15:34.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.149+0000 7fe69a000700 1 -- 172.21.15.111:0/29162392 shutdown_connections 2024-09-11T00:15:34.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.149+0000 7fe69a000700 1 --2- 172.21.15.111:0/29162392 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe67807a6f0 0x7fe67807cba0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:34.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.149+0000 7fe69a000700 1 --2- 172.21.15.111:0/29162392 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe694102610 0x7fe694197fe0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:34.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.149+0000 7fe69a000700 1 --2- 172.21.15.111:0/29162392 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe694102fb0 0x7fe694198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:34.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.149+0000 7fe69a000700 1 -- 172.21.15.111:0/29162392 >> 172.21.15.111:0/29162392 conn(0x7fe6940fde90 msgr2=0x7fe6940ff460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:34.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.150+0000 7fe69a000700 1 -- 172.21.15.111:0/29162392 shutdown_connections 2024-09-11T00:15:34.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.150+0000 7fe69a000700 1 -- 172.21.15.111:0/29162392 wait complete. 2024-09-11T00:15:34.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.286+0000 7fc0a4800700 1 -- 172.21.15.111:0/3725145792 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc09c1003d0 msgr2=0x7fc09c1007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:34.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.286+0000 7fc0a4800700 1 --2- 172.21.15.111:0/3725145792 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc09c1003d0 0x7fc09c1007a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc090009910 tx=0x7fc090009c20 comp rx=0 tx=0).stop 2024-09-11T00:15:34.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.286+0000 7fc0a4800700 1 -- 172.21.15.111:0/3725145792 shutdown_connections 2024-09-11T00:15:34.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.286+0000 7fc0a4800700 1 --2- 172.21.15.111:0/3725145792 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc09c100d70 0x7fc09c104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:34.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.286+0000 7fc0a4800700 1 --2- 172.21.15.111:0/3725145792 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc09c1003d0 0x7fc09c1007a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:34.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.286+0000 7fc0a4800700 1 -- 172.21.15.111:0/3725145792 >> 172.21.15.111:0/3725145792 conn(0x7fc09c0fbc90 msgr2=0x7fc09c0fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:34.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.286+0000 7fc0a4800700 1 -- 172.21.15.111:0/3725145792 shutdown_connections 2024-09-11T00:15:34.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.286+0000 7fc0a4800700 1 -- 172.21.15.111:0/3725145792 wait complete. 2024-09-11T00:15:34.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.287+0000 7fc0a4800700 1 Processor -- start 2024-09-11T00:15:34.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.287+0000 7fc0a4800700 1 -- start start 2024-09-11T00:15:34.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.287+0000 7fc0a4800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc09c1003d0 0x7fc09c073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:34.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.287+0000 7fc0a4800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc09c100d70 0x7fc09c073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:34.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.287+0000 7fc0a4800700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c073ad0 con 0x7fc09c1003d0 2024-09-11T00:15:34.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.287+0000 7fc0a4800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c073c10 con 0x7fc09c100d70 2024-09-11T00:15:34.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.287+0000 7fc0a1e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc09c1003d0 0x7fc09c073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:34.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.288+0000 7fc0a1e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc09c1003d0 0x7fc09c073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42306/0 (socket says 172.21.15.111:42306) 2024-09-11T00:15:34.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.288+0000 7fc0a1e00700 1 -- 172.21.15.111:0/2262486557 learned_addr learned my addr 172.21.15.111:0/2262486557 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:15:34.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.288+0000 7fc0a1400700 1 --2- 172.21.15.111:0/2262486557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc09c100d70 0x7fc09c073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:34.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.288+0000 7fc0a1e00700 1 -- 172.21.15.111:0/2262486557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc09c100d70 msgr2=0x7fc09c073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:34.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.288+0000 7fc0a1e00700 1 --2- 172.21.15.111:0/2262486557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc09c100d70 0x7fc09c073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:34.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.288+0000 7fc0a1e00700 1 -- 172.21.15.111:0/2262486557 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0900095f0 con 0x7fc09c1003d0 2024-09-11T00:15:34.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.288+0000 7fc0a1e00700 1 --2- 172.21.15.111:0/2262486557 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc09c1003d0 0x7fc09c073050 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc09000b5c0 tx=0x7fc09000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:34.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.288+0000 7fc096a00700 1 -- 172.21.15.111:0/2262486557 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc09001d070 con 0x7fc09c1003d0 2024-09-11T00:15:34.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.289+0000 7fc096a00700 1 -- 172.21.15.111:0/2262486557 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc090005e00 con 0x7fc09c1003d0 2024-09-11T00:15:34.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.289+0000 7fc0a4800700 1 -- 172.21.15.111:0/2262486557 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc09c073e90 con 0x7fc09c1003d0 2024-09-11T00:15:34.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.289+0000 7fc096a00700 1 -- 172.21.15.111:0/2262486557 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc090017400 con 0x7fc09c1003d0 2024-09-11T00:15:34.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.289+0000 7fc0a4800700 1 -- 172.21.15.111:0/2262486557 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09c1a2260 con 0x7fc09c1003d0 2024-09-11T00:15:34.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.290+0000 7fc0a4800700 1 -- 172.21.15.111:0/2262486557 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc09c1086e0 con 0x7fc09c1003d0 2024-09-11T00:15:34.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.291+0000 7fc096a00700 1 -- 172.21.15.111:0/2262486557 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fc09000f6f0 con 0x7fc09c1003d0 2024-09-11T00:15:34.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.292+0000 7fc096a00700 1 --2- 172.21.15.111:0/2262486557 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc08407a6f0 0x7fc08407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:34.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.292+0000 7fc096a00700 1 -- 172.21.15.111:0/2262486557 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fc09009e620 con 0x7fc09c1003d0 2024-09-11T00:15:34.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.292+0000 7fc0a1400700 1 --2- 172.21.15.111:0/2262486557 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc08407a6f0 0x7fc08407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:34.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.293+0000 7fc0a1400700 1 --2- 172.21.15.111:0/2262486557 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc08407a6f0 0x7fc08407cba0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc09c074840 tx=0x7fc08c00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:34.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.296+0000 7fc096a00700 1 -- 172.21.15.111:0/2262486557 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fc090061e40 con 0x7fc09c1003d0 2024-09-11T00:15:34.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.630+0000 7fc0a4800700 1 -- 172.21.15.111:0/2262486557 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc09c02cc30 con 0x7fc09c1003d0 2024-09-11T00:15:34.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.635+0000 7fc096a00700 1 -- 172.21.15.111:0/2262486557 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7fc090064f60 con 0x7fc09c1003d0 2024-09-11T00:15:34.640 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:15:34.640 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-11T00:15:34.640 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:15:34.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:15:34.640 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-11T00:15:34.640 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:15:34.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:15:34.640 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-11T00:15:34.640 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-09-11T00:15:34.640 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 3 2024-09-11T00:15:34.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:15:34.640 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-11T00:15:34.640 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-11T00:15:34.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:15:34.641 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-11T00:15:34.641 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 7, 2024-09-11T00:15:34.641 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 7 2024-09-11T00:15:34.641 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-11T00:15:34.641 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:15:34.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.639+0000 7fc0a4800700 1 -- 172.21.15.111:0/2262486557 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc08407a6f0 msgr2=0x7fc08407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:34.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.639+0000 7fc0a4800700 1 --2- 172.21.15.111:0/2262486557 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc08407a6f0 0x7fc08407cba0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc09c074840 tx=0x7fc08c00b410 comp rx=0 tx=0).stop 2024-09-11T00:15:34.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.639+0000 7fc0a4800700 1 -- 172.21.15.111:0/2262486557 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc09c1003d0 msgr2=0x7fc09c073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:34.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.640+0000 7fc0a4800700 1 --2- 172.21.15.111:0/2262486557 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc09c1003d0 0x7fc09c073050 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc09000b5c0 tx=0x7fc09000bd70 comp rx=0 tx=0).stop 2024-09-11T00:15:34.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.640+0000 7fc0a4800700 1 -- 172.21.15.111:0/2262486557 shutdown_connections 2024-09-11T00:15:34.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.640+0000 7fc0a4800700 1 --2- 172.21.15.111:0/2262486557 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc08407a6f0 0x7fc08407cba0 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc09c074840 tx=0x7fc08c00b410 comp rx=0 tx=0).stop 2024-09-11T00:15:34.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.640+0000 7fc0a4800700 1 --2- 172.21.15.111:0/2262486557 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc09c1003d0 0x7fc09c073050 secure :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc09000b5c0 tx=0x7fc09000bd70 comp rx=0 tx=0).stop 2024-09-11T00:15:34.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.640+0000 7fc0a4800700 1 --2- 172.21.15.111:0/2262486557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc09c100d70 0x7fc09c073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:34.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.640+0000 7fc0a4800700 1 -- 172.21.15.111:0/2262486557 >> 172.21.15.111:0/2262486557 conn(0x7fc09c0fbc90 msgr2=0x7fc09c0fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:34.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.641+0000 7fc0a4800700 1 -- 172.21.15.111:0/2262486557 shutdown_connections 2024-09-11T00:15:34.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.641+0000 7fc0a4800700 1 -- 172.21.15.111:0/2262486557 wait complete. 2024-09-11T00:15:34.658 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:34 smithi111 ceph-mon[90842]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:34.658 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:34 smithi111 ceph-mon[90842]: from='osd.2 [v2:172.21.15.111:6818/2305494096,v1:172.21.15.111:6819/2305494096]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T00:15:34.658 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:34 smithi111 ceph-mon[90842]: pgmap v108: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-09-11T00:15:34.658 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:34 smithi111 ceph-mon[90842]: osdmap e63: 6 total, 5 up, 6 in 2024-09-11T00:15:34.658 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:34 smithi111 ceph-mon[90842]: from='osd.2 [v2:172.21.15.111:6818/2305494096,v1:172.21.15.111:6819/2305494096]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi111", "root=default"]} : dispatch 2024-09-11T00:15:34.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.785+0000 7f8b7ec00700 1 -- 172.21.15.111:0/641393485 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8b78100210 msgr2=0x7f8b781005e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:34.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.786+0000 7f8b7ec00700 1 --2- 172.21.15.111:0/641393485 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8b78100210 0x7f8b781005e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c009910 tx=0x7f8b6c009c20 comp rx=0 tx=0).stop 2024-09-11T00:15:34.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.786+0000 7f8b7ec00700 1 -- 172.21.15.111:0/641393485 shutdown_connections 2024-09-11T00:15:34.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.786+0000 7f8b7ec00700 1 --2- 172.21.15.111:0/641393485 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b78100bb0 0x7f8b78104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:34.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.786+0000 7f8b7ec00700 1 --2- 172.21.15.111:0/641393485 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8b78100210 0x7f8b781005e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:34.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.786+0000 7f8b7ec00700 1 -- 172.21.15.111:0/641393485 >> 172.21.15.111:0/641393485 conn(0x7f8b780fbab0 msgr2=0x7f8b780fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:34.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.786+0000 7f8b7ec00700 1 -- 172.21.15.111:0/641393485 shutdown_connections 2024-09-11T00:15:34.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.786+0000 7f8b7ec00700 1 -- 172.21.15.111:0/641393485 wait complete. 2024-09-11T00:15:34.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.787+0000 7f8b7ec00700 1 Processor -- start 2024-09-11T00:15:34.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.788+0000 7f8b7ec00700 1 -- start start 2024-09-11T00:15:34.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.788+0000 7f8b7ec00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8b78100210 0x7f8b78073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:34.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.788+0000 7f8b7ec00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b78100bb0 0x7f8b78073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:34.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.788+0000 7f8b7ec00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b78073ad0 con 0x7f8b78100210 2024-09-11T00:15:34.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.788+0000 7f8b7ec00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b78073c10 con 0x7f8b78100bb0 2024-09-11T00:15:34.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.789+0000 7f8b7d800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8b78100210 0x7f8b78073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:34.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.789+0000 7f8b7d800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8b78100210 0x7f8b78073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42320/0 (socket says 172.21.15.111:42320) 2024-09-11T00:15:34.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.789+0000 7f8b7d800700 1 -- 172.21.15.111:0/2906808703 learned_addr learned my addr 172.21.15.111:0/2906808703 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:15:34.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.789+0000 7f8b7ce00700 1 --2- 172.21.15.111:0/2906808703 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b78100bb0 0x7f8b78073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:34.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.789+0000 7f8b7d800700 1 -- 172.21.15.111:0/2906808703 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b78100bb0 msgr2=0x7f8b78073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:34.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.789+0000 7f8b7d800700 1 --2- 172.21.15.111:0/2906808703 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b78100bb0 0x7f8b78073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:34.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.789+0000 7f8b7d800700 1 -- 172.21.15.111:0/2906808703 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6c0095f0 con 0x7f8b78100210 2024-09-11T00:15:34.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.789+0000 7f8b7d800700 1 --2- 172.21.15.111:0/2906808703 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8b78100210 0x7f8b78073050 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0092e0 tx=0x7f8b6c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:34.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.790+0000 7f8b76000700 1 -- 172.21.15.111:0/2906808703 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b6c01d070 con 0x7f8b78100210 2024-09-11T00:15:34.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.790+0000 7f8b76000700 1 -- 172.21.15.111:0/2906808703 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b6c0052a0 con 0x7f8b78100210 2024-09-11T00:15:34.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.790+0000 7f8b7ec00700 1 -- 172.21.15.111:0/2906808703 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b78073e90 con 0x7f8b78100210 2024-09-11T00:15:34.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.790+0000 7f8b76000700 1 -- 172.21.15.111:0/2906808703 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b6c017400 con 0x7f8b78100210 2024-09-11T00:15:34.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.790+0000 7f8b7ec00700 1 -- 172.21.15.111:0/2906808703 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b781a2090 con 0x7f8b78100210 2024-09-11T00:15:34.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.791+0000 7f8b7ec00700 1 -- 172.21.15.111:0/2906808703 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b78108520 con 0x7f8b78100210 2024-09-11T00:15:34.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.792+0000 7f8b76000700 1 -- 172.21.15.111:0/2906808703 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f8b6c00f820 con 0x7f8b78100210 2024-09-11T00:15:34.794 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:34 smithi203 ceph-mon[69002]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:34.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:34 smithi203 ceph-mon[69002]: from='osd.2 [v2:172.21.15.111:6818/2305494096,v1:172.21.15.111:6819/2305494096]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T00:15:34.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:34 smithi203 ceph-mon[69002]: pgmap v108: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 258 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-09-11T00:15:34.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:34 smithi203 ceph-mon[69002]: osdmap e63: 6 total, 5 up, 6 in 2024-09-11T00:15:34.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:34 smithi203 ceph-mon[69002]: from='osd.2 [v2:172.21.15.111:6818/2305494096,v1:172.21.15.111:6819/2305494096]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi111", "root=default"]} : dispatch 2024-09-11T00:15:34.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.793+0000 7f8b76000700 1 --2- 172.21.15.111:0/2906808703 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f8b6007a6f0 0x7f8b6007cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:34.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.793+0000 7f8b76000700 1 -- 172.21.15.111:0/2906808703 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f8b6c09e4a0 con 0x7f8b78100210 2024-09-11T00:15:34.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.793+0000 7f8b7ce00700 1 --2- 172.21.15.111:0/2906808703 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f8b6007a6f0 0x7f8b6007cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:34.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.794+0000 7f8b7ce00700 1 --2- 172.21.15.111:0/2906808703 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f8b6007a6f0 0x7f8b6007cba0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8b78074840 tx=0x7f8b64009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:34.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:34.797+0000 7f8b76000700 1 -- 172.21.15.111:0/2906808703 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f8b6c061cc0 con 0x7f8b78100210 2024-09-11T00:15:35.089 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.084+0000 7f8b7ec00700 1 -- 172.21.15.111:0/2906808703 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8b7802cc30 con 0x7f8b78100210 2024-09-11T00:15:35.089 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.084+0000 7f8b76000700 1 -- 172.21.15.111:0/2906808703 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1921 (secure 0 0 0) 0x7f8b6c064de0 con 0x7f8b78100210 2024-09-11T00:15:35.089 INFO:teuthology.orchestra.run.smithi111.stdout:e15 2024-09-11T00:15:35.089 INFO:teuthology.orchestra.run.smithi111.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-11T00:15:35.090 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T00:15:35.090 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:15:35.090 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-11T00:15:35.090 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:15:35.090 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-11T00:15:35.090 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-11T00:15:35.090 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 14 2024-09-11T00:15:35.090 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-11T00:15:35.090 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-11T00:03:47.950356+0000 2024-09-11T00:15:35.090 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-11T00:04:06.275905+0000 2024-09-11T00:15:35.090 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-11T00:15:35.090 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-11T00:15:35.090 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-11T00:15:35.091 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-11T00:15:35.091 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-11T00:15:35.091 INFO:teuthology.orchestra.run.smithi111.stdout:max_xattr_size 65536 2024-09-11T00:15:35.091 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-11T00:15:35.091 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-11T00:15:35.091 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 47 2024-09-11T00:15:35.091 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:15:35.091 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-11T00:15:35.091 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-11T00:15:35.091 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=24363} 2024-09-11T00:15:35.091 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-11T00:15:35.091 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-11T00:15:35.092 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-11T00:15:35.092 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-11T00:15:35.092 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-11T00:15:35.092 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data enabled 2024-09-11T00:15:35.092 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-11T00:15:35.092 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-11T00:15:35.092 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 1 2024-09-11T00:15:35.092 INFO:teuthology.orchestra.run.smithi111.stdout:qdb_cluster leader: 0 members: 2024-09-11T00:15:35.092 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.tcrqop{0:24363} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.203:6824/3082736449,v1:172.21.15.203:6825/3082736449] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:15:35.092 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:15:35.092 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:15:35.092 INFO:teuthology.orchestra.run.smithi111.stdout:Standby daemons: 2024-09-11T00:15:35.092 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:15:35.093 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.rucaba{-1:14554} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6828/2045133285,v1:172.21.15.111:6829/2045133285] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:15:35.093 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.gmgsay{-1:14566} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.111:6826/1122545830,v1:172.21.15.111:6827/1122545830] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:15:35.093 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.uqkbkn{-1:24379} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.203:6826/695613114,v1:172.21.15.203:6827/695613114] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:15:35.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.087+0000 7f8b7ec00700 1 -- 172.21.15.111:0/2906808703 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f8b6007a6f0 msgr2=0x7f8b6007cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:35.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.087+0000 7f8b7ec00700 1 --2- 172.21.15.111:0/2906808703 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f8b6007a6f0 0x7f8b6007cba0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8b78074840 tx=0x7f8b64009260 comp rx=0 tx=0).stop 2024-09-11T00:15:35.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.087+0000 7f8b7ec00700 1 -- 172.21.15.111:0/2906808703 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8b78100210 msgr2=0x7f8b78073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:35.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.087+0000 7f8b7ec00700 1 --2- 172.21.15.111:0/2906808703 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8b78100210 0x7f8b78073050 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0092e0 tx=0x7f8b6c00b6c0 comp rx=0 tx=0).stop 2024-09-11T00:15:35.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.087+0000 7f8b7ec00700 1 -- 172.21.15.111:0/2906808703 shutdown_connections 2024-09-11T00:15:35.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.087+0000 7f8b7ec00700 1 --2- 172.21.15.111:0/2906808703 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f8b6007a6f0 0x7f8b6007cba0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:35.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.087+0000 7f8b7ec00700 1 --2- 172.21.15.111:0/2906808703 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8b78100210 0x7f8b78073050 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:35.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.087+0000 7f8b7ec00700 1 --2- 172.21.15.111:0/2906808703 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b78100bb0 0x7f8b78073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:35.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.087+0000 7f8b7ec00700 1 -- 172.21.15.111:0/2906808703 >> 172.21.15.111:0/2906808703 conn(0x7f8b780fbab0 msgr2=0x7f8b780fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:35.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.087+0000 7f8b7ec00700 1 -- 172.21.15.111:0/2906808703 shutdown_connections 2024-09-11T00:15:35.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.087+0000 7f8b7ec00700 1 -- 172.21.15.111:0/2906808703 wait complete. 2024-09-11T00:15:35.095 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 15 2024-09-11T00:15:35.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.235+0000 7fa5bd800700 1 -- 172.21.15.111:0/2844481131 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5b8100d50 msgr2=0x7fa5b8104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:35.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.235+0000 7fa5bd800700 1 --2- 172.21.15.111:0/2844481131 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5b8100d50 0x7fa5b8104d20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4009910 tx=0x7fa5a4009c20 comp rx=0 tx=0).stop 2024-09-11T00:15:35.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.236+0000 7fa5bd800700 1 -- 172.21.15.111:0/2844481131 shutdown_connections 2024-09-11T00:15:35.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.236+0000 7fa5bd800700 1 --2- 172.21.15.111:0/2844481131 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5b8100d50 0x7fa5b8104d20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:35.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.236+0000 7fa5bd800700 1 --2- 172.21.15.111:0/2844481131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa5b81003b0 0x7fa5b8100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:35.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.236+0000 7fa5bd800700 1 -- 172.21.15.111:0/2844481131 >> 172.21.15.111:0/2844481131 conn(0x7fa5b80fbc30 msgr2=0x7fa5b80fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:35.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.236+0000 7fa5bd800700 1 -- 172.21.15.111:0/2844481131 shutdown_connections 2024-09-11T00:15:35.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.236+0000 7fa5bd800700 1 -- 172.21.15.111:0/2844481131 wait complete. 2024-09-11T00:15:35.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.237+0000 7fa5bd800700 1 Processor -- start 2024-09-11T00:15:35.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.237+0000 7fa5bd800700 1 -- start start 2024-09-11T00:15:35.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.238+0000 7fa5bd800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5b81003b0 0x7fa5b8195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:35.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.238+0000 7fa5bd800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa5b8100d50 0x7fa5b8196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:35.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.238+0000 7fa5bd800700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b81969e0 con 0x7fa5b81003b0 2024-09-11T00:15:35.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.238+0000 7fa5bd800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b819a770 con 0x7fa5b8100d50 2024-09-11T00:15:35.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.238+0000 7fa5b6a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5b81003b0 0x7fa5b8195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:35.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.238+0000 7fa5b6a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5b81003b0 0x7fa5b8195dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42346/0 (socket says 172.21.15.111:42346) 2024-09-11T00:15:35.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.238+0000 7fa5b6a00700 1 -- 172.21.15.111:0/4103614257 learned_addr learned my addr 172.21.15.111:0/4103614257 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:15:35.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.238+0000 7fa5b6000700 1 --2- 172.21.15.111:0/4103614257 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa5b8100d50 0x7fa5b8196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:35.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.239+0000 7fa5b6a00700 1 -- 172.21.15.111:0/4103614257 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa5b8100d50 msgr2=0x7fa5b8196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:35.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.239+0000 7fa5b6a00700 1 --2- 172.21.15.111:0/4103614257 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa5b8100d50 0x7fa5b8196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:35.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.239+0000 7fa5b6a00700 1 -- 172.21.15.111:0/4103614257 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a40095f0 con 0x7fa5b81003b0 2024-09-11T00:15:35.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.239+0000 7fa5b6a00700 1 --2- 172.21.15.111:0/4103614257 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5b81003b0 0x7fa5b8195dc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800d8d0 tx=0x7fa5a800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:35.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.240+0000 7fa5af400700 1 -- 172.21.15.111:0/4103614257 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5a80098a0 con 0x7fa5b81003b0 2024-09-11T00:15:35.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.240+0000 7fa5af400700 1 -- 172.21.15.111:0/4103614257 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa5a8010460 con 0x7fa5b81003b0 2024-09-11T00:15:35.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.240+0000 7fa5af400700 1 -- 172.21.15.111:0/4103614257 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5a800f5f0 con 0x7fa5b81003b0 2024-09-11T00:15:35.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.240+0000 7fa5bd800700 1 -- 172.21.15.111:0/4103614257 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b819aa50 con 0x7fa5b81003b0 2024-09-11T00:15:35.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.240+0000 7fa5bd800700 1 -- 172.21.15.111:0/4103614257 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b819afa0 con 0x7fa5b81003b0 2024-09-11T00:15:35.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.241+0000 7fa5bd800700 1 -- 172.21.15.111:0/4103614257 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b8108720 con 0x7fa5b81003b0 2024-09-11T00:15:35.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.242+0000 7fa5af400700 1 -- 172.21.15.111:0/4103614257 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fa5a8009a00 con 0x7fa5b81003b0 2024-09-11T00:15:35.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.244+0000 7fa5af400700 1 --2- 172.21.15.111:0/4103614257 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa59c07a6f0 0x7fa59c07cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:35.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.244+0000 7fa5af400700 1 -- 172.21.15.111:0/4103614257 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fa5a809d030 con 0x7fa5b81003b0 2024-09-11T00:15:35.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.244+0000 7fa5b6000700 1 --2- 172.21.15.111:0/4103614257 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa59c07a6f0 0x7fa59c07cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:35.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.245+0000 7fa5b6000700 1 --2- 172.21.15.111:0/4103614257 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa59c07a6f0 0x7fa59c07cba0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa5b81973e0 tx=0x7fa5a401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:35.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.248+0000 7fa5af400700 1 -- 172.21.15.111:0/4103614257 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fa5a8060850 con 0x7fa5b81003b0 2024-09-11T00:15:35.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.501+0000 7fa5bd800700 1 -- 172.21.15.111:0/4103614257 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5b819b210 con 0x7fa59c07a6f0 2024-09-11T00:15:35.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.502+0000 7fa5af400700 1 -- 172.21.15.111:0/4103614257 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa5b819b210 con 0x7fa59c07a6f0 2024-09-11T00:15:35.505 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:15:35.505 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e", 2024-09-11T00:15:35.505 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-11T00:15:35.505 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-11T00:15:35.505 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-11T00:15:35.505 INFO:teuthology.orchestra.run.smithi111.stdout: "crash", 2024-09-11T00:15:35.505 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr", 2024-09-11T00:15:35.505 INFO:teuthology.orchestra.run.smithi111.stdout: "mon" 2024-09-11T00:15:35.505 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-11T00:15:35.505 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "9/23 daemons upgraded", 2024-09-11T00:15:35.505 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading osd daemons", 2024-09-11T00:15:35.505 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-11T00:15:35.506 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:15:35.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.505+0000 7fa5bd800700 1 -- 172.21.15.111:0/4103614257 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa59c07a6f0 msgr2=0x7fa59c07cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:35.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.505+0000 7fa5bd800700 1 --2- 172.21.15.111:0/4103614257 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa59c07a6f0 0x7fa59c07cba0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa5b81973e0 tx=0x7fa5a401a040 comp rx=0 tx=0).stop 2024-09-11T00:15:35.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.505+0000 7fa5bd800700 1 -- 172.21.15.111:0/4103614257 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5b81003b0 msgr2=0x7fa5b8195dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:35.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.505+0000 7fa5bd800700 1 --2- 172.21.15.111:0/4103614257 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5b81003b0 0x7fa5b8195dc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800d8d0 tx=0x7fa5a800dbe0 comp rx=0 tx=0).stop 2024-09-11T00:15:35.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.505+0000 7fa5bd800700 1 -- 172.21.15.111:0/4103614257 shutdown_connections 2024-09-11T00:15:35.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.505+0000 7fa5bd800700 1 --2- 172.21.15.111:0/4103614257 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa59c07a6f0 0x7fa59c07cba0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:35.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.505+0000 7fa5bd800700 1 --2- 172.21.15.111:0/4103614257 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5b81003b0 0x7fa5b8195dc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:35.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.505+0000 7fa5bd800700 1 --2- 172.21.15.111:0/4103614257 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa5b8100d50 0x7fa5b8196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:35.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.505+0000 7fa5bd800700 1 -- 172.21.15.111:0/4103614257 >> 172.21.15.111:0/4103614257 conn(0x7fa5b80fbc30 msgr2=0x7fa5b80fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:35.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.505+0000 7fa5bd800700 1 -- 172.21.15.111:0/4103614257 shutdown_connections 2024-09-11T00:15:35.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.505+0000 7fa5bd800700 1 -- 172.21.15.111:0/4103614257 wait complete. 2024-09-11T00:15:35.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.665+0000 7f6bb4400700 1 -- 172.21.15.111:0/1498831268 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bac102620 msgr2=0x7f6bac1029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:35.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.665+0000 7f6bb4400700 1 --2- 172.21.15.111:0/1498831268 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bac102620 0x7f6bac1029f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009910 tx=0x7f6ba0009c20 comp rx=0 tx=0).stop 2024-09-11T00:15:35.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.665+0000 7f6bb4400700 1 -- 172.21.15.111:0/1498831268 shutdown_connections 2024-09-11T00:15:35.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.665+0000 7f6bb4400700 1 --2- 172.21.15.111:0/1498831268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6bac102fc0 0x7f6bac106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:35.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.665+0000 7f6bb4400700 1 --2- 172.21.15.111:0/1498831268 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bac102620 0x7f6bac1029f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:35.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.665+0000 7f6bb4400700 1 -- 172.21.15.111:0/1498831268 >> 172.21.15.111:0/1498831268 conn(0x7f6bac0fdec0 msgr2=0x7f6bac1002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:35.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.665+0000 7f6bb4400700 1 -- 172.21.15.111:0/1498831268 shutdown_connections 2024-09-11T00:15:35.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.665+0000 7f6bb4400700 1 -- 172.21.15.111:0/1498831268 wait complete. 2024-09-11T00:15:35.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.666+0000 7f6bb4400700 1 Processor -- start 2024-09-11T00:15:35.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.666+0000 7f6bb4400700 1 -- start start 2024-09-11T00:15:35.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.667+0000 7f6bb4400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6bac102620 0x7f6bac197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:35.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.667+0000 7f6bb4400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bac102fc0 0x7f6bac198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:35.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.667+0000 7f6bb4400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac198c10 con 0x7f6bac102fc0 2024-09-11T00:15:35.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.667+0000 7f6bb4400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac19c9a0 con 0x7f6bac102620 2024-09-11T00:15:35.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.667+0000 7f6bb1a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6bac102620 0x7f6bac197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:35.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.667+0000 7f6bb1a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6bac102620 0x7f6bac197ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.111:51628/0 (socket says 172.21.15.111:51628) 2024-09-11T00:15:35.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.667+0000 7f6bb1a00700 1 -- 172.21.15.111:0/2005329158 learned_addr learned my addr 172.21.15.111:0/2005329158 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:15:35.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.667+0000 7f6bb1000700 1 --2- 172.21.15.111:0/2005329158 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bac102fc0 0x7f6bac198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:35.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.668+0000 7f6bb1a00700 1 -- 172.21.15.111:0/2005329158 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bac102fc0 msgr2=0x7f6bac198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:35.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.668+0000 7f6bb1a00700 1 --2- 172.21.15.111:0/2005329158 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bac102fc0 0x7f6bac198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:35.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.668+0000 7f6bb1a00700 1 -- 172.21.15.111:0/2005329158 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b98009520 con 0x7f6bac102620 2024-09-11T00:15:35.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.668+0000 7f6bb1a00700 1 --2- 172.21.15.111:0/2005329158 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6bac102620 0x7f6bac197ff0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00092e0 tx=0x7f6ba000b6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:35.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.668+0000 7f6baa000700 1 -- 172.21.15.111:0/2005329158 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ba001d070 con 0x7f6bac102620 2024-09-11T00:15:35.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.668+0000 7f6baa000700 1 -- 172.21.15.111:0/2005329158 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6ba0022470 con 0x7f6bac102620 2024-09-11T00:15:35.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.668+0000 7f6bb4400700 1 -- 172.21.15.111:0/2005329158 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba00095f0 con 0x7f6bac102620 2024-09-11T00:15:35.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.668+0000 7f6baa000700 1 -- 172.21.15.111:0/2005329158 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ba0017630 con 0x7f6bac102620 2024-09-11T00:15:35.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.669+0000 7f6bb4400700 1 -- 172.21.15.111:0/2005329158 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bac19cf80 con 0x7f6bac102620 2024-09-11T00:15:35.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.670+0000 7f6bb4400700 1 -- 172.21.15.111:0/2005329158 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bac10a930 con 0x7f6bac102620 2024-09-11T00:15:35.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.671+0000 7f6baa000700 1 -- 172.21.15.111:0/2005329158 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f6ba0005120 con 0x7f6bac102620 2024-09-11T00:15:35.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.672+0000 7f6baa000700 1 --2- 172.21.15.111:0/2005329158 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f6b9407a6f0 0x7f6b9407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:35.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.672+0000 7f6baa000700 1 -- 172.21.15.111:0/2005329158 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f6ba009e870 con 0x7f6bac102620 2024-09-11T00:15:35.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.672+0000 7f6bb1000700 1 --2- 172.21.15.111:0/2005329158 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f6b9407a6f0 0x7f6b9407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:35.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.673+0000 7f6bb1000700 1 --2- 172.21.15.111:0/2005329158 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f6b9407a6f0 0x7f6b9407cba0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6bac199610 tx=0x7f6b98009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:35.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:35.675+0000 7f6baa000700 1 -- 172.21.15.111:0/2005329158 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f6ba0062120 con 0x7f6bac102620 2024-09-11T00:15:35.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:35 smithi111 ceph-mon[90842]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:35.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:35 smithi111 ceph-mon[90842]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:35.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:35 smithi111 ceph-mon[90842]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-11T00:15:35.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:35 smithi111 ceph-mon[90842]: osd.2 [v2:172.21.15.111:6818/2305494096,v1:172.21.15.111:6819/2305494096] boot 2024-09-11T00:15:35.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:35 smithi111 ceph-mon[90842]: osdmap e64: 6 total, 6 up, 6 in 2024-09-11T00:15:35.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:35 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T00:15:35.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:35 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/2262486557' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:15:35.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:35 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/2906808703' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:15:35.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:35 smithi111 ceph-mon[90842]: osdmap e65: 6 total, 6 up, 6 in 2024-09-11T00:15:36.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:36.004+0000 7f6bb4400700 1 -- 172.21.15.111:0/2005329158 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6bac04ea50 con 0x7f6bac102620 2024-09-11T00:15:36.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:36.005+0000 7f6baa000700 1 -- 172.21.15.111:0/2005329158 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+703 (secure 0 0 0) 0x7f6ba0065240 con 0x7f6bac102620 2024-09-11T00:15:36.007 INFO:teuthology.orchestra.run.smithi111.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 21/264 objects degraded (7.955%), 6 pgs degraded 2024-09-11T00:15:36.007 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-11T00:15:36.007 INFO:teuthology.orchestra.run.smithi111.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-11T00:15:36.007 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 21/264 objects degraded (7.955%), 6 pgs degraded 2024-09-11T00:15:36.007 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-09-11T00:15:36.007 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.c is active+undersized+degraded, acting [3,0] 2024-09-11T00:15:36.007 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-09-11T00:15:36.007 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-09-11T00:15:36.007 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-09-11T00:15:36.007 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-09-11T00:15:36.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:36.007+0000 7f6bb4400700 1 -- 172.21.15.111:0/2005329158 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f6b9407a6f0 msgr2=0x7f6b9407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:36.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:36.007+0000 7f6bb4400700 1 --2- 172.21.15.111:0/2005329158 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f6b9407a6f0 0x7f6b9407cba0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6bac199610 tx=0x7f6b98009260 comp rx=0 tx=0).stop 2024-09-11T00:15:36.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:36.007+0000 7f6bb4400700 1 -- 172.21.15.111:0/2005329158 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6bac102620 msgr2=0x7f6bac197ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:36.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:36.007+0000 7f6bb4400700 1 --2- 172.21.15.111:0/2005329158 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6bac102620 0x7f6bac197ff0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00092e0 tx=0x7f6ba000b6c0 comp rx=0 tx=0).stop 2024-09-11T00:15:36.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:36.007+0000 7f6bb4400700 1 -- 172.21.15.111:0/2005329158 shutdown_connections 2024-09-11T00:15:36.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:36.007+0000 7f6bb4400700 1 --2- 172.21.15.111:0/2005329158 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f6b9407a6f0 0x7f6b9407cba0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:36.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:36.007+0000 7f6bb4400700 1 --2- 172.21.15.111:0/2005329158 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6bac102620 0x7f6bac197ff0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:36.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:36.007+0000 7f6bb4400700 1 --2- 172.21.15.111:0/2005329158 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bac102fc0 0x7f6bac198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:36.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:36.007+0000 7f6bb4400700 1 -- 172.21.15.111:0/2005329158 >> 172.21.15.111:0/2005329158 conn(0x7f6bac0fdec0 msgr2=0x7f6bac0ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:36.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:36.008+0000 7f6bb4400700 1 -- 172.21.15.111:0/2005329158 shutdown_connections 2024-09-11T00:15:36.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:15:36.008+0000 7f6bb4400700 1 -- 172.21.15.111:0/2005329158 wait complete. 2024-09-11T00:15:36.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:35 smithi203 ceph-mon[69002]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:36.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:35 smithi203 ceph-mon[69002]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:36.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:35 smithi203 ceph-mon[69002]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-11T00:15:36.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:35 smithi203 ceph-mon[69002]: osd.2 [v2:172.21.15.111:6818/2305494096,v1:172.21.15.111:6819/2305494096] boot 2024-09-11T00:15:36.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:35 smithi203 ceph-mon[69002]: osdmap e64: 6 total, 6 up, 6 in 2024-09-11T00:15:36.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:35 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T00:15:36.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:35 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/2262486557' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:15:36.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:35 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/2906808703' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:15:36.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:35 smithi203 ceph-mon[69002]: osdmap e65: 6 total, 6 up, 6 in 2024-09-11T00:15:36.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:36 smithi111 ceph-mon[90842]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:36.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:36 smithi111 ceph-mon[90842]: pgmap v110: 65 pgs: 15 peering, 6 active+undersized, 6 active+undersized+degraded, 38 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 21/264 objects degraded (7.955%) 2024-09-11T00:15:36.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:36 smithi111 ceph-mon[90842]: Health check update: Degraded data redundancy: 21/264 objects degraded (7.955%), 6 pgs degraded (PG_DEGRADED) 2024-09-11T00:15:36.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:36 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/2005329158' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-11T00:15:37.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:36 smithi203 ceph-mon[69002]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:37.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:36 smithi203 ceph-mon[69002]: pgmap v110: 65 pgs: 15 peering, 6 active+undersized, 6 active+undersized+degraded, 38 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 21/264 objects degraded (7.955%) 2024-09-11T00:15:37.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:36 smithi203 ceph-mon[69002]: Health check update: Degraded data redundancy: 21/264 objects degraded (7.955%), 6 pgs degraded (PG_DEGRADED) 2024-09-11T00:15:37.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:36 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/2005329158' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-11T00:15:38.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:37 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:38.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:37 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:38.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:37 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:15:38.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:37 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:15:38.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:37 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:38.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:37 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:15:38.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:37 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:15:38.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:37 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:15:38.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:37 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:15:38.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:37 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-11T00:15:38.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:37 smithi203 ceph-mon[69002]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-11T00:15:38.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:37 smithi203 ceph-mon[69002]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-11T00:15:38.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:37 smithi203 ceph-mon[69002]: pgmap v112: 65 pgs: 15 peering, 6 active+undersized, 6 active+undersized+degraded, 38 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 21/264 objects degraded (7.955%) 2024-09-11T00:15:38.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:37 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:38.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:37 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:38.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:37 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:15:38.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:37 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:15:38.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:37 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:38.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:37 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:15:38.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:37 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:15:38.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:37 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:15:38.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:37 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:15:38.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:37 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-11T00:15:38.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:37 smithi111 ceph-mon[90842]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-11T00:15:38.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:37 smithi111 ceph-mon[90842]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-11T00:15:38.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:37 smithi111 ceph-mon[90842]: pgmap v112: 65 pgs: 15 peering, 6 active+undersized, 6 active+undersized+degraded, 38 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 21/264 objects degraded (7.955%) 2024-09-11T00:15:39.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:39 smithi203 ceph-mon[69002]: pgmap v113: 65 pgs: 15 peering, 50 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:39.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:39 smithi203 ceph-mon[69002]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/264 objects degraded (7.955%), 6 pgs degraded) 2024-09-11T00:15:40.042 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:39 smithi111 ceph-mon[90842]: pgmap v113: 65 pgs: 15 peering, 50 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:40.042 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:39 smithi111 ceph-mon[90842]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/264 objects degraded (7.955%), 6 pgs degraded) 2024-09-11T00:15:43.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:42 smithi203 ceph-mon[69002]: pgmap v114: 65 pgs: 65 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:43.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:42 smithi111 ceph-mon[90842]: pgmap v114: 65 pgs: 65 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:45.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:44 smithi203 ceph-mon[69002]: pgmap v115: 65 pgs: 65 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:45.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:44 smithi111 ceph-mon[90842]: pgmap v115: 65 pgs: 65 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:46.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:45 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:46.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:45 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:15:46.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:45 smithi203 ceph-mon[69002]: pgmap v116: 65 pgs: 65 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:46.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:45 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:46.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:45 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:15:46.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:45 smithi111 ceph-mon[90842]: pgmap v116: 65 pgs: 65 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:49.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:48 smithi203 ceph-mon[69002]: pgmap v117: 65 pgs: 65 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:49.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:48 smithi111 ceph-mon[90842]: pgmap v117: 65 pgs: 65 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:51.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:50 smithi203 ceph-mon[69002]: pgmap v118: 65 pgs: 65 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:51.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:50 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:51.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:50 smithi111 ceph-mon[90842]: pgmap v118: 65 pgs: 65 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:51.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:50 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:52.807 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:52 smithi203 ceph-mon[69002]: pgmap v119: 65 pgs: 65 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:52.810 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:52 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-11T00:15:53.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:52 smithi111 ceph-mon[90842]: pgmap v119: 65 pgs: 65 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:53.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:52 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-11T00:15:54.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:53 smithi203 ceph-mon[69002]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-11T00:15:54.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:53 smithi203 ceph-mon[69002]: Upgrade: osd.3 is safe to restart 2024-09-11T00:15:54.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:53 smithi111 ceph-mon[90842]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-11T00:15:54.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:53 smithi111 ceph-mon[90842]: Upgrade: osd.3 is safe to restart 2024-09-11T00:15:55.022 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:54 smithi203 ceph-mon[69002]: pgmap v120: 65 pgs: 65 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:55.023 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:54 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:55.023 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:54 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-11T00:15:55.023 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:54 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:15:55.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:54 smithi111 ceph-mon[90842]: pgmap v120: 65 pgs: 65 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:55.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:54 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:15:55.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:54 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-11T00:15:55.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:54 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:15:55.960 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:55 smithi203 ceph-mon[69002]: Upgrade: Updating osd.3 2024-09-11T00:15:55.960 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:55 smithi203 ceph-mon[69002]: Deploying daemon osd.3 on smithi203 2024-09-11T00:15:56.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:55 smithi111 ceph-mon[90842]: Upgrade: Updating osd.3 2024-09-11T00:15:56.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:55 smithi111 ceph-mon[90842]: Deploying daemon osd.3 on smithi203 2024-09-11T00:15:56.797 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:56 smithi203 ceph-mon[69002]: pgmap v121: 65 pgs: 65 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:57.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:56 smithi111 ceph-mon[90842]: pgmap v121: 65 pgs: 65 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:57.795 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:15:57 smithi203 systemd[1]: Stopping Ceph osd.3 for 03107fbe-6fd0-11ef-bcea-c7b262605968... 2024-09-11T00:15:58.295 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:15:57 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3[39248]: 2024-09-11T00:15:57.811+0000 7f0d26800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:15:58.295 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:15:57 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3[39248]: 2024-09-11T00:15:57.811+0000 7f0d26800700 -1 osd.3 65 *** Got signal Terminated *** 2024-09-11T00:15:58.295 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:15:57 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3[39248]: 2024-09-11T00:15:57.811+0000 7f0d26800700 -1 osd.3 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:15:58.955 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:58 smithi111 ceph-mon[90842]: pgmap v122: 65 pgs: 65 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:58.955 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:58 smithi111 ceph-mon[90842]: osd.3 marked itself down and dead 2024-09-11T00:15:59.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:58 smithi203 ceph-mon[69002]: pgmap v122: 65 pgs: 65 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:15:59.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:58 smithi203 ceph-mon[69002]: osd.3 marked itself down and dead 2024-09-11T00:15:59.478 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:15:59 smithi203 podman[78301]: 2024-09-11 00:15:59.175442567 +0000 UTC m=+1.502049179 container died 60b1cef7a70dd207a11a799f15772bab7578dccc4c0628e1acf3b379c787cfcc (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2024-09-11T00:15:59.761 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:59 smithi203 ceph-mon[69002]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-11T00:15:59.761 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:15:59 smithi203 ceph-mon[69002]: osdmap e66: 6 total, 5 up, 6 in 2024-09-11T00:15:59.761 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:15:59 smithi203 podman[78301]: 2024-09-11 00:15:59.566604139 +0000 UTC m=+1.893210751 container cleanup 60b1cef7a70dd207a11a799f15772bab7578dccc4c0628e1acf3b379c787cfcc (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.0, RELEASE=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, org.label-schema.build-date=20231212, GIT_CLEAN=True, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-11T00:15:59.761 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:15:59 smithi203 bash[78301]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3 2024-09-11T00:15:59.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:59 smithi111 ceph-mon[90842]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-11T00:15:59.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:15:59 smithi111 ceph-mon[90842]: osdmap e66: 6 total, 5 up, 6 in 2024-09-11T00:16:00.045 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:15:59 smithi203 podman[78318]: 2024-09-11 00:15:59.860620357 +0000 UTC m=+0.673384559 container remove 60b1cef7a70dd207a11a799f15772bab7578dccc4c0628e1acf3b379c787cfcc (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3, RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.license=GPLv2) 2024-09-11T00:16:00.607 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:00 smithi203 podman[78402]: 2024-09-11 00:16:00.328293122 +0000 UTC m=+0.113736973 container create cfcfa5a7b126bf3a548f6bc24eeffa6cfc86de81b988b09707e043a22bcccf85 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True) 2024-09-11T00:16:00.607 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:00 smithi203 podman[78402]: 2024-09-11 00:16:00.241928378 +0000 UTC m=+0.027372235 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:16:00.607 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:00 smithi203 podman[78402]: 2024-09-11 00:16:00.60619825 +0000 UTC m=+0.391642106 container init cfcfa5a7b126bf3a548f6bc24eeffa6cfc86de81b988b09707e043a22bcccf85 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:16:00.880 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:00 smithi203 ceph-mon[69002]: pgmap v124: 65 pgs: 9 peering, 14 stale+active+clean, 42 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:16:00.880 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:00 smithi203 ceph-mon[69002]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-11T00:16:00.880 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:00 smithi203 ceph-mon[69002]: osdmap e67: 6 total, 5 up, 6 in 2024-09-11T00:16:00.880 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:00 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:00.881 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:00 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:16:00.881 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:00 smithi203 podman[78402]: 2024-09-11 00:16:00.613844785 +0000 UTC m=+0.399288645 container start cfcfa5a7b126bf3a548f6bc24eeffa6cfc86de81b988b09707e043a22bcccf85 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-11T00:16:00.881 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:00 smithi203 podman[78402]: 2024-09-11 00:16:00.689300094 +0000 UTC m=+0.474743961 container attach cfcfa5a7b126bf3a548f6bc24eeffa6cfc86de81b988b09707e043a22bcccf85 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2) 2024-09-11T00:16:00.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:00 smithi111 ceph-mon[90842]: pgmap v124: 65 pgs: 9 peering, 14 stale+active+clean, 42 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:16:00.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:00 smithi111 ceph-mon[90842]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-11T00:16:00.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:00 smithi111 ceph-mon[90842]: osdmap e67: 6 total, 5 up, 6 in 2024-09-11T00:16:00.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:00 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:00.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:00 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:16:01.261 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:00 smithi203 podman[78402]: 2024-09-11 00:16:00.879498399 +0000 UTC m=+0.664942269 container died cfcfa5a7b126bf3a548f6bc24eeffa6cfc86de81b988b09707e043a22bcccf85 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:16:01.938 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:01 smithi203 ceph-mon[69002]: pgmap v126: 65 pgs: 14 active+undersized, 9 peering, 1 stale+active+clean, 11 active+undersized+degraded, 30 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 40/264 objects degraded (15.152%) 2024-09-11T00:16:01.938 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:01 smithi203 ceph-mon[69002]: Health check failed: Degraded data redundancy: 40/264 objects degraded (15.152%), 11 pgs degraded (PG_DEGRADED) 2024-09-11T00:16:01.938 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:01 smithi203 podman[78425]: 2024-09-11 00:16:01.593864306 +0000 UTC m=+0.695187672 container remove cfcfa5a7b126bf3a548f6bc24eeffa6cfc86de81b988b09707e043a22bcccf85 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:16:01.938 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:01 smithi203 systemd[1]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-11T00:16:01.938 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:01 smithi203 systemd[1]: Stopped Ceph osd.3 for 03107fbe-6fd0-11ef-bcea-c7b262605968. 2024-09-11T00:16:01.938 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:01 smithi203 systemd[1]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.3.service: Consumed 1min 27.598s CPU time. 2024-09-11T00:16:02.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:01 smithi111 ceph-mon[90842]: pgmap v126: 65 pgs: 14 active+undersized, 9 peering, 1 stale+active+clean, 11 active+undersized+degraded, 30 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 40/264 objects degraded (15.152%) 2024-09-11T00:16:02.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:01 smithi111 ceph-mon[90842]: Health check failed: Degraded data redundancy: 40/264 objects degraded (15.152%), 11 pgs degraded (PG_DEGRADED) 2024-09-11T00:16:02.246 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:01 smithi203 systemd[1]: Starting Ceph osd.3 for 03107fbe-6fd0-11ef-bcea-c7b262605968... 2024-09-11T00:16:02.540 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:02 smithi203 podman[78522]: 2024-09-11 00:16:02.244959589 +0000 UTC m=+0.116647635 container create 0e1c6f9087f1a2f834305c4da2f7925e9a94554b26d52515c8523567bbec468a (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3-activate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:16:02.541 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:02 smithi203 podman[78522]: 2024-09-11 00:16:02.156131435 +0000 UTC m=+0.027819502 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:16:02.541 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:02 smithi203 podman[78522]: 2024-09-11 00:16:02.539561059 +0000 UTC m=+0.411249123 container init 0e1c6f9087f1a2f834305c4da2f7925e9a94554b26d52515c8523567bbec468a (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3-activate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:16:02.795 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:02 smithi203 podman[78522]: 2024-09-11 00:16:02.547222667 +0000 UTC m=+0.418910713 container start 0e1c6f9087f1a2f834305c4da2f7925e9a94554b26d52515c8523567bbec468a (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-11T00:16:02.795 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:02 smithi203 podman[78522]: 2024-09-11 00:16:02.622761476 +0000 UTC m=+0.494449537 container attach 0e1c6f9087f1a2f834305c4da2f7925e9a94554b26d52515c8523567bbec468a (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3-activate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-11T00:16:02.795 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:02 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3-activate[78537]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-11T00:16:02.795 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:02 smithi203 bash[78522]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-11T00:16:02.795 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:02 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3-activate[78537]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-11T00:16:02.795 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:02 smithi203 bash[78522]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-11T00:16:03.960 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:03 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3-activate[78537]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-11T00:16:03.960 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:03 smithi203 bash[78522]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-11T00:16:03.960 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:03 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3-activate[78537]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-11T00:16:03.960 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:03 smithi203 bash[78522]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-11T00:16:04.295 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:03 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3-activate[78537]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-11T00:16:04.295 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:03 smithi203 bash[78522]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-11T00:16:04.295 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:03 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3-activate[78537]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-11T00:16:04.295 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:03 smithi203 bash[78522]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-11T00:16:04.295 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:03 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3-activate[78537]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-11T00:16:04.296 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:03 smithi203 bash[78522]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-11T00:16:04.296 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:03 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3-activate[78537]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-11T00:16:04.296 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:03 smithi203 bash[78522]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-11T00:16:04.296 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:03 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3-activate[78537]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-11T00:16:04.296 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:03 smithi203 bash[78522]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-11T00:16:04.296 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:04 smithi203 podman[78522]: 2024-09-11 00:16:04.010845403 +0000 UTC m=+1.882533455 container died 0e1c6f9087f1a2f834305c4da2f7925e9a94554b26d52515c8523567bbec468a (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3-activate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-09-11T00:16:04.977 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:04 smithi203 ceph-mon[69002]: pgmap v127: 65 pgs: 14 active+undersized, 9 peering, 1 stale+active+clean, 11 active+undersized+degraded, 30 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 40/264 objects degraded (15.152%) 2024-09-11T00:16:04.977 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:04 smithi203 podman[78673]: 2024-09-11 00:16:04.66038972 +0000 UTC m=+0.636145525 container remove 0e1c6f9087f1a2f834305c4da2f7925e9a94554b26d52515c8523567bbec468a (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3-activate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-11T00:16:05.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:04 smithi111 ceph-mon[90842]: pgmap v127: 65 pgs: 14 active+undersized, 9 peering, 1 stale+active+clean, 11 active+undersized+degraded, 30 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 40/264 objects degraded (15.152%) 2024-09-11T00:16:05.240 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:04 smithi203 podman[78732]: 2024-09-11 00:16:04.880407145 +0000 UTC m=+0.027501026 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:16:05.240 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:04 smithi203 podman[78732]: 2024-09-11 00:16:04.97820867 +0000 UTC m=+0.125302563 container create 288c7e8ae34bb71214d6e7ab9184b150c0d0da9ed59b92f6be0133d3ad959132 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux ) 2024-09-11T00:16:05.240 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:05 smithi203 podman[78732]: 2024-09-11 00:16:05.239287356 +0000 UTC m=+0.386381237 container init 288c7e8ae34bb71214d6e7ab9184b150c0d0da9ed59b92f6be0133d3ad959132 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-11T00:16:05.545 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:05 smithi203 podman[78732]: 2024-09-11 00:16:05.24617978 +0000 UTC m=+0.393273636 container start 288c7e8ae34bb71214d6e7ab9184b150c0d0da9ed59b92f6be0133d3ad959132 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:16:05.545 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:05 smithi203 ceph-osd[78750]: -- 172.21.15.203:0/161264781 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55696fc9a1e0 con 0x55696fc28000 2024-09-11T00:16:05.545 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:05 smithi203 bash[78732]: 288c7e8ae34bb71214d6e7ab9184b150c0d0da9ed59b92f6be0133d3ad959132 2024-09-11T00:16:05.545 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:05 smithi203 systemd[1]: Started Ceph osd.3 for 03107fbe-6fd0-11ef-bcea-c7b262605968. 2024-09-11T00:16:06.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.160+0000 7f4f1b400700 1 -- 172.21.15.111:0/1046193861 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4f141003b0 msgr2=0x7f4f14100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:06.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.160+0000 7f4f1b400700 1 --2- 172.21.15.111:0/1046193861 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4f141003b0 0x7f4f14100780 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009910 tx=0x7f4f08009c20 comp rx=0 tx=0).stop 2024-09-11T00:16:06.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.160+0000 7f4f1b400700 1 -- 172.21.15.111:0/1046193861 shutdown_connections 2024-09-11T00:16:06.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.160+0000 7f4f1b400700 1 --2- 172.21.15.111:0/1046193861 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f14100d50 0x7f4f14104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.160+0000 7f4f1b400700 1 --2- 172.21.15.111:0/1046193861 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4f141003b0 0x7f4f14100780 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.160+0000 7f4f1b400700 1 -- 172.21.15.111:0/1046193861 >> 172.21.15.111:0/1046193861 conn(0x7f4f140fbc30 msgr2=0x7f4f140fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:06.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.160+0000 7f4f1b400700 1 -- 172.21.15.111:0/1046193861 shutdown_connections 2024-09-11T00:16:06.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.160+0000 7f4f1b400700 1 -- 172.21.15.111:0/1046193861 wait complete. 2024-09-11T00:16:06.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.161+0000 7f4f1b400700 1 Processor -- start 2024-09-11T00:16:06.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.161+0000 7f4f1b400700 1 -- start start 2024-09-11T00:16:06.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.161+0000 7f4f1b400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f141003b0 0x7f4f14073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:06.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.161+0000 7f4f1b400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4f14100d50 0x7f4f14073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:06.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.161+0000 7f4f1b400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f14073ad0 con 0x7f4f14100d50 2024-09-11T00:16:06.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.161+0000 7f4f1b400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f14073c10 con 0x7f4f141003b0 2024-09-11T00:16:06.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.162+0000 7f4f18a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f141003b0 0x7f4f14073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:06.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.162+0000 7f4f13e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4f14100d50 0x7f4f14073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:06.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.162+0000 7f4f18a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f141003b0 0x7f4f14073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.111:47096/0 (socket says 172.21.15.111:47096) 2024-09-11T00:16:06.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.162+0000 7f4f18a00700 1 -- 172.21.15.111:0/2426943327 learned_addr learned my addr 172.21.15.111:0/2426943327 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:16:06.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.162+0000 7f4f18a00700 1 -- 172.21.15.111:0/2426943327 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4f14100d50 msgr2=0x7f4f14073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:06.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.162+0000 7f4f18a00700 1 --2- 172.21.15.111:0/2426943327 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4f14100d50 0x7f4f14073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.162+0000 7f4f18a00700 1 -- 172.21.15.111:0/2426943327 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f080095f0 con 0x7f4f141003b0 2024-09-11T00:16:06.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.162+0000 7f4f13e00700 1 --2- 172.21.15.111:0/2426943327 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4f14100d50 0x7f4f14073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:16:06.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.162+0000 7f4f18a00700 1 --2- 172.21.15.111:0/2426943327 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f141003b0 0x7f4f14073050 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4f08005b40 tx=0x7f4f0800f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:06.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.163+0000 7f4f11600700 1 -- 172.21.15.111:0/2426943327 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f0801d070 con 0x7f4f141003b0 2024-09-11T00:16:06.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.163+0000 7f4f1b400700 1 -- 172.21.15.111:0/2426943327 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f14073e90 con 0x7f4f141003b0 2024-09-11T00:16:06.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.163+0000 7f4f11600700 1 -- 172.21.15.111:0/2426943327 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f0800bed0 con 0x7f4f141003b0 2024-09-11T00:16:06.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.163+0000 7f4f11600700 1 -- 172.21.15.111:0/2426943327 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f08022470 con 0x7f4f141003b0 2024-09-11T00:16:06.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.163+0000 7f4f1b400700 1 -- 172.21.15.111:0/2426943327 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f141a2210 con 0x7f4f141003b0 2024-09-11T00:16:06.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.164+0000 7f4f1b400700 1 -- 172.21.15.111:0/2426943327 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f141086c0 con 0x7f4f141003b0 2024-09-11T00:16:06.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.165+0000 7f4f11600700 1 -- 172.21.15.111:0/2426943327 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f4f080050d0 con 0x7f4f141003b0 2024-09-11T00:16:06.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.166+0000 7f4f11600700 1 --2- 172.21.15.111:0/2426943327 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4efc07a6f0 0x7f4efc07cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:06.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.166+0000 7f4f11600700 1 -- 172.21.15.111:0/2426943327 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f4f0809e980 con 0x7f4f141003b0 2024-09-11T00:16:06.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.166+0000 7f4f13e00700 1 --2- 172.21.15.111:0/2426943327 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4efc07a6f0 0x7f4efc07cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:06.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.167+0000 7f4f13e00700 1 --2- 172.21.15.111:0/2426943327 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4efc07a6f0 0x7f4efc07cba0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4f14074840 tx=0x7f4f00009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:06.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.170+0000 7f4f11600700 1 -- 172.21.15.111:0/2426943327 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f4f08062100 con 0x7f4f141003b0 2024-09-11T00:16:06.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.410+0000 7f4f1b400700 1 -- 172.21.15.111:0/2426943327 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f1402cd40 con 0x7f4efc07a6f0 2024-09-11T00:16:06.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.412+0000 7f4f11600700 1 -- 172.21.15.111:0/2426943327 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f4f1402cd40 con 0x7f4efc07a6f0 2024-09-11T00:16:06.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.415+0000 7f4f1b400700 1 -- 172.21.15.111:0/2426943327 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4efc07a6f0 msgr2=0x7f4efc07cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:06.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.415+0000 7f4f1b400700 1 --2- 172.21.15.111:0/2426943327 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4efc07a6f0 0x7f4efc07cba0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4f14074840 tx=0x7f4f00009260 comp rx=0 tx=0).stop 2024-09-11T00:16:06.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.415+0000 7f4f1b400700 1 -- 172.21.15.111:0/2426943327 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f141003b0 msgr2=0x7f4f14073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:06.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.415+0000 7f4f1b400700 1 --2- 172.21.15.111:0/2426943327 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f141003b0 0x7f4f14073050 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4f08005b40 tx=0x7f4f0800f690 comp rx=0 tx=0).stop 2024-09-11T00:16:06.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.415+0000 7f4f1b400700 1 -- 172.21.15.111:0/2426943327 shutdown_connections 2024-09-11T00:16:06.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.415+0000 7f4f1b400700 1 --2- 172.21.15.111:0/2426943327 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4efc07a6f0 0x7f4efc07cba0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.415+0000 7f4f1b400700 1 --2- 172.21.15.111:0/2426943327 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f141003b0 0x7f4f14073050 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.415+0000 7f4f1b400700 1 --2- 172.21.15.111:0/2426943327 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4f14100d50 0x7f4f14073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.415+0000 7f4f1b400700 1 -- 172.21.15.111:0/2426943327 >> 172.21.15.111:0/2426943327 conn(0x7f4f140fbc30 msgr2=0x7f4f140fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:06.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.416+0000 7f4f1b400700 1 -- 172.21.15.111:0/2426943327 shutdown_connections 2024-09-11T00:16:06.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.416+0000 7f4f1b400700 1 -- 172.21.15.111:0/2426943327 wait complete. 2024-09-11T00:16:06.432 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:16:06.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:06 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:06.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:06 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:06.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:06 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:16:06.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:06 smithi203 ceph-mon[69002]: pgmap v128: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-09-11T00:16:06.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.557+0000 7fb02c600700 1 -- 172.21.15.111:0/3454937186 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb024100d70 msgr2=0x7fb024104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:06.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.557+0000 7fb02c600700 1 --2- 172.21.15.111:0/3454937186 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb024100d70 0x7fb024104d40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb010009910 tx=0x7fb010009c20 comp rx=0 tx=0).stop 2024-09-11T00:16:06.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.557+0000 7fb02c600700 1 -- 172.21.15.111:0/3454937186 shutdown_connections 2024-09-11T00:16:06.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.557+0000 7fb02c600700 1 --2- 172.21.15.111:0/3454937186 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb024100d70 0x7fb024104d40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.557+0000 7fb02c600700 1 --2- 172.21.15.111:0/3454937186 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb0241003d0 0x7fb0241007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.557+0000 7fb02c600700 1 -- 172.21.15.111:0/3454937186 >> 172.21.15.111:0/3454937186 conn(0x7fb0240fbc50 msgr2=0x7fb0240fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:06.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.557+0000 7fb02c600700 1 -- 172.21.15.111:0/3454937186 shutdown_connections 2024-09-11T00:16:06.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.557+0000 7fb02c600700 1 -- 172.21.15.111:0/3454937186 wait complete. 2024-09-11T00:16:06.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.558+0000 7fb02c600700 1 Processor -- start 2024-09-11T00:16:06.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.559+0000 7fb02c600700 1 -- start start 2024-09-11T00:16:06.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.559+0000 7fb02c600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb0241003d0 0x7fb024073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:06.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.559+0000 7fb02c600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb024100d70 0x7fb024073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:06.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.559+0000 7fb02c600700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb024073ad0 con 0x7fb0241003d0 2024-09-11T00:16:06.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.559+0000 7fb02c600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb024073c10 con 0x7fb024100d70 2024-09-11T00:16:06.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.559+0000 7fb029c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb0241003d0 0x7fb024073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:06.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.559+0000 7fb029c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb0241003d0 0x7fb024073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:33562/0 (socket says 172.21.15.111:33562) 2024-09-11T00:16:06.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.559+0000 7fb029c00700 1 -- 172.21.15.111:0/2270962907 learned_addr learned my addr 172.21.15.111:0/2270962907 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:16:06.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.559+0000 7fb029200700 1 --2- 172.21.15.111:0/2270962907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb024100d70 0x7fb024073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:06.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.560+0000 7fb029c00700 1 -- 172.21.15.111:0/2270962907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb024100d70 msgr2=0x7fb024073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:06.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.560+0000 7fb029c00700 1 --2- 172.21.15.111:0/2270962907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb024100d70 0x7fb024073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.560+0000 7fb029c00700 1 -- 172.21.15.111:0/2270962907 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0100095f0 con 0x7fb0241003d0 2024-09-11T00:16:06.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.560+0000 7fb029c00700 1 --2- 172.21.15.111:0/2270962907 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb0241003d0 0x7fb024073050 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb01800e920 tx=0x7fb01800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:06.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.560+0000 7fb022000700 1 -- 172.21.15.111:0/2270962907 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb01800c9d0 con 0x7fb0241003d0 2024-09-11T00:16:06.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.560+0000 7fb022000700 1 -- 172.21.15.111:0/2270962907 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb018010430 con 0x7fb0241003d0 2024-09-11T00:16:06.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.560+0000 7fb02c600700 1 -- 172.21.15.111:0/2270962907 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0241a1fd0 con 0x7fb0241003d0 2024-09-11T00:16:06.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.560+0000 7fb022000700 1 -- 172.21.15.111:0/2270962907 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb018018630 con 0x7fb0241003d0 2024-09-11T00:16:06.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.560+0000 7fb02c600700 1 -- 172.21.15.111:0/2270962907 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0241a2380 con 0x7fb0241003d0 2024-09-11T00:16:06.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.561+0000 7fb02c600700 1 -- 172.21.15.111:0/2270962907 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb024108740 con 0x7fb0241003d0 2024-09-11T00:16:06.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.563+0000 7fb022000700 1 -- 172.21.15.111:0/2270962907 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fb0180105a0 con 0x7fb0241003d0 2024-09-11T00:16:06.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.563+0000 7fb022000700 1 --2- 172.21.15.111:0/2270962907 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb00c07a6f0 0x7fb00c07cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:06.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.564+0000 7fb022000700 1 -- 172.21.15.111:0/2270962907 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb018014070 con 0x7fb0241003d0 2024-09-11T00:16:06.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.564+0000 7fb029200700 1 --2- 172.21.15.111:0/2270962907 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb00c07a6f0 0x7fb00c07cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:06.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.565+0000 7fb029200700 1 --2- 172.21.15.111:0/2270962907 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb00c07a6f0 0x7fb00c07cba0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb010009fd0 tx=0x7fb010005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:06.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.568+0000 7fb022000700 1 -- 172.21.15.111:0/2270962907 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fb018060bd0 con 0x7fb0241003d0 2024-09-11T00:16:06.767 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:06 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:06.767 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:06 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:06.768 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:06 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:16:06.768 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:06 smithi111 ceph-mon[90842]: pgmap v128: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-09-11T00:16:06.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.814+0000 7fb02c600700 1 -- 172.21.15.111:0/2270962907 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb02402cd40 con 0x7fb00c07a6f0 2024-09-11T00:16:06.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.815+0000 7fb022000700 1 -- 172.21.15.111:0/2270962907 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb02402cd40 con 0x7fb00c07a6f0 2024-09-11T00:16:06.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.818+0000 7fb02c600700 1 -- 172.21.15.111:0/2270962907 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb00c07a6f0 msgr2=0x7fb00c07cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:06.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.818+0000 7fb02c600700 1 --2- 172.21.15.111:0/2270962907 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb00c07a6f0 0x7fb00c07cba0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb010009fd0 tx=0x7fb010005a90 comp rx=0 tx=0).stop 2024-09-11T00:16:06.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.818+0000 7fb02c600700 1 -- 172.21.15.111:0/2270962907 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb0241003d0 msgr2=0x7fb024073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:06.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.818+0000 7fb02c600700 1 --2- 172.21.15.111:0/2270962907 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb0241003d0 0x7fb024073050 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb01800e920 tx=0x7fb01800ec30 comp rx=0 tx=0).stop 2024-09-11T00:16:06.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.818+0000 7fb02c600700 1 -- 172.21.15.111:0/2270962907 shutdown_connections 2024-09-11T00:16:06.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.818+0000 7fb02c600700 1 --2- 172.21.15.111:0/2270962907 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb00c07a6f0 0x7fb00c07cba0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.818+0000 7fb02c600700 1 --2- 172.21.15.111:0/2270962907 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb0241003d0 0x7fb024073050 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.818+0000 7fb02c600700 1 --2- 172.21.15.111:0/2270962907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb024100d70 0x7fb024073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.818+0000 7fb02c600700 1 -- 172.21.15.111:0/2270962907 >> 172.21.15.111:0/2270962907 conn(0x7fb0240fbc50 msgr2=0x7fb0240fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:06.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.819+0000 7fb02c600700 1 -- 172.21.15.111:0/2270962907 shutdown_connections 2024-09-11T00:16:06.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.819+0000 7fb02c600700 1 -- 172.21.15.111:0/2270962907 wait complete. 2024-09-11T00:16:06.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.954+0000 7fb64b200700 1 -- 172.21.15.111:0/1293081786 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb644100d50 msgr2=0x7fb644104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:06.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.954+0000 7fb64b200700 1 --2- 172.21.15.111:0/1293081786 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb644100d50 0x7fb644104d20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb630009910 tx=0x7fb630009c20 comp rx=0 tx=0).stop 2024-09-11T00:16:06.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.954+0000 7fb64b200700 1 -- 172.21.15.111:0/1293081786 shutdown_connections 2024-09-11T00:16:06.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.954+0000 7fb64b200700 1 --2- 172.21.15.111:0/1293081786 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb644100d50 0x7fb644104d20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.954+0000 7fb64b200700 1 --2- 172.21.15.111:0/1293081786 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb6441003b0 0x7fb644100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.954+0000 7fb64b200700 1 -- 172.21.15.111:0/1293081786 >> 172.21.15.111:0/1293081786 conn(0x7fb6440fbc30 msgr2=0x7fb6440fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:06.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.954+0000 7fb64b200700 1 -- 172.21.15.111:0/1293081786 shutdown_connections 2024-09-11T00:16:06.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.954+0000 7fb64b200700 1 -- 172.21.15.111:0/1293081786 wait complete. 2024-09-11T00:16:06.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.955+0000 7fb64b200700 1 Processor -- start 2024-09-11T00:16:06.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.956+0000 7fb64b200700 1 -- start start 2024-09-11T00:16:06.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.956+0000 7fb64b200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb6441003b0 0x7fb644195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:06.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.956+0000 7fb64b200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb644100d50 0x7fb644196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:06.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.956+0000 7fb64b200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6441969e0 con 0x7fb6441003b0 2024-09-11T00:16:06.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.956+0000 7fb64b200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64419a770 con 0x7fb644100d50 2024-09-11T00:16:06.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.956+0000 7fb643e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb6441003b0 0x7fb644195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:06.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.956+0000 7fb643e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb6441003b0 0x7fb644195dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:33578/0 (socket says 172.21.15.111:33578) 2024-09-11T00:16:06.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.956+0000 7fb643e00700 1 -- 172.21.15.111:0/2723531198 learned_addr learned my addr 172.21.15.111:0/2723531198 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:16:06.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.957+0000 7fb643400700 1 --2- 172.21.15.111:0/2723531198 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb644100d50 0x7fb644196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:06.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.957+0000 7fb643e00700 1 -- 172.21.15.111:0/2723531198 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb644100d50 msgr2=0x7fb644196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:06.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.957+0000 7fb643e00700 1 --2- 172.21.15.111:0/2723531198 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb644100d50 0x7fb644196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.957+0000 7fb643e00700 1 -- 172.21.15.111:0/2723531198 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6300095f0 con 0x7fb6441003b0 2024-09-11T00:16:06.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.957+0000 7fb643400700 1 --2- 172.21.15.111:0/2723531198 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb644100d50 0x7fb644196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:16:06.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.957+0000 7fb643e00700 1 --2- 172.21.15.111:0/2723531198 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb6441003b0 0x7fb644195dc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb63400d8d0 tx=0x7fb63400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:06.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.957+0000 7fb640c00700 1 -- 172.21.15.111:0/2723531198 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb634009940 con 0x7fb6441003b0 2024-09-11T00:16:06.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.957+0000 7fb640c00700 1 -- 172.21.15.111:0/2723531198 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb634010460 con 0x7fb6441003b0 2024-09-11T00:16:06.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.957+0000 7fb64b200700 1 -- 172.21.15.111:0/2723531198 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb64419aa50 con 0x7fb6441003b0 2024-09-11T00:16:06.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.957+0000 7fb640c00700 1 -- 172.21.15.111:0/2723531198 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb63400f5f0 con 0x7fb6441003b0 2024-09-11T00:16:06.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.957+0000 7fb64b200700 1 -- 172.21.15.111:0/2723531198 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb64419afa0 con 0x7fb6441003b0 2024-09-11T00:16:06.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.958+0000 7fb64b200700 1 -- 172.21.15.111:0/2723531198 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb644108720 con 0x7fb6441003b0 2024-09-11T00:16:06.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.960+0000 7fb640c00700 1 -- 172.21.15.111:0/2723531198 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fb6340105d0 con 0x7fb6441003b0 2024-09-11T00:16:06.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.961+0000 7fb640c00700 1 --2- 172.21.15.111:0/2723531198 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb62807a6f0 0x7fb62807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:06.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.961+0000 7fb640c00700 1 -- 172.21.15.111:0/2723531198 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb63409d210 con 0x7fb6441003b0 2024-09-11T00:16:06.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.962+0000 7fb643400700 1 --2- 172.21.15.111:0/2723531198 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb62807a6f0 0x7fb62807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:06.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.962+0000 7fb643400700 1 --2- 172.21.15.111:0/2723531198 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb62807a6f0 0x7fb62807cba0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb630006010 tx=0x7fb63000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:06.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:06.967+0000 7fb640c00700 1 -- 172.21.15.111:0/2723531198 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fb634060990 con 0x7fb6441003b0 2024-09-11T00:16:07.045 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:06 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3[78746]: 2024-09-11T00:16:06.677+0000 7f7efdc95640 -1 Falling back to public interface 2024-09-11T00:16:07.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.200+0000 7fb64b200700 1 -- 172.21.15.111:0/2723531198 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb64419b320 con 0x7fb62807a6f0 2024-09-11T00:16:07.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.209+0000 7fb640c00700 1 -- 172.21.15.111:0/2723531198 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fb64419b320 con 0x7fb62807a6f0 2024-09-11T00:16:07.212 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:16:07.212 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (5m) 35s ago 19m 14.7M - 0.27.0 11f11916f8cd d6d3253e881f 2024-09-11T00:16:07.212 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (8m) 35s ago 19m 8186k - 18.2.0 dc2bc1663786 7c40af85314c 2024-09-11T00:16:07.212 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi203 smithi203 running (8m) 2m ago 18m 7730k - 18.2.0 dc2bc1663786 922e3261ff70 2024-09-11T00:16:07.212 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (2m) 35s ago 19m 6899k - 19.3.0-4854-g8f219c47 589dd18248e4 a9cacdb9a638 2024-09-11T00:16:07.212 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi203 smithi203 running (2m) 2m ago 18m 6899k - 19.3.0-4854-g8f219c47 589dd18248e4 d452d9dfa04b 2024-09-11T00:16:07.212 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (5m) 35s ago 18m 67.6M - c8b91775d855 7d3b50b5b59f 2024-09-11T00:16:07.212 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.gmgsay smithi111 running (12m) 35s ago 12m 18.3M - 18.2.0 dc2bc1663786 795e4ff0075c 2024-09-11T00:16:07.212 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.rucaba smithi111 running (12m) 35s ago 12m 18.2M - 18.2.0 dc2bc1663786 02885adac62c 2024-09-11T00:16:07.212 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.tcrqop smithi203 running (12m) 2m ago 12m 150M - 18.2.0 dc2bc1663786 4df492159bb4 2024-09-11T00:16:07.213 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.uqkbkn smithi203 running (12m) 2m ago 12m 17.6M - 18.2.0 dc2bc1663786 619aa58ea314 2024-09-11T00:16:07.213 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.ypucji smithi111 *:8443,9283,8765 running (7m) 35s ago 20m 514M - 19.3.0-4854-g8f219c47 589dd18248e4 07fa31f49618 2024-09-11T00:16:07.213 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi203.smuspl smithi203 *:8443,9283,8765 running (6m) 2m ago 18m 454M - 19.3.0-4854-g8f219c47 589dd18248e4 7e5a93a5ffa7 2024-09-11T00:16:07.213 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (3m) 35s ago 21m 48.4M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 3c29c070a612 2024-09-11T00:16:07.213 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi203 smithi203 running (3m) 2m ago 17m 36.1M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 45e8285e4b4d 2024-09-11T00:16:07.213 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (6m) 35s ago 19m 7792k - 1.7.0 72c9c2088986 ec478ea14488 2024-09-11T00:16:07.213 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi203 smithi203 *:9100 running (6m) 2m ago 18m 7209k - 1.7.0 72c9c2088986 54d461cde1bc 2024-09-11T00:16:07.213 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (2m) 35s ago 16m 88.9M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 d2f1a2312736 2024-09-11T00:16:07.213 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (81s) 35s ago 15m 90.1M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 19cf95ecca7d 2024-09-11T00:16:07.213 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (42s) 35s ago 15m 10.4M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 3a3b318b337a 2024-09-11T00:16:07.213 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi203 starting - - - 2240M 2024-09-11T00:16:07.214 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi203 running (14m) 2m ago 14m 209M 2240M 18.2.0 dc2bc1663786 769c7942c42b 2024-09-11T00:16:07.214 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi203 running (13m) 2m ago 13m 194M 2240M 18.2.0 dc2bc1663786 6d824001d40c 2024-09-11T00:16:07.214 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (6m) 35s ago 18m 60.1M - 2.51.0 1d3b7f56885b 3e72ac10983d 2024-09-11T00:16:07.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.213+0000 7fb64b200700 1 -- 172.21.15.111:0/2723531198 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb62807a6f0 msgr2=0x7fb62807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:07.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.213+0000 7fb64b200700 1 --2- 172.21.15.111:0/2723531198 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb62807a6f0 0x7fb62807cba0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb630006010 tx=0x7fb63000b540 comp rx=0 tx=0).stop 2024-09-11T00:16:07.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.213+0000 7fb64b200700 1 -- 172.21.15.111:0/2723531198 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb6441003b0 msgr2=0x7fb644195dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:07.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.213+0000 7fb64b200700 1 --2- 172.21.15.111:0/2723531198 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb6441003b0 0x7fb644195dc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb63400d8d0 tx=0x7fb63400dc90 comp rx=0 tx=0).stop 2024-09-11T00:16:07.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.213+0000 7fb64b200700 1 -- 172.21.15.111:0/2723531198 shutdown_connections 2024-09-11T00:16:07.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.213+0000 7fb64b200700 1 --2- 172.21.15.111:0/2723531198 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb62807a6f0 0x7fb62807cba0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:07.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.213+0000 7fb64b200700 1 --2- 172.21.15.111:0/2723531198 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb6441003b0 0x7fb644195dc0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:07.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.213+0000 7fb64b200700 1 --2- 172.21.15.111:0/2723531198 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb644100d50 0x7fb644196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:07.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.213+0000 7fb64b200700 1 -- 172.21.15.111:0/2723531198 >> 172.21.15.111:0/2723531198 conn(0x7fb6440fbc30 msgr2=0x7fb6440fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:07.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.213+0000 7fb64b200700 1 -- 172.21.15.111:0/2723531198 shutdown_connections 2024-09-11T00:16:07.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.213+0000 7fb64b200700 1 -- 172.21.15.111:0/2723531198 wait complete. 2024-09-11T00:16:07.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.349+0000 7fab56400700 1 -- 172.21.15.111:0/1569940592 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab50101330 msgr2=0x7fab50101700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:07.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.349+0000 7fab56400700 1 --2- 172.21.15.111:0/1569940592 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab50101330 0x7fab50101700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fab40009940 tx=0x7fab40009c50 comp rx=0 tx=0).stop 2024-09-11T00:16:07.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.349+0000 7fab56400700 1 -- 172.21.15.111:0/1569940592 shutdown_connections 2024-09-11T00:16:07.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.349+0000 7fab56400700 1 --2- 172.21.15.111:0/1569940592 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab50101c40 0x7fab5010a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:07.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.349+0000 7fab56400700 1 --2- 172.21.15.111:0/1569940592 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab50101330 0x7fab50101700 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:07.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.349+0000 7fab56400700 1 -- 172.21.15.111:0/1569940592 >> 172.21.15.111:0/1569940592 conn(0x7fab500fabb0 msgr2=0x7fab500fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:07.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.349+0000 7fab56400700 1 -- 172.21.15.111:0/1569940592 shutdown_connections 2024-09-11T00:16:07.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.349+0000 7fab56400700 1 -- 172.21.15.111:0/1569940592 wait complete. 2024-09-11T00:16:07.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.350+0000 7fab56400700 1 Processor -- start 2024-09-11T00:16:07.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.350+0000 7fab56400700 1 -- start start 2024-09-11T00:16:07.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.350+0000 7fab56400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab50101330 0x7fab50197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:07.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.350+0000 7fab56400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab50101c40 0x7fab50198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:07.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.350+0000 7fab56400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab50198b20 con 0x7fab50101330 2024-09-11T00:16:07.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.350+0000 7fab56400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5019c8b0 con 0x7fab50101c40 2024-09-11T00:16:07.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.351+0000 7fab4f400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab50101330 0x7fab50197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:07.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.351+0000 7fab4f400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab50101330 0x7fab50197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:33592/0 (socket says 172.21.15.111:33592) 2024-09-11T00:16:07.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.351+0000 7fab4f400700 1 -- 172.21.15.111:0/1097667742 learned_addr learned my addr 172.21.15.111:0/1097667742 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:16:07.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.351+0000 7fab4ea00700 1 --2- 172.21.15.111:0/1097667742 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab50101c40 0x7fab50198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:07.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.351+0000 7fab4f400700 1 -- 172.21.15.111:0/1097667742 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab50101c40 msgr2=0x7fab50198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:07.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.351+0000 7fab4f400700 1 --2- 172.21.15.111:0/1097667742 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab50101c40 0x7fab50198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:07.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.351+0000 7fab4f400700 1 -- 172.21.15.111:0/1097667742 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab400095f0 con 0x7fab50101330 2024-09-11T00:16:07.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.352+0000 7fab4f400700 1 --2- 172.21.15.111:0/1097667742 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab50101330 0x7fab50197f00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fab4000bb10 tx=0x7fab4000bbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:07.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.352+0000 7fab47e00700 1 -- 172.21.15.111:0/1097667742 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab4001d070 con 0x7fab50101330 2024-09-11T00:16:07.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.352+0000 7fab47e00700 1 -- 172.21.15.111:0/1097667742 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fab4000be80 con 0x7fab50101330 2024-09-11T00:16:07.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.352+0000 7fab56400700 1 -- 172.21.15.111:0/1097667742 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab5019cb30 con 0x7fab50101330 2024-09-11T00:16:07.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.352+0000 7fab47e00700 1 -- 172.21.15.111:0/1097667742 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab40021410 con 0x7fab50101330 2024-09-11T00:16:07.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.352+0000 7fab56400700 1 -- 172.21.15.111:0/1097667742 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab5019d020 con 0x7fab50101330 2024-09-11T00:16:07.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.353+0000 7fab56400700 1 -- 172.21.15.111:0/1097667742 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab50109c10 con 0x7fab50101330 2024-09-11T00:16:07.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.354+0000 7fab47e00700 1 -- 172.21.15.111:0/1097667742 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fab4000f7f0 con 0x7fab50101330 2024-09-11T00:16:07.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.355+0000 7fab47e00700 1 --2- 172.21.15.111:0/1097667742 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fab3407a6f0 0x7fab3407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:07.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.355+0000 7fab47e00700 1 -- 172.21.15.111:0/1097667742 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fab4009e400 con 0x7fab50101330 2024-09-11T00:16:07.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.355+0000 7fab4ea00700 1 --2- 172.21.15.111:0/1097667742 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fab3407a6f0 0x7fab3407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:07.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.356+0000 7fab4ea00700 1 --2- 172.21.15.111:0/1097667742 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fab3407a6f0 0x7fab3407cba0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fab50199520 tx=0x7fab3c009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:07.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.359+0000 7fab47e00700 1 -- 172.21.15.111:0/1097667742 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fab40061b80 con 0x7fab50101330 2024-09-11T00:16:07.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:07 smithi111 ceph-mon[90842]: from='client.44231 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:16:07.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:07 smithi111 ceph-mon[90842]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-11T00:16:07.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:07 smithi111 ceph-mon[90842]: Health check update: Degraded data redundancy: 59/264 objects degraded (22.348%), 18 pgs degraded (PG_DEGRADED) 2024-09-11T00:16:07.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.675+0000 7fab56400700 1 -- 172.21.15.111:0/1097667742 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fab5002ccd0 con 0x7fab50101330 2024-09-11T00:16:07.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.676+0000 7fab47e00700 1 -- 172.21.15.111:0/1097667742 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7fab40064ca0 con 0x7fab50101330 2024-09-11T00:16:07.679 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:16:07.679 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-11T00:16:07.679 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:16:07.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:16:07.679 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-11T00:16:07.679 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:16:07.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:16:07.679 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-11T00:16:07.679 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-09-11T00:16:07.679 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 3 2024-09-11T00:16:07.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:16:07.679 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-11T00:16:07.679 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-11T00:16:07.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:16:07.680 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-11T00:16:07.680 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6, 2024-09-11T00:16:07.680 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 7 2024-09-11T00:16:07.680 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-11T00:16:07.680 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:16:07.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.679+0000 7fab56400700 1 -- 172.21.15.111:0/1097667742 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fab3407a6f0 msgr2=0x7fab3407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:07.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.679+0000 7fab56400700 1 --2- 172.21.15.111:0/1097667742 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fab3407a6f0 0x7fab3407cba0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fab50199520 tx=0x7fab3c009260 comp rx=0 tx=0).stop 2024-09-11T00:16:07.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.679+0000 7fab56400700 1 -- 172.21.15.111:0/1097667742 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab50101330 msgr2=0x7fab50197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:07.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.679+0000 7fab56400700 1 --2- 172.21.15.111:0/1097667742 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab50101330 0x7fab50197f00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fab4000bb10 tx=0x7fab4000bbf0 comp rx=0 tx=0).stop 2024-09-11T00:16:07.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.679+0000 7fab56400700 1 -- 172.21.15.111:0/1097667742 shutdown_connections 2024-09-11T00:16:07.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.679+0000 7fab56400700 1 --2- 172.21.15.111:0/1097667742 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fab3407a6f0 0x7fab3407cba0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:07.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.679+0000 7fab56400700 1 --2- 172.21.15.111:0/1097667742 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab50101330 0x7fab50197f00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:07.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.679+0000 7fab56400700 1 --2- 172.21.15.111:0/1097667742 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab50101c40 0x7fab50198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:07.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.679+0000 7fab56400700 1 -- 172.21.15.111:0/1097667742 >> 172.21.15.111:0/1097667742 conn(0x7fab500fabb0 msgr2=0x7fab50106d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:07.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.679+0000 7fab56400700 1 -- 172.21.15.111:0/1097667742 shutdown_connections 2024-09-11T00:16:07.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.679+0000 7fab56400700 1 -- 172.21.15.111:0/1097667742 wait complete. 2024-09-11T00:16:07.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:07 smithi203 ceph-mon[69002]: from='client.44231 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:16:07.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:07 smithi203 ceph-mon[69002]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-11T00:16:07.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:07 smithi203 ceph-mon[69002]: Health check update: Degraded data redundancy: 59/264 objects degraded (22.348%), 18 pgs degraded (PG_DEGRADED) 2024-09-11T00:16:07.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.817+0000 7fd18a800700 1 -- 172.21.15.111:0/310546999 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1841001b0 msgr2=0x7fd184100580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:07.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.817+0000 7fd18a800700 1 --2- 172.21.15.111:0/310546999 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1841001b0 0x7fd184100580 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd178009910 tx=0x7fd178009c20 comp rx=0 tx=0).stop 2024-09-11T00:16:07.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.817+0000 7fd18a800700 1 -- 172.21.15.111:0/310546999 shutdown_connections 2024-09-11T00:16:07.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.817+0000 7fd18a800700 1 --2- 172.21.15.111:0/310546999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd184100b50 0x7fd184104b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:07.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.817+0000 7fd18a800700 1 --2- 172.21.15.111:0/310546999 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1841001b0 0x7fd184100580 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:07.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.817+0000 7fd18a800700 1 -- 172.21.15.111:0/310546999 >> 172.21.15.111:0/310546999 conn(0x7fd1840fba30 msgr2=0x7fd1840fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:07.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.817+0000 7fd18a800700 1 -- 172.21.15.111:0/310546999 shutdown_connections 2024-09-11T00:16:07.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.817+0000 7fd18a800700 1 -- 172.21.15.111:0/310546999 wait complete. 2024-09-11T00:16:07.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.818+0000 7fd18a800700 1 Processor -- start 2024-09-11T00:16:07.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.818+0000 7fd18a800700 1 -- start start 2024-09-11T00:16:07.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.819+0000 7fd18a800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd1841001b0 0x7fd18419b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:07.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.819+0000 7fd18a800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd184100b50 0x7fd18419be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:07.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.819+0000 7fd18a800700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18419c490 con 0x7fd184100b50 2024-09-11T00:16:07.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.819+0000 7fd18a800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd184195940 con 0x7fd1841001b0 2024-09-11T00:16:07.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.819+0000 7fd188a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd184100b50 0x7fd18419be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:07.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.819+0000 7fd188a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd184100b50 0x7fd18419be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:36786/0 (socket says 172.21.15.111:36786) 2024-09-11T00:16:07.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.819+0000 7fd188a00700 1 -- 172.21.15.111:0/4084547900 learned_addr learned my addr 172.21.15.111:0/4084547900 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:16:07.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.819+0000 7fd189400700 1 --2- 172.21.15.111:0/4084547900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd1841001b0 0x7fd18419b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:07.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.819+0000 7fd188a00700 1 -- 172.21.15.111:0/4084547900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd1841001b0 msgr2=0x7fd18419b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:07.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.819+0000 7fd188a00700 1 --2- 172.21.15.111:0/4084547900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd1841001b0 0x7fd18419b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:07.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.820+0000 7fd188a00700 1 -- 172.21.15.111:0/4084547900 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1780095f0 con 0x7fd184100b50 2024-09-11T00:16:07.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.820+0000 7fd188a00700 1 --2- 172.21.15.111:0/4084547900 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd184100b50 0x7fd18419be00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd17000e8f0 tx=0x7fd17000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:07.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.820+0000 7fd182000700 1 -- 172.21.15.111:0/4084547900 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd170009790 con 0x7fd184100b50 2024-09-11T00:16:07.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.820+0000 7fd182000700 1 -- 172.21.15.111:0/4084547900 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd17000c810 con 0x7fd184100b50 2024-09-11T00:16:07.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.820+0000 7fd182000700 1 -- 172.21.15.111:0/4084547900 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd170005580 con 0x7fd184100b50 2024-09-11T00:16:07.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.820+0000 7fd18a800700 1 -- 172.21.15.111:0/4084547900 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd184195c20 con 0x7fd184100b50 2024-09-11T00:16:07.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.820+0000 7fd18a800700 1 -- 172.21.15.111:0/4084547900 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd184196170 con 0x7fd184100b50 2024-09-11T00:16:07.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.821+0000 7fd18a800700 1 -- 172.21.15.111:0/4084547900 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1841084c0 con 0x7fd184100b50 2024-09-11T00:16:07.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.823+0000 7fd182000700 1 -- 172.21.15.111:0/4084547900 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fd17000c980 con 0x7fd184100b50 2024-09-11T00:16:07.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.823+0000 7fd182000700 1 --2- 172.21.15.111:0/4084547900 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd16c07a6f0 0x7fd16c07cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:07.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.824+0000 7fd182000700 1 -- 172.21.15.111:0/4084547900 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd170014070 con 0x7fd184100b50 2024-09-11T00:16:07.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.824+0000 7fd189400700 1 --2- 172.21.15.111:0/4084547900 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd16c07a6f0 0x7fd16c07cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:07.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.824+0000 7fd189400700 1 --2- 172.21.15.111:0/4084547900 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd16c07a6f0 0x7fd16c07cba0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd17800b760 tx=0x7fd178005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:07.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:07.828+0000 7fd182000700 1 -- 172.21.15.111:0/4084547900 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fd170060c70 con 0x7fd184100b50 2024-09-11T00:16:08.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.094+0000 7fd18a800700 1 -- 172.21.15.111:0/4084547900 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd18404f2a0 con 0x7fd184100b50 2024-09-11T00:16:08.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.095+0000 7fd182000700 1 -- 172.21.15.111:0/4084547900 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1921 (secure 0 0 0) 0x7fd170063d90 con 0x7fd184100b50 2024-09-11T00:16:08.097 INFO:teuthology.orchestra.run.smithi111.stdout:e15 2024-09-11T00:16:08.097 INFO:teuthology.orchestra.run.smithi111.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-11T00:16:08.097 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T00:16:08.098 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:16:08.098 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-11T00:16:08.098 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:16:08.098 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-11T00:16:08.098 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-11T00:16:08.098 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 14 2024-09-11T00:16:08.098 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-11T00:16:08.098 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-11T00:03:47.950356+0000 2024-09-11T00:16:08.098 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-11T00:04:06.275905+0000 2024-09-11T00:16:08.098 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-11T00:16:08.098 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-11T00:16:08.098 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-11T00:16:08.098 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-11T00:16:08.099 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-11T00:16:08.099 INFO:teuthology.orchestra.run.smithi111.stdout:max_xattr_size 65536 2024-09-11T00:16:08.099 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-11T00:16:08.099 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-11T00:16:08.099 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 47 2024-09-11T00:16:08.099 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:16:08.099 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-11T00:16:08.099 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-11T00:16:08.099 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=24363} 2024-09-11T00:16:08.099 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-11T00:16:08.099 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-11T00:16:08.099 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-11T00:16:08.099 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-11T00:16:08.100 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-11T00:16:08.100 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data enabled 2024-09-11T00:16:08.100 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-11T00:16:08.100 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-11T00:16:08.100 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 1 2024-09-11T00:16:08.100 INFO:teuthology.orchestra.run.smithi111.stdout:qdb_cluster leader: 0 members: 2024-09-11T00:16:08.100 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.tcrqop{0:24363} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.203:6824/3082736449,v1:172.21.15.203:6825/3082736449] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:16:08.100 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:16:08.100 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:16:08.100 INFO:teuthology.orchestra.run.smithi111.stdout:Standby daemons: 2024-09-11T00:16:08.100 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:16:08.100 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.rucaba{-1:14554} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6828/2045133285,v1:172.21.15.111:6829/2045133285] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:16:08.100 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.gmgsay{-1:14566} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.111:6826/1122545830,v1:172.21.15.111:6827/1122545830] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:16:08.100 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.uqkbkn{-1:24379} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.203:6826/695613114,v1:172.21.15.203:6827/695613114] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:16:08.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.098+0000 7fd18a800700 1 -- 172.21.15.111:0/4084547900 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd16c07a6f0 msgr2=0x7fd16c07cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:08.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.098+0000 7fd18a800700 1 --2- 172.21.15.111:0/4084547900 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd16c07a6f0 0x7fd16c07cba0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd17800b760 tx=0x7fd178005a90 comp rx=0 tx=0).stop 2024-09-11T00:16:08.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.098+0000 7fd18a800700 1 -- 172.21.15.111:0/4084547900 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd184100b50 msgr2=0x7fd18419be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:08.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.098+0000 7fd18a800700 1 --2- 172.21.15.111:0/4084547900 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd184100b50 0x7fd18419be00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd17000e8f0 tx=0x7fd17000ec00 comp rx=0 tx=0).stop 2024-09-11T00:16:08.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.098+0000 7fd18a800700 1 -- 172.21.15.111:0/4084547900 shutdown_connections 2024-09-11T00:16:08.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.098+0000 7fd18a800700 1 --2- 172.21.15.111:0/4084547900 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd16c07a6f0 0x7fd16c07cba0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.098+0000 7fd18a800700 1 --2- 172.21.15.111:0/4084547900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd1841001b0 0x7fd18419b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.098+0000 7fd18a800700 1 --2- 172.21.15.111:0/4084547900 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd184100b50 0x7fd18419be00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.098+0000 7fd18a800700 1 -- 172.21.15.111:0/4084547900 >> 172.21.15.111:0/4084547900 conn(0x7fd1840fba30 msgr2=0x7fd1840fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:08.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.098+0000 7fd18a800700 1 -- 172.21.15.111:0/4084547900 shutdown_connections 2024-09-11T00:16:08.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.098+0000 7fd18a800700 1 -- 172.21.15.111:0/4084547900 wait complete. 2024-09-11T00:16:08.102 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 15 2024-09-11T00:16:08.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.237+0000 7fba45e00700 1 -- 172.21.15.111:0/3003973373 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba40102610 msgr2=0x7fba401029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:08.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.237+0000 7fba45e00700 1 --2- 172.21.15.111:0/3003973373 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba40102610 0x7fba401029e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fba30009910 tx=0x7fba30009c20 comp rx=0 tx=0).stop 2024-09-11T00:16:08.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.237+0000 7fba45e00700 1 -- 172.21.15.111:0/3003973373 shutdown_connections 2024-09-11T00:16:08.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.237+0000 7fba45e00700 1 --2- 172.21.15.111:0/3003973373 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba40102fb0 0x7fba40106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.237+0000 7fba45e00700 1 --2- 172.21.15.111:0/3003973373 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba40102610 0x7fba401029e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.237+0000 7fba45e00700 1 -- 172.21.15.111:0/3003973373 >> 172.21.15.111:0/3003973373 conn(0x7fba400fde90 msgr2=0x7fba401002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:08.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.237+0000 7fba45e00700 1 -- 172.21.15.111:0/3003973373 shutdown_connections 2024-09-11T00:16:08.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.237+0000 7fba45e00700 1 -- 172.21.15.111:0/3003973373 wait complete. 2024-09-11T00:16:08.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.238+0000 7fba45e00700 1 Processor -- start 2024-09-11T00:16:08.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.239+0000 7fba45e00700 1 -- start start 2024-09-11T00:16:08.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.239+0000 7fba45e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba40102610 0x7fba40197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:08.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.239+0000 7fba45e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba40102fb0 0x7fba40198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:08.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.239+0000 7fba45e00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba40198be0 con 0x7fba40102fb0 2024-09-11T00:16:08.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.239+0000 7fba45e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4019c970 con 0x7fba40102610 2024-09-11T00:16:08.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.239+0000 7fba36000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba40102fb0 0x7fba40198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:08.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.239+0000 7fba36000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba40102fb0 0x7fba40198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:36804/0 (socket says 172.21.15.111:36804) 2024-09-11T00:16:08.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.239+0000 7fba36000700 1 -- 172.21.15.111:0/1750011280 learned_addr learned my addr 172.21.15.111:0/1750011280 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:16:08.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.239+0000 7fba3ea00700 1 --2- 172.21.15.111:0/1750011280 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba40102610 0x7fba40197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:08.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.240+0000 7fba36000700 1 -- 172.21.15.111:0/1750011280 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba40102610 msgr2=0x7fba40197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:08.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.240+0000 7fba36000700 1 --2- 172.21.15.111:0/1750011280 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba40102610 0x7fba40197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.240+0000 7fba36000700 1 -- 172.21.15.111:0/1750011280 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba300095f0 con 0x7fba40102fb0 2024-09-11T00:16:08.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.240+0000 7fba36000700 1 --2- 172.21.15.111:0/1750011280 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba40102fb0 0x7fba40198500 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fba28007e90 tx=0x7fba2800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:08.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.240+0000 7fba44a00700 1 -- 172.21.15.111:0/1750011280 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba2800dda0 con 0x7fba40102fb0 2024-09-11T00:16:08.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.240+0000 7fba44a00700 1 -- 172.21.15.111:0/1750011280 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba2800f040 con 0x7fba40102fb0 2024-09-11T00:16:08.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.240+0000 7fba45e00700 1 -- 172.21.15.111:0/1750011280 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba4019cc50 con 0x7fba40102fb0 2024-09-11T00:16:08.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.240+0000 7fba44a00700 1 -- 172.21.15.111:0/1750011280 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba280125f0 con 0x7fba40102fb0 2024-09-11T00:16:08.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.240+0000 7fba45e00700 1 -- 172.21.15.111:0/1750011280 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba4019d1a0 con 0x7fba40102fb0 2024-09-11T00:16:08.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.241+0000 7fba45e00700 1 -- 172.21.15.111:0/1750011280 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba4004ea50 con 0x7fba40102fb0 2024-09-11T00:16:08.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.243+0000 7fba44a00700 1 -- 172.21.15.111:0/1750011280 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fba280133f0 con 0x7fba40102fb0 2024-09-11T00:16:08.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.244+0000 7fba44a00700 1 --2- 172.21.15.111:0/1750011280 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fba2407a6f0 0x7fba2407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:08.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.244+0000 7fba44a00700 1 -- 172.21.15.111:0/1750011280 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fba2809cab0 con 0x7fba40102fb0 2024-09-11T00:16:08.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.244+0000 7fba3ea00700 1 --2- 172.21.15.111:0/1750011280 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fba2407a6f0 0x7fba2407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:08.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.245+0000 7fba3ea00700 1 --2- 172.21.15.111:0/1750011280 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fba2407a6f0 0x7fba2407cba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fba3000b5c0 tx=0x7fba3001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:08.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.248+0000 7fba44a00700 1 -- 172.21.15.111:0/1750011280 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fba2809ee60 con 0x7fba40102fb0 2024-09-11T00:16:08.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.494+0000 7fba45e00700 1 -- 172.21.15.111:0/1750011280 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fba4019d6d0 con 0x7fba2407a6f0 2024-09-11T00:16:08.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.496+0000 7fba44a00700 1 -- 172.21.15.111:0/1750011280 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fba4019d6d0 con 0x7fba2407a6f0 2024-09-11T00:16:08.498 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:16:08.498 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e", 2024-09-11T00:16:08.498 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-11T00:16:08.498 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-11T00:16:08.498 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-11T00:16:08.498 INFO:teuthology.orchestra.run.smithi111.stdout: "crash", 2024-09-11T00:16:08.498 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr", 2024-09-11T00:16:08.498 INFO:teuthology.orchestra.run.smithi111.stdout: "mon" 2024-09-11T00:16:08.498 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-11T00:16:08.499 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "9/23 daemons upgraded", 2024-09-11T00:16:08.499 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading osd daemons", 2024-09-11T00:16:08.499 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-11T00:16:08.499 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:16:08.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.498+0000 7fba45e00700 1 -- 172.21.15.111:0/1750011280 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fba2407a6f0 msgr2=0x7fba2407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:08.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.498+0000 7fba45e00700 1 --2- 172.21.15.111:0/1750011280 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fba2407a6f0 0x7fba2407cba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fba3000b5c0 tx=0x7fba3001a040 comp rx=0 tx=0).stop 2024-09-11T00:16:08.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.498+0000 7fba45e00700 1 -- 172.21.15.111:0/1750011280 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba40102fb0 msgr2=0x7fba40198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:08.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.498+0000 7fba45e00700 1 --2- 172.21.15.111:0/1750011280 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba40102fb0 0x7fba40198500 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fba28007e90 tx=0x7fba2800d3b0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.499+0000 7fba45e00700 1 -- 172.21.15.111:0/1750011280 shutdown_connections 2024-09-11T00:16:08.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.499+0000 7fba45e00700 1 --2- 172.21.15.111:0/1750011280 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fba2407a6f0 0x7fba2407cba0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.499+0000 7fba45e00700 1 --2- 172.21.15.111:0/1750011280 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba40102610 0x7fba40197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.499+0000 7fba45e00700 1 --2- 172.21.15.111:0/1750011280 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba40102fb0 0x7fba40198500 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.499+0000 7fba45e00700 1 -- 172.21.15.111:0/1750011280 >> 172.21.15.111:0/1750011280 conn(0x7fba400fde90 msgr2=0x7fba400ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:08.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.499+0000 7fba45e00700 1 -- 172.21.15.111:0/1750011280 shutdown_connections 2024-09-11T00:16:08.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.499+0000 7fba45e00700 1 -- 172.21.15.111:0/1750011280 wait complete. 2024-09-11T00:16:08.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.635+0000 7f8349000700 1 -- 172.21.15.111:0/3028586934 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f83441025f0 msgr2=0x7f83441029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:08.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.635+0000 7f8349000700 1 --2- 172.21.15.111:0/3028586934 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f83441025f0 0x7f83441029c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8334009910 tx=0x7f8334009c20 comp rx=0 tx=0).stop 2024-09-11T00:16:08.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.636+0000 7f8349000700 1 -- 172.21.15.111:0/3028586934 shutdown_connections 2024-09-11T00:16:08.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.636+0000 7f8349000700 1 --2- 172.21.15.111:0/3028586934 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8344102f90 0x7f8344106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.636+0000 7f8349000700 1 --2- 172.21.15.111:0/3028586934 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f83441025f0 0x7f83441029c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.636+0000 7f8349000700 1 -- 172.21.15.111:0/3028586934 >> 172.21.15.111:0/3028586934 conn(0x7f83440fde90 msgr2=0x7f83441002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:08.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.636+0000 7f8349000700 1 -- 172.21.15.111:0/3028586934 shutdown_connections 2024-09-11T00:16:08.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.636+0000 7f8349000700 1 -- 172.21.15.111:0/3028586934 wait complete. 2024-09-11T00:16:08.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.637+0000 7f8349000700 1 Processor -- start 2024-09-11T00:16:08.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.637+0000 7f8349000700 1 -- start start 2024-09-11T00:16:08.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.637+0000 7f8349000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f83441025f0 0x7f8344197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:08.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.637+0000 7f8349000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8344102f90 0x7f8344198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:08.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.637+0000 7f8349000700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8344198b60 con 0x7f83441025f0 2024-09-11T00:16:08.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.637+0000 7f8349000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834419c8f0 con 0x7f8344102f90 2024-09-11T00:16:08.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.637+0000 7f8341e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f83441025f0 0x7f8344197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:08.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.638+0000 7f8341e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f83441025f0 0x7f8344197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:36834/0 (socket says 172.21.15.111:36834) 2024-09-11T00:16:08.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.638+0000 7f8341e00700 1 -- 172.21.15.111:0/82284162 learned_addr learned my addr 172.21.15.111:0/82284162 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:16:08.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.638+0000 7f8341400700 1 --2- 172.21.15.111:0/82284162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8344102f90 0x7f8344198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:08.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.638+0000 7f8341e00700 1 -- 172.21.15.111:0/82284162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8344102f90 msgr2=0x7f8344198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:08.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.638+0000 7f8341e00700 1 --2- 172.21.15.111:0/82284162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8344102f90 0x7f8344198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.638+0000 7f8341e00700 1 -- 172.21.15.111:0/82284162 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83340095f0 con 0x7f83441025f0 2024-09-11T00:16:08.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.638+0000 7f8341e00700 1 --2- 172.21.15.111:0/82284162 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f83441025f0 0x7f8344197f40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f83340092e0 tx=0x7f833400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:08.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.639+0000 7f833aa00700 1 -- 172.21.15.111:0/82284162 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f833401d070 con 0x7f83441025f0 2024-09-11T00:16:08.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.639+0000 7f8349000700 1 -- 172.21.15.111:0/82284162 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f834419cb70 con 0x7f83441025f0 2024-09-11T00:16:08.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.639+0000 7f833aa00700 1 -- 172.21.15.111:0/82284162 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8334005e00 con 0x7f83441025f0 2024-09-11T00:16:08.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.639+0000 7f833aa00700 1 -- 172.21.15.111:0/82284162 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8334017400 con 0x7f83441025f0 2024-09-11T00:16:08.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.639+0000 7f8349000700 1 -- 172.21.15.111:0/82284162 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f834419d060 con 0x7f83441025f0 2024-09-11T00:16:08.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.640+0000 7f8349000700 1 -- 172.21.15.111:0/82284162 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f834410a900 con 0x7f83441025f0 2024-09-11T00:16:08.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.641+0000 7f833aa00700 1 -- 172.21.15.111:0/82284162 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f833400f6f0 con 0x7f83441025f0 2024-09-11T00:16:08.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.642+0000 7f833aa00700 1 --2- 172.21.15.111:0/82284162 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f832807a6f0 0x7f832807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:08.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.643+0000 7f833aa00700 1 -- 172.21.15.111:0/82284162 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f833409e6c0 con 0x7f83441025f0 2024-09-11T00:16:08.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.643+0000 7f8341400700 1 --2- 172.21.15.111:0/82284162 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f832807a6f0 0x7f832807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:08.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.643+0000 7f8341400700 1 --2- 172.21.15.111:0/82284162 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f832807a6f0 0x7f832807cba0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8344199560 tx=0x7f833000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:08.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.647+0000 7f833aa00700 1 -- 172.21.15.111:0/82284162 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f8334061e40 con 0x7f83441025f0 2024-09-11T00:16:08.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:08 smithi203 ceph-mon[69002]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:16:08.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:08 smithi203 ceph-mon[69002]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:16:08.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:08 smithi203 ceph-mon[69002]: pgmap v129: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-09-11T00:16:08.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:08 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/1097667742' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:16:08.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:08 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/4084547900' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:16:08.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:08 smithi111 ceph-mon[90842]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:16:08.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:08 smithi111 ceph-mon[90842]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:16:08.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:08 smithi111 ceph-mon[90842]: pgmap v129: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-09-11T00:16:08.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:08 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/1097667742' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:16:08.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:08 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/4084547900' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:16:08.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.964+0000 7f8349000700 1 -- 172.21.15.111:0/82284162 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f834404ea50 con 0x7f83441025f0 2024-09-11T00:16:08.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.965+0000 7f833aa00700 1 -- 172.21.15.111:0/82284162 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1461 (secure 0 0 0) 0x7f8334064f60 con 0x7f83441025f0 2024-09-11T00:16:08.967 INFO:teuthology.orchestra.run.smithi111.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 59/264 objects degraded (22.348%), 18 pgs degraded 2024-09-11T00:16:08.967 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-11T00:16:08.967 INFO:teuthology.orchestra.run.smithi111.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-11T00:16:08.967 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-11T00:16:08.968 INFO:teuthology.orchestra.run.smithi111.stdout: osd.3 (root=default,host=smithi203) is down 2024-09-11T00:16:08.968 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 59/264 objects degraded (22.348%), 18 pgs degraded 2024-09-11T00:16:08.968 INFO:teuthology.orchestra.run.smithi111.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-09-11T00:16:08.968 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-09-11T00:16:08.968 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-09-11T00:16:08.968 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-09-11T00:16:08.968 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-09-11T00:16:08.968 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-09-11T00:16:08.968 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-09-11T00:16:08.968 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-09-11T00:16:08.968 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2024-09-11T00:16:08.968 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-09-11T00:16:08.968 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2024-09-11T00:16:08.969 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-09-11T00:16:08.969 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-09-11T00:16:08.969 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-09-11T00:16:08.969 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-09-11T00:16:08.969 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-09-11T00:16:08.969 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-09-11T00:16:08.969 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-09-11T00:16:08.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.967+0000 7f8349000700 1 -- 172.21.15.111:0/82284162 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f832807a6f0 msgr2=0x7f832807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:08.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.967+0000 7f8349000700 1 --2- 172.21.15.111:0/82284162 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f832807a6f0 0x7f832807cba0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8344199560 tx=0x7f833000b410 comp rx=0 tx=0).stop 2024-09-11T00:16:08.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.967+0000 7f8349000700 1 -- 172.21.15.111:0/82284162 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f83441025f0 msgr2=0x7f8344197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:08.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.967+0000 7f8349000700 1 --2- 172.21.15.111:0/82284162 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f83441025f0 0x7f8344197f40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f83340092e0 tx=0x7f833400bd70 comp rx=0 tx=0).stop 2024-09-11T00:16:08.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.968+0000 7f8349000700 1 -- 172.21.15.111:0/82284162 shutdown_connections 2024-09-11T00:16:08.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.968+0000 7f8349000700 1 --2- 172.21.15.111:0/82284162 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f832807a6f0 0x7f832807cba0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.968+0000 7f8349000700 1 --2- 172.21.15.111:0/82284162 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f83441025f0 0x7f8344197f40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.968+0000 7f8349000700 1 --2- 172.21.15.111:0/82284162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8344102f90 0x7f8344198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.968+0000 7f8349000700 1 -- 172.21.15.111:0/82284162 >> 172.21.15.111:0/82284162 conn(0x7f83440fde90 msgr2=0x7f8344100230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:08.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.968+0000 7f8349000700 1 -- 172.21.15.111:0/82284162 shutdown_connections 2024-09-11T00:16:08.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:08.968+0000 7f8349000700 1 -- 172.21.15.111:0/82284162 wait complete. 2024-09-11T00:16:09.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:09 smithi203 ceph-mon[69002]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:16:09.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:09 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:09.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:09 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:09.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:09 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/82284162' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-11T00:16:09.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:09 smithi111 ceph-mon[90842]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:16:09.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:09 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:09.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:09 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:09.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:09 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/82284162' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-11T00:16:10.693 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:10 smithi203 ceph-mon[69002]: pgmap v130: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-09-11T00:16:10.693 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:10 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:10.693 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:10 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:10.895 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:10 smithi111 ceph-mon[90842]: pgmap v130: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-09-11T00:16:10.896 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:10 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:10.896 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:10 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:13.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:12 smithi203 ceph-mon[69002]: pgmap v131: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-09-11T00:16:13.045 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:12 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3[78746]: 2024-09-11T00:16:12.733+0000 7f7efdc95640 -1 osd.3 0 read_superblock omap replica is missing. 2024-09-11T00:16:13.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:12 smithi111 ceph-mon[90842]: pgmap v131: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-09-11T00:16:13.545 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:13 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3[78746]: 2024-09-11T00:16:13.177+0000 7f7efdc95640 -1 osd.3 65 log_to_monitors true 2024-09-11T00:16:14.045 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:16:13 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3[78746]: 2024-09-11T00:16:13.710+0000 7f7ef3c00640 -1 osd.3 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:16:14.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:13 smithi203 ceph-mon[69002]: from='osd.3 [v2:172.21.15.203:6800/489072149,v1:172.21.15.203:6801/489072149]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-11T00:16:14.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:13 smithi203 ceph-mon[69002]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-11T00:16:14.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:13 smithi111 ceph-mon[90842]: from='osd.3 [v2:172.21.15.203:6800/489072149,v1:172.21.15.203:6801/489072149]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-11T00:16:14.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:13 smithi111 ceph-mon[90842]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-11T00:16:15.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:14 smithi203 ceph-mon[69002]: pgmap v132: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-09-11T00:16:15.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:14 smithi203 ceph-mon[69002]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T00:16:15.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:14 smithi203 ceph-mon[69002]: from='osd.3 [v2:172.21.15.203:6800/489072149,v1:172.21.15.203:6801/489072149]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi203", "root=default"]} : dispatch 2024-09-11T00:16:15.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:14 smithi203 ceph-mon[69002]: osdmap e68: 6 total, 5 up, 6 in 2024-09-11T00:16:15.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:14 smithi203 ceph-mon[69002]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi203", "root=default"]} : dispatch 2024-09-11T00:16:15.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:14 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:15.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:14 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:15.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:14 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:16:15.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:14 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:16:15.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:14 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:15.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:14 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:16:15.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:14 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:16:15.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:14 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:16:15.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:14 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:16:15.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:14 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-11T00:16:15.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:14 smithi111 ceph-mon[90842]: pgmap v132: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 258 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-09-11T00:16:15.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:14 smithi111 ceph-mon[90842]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T00:16:15.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:14 smithi111 ceph-mon[90842]: from='osd.3 [v2:172.21.15.203:6800/489072149,v1:172.21.15.203:6801/489072149]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi203", "root=default"]} : dispatch 2024-09-11T00:16:15.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:14 smithi111 ceph-mon[90842]: osdmap e68: 6 total, 5 up, 6 in 2024-09-11T00:16:15.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:14 smithi111 ceph-mon[90842]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi203", "root=default"]} : dispatch 2024-09-11T00:16:15.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:14 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:15.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:14 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:15.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:14 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:16:15.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:14 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:16:15.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:14 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:15.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:14 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:16:15.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:14 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:16:15.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:14 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:16:15.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:14 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:16:15.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:14 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-11T00:16:16.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:15 smithi203 ceph-mon[69002]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-11T00:16:16.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:15 smithi203 ceph-mon[69002]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-11T00:16:16.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:15 smithi203 ceph-mon[69002]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-11T00:16:16.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:15 smithi203 ceph-mon[69002]: osd.3 [v2:172.21.15.203:6800/489072149,v1:172.21.15.203:6801/489072149] boot 2024-09-11T00:16:16.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:15 smithi203 ceph-mon[69002]: osdmap e69: 6 total, 6 up, 6 in 2024-09-11T00:16:16.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:15 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T00:16:16.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:15 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:16.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:15 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:16:16.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:15 smithi111 ceph-mon[90842]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-11T00:16:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:15 smithi111 ceph-mon[90842]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-11T00:16:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:15 smithi111 ceph-mon[90842]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-11T00:16:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:15 smithi111 ceph-mon[90842]: osd.3 [v2:172.21.15.203:6800/489072149,v1:172.21.15.203:6801/489072149] boot 2024-09-11T00:16:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:15 smithi111 ceph-mon[90842]: osdmap e69: 6 total, 6 up, 6 in 2024-09-11T00:16:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:15 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T00:16:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:15 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:15 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:16:17.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:16 smithi203 ceph-mon[69002]: pgmap v135: 65 pgs: 12 peering, 11 active+undersized, 15 active+undersized+degraded, 27 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 47/264 objects degraded (17.803%) 2024-09-11T00:16:17.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:16 smithi203 ceph-mon[69002]: osdmap e70: 6 total, 6 up, 6 in 2024-09-11T00:16:17.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:16 smithi203 ceph-mon[69002]: Health check update: Degraded data redundancy: 47/264 objects degraded (17.803%), 15 pgs degraded (PG_DEGRADED) 2024-09-11T00:16:17.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:16 smithi111 ceph-mon[90842]: pgmap v135: 65 pgs: 12 peering, 11 active+undersized, 15 active+undersized+degraded, 27 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 47/264 objects degraded (17.803%) 2024-09-11T00:16:17.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:16 smithi111 ceph-mon[90842]: osdmap e70: 6 total, 6 up, 6 in 2024-09-11T00:16:17.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:16 smithi111 ceph-mon[90842]: Health check update: Degraded data redundancy: 47/264 objects degraded (17.803%), 15 pgs degraded (PG_DEGRADED) 2024-09-11T00:16:19.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:18 smithi203 ceph-mon[69002]: pgmap v137: 65 pgs: 12 peering, 11 active+undersized, 15 active+undersized+degraded, 27 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 47/264 objects degraded (17.803%) 2024-09-11T00:16:19.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:18 smithi111 ceph-mon[90842]: pgmap v137: 65 pgs: 12 peering, 11 active+undersized, 15 active+undersized+degraded, 27 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 47/264 objects degraded (17.803%) 2024-09-11T00:16:20.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:19 smithi203 ceph-mon[69002]: pgmap v138: 65 pgs: 12 peering, 53 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:16:20.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:19 smithi203 ceph-mon[69002]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 47/264 objects degraded (17.803%), 15 pgs degraded) 2024-09-11T00:16:20.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:19 smithi111 ceph-mon[90842]: pgmap v138: 65 pgs: 12 peering, 53 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:16:20.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:19 smithi111 ceph-mon[90842]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 47/264 objects degraded (17.803%), 15 pgs degraded) 2024-09-11T00:16:23.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:22 smithi203 ceph-mon[69002]: pgmap v139: 65 pgs: 65 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:16:23.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:22 smithi111 ceph-mon[90842]: pgmap v139: 65 pgs: 65 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:16:25.024 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:24 smithi203 ceph-mon[69002]: pgmap v140: 65 pgs: 65 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:16:25.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:24 smithi111 ceph-mon[90842]: pgmap v140: 65 pgs: 65 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:16:26.977 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:26 smithi111 ceph-mon[90842]: pgmap v141: 65 pgs: 65 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:16:27.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:26 smithi203 ceph-mon[69002]: pgmap v141: 65 pgs: 65 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:16:29.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:28 smithi203 ceph-mon[69002]: pgmap v142: 65 pgs: 65 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:16:29.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:28 smithi111 ceph-mon[90842]: pgmap v142: 65 pgs: 65 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:16:29.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:29 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-11T00:16:30.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:29 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-11T00:16:31.010 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:30 smithi203 ceph-mon[69002]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-11T00:16:31.010 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:30 smithi203 ceph-mon[69002]: Upgrade: osd.4 is safe to restart 2024-09-11T00:16:31.010 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:30 smithi203 ceph-mon[69002]: pgmap v143: 65 pgs: 65 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:16:31.010 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:31.010 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:16:31.011 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:31.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:30 smithi111 ceph-mon[90842]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-11T00:16:31.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:30 smithi111 ceph-mon[90842]: Upgrade: osd.4 is safe to restart 2024-09-11T00:16:31.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:30 smithi111 ceph-mon[90842]: pgmap v143: 65 pgs: 65 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:16:31.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:31.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:16:31.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:32.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:32 smithi203 ceph-mon[69002]: Upgrade: Updating osd.4 2024-09-11T00:16:32.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:32 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:32.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:32 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-11T00:16:32.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:32 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:16:32.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:32 smithi203 ceph-mon[69002]: Deploying daemon osd.4 on smithi203 2024-09-11T00:16:32.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:32 smithi203 ceph-mon[69002]: pgmap v144: 65 pgs: 65 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:16:32.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:32 smithi111 ceph-mon[90842]: Upgrade: Updating osd.4 2024-09-11T00:16:32.865 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:32 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:32.865 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:32 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-11T00:16:32.865 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:32 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:16:32.865 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:32 smithi111 ceph-mon[90842]: Deploying daemon osd.4 on smithi203 2024-09-11T00:16:32.865 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:32 smithi111 ceph-mon[90842]: pgmap v144: 65 pgs: 65 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:16:34.937 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:34 smithi203 ceph-mon[69002]: pgmap v145: 65 pgs: 65 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:16:35.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:34 smithi111 ceph-mon[90842]: pgmap v145: 65 pgs: 65 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:16:35.271 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:34 smithi203 systemd[1]: Stopping Ceph osd.4 for 03107fbe-6fd0-11ef-bcea-c7b262605968... 2024-09-11T00:16:35.545 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:35 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4[43860]: 2024-09-11T00:16:35.269+0000 7fd0d1000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:16:35.545 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:35 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4[43860]: 2024-09-11T00:16:35.269+0000 7fd0d1000700 -1 osd.4 70 *** Got signal Terminated *** 2024-09-11T00:16:35.545 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:35 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4[43860]: 2024-09-11T00:16:35.269+0000 7fd0d1000700 -1 osd.4 70 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:16:36.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:35 smithi203 ceph-mon[69002]: osd.4 marked itself down and dead 2024-09-11T00:16:36.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:35 smithi111 ceph-mon[90842]: osd.4 marked itself down and dead 2024-09-11T00:16:36.545 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:36 smithi203 podman[83169]: 2024-09-11 00:16:36.27275152 +0000 UTC m=+1.131326630 container died 769c7942c42b6cb08d94387ce6210bb6a224043e6705cf6a72c654a7679949ba (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4, org.label-schema.license=GPLv2, RELEASE=HEAD, io.buildah.version=1.29.1, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.build-date=20231212) 2024-09-11T00:16:37.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:36 smithi203 ceph-mon[69002]: pgmap v146: 65 pgs: 65 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:16:37.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:36 smithi203 ceph-mon[69002]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-11T00:16:37.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:36 smithi203 ceph-mon[69002]: osdmap e71: 6 total, 5 up, 6 in 2024-09-11T00:16:37.045 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:36 smithi203 podman[83169]: 2024-09-11 00:16:36.66818578 +0000 UTC m=+1.526760891 container cleanup 769c7942c42b6cb08d94387ce6210bb6a224043e6705cf6a72c654a7679949ba (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, ceph=True, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-11T00:16:37.045 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:36 smithi203 bash[83169]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4 2024-09-11T00:16:37.085 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:36 smithi111 ceph-mon[90842]: pgmap v146: 65 pgs: 65 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:16:37.085 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:36 smithi111 ceph-mon[90842]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-11T00:16:37.085 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:36 smithi111 ceph-mon[90842]: osdmap e71: 6 total, 5 up, 6 in 2024-09-11T00:16:37.499 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:37 smithi203 podman[83185]: 2024-09-11 00:16:37.049031454 +0000 UTC m=+0.763184021 container remove 769c7942c42b6cb08d94387ce6210bb6a224043e6705cf6a72c654a7679949ba (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-11T00:16:37.777 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:37 smithi203 ceph-mon[69002]: osdmap e72: 6 total, 5 up, 6 in 2024-09-11T00:16:37.777 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:37 smithi203 podman[83274]: 2024-09-11 00:16:37.403959329 +0000 UTC m=+0.028420166 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:16:37.777 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:37 smithi203 podman[83274]: 2024-09-11 00:16:37.523336542 +0000 UTC m=+0.147797378 container create 907a3e53cbe0b66720a5dc63b37c3241c0f3e92aa4659ad7d8add64b1a2f14ef (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:16:37.777 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:37 smithi203 podman[83274]: 2024-09-11 00:16:37.776253932 +0000 UTC m=+0.400714768 container init 907a3e53cbe0b66720a5dc63b37c3241c0f3e92aa4659ad7d8add64b1a2f14ef (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:16:38.043 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:37 smithi203 podman[83274]: 2024-09-11 00:16:37.783885001 +0000 UTC m=+0.408345837 container start 907a3e53cbe0b66720a5dc63b37c3241c0f3e92aa4659ad7d8add64b1a2f14ef (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-11T00:16:38.043 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:37 smithi203 podman[83274]: 2024-09-11 00:16:37.868806007 +0000 UTC m=+0.493266874 container attach 907a3e53cbe0b66720a5dc63b37c3241c0f3e92aa4659ad7d8add64b1a2f14ef (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-11T00:16:38.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:37 smithi111 ceph-mon[90842]: osdmap e72: 6 total, 5 up, 6 in 2024-09-11T00:16:38.295 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:38 smithi203 podman[83274]: 2024-09-11 00:16:38.04290964 +0000 UTC m=+0.667370486 container died 907a3e53cbe0b66720a5dc63b37c3241c0f3e92aa4659ad7d8add64b1a2f14ef (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:16:39.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:38 smithi203 ceph-mon[69002]: pgmap v149: 65 pgs: 6 stale+active+clean, 59 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:16:39.045 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:38 smithi203 podman[83297]: 2024-09-11 00:16:38.748875218 +0000 UTC m=+0.689357324 container remove 907a3e53cbe0b66720a5dc63b37c3241c0f3e92aa4659ad7d8add64b1a2f14ef (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-11T00:16:39.045 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:38 smithi203 systemd[1]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-11T00:16:39.045 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:38 smithi203 systemd[1]: Stopped Ceph osd.4 for 03107fbe-6fd0-11ef-bcea-c7b262605968. 2024-09-11T00:16:39.046 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:38 smithi203 systemd[1]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.4.service: Consumed 1min 14.050s CPU time. 2024-09-11T00:16:39.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.120+0000 7fe254000700 1 -- 172.21.15.111:0/2729856192 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe24c075b90 msgr2=0x7fe24c110b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:39.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.120+0000 7fe254000700 1 --2- 172.21.15.111:0/2729856192 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe24c075b90 0x7fe24c110b00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe238009910 tx=0x7fe238009c20 comp rx=0 tx=0).stop 2024-09-11T00:16:39.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.120+0000 7fe254000700 1 -- 172.21.15.111:0/2729856192 shutdown_connections 2024-09-11T00:16:39.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.120+0000 7fe254000700 1 --2- 172.21.15.111:0/2729856192 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe24c075b90 0x7fe24c110b00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:39.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.120+0000 7fe254000700 1 --2- 172.21.15.111:0/2729856192 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe24c075280 0x7fe24c075650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:39.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.120+0000 7fe254000700 1 -- 172.21.15.111:0/2729856192 >> 172.21.15.111:0/2729856192 conn(0x7fe24c0fdec0 msgr2=0x7fe24c1002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:39.123 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:38 smithi111 ceph-mon[90842]: pgmap v149: 65 pgs: 6 stale+active+clean, 59 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:16:39.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.120+0000 7fe254000700 1 -- 172.21.15.111:0/2729856192 shutdown_connections 2024-09-11T00:16:39.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.120+0000 7fe254000700 1 -- 172.21.15.111:0/2729856192 wait complete. 2024-09-11T00:16:39.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.121+0000 7fe254000700 1 Processor -- start 2024-09-11T00:16:39.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.121+0000 7fe254000700 1 -- start start 2024-09-11T00:16:39.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.122+0000 7fe254000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe24c075280 0x7fe24c19c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:39.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.122+0000 7fe254000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe24c075b90 0x7fe24c19c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:39.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.122+0000 7fe254000700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c19ced0 con 0x7fe24c075280 2024-09-11T00:16:39.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.122+0000 7fe254000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c19d010 con 0x7fe24c075b90 2024-09-11T00:16:39.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.122+0000 7fe251600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe24c075280 0x7fe24c19c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:39.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.122+0000 7fe251600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe24c075280 0x7fe24c19c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52180/0 (socket says 172.21.15.111:52180) 2024-09-11T00:16:39.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.122+0000 7fe251600700 1 -- 172.21.15.111:0/2556811094 learned_addr learned my addr 172.21.15.111:0/2556811094 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:16:39.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.122+0000 7fe250c00700 1 --2- 172.21.15.111:0/2556811094 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe24c075b90 0x7fe24c19c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:39.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.122+0000 7fe251600700 1 -- 172.21.15.111:0/2556811094 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe24c075b90 msgr2=0x7fe24c19c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:39.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.122+0000 7fe251600700 1 --2- 172.21.15.111:0/2556811094 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe24c075b90 0x7fe24c19c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:39.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.122+0000 7fe251600700 1 -- 172.21.15.111:0/2556811094 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2380095f0 con 0x7fe24c075280 2024-09-11T00:16:39.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.123+0000 7fe251600700 1 --2- 172.21.15.111:0/2556811094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe24c075280 0x7fe24c19c340 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe24000c930 tx=0x7fe24000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:39.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.123+0000 7fe24a000700 1 -- 172.21.15.111:0/2556811094 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe240007ad0 con 0x7fe24c075280 2024-09-11T00:16:39.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.123+0000 7fe254000700 1 -- 172.21.15.111:0/2556811094 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe24c1a0e60 con 0x7fe24c075280 2024-09-11T00:16:39.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.123+0000 7fe24a000700 1 -- 172.21.15.111:0/2556811094 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe24000ce80 con 0x7fe24c075280 2024-09-11T00:16:39.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.123+0000 7fe24a000700 1 -- 172.21.15.111:0/2556811094 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe240018630 con 0x7fe24c075280 2024-09-11T00:16:39.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.123+0000 7fe254000700 1 -- 172.21.15.111:0/2556811094 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe24c1a13b0 con 0x7fe24c075280 2024-09-11T00:16:39.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.124+0000 7fe254000700 1 -- 172.21.15.111:0/2556811094 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe24c10e270 con 0x7fe24c075280 2024-09-11T00:16:39.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.126+0000 7fe24a000700 1 -- 172.21.15.111:0/2556811094 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fe240007c30 con 0x7fe24c075280 2024-09-11T00:16:39.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.127+0000 7fe24a000700 1 --2- 172.21.15.111:0/2556811094 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe23407a6f0 0x7fe23407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:39.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.127+0000 7fe24a000700 1 -- 172.21.15.111:0/2556811094 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fe24009d2b0 con 0x7fe24c075280 2024-09-11T00:16:39.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.127+0000 7fe250c00700 1 --2- 172.21.15.111:0/2556811094 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe23407a6f0 0x7fe23407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:39.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.128+0000 7fe250c00700 1 --2- 172.21.15.111:0/2556811094 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe23407a6f0 0x7fe23407cba0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe24c19d960 tx=0x7fe23800b580 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:39.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.132+0000 7fe24a000700 1 -- 172.21.15.111:0/2556811094 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fe2400609b0 con 0x7fe24c075280 2024-09-11T00:16:39.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.374+0000 7fe254000700 1 -- 172.21.15.111:0/2556811094 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe24c02cd40 con 0x7fe23407a6f0 2024-09-11T00:16:39.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.375+0000 7fe24a000700 1 -- 172.21.15.111:0/2556811094 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fe24c02cd40 con 0x7fe23407a6f0 2024-09-11T00:16:39.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.378+0000 7fe254000700 1 -- 172.21.15.111:0/2556811094 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe23407a6f0 msgr2=0x7fe23407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:39.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.378+0000 7fe254000700 1 --2- 172.21.15.111:0/2556811094 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe23407a6f0 0x7fe23407cba0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe24c19d960 tx=0x7fe23800b580 comp rx=0 tx=0).stop 2024-09-11T00:16:39.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.378+0000 7fe254000700 1 -- 172.21.15.111:0/2556811094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe24c075280 msgr2=0x7fe24c19c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:39.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.378+0000 7fe254000700 1 --2- 172.21.15.111:0/2556811094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe24c075280 0x7fe24c19c340 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe24000c930 tx=0x7fe24000cc40 comp rx=0 tx=0).stop 2024-09-11T00:16:39.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.379+0000 7fe254000700 1 -- 172.21.15.111:0/2556811094 shutdown_connections 2024-09-11T00:16:39.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.379+0000 7fe254000700 1 --2- 172.21.15.111:0/2556811094 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe23407a6f0 0x7fe23407cba0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:39.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.379+0000 7fe254000700 1 --2- 172.21.15.111:0/2556811094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe24c075280 0x7fe24c19c340 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:39.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.379+0000 7fe254000700 1 --2- 172.21.15.111:0/2556811094 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe24c075b90 0x7fe24c19c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:39.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.379+0000 7fe254000700 1 -- 172.21.15.111:0/2556811094 >> 172.21.15.111:0/2556811094 conn(0x7fe24c0fdec0 msgr2=0x7fe24c0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:39.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.379+0000 7fe254000700 1 -- 172.21.15.111:0/2556811094 shutdown_connections 2024-09-11T00:16:39.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.379+0000 7fe254000700 1 -- 172.21.15.111:0/2556811094 wait complete. 2024-09-11T00:16:39.395 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:16:39.407 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:39 smithi203 systemd[1]: Starting Ceph osd.4 for 03107fbe-6fd0-11ef-bcea-c7b262605968... 2024-09-11T00:16:39.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.517+0000 7f79f4800700 1 -- 172.21.15.111:0/2022390325 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79ec073070 msgr2=0x7f79ec073440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:39.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.517+0000 7f79f4800700 1 --2- 172.21.15.111:0/2022390325 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79ec073070 0x7f79ec073440 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009940 tx=0x7f79e0009c50 comp rx=0 tx=0).stop 2024-09-11T00:16:39.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.517+0000 7f79f4800700 1 -- 172.21.15.111:0/2022390325 shutdown_connections 2024-09-11T00:16:39.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.517+0000 7f79f4800700 1 --2- 172.21.15.111:0/2022390325 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79ec073980 0x7f79ec10c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:39.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.517+0000 7f79f4800700 1 --2- 172.21.15.111:0/2022390325 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79ec073070 0x7f79ec073440 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:39.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.517+0000 7f79f4800700 1 -- 172.21.15.111:0/2022390325 >> 172.21.15.111:0/2022390325 conn(0x7f79ec0fbc90 msgr2=0x7f79ec0fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:39.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.517+0000 7f79f4800700 1 -- 172.21.15.111:0/2022390325 shutdown_connections 2024-09-11T00:16:39.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.517+0000 7f79f4800700 1 -- 172.21.15.111:0/2022390325 wait complete. 2024-09-11T00:16:39.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.518+0000 7f79f4800700 1 Processor -- start 2024-09-11T00:16:39.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.518+0000 7f79f4800700 1 -- start start 2024-09-11T00:16:39.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.518+0000 7f79f4800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79ec073070 0x7f79ec197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:39.523 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.518+0000 7f79f4800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79ec073980 0x7f79ec1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:39.523 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.518+0000 7f79f4800700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec198b80 con 0x7f79ec073980 2024-09-11T00:16:39.523 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.518+0000 7f79f4800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec19c910 con 0x7f79ec073070 2024-09-11T00:16:39.523 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.519+0000 7f79f1400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79ec073980 0x7f79ec1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:39.523 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.519+0000 7f79f1400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79ec073980 0x7f79ec1984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52202/0 (socket says 172.21.15.111:52202) 2024-09-11T00:16:39.523 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.519+0000 7f79f1400700 1 -- 172.21.15.111:0/2344357864 learned_addr learned my addr 172.21.15.111:0/2344357864 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:16:39.523 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.519+0000 7f79f1e00700 1 --2- 172.21.15.111:0/2344357864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79ec073070 0x7f79ec197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:39.523 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.519+0000 7f79f1400700 1 -- 172.21.15.111:0/2344357864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79ec073070 msgr2=0x7f79ec197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:39.523 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.519+0000 7f79f1400700 1 --2- 172.21.15.111:0/2344357864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79ec073070 0x7f79ec197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:39.523 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.519+0000 7f79f1400700 1 -- 172.21.15.111:0/2344357864 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e00095f0 con 0x7f79ec073980 2024-09-11T00:16:39.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.519+0000 7f79f1400700 1 --2- 172.21.15.111:0/2344357864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79ec073980 0x7f79ec1984a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00e920 tx=0x7f79dc00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:39.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.520+0000 7f79e6a00700 1 -- 172.21.15.111:0/2344357864 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79dc00c9d0 con 0x7f79ec073980 2024-09-11T00:16:39.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.520+0000 7f79f4800700 1 -- 172.21.15.111:0/2344357864 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79ec19cbf0 con 0x7f79ec073980 2024-09-11T00:16:39.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.520+0000 7f79e6a00700 1 -- 172.21.15.111:0/2344357864 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f79dc010430 con 0x7f79ec073980 2024-09-11T00:16:39.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.520+0000 7f79e6a00700 1 -- 172.21.15.111:0/2344357864 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79dc018630 con 0x7f79ec073980 2024-09-11T00:16:39.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.520+0000 7f79f4800700 1 -- 172.21.15.111:0/2344357864 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79ec19d140 con 0x7f79ec073980 2024-09-11T00:16:39.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.521+0000 7f79f4800700 1 -- 172.21.15.111:0/2344357864 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79ec109bf0 con 0x7f79ec073980 2024-09-11T00:16:39.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.523+0000 7f79e6a00700 1 -- 172.21.15.111:0/2344357864 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f79dc0105a0 con 0x7f79ec073980 2024-09-11T00:16:39.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.523+0000 7f79e6a00700 1 --2- 172.21.15.111:0/2344357864 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f79d407a6f0 0x7f79d407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:39.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.524+0000 7f79e6a00700 1 -- 172.21.15.111:0/2344357864 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f79dc014070 con 0x7f79ec073980 2024-09-11T00:16:39.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.524+0000 7f79f1e00700 1 --2- 172.21.15.111:0/2344357864 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f79d407a6f0 0x7f79d407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:39.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.524+0000 7f79f1e00700 1 --2- 172.21.15.111:0/2344357864 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f79d407a6f0 0x7f79d407cba0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f79e0006010 tx=0x7f79e000b5a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:39.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.528+0000 7f79e6a00700 1 -- 172.21.15.111:0/2344357864 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f79dc060c40 con 0x7f79ec073980 2024-09-11T00:16:39.753 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:39 smithi203 podman[83395]: 2024-09-11 00:16:39.310423632 +0000 UTC m=+0.027484698 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:16:39.754 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:39 smithi203 podman[83395]: 2024-09-11 00:16:39.457817038 +0000 UTC m=+0.174878114 container create dc443fceba1bffe211e72c5024ad49f99f1a035ab280f226c5ea7e85d12b93a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4-activate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True) 2024-09-11T00:16:39.754 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:39 smithi203 podman[83395]: 2024-09-11 00:16:39.75231435 +0000 UTC m=+0.469375416 container init dc443fceba1bffe211e72c5024ad49f99f1a035ab280f226c5ea7e85d12b93a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4-activate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-11T00:16:39.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.777+0000 7f79f4800700 1 -- 172.21.15.111:0/2344357864 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f79ec19d580 con 0x7f79d407a6f0 2024-09-11T00:16:39.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.779+0000 7f79e6a00700 1 -- 172.21.15.111:0/2344357864 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f79ec19d580 con 0x7f79d407a6f0 2024-09-11T00:16:39.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.781+0000 7f79f4800700 1 -- 172.21.15.111:0/2344357864 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f79d407a6f0 msgr2=0x7f79d407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:39.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.781+0000 7f79f4800700 1 --2- 172.21.15.111:0/2344357864 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f79d407a6f0 0x7f79d407cba0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f79e0006010 tx=0x7f79e000b5a0 comp rx=0 tx=0).stop 2024-09-11T00:16:39.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.781+0000 7f79f4800700 1 -- 172.21.15.111:0/2344357864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79ec073980 msgr2=0x7f79ec1984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:39.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.781+0000 7f79f4800700 1 --2- 172.21.15.111:0/2344357864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79ec073980 0x7f79ec1984a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00e920 tx=0x7f79dc00ec30 comp rx=0 tx=0).stop 2024-09-11T00:16:39.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.781+0000 7f79f4800700 1 -- 172.21.15.111:0/2344357864 shutdown_connections 2024-09-11T00:16:39.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.781+0000 7f79f4800700 1 --2- 172.21.15.111:0/2344357864 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f79d407a6f0 0x7f79d407cba0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:39.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.781+0000 7f79f4800700 1 --2- 172.21.15.111:0/2344357864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79ec073070 0x7f79ec197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:39.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.781+0000 7f79f4800700 1 --2- 172.21.15.111:0/2344357864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79ec073980 0x7f79ec1984a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:39.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.781+0000 7f79f4800700 1 -- 172.21.15.111:0/2344357864 >> 172.21.15.111:0/2344357864 conn(0x7f79ec0fbc90 msgr2=0x7f79ec106d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:39.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.781+0000 7f79f4800700 1 -- 172.21.15.111:0/2344357864 shutdown_connections 2024-09-11T00:16:39.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.781+0000 7f79f4800700 1 -- 172.21.15.111:0/2344357864 wait complete. 2024-09-11T00:16:39.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.917+0000 7fe54a200700 1 -- 172.21.15.111:0/4281980231 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe544100200 msgr2=0x7fe5441005d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:39.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.917+0000 7fe54a200700 1 --2- 172.21.15.111:0/4281980231 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe544100200 0x7fe5441005d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe538009910 tx=0x7fe538009c20 comp rx=0 tx=0).stop 2024-09-11T00:16:39.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.917+0000 7fe54a200700 1 -- 172.21.15.111:0/4281980231 shutdown_connections 2024-09-11T00:16:39.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.917+0000 7fe54a200700 1 --2- 172.21.15.111:0/4281980231 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe544100ba0 0x7fe544104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:39.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.917+0000 7fe54a200700 1 --2- 172.21.15.111:0/4281980231 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe544100200 0x7fe5441005d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:39.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.917+0000 7fe54a200700 1 -- 172.21.15.111:0/4281980231 >> 172.21.15.111:0/4281980231 conn(0x7fe5440fba80 msgr2=0x7fe5440fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:39.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.917+0000 7fe54a200700 1 -- 172.21.15.111:0/4281980231 shutdown_connections 2024-09-11T00:16:39.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.917+0000 7fe54a200700 1 -- 172.21.15.111:0/4281980231 wait complete. 2024-09-11T00:16:39.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.918+0000 7fe54a200700 1 Processor -- start 2024-09-11T00:16:39.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.919+0000 7fe54a200700 1 -- start start 2024-09-11T00:16:39.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.919+0000 7fe54a200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe544100200 0x7fe544073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:39.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.919+0000 7fe54a200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe544100ba0 0x7fe544073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:39.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.919+0000 7fe54a200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe544073ad0 con 0x7fe544100200 2024-09-11T00:16:39.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.919+0000 7fe54a200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe544073c10 con 0x7fe544100ba0 2024-09-11T00:16:39.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.919+0000 7fe548e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe544100200 0x7fe544073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:39.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.919+0000 7fe548e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe544100200 0x7fe544073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52222/0 (socket says 172.21.15.111:52222) 2024-09-11T00:16:39.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.919+0000 7fe548e00700 1 -- 172.21.15.111:0/1644670250 learned_addr learned my addr 172.21.15.111:0/1644670250 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:16:39.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.919+0000 7fe543e00700 1 --2- 172.21.15.111:0/1644670250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe544100ba0 0x7fe544073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:39.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.920+0000 7fe548e00700 1 -- 172.21.15.111:0/1644670250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe544100ba0 msgr2=0x7fe544073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:39.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.920+0000 7fe548e00700 1 --2- 172.21.15.111:0/1644670250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe544100ba0 0x7fe544073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:39.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.920+0000 7fe548e00700 1 -- 172.21.15.111:0/1644670250 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5380095f0 con 0x7fe544100200 2024-09-11T00:16:39.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.920+0000 7fe548e00700 1 --2- 172.21.15.111:0/1644670250 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe544100200 0x7fe544073050 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe53800f690 tx=0x7fe53800f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:39.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.920+0000 7fe541600700 1 -- 172.21.15.111:0/1644670250 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe53801d070 con 0x7fe544100200 2024-09-11T00:16:39.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.920+0000 7fe541600700 1 -- 172.21.15.111:0/1644670250 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe5380050d0 con 0x7fe544100200 2024-09-11T00:16:39.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.920+0000 7fe54a200700 1 -- 172.21.15.111:0/1644670250 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe544073e90 con 0x7fe544100200 2024-09-11T00:16:39.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.920+0000 7fe541600700 1 -- 172.21.15.111:0/1644670250 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe538022470 con 0x7fe544100200 2024-09-11T00:16:39.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.920+0000 7fe54a200700 1 -- 172.21.15.111:0/1644670250 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5441a2100 con 0x7fe544100200 2024-09-11T00:16:39.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.921+0000 7fe54a200700 1 -- 172.21.15.111:0/1644670250 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe544108510 con 0x7fe544100200 2024-09-11T00:16:39.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.923+0000 7fe541600700 1 -- 172.21.15.111:0/1644670250 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fe538003780 con 0x7fe544100200 2024-09-11T00:16:39.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.924+0000 7fe541600700 1 --2- 172.21.15.111:0/1644670250 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe52c07a6f0 0x7fe52c07cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:39.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.924+0000 7fe541600700 1 -- 172.21.15.111:0/1644670250 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fe53809e590 con 0x7fe544100200 2024-09-11T00:16:39.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.924+0000 7fe543e00700 1 --2- 172.21.15.111:0/1644670250 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe52c07a6f0 0x7fe52c07cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:39.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.925+0000 7fe543e00700 1 --2- 172.21.15.111:0/1644670250 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe52c07a6f0 0x7fe52c07cba0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe544074840 tx=0x7fe530009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:39.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:39.928+0000 7fe541600700 1 -- 172.21.15.111:0/1644670250 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fe538061db0 con 0x7fe544100200 2024-09-11T00:16:40.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:39 smithi203 ceph-mon[69002]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:16:40.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:39 smithi203 ceph-mon[69002]: pgmap v150: 65 pgs: 12 active+undersized, 3 stale+active+clean, 9 active+undersized+degraded, 41 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 29/264 objects degraded (10.985%) 2024-09-11T00:16:40.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:39 smithi203 ceph-mon[69002]: Health check failed: Degraded data redundancy: 29/264 objects degraded (10.985%), 9 pgs degraded (PG_DEGRADED) 2024-09-11T00:16:40.045 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:39 smithi203 podman[83395]: 2024-09-11 00:16:39.759754985 +0000 UTC m=+0.476816059 container start dc443fceba1bffe211e72c5024ad49f99f1a035ab280f226c5ea7e85d12b93a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4-activate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:16:40.045 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:39 smithi203 podman[83395]: 2024-09-11 00:16:39.860867124 +0000 UTC m=+0.577928206 container attach dc443fceba1bffe211e72c5024ad49f99f1a035ab280f226c5ea7e85d12b93a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4-activate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-11T00:16:40.045 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:39 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4-activate[83410]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-11T00:16:40.046 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:39 smithi203 bash[83395]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-11T00:16:40.046 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:39 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4-activate[83410]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-11T00:16:40.046 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:39 smithi203 bash[83395]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-11T00:16:40.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:39 smithi111 ceph-mon[90842]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:16:40.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:39 smithi111 ceph-mon[90842]: pgmap v150: 65 pgs: 12 active+undersized, 3 stale+active+clean, 9 active+undersized+degraded, 41 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 29/264 objects degraded (10.985%) 2024-09-11T00:16:40.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:39 smithi111 ceph-mon[90842]: Health check failed: Degraded data redundancy: 29/264 objects degraded (10.985%), 9 pgs degraded (PG_DEGRADED) 2024-09-11T00:16:40.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.158+0000 7fe54a200700 1 -- 172.21.15.111:0/1644670250 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe54402cd10 con 0x7fe52c07a6f0 2024-09-11T00:16:40.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.168+0000 7fe541600700 1 -- 172.21.15.111:0/1644670250 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fe54402cd10 con 0x7fe52c07a6f0 2024-09-11T00:16:40.171 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:16:40.171 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (6m) 68s ago 19m 14.7M - 0.27.0 11f11916f8cd d6d3253e881f 2024-09-11T00:16:40.171 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (8m) 68s ago 20m 8186k - 18.2.0 dc2bc1663786 7c40af85314c 2024-09-11T00:16:40.171 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi203 smithi203 running (8m) 31s ago 18m 7931k - 18.2.0 dc2bc1663786 922e3261ff70 2024-09-11T00:16:40.171 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (3m) 68s ago 20m 6899k - 19.3.0-4854-g8f219c47 589dd18248e4 a9cacdb9a638 2024-09-11T00:16:40.171 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi203 smithi203 running (2m) 31s ago 18m 6899k - 19.3.0-4854-g8f219c47 589dd18248e4 d452d9dfa04b 2024-09-11T00:16:40.171 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (5m) 68s ago 19m 67.6M - c8b91775d855 7d3b50b5b59f 2024-09-11T00:16:40.171 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.gmgsay smithi111 running (12m) 68s ago 12m 18.3M - 18.2.0 dc2bc1663786 795e4ff0075c 2024-09-11T00:16:40.171 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.rucaba smithi111 running (12m) 68s ago 12m 18.2M - 18.2.0 dc2bc1663786 02885adac62c 2024-09-11T00:16:40.171 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.tcrqop smithi203 running (12m) 31s ago 12m 150M - 18.2.0 dc2bc1663786 4df492159bb4 2024-09-11T00:16:40.171 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.uqkbkn smithi203 running (12m) 31s ago 12m 18.5M - 18.2.0 dc2bc1663786 619aa58ea314 2024-09-11T00:16:40.171 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.ypucji smithi111 *:8443,9283,8765 running (8m) 68s ago 21m 514M - 19.3.0-4854-g8f219c47 589dd18248e4 07fa31f49618 2024-09-11T00:16:40.172 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi203.smuspl smithi203 *:8443,9283,8765 running (7m) 31s ago 18m 455M - 19.3.0-4854-g8f219c47 589dd18248e4 7e5a93a5ffa7 2024-09-11T00:16:40.172 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (4m) 68s ago 21m 48.4M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 3c29c070a612 2024-09-11T00:16:40.172 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi203 smithi203 running (3m) 31s ago 18m 40.9M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 45e8285e4b4d 2024-09-11T00:16:40.172 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (7m) 68s ago 19m 7792k - 1.7.0 72c9c2088986 ec478ea14488 2024-09-11T00:16:40.172 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi203 smithi203 *:9100 running (7m) 31s ago 18m 7940k - 1.7.0 72c9c2088986 54d461cde1bc 2024-09-11T00:16:40.172 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (2m) 68s ago 17m 88.9M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 d2f1a2312736 2024-09-11T00:16:40.172 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (114s) 68s ago 16m 90.1M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 19cf95ecca7d 2024-09-11T00:16:40.172 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (75s) 68s ago 15m 10.4M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 3a3b318b337a 2024-09-11T00:16:40.172 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi203 running (35s) 31s ago 15m 10.4M 2240M 19.3.0-4854-g8f219c47 589dd18248e4 288c7e8ae34b 2024-09-11T00:16:40.172 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi203 running (14m) 31s ago 14m 210M 2240M 18.2.0 dc2bc1663786 769c7942c42b 2024-09-11T00:16:40.172 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi203 running (14m) 31s ago 14m 195M 2240M 18.2.0 dc2bc1663786 6d824001d40c 2024-09-11T00:16:40.172 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (6m) 68s ago 19m 60.1M - 2.51.0 1d3b7f56885b 3e72ac10983d 2024-09-11T00:16:40.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.171+0000 7fe54a200700 1 -- 172.21.15.111:0/1644670250 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe52c07a6f0 msgr2=0x7fe52c07cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:40.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.171+0000 7fe54a200700 1 --2- 172.21.15.111:0/1644670250 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe52c07a6f0 0x7fe52c07cba0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe544074840 tx=0x7fe530009260 comp rx=0 tx=0).stop 2024-09-11T00:16:40.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.171+0000 7fe54a200700 1 -- 172.21.15.111:0/1644670250 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe544100200 msgr2=0x7fe544073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:40.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.171+0000 7fe54a200700 1 --2- 172.21.15.111:0/1644670250 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe544100200 0x7fe544073050 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe53800f690 tx=0x7fe53800f6c0 comp rx=0 tx=0).stop 2024-09-11T00:16:40.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.171+0000 7fe54a200700 1 -- 172.21.15.111:0/1644670250 shutdown_connections 2024-09-11T00:16:40.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.171+0000 7fe54a200700 1 --2- 172.21.15.111:0/1644670250 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe52c07a6f0 0x7fe52c07cba0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:40.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.171+0000 7fe54a200700 1 --2- 172.21.15.111:0/1644670250 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe544100200 0x7fe544073050 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:40.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.171+0000 7fe54a200700 1 --2- 172.21.15.111:0/1644670250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe544100ba0 0x7fe544073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:40.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.171+0000 7fe54a200700 1 -- 172.21.15.111:0/1644670250 >> 172.21.15.111:0/1644670250 conn(0x7fe5440fba80 msgr2=0x7fe5440fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:40.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.171+0000 7fe54a200700 1 -- 172.21.15.111:0/1644670250 shutdown_connections 2024-09-11T00:16:40.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.171+0000 7fe54a200700 1 -- 172.21.15.111:0/1644670250 wait complete. 2024-09-11T00:16:40.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.305+0000 7fde21a00700 1 -- 172.21.15.111:0/4281944561 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde1c100d50 msgr2=0x7fde1c104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:40.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.305+0000 7fde21a00700 1 --2- 172.21.15.111:0/4281944561 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde1c100d50 0x7fde1c104d20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fde08009910 tx=0x7fde08009c20 comp rx=0 tx=0).stop 2024-09-11T00:16:40.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.305+0000 7fde21a00700 1 -- 172.21.15.111:0/4281944561 shutdown_connections 2024-09-11T00:16:40.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.305+0000 7fde21a00700 1 --2- 172.21.15.111:0/4281944561 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde1c100d50 0x7fde1c104d20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:40.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.305+0000 7fde21a00700 1 --2- 172.21.15.111:0/4281944561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde1c1003b0 0x7fde1c100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:40.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.305+0000 7fde21a00700 1 -- 172.21.15.111:0/4281944561 >> 172.21.15.111:0/4281944561 conn(0x7fde1c0fbc30 msgr2=0x7fde1c0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:40.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.305+0000 7fde21a00700 1 -- 172.21.15.111:0/4281944561 shutdown_connections 2024-09-11T00:16:40.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.305+0000 7fde21a00700 1 -- 172.21.15.111:0/4281944561 wait complete. 2024-09-11T00:16:40.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.306+0000 7fde21a00700 1 Processor -- start 2024-09-11T00:16:40.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.306+0000 7fde21a00700 1 -- start start 2024-09-11T00:16:40.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.307+0000 7fde21a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde1c1003b0 0x7fde1c073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:40.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.307+0000 7fde21a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde1c100d50 0x7fde1c073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:40.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.307+0000 7fde21a00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c073ad0 con 0x7fde1c100d50 2024-09-11T00:16:40.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.307+0000 7fde21a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c073c10 con 0x7fde1c1003b0 2024-09-11T00:16:40.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.307+0000 7fde1a000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde1c100d50 0x7fde1c073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:40.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.307+0000 7fde1a000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde1c100d50 0x7fde1c073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52238/0 (socket says 172.21.15.111:52238) 2024-09-11T00:16:40.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.307+0000 7fde1a000700 1 -- 172.21.15.111:0/1220653860 learned_addr learned my addr 172.21.15.111:0/1220653860 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:16:40.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.307+0000 7fde1aa00700 1 --2- 172.21.15.111:0/1220653860 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde1c1003b0 0x7fde1c073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:40.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.308+0000 7fde1a000700 1 -- 172.21.15.111:0/1220653860 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde1c1003b0 msgr2=0x7fde1c073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:40.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.308+0000 7fde1a000700 1 --2- 172.21.15.111:0/1220653860 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde1c1003b0 0x7fde1c073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:40.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.308+0000 7fde1a000700 1 -- 172.21.15.111:0/1220653860 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde080095f0 con 0x7fde1c100d50 2024-09-11T00:16:40.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.308+0000 7fde1a000700 1 --2- 172.21.15.111:0/1220653860 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde1c100d50 0x7fde1c073590 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fde0800b610 tx=0x7fde0800b640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:40.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.308+0000 7fde13400700 1 -- 172.21.15.111:0/1220653860 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde0801d070 con 0x7fde1c100d50 2024-09-11T00:16:40.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.308+0000 7fde21a00700 1 -- 172.21.15.111:0/1220653860 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde1c073e90 con 0x7fde1c100d50 2024-09-11T00:16:40.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.308+0000 7fde13400700 1 -- 172.21.15.111:0/1220653860 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fde080052a0 con 0x7fde1c100d50 2024-09-11T00:16:40.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.308+0000 7fde13400700 1 -- 172.21.15.111:0/1220653860 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde08017400 con 0x7fde1c100d50 2024-09-11T00:16:40.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.308+0000 7fde21a00700 1 -- 172.21.15.111:0/1220653860 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde1c1a22c0 con 0x7fde1c100d50 2024-09-11T00:16:40.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.309+0000 7fde21a00700 1 -- 172.21.15.111:0/1220653860 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde1c108720 con 0x7fde1c100d50 2024-09-11T00:16:40.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.310+0000 7fde13400700 1 -- 172.21.15.111:0/1220653860 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fde0800f770 con 0x7fde1c100d50 2024-09-11T00:16:40.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.311+0000 7fde13400700 1 --2- 172.21.15.111:0/1220653860 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fde0007a6f0 0x7fde0007cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:40.314 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.312+0000 7fde13400700 1 -- 172.21.15.111:0/1220653860 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fde0809e7a0 con 0x7fde1c100d50 2024-09-11T00:16:40.314 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.312+0000 7fde1aa00700 1 --2- 172.21.15.111:0/1220653860 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fde0007a6f0 0x7fde0007cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:40.314 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.312+0000 7fde1aa00700 1 --2- 172.21.15.111:0/1220653860 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fde0007a6f0 0x7fde0007cba0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fde0c009c60 tx=0x7fde0c009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:40.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.316+0000 7fde13400700 1 -- 172.21.15.111:0/1220653860 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fde08061ea0 con 0x7fde1c100d50 2024-09-11T00:16:40.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.623+0000 7fde21a00700 1 -- 172.21.15.111:0/1220653860 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fde1c04ea50 con 0x7fde1c100d50 2024-09-11T00:16:40.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.624+0000 7fde13400700 1 -- 172.21.15.111:0/1220653860 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7fde08064fc0 con 0x7fde1c100d50 2024-09-11T00:16:40.626 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:16:40.626 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-11T00:16:40.626 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:16:40.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:16:40.626 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-11T00:16:40.627 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:16:40.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:16:40.627 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-11T00:16:40.627 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-09-11T00:16:40.627 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 4 2024-09-11T00:16:40.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:16:40.627 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-11T00:16:40.627 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-11T00:16:40.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:16:40.628 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-11T00:16:40.628 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 5, 2024-09-11T00:16:40.628 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 8 2024-09-11T00:16:40.628 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-11T00:16:40.628 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:16:40.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.626+0000 7fde21a00700 1 -- 172.21.15.111:0/1220653860 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fde0007a6f0 msgr2=0x7fde0007cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:40.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.626+0000 7fde21a00700 1 --2- 172.21.15.111:0/1220653860 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fde0007a6f0 0x7fde0007cba0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fde0c009c60 tx=0x7fde0c009260 comp rx=0 tx=0).stop 2024-09-11T00:16:40.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.626+0000 7fde21a00700 1 -- 172.21.15.111:0/1220653860 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde1c100d50 msgr2=0x7fde1c073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:40.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.626+0000 7fde21a00700 1 --2- 172.21.15.111:0/1220653860 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde1c100d50 0x7fde1c073590 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fde0800b610 tx=0x7fde0800b640 comp rx=0 tx=0).stop 2024-09-11T00:16:40.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.627+0000 7fde21a00700 1 -- 172.21.15.111:0/1220653860 shutdown_connections 2024-09-11T00:16:40.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.627+0000 7fde21a00700 1 --2- 172.21.15.111:0/1220653860 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fde0007a6f0 0x7fde0007cba0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:40.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.627+0000 7fde21a00700 1 --2- 172.21.15.111:0/1220653860 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde1c1003b0 0x7fde1c073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:40.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.627+0000 7fde21a00700 1 --2- 172.21.15.111:0/1220653860 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde1c100d50 0x7fde1c073590 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:40.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.627+0000 7fde21a00700 1 -- 172.21.15.111:0/1220653860 >> 172.21.15.111:0/1220653860 conn(0x7fde1c0fbc30 msgr2=0x7fde1c0fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:40.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.627+0000 7fde21a00700 1 -- 172.21.15.111:0/1220653860 shutdown_connections 2024-09-11T00:16:40.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.627+0000 7fde21a00700 1 -- 172.21.15.111:0/1220653860 wait complete. 2024-09-11T00:16:40.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.764+0000 7f99d1400700 1 -- 172.21.15.111:0/548909112 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99cc100250 msgr2=0x7f99cc100620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:40.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.764+0000 7f99d1400700 1 --2- 172.21.15.111:0/548909112 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99cc100250 0x7f99cc100620 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f99bc009910 tx=0x7f99bc009c20 comp rx=0 tx=0).stop 2024-09-11T00:16:40.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.764+0000 7f99d1400700 1 -- 172.21.15.111:0/548909112 shutdown_connections 2024-09-11T00:16:40.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.764+0000 7f99d1400700 1 --2- 172.21.15.111:0/548909112 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99cc100bf0 0x7f99cc104bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:40.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.764+0000 7f99d1400700 1 --2- 172.21.15.111:0/548909112 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99cc100250 0x7f99cc100620 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:40.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.764+0000 7f99d1400700 1 -- 172.21.15.111:0/548909112 >> 172.21.15.111:0/548909112 conn(0x7f99cc0fbb10 msgr2=0x7f99cc0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:40.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.764+0000 7f99d1400700 1 -- 172.21.15.111:0/548909112 shutdown_connections 2024-09-11T00:16:40.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.764+0000 7f99d1400700 1 -- 172.21.15.111:0/548909112 wait complete. 2024-09-11T00:16:40.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.765+0000 7f99d1400700 1 Processor -- start 2024-09-11T00:16:40.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.765+0000 7f99d1400700 1 -- start start 2024-09-11T00:16:40.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.765+0000 7f99d1400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99cc100250 0x7f99cc19b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:40.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.765+0000 7f99d1400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99cc100bf0 0x7f99cc19bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:40.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.765+0000 7f99d1400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc19c5b0 con 0x7f99cc100bf0 2024-09-11T00:16:40.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.766+0000 7f99d1400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc195a60 con 0x7f99cc100250 2024-09-11T00:16:40.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.766+0000 7f99c3e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99cc100bf0 0x7f99cc19bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:40.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.766+0000 7f99c3e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99cc100bf0 0x7f99cc19bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52258/0 (socket says 172.21.15.111:52258) 2024-09-11T00:16:40.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.766+0000 7f99c3e00700 1 -- 172.21.15.111:0/4000621623 learned_addr learned my addr 172.21.15.111:0/4000621623 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:16:40.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.766+0000 7f99cbe00700 1 --2- 172.21.15.111:0/4000621623 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99cc100250 0x7f99cc19b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:40.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.766+0000 7f99c3e00700 1 -- 172.21.15.111:0/4000621623 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99cc100250 msgr2=0x7f99cc19b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:40.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.766+0000 7f99c3e00700 1 --2- 172.21.15.111:0/4000621623 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99cc100250 0x7f99cc19b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:40.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.766+0000 7f99c3e00700 1 -- 172.21.15.111:0/4000621623 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc0095f0 con 0x7f99cc100bf0 2024-09-11T00:16:40.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.767+0000 7f99c3e00700 1 --2- 172.21.15.111:0/4000621623 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99cc100bf0 0x7f99cc19bf20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f99b400e8f0 tx=0x7f99b400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:40.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.767+0000 7f99c9600700 1 -- 172.21.15.111:0/4000621623 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99b4009790 con 0x7f99cc100bf0 2024-09-11T00:16:40.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.767+0000 7f99c9600700 1 -- 172.21.15.111:0/4000621623 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f99b400c810 con 0x7f99cc100bf0 2024-09-11T00:16:40.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.767+0000 7f99c9600700 1 -- 172.21.15.111:0/4000621623 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99b4005580 con 0x7f99cc100bf0 2024-09-11T00:16:40.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.767+0000 7f99d1400700 1 -- 172.21.15.111:0/4000621623 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99cc195d40 con 0x7f99cc100bf0 2024-09-11T00:16:40.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.767+0000 7f99d1400700 1 -- 172.21.15.111:0/4000621623 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99cc196290 con 0x7f99cc100bf0 2024-09-11T00:16:40.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.768+0000 7f99d1400700 1 -- 172.21.15.111:0/4000621623 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99cc04f2a0 con 0x7f99cc100bf0 2024-09-11T00:16:40.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.769+0000 7f99c9600700 1 -- 172.21.15.111:0/4000621623 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f99b400c980 con 0x7f99cc100bf0 2024-09-11T00:16:40.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.770+0000 7f99c9600700 1 --2- 172.21.15.111:0/4000621623 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f99b007a6f0 0x7f99b007cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:40.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.770+0000 7f99c9600700 1 -- 172.21.15.111:0/4000621623 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f99b4014070 con 0x7f99cc100bf0 2024-09-11T00:16:40.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.770+0000 7f99cbe00700 1 --2- 172.21.15.111:0/4000621623 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f99b007a6f0 0x7f99b007cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:40.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.771+0000 7f99cbe00700 1 --2- 172.21.15.111:0/4000621623 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f99b007a6f0 0x7f99b007cba0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00b760 tx=0x7f99bc005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:40.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:40.774+0000 7f99c9600700 1 -- 172.21.15.111:0/4000621623 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f99b4060c30 con 0x7f99cc100bf0 2024-09-11T00:16:40.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:40 smithi111 ceph-mon[90842]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:16:40.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:40 smithi111 ceph-mon[90842]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:16:40.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:40 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/1220653860' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:16:41.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.041+0000 7f99d1400700 1 -- 172.21.15.111:0/4000621623 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f99cc1965a0 con 0x7f99cc100bf0 2024-09-11T00:16:41.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.042+0000 7f99c9600700 1 -- 172.21.15.111:0/4000621623 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1921 (secure 0 0 0) 0x7f99b4063d50 con 0x7f99cc100bf0 2024-09-11T00:16:41.044 INFO:teuthology.orchestra.run.smithi111.stdout:e15 2024-09-11T00:16:41.044 INFO:teuthology.orchestra.run.smithi111.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-11T00:16:41.044 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T00:16:41.044 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:16:41.044 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-11T00:16:41.044 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:16:41.045 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-11T00:16:41.045 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-11T00:16:41.045 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 14 2024-09-11T00:16:41.045 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-11T00:16:41.045 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-11T00:03:47.950356+0000 2024-09-11T00:16:41.045 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-11T00:04:06.275905+0000 2024-09-11T00:16:41.045 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-11T00:16:41.045 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-11T00:16:41.045 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-11T00:16:41.045 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-11T00:16:41.045 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-11T00:16:41.045 INFO:teuthology.orchestra.run.smithi111.stdout:max_xattr_size 65536 2024-09-11T00:16:41.046 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-11T00:16:41.046 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-11T00:16:41.046 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 47 2024-09-11T00:16:41.046 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:16:41.046 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-11T00:16:41.046 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-11T00:16:41.047 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=24363} 2024-09-11T00:16:41.047 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-11T00:16:41.047 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-11T00:16:41.047 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-11T00:16:41.047 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-11T00:16:41.047 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-11T00:16:41.048 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data enabled 2024-09-11T00:16:41.048 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-11T00:16:41.048 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-11T00:16:41.048 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 1 2024-09-11T00:16:41.048 INFO:teuthology.orchestra.run.smithi111.stdout:qdb_cluster leader: 0 members: 2024-09-11T00:16:41.048 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.tcrqop{0:24363} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.203:6824/3082736449,v1:172.21.15.203:6825/3082736449] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:16:41.049 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:16:41.049 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:16:41.049 INFO:teuthology.orchestra.run.smithi111.stdout:Standby daemons: 2024-09-11T00:16:41.049 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:16:41.049 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.rucaba{-1:14554} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6828/2045133285,v1:172.21.15.111:6829/2045133285] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:16:41.049 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.gmgsay{-1:14566} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.111:6826/1122545830,v1:172.21.15.111:6827/1122545830] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:16:41.049 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.uqkbkn{-1:24379} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.203:6826/695613114,v1:172.21.15.203:6827/695613114] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:16:41.051 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:40 smithi203 ceph-mon[69002]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:16:41.051 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:40 smithi203 ceph-mon[69002]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:16:41.051 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:40 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/1220653860' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:16:41.052 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:40 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4-activate[83410]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-11T00:16:41.052 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:40 smithi203 bash[83395]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-11T00:16:41.052 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:40 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4-activate[83410]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-11T00:16:41.052 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:40 smithi203 bash[83395]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-11T00:16:41.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.044+0000 7f99d1400700 1 -- 172.21.15.111:0/4000621623 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f99b007a6f0 msgr2=0x7f99b007cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:41.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.044+0000 7f99d1400700 1 --2- 172.21.15.111:0/4000621623 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f99b007a6f0 0x7f99b007cba0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00b760 tx=0x7f99bc005a90 comp rx=0 tx=0).stop 2024-09-11T00:16:41.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.044+0000 7f99d1400700 1 -- 172.21.15.111:0/4000621623 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99cc100bf0 msgr2=0x7f99cc19bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:41.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.044+0000 7f99d1400700 1 --2- 172.21.15.111:0/4000621623 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99cc100bf0 0x7f99cc19bf20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f99b400e8f0 tx=0x7f99b400ec00 comp rx=0 tx=0).stop 2024-09-11T00:16:41.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.044+0000 7f99d1400700 1 -- 172.21.15.111:0/4000621623 shutdown_connections 2024-09-11T00:16:41.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.044+0000 7f99d1400700 1 --2- 172.21.15.111:0/4000621623 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f99b007a6f0 0x7f99b007cba0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:41.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.044+0000 7f99d1400700 1 --2- 172.21.15.111:0/4000621623 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99cc100250 0x7f99cc19b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:41.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.044+0000 7f99d1400700 1 --2- 172.21.15.111:0/4000621623 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99cc100bf0 0x7f99cc19bf20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:41.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.044+0000 7f99d1400700 1 -- 172.21.15.111:0/4000621623 >> 172.21.15.111:0/4000621623 conn(0x7f99cc0fbb10 msgr2=0x7f99cc0fd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:41.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.044+0000 7f99d1400700 1 -- 172.21.15.111:0/4000621623 shutdown_connections 2024-09-11T00:16:41.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.044+0000 7f99d1400700 1 -- 172.21.15.111:0/4000621623 wait complete. 2024-09-11T00:16:41.055 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 15 2024-09-11T00:16:41.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.182+0000 7f1234e00700 1 -- 172.21.15.111:0/1860604221 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1230068fd0 msgr2=0x7f1230104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:41.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.182+0000 7f1234e00700 1 --2- 172.21.15.111:0/1860604221 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1230068fd0 0x7f1230104df0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f121c009910 tx=0x7f121c009c20 comp rx=0 tx=0).stop 2024-09-11T00:16:41.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.182+0000 7f1234e00700 1 -- 172.21.15.111:0/1860604221 shutdown_connections 2024-09-11T00:16:41.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.182+0000 7f1234e00700 1 --2- 172.21.15.111:0/1860604221 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1230068fd0 0x7f1230104df0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:41.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.182+0000 7f1234e00700 1 --2- 172.21.15.111:0/1860604221 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1230068630 0x7f1230068a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:41.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.182+0000 7f1234e00700 1 -- 172.21.15.111:0/1860604221 >> 172.21.15.111:0/1860604221 conn(0x7f1230074f50 msgr2=0x7f1230075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:41.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.182+0000 7f1234e00700 1 -- 172.21.15.111:0/1860604221 shutdown_connections 2024-09-11T00:16:41.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.182+0000 7f1234e00700 1 -- 172.21.15.111:0/1860604221 wait complete. 2024-09-11T00:16:41.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.183+0000 7f1234e00700 1 Processor -- start 2024-09-11T00:16:41.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.183+0000 7f1234e00700 1 -- start start 2024-09-11T00:16:41.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.184+0000 7f1234e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1230068630 0x7f1230198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:41.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.184+0000 7f1234e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1230068fd0 0x7f1230198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:41.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.184+0000 7f1234e00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1230198c60 con 0x7f1230068fd0 2024-09-11T00:16:41.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.184+0000 7f1234e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123019c9f0 con 0x7f1230068630 2024-09-11T00:16:41.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.184+0000 7f122d400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1230068fd0 0x7f1230198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:41.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.184+0000 7f122d400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1230068fd0 0x7f1230198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52276/0 (socket says 172.21.15.111:52276) 2024-09-11T00:16:41.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.184+0000 7f122d400700 1 -- 172.21.15.111:0/660714785 learned_addr learned my addr 172.21.15.111:0/660714785 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:16:41.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.184+0000 7f122de00700 1 --2- 172.21.15.111:0/660714785 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1230068630 0x7f1230198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:41.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.185+0000 7f122d400700 1 -- 172.21.15.111:0/660714785 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1230068630 msgr2=0x7f1230198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:41.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.185+0000 7f122d400700 1 --2- 172.21.15.111:0/660714785 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1230068630 0x7f1230198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:41.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.185+0000 7f122d400700 1 -- 172.21.15.111:0/660714785 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121c0095f0 con 0x7f1230068fd0 2024-09-11T00:16:41.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.185+0000 7f122d400700 1 --2- 172.21.15.111:0/660714785 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1230068fd0 0x7f1230198580 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f121c009fd0 tx=0x7f121c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:41.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.185+0000 7f1226a00700 1 -- 172.21.15.111:0/660714785 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f121c01d070 con 0x7f1230068fd0 2024-09-11T00:16:41.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.185+0000 7f1226a00700 1 -- 172.21.15.111:0/660714785 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f121c022470 con 0x7f1230068fd0 2024-09-11T00:16:41.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.185+0000 7f1234e00700 1 -- 172.21.15.111:0/660714785 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f123019cc70 con 0x7f1230068fd0 2024-09-11T00:16:41.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.185+0000 7f1226a00700 1 -- 172.21.15.111:0/660714785 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f121c017650 con 0x7f1230068fd0 2024-09-11T00:16:41.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.185+0000 7f1234e00700 1 -- 172.21.15.111:0/660714785 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123019d100 con 0x7f1230068fd0 2024-09-11T00:16:41.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.186+0000 7f1234e00700 1 -- 172.21.15.111:0/660714785 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1230104570 con 0x7f1230068fd0 2024-09-11T00:16:41.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.188+0000 7f1226a00700 1 -- 172.21.15.111:0/660714785 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f121c0225e0 con 0x7f1230068fd0 2024-09-11T00:16:41.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.189+0000 7f1226a00700 1 --2- 172.21.15.111:0/660714785 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f121407a6f0 0x7f121407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:41.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.189+0000 7f1226a00700 1 -- 172.21.15.111:0/660714785 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f121c09e750 con 0x7f1230068fd0 2024-09-11T00:16:41.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.189+0000 7f122de00700 1 --2- 172.21.15.111:0/660714785 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f121407a6f0 0x7f121407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:41.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.190+0000 7f122de00700 1 --2- 172.21.15.111:0/660714785 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f121407a6f0 0x7f121407cba0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1220009c60 tx=0x7f1220009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:41.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.193+0000 7f1226a00700 1 -- 172.21.15.111:0/660714785 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f121c061ef0 con 0x7f1230068fd0 2024-09-11T00:16:41.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.433+0000 7f1234e00700 1 -- 172.21.15.111:0/660714785 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f123002ccf0 con 0x7f121407a6f0 2024-09-11T00:16:41.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.434+0000 7f1226a00700 1 -- 172.21.15.111:0/660714785 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f123002ccf0 con 0x7f121407a6f0 2024-09-11T00:16:41.437 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:16:41.437 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e", 2024-09-11T00:16:41.437 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-11T00:16:41.437 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-11T00:16:41.437 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-11T00:16:41.437 INFO:teuthology.orchestra.run.smithi111.stdout: "crash", 2024-09-11T00:16:41.437 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr", 2024-09-11T00:16:41.437 INFO:teuthology.orchestra.run.smithi111.stdout: "mon" 2024-09-11T00:16:41.437 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-11T00:16:41.437 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "10/23 daemons upgraded", 2024-09-11T00:16:41.437 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading osd daemons", 2024-09-11T00:16:41.438 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-11T00:16:41.438 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:16:41.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.437+0000 7f1234e00700 1 -- 172.21.15.111:0/660714785 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f121407a6f0 msgr2=0x7f121407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:41.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.437+0000 7f1234e00700 1 --2- 172.21.15.111:0/660714785 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f121407a6f0 0x7f121407cba0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1220009c60 tx=0x7f1220009260 comp rx=0 tx=0).stop 2024-09-11T00:16:41.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.437+0000 7f1234e00700 1 -- 172.21.15.111:0/660714785 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1230068fd0 msgr2=0x7f1230198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:41.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.437+0000 7f1234e00700 1 --2- 172.21.15.111:0/660714785 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1230068fd0 0x7f1230198580 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f121c009fd0 tx=0x7f121c00f690 comp rx=0 tx=0).stop 2024-09-11T00:16:41.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.437+0000 7f1234e00700 1 -- 172.21.15.111:0/660714785 shutdown_connections 2024-09-11T00:16:41.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.437+0000 7f1234e00700 1 --2- 172.21.15.111:0/660714785 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f121407a6f0 0x7f121407cba0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:41.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.437+0000 7f1234e00700 1 --2- 172.21.15.111:0/660714785 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1230068630 0x7f1230198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:41.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.437+0000 7f1234e00700 1 --2- 172.21.15.111:0/660714785 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1230068fd0 0x7f1230198580 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:41.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.437+0000 7f1234e00700 1 -- 172.21.15.111:0/660714785 >> 172.21.15.111:0/660714785 conn(0x7f1230074f50 msgr2=0x7f12300fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:41.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.437+0000 7f1234e00700 1 -- 172.21.15.111:0/660714785 shutdown_connections 2024-09-11T00:16:41.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.437+0000 7f1234e00700 1 -- 172.21.15.111:0/660714785 wait complete. 2024-09-11T00:16:41.545 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:41 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4-activate[83410]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-11T00:16:41.546 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:41 smithi203 bash[83395]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-11T00:16:41.546 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:41 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4-activate[83410]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-11T00:16:41.546 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:41 smithi203 bash[83395]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-11T00:16:41.546 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:41 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4-activate[83410]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-11T00:16:41.546 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:41 smithi203 bash[83395]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-11T00:16:41.546 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:41 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4-activate[83410]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-11T00:16:41.547 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:41 smithi203 bash[83395]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-11T00:16:41.547 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:41 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4-activate[83410]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-11T00:16:41.547 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:41 smithi203 bash[83395]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-11T00:16:41.547 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:41 smithi203 podman[83395]: 2024-09-11 00:16:41.201498594 +0000 UTC m=+1.918559660 container died dc443fceba1bffe211e72c5024ad49f99f1a035ab280f226c5ea7e85d12b93a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4-activate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-11T00:16:41.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.573+0000 7ff1fa400700 1 -- 172.21.15.111:0/535783499 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1f4100bb0 msgr2=0x7ff1f4104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:41.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.573+0000 7ff1fa400700 1 --2- 172.21.15.111:0/535783499 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1f4100bb0 0x7ff1f4104b80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0009910 tx=0x7ff1e0009c20 comp rx=0 tx=0).stop 2024-09-11T00:16:41.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.573+0000 7ff1fa400700 1 -- 172.21.15.111:0/535783499 shutdown_connections 2024-09-11T00:16:41.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.573+0000 7ff1fa400700 1 --2- 172.21.15.111:0/535783499 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1f4100bb0 0x7ff1f4104b80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:41.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.573+0000 7ff1fa400700 1 --2- 172.21.15.111:0/535783499 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1f4100210 0x7ff1f41005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:41.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.573+0000 7ff1fa400700 1 -- 172.21.15.111:0/535783499 >> 172.21.15.111:0/535783499 conn(0x7ff1f40fbab0 msgr2=0x7ff1f40fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:41.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.573+0000 7ff1fa400700 1 -- 172.21.15.111:0/535783499 shutdown_connections 2024-09-11T00:16:41.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.573+0000 7ff1fa400700 1 -- 172.21.15.111:0/535783499 wait complete. 2024-09-11T00:16:41.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.574+0000 7ff1fa400700 1 Processor -- start 2024-09-11T00:16:41.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.575+0000 7ff1fa400700 1 -- start start 2024-09-11T00:16:41.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.575+0000 7ff1fa400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1f4100210 0x7ff1f419b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:41.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.575+0000 7ff1fa400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1f4100bb0 0x7ff1f419beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:41.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.575+0000 7ff1fa400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f419c540 con 0x7ff1f4100bb0 2024-09-11T00:16:41.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.575+0000 7ff1fa400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f41959f0 con 0x7ff1f4100210 2024-09-11T00:16:41.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.575+0000 7ff1f3e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1f4100bb0 0x7ff1f419beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:41.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.575+0000 7ff1f3e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1f4100bb0 0x7ff1f419beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52290/0 (socket says 172.21.15.111:52290) 2024-09-11T00:16:41.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.575+0000 7ff1f3e00700 1 -- 172.21.15.111:0/1836195878 learned_addr learned my addr 172.21.15.111:0/1836195878 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:16:41.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.576+0000 7ff1f3e00700 1 -- 172.21.15.111:0/1836195878 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1f4100210 msgr2=0x7ff1f419b970 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T00:16:41.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.576+0000 7ff1f3e00700 1 --2- 172.21.15.111:0/1836195878 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1f4100210 0x7ff1f419b970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:41.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.576+0000 7ff1f3e00700 1 -- 172.21.15.111:0/1836195878 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e00095f0 con 0x7ff1f4100bb0 2024-09-11T00:16:41.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.576+0000 7ff1f3e00700 1 --2- 172.21.15.111:0/1836195878 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1f4100bb0 0x7ff1f419beb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000b5d0 tx=0x7ff1e000b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:41.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.576+0000 7ff1f1600700 1 -- 172.21.15.111:0/1836195878 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1e001d070 con 0x7ff1f4100bb0 2024-09-11T00:16:41.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.576+0000 7ff1f1600700 1 -- 172.21.15.111:0/1836195878 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff1e00052a0 con 0x7ff1f4100bb0 2024-09-11T00:16:41.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.576+0000 7ff1f1600700 1 -- 172.21.15.111:0/1836195878 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1e0022470 con 0x7ff1f4100bb0 2024-09-11T00:16:41.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.576+0000 7ff1fa400700 1 -- 172.21.15.111:0/1836195878 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f4195c70 con 0x7ff1f4100bb0 2024-09-11T00:16:41.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.576+0000 7ff1fa400700 1 -- 172.21.15.111:0/1836195878 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f4196160 con 0x7ff1f4100bb0 2024-09-11T00:16:41.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.577+0000 7ff1fa400700 1 -- 172.21.15.111:0/1836195878 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f4108580 con 0x7ff1f4100bb0 2024-09-11T00:16:41.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.579+0000 7ff1f1600700 1 -- 172.21.15.111:0/1836195878 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7ff1e0003680 con 0x7ff1f4100bb0 2024-09-11T00:16:41.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.579+0000 7ff1f1600700 1 --2- 172.21.15.111:0/1836195878 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7ff1dc07a6f0 0x7ff1dc07cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:41.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.580+0000 7ff1f1600700 1 -- 172.21.15.111:0/1836195878 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ff1e009e6a0 con 0x7ff1f4100bb0 2024-09-11T00:16:41.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.580+0000 7ff1f9000700 1 --2- 172.21.15.111:0/1836195878 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7ff1dc07a6f0 0x7ff1dc07cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:41.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.580+0000 7ff1f9000700 1 --2- 172.21.15.111:0/1836195878 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7ff1dc07a6f0 0x7ff1dc07cba0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8009af0 tx=0x7ff1e8009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:41.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.584+0000 7ff1f1600700 1 -- 172.21.15.111:0/1836195878 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7ff1e0061e20 con 0x7ff1f4100bb0 2024-09-11T00:16:41.864 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:41 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/4000621623' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:16:41.864 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:41 smithi203 ceph-mon[69002]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:16:41.864 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:41 smithi203 ceph-mon[69002]: pgmap v151: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-09-11T00:16:41.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.899+0000 7ff1fa400700 1 -- 172.21.15.111:0/1836195878 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff1f404f2a0 con 0x7ff1f4100bb0 2024-09-11T00:16:41.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.899+0000 7ff1f1600700 1 -- 172.21.15.111:0/1836195878 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1296 (secure 0 0 0) 0x7ff1e0064f40 con 0x7ff1f4100bb0 2024-09-11T00:16:41.902 INFO:teuthology.orchestra.run.smithi111.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 46/264 objects degraded (17.424%), 15 pgs degraded 2024-09-11T00:16:41.902 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-11T00:16:41.902 INFO:teuthology.orchestra.run.smithi111.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-11T00:16:41.902 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-11T00:16:41.902 INFO:teuthology.orchestra.run.smithi111.stdout: osd.4 (root=default,host=smithi203) is down 2024-09-11T00:16:41.903 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 46/264 objects degraded (17.424%), 15 pgs degraded 2024-09-11T00:16:41.903 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-09-11T00:16:41.903 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-09-11T00:16:41.903 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-09-11T00:16:41.903 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-09-11T00:16:41.903 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-09-11T00:16:41.903 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-09-11T00:16:41.903 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-09-11T00:16:41.903 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-09-11T00:16:41.903 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-09-11T00:16:41.903 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-09-11T00:16:41.903 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-09-11T00:16:41.903 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-09-11T00:16:41.903 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-09-11T00:16:41.903 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-09-11T00:16:41.904 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-09-11T00:16:41.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.902+0000 7ff1fa400700 1 -- 172.21.15.111:0/1836195878 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7ff1dc07a6f0 msgr2=0x7ff1dc07cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:41.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.902+0000 7ff1fa400700 1 --2- 172.21.15.111:0/1836195878 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7ff1dc07a6f0 0x7ff1dc07cba0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8009af0 tx=0x7ff1e8009260 comp rx=0 tx=0).stop 2024-09-11T00:16:41.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.902+0000 7ff1fa400700 1 -- 172.21.15.111:0/1836195878 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1f4100bb0 msgr2=0x7ff1f419beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:41.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.902+0000 7ff1fa400700 1 --2- 172.21.15.111:0/1836195878 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1f4100bb0 0x7ff1f419beb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000b5d0 tx=0x7ff1e000b6b0 comp rx=0 tx=0).stop 2024-09-11T00:16:41.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.902+0000 7ff1fa400700 1 -- 172.21.15.111:0/1836195878 shutdown_connections 2024-09-11T00:16:41.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.902+0000 7ff1fa400700 1 --2- 172.21.15.111:0/1836195878 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7ff1dc07a6f0 0x7ff1dc07cba0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:41.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.902+0000 7ff1fa400700 1 --2- 172.21.15.111:0/1836195878 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1f4100210 0x7ff1f419b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:41.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.902+0000 7ff1fa400700 1 --2- 172.21.15.111:0/1836195878 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1f4100bb0 0x7ff1f419beb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:41.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.902+0000 7ff1fa400700 1 -- 172.21.15.111:0/1836195878 >> 172.21.15.111:0/1836195878 conn(0x7ff1f40fbab0 msgr2=0x7ff1f40fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:41.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.902+0000 7ff1fa400700 1 -- 172.21.15.111:0/1836195878 shutdown_connections 2024-09-11T00:16:41.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:16:41.902+0000 7ff1fa400700 1 -- 172.21.15.111:0/1836195878 wait complete. 2024-09-11T00:16:42.138 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:41 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/4000621623' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:16:42.138 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:41 smithi111 ceph-mon[90842]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:16:42.138 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:41 smithi111 ceph-mon[90842]: pgmap v151: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-09-11T00:16:42.168 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:41 smithi203 podman[83544]: 2024-09-11 00:16:41.862919452 +0000 UTC m=+0.646263748 container remove dc443fceba1bffe211e72c5024ad49f99f1a035ab280f226c5ea7e85d12b93a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4-activate, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:16:42.434 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:42 smithi203 podman[83601]: 2024-09-11 00:16:42.071684347 +0000 UTC m=+0.027291600 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:16:42.434 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:42 smithi203 podman[83601]: 2024-09-11 00:16:42.22236407 +0000 UTC m=+0.177971316 container create 485f82d3eafba2123f8e5b4605d2f3cb7b8ae4d45cf9e0e729b7549d7045c44a (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True) 2024-09-11T00:16:42.435 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:42 smithi203 podman[83601]: 2024-09-11 00:16:42.433647842 +0000 UTC m=+0.389255087 container init 485f82d3eafba2123f8e5b4605d2f3cb7b8ae4d45cf9e0e729b7549d7045c44a (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-11T00:16:42.768 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:42 smithi203 podman[83601]: 2024-09-11 00:16:42.440853052 +0000 UTC m=+0.396460299 container start 485f82d3eafba2123f8e5b4605d2f3cb7b8ae4d45cf9e0e729b7549d7045c44a (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True) 2024-09-11T00:16:42.769 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:42 smithi203 ceph-osd[83620]: -- 172.21.15.203:0/2815648408 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557c869ea1e0 con 0x557c85b85c00 2024-09-11T00:16:42.769 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:42 smithi203 bash[83601]: 485f82d3eafba2123f8e5b4605d2f3cb7b8ae4d45cf9e0e729b7549d7045c44a 2024-09-11T00:16:42.769 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:42 smithi203 systemd[1]: Started Ceph osd.4 for 03107fbe-6fd0-11ef-bcea-c7b262605968. 2024-09-11T00:16:43.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:42 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/1836195878' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-11T00:16:43.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:42 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:43.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:42 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:43.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:42 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:16:43.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:42 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/1836195878' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-11T00:16:43.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:42 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:43.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:42 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:43.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:42 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:16:44.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:43 smithi203 ceph-mon[69002]: pgmap v152: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-09-11T00:16:44.045 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:43 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4[83616]: 2024-09-11T00:16:43.910+0000 7f275843c640 -1 Falling back to public interface 2024-09-11T00:16:44.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:43 smithi111 ceph-mon[90842]: pgmap v152: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-09-11T00:16:46.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:45 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:46.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:45 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:16:46.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:45 smithi203 ceph-mon[69002]: pgmap v153: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-09-11T00:16:46.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:45 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:46.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:45 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:16:46.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:45 smithi111 ceph-mon[90842]: pgmap v153: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-09-11T00:16:47.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:47 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:47.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:47 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:47.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:47 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:47.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:47 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:48.242 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:48 smithi203 ceph-mon[69002]: Health check update: Degraded data redundancy: 46/264 objects degraded (17.424%), 15 pgs degraded (PG_DEGRADED) 2024-09-11T00:16:48.243 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:48 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:48.243 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:48 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:48.243 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:48 smithi203 ceph-mon[69002]: pgmap v154: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-09-11T00:16:48.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:48 smithi111 ceph-mon[90842]: Health check update: Degraded data redundancy: 46/264 objects degraded (17.424%), 15 pgs degraded (PG_DEGRADED) 2024-09-11T00:16:48.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:48 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:48.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:48 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:48.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:48 smithi111 ceph-mon[90842]: pgmap v154: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-09-11T00:16:49.795 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:49 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4[83616]: 2024-09-11T00:16:49.595+0000 7f275843c640 -1 osd.4 0 read_superblock omap replica is missing. 2024-09-11T00:16:50.282 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:50 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4[83616]: 2024-09-11T00:16:50.023+0000 7f275843c640 -1 osd.4 70 log_to_monitors true 2024-09-11T00:16:50.912 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:50 smithi203 ceph-mon[69002]: pgmap v155: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-09-11T00:16:50.912 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:50 smithi203 ceph-mon[69002]: from='osd.4 [v2:172.21.15.203:6808/388034274,v1:172.21.15.203:6809/388034274]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-11T00:16:50.913 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:50 smithi203 ceph-mon[69002]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-11T00:16:51.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:50 smithi111 ceph-mon[90842]: pgmap v155: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-09-11T00:16:51.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:50 smithi111 ceph-mon[90842]: from='osd.4 [v2:172.21.15.203:6808/388034274,v1:172.21.15.203:6809/388034274]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-11T00:16:51.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:50 smithi111 ceph-mon[90842]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-11T00:16:51.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:51 smithi111 ceph-mon[90842]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T00:16:51.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:51 smithi111 ceph-mon[90842]: osdmap e73: 6 total, 5 up, 6 in 2024-09-11T00:16:51.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:51 smithi111 ceph-mon[90842]: from='osd.4 [v2:172.21.15.203:6808/388034274,v1:172.21.15.203:6809/388034274]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]} : dispatch 2024-09-11T00:16:51.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:51 smithi111 ceph-mon[90842]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]} : dispatch 2024-09-11T00:16:51.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:51 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:51.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:51 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:51.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:51 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:16:51.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:51 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:16:51.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:51 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:51.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:51 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:16:51.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:51 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:16:51.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:51 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:16:51.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:51 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:16:51.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:51 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-11T00:16:51.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:51 smithi111 ceph-mon[90842]: from='osd.4 ' entity='osd.4' 2024-09-11T00:16:52.045 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:16:51 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4[83616]: 2024-09-11T00:16:51.675+0000 7f2749000640 -1 osd.4 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:16:52.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:51 smithi203 ceph-mon[69002]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T00:16:52.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:51 smithi203 ceph-mon[69002]: osdmap e73: 6 total, 5 up, 6 in 2024-09-11T00:16:52.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:51 smithi203 ceph-mon[69002]: from='osd.4 [v2:172.21.15.203:6808/388034274,v1:172.21.15.203:6809/388034274]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]} : dispatch 2024-09-11T00:16:52.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:51 smithi203 ceph-mon[69002]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]} : dispatch 2024-09-11T00:16:52.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:51 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:52.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:51 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:52.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:51 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:16:52.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:51 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:16:52.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:51 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:16:52.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:51 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:16:52.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:51 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:16:52.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:51 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:16:52.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:51 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:16:52.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:51 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-11T00:16:52.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:51 smithi203 ceph-mon[69002]: from='osd.4 ' entity='osd.4' 2024-09-11T00:16:53.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:52 smithi203 ceph-mon[69002]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-11T00:16:53.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:52 smithi203 ceph-mon[69002]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-11T00:16:53.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:52 smithi203 ceph-mon[69002]: pgmap v157: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-09-11T00:16:53.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:52 smithi203 ceph-mon[69002]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-11T00:16:53.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:52 smithi203 ceph-mon[69002]: osd.4 [v2:172.21.15.203:6808/388034274,v1:172.21.15.203:6809/388034274] boot 2024-09-11T00:16:53.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:52 smithi203 ceph-mon[69002]: osdmap e74: 6 total, 6 up, 6 in 2024-09-11T00:16:53.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:52 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T00:16:53.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:52 smithi111 ceph-mon[90842]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-11T00:16:53.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:52 smithi111 ceph-mon[90842]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-11T00:16:53.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:52 smithi111 ceph-mon[90842]: pgmap v157: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-09-11T00:16:53.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:52 smithi111 ceph-mon[90842]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-11T00:16:53.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:52 smithi111 ceph-mon[90842]: osd.4 [v2:172.21.15.203:6808/388034274,v1:172.21.15.203:6809/388034274] boot 2024-09-11T00:16:53.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:52 smithi111 ceph-mon[90842]: osdmap e74: 6 total, 6 up, 6 in 2024-09-11T00:16:53.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:52 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T00:16:55.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:54 smithi203 ceph-mon[69002]: pgmap v159: 65 pgs: 1 peering, 18 active+undersized, 15 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-09-11T00:16:55.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:54 smithi203 ceph-mon[69002]: osdmap e75: 6 total, 6 up, 6 in 2024-09-11T00:16:55.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:54 smithi111 ceph-mon[90842]: pgmap v159: 65 pgs: 1 peering, 18 active+undersized, 15 active+undersized+degraded, 31 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-09-11T00:16:55.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:54 smithi111 ceph-mon[90842]: osdmap e75: 6 total, 6 up, 6 in 2024-09-11T00:16:56.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:55 smithi203 ceph-mon[69002]: pgmap v161: 65 pgs: 1 peering, 4 active+undersized, 2 active+undersized+degraded, 58 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5/264 objects degraded (1.894%) 2024-09-11T00:16:56.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:55 smithi203 ceph-mon[69002]: Health check update: Degraded data redundancy: 5/264 objects degraded (1.894%), 2 pgs degraded (PG_DEGRADED) 2024-09-11T00:16:56.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:55 smithi111 ceph-mon[90842]: pgmap v161: 65 pgs: 1 peering, 4 active+undersized, 2 active+undersized+degraded, 58 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5/264 objects degraded (1.894%) 2024-09-11T00:16:56.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:55 smithi111 ceph-mon[90842]: Health check update: Degraded data redundancy: 5/264 objects degraded (1.894%), 2 pgs degraded (PG_DEGRADED) 2024-09-11T00:16:58.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:57 smithi203 ceph-mon[69002]: pgmap v162: 65 pgs: 1 peering, 64 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:16:58.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:16:57 smithi203 ceph-mon[69002]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/264 objects degraded (1.894%), 2 pgs degraded) 2024-09-11T00:16:58.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:57 smithi111 ceph-mon[90842]: pgmap v162: 65 pgs: 1 peering, 64 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:16:58.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:16:57 smithi111 ceph-mon[90842]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/264 objects degraded (1.894%), 2 pgs degraded) 2024-09-11T00:17:01.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:00 smithi203 ceph-mon[69002]: pgmap v163: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:01.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:00 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:01.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:00 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:17:01.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:00 smithi111 ceph-mon[90842]: pgmap v163: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:01.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:00 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:01.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:00 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:17:03.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:02 smithi203 ceph-mon[69002]: pgmap v164: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:03.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:02 smithi111 ceph-mon[90842]: pgmap v164: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:05.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:04 smithi203 ceph-mon[69002]: pgmap v165: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:05.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:04 smithi111 ceph-mon[90842]: pgmap v165: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:06.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:05 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:06.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:05 smithi203 ceph-mon[69002]: pgmap v166: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:06.405 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:05 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:06.405 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:05 smithi111 ceph-mon[90842]: pgmap v166: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:07.279 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:06 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-11T00:17:07.279 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:06 smithi203 ceph-mon[69002]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-11T00:17:07.279 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:06 smithi203 ceph-mon[69002]: Upgrade: osd.5 is safe to restart 2024-09-11T00:17:07.399 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:06 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-11T00:17:07.399 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:06 smithi111 ceph-mon[90842]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-11T00:17:07.399 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:06 smithi111 ceph-mon[90842]: Upgrade: osd.5 is safe to restart 2024-09-11T00:17:08.160 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:07 smithi203 ceph-mon[69002]: pgmap v167: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:08.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:07 smithi111 ceph-mon[90842]: pgmap v167: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:09.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:09 smithi203 ceph-mon[69002]: Upgrade: Updating osd.5 2024-09-11T00:17:09.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:09 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:09.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:09 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-11T00:17:09.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:09 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:17:09.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:09 smithi203 ceph-mon[69002]: Deploying daemon osd.5 on smithi203 2024-09-11T00:17:09.484 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:09 smithi111 ceph-mon[90842]: Upgrade: Updating osd.5 2024-09-11T00:17:09.485 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:09 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:09.485 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:09 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-11T00:17:09.485 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:09 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:17:09.485 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:09 smithi111 ceph-mon[90842]: Deploying daemon osd.5 on smithi203 2024-09-11T00:17:10.428 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:10 smithi203 ceph-mon[69002]: pgmap v168: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:10.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:10 smithi111 ceph-mon[90842]: pgmap v168: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:12.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.056+0000 7f5a2f000700 1 -- 172.21.15.111:0/4257176483 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5a28102610 msgr2=0x7f5a281029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:12.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.056+0000 7f5a2f000700 1 --2- 172.21.15.111:0/4257176483 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5a28102610 0x7f5a281029e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5a18009910 tx=0x7f5a18009c20 comp rx=0 tx=0).stop 2024-09-11T00:17:12.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.056+0000 7f5a2f000700 1 -- 172.21.15.111:0/4257176483 shutdown_connections 2024-09-11T00:17:12.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.056+0000 7f5a2f000700 1 --2- 172.21.15.111:0/4257176483 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a28102fb0 0x7f5a28106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:12.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.056+0000 7f5a2f000700 1 --2- 172.21.15.111:0/4257176483 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5a28102610 0x7f5a281029e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:12.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.056+0000 7f5a2f000700 1 -- 172.21.15.111:0/4257176483 >> 172.21.15.111:0/4257176483 conn(0x7f5a280fde90 msgr2=0x7f5a281002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:12.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.056+0000 7f5a2f000700 1 -- 172.21.15.111:0/4257176483 shutdown_connections 2024-09-11T00:17:12.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.056+0000 7f5a2f000700 1 -- 172.21.15.111:0/4257176483 wait complete. 2024-09-11T00:17:12.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.057+0000 7f5a2f000700 1 Processor -- start 2024-09-11T00:17:12.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.057+0000 7f5a2f000700 1 -- start start 2024-09-11T00:17:12.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.057+0000 7f5a2f000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5a28102610 0x7f5a28197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:12.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.057+0000 7f5a2f000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a28102fb0 0x7f5a28198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:12.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.057+0000 7f5a2f000700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a28198be0 con 0x7f5a28102610 2024-09-11T00:17:12.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.057+0000 7f5a2f000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2819c970 con 0x7f5a28102fb0 2024-09-11T00:17:12.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.058+0000 7f5a27e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5a28102610 0x7f5a28197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:12.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.058+0000 7f5a27e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5a28102610 0x7f5a28197fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40114/0 (socket says 172.21.15.111:40114) 2024-09-11T00:17:12.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.058+0000 7f5a27e00700 1 -- 172.21.15.111:0/1598272367 learned_addr learned my addr 172.21.15.111:0/1598272367 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:17:12.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.058+0000 7f5a27400700 1 --2- 172.21.15.111:0/1598272367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a28102fb0 0x7f5a28198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:12.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.058+0000 7f5a27e00700 1 -- 172.21.15.111:0/1598272367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a28102fb0 msgr2=0x7f5a28198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:12.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.058+0000 7f5a27e00700 1 --2- 172.21.15.111:0/1598272367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a28102fb0 0x7f5a28198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:12.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.058+0000 7f5a27e00700 1 -- 172.21.15.111:0/1598272367 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a180095f0 con 0x7f5a28102610 2024-09-11T00:17:12.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.058+0000 7f5a27400700 1 --2- 172.21.15.111:0/1598272367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a28102fb0 0x7f5a28198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:17:12.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.059+0000 7f5a27e00700 1 --2- 172.21.15.111:0/1598272367 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5a28102610 0x7f5a28197fc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5a180092e0 tx=0x7f5a1800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:12.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.059+0000 7f5a24c00700 1 -- 172.21.15.111:0/1598272367 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a1801d070 con 0x7f5a28102610 2024-09-11T00:17:12.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.059+0000 7f5a24c00700 1 -- 172.21.15.111:0/1598272367 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5a180052a0 con 0x7f5a28102610 2024-09-11T00:17:12.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.059+0000 7f5a2f000700 1 -- 172.21.15.111:0/1598272367 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a2819cbf0 con 0x7f5a28102610 2024-09-11T00:17:12.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.059+0000 7f5a24c00700 1 -- 172.21.15.111:0/1598272367 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a18017400 con 0x7f5a28102610 2024-09-11T00:17:12.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.059+0000 7f5a2f000700 1 -- 172.21.15.111:0/1598272367 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a2819d0e0 con 0x7f5a28102610 2024-09-11T00:17:12.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.060+0000 7f5a2f000700 1 -- 172.21.15.111:0/1598272367 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a2804ea50 con 0x7f5a28102610 2024-09-11T00:17:12.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.061+0000 7f5a24c00700 1 -- 172.21.15.111:0/1598272367 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f5a1800f820 con 0x7f5a28102610 2024-09-11T00:17:12.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.062+0000 7f5a24c00700 1 --2- 172.21.15.111:0/1598272367 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f5a0c07a6f0 0x7f5a0c07cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:12.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.062+0000 7f5a24c00700 1 -- 172.21.15.111:0/1598272367 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f5a1809e500 con 0x7f5a28102610 2024-09-11T00:17:12.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.062+0000 7f5a27400700 1 --2- 172.21.15.111:0/1598272367 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f5a0c07a6f0 0x7f5a0c07cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:12.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.063+0000 7f5a27400700 1 --2- 172.21.15.111:0/1598272367 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f5a0c07a6f0 0x7f5a0c07cba0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5a281995e0 tx=0x7f5a14009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:12.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.067+0000 7f5a24c00700 1 -- 172.21.15.111:0/1598272367 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f5a18061c80 con 0x7f5a28102610 2024-09-11T00:17:12.216 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:11 smithi203 systemd[1]: Stopping Ceph osd.5 for 03107fbe-6fd0-11ef-bcea-c7b262605968... 2024-09-11T00:17:12.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.307+0000 7f5a2f000700 1 -- 172.21.15.111:0/1598272367 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a2819d5c0 con 0x7f5a0c07a6f0 2024-09-11T00:17:12.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.309+0000 7f5a24c00700 1 -- 172.21.15.111:0/1598272367 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f5a2819d5c0 con 0x7f5a0c07a6f0 2024-09-11T00:17:12.314 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.311+0000 7f5a2f000700 1 -- 172.21.15.111:0/1598272367 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f5a0c07a6f0 msgr2=0x7f5a0c07cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:12.314 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.311+0000 7f5a2f000700 1 --2- 172.21.15.111:0/1598272367 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f5a0c07a6f0 0x7f5a0c07cba0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5a281995e0 tx=0x7f5a14009260 comp rx=0 tx=0).stop 2024-09-11T00:17:12.314 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.311+0000 7f5a2f000700 1 -- 172.21.15.111:0/1598272367 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5a28102610 msgr2=0x7f5a28197fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:12.314 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.311+0000 7f5a2f000700 1 --2- 172.21.15.111:0/1598272367 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5a28102610 0x7f5a28197fc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5a180092e0 tx=0x7f5a1800b6c0 comp rx=0 tx=0).stop 2024-09-11T00:17:12.314 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.311+0000 7f5a2f000700 1 -- 172.21.15.111:0/1598272367 shutdown_connections 2024-09-11T00:17:12.314 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.311+0000 7f5a2f000700 1 --2- 172.21.15.111:0/1598272367 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f5a0c07a6f0 0x7f5a0c07cba0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:12.314 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.311+0000 7f5a2f000700 1 --2- 172.21.15.111:0/1598272367 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5a28102610 0x7f5a28197fc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:12.314 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.311+0000 7f5a2f000700 1 --2- 172.21.15.111:0/1598272367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a28102fb0 0x7f5a28198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:12.314 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.311+0000 7f5a2f000700 1 -- 172.21.15.111:0/1598272367 >> 172.21.15.111:0/1598272367 conn(0x7f5a280fde90 msgr2=0x7f5a280ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:12.314 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.312+0000 7f5a2f000700 1 -- 172.21.15.111:0/1598272367 shutdown_connections 2024-09-11T00:17:12.314 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.312+0000 7f5a2f000700 1 -- 172.21.15.111:0/1598272367 wait complete. 2024-09-11T00:17:12.329 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:17:12.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.449+0000 7fb8b9e00700 1 -- 172.21.15.111:0/813324979 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8b4100d50 msgr2=0x7fb8b4104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:12.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.449+0000 7fb8b9e00700 1 --2- 172.21.15.111:0/813324979 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8b4100d50 0x7fb8b4104d20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0009910 tx=0x7fb8a0009c20 comp rx=0 tx=0).stop 2024-09-11T00:17:12.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.449+0000 7fb8b9e00700 1 -- 172.21.15.111:0/813324979 shutdown_connections 2024-09-11T00:17:12.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.449+0000 7fb8b9e00700 1 --2- 172.21.15.111:0/813324979 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8b4100d50 0x7fb8b4104d20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:12.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.449+0000 7fb8b9e00700 1 --2- 172.21.15.111:0/813324979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8b41003b0 0x7fb8b4100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:12.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.449+0000 7fb8b9e00700 1 -- 172.21.15.111:0/813324979 >> 172.21.15.111:0/813324979 conn(0x7fb8b40fbc30 msgr2=0x7fb8b40fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:12.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.449+0000 7fb8b9e00700 1 -- 172.21.15.111:0/813324979 shutdown_connections 2024-09-11T00:17:12.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.449+0000 7fb8b9e00700 1 -- 172.21.15.111:0/813324979 wait complete. 2024-09-11T00:17:12.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.450+0000 7fb8b9e00700 1 Processor -- start 2024-09-11T00:17:12.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.451+0000 7fb8b9e00700 1 -- start start 2024-09-11T00:17:12.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.451+0000 7fb8b9e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8b41003b0 0x7fb8b4197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:12.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.451+0000 7fb8b9e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8b4100d50 0x7fb8b4198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:12.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.451+0000 7fb8b9e00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b4198c00 con 0x7fb8b41003b0 2024-09-11T00:17:12.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.451+0000 7fb8b9e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b419c990 con 0x7fb8b4100d50 2024-09-11T00:17:12.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.451+0000 7fb8b2a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8b41003b0 0x7fb8b4197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:12.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.451+0000 7fb8b2000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8b4100d50 0x7fb8b4198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:12.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.451+0000 7fb8b2a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8b41003b0 0x7fb8b4197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40126/0 (socket says 172.21.15.111:40126) 2024-09-11T00:17:12.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.451+0000 7fb8b2a00700 1 -- 172.21.15.111:0/4259951384 learned_addr learned my addr 172.21.15.111:0/4259951384 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:17:12.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.452+0000 7fb8b2000700 1 -- 172.21.15.111:0/4259951384 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8b41003b0 msgr2=0x7fb8b4197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:12.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.452+0000 7fb8b2000700 1 --2- 172.21.15.111:0/4259951384 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8b41003b0 0x7fb8b4197fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:12.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.452+0000 7fb8b2000700 1 -- 172.21.15.111:0/4259951384 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a00095f0 con 0x7fb8b4100d50 2024-09-11T00:17:12.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.452+0000 7fb8b2000700 1 --2- 172.21.15.111:0/4259951384 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8b4100d50 0x7fb8b4198520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0006010 tx=0x7fb8a000f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:12.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.452+0000 7fb8b8a00700 1 -- 172.21.15.111:0/4259951384 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8a001d070 con 0x7fb8b4100d50 2024-09-11T00:17:12.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.452+0000 7fb8b8a00700 1 -- 172.21.15.111:0/4259951384 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb8a00050d0 con 0x7fb8b4100d50 2024-09-11T00:17:12.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.452+0000 7fb8b9e00700 1 -- 172.21.15.111:0/4259951384 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b419cc10 con 0x7fb8b4100d50 2024-09-11T00:17:12.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.452+0000 7fb8b8a00700 1 -- 172.21.15.111:0/4259951384 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8a0003e90 con 0x7fb8b4100d50 2024-09-11T00:17:12.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.452+0000 7fb8b9e00700 1 -- 172.21.15.111:0/4259951384 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b419d0d0 con 0x7fb8b4100d50 2024-09-11T00:17:12.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.454+0000 7fb8b9e00700 1 -- 172.21.15.111:0/4259951384 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b41044a0 con 0x7fb8b4100d50 2024-09-11T00:17:12.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.455+0000 7fb8b8a00700 1 -- 172.21.15.111:0/4259951384 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fb8a0003680 con 0x7fb8b4100d50 2024-09-11T00:17:12.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.456+0000 7fb8b8a00700 1 --2- 172.21.15.111:0/4259951384 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb89807a6f0 0x7fb89807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:12.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.456+0000 7fb8b8a00700 1 -- 172.21.15.111:0/4259951384 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb8a009e6b0 con 0x7fb8b4100d50 2024-09-11T00:17:12.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.456+0000 7fb8b2a00700 1 --2- 172.21.15.111:0/4259951384 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb89807a6f0 0x7fb89807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:12.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.457+0000 7fb8b2a00700 1 --2- 172.21.15.111:0/4259951384 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb89807a6f0 0x7fb89807cba0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4009d20 tx=0x7fb8a4009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:12.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.461+0000 7fb8b8a00700 1 -- 172.21.15.111:0/4259951384 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fb8a0061db0 con 0x7fb8b4100d50 2024-09-11T00:17:12.545 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:12 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[48583]: 2024-09-11T00:17:12.213+0000 7f436c400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:17:12.545 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:12 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[48583]: 2024-09-11T00:17:12.213+0000 7f436c400700 -1 osd.5 75 *** Got signal Terminated *** 2024-09-11T00:17:12.546 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:12 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[48583]: 2024-09-11T00:17:12.213+0000 7f436c400700 -1 osd.5 75 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:17:12.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.716+0000 7fb8b9e00700 1 -- 172.21.15.111:0/4259951384 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8b402cca0 con 0x7fb89807a6f0 2024-09-11T00:17:12.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.718+0000 7fb8b8a00700 1 -- 172.21.15.111:0/4259951384 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fb8b402cca0 con 0x7fb89807a6f0 2024-09-11T00:17:12.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.720+0000 7fb8b9e00700 1 -- 172.21.15.111:0/4259951384 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb89807a6f0 msgr2=0x7fb89807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:12.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.720+0000 7fb8b9e00700 1 --2- 172.21.15.111:0/4259951384 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb89807a6f0 0x7fb89807cba0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4009d20 tx=0x7fb8a4009260 comp rx=0 tx=0).stop 2024-09-11T00:17:12.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.720+0000 7fb8b9e00700 1 -- 172.21.15.111:0/4259951384 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8b4100d50 msgr2=0x7fb8b4198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:12.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.720+0000 7fb8b9e00700 1 --2- 172.21.15.111:0/4259951384 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8b4100d50 0x7fb8b4198520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0006010 tx=0x7fb8a000f690 comp rx=0 tx=0).stop 2024-09-11T00:17:12.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.720+0000 7fb8b9e00700 1 -- 172.21.15.111:0/4259951384 shutdown_connections 2024-09-11T00:17:12.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.720+0000 7fb8b9e00700 1 --2- 172.21.15.111:0/4259951384 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb89807a6f0 0x7fb89807cba0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:12.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.720+0000 7fb8b9e00700 1 --2- 172.21.15.111:0/4259951384 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8b41003b0 0x7fb8b4197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:12.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.720+0000 7fb8b9e00700 1 --2- 172.21.15.111:0/4259951384 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8b4100d50 0x7fb8b4198520 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:12.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.720+0000 7fb8b9e00700 1 -- 172.21.15.111:0/4259951384 >> 172.21.15.111:0/4259951384 conn(0x7fb8b40fbc30 msgr2=0x7fb8b40fd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:12.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.721+0000 7fb8b9e00700 1 -- 172.21.15.111:0/4259951384 shutdown_connections 2024-09-11T00:17:12.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.721+0000 7fb8b9e00700 1 -- 172.21.15.111:0/4259951384 wait complete. 2024-09-11T00:17:12.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.857+0000 7f3726e00700 1 -- 172.21.15.111:0/469528138 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3720073070 msgr2=0x7f3720073440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:12.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.857+0000 7f3726e00700 1 --2- 172.21.15.111:0/469528138 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3720073070 0x7f3720073440 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3710009940 tx=0x7f3710009c50 comp rx=0 tx=0).stop 2024-09-11T00:17:12.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.857+0000 7f3726e00700 1 -- 172.21.15.111:0/469528138 shutdown_connections 2024-09-11T00:17:12.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.857+0000 7f3726e00700 1 --2- 172.21.15.111:0/469528138 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3720073980 0x7f372010c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:12.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.857+0000 7f3726e00700 1 --2- 172.21.15.111:0/469528138 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3720073070 0x7f3720073440 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:12.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.857+0000 7f3726e00700 1 -- 172.21.15.111:0/469528138 >> 172.21.15.111:0/469528138 conn(0x7f37200fbc90 msgr2=0x7f37200fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:12.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.857+0000 7f3726e00700 1 -- 172.21.15.111:0/469528138 shutdown_connections 2024-09-11T00:17:12.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.857+0000 7f3726e00700 1 -- 172.21.15.111:0/469528138 wait complete. 2024-09-11T00:17:12.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.858+0000 7f3726e00700 1 Processor -- start 2024-09-11T00:17:12.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.858+0000 7f3726e00700 1 -- start start 2024-09-11T00:17:12.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.858+0000 7f3726e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3720073070 0x7f3720197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:12.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.858+0000 7f3726e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3720073980 0x7f37201984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:12.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.858+0000 7f3726e00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3720198b80 con 0x7f3720073070 2024-09-11T00:17:12.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.858+0000 7f3726e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372019c910 con 0x7f3720073980 2024-09-11T00:17:12.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.859+0000 7f371fe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3720073070 0x7f3720197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:12.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.859+0000 7f371fe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3720073070 0x7f3720197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40132/0 (socket says 172.21.15.111:40132) 2024-09-11T00:17:12.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.859+0000 7f371fe00700 1 -- 172.21.15.111:0/2609401831 learned_addr learned my addr 172.21.15.111:0/2609401831 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:17:12.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.859+0000 7f371f400700 1 --2- 172.21.15.111:0/2609401831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3720073980 0x7f37201984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:12.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.859+0000 7f371fe00700 1 -- 172.21.15.111:0/2609401831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3720073980 msgr2=0x7f37201984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:12.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.859+0000 7f371fe00700 1 --2- 172.21.15.111:0/2609401831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3720073980 0x7f37201984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:12.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.859+0000 7f371fe00700 1 -- 172.21.15.111:0/2609401831 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37100095f0 con 0x7f3720073070 2024-09-11T00:17:12.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.859+0000 7f371fe00700 1 --2- 172.21.15.111:0/2609401831 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3720073070 0x7f3720197f60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3710000c00 tx=0x7f371000bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:12.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.860+0000 7f371cc00700 1 -- 172.21.15.111:0/2609401831 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f371001d070 con 0x7f3720073070 2024-09-11T00:17:12.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.860+0000 7f371cc00700 1 -- 172.21.15.111:0/2609401831 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3710003d10 con 0x7f3720073070 2024-09-11T00:17:12.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.860+0000 7f3726e00700 1 -- 172.21.15.111:0/2609401831 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f372019cb90 con 0x7f3720073070 2024-09-11T00:17:12.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.860+0000 7f371cc00700 1 -- 172.21.15.111:0/2609401831 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f371000fe90 con 0x7f3720073070 2024-09-11T00:17:12.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.860+0000 7f3726e00700 1 -- 172.21.15.111:0/2609401831 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f372019d020 con 0x7f3720073070 2024-09-11T00:17:12.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.861+0000 7f3726e00700 1 -- 172.21.15.111:0/2609401831 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3720109bf0 con 0x7f3720073070 2024-09-11T00:17:12.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.862+0000 7f371cc00700 1 -- 172.21.15.111:0/2609401831 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f371000f6f0 con 0x7f3720073070 2024-09-11T00:17:12.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.864+0000 7f371cc00700 1 --2- 172.21.15.111:0/2609401831 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f370407a6f0 0x7f370407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:12.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.864+0000 7f371cc00700 1 -- 172.21.15.111:0/2609401831 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f371009e4b0 con 0x7f3720073070 2024-09-11T00:17:12.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.864+0000 7f371f400700 1 --2- 172.21.15.111:0/2609401831 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f370407a6f0 0x7f370407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:12.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.865+0000 7f371f400700 1 --2- 172.21.15.111:0/2609401831 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f370407a6f0 0x7f370407cba0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3720199580 tx=0x7f370c009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:12.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:12.868+0000 7f371cc00700 1 -- 172.21.15.111:0/2609401831 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f3710061bb0 con 0x7f3720073070 2024-09-11T00:17:13.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:12 smithi203 ceph-mon[69002]: pgmap v169: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:13.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:12 smithi203 ceph-mon[69002]: osd.5 marked itself down and dead 2024-09-11T00:17:13.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.099+0000 7f3726e00700 1 -- 172.21.15.111:0/2609401831 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f372002cd90 con 0x7f370407a6f0 2024-09-11T00:17:13.101 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:12 smithi111 ceph-mon[90842]: pgmap v169: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:13.101 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:12 smithi111 ceph-mon[90842]: osd.5 marked itself down and dead 2024-09-11T00:17:13.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.108+0000 7f371cc00700 1 -- 172.21.15.111:0/2609401831 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f372002cd90 con 0x7f370407a6f0 2024-09-11T00:17:13.111 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:17:13.111 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (6m) 101s ago 20m 14.7M - 0.27.0 11f11916f8cd d6d3253e881f 2024-09-11T00:17:13.111 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (9m) 101s ago 20m 8186k - 18.2.0 dc2bc1663786 7c40af85314c 2024-09-11T00:17:13.111 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi203 smithi203 running (9m) 26s ago 19m 8250k - 18.2.0 dc2bc1663786 922e3261ff70 2024-09-11T00:17:13.111 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (3m) 101s ago 20m 6899k - 19.3.0-4854-g8f219c47 589dd18248e4 a9cacdb9a638 2024-09-11T00:17:13.111 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi203 smithi203 running (3m) 26s ago 19m 6899k - 19.3.0-4854-g8f219c47 589dd18248e4 d452d9dfa04b 2024-09-11T00:17:13.111 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (6m) 101s ago 20m 67.6M - c8b91775d855 7d3b50b5b59f 2024-09-11T00:17:13.111 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.gmgsay smithi111 running (13m) 101s ago 13m 18.3M - 18.2.0 dc2bc1663786 795e4ff0075c 2024-09-11T00:17:13.111 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.rucaba smithi111 running (13m) 101s ago 13m 18.2M - 18.2.0 dc2bc1663786 02885adac62c 2024-09-11T00:17:13.112 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.tcrqop smithi203 running (13m) 26s ago 13m 150M - 18.2.0 dc2bc1663786 4df492159bb4 2024-09-11T00:17:13.112 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.uqkbkn smithi203 running (13m) 26s ago 13m 18.8M - 18.2.0 dc2bc1663786 619aa58ea314 2024-09-11T00:17:13.112 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.ypucji smithi111 *:8443,9283,8765 running (9m) 101s ago 22m 514M - 19.3.0-4854-g8f219c47 589dd18248e4 07fa31f49618 2024-09-11T00:17:13.112 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi203.smuspl smithi203 *:8443,9283,8765 running (8m) 26s ago 19m 456M - 19.3.0-4854-g8f219c47 589dd18248e4 7e5a93a5ffa7 2024-09-11T00:17:13.112 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (4m) 101s ago 22m 48.4M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 3c29c070a612 2024-09-11T00:17:13.112 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi203 smithi203 running (4m) 26s ago 19m 41.6M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 45e8285e4b4d 2024-09-11T00:17:13.112 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (7m) 101s ago 20m 7792k - 1.7.0 72c9c2088986 ec478ea14488 2024-09-11T00:17:13.112 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi203 smithi203 *:9100 running (7m) 26s ago 19m 7516k - 1.7.0 72c9c2088986 54d461cde1bc 2024-09-11T00:17:13.112 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (3m) 101s ago 17m 88.9M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 d2f1a2312736 2024-09-11T00:17:13.112 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (2m) 101s ago 17m 90.1M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 19cf95ecca7d 2024-09-11T00:17:13.112 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (108s) 101s ago 16m 10.4M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 3a3b318b337a 2024-09-11T00:17:13.113 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi203 running (68s) 26s ago 16m 91.4M 2240M 19.3.0-4854-g8f219c47 589dd18248e4 288c7e8ae34b 2024-09-11T00:17:13.113 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi203 running (31s) 26s ago 15m 10.4M 2240M 19.3.0-4854-g8f219c47 589dd18248e4 485f82d3eafb 2024-09-11T00:17:13.113 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi203 running (14m) 26s ago 14m 195M 2240M 18.2.0 dc2bc1663786 6d824001d40c 2024-09-11T00:17:13.113 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (7m) 101s ago 19m 60.1M - 2.51.0 1d3b7f56885b 3e72ac10983d 2024-09-11T00:17:13.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.111+0000 7f3726e00700 1 -- 172.21.15.111:0/2609401831 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f370407a6f0 msgr2=0x7f370407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:13.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.111+0000 7f3726e00700 1 --2- 172.21.15.111:0/2609401831 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f370407a6f0 0x7f370407cba0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3720199580 tx=0x7f370c009260 comp rx=0 tx=0).stop 2024-09-11T00:17:13.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.111+0000 7f3726e00700 1 -- 172.21.15.111:0/2609401831 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3720073070 msgr2=0x7f3720197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:13.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.111+0000 7f3726e00700 1 --2- 172.21.15.111:0/2609401831 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3720073070 0x7f3720197f60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3710000c00 tx=0x7f371000bb10 comp rx=0 tx=0).stop 2024-09-11T00:17:13.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.111+0000 7f3726e00700 1 -- 172.21.15.111:0/2609401831 shutdown_connections 2024-09-11T00:17:13.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.111+0000 7f3726e00700 1 --2- 172.21.15.111:0/2609401831 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f370407a6f0 0x7f370407cba0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:13.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.111+0000 7f3726e00700 1 --2- 172.21.15.111:0/2609401831 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3720073070 0x7f3720197f60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:13.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.111+0000 7f3726e00700 1 --2- 172.21.15.111:0/2609401831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3720073980 0x7f37201984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:13.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.111+0000 7f3726e00700 1 -- 172.21.15.111:0/2609401831 >> 172.21.15.111:0/2609401831 conn(0x7f37200fbc90 msgr2=0x7f3720106d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:13.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.112+0000 7f3726e00700 1 -- 172.21.15.111:0/2609401831 shutdown_connections 2024-09-11T00:17:13.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.112+0000 7f3726e00700 1 -- 172.21.15.111:0/2609401831 wait complete. 2024-09-11T00:17:13.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.246+0000 7fd01ec00700 1 -- 172.21.15.111:0/3909153493 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd018101c40 msgr2=0x7fd01810a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:13.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.246+0000 7fd01ec00700 1 --2- 172.21.15.111:0/3909153493 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd018101c40 0x7fd01810a140 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd004009940 tx=0x7fd004009c50 comp rx=0 tx=0).stop 2024-09-11T00:17:13.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.246+0000 7fd01ec00700 1 -- 172.21.15.111:0/3909153493 shutdown_connections 2024-09-11T00:17:13.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.246+0000 7fd01ec00700 1 --2- 172.21.15.111:0/3909153493 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd018101c40 0x7fd01810a140 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:13.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.246+0000 7fd01ec00700 1 --2- 172.21.15.111:0/3909153493 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd018101330 0x7fd018101700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:13.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.246+0000 7fd01ec00700 1 -- 172.21.15.111:0/3909153493 >> 172.21.15.111:0/3909153493 conn(0x7fd0180fabb0 msgr2=0x7fd0180fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:13.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.247+0000 7fd01ec00700 1 -- 172.21.15.111:0/3909153493 shutdown_connections 2024-09-11T00:17:13.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.247+0000 7fd01ec00700 1 -- 172.21.15.111:0/3909153493 wait complete. 2024-09-11T00:17:13.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.248+0000 7fd01ec00700 1 Processor -- start 2024-09-11T00:17:13.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.248+0000 7fd01ec00700 1 -- start start 2024-09-11T00:17:13.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.248+0000 7fd01ec00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd018101330 0x7fd0180fef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:13.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.248+0000 7fd01ec00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd018101c40 0x7fd0180ff4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:13.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.248+0000 7fd01ec00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0180ffa10 con 0x7fd018101330 2024-09-11T00:17:13.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.248+0000 7fd01ec00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0180ffb50 con 0x7fd018101c40 2024-09-11T00:17:13.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.248+0000 7fd017e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd018101330 0x7fd0180fef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:13.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.248+0000 7fd017e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd018101330 0x7fd0180fef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40162/0 (socket says 172.21.15.111:40162) 2024-09-11T00:17:13.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.248+0000 7fd017e00700 1 -- 172.21.15.111:0/116979097 learned_addr learned my addr 172.21.15.111:0/116979097 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:17:13.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.248+0000 7fd017400700 1 --2- 172.21.15.111:0/116979097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd018101c40 0x7fd0180ff4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:13.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.249+0000 7fd017e00700 1 -- 172.21.15.111:0/116979097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd018101c40 msgr2=0x7fd0180ff4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:13.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.249+0000 7fd017e00700 1 --2- 172.21.15.111:0/116979097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd018101c40 0x7fd0180ff4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:13.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.249+0000 7fd017e00700 1 -- 172.21.15.111:0/116979097 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0040095f0 con 0x7fd018101330 2024-09-11T00:17:13.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.249+0000 7fd017e00700 1 --2- 172.21.15.111:0/116979097 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd018101330 0x7fd0180fef90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd00800b4b0 tx=0x7fd00800b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:13.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.249+0000 7fd014c00700 1 -- 172.21.15.111:0/116979097 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd008011800 con 0x7fd018101330 2024-09-11T00:17:13.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.249+0000 7fd014c00700 1 -- 172.21.15.111:0/116979097 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd008011e20 con 0x7fd018101330 2024-09-11T00:17:13.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.249+0000 7fd014c00700 1 -- 172.21.15.111:0/116979097 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd00800f2e0 con 0x7fd018101330 2024-09-11T00:17:13.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.249+0000 7fd01ec00700 1 -- 172.21.15.111:0/116979097 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0181a1ff0 con 0x7fd018101330 2024-09-11T00:17:13.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.250+0000 7fd01ec00700 1 -- 172.21.15.111:0/116979097 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0181a23a0 con 0x7fd018101330 2024-09-11T00:17:13.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.251+0000 7fd01ec00700 1 -- 172.21.15.111:0/116979097 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0181077b0 con 0x7fd018101330 2024-09-11T00:17:13.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.252+0000 7fd014c00700 1 -- 172.21.15.111:0/116979097 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fd008010380 con 0x7fd018101330 2024-09-11T00:17:13.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.253+0000 7fd014c00700 1 --2- 172.21.15.111:0/116979097 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fcffc07a6f0 0x7fcffc07cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:13.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.253+0000 7fd014c00700 1 -- 172.21.15.111:0/116979097 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd00809caf0 con 0x7fd018101330 2024-09-11T00:17:13.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.254+0000 7fd017400700 1 --2- 172.21.15.111:0/116979097 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fcffc07a6f0 0x7fcffc07cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:13.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.254+0000 7fd017400700 1 --2- 172.21.15.111:0/116979097 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fcffc07a6f0 0x7fcffc07cba0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd004005b40 tx=0x7fd004005ab0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:13.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.258+0000 7fd014c00700 1 -- 172.21.15.111:0/116979097 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fd008060310 con 0x7fd018101330 2024-09-11T00:17:13.362 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:13 smithi203 podman[88178]: 2024-09-11 00:17:13.094265009 +0000 UTC m=+1.007929736 container died 6d824001d40cfaea1d8e815d5edc8ddc300540f37451ea65905316c7a90da739 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-11T00:17:13.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.565+0000 7fd01ec00700 1 -- 172.21.15.111:0/116979097 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd0180ffd10 con 0x7fd018101330 2024-09-11T00:17:13.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.566+0000 7fd014c00700 1 -- 172.21.15.111:0/116979097 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+700 (secure 0 0 0) 0x7fd0180ffd10 con 0x7fd018101330 2024-09-11T00:17:13.568 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:17:13.568 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-11T00:17:13.568 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:17:13.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:17:13.568 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-11T00:17:13.568 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:17:13.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:17:13.569 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-11T00:17:13.569 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 5 2024-09-11T00:17:13.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:17:13.569 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-11T00:17:13.569 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-11T00:17:13.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:17:13.569 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-11T00:17:13.569 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4, 2024-09-11T00:17:13.569 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 9 2024-09-11T00:17:13.569 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-11T00:17:13.569 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:17:13.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.568+0000 7fd01ec00700 1 -- 172.21.15.111:0/116979097 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fcffc07a6f0 msgr2=0x7fcffc07cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:13.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.569+0000 7fd01ec00700 1 --2- 172.21.15.111:0/116979097 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fcffc07a6f0 0x7fcffc07cba0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd004005b40 tx=0x7fd004005ab0 comp rx=0 tx=0).stop 2024-09-11T00:17:13.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.569+0000 7fd01ec00700 1 -- 172.21.15.111:0/116979097 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd018101330 msgr2=0x7fd0180fef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:13.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.569+0000 7fd01ec00700 1 --2- 172.21.15.111:0/116979097 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd018101330 0x7fd0180fef90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd00800b4b0 tx=0x7fd00800b7c0 comp rx=0 tx=0).stop 2024-09-11T00:17:13.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.569+0000 7fd01ec00700 1 -- 172.21.15.111:0/116979097 shutdown_connections 2024-09-11T00:17:13.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.569+0000 7fd01ec00700 1 --2- 172.21.15.111:0/116979097 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fcffc07a6f0 0x7fcffc07cba0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:13.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.569+0000 7fd01ec00700 1 --2- 172.21.15.111:0/116979097 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd018101330 0x7fd0180fef90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:13.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.569+0000 7fd01ec00700 1 --2- 172.21.15.111:0/116979097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd018101c40 0x7fd0180ff4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:13.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.569+0000 7fd01ec00700 1 -- 172.21.15.111:0/116979097 >> 172.21.15.111:0/116979097 conn(0x7fd0180fabb0 msgr2=0x7fd0181048f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:13.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.569+0000 7fd01ec00700 1 -- 172.21.15.111:0/116979097 shutdown_connections 2024-09-11T00:17:13.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.569+0000 7fd01ec00700 1 -- 172.21.15.111:0/116979097 wait complete. 2024-09-11T00:17:13.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.715+0000 7fcb07c00700 1 -- 172.21.15.111:0/2816293685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb000fec90 msgr2=0x7fcb000ff060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:13.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.715+0000 7fcb07c00700 1 --2- 172.21.15.111:0/2816293685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb000fec90 0x7fcb000ff060 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009870 tx=0x7fcaf8009b80 comp rx=0 tx=0).stop 2024-09-11T00:17:13.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.716+0000 7fcb07c00700 1 -- 172.21.15.111:0/2816293685 shutdown_connections 2024-09-11T00:17:13.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.716+0000 7fcb07c00700 1 --2- 172.21.15.111:0/2816293685 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb000ff630 0x7fcb00102fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:13.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.716+0000 7fcb07c00700 1 --2- 172.21.15.111:0/2816293685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb000fec90 0x7fcb000ff060 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:13.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.716+0000 7fcb07c00700 1 -- 172.21.15.111:0/2816293685 >> 172.21.15.111:0/2816293685 conn(0x7fcb00075680 msgr2=0x7fcb00075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:13.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.716+0000 7fcb07c00700 1 -- 172.21.15.111:0/2816293685 shutdown_connections 2024-09-11T00:17:13.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.717+0000 7fcb07c00700 1 -- 172.21.15.111:0/2816293685 wait complete. 2024-09-11T00:17:13.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.718+0000 7fcb07c00700 1 Processor -- start 2024-09-11T00:17:13.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.719+0000 7fcb07c00700 1 -- start start 2024-09-11T00:17:13.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.719+0000 7fcb07c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb000fec90 0x7fcb0006a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:13.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.719+0000 7fcb07c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb000ff630 0x7fcb0006acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:13.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.719+0000 7fcb07c00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0006b390 con 0x7fcb000fec90 2024-09-11T00:17:13.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.719+0000 7fcb07c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0006b4d0 con 0x7fcb000ff630 2024-09-11T00:17:13.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.719+0000 7fcb05200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb000fec90 0x7fcb0006a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:13.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.720+0000 7fcb05200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb000fec90 0x7fcb0006a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40178/0 (socket says 172.21.15.111:40178) 2024-09-11T00:17:13.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.720+0000 7fcb05200700 1 -- 172.21.15.111:0/2588619403 learned_addr learned my addr 172.21.15.111:0/2588619403 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:17:13.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.720+0000 7fcaffe00700 1 --2- 172.21.15.111:0/2588619403 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb000ff630 0x7fcb0006acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:13.723 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:13 smithi203 podman[88178]: 2024-09-11 00:17:13.476925718 +0000 UTC m=+1.390590441 container cleanup 6d824001d40cfaea1d8e815d5edc8ddc300540f37451ea65905316c7a90da739 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD) 2024-09-11T00:17:13.723 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:13 smithi203 bash[88178]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5 2024-09-11T00:17:13.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.720+0000 7fcb05200700 1 -- 172.21.15.111:0/2588619403 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb000ff630 msgr2=0x7fcb0006acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:13.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.720+0000 7fcb05200700 1 --2- 172.21.15.111:0/2588619403 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb000ff630 0x7fcb0006acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:13.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.720+0000 7fcb05200700 1 -- 172.21.15.111:0/2588619403 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaec0071c0 con 0x7fcb000fec90 2024-09-11T00:17:13.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.721+0000 7fcb05200700 1 --2- 172.21.15.111:0/2588619403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb000fec90 0x7fcb0006a770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009230 tx=0x7fcaf80047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:13.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.724+0000 7fcafd600700 1 -- 172.21.15.111:0/2588619403 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaf801c070 con 0x7fcb000fec90 2024-09-11T00:17:13.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.724+0000 7fcafd600700 1 -- 172.21.15.111:0/2588619403 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcaf800fc60 con 0x7fcb000fec90 2024-09-11T00:17:13.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.724+0000 7fcb07c00700 1 -- 172.21.15.111:0/2588619403 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf8009520 con 0x7fcb000fec90 2024-09-11T00:17:13.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.724+0000 7fcafd600700 1 -- 172.21.15.111:0/2588619403 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaf8022d60 con 0x7fcb000fec90 2024-09-11T00:17:13.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.724+0000 7fcb07c00700 1 -- 172.21.15.111:0/2588619403 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb00071ab0 con 0x7fcb000fec90 2024-09-11T00:17:13.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.725+0000 7fcb07c00700 1 -- 172.21.15.111:0/2588619403 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb0004ea50 con 0x7fcb000fec90 2024-09-11T00:17:13.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.727+0000 7fcafd600700 1 -- 172.21.15.111:0/2588619403 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fcaf8020070 con 0x7fcb000fec90 2024-09-11T00:17:13.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.728+0000 7fcafd600700 1 --2- 172.21.15.111:0/2588619403 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fcae407a740 0x7fcae407cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:13.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.728+0000 7fcafd600700 1 -- 172.21.15.111:0/2588619403 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fcaf809e560 con 0x7fcb000fec90 2024-09-11T00:17:13.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.728+0000 7fcaffe00700 1 --2- 172.21.15.111:0/2588619403 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fcae407a740 0x7fcae407cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:13.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.729+0000 7fcaffe00700 1 --2- 172.21.15.111:0/2588619403 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fcae407a740 0x7fcae407cbf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcaec00afd0 tx=0x7fcaec00c040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:13.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:13.732+0000 7fcafd600700 1 -- 172.21.15.111:0/2588619403 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fcaf8061da0 con 0x7fcb000fec90 2024-09-11T00:17:13.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:13 smithi111 ceph-mon[90842]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:17:13.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:13 smithi111 ceph-mon[90842]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-11T00:17:13.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:13 smithi111 ceph-mon[90842]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-11T00:17:13.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:13 smithi111 ceph-mon[90842]: osdmap e76: 6 total, 5 up, 6 in 2024-09-11T00:17:13.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:13 smithi111 ceph-mon[90842]: from='client.44291 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:17:13.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:13 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/116979097' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:17:13.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:13 smithi111 ceph-mon[90842]: osdmap e77: 6 total, 5 up, 6 in 2024-09-11T00:17:14.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.000+0000 7fcb07c00700 1 -- 172.21.15.111:0/2588619403 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcb00108780 con 0x7fcb000fec90 2024-09-11T00:17:14.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.001+0000 7fcafd600700 1 -- 172.21.15.111:0/2588619403 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1921 (secure 0 0 0) 0x7fcaf8064ec0 con 0x7fcb000fec90 2024-09-11T00:17:14.003 INFO:teuthology.orchestra.run.smithi111.stdout:e15 2024-09-11T00:17:14.003 INFO:teuthology.orchestra.run.smithi111.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-11T00:17:14.003 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T00:17:14.003 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:17:14.003 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-11T00:17:14.003 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:17:14.003 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-11T00:17:14.004 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-11T00:17:14.004 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 14 2024-09-11T00:17:14.004 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-11T00:17:14.004 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-11T00:03:47.950356+0000 2024-09-11T00:17:14.004 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-11T00:04:06.275905+0000 2024-09-11T00:17:14.004 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-11T00:17:14.004 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-11T00:17:14.004 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-11T00:17:14.004 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-11T00:17:14.004 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-11T00:17:14.004 INFO:teuthology.orchestra.run.smithi111.stdout:max_xattr_size 65536 2024-09-11T00:17:14.004 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-11T00:17:14.004 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-11T00:17:14.005 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 47 2024-09-11T00:17:14.005 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:17:14.005 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-11T00:17:14.005 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-11T00:17:14.005 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=24363} 2024-09-11T00:17:14.005 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-11T00:17:14.005 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-11T00:17:14.005 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-11T00:17:14.005 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-11T00:17:14.005 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-11T00:17:14.005 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data enabled 2024-09-11T00:17:14.005 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-11T00:17:14.005 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-11T00:17:14.005 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 1 2024-09-11T00:17:14.006 INFO:teuthology.orchestra.run.smithi111.stdout:qdb_cluster leader: 0 members: 2024-09-11T00:17:14.006 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.tcrqop{0:24363} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.203:6824/3082736449,v1:172.21.15.203:6825/3082736449] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:17:14.006 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:17:14.006 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:17:14.006 INFO:teuthology.orchestra.run.smithi111.stdout:Standby daemons: 2024-09-11T00:17:14.006 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:17:14.006 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.rucaba{-1:14554} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6828/2045133285,v1:172.21.15.111:6829/2045133285] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:17:14.006 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.gmgsay{-1:14566} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.111:6826/1122545830,v1:172.21.15.111:6827/1122545830] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:17:14.006 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.uqkbkn{-1:24379} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.203:6826/695613114,v1:172.21.15.203:6827/695613114] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:17:14.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.004+0000 7fcb07c00700 1 -- 172.21.15.111:0/2588619403 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fcae407a740 msgr2=0x7fcae407cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:14.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.004+0000 7fcb07c00700 1 --2- 172.21.15.111:0/2588619403 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fcae407a740 0x7fcae407cbf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcaec00afd0 tx=0x7fcaec00c040 comp rx=0 tx=0).stop 2024-09-11T00:17:14.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.004+0000 7fcb07c00700 1 -- 172.21.15.111:0/2588619403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb000fec90 msgr2=0x7fcb0006a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:14.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.004+0000 7fcb07c00700 1 --2- 172.21.15.111:0/2588619403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb000fec90 0x7fcb0006a770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009230 tx=0x7fcaf80047b0 comp rx=0 tx=0).stop 2024-09-11T00:17:14.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.005+0000 7fcb07c00700 1 -- 172.21.15.111:0/2588619403 shutdown_connections 2024-09-11T00:17:14.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.005+0000 7fcb07c00700 1 --2- 172.21.15.111:0/2588619403 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fcae407a740 0x7fcae407cbf0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:14.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.005+0000 7fcb07c00700 1 --2- 172.21.15.111:0/2588619403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb000fec90 0x7fcb0006a770 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:14.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.005+0000 7fcb07c00700 1 --2- 172.21.15.111:0/2588619403 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb000ff630 0x7fcb0006acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:14.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.005+0000 7fcb07c00700 1 -- 172.21.15.111:0/2588619403 >> 172.21.15.111:0/2588619403 conn(0x7fcb00075680 msgr2=0x7fcb00102810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:14.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.005+0000 7fcb07c00700 1 -- 172.21.15.111:0/2588619403 shutdown_connections 2024-09-11T00:17:14.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.005+0000 7fcb07c00700 1 -- 172.21.15.111:0/2588619403 wait complete. 2024-09-11T00:17:14.008 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 15 2024-09-11T00:17:14.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:13 smithi203 ceph-mon[69002]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:17:14.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:13 smithi203 ceph-mon[69002]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-11T00:17:14.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:13 smithi203 ceph-mon[69002]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-11T00:17:14.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:13 smithi203 ceph-mon[69002]: osdmap e76: 6 total, 5 up, 6 in 2024-09-11T00:17:14.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:13 smithi203 ceph-mon[69002]: from='client.44291 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:17:14.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:13 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/116979097' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:17:14.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:13 smithi203 ceph-mon[69002]: osdmap e77: 6 total, 5 up, 6 in 2024-09-11T00:17:14.045 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:13 smithi203 podman[88196]: 2024-09-11 00:17:13.761854237 +0000 UTC m=+0.660598380 container remove 6d824001d40cfaea1d8e815d5edc8ddc300540f37451ea65905316c7a90da739 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5, io.buildah.version=1.29.1, ceph=True, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD, RELEASE=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0) 2024-09-11T00:17:14.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.143+0000 7efe62000700 1 -- 172.21.15.111:0/881088981 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe5c100200 msgr2=0x7efe5c1005d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:14.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.143+0000 7efe62000700 1 --2- 172.21.15.111:0/881088981 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe5c100200 0x7efe5c1005d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efe50009910 tx=0x7efe50009c20 comp rx=0 tx=0).stop 2024-09-11T00:17:14.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.143+0000 7efe62000700 1 -- 172.21.15.111:0/881088981 shutdown_connections 2024-09-11T00:17:14.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.143+0000 7efe62000700 1 --2- 172.21.15.111:0/881088981 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe5c100ba0 0x7efe5c104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:14.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.143+0000 7efe62000700 1 --2- 172.21.15.111:0/881088981 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe5c100200 0x7efe5c1005d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:14.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.143+0000 7efe62000700 1 -- 172.21.15.111:0/881088981 >> 172.21.15.111:0/881088981 conn(0x7efe5c0fba80 msgr2=0x7efe5c0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:14.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.143+0000 7efe62000700 1 -- 172.21.15.111:0/881088981 shutdown_connections 2024-09-11T00:17:14.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.143+0000 7efe62000700 1 -- 172.21.15.111:0/881088981 wait complete. 2024-09-11T00:17:14.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.144+0000 7efe62000700 1 Processor -- start 2024-09-11T00:17:14.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.144+0000 7efe62000700 1 -- start start 2024-09-11T00:17:14.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.145+0000 7efe62000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe5c100200 0x7efe5c19b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:14.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.145+0000 7efe62000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe5c100ba0 0x7efe5c19bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:14.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.145+0000 7efe62000700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c19c5a0 con 0x7efe5c100200 2024-09-11T00:17:14.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.145+0000 7efe62000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c195a50 con 0x7efe5c100ba0 2024-09-11T00:17:14.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.145+0000 7efe60c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe5c100200 0x7efe5c19b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:14.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.145+0000 7efe60c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe5c100200 0x7efe5c19b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40198/0 (socket says 172.21.15.111:40198) 2024-09-11T00:17:14.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.145+0000 7efe60c00700 1 -- 172.21.15.111:0/1273397469 learned_addr learned my addr 172.21.15.111:0/1273397469 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:17:14.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.145+0000 7efe5be00700 1 --2- 172.21.15.111:0/1273397469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe5c100ba0 0x7efe5c19bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:14.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.145+0000 7efe60c00700 1 -- 172.21.15.111:0/1273397469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe5c100ba0 msgr2=0x7efe5c19bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:14.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.145+0000 7efe60c00700 1 --2- 172.21.15.111:0/1273397469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe5c100ba0 0x7efe5c19bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:14.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.145+0000 7efe60c00700 1 -- 172.21.15.111:0/1273397469 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe500095f0 con 0x7efe5c100200 2024-09-11T00:17:14.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.146+0000 7efe60c00700 1 --2- 172.21.15.111:0/1273397469 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe5c100200 0x7efe5c19b9d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efe50009fd0 tx=0x7efe5000bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:14.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.146+0000 7efe59600700 1 -- 172.21.15.111:0/1273397469 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe5001d070 con 0x7efe5c100200 2024-09-11T00:17:14.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.146+0000 7efe59600700 1 -- 172.21.15.111:0/1273397469 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe500050d0 con 0x7efe5c100200 2024-09-11T00:17:14.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.146+0000 7efe62000700 1 -- 172.21.15.111:0/1273397469 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe5c195cd0 con 0x7efe5c100200 2024-09-11T00:17:14.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.146+0000 7efe59600700 1 -- 172.21.15.111:0/1273397469 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe50017400 con 0x7efe5c100200 2024-09-11T00:17:14.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.146+0000 7efe62000700 1 -- 172.21.15.111:0/1273397469 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe5c1961c0 con 0x7efe5c100200 2024-09-11T00:17:14.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.147+0000 7efe62000700 1 -- 172.21.15.111:0/1273397469 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe5c108510 con 0x7efe5c100200 2024-09-11T00:17:14.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.149+0000 7efe59600700 1 -- 172.21.15.111:0/1273397469 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7efe50003710 con 0x7efe5c100200 2024-09-11T00:17:14.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.150+0000 7efe59600700 1 --2- 172.21.15.111:0/1273397469 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7efe4407a6f0 0x7efe4407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:14.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.150+0000 7efe59600700 1 -- 172.21.15.111:0/1273397469 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6156+0+0 (secure 0 0 0) 0x7efe5009e500 con 0x7efe5c100200 2024-09-11T00:17:14.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.150+0000 7efe5be00700 1 --2- 172.21.15.111:0/1273397469 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7efe4407a6f0 0x7efe4407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:14.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.151+0000 7efe5be00700 1 --2- 172.21.15.111:0/1273397469 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7efe4407a6f0 0x7efe4407cba0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efe5c0fc1f0 tx=0x7efe48009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:14.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.154+0000 7efe59600700 1 -- 172.21.15.111:0/1273397469 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7efe50061c80 con 0x7efe5c100200 2024-09-11T00:17:14.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.396+0000 7efe62000700 1 -- 172.21.15.111:0/1273397469 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efe5c1964f0 con 0x7efe4407a6f0 2024-09-11T00:17:14.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.397+0000 7efe59600700 1 -- 172.21.15.111:0/1273397469 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7efe5c1964f0 con 0x7efe4407a6f0 2024-09-11T00:17:14.400 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:17:14.400 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e", 2024-09-11T00:17:14.400 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-11T00:17:14.400 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-11T00:17:14.400 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-11T00:17:14.400 INFO:teuthology.orchestra.run.smithi111.stdout: "crash", 2024-09-11T00:17:14.400 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr", 2024-09-11T00:17:14.400 INFO:teuthology.orchestra.run.smithi111.stdout: "mon" 2024-09-11T00:17:14.400 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-11T00:17:14.400 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "11/23 daemons upgraded", 2024-09-11T00:17:14.400 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading osd daemons", 2024-09-11T00:17:14.400 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-11T00:17:14.401 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:17:14.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.400+0000 7efe62000700 1 -- 172.21.15.111:0/1273397469 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7efe4407a6f0 msgr2=0x7efe4407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:14.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.400+0000 7efe62000700 1 --2- 172.21.15.111:0/1273397469 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7efe4407a6f0 0x7efe4407cba0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efe5c0fc1f0 tx=0x7efe48009260 comp rx=0 tx=0).stop 2024-09-11T00:17:14.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.400+0000 7efe62000700 1 -- 172.21.15.111:0/1273397469 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe5c100200 msgr2=0x7efe5c19b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:14.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.400+0000 7efe62000700 1 --2- 172.21.15.111:0/1273397469 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe5c100200 0x7efe5c19b9d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efe50009fd0 tx=0x7efe5000bfd0 comp rx=0 tx=0).stop 2024-09-11T00:17:14.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.400+0000 7efe62000700 1 -- 172.21.15.111:0/1273397469 shutdown_connections 2024-09-11T00:17:14.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.400+0000 7efe62000700 1 --2- 172.21.15.111:0/1273397469 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7efe4407a6f0 0x7efe4407cba0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:14.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.400+0000 7efe62000700 1 --2- 172.21.15.111:0/1273397469 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe5c100200 0x7efe5c19b9d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:14.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.400+0000 7efe62000700 1 --2- 172.21.15.111:0/1273397469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe5c100ba0 0x7efe5c19bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:14.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.400+0000 7efe62000700 1 -- 172.21.15.111:0/1273397469 >> 172.21.15.111:0/1273397469 conn(0x7efe5c0fba80 msgr2=0x7efe5c0fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:14.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.401+0000 7efe62000700 1 -- 172.21.15.111:0/1273397469 shutdown_connections 2024-09-11T00:17:14.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.401+0000 7efe62000700 1 -- 172.21.15.111:0/1273397469 wait complete. 2024-09-11T00:17:14.516 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:14 smithi203 podman[88282]: 2024-09-11 00:17:14.151252967 +0000 UTC m=+0.027797837 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:17:14.516 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:14 smithi203 podman[88282]: 2024-09-11 00:17:14.287751293 +0000 UTC m=+0.164296153 container create 40fb6d6b2c79ec8937f0cb0e95a123753934571bb86499d3540de4fe0cf495da (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:17:14.516 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:14 smithi203 podman[88282]: 2024-09-11 00:17:14.515147729 +0000 UTC m=+0.391692603 container init 40fb6d6b2c79ec8937f0cb0e95a123753934571bb86499d3540de4fe0cf495da (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-11T00:17:14.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.537+0000 7f14a8c00700 1 -- 172.21.15.111:0/2238779801 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14a4100250 msgr2=0x7f14a4100620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:14.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.537+0000 7f14a8c00700 1 --2- 172.21.15.111:0/2238779801 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14a4100250 0x7f14a4100620 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1494009910 tx=0x7f1494009c20 comp rx=0 tx=0).stop 2024-09-11T00:17:14.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.537+0000 7f14a8c00700 1 -- 172.21.15.111:0/2238779801 shutdown_connections 2024-09-11T00:17:14.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.537+0000 7f14a8c00700 1 --2- 172.21.15.111:0/2238779801 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f14a4100bf0 0x7f14a4104bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:14.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.537+0000 7f14a8c00700 1 --2- 172.21.15.111:0/2238779801 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14a4100250 0x7f14a4100620 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:14.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.537+0000 7f14a8c00700 1 -- 172.21.15.111:0/2238779801 >> 172.21.15.111:0/2238779801 conn(0x7f14a40fbb10 msgr2=0x7f14a40fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:14.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.537+0000 7f14a8c00700 1 -- 172.21.15.111:0/2238779801 shutdown_connections 2024-09-11T00:17:14.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.537+0000 7f14a8c00700 1 -- 172.21.15.111:0/2238779801 wait complete. 2024-09-11T00:17:14.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.538+0000 7f14a8c00700 1 Processor -- start 2024-09-11T00:17:14.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.538+0000 7f14a8c00700 1 -- start start 2024-09-11T00:17:14.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.538+0000 7f14a8c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f14a4100250 0x7f14a419ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:14.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.538+0000 7f14a8c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14a4100bf0 0x7f14a419bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:14.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.538+0000 7f14a8c00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a419c5d0 con 0x7f14a4100bf0 2024-09-11T00:17:14.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.538+0000 7f14a8c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a4195a80 con 0x7f14a4100250 2024-09-11T00:17:14.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.539+0000 7f14a2a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14a4100bf0 0x7f14a419bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:14.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.539+0000 7f14a2a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14a4100bf0 0x7f14a419bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40216/0 (socket says 172.21.15.111:40216) 2024-09-11T00:17:14.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.539+0000 7f14a2a00700 1 -- 172.21.15.111:0/697299633 learned_addr learned my addr 172.21.15.111:0/697299633 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:17:14.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.539+0000 7f14a3400700 1 --2- 172.21.15.111:0/697299633 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f14a4100250 0x7f14a419ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:14.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.539+0000 7f14a2a00700 1 -- 172.21.15.111:0/697299633 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f14a4100250 msgr2=0x7f14a419ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:14.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.539+0000 7f14a2a00700 1 --2- 172.21.15.111:0/697299633 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f14a4100250 0x7f14a419ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:14.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.539+0000 7f14a2a00700 1 -- 172.21.15.111:0/697299633 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14940095f0 con 0x7f14a4100bf0 2024-09-11T00:17:14.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.539+0000 7f14a2a00700 1 --2- 172.21.15.111:0/697299633 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14a4100bf0 0x7f14a419bf40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f149000d900 tx=0x7f149000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:14.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.539+0000 7f149be00700 1 -- 172.21.15.111:0/697299633 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1490009900 con 0x7f14a4100bf0 2024-09-11T00:17:14.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.540+0000 7f149be00700 1 -- 172.21.15.111:0/697299633 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1490010460 con 0x7f14a4100bf0 2024-09-11T00:17:14.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.540+0000 7f149be00700 1 -- 172.21.15.111:0/697299633 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f149000f5f0 con 0x7f14a4100bf0 2024-09-11T00:17:14.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.540+0000 7f14a8c00700 1 -- 172.21.15.111:0/697299633 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a4195d60 con 0x7f14a4100bf0 2024-09-11T00:17:14.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.540+0000 7f14a8c00700 1 -- 172.21.15.111:0/697299633 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a41962b0 con 0x7f14a4100bf0 2024-09-11T00:17:14.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.541+0000 7f14a8c00700 1 -- 172.21.15.111:0/697299633 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a4108560 con 0x7f14a4100bf0 2024-09-11T00:17:14.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.542+0000 7f149be00700 1 -- 172.21.15.111:0/697299633 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f14900105d0 con 0x7f14a4100bf0 2024-09-11T00:17:14.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.543+0000 7f149be00700 1 --2- 172.21.15.111:0/697299633 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f148807a6f0 0x7f148807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:14.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.543+0000 7f149be00700 1 -- 172.21.15.111:0/697299633 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f149009cd00 con 0x7f14a4100bf0 2024-09-11T00:17:14.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.544+0000 7f14a3400700 1 --2- 172.21.15.111:0/697299633 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f148807a6f0 0x7f148807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:14.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.544+0000 7f14a3400700 1 --2- 172.21.15.111:0/697299633 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f148807a6f0 0x7f148807cba0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1494006010 tx=0x7f149401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:14.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.548+0000 7f149be00700 1 -- 172.21.15.111:0/697299633 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f14900a0030 con 0x7f14a4100bf0 2024-09-11T00:17:14.780 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:14 smithi203 ceph-mon[69002]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:17:14.780 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:14 smithi203 ceph-mon[69002]: pgmap v171: 65 pgs: 5 peering, 10 stale+active+clean, 50 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:14.780 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:14 smithi203 ceph-mon[69002]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-11T00:17:14.781 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:14 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/2588619403' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:17:14.781 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:14 smithi203 podman[88282]: 2024-09-11 00:17:14.522143233 +0000 UTC m=+0.398688098 container start 40fb6d6b2c79ec8937f0cb0e95a123753934571bb86499d3540de4fe0cf495da (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True) 2024-09-11T00:17:14.781 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:14 smithi203 podman[88282]: 2024-09-11 00:17:14.623414885 +0000 UTC m=+0.499959747 container attach 40fb6d6b2c79ec8937f0cb0e95a123753934571bb86499d3540de4fe0cf495da (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:17:14.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.862+0000 7f14a8c00700 1 -- 172.21.15.111:0/697299633 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f14a404f2a0 con 0x7f14a4100bf0 2024-09-11T00:17:14.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.863+0000 7f149be00700 1 -- 172.21.15.111:0/697299633 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+865 (secure 0 0 0) 0x7f1490017380 con 0x7f14a4100bf0 2024-09-11T00:17:14.865 INFO:teuthology.orchestra.run.smithi111.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Reduced data availability: 3 pgs peering 2024-09-11T00:17:14.865 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-11T00:17:14.865 INFO:teuthology.orchestra.run.smithi111.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-11T00:17:14.865 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-11T00:17:14.865 INFO:teuthology.orchestra.run.smithi111.stdout: osd.5 (root=default,host=smithi203) is down 2024-09-11T00:17:14.865 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-09-11T00:17:14.865 INFO:teuthology.orchestra.run.smithi111.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-09-11T00:17:14.865 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 3 pgs peering 2024-09-11T00:17:14.866 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.3 is stuck peering for 8m, current state peering, last acting [2,1] 2024-09-11T00:17:14.866 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.17 is stuck peering for 8m, current state peering, last acting [2,1] 2024-09-11T00:17:14.866 INFO:teuthology.orchestra.run.smithi111.stdout: pg 3.5 is stuck peering for 7m, current state peering, last acting [2,3] 2024-09-11T00:17:14.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.865+0000 7f14a8c00700 1 -- 172.21.15.111:0/697299633 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f148807a6f0 msgr2=0x7f148807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:14.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.865+0000 7f14a8c00700 1 --2- 172.21.15.111:0/697299633 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f148807a6f0 0x7f148807cba0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1494006010 tx=0x7f149401a040 comp rx=0 tx=0).stop 2024-09-11T00:17:14.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.865+0000 7f14a8c00700 1 -- 172.21.15.111:0/697299633 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14a4100bf0 msgr2=0x7f14a419bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:14.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.865+0000 7f14a8c00700 1 --2- 172.21.15.111:0/697299633 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14a4100bf0 0x7f14a419bf40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f149000d900 tx=0x7f149000dc10 comp rx=0 tx=0).stop 2024-09-11T00:17:14.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.865+0000 7f14a8c00700 1 -- 172.21.15.111:0/697299633 shutdown_connections 2024-09-11T00:17:14.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.865+0000 7f14a8c00700 1 --2- 172.21.15.111:0/697299633 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f148807a6f0 0x7f148807cba0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:14.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.865+0000 7f14a8c00700 1 --2- 172.21.15.111:0/697299633 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f14a4100250 0x7f14a419ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:14.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.865+0000 7f14a8c00700 1 --2- 172.21.15.111:0/697299633 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14a4100bf0 0x7f14a419bf40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:14.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.865+0000 7f14a8c00700 1 -- 172.21.15.111:0/697299633 >> 172.21.15.111:0/697299633 conn(0x7f14a40fbb10 msgr2=0x7f14a40fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:14.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.866+0000 7f14a8c00700 1 -- 172.21.15.111:0/697299633 shutdown_connections 2024-09-11T00:17:14.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:14.866+0000 7f14a8c00700 1 -- 172.21.15.111:0/697299633 wait complete. 2024-09-11T00:17:15.045 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:14 smithi203 podman[88282]: 2024-09-11 00:17:14.77990324 +0000 UTC m=+0.656448113 container died 40fb6d6b2c79ec8937f0cb0e95a123753934571bb86499d3540de4fe0cf495da (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-11T00:17:15.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:14 smithi111 ceph-mon[90842]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:17:15.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:14 smithi111 ceph-mon[90842]: pgmap v171: 65 pgs: 5 peering, 10 stale+active+clean, 50 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:15.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:14 smithi111 ceph-mon[90842]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-11T00:17:15.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:14 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/2588619403' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:17:15.723 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:15 smithi203 podman[88305]: 2024-09-11 00:17:15.351980669 +0000 UTC m=+0.558866822 container remove 40fb6d6b2c79ec8937f0cb0e95a123753934571bb86499d3540de4fe0cf495da (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-11T00:17:15.724 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:15 smithi203 systemd[1]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-11T00:17:15.724 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:15 smithi203 systemd[1]: Stopped Ceph osd.5 for 03107fbe-6fd0-11ef-bcea-c7b262605968. 2024-09-11T00:17:15.724 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:15 smithi203 systemd[1]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.5.service: Consumed 1min 14.663s CPU time. 2024-09-11T00:17:16.035 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:15 smithi203 systemd[1]: Starting Ceph osd.5 for 03107fbe-6fd0-11ef-bcea-c7b262605968... 2024-09-11T00:17:16.036 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:15 smithi203 ceph-mon[69002]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:17:16.036 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:15 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/697299633' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-11T00:17:16.036 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:15 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:16.036 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:15 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:17:16.036 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:15 smithi203 ceph-mon[69002]: pgmap v173: 65 pgs: 8 active+undersized, 5 peering, 4 stale+active+clean, 8 active+undersized+degraded, 40 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 27/264 objects degraded (10.227%) 2024-09-11T00:17:16.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:15 smithi111 ceph-mon[90842]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:17:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:15 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/697299633' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-11T00:17:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:15 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:15 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:17:16.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:15 smithi111 ceph-mon[90842]: pgmap v173: 65 pgs: 8 active+undersized, 5 peering, 4 stale+active+clean, 8 active+undersized+degraded, 40 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 27/264 objects degraded (10.227%) 2024-09-11T00:17:16.295 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:16 smithi203 podman[88403]: 2024-09-11 00:17:15.938944806 +0000 UTC m=+0.027319952 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:17:16.295 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:16 smithi203 podman[88403]: 2024-09-11 00:17:16.069691754 +0000 UTC m=+0.158066898 container create 2adbfd69446da9b1ed6b71f672dd61414d2e81135ee976ffaa4fe4e90d252969 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5-activate, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-11T00:17:16.727 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:16 smithi203 podman[88403]: 2024-09-11 00:17:16.33092778 +0000 UTC m=+0.419302942 container init 2adbfd69446da9b1ed6b71f672dd61414d2e81135ee976ffaa4fe4e90d252969 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5-activate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:17:16.727 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:16 smithi203 podman[88403]: 2024-09-11 00:17:16.338359176 +0000 UTC m=+0.426734331 container start 2adbfd69446da9b1ed6b71f672dd61414d2e81135ee976ffaa4fe4e90d252969 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5-activate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-11T00:17:16.727 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:16 smithi203 podman[88403]: 2024-09-11 00:17:16.422147101 +0000 UTC m=+0.510522256 container attach 2adbfd69446da9b1ed6b71f672dd61414d2e81135ee976ffaa4fe4e90d252969 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5-activate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:17:16.728 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:16 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5-activate[88419]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-11T00:17:16.728 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:16 smithi203 bash[88403]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-11T00:17:16.728 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:16 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5-activate[88419]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-11T00:17:16.728 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:16 smithi203 bash[88403]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-11T00:17:17.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:16 smithi203 ceph-mon[69002]: Health check failed: Degraded data redundancy: 27/264 objects degraded (10.227%), 8 pgs degraded (PG_DEGRADED) 2024-09-11T00:17:17.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:16 smithi111 ceph-mon[90842]: Health check failed: Degraded data redundancy: 27/264 objects degraded (10.227%), 8 pgs degraded (PG_DEGRADED) 2024-09-11T00:17:17.731 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:17 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5-activate[88419]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-11T00:17:17.731 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:17 smithi203 bash[88403]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-11T00:17:17.731 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:17 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5-activate[88419]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-11T00:17:17.732 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:17 smithi203 bash[88403]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-11T00:17:17.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:17 smithi111 ceph-mon[90842]: pgmap v174: 65 pgs: 12 active+undersized, 5 peering, 11 active+undersized+degraded, 37 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 37/264 objects degraded (14.015%) 2024-09-11T00:17:18.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:17 smithi203 ceph-mon[69002]: pgmap v174: 65 pgs: 12 active+undersized, 5 peering, 11 active+undersized+degraded, 37 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 37/264 objects degraded (14.015%) 2024-09-11T00:17:18.045 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:17 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5-activate[88419]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-11T00:17:18.045 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:17 smithi203 bash[88403]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-11T00:17:18.045 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:17 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5-activate[88419]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-11T00:17:18.045 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:17 smithi203 bash[88403]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-11T00:17:18.045 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:17 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5-activate[88419]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-11T00:17:18.045 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:17 smithi203 bash[88403]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-11T00:17:18.045 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:17 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5-activate[88419]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-11T00:17:18.046 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:17 smithi203 bash[88403]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-11T00:17:18.046 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:17 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5-activate[88419]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-11T00:17:18.046 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:17 smithi203 bash[88403]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-11T00:17:18.046 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:17 smithi203 podman[88559]: 2024-09-11 00:17:17.82406528 +0000 UTC m=+0.026586234 container died 2adbfd69446da9b1ed6b71f672dd61414d2e81135ee976ffaa4fe4e90d252969 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5-activate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:17:18.748 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:18 smithi203 podman[88559]: 2024-09-11 00:17:18.442542591 +0000 UTC m=+0.645063523 container remove 2adbfd69446da9b1ed6b71f672dd61414d2e81135ee976ffaa4fe4e90d252969 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5-activate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-11T00:17:19.004 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:18 smithi203 podman[88618]: 2024-09-11 00:17:18.65132919 +0000 UTC m=+0.027749984 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:17:19.004 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:18 smithi203 podman[88618]: 2024-09-11 00:17:18.785291884 +0000 UTC m=+0.161712677 container create ef4834f3adf195bab61c4b49ce0a0822d735494459c6d15a6a28f9c7165d4c7c (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:17:19.004 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:18 smithi203 podman[88618]: 2024-09-11 00:17:18.99630076 +0000 UTC m=+0.372721575 container init ef4834f3adf195bab61c4b49ce0a0822d735494459c6d15a6a28f9c7165d4c7c (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:17:19.004 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:19 smithi203 podman[88618]: 2024-09-11 00:17:19.003236294 +0000 UTC m=+0.379657089 container start ef4834f3adf195bab61c4b49ce0a0822d735494459c6d15a6a28f9c7165d4c7c (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-11T00:17:19.295 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:19 smithi203 ceph-osd[88637]: -- 172.21.15.203:0/2860304769 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5625fad361e0 con 0x5625facc6000 2024-09-11T00:17:19.295 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:19 smithi203 bash[88618]: ef4834f3adf195bab61c4b49ce0a0822d735494459c6d15a6a28f9c7165d4c7c 2024-09-11T00:17:19.295 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:19 smithi203 systemd[1]: Started Ceph osd.5 for 03107fbe-6fd0-11ef-bcea-c7b262605968. 2024-09-11T00:17:20.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:20 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:20.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:20 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:20.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:20 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:17:20.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:20 smithi203 ceph-mon[69002]: pgmap v175: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 41/264 objects degraded (15.530%) 2024-09-11T00:17:20.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:20 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:20.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:20 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:20.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:20 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:20.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:20 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:20.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:20 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:17:20.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:20 smithi111 ceph-mon[90842]: pgmap v175: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 41/264 objects degraded (15.530%) 2024-09-11T00:17:20.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:20 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:20.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:20 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:20.956 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:20 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:17:20.714+0000 7fc5ea435640 -1 Falling back to public interface 2024-09-11T00:17:21.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:21 smithi203 ceph-mon[69002]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-11T00:17:21.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:21 smithi111 ceph-mon[90842]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-11T00:17:22.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:22 smithi203 ceph-mon[69002]: pgmap v176: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 41/264 objects degraded (15.530%) 2024-09-11T00:17:22.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:22 smithi203 ceph-mon[69002]: Health check update: Degraded data redundancy: 41/264 objects degraded (15.530%), 13 pgs degraded (PG_DEGRADED) 2024-09-11T00:17:22.557 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:22 smithi111 ceph-mon[90842]: pgmap v176: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 41/264 objects degraded (15.530%) 2024-09-11T00:17:22.558 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:22 smithi111 ceph-mon[90842]: Health check update: Degraded data redundancy: 41/264 objects degraded (15.530%), 13 pgs degraded (PG_DEGRADED) 2024-09-11T00:17:24.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:23 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:24.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:23 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:24.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:23 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:24.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:23 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:24.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:24 smithi203 ceph-mon[69002]: pgmap v177: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 41/264 objects degraded (15.530%) 2024-09-11T00:17:24.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:24 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:24.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:24 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:25.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:24 smithi111 ceph-mon[90842]: pgmap v177: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 41/264 objects degraded (15.530%) 2024-09-11T00:17:25.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:24 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:25.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:24 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:25.850 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:25 smithi203 ceph-mon[69002]: pgmap v178: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 41/264 objects degraded (15.530%) 2024-09-11T00:17:26.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:25 smithi111 ceph-mon[90842]: pgmap v178: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 41/264 objects degraded (15.530%) 2024-09-11T00:17:26.428 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:26 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:17:26.115+0000 7fc5ea435640 -1 osd.5 0 read_superblock omap replica is missing. 2024-09-11T00:17:26.778 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:26 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:17:26.425+0000 7fc5ea435640 -1 osd.5 75 log_to_monitors true 2024-09-11T00:17:27.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:26 smithi203 ceph-mon[69002]: from='osd.5 [v2:172.21.15.203:6816/727312193,v1:172.21.15.203:6817/727312193]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-11T00:17:27.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:26 smithi203 ceph-mon[69002]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-11T00:17:27.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:26 smithi111 ceph-mon[90842]: from='osd.5 [v2:172.21.15.203:6816/727312193,v1:172.21.15.203:6817/727312193]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-11T00:17:27.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:26 smithi111 ceph-mon[90842]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-11T00:17:27.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:27 smithi111 ceph-mon[90842]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T00:17:27.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:27 smithi111 ceph-mon[90842]: osdmap e78: 6 total, 5 up, 6 in 2024-09-11T00:17:27.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:27 smithi111 ceph-mon[90842]: from='osd.5 [v2:172.21.15.203:6816/727312193,v1:172.21.15.203:6817/727312193]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]} : dispatch 2024-09-11T00:17:27.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:27 smithi111 ceph-mon[90842]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]} : dispatch 2024-09-11T00:17:27.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:27 smithi111 ceph-mon[90842]: pgmap v180: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 41/264 objects degraded (15.530%) 2024-09-11T00:17:28.005 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:17:27 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:17:27.792+0000 7fc5db000640 -1 osd.5 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:17:28.006 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:27 smithi203 ceph-mon[69002]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T00:17:28.006 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:27 smithi203 ceph-mon[69002]: osdmap e78: 6 total, 5 up, 6 in 2024-09-11T00:17:28.006 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:27 smithi203 ceph-mon[69002]: from='osd.5 [v2:172.21.15.203:6816/727312193,v1:172.21.15.203:6817/727312193]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]} : dispatch 2024-09-11T00:17:28.006 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:27 smithi203 ceph-mon[69002]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]} : dispatch 2024-09-11T00:17:28.006 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:27 smithi203 ceph-mon[69002]: pgmap v180: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 41/264 objects degraded (15.530%) 2024-09-11T00:17:29.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:28 smithi111 ceph-mon[90842]: from='osd.5 ' entity='osd.5' 2024-09-11T00:17:29.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:29.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:29.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:17:29.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:17:29.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:29.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:17:29.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:17:29.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:17:29.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:17:29.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:17:29.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:28 smithi111 ceph-mon[90842]: Upgrade: Setting container_image for all osd 2024-09-11T00:17:29.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:29.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-11T00:17:29.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-11T00:17:29.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-11T00:17:29.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-11T00:17:29.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-11T00:17:29.155 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-11T00:17:29.156 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-11T00:17:29.156 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-11T00:17:29.156 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-11T00:17:29.156 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-11T00:17:29.156 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-11T00:17:29.156 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-11T00:17:29.156 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:28 smithi111 ceph-mon[90842]: Upgrade: Setting require_osd_release to 19 squid 2024-09-11T00:17:29.156 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd require-osd-release", "release": "squid"} : dispatch 2024-09-11T00:17:29.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:28 smithi203 ceph-mon[69002]: from='osd.5 ' entity='osd.5' 2024-09-11T00:17:29.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:29.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:29.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:17:29.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:17:29.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:29.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:17:29.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:17:29.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:17:29.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:17:29.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:17:29.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:28 smithi203 ceph-mon[69002]: Upgrade: Setting container_image for all osd 2024-09-11T00:17:29.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:29.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-11T00:17:29.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-11T00:17:29.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-11T00:17:29.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-11T00:17:29.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-11T00:17:29.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-11T00:17:29.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-11T00:17:29.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-11T00:17:29.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-11T00:17:29.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-11T00:17:29.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-11T00:17:29.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-11T00:17:29.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:28 smithi203 ceph-mon[69002]: Upgrade: Setting require_osd_release to 19 squid 2024-09-11T00:17:29.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd require-osd-release", "release": "squid"} : dispatch 2024-09-11T00:17:30.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:29 smithi111 ceph-mon[90842]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-11T00:17:30.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:29 smithi111 ceph-mon[90842]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-11T00:17:30.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:29 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-11T00:17:30.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:29 smithi111 ceph-mon[90842]: osd.5 [v2:172.21.15.203:6816/727312193,v1:172.21.15.203:6817/727312193] boot 2024-09-11T00:17:30.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:29 smithi111 ceph-mon[90842]: osdmap e79: 6 total, 6 up, 6 in 2024-09-11T00:17:30.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:29 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T00:17:30.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:29 smithi111 ceph-mon[90842]: pgmap v182: 65 pgs: 2 peering, 14 active+undersized, 12 active+undersized+degraded, 37 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 40/264 objects degraded (15.152%) 2024-09-11T00:17:30.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:29 smithi203 ceph-mon[69002]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-11T00:17:30.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:29 smithi203 ceph-mon[69002]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-11T00:17:30.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:29 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-11T00:17:30.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:29 smithi203 ceph-mon[69002]: osd.5 [v2:172.21.15.203:6816/727312193,v1:172.21.15.203:6817/727312193] boot 2024-09-11T00:17:30.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:29 smithi203 ceph-mon[69002]: osdmap e79: 6 total, 6 up, 6 in 2024-09-11T00:17:30.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:29 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T00:17:30.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:29 smithi203 ceph-mon[69002]: pgmap v182: 65 pgs: 2 peering, 14 active+undersized, 12 active+undersized+degraded, 37 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 40/264 objects degraded (15.152%) 2024-09-11T00:17:31.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:30 smithi203 ceph-mon[69002]: Health check update: Degraded data redundancy: 40/264 objects degraded (15.152%), 12 pgs degraded (PG_DEGRADED) 2024-09-11T00:17:31.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:30 smithi203 ceph-mon[69002]: osdmap e80: 6 total, 6 up, 6 in 2024-09-11T00:17:31.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:31.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:17:31.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:30 smithi203 ceph-mon[69002]: Upgrade: Updating mds.cephfs.smithi111.gmgsay 2024-09-11T00:17:31.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:31.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.gmgsay", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:17:31.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:17:31.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:30 smithi203 ceph-mon[69002]: Deploying daemon mds.cephfs.smithi111.gmgsay on smithi111 2024-09-11T00:17:31.078 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:30 smithi111 ceph-mon[90842]: Health check update: Degraded data redundancy: 40/264 objects degraded (15.152%), 12 pgs degraded (PG_DEGRADED) 2024-09-11T00:17:31.078 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:30 smithi111 ceph-mon[90842]: osdmap e80: 6 total, 6 up, 6 in 2024-09-11T00:17:31.078 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:31.078 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:17:31.078 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:30 smithi111 ceph-mon[90842]: Upgrade: Updating mds.cephfs.smithi111.gmgsay 2024-09-11T00:17:31.078 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:31.078 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.gmgsay", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:17:31.078 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:17:31.079 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:30 smithi111 ceph-mon[90842]: Deploying daemon mds.cephfs.smithi111.gmgsay on smithi111 2024-09-11T00:17:32.142 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:31 smithi111 ceph-mon[90842]: pgmap v184: 65 pgs: 2 peering, 12 active+undersized, 10 active+undersized+degraded, 41 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 35/264 objects degraded (13.258%) 2024-09-11T00:17:32.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:31 smithi203 ceph-mon[69002]: pgmap v184: 65 pgs: 2 peering, 12 active+undersized, 10 active+undersized+degraded, 41 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 35/264 objects degraded (13.258%) 2024-09-11T00:17:34.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:33 smithi203 ceph-mon[69002]: osdmap e81: 6 total, 6 up, 6 in 2024-09-11T00:17:34.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:33 smithi203 ceph-mon[69002]: fsmap cephfs:1 {0=cephfs.smithi203.tcrqop=up:active} 2 up:standby 2024-09-11T00:17:34.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:33 smithi203 ceph-mon[69002]: pgmap v186: 65 pgs: 2 peering, 2 active+undersized, 5 active+undersized+degraded, 56 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20/264 objects degraded (7.576%) 2024-09-11T00:17:34.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:33 smithi111 ceph-mon[90842]: osdmap e81: 6 total, 6 up, 6 in 2024-09-11T00:17:34.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:33 smithi111 ceph-mon[90842]: fsmap cephfs:1 {0=cephfs.smithi203.tcrqop=up:active} 2 up:standby 2024-09-11T00:17:34.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:33 smithi111 ceph-mon[90842]: pgmap v186: 65 pgs: 2 peering, 2 active+undersized, 5 active+undersized+degraded, 56 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20/264 objects degraded (7.576%) 2024-09-11T00:17:36.039 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:35 smithi111 ceph-mon[90842]: pgmap v187: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:36.039 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:35 smithi111 ceph-mon[90842]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 20/264 objects degraded (7.576%), 5 pgs degraded) 2024-09-11T00:17:36.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:35 smithi203 ceph-mon[69002]: pgmap v187: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:36.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:35 smithi203 ceph-mon[69002]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 20/264 objects degraded (7.576%), 5 pgs degraded) 2024-09-11T00:17:38.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:38 smithi203 ceph-mon[69002]: mds.? [v2:172.21.15.111:6826/3970632147,v1:172.21.15.111:6827/3970632147] up:boot 2024-09-11T00:17:38.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:38 smithi203 ceph-mon[69002]: fsmap cephfs:1 {0=cephfs.smithi203.tcrqop=up:active} 3 up:standby 2024-09-11T00:17:38.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:38 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mds metadata", "who": "cephfs.smithi111.gmgsay"} : dispatch 2024-09-11T00:17:38.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:38 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:38.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:38 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:38.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:38 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:17:38.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:38 smithi203 ceph-mon[69002]: pgmap v188: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:38.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:38 smithi111 ceph-mon[90842]: mds.? [v2:172.21.15.111:6826/3970632147,v1:172.21.15.111:6827/3970632147] up:boot 2024-09-11T00:17:38.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:38 smithi111 ceph-mon[90842]: fsmap cephfs:1 {0=cephfs.smithi203.tcrqop=up:active} 3 up:standby 2024-09-11T00:17:38.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:38 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mds metadata", "who": "cephfs.smithi111.gmgsay"} : dispatch 2024-09-11T00:17:38.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:38 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:38.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:38 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:38.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:38 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:17:38.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:38 smithi111 ceph-mon[90842]: pgmap v188: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:41.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:40 smithi203 ceph-mon[69002]: pgmap v189: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:41.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:40 smithi111 ceph-mon[90842]: pgmap v189: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:43.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:42 smithi203 ceph-mon[69002]: pgmap v190: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:43.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:42 smithi111 ceph-mon[90842]: pgmap v190: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:44.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:44 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:44.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:44 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:44.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:44 smithi111 ceph-mon[90842]: pgmap v191: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:44.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:44 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:44.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:44 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:44.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:44 smithi203 ceph-mon[69002]: pgmap v191: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:45.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.017+0000 7feccbe00700 1 -- 172.21.15.111:0/2526698168 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feccc075b90 msgr2=0x7feccc110950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:45.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.017+0000 7feccbe00700 1 --2- 172.21.15.111:0/2526698168 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feccc075b90 0x7feccc110950 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fecb8009910 tx=0x7fecb8009c20 comp rx=0 tx=0).stop 2024-09-11T00:17:45.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.017+0000 7feccbe00700 1 -- 172.21.15.111:0/2526698168 shutdown_connections 2024-09-11T00:17:45.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.017+0000 7feccbe00700 1 --2- 172.21.15.111:0/2526698168 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feccc075b90 0x7feccc110950 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:45.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.017+0000 7feccbe00700 1 --2- 172.21.15.111:0/2526698168 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feccc075280 0x7feccc075650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:45.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.017+0000 7feccbe00700 1 -- 172.21.15.111:0/2526698168 >> 172.21.15.111:0/2526698168 conn(0x7feccc0fdd30 msgr2=0x7feccc100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:45.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.017+0000 7feccbe00700 1 -- 172.21.15.111:0/2526698168 shutdown_connections 2024-09-11T00:17:45.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.017+0000 7feccbe00700 1 -- 172.21.15.111:0/2526698168 wait complete. 2024-09-11T00:17:45.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.018+0000 7feccbe00700 1 Processor -- start 2024-09-11T00:17:45.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.018+0000 7feccbe00700 1 -- start start 2024-09-11T00:17:45.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.019+0000 7feccbe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feccc075280 0x7feccc19c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:45.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.019+0000 7feccbe00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feccc075b90 0x7feccc19c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:45.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.019+0000 7feccbe00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc19cd80 con 0x7feccc075280 2024-09-11T00:17:45.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.019+0000 7feccbe00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc1a0b10 con 0x7feccc075b90 2024-09-11T00:17:45.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.019+0000 7feccaa00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feccc075280 0x7feccc19c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:45.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.019+0000 7feccaa00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feccc075280 0x7feccc19c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42130/0 (socket says 172.21.15.111:42130) 2024-09-11T00:17:45.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.019+0000 7feccaa00700 1 -- 172.21.15.111:0/3742560813 learned_addr learned my addr 172.21.15.111:0/3742560813 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:17:45.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.019+0000 7fecca000700 1 --2- 172.21.15.111:0/3742560813 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feccc075b90 0x7feccc19c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:45.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.020+0000 7feccaa00700 1 -- 172.21.15.111:0/3742560813 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feccc075b90 msgr2=0x7feccc19c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:45.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.020+0000 7feccaa00700 1 --2- 172.21.15.111:0/3742560813 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feccc075b90 0x7feccc19c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:45.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.020+0000 7feccaa00700 1 -- 172.21.15.111:0/3742560813 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb80095f0 con 0x7feccc075280 2024-09-11T00:17:45.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.020+0000 7feccaa00700 1 --2- 172.21.15.111:0/3742560813 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feccc075280 0x7feccc19c160 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fecbc00d8d0 tx=0x7fecbc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:45.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.020+0000 7fecc3400700 1 -- 172.21.15.111:0/3742560813 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecbc0098a0 con 0x7feccc075280 2024-09-11T00:17:45.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.020+0000 7feccbe00700 1 -- 172.21.15.111:0/3742560813 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feccc1a0df0 con 0x7feccc075280 2024-09-11T00:17:45.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.020+0000 7fecc3400700 1 -- 172.21.15.111:0/3742560813 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fecbc010460 con 0x7feccc075280 2024-09-11T00:17:45.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.020+0000 7fecc3400700 1 -- 172.21.15.111:0/3742560813 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecbc00f5f0 con 0x7feccc075280 2024-09-11T00:17:45.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.020+0000 7feccbe00700 1 -- 172.21.15.111:0/3742560813 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feccc1a1340 con 0x7feccc075280 2024-09-11T00:17:45.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.022+0000 7feccbe00700 1 -- 172.21.15.111:0/3742560813 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feccc10e0c0 con 0x7feccc075280 2024-09-11T00:17:45.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.023+0000 7fecc3400700 1 -- 172.21.15.111:0/3742560813 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fecbc009a00 con 0x7feccc075280 2024-09-11T00:17:45.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.024+0000 7fecc3400700 1 --2- 172.21.15.111:0/3742560813 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fecb007a6f0 0x7fecb007cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:45.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.024+0000 7fecc3400700 1 -- 172.21.15.111:0/3742560813 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fecbc09d030 con 0x7feccc075280 2024-09-11T00:17:45.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.024+0000 7fecca000700 1 --2- 172.21.15.111:0/3742560813 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fecb007a6f0 0x7fecb007cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:45.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.025+0000 7fecca000700 1 --2- 172.21.15.111:0/3742560813 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fecb007a6f0 0x7fecb007cba0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fecb800b850 tx=0x7fecb800b580 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:45.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.029+0000 7fecc3400700 1 -- 172.21.15.111:0/3742560813 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fecbc060850 con 0x7feccc075280 2024-09-11T00:17:45.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.293+0000 7feccbe00700 1 -- 172.21.15.111:0/3742560813 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feccc1a16c0 con 0x7fecb007a6f0 2024-09-11T00:17:45.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.294+0000 7fecc3400700 1 -- 172.21.15.111:0/3742560813 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7feccc1a16c0 con 0x7fecb007a6f0 2024-09-11T00:17:45.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.297+0000 7feccbe00700 1 -- 172.21.15.111:0/3742560813 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fecb007a6f0 msgr2=0x7fecb007cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:45.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.297+0000 7feccbe00700 1 --2- 172.21.15.111:0/3742560813 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fecb007a6f0 0x7fecb007cba0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fecb800b850 tx=0x7fecb800b580 comp rx=0 tx=0).stop 2024-09-11T00:17:45.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.297+0000 7feccbe00700 1 -- 172.21.15.111:0/3742560813 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feccc075280 msgr2=0x7feccc19c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:45.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.297+0000 7feccbe00700 1 --2- 172.21.15.111:0/3742560813 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feccc075280 0x7feccc19c160 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fecbc00d8d0 tx=0x7fecbc00dbe0 comp rx=0 tx=0).stop 2024-09-11T00:17:45.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.297+0000 7feccbe00700 1 -- 172.21.15.111:0/3742560813 shutdown_connections 2024-09-11T00:17:45.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.297+0000 7feccbe00700 1 --2- 172.21.15.111:0/3742560813 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fecb007a6f0 0x7fecb007cba0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:45.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.297+0000 7feccbe00700 1 --2- 172.21.15.111:0/3742560813 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feccc075280 0x7feccc19c160 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:45.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.297+0000 7feccbe00700 1 --2- 172.21.15.111:0/3742560813 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feccc075b90 0x7feccc19c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:45.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.297+0000 7feccbe00700 1 -- 172.21.15.111:0/3742560813 >> 172.21.15.111:0/3742560813 conn(0x7feccc0fdd30 msgr2=0x7feccc0fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:45.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.297+0000 7feccbe00700 1 -- 172.21.15.111:0/3742560813 shutdown_connections 2024-09-11T00:17:45.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.297+0000 7feccbe00700 1 -- 172.21.15.111:0/3742560813 wait complete. 2024-09-11T00:17:45.314 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:17:45.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:45 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:45.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:45 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:45.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:45 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:45.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:45 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:17:45.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:45 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:45.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.437+0000 7fe513a00700 1 -- 172.21.15.111:0/4020662204 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe50c1003d0 msgr2=0x7fe50c1007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:45.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.437+0000 7fe513a00700 1 --2- 172.21.15.111:0/4020662204 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe50c1003d0 0x7fe50c1007a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc009910 tx=0x7fe4fc009c20 comp rx=0 tx=0).stop 2024-09-11T00:17:45.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.437+0000 7fe513a00700 1 -- 172.21.15.111:0/4020662204 shutdown_connections 2024-09-11T00:17:45.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.437+0000 7fe513a00700 1 --2- 172.21.15.111:0/4020662204 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe50c100d70 0x7fe50c104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:45.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.437+0000 7fe513a00700 1 --2- 172.21.15.111:0/4020662204 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe50c1003d0 0x7fe50c1007a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:45.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.437+0000 7fe513a00700 1 -- 172.21.15.111:0/4020662204 >> 172.21.15.111:0/4020662204 conn(0x7fe50c0fbc50 msgr2=0x7fe50c0fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:45.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.437+0000 7fe513a00700 1 -- 172.21.15.111:0/4020662204 shutdown_connections 2024-09-11T00:17:45.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.437+0000 7fe513a00700 1 -- 172.21.15.111:0/4020662204 wait complete. 2024-09-11T00:17:45.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.438+0000 7fe513a00700 1 Processor -- start 2024-09-11T00:17:45.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.438+0000 7fe513a00700 1 -- start start 2024-09-11T00:17:45.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.438+0000 7fe513a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe50c1003d0 0x7fe50c073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:45.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.438+0000 7fe513a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe50c100d70 0x7fe50c073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:45.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.438+0000 7fe513a00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c073ad0 con 0x7fe50c100d70 2024-09-11T00:17:45.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.438+0000 7fe513a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c073c10 con 0x7fe50c1003d0 2024-09-11T00:17:45.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.439+0000 7fe503e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe50c100d70 0x7fe50c073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:45.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.439+0000 7fe503e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe50c100d70 0x7fe50c073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42148/0 (socket says 172.21.15.111:42148) 2024-09-11T00:17:45.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.439+0000 7fe503e00700 1 -- 172.21.15.111:0/3772554499 learned_addr learned my addr 172.21.15.111:0/3772554499 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:17:45.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.439+0000 7fe511000700 1 --2- 172.21.15.111:0/3772554499 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe50c1003d0 0x7fe50c073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:45.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.439+0000 7fe503e00700 1 -- 172.21.15.111:0/3772554499 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe50c1003d0 msgr2=0x7fe50c073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:45.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.439+0000 7fe503e00700 1 --2- 172.21.15.111:0/3772554499 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe50c1003d0 0x7fe50c073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:45.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.439+0000 7fe503e00700 1 -- 172.21.15.111:0/3772554499 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4fc0095f0 con 0x7fe50c100d70 2024-09-11T00:17:45.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.439+0000 7fe503e00700 1 --2- 172.21.15.111:0/3772554499 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe50c100d70 0x7fe50c073590 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe4f400d900 tx=0x7fe4f400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:45.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.439+0000 7fe50a000700 1 -- 172.21.15.111:0/3772554499 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4f4009900 con 0x7fe50c100d70 2024-09-11T00:17:45.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.440+0000 7fe50a000700 1 -- 172.21.15.111:0/3772554499 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe4f4010460 con 0x7fe50c100d70 2024-09-11T00:17:45.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.440+0000 7fe50a000700 1 -- 172.21.15.111:0/3772554499 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4f400f5f0 con 0x7fe50c100d70 2024-09-11T00:17:45.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.440+0000 7fe513a00700 1 -- 172.21.15.111:0/3772554499 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe50c1a1f80 con 0x7fe50c100d70 2024-09-11T00:17:45.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.440+0000 7fe513a00700 1 -- 172.21.15.111:0/3772554499 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe50c1a2390 con 0x7fe50c100d70 2024-09-11T00:17:45.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.441+0000 7fe513a00700 1 -- 172.21.15.111:0/3772554499 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe50c1086e0 con 0x7fe50c100d70 2024-09-11T00:17:45.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.442+0000 7fe50a000700 1 -- 172.21.15.111:0/3772554499 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fe4f40105d0 con 0x7fe50c100d70 2024-09-11T00:17:45.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.443+0000 7fe50a000700 1 --2- 172.21.15.111:0/3772554499 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe4f007a6f0 0x7fe4f007cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:45.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.443+0000 7fe50a000700 1 -- 172.21.15.111:0/3772554499 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fe4f409cda0 con 0x7fe50c100d70 2024-09-11T00:17:45.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.443+0000 7fe511000700 1 --2- 172.21.15.111:0/3772554499 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe4f007a6f0 0x7fe4f007cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:45.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.444+0000 7fe511000700 1 --2- 172.21.15.111:0/3772554499 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe4f007a6f0 0x7fe4f007cba0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc006010 tx=0x7fe4fc01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:45.449 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.447+0000 7fe50a000700 1 -- 172.21.15.111:0/3772554499 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fe4f4060520 con 0x7fe50c100d70 2024-09-11T00:17:45.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:45 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:45.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:45 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:45.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:45 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:45.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:45 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:17:45.546 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:45 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:45.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.696+0000 7fe513a00700 1 -- 172.21.15.111:0/3772554499 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe50c02ccf0 con 0x7fe4f007a6f0 2024-09-11T00:17:45.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.698+0000 7fe50a000700 1 -- 172.21.15.111:0/3772554499 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe50c02ccf0 con 0x7fe4f007a6f0 2024-09-11T00:17:45.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.700+0000 7fe513a00700 1 -- 172.21.15.111:0/3772554499 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe4f007a6f0 msgr2=0x7fe4f007cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:45.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.700+0000 7fe513a00700 1 --2- 172.21.15.111:0/3772554499 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe4f007a6f0 0x7fe4f007cba0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc006010 tx=0x7fe4fc01a040 comp rx=0 tx=0).stop 2024-09-11T00:17:45.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.700+0000 7fe513a00700 1 -- 172.21.15.111:0/3772554499 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe50c100d70 msgr2=0x7fe50c073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:45.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.700+0000 7fe513a00700 1 --2- 172.21.15.111:0/3772554499 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe50c100d70 0x7fe50c073590 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe4f400d900 tx=0x7fe4f400dc10 comp rx=0 tx=0).stop 2024-09-11T00:17:45.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.700+0000 7fe513a00700 1 -- 172.21.15.111:0/3772554499 shutdown_connections 2024-09-11T00:17:45.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.700+0000 7fe513a00700 1 --2- 172.21.15.111:0/3772554499 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe4f007a6f0 0x7fe4f007cba0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:45.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.700+0000 7fe513a00700 1 --2- 172.21.15.111:0/3772554499 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe50c1003d0 0x7fe50c073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:45.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.700+0000 7fe513a00700 1 --2- 172.21.15.111:0/3772554499 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe50c100d70 0x7fe50c073590 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:45.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.700+0000 7fe513a00700 1 -- 172.21.15.111:0/3772554499 >> 172.21.15.111:0/3772554499 conn(0x7fe50c0fbc50 msgr2=0x7fe50c0fd260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:45.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.701+0000 7fe513a00700 1 -- 172.21.15.111:0/3772554499 shutdown_connections 2024-09-11T00:17:45.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.701+0000 7fe513a00700 1 -- 172.21.15.111:0/3772554499 wait complete. 2024-09-11T00:17:45.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.840+0000 7fd1d3600700 1 -- 172.21.15.111:0/3397959330 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1cc1003b0 msgr2=0x7fd1cc100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:45.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.840+0000 7fd1d3600700 1 --2- 172.21.15.111:0/3397959330 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1cc1003b0 0x7fd1cc100780 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0009910 tx=0x7fd1c0009c20 comp rx=0 tx=0).stop 2024-09-11T00:17:45.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.840+0000 7fd1d3600700 1 -- 172.21.15.111:0/3397959330 shutdown_connections 2024-09-11T00:17:45.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.840+0000 7fd1d3600700 1 --2- 172.21.15.111:0/3397959330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd1cc100d50 0x7fd1cc104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:45.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.840+0000 7fd1d3600700 1 --2- 172.21.15.111:0/3397959330 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1cc1003b0 0x7fd1cc100780 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:45.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.840+0000 7fd1d3600700 1 -- 172.21.15.111:0/3397959330 >> 172.21.15.111:0/3397959330 conn(0x7fd1cc0fbc30 msgr2=0x7fd1cc0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:45.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.840+0000 7fd1d3600700 1 -- 172.21.15.111:0/3397959330 shutdown_connections 2024-09-11T00:17:45.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.840+0000 7fd1d3600700 1 -- 172.21.15.111:0/3397959330 wait complete. 2024-09-11T00:17:45.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.841+0000 7fd1d3600700 1 Processor -- start 2024-09-11T00:17:45.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.842+0000 7fd1d3600700 1 -- start start 2024-09-11T00:17:45.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.842+0000 7fd1d3600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1cc1003b0 0x7fd1cc197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:45.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.842+0000 7fd1d3600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd1cc100d50 0x7fd1cc198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:45.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.842+0000 7fd1d3600700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc198b00 con 0x7fd1cc1003b0 2024-09-11T00:17:45.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.842+0000 7fd1d3600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc19c890 con 0x7fd1cc100d50 2024-09-11T00:17:45.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.842+0000 7fd1d0c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1cc1003b0 0x7fd1cc197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:45.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.842+0000 7fd1d0c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1cc1003b0 0x7fd1cc197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42160/0 (socket says 172.21.15.111:42160) 2024-09-11T00:17:45.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.842+0000 7fd1d0c00700 1 -- 172.21.15.111:0/607749400 learned_addr learned my addr 172.21.15.111:0/607749400 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:17:45.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.842+0000 7fd1cbe00700 1 --2- 172.21.15.111:0/607749400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd1cc100d50 0x7fd1cc198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:45.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.843+0000 7fd1d0c00700 1 -- 172.21.15.111:0/607749400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd1cc100d50 msgr2=0x7fd1cc198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:45.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.843+0000 7fd1d0c00700 1 --2- 172.21.15.111:0/607749400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd1cc100d50 0x7fd1cc198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:45.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.843+0000 7fd1d0c00700 1 -- 172.21.15.111:0/607749400 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c00095f0 con 0x7fd1cc1003b0 2024-09-11T00:17:45.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.843+0000 7fd1d0c00700 1 --2- 172.21.15.111:0/607749400 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1cc1003b0 0x7fd1cc197ee0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd1c00092e0 tx=0x7fd1c000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:45.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.843+0000 7fd1c9600700 1 -- 172.21.15.111:0/607749400 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1c001d070 con 0x7fd1cc1003b0 2024-09-11T00:17:45.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.843+0000 7fd1c9600700 1 -- 172.21.15.111:0/607749400 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd1c0005e00 con 0x7fd1cc1003b0 2024-09-11T00:17:45.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.843+0000 7fd1d3600700 1 -- 172.21.15.111:0/607749400 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1cc19cb10 con 0x7fd1cc1003b0 2024-09-11T00:17:45.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.843+0000 7fd1c9600700 1 -- 172.21.15.111:0/607749400 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1c0017400 con 0x7fd1cc1003b0 2024-09-11T00:17:45.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.843+0000 7fd1d3600700 1 -- 172.21.15.111:0/607749400 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1cc19d000 con 0x7fd1cc1003b0 2024-09-11T00:17:45.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.844+0000 7fd1d3600700 1 -- 172.21.15.111:0/607749400 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1cc1044a0 con 0x7fd1cc1003b0 2024-09-11T00:17:45.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.845+0000 7fd1c9600700 1 -- 172.21.15.111:0/607749400 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fd1c000f6f0 con 0x7fd1cc1003b0 2024-09-11T00:17:45.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.846+0000 7fd1c9600700 1 --2- 172.21.15.111:0/607749400 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd1b407a6f0 0x7fd1b407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:45.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.847+0000 7fd1c9600700 1 -- 172.21.15.111:0/607749400 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd1c009e750 con 0x7fd1cc1003b0 2024-09-11T00:17:45.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.847+0000 7fd1cbe00700 1 --2- 172.21.15.111:0/607749400 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd1b407a6f0 0x7fd1b407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:45.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.847+0000 7fd1cbe00700 1 --2- 172.21.15.111:0/607749400 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd1b407a6f0 0x7fd1b407cba0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc199500 tx=0x7fd1b800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:45.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:45.851+0000 7fd1c9600700 1 -- 172.21.15.111:0/607749400 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fd1c0061e50 con 0x7fd1cc1003b0 2024-09-11T00:17:46.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.092+0000 7fd1d3600700 1 -- 172.21.15.111:0/607749400 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1cc02ccf0 con 0x7fd1b407a6f0 2024-09-11T00:17:46.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.102+0000 7fd1c9600700 1 -- 172.21.15.111:0/607749400 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fd1cc02ccf0 con 0x7fd1b407a6f0 2024-09-11T00:17:46.104 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:17:46.105 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (7m) 2s ago 20m 15.5M - 0.27.0 11f11916f8cd d6d3253e881f 2024-09-11T00:17:46.105 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (9m) 2s ago 21m 8614k - 18.2.0 dc2bc1663786 7c40af85314c 2024-09-11T00:17:46.105 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi203 smithi203 running (9m) 23s ago 19m 8682k - 18.2.0 dc2bc1663786 922e3261ff70 2024-09-11T00:17:46.105 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (4m) 2s ago 21m 6899k - 19.3.0-4854-g8f219c47 589dd18248e4 a9cacdb9a638 2024-09-11T00:17:46.105 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi203 smithi203 running (4m) 23s ago 19m 6899k - 19.3.0-4854-g8f219c47 589dd18248e4 d452d9dfa04b 2024-09-11T00:17:46.105 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (6m) 2s ago 20m 68.1M - c8b91775d855 7d3b50b5b59f 2024-09-11T00:17:46.105 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.gmgsay smithi111 running (9s) 2s ago 13m 12.2M - 19.3.0-4854-g8f219c47 589dd18248e4 a8cff96fcbbe 2024-09-11T00:17:46.105 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.rucaba smithi111 running (13m) 2s ago 13m 19.2M - 18.2.0 dc2bc1663786 02885adac62c 2024-09-11T00:17:46.105 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.tcrqop smithi203 running (13m) 23s ago 13m 150M - 18.2.0 dc2bc1663786 4df492159bb4 2024-09-11T00:17:46.105 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.uqkbkn smithi203 running (13m) 23s ago 13m 19.1M - 18.2.0 dc2bc1663786 619aa58ea314 2024-09-11T00:17:46.105 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.ypucji smithi111 *:8443,9283,8765 running (9m) 2s ago 22m 518M - 19.3.0-4854-g8f219c47 589dd18248e4 07fa31f49618 2024-09-11T00:17:46.105 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi203.smuspl smithi203 *:8443,9283,8765 running (8m) 23s ago 19m 456M - 19.3.0-4854-g8f219c47 589dd18248e4 7e5a93a5ffa7 2024-09-11T00:17:46.106 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (5m) 2s ago 22m 53.9M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 3c29c070a612 2024-09-11T00:17:46.106 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi203 smithi203 running (4m) 23s ago 19m 43.2M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 45e8285e4b4d 2024-09-11T00:17:46.106 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (8m) 2s ago 21m 7759k - 1.7.0 72c9c2088986 ec478ea14488 2024-09-11T00:17:46.106 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi203 smithi203 *:9100 running (8m) 23s ago 19m 8132k - 1.7.0 72c9c2088986 54d461cde1bc 2024-09-11T00:17:46.106 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (3m) 2s ago 18m 92.9M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 d2f1a2312736 2024-09-11T00:17:46.106 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (3m) 2s ago 17m 94.0M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 19cf95ecca7d 2024-09-11T00:17:46.106 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (2m) 2s ago 17m 76.2M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 3a3b318b337a 2024-09-11T00:17:46.106 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi203 running (101s) 23s ago 16m 93.1M 2240M 19.3.0-4854-g8f219c47 589dd18248e4 288c7e8ae34b 2024-09-11T00:17:46.106 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi203 running (64s) 23s ago 16m 90.4M 2240M 19.3.0-4854-g8f219c47 589dd18248e4 485f82d3eafb 2024-09-11T00:17:46.106 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi203 running (27s) 23s ago 15m 10.4M 2240M 19.3.0-4854-g8f219c47 589dd18248e4 ef4834f3adf1 2024-09-11T00:17:46.106 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (7m) 2s ago 20m 63.5M - 2.51.0 1d3b7f56885b 3e72ac10983d 2024-09-11T00:17:46.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.107+0000 7fd1d3600700 1 -- 172.21.15.111:0/607749400 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd1b407a6f0 msgr2=0x7fd1b407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:46.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.107+0000 7fd1d3600700 1 --2- 172.21.15.111:0/607749400 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd1b407a6f0 0x7fd1b407cba0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc199500 tx=0x7fd1b800b410 comp rx=0 tx=0).stop 2024-09-11T00:17:46.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.107+0000 7fd1d3600700 1 -- 172.21.15.111:0/607749400 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1cc1003b0 msgr2=0x7fd1cc197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:46.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.107+0000 7fd1d3600700 1 --2- 172.21.15.111:0/607749400 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1cc1003b0 0x7fd1cc197ee0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd1c00092e0 tx=0x7fd1c000bd70 comp rx=0 tx=0).stop 2024-09-11T00:17:46.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.107+0000 7fd1d3600700 1 -- 172.21.15.111:0/607749400 shutdown_connections 2024-09-11T00:17:46.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.107+0000 7fd1d3600700 1 --2- 172.21.15.111:0/607749400 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd1b407a6f0 0x7fd1b407cba0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:46.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.107+0000 7fd1d3600700 1 --2- 172.21.15.111:0/607749400 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1cc1003b0 0x7fd1cc197ee0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:46.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.107+0000 7fd1d3600700 1 --2- 172.21.15.111:0/607749400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd1cc100d50 0x7fd1cc198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:46.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.107+0000 7fd1d3600700 1 -- 172.21.15.111:0/607749400 >> 172.21.15.111:0/607749400 conn(0x7fd1cc0fbc30 msgr2=0x7fd1cc0fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:46.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.107+0000 7fd1d3600700 1 -- 172.21.15.111:0/607749400 shutdown_connections 2024-09-11T00:17:46.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.107+0000 7fd1d3600700 1 -- 172.21.15.111:0/607749400 wait complete. 2024-09-11T00:17:46.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.257+0000 7f6baf000700 1 -- 172.21.15.111:0/2905955828 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ba8105f90 msgr2=0x7f6ba8106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:46.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.257+0000 7f6baf000700 1 --2- 172.21.15.111:0/2905955828 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ba8105f90 0x7f6ba8106360 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009910 tx=0x7f6b9c009c20 comp rx=0 tx=0).stop 2024-09-11T00:17:46.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.257+0000 7f6baf000700 1 -- 172.21.15.111:0/2905955828 shutdown_connections 2024-09-11T00:17:46.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.257+0000 7f6baf000700 1 --2- 172.21.15.111:0/2905955828 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ba80683d0 0x7f6ba8068840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:46.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.257+0000 7f6baf000700 1 --2- 172.21.15.111:0/2905955828 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ba8105f90 0x7f6ba8106360 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:46.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.257+0000 7f6baf000700 1 -- 172.21.15.111:0/2905955828 >> 172.21.15.111:0/2905955828 conn(0x7f6ba8074d00 msgr2=0x7f6ba8075100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:46.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.257+0000 7f6baf000700 1 -- 172.21.15.111:0/2905955828 shutdown_connections 2024-09-11T00:17:46.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.257+0000 7f6baf000700 1 -- 172.21.15.111:0/2905955828 wait complete. 2024-09-11T00:17:46.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.258+0000 7f6baf000700 1 Processor -- start 2024-09-11T00:17:46.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.258+0000 7f6baf000700 1 -- start start 2024-09-11T00:17:46.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.259+0000 7f6baf000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ba80683d0 0x7f6ba80ff040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:46.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.259+0000 7f6baf000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ba8105f90 0x7f6ba80ff580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:46.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.259+0000 7f6baf000700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba80ffac0 con 0x7f6ba80683d0 2024-09-11T00:17:46.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.259+0000 7f6baf000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba80ffc00 con 0x7f6ba8105f90 2024-09-11T00:17:46.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.259+0000 7f6badc00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ba80683d0 0x7f6ba80ff040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:46.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.259+0000 7f6badc00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ba80683d0 0x7f6ba80ff040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42184/0 (socket says 172.21.15.111:42184) 2024-09-11T00:17:46.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.259+0000 7f6badc00700 1 -- 172.21.15.111:0/3507293266 learned_addr learned my addr 172.21.15.111:0/3507293266 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:17:46.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.259+0000 7f6bad200700 1 --2- 172.21.15.111:0/3507293266 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ba8105f90 0x7f6ba80ff580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:46.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.259+0000 7f6badc00700 1 -- 172.21.15.111:0/3507293266 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ba8105f90 msgr2=0x7f6ba80ff580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:46.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.259+0000 7f6badc00700 1 --2- 172.21.15.111:0/3507293266 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ba8105f90 0x7f6ba80ff580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:46.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.259+0000 7f6badc00700 1 -- 172.21.15.111:0/3507293266 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9c0095f0 con 0x7f6ba80683d0 2024-09-11T00:17:46.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.260+0000 7f6badc00700 1 --2- 172.21.15.111:0/3507293266 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ba80683d0 0x7f6ba80ff040 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c0092e0 tx=0x7f6b9c00f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:46.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.260+0000 7f6ba6000700 1 -- 172.21.15.111:0/3507293266 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b9c01d070 con 0x7f6ba80683d0 2024-09-11T00:17:46.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.260+0000 7f6ba6000700 1 -- 172.21.15.111:0/3507293266 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6b9c0052a0 con 0x7f6ba80683d0 2024-09-11T00:17:46.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.260+0000 7f6baf000700 1 -- 172.21.15.111:0/3507293266 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba80ffe80 con 0x7f6ba80683d0 2024-09-11T00:17:46.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.260+0000 7f6ba6000700 1 -- 172.21.15.111:0/3507293266 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b9c017630 con 0x7f6ba80683d0 2024-09-11T00:17:46.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.260+0000 7f6baf000700 1 -- 172.21.15.111:0/3507293266 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba81a2080 con 0x7f6ba80683d0 2024-09-11T00:17:46.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.261+0000 7f6baf000700 1 -- 172.21.15.111:0/3507293266 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba8108470 con 0x7f6ba80683d0 2024-09-11T00:17:46.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.262+0000 7f6ba6000700 1 -- 172.21.15.111:0/3507293266 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f6b9c0178a0 con 0x7f6ba80683d0 2024-09-11T00:17:46.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.263+0000 7f6ba6000700 1 --2- 172.21.15.111:0/3507293266 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f6b9007a6f0 0x7f6b9007cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:46.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.263+0000 7f6ba6000700 1 -- 172.21.15.111:0/3507293266 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f6b9c09e4b0 con 0x7f6ba80683d0 2024-09-11T00:17:46.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.264+0000 7f6bad200700 1 --2- 172.21.15.111:0/3507293266 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f6b9007a6f0 0x7f6b9007cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:46.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.264+0000 7f6bad200700 1 --2- 172.21.15.111:0/3507293266 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f6b9007a6f0 0x7f6b9007cba0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8100830 tx=0x7f6b94009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:46.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.268+0000 7f6ba6000700 1 -- 172.21.15.111:0/3507293266 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f6b9c061cd0 con 0x7f6ba80683d0 2024-09-11T00:17:46.293 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:46 smithi111 ceph-mon[90842]: from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:17:46.293 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:46 smithi111 ceph-mon[90842]: pgmap v192: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:46.293 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:46 smithi111 ceph-mon[90842]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:17:46.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:46 smithi203 ceph-mon[69002]: from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:17:46.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:46 smithi203 ceph-mon[69002]: pgmap v192: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:46.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:46 smithi203 ceph-mon[69002]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:17:46.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.596+0000 7f6baf000700 1 -- 172.21.15.111:0/3507293266 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6ba804f2a0 con 0x7f6ba80683d0 2024-09-11T00:17:46.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.597+0000 7f6ba6000700 1 -- 172.21.15.111:0/3507293266 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+805 (secure 0 0 0) 0x7f6b9c003e60 con 0x7f6ba80683d0 2024-09-11T00:17:46.599 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:17:46.599 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-11T00:17:46.599 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:17:46.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:17:46.599 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-11T00:17:46.599 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:17:46.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:17:46.599 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-11T00:17:46.599 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 6 2024-09-11T00:17:46.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:17:46.600 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-11T00:17:46.600 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-09-11T00:17:46.600 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 1 2024-09-11T00:17:46.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:17:46.600 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-11T00:17:46.600 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-09-11T00:17:46.600 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 11 2024-09-11T00:17:46.600 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-11T00:17:46.600 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:17:46.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.599+0000 7f6baf000700 1 -- 172.21.15.111:0/3507293266 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f6b9007a6f0 msgr2=0x7f6b9007cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:46.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.599+0000 7f6baf000700 1 --2- 172.21.15.111:0/3507293266 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f6b9007a6f0 0x7f6b9007cba0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8100830 tx=0x7f6b94009260 comp rx=0 tx=0).stop 2024-09-11T00:17:46.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.599+0000 7f6baf000700 1 -- 172.21.15.111:0/3507293266 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ba80683d0 msgr2=0x7f6ba80ff040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:46.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.599+0000 7f6baf000700 1 --2- 172.21.15.111:0/3507293266 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ba80683d0 0x7f6ba80ff040 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c0092e0 tx=0x7f6b9c00f460 comp rx=0 tx=0).stop 2024-09-11T00:17:46.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.600+0000 7f6baf000700 1 -- 172.21.15.111:0/3507293266 shutdown_connections 2024-09-11T00:17:46.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.600+0000 7f6baf000700 1 --2- 172.21.15.111:0/3507293266 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f6b9007a6f0 0x7f6b9007cba0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:46.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.600+0000 7f6baf000700 1 --2- 172.21.15.111:0/3507293266 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ba80683d0 0x7f6ba80ff040 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:46.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.600+0000 7f6baf000700 1 --2- 172.21.15.111:0/3507293266 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ba8105f90 0x7f6ba80ff580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:46.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.600+0000 7f6baf000700 1 -- 172.21.15.111:0/3507293266 >> 172.21.15.111:0/3507293266 conn(0x7f6ba8074d00 msgr2=0x7f6ba80fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:46.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.600+0000 7f6baf000700 1 -- 172.21.15.111:0/3507293266 shutdown_connections 2024-09-11T00:17:46.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.600+0000 7f6baf000700 1 -- 172.21.15.111:0/3507293266 wait complete. 2024-09-11T00:17:46.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.741+0000 7fc0b9400700 1 -- 172.21.15.111:0/1353700878 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0b41003b0 msgr2=0x7fc0b4100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:46.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.741+0000 7fc0b9400700 1 --2- 172.21.15.111:0/1353700878 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0b41003b0 0x7fc0b4100780 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4009910 tx=0x7fc0a4009c20 comp rx=0 tx=0).stop 2024-09-11T00:17:46.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.741+0000 7fc0b9400700 1 -- 172.21.15.111:0/1353700878 shutdown_connections 2024-09-11T00:17:46.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.741+0000 7fc0b9400700 1 --2- 172.21.15.111:0/1353700878 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc0b4100d50 0x7fc0b4104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:46.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.741+0000 7fc0b9400700 1 --2- 172.21.15.111:0/1353700878 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0b41003b0 0x7fc0b4100780 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:46.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.741+0000 7fc0b9400700 1 -- 172.21.15.111:0/1353700878 >> 172.21.15.111:0/1353700878 conn(0x7fc0b40fbc30 msgr2=0x7fc0b40fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:46.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.741+0000 7fc0b9400700 1 -- 172.21.15.111:0/1353700878 shutdown_connections 2024-09-11T00:17:46.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.741+0000 7fc0b9400700 1 -- 172.21.15.111:0/1353700878 wait complete. 2024-09-11T00:17:46.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.742+0000 7fc0b9400700 1 Processor -- start 2024-09-11T00:17:46.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.742+0000 7fc0b9400700 1 -- start start 2024-09-11T00:17:46.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.742+0000 7fc0b9400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc0b41003b0 0x7fc0b4197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:46.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.742+0000 7fc0b9400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0b4100d50 0x7fc0b4198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:46.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.742+0000 7fc0b9400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b4198b40 con 0x7fc0b4100d50 2024-09-11T00:17:46.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.742+0000 7fc0b9400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b419c8d0 con 0x7fc0b41003b0 2024-09-11T00:17:46.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.743+0000 7fc0b1e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0b4100d50 0x7fc0b4198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:46.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.743+0000 7fc0b1e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0b4100d50 0x7fc0b4198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42204/0 (socket says 172.21.15.111:42204) 2024-09-11T00:17:46.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.743+0000 7fc0b1e00700 1 -- 172.21.15.111:0/3314120110 learned_addr learned my addr 172.21.15.111:0/3314120110 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:17:46.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.743+0000 7fc0b2800700 1 --2- 172.21.15.111:0/3314120110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc0b41003b0 0x7fc0b4197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:46.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.743+0000 7fc0b1e00700 1 -- 172.21.15.111:0/3314120110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc0b41003b0 msgr2=0x7fc0b4197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:46.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.743+0000 7fc0b1e00700 1 --2- 172.21.15.111:0/3314120110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc0b41003b0 0x7fc0b4197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:46.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.743+0000 7fc0b1e00700 1 -- 172.21.15.111:0/3314120110 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a40095f0 con 0x7fc0b4100d50 2024-09-11T00:17:46.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.744+0000 7fc0b1e00700 1 --2- 172.21.15.111:0/3314120110 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0b4100d50 0x7fc0b4198460 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc0a000e8f0 tx=0x7fc0a000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:46.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.744+0000 7fc0ab400700 1 -- 172.21.15.111:0/3314120110 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0a0009790 con 0x7fc0b4100d50 2024-09-11T00:17:46.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.744+0000 7fc0ab400700 1 -- 172.21.15.111:0/3314120110 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc0a000c810 con 0x7fc0b4100d50 2024-09-11T00:17:46.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.744+0000 7fc0b9400700 1 -- 172.21.15.111:0/3314120110 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b419cbb0 con 0x7fc0b4100d50 2024-09-11T00:17:46.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.744+0000 7fc0ab400700 1 -- 172.21.15.111:0/3314120110 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0a0005580 con 0x7fc0b4100d50 2024-09-11T00:17:46.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.744+0000 7fc0b9400700 1 -- 172.21.15.111:0/3314120110 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b419d100 con 0x7fc0b4100d50 2024-09-11T00:17:46.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.745+0000 7fc0b9400700 1 -- 172.21.15.111:0/3314120110 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b41044a0 con 0x7fc0b4100d50 2024-09-11T00:17:46.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.747+0000 7fc0ab400700 1 -- 172.21.15.111:0/3314120110 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fc0a000c980 con 0x7fc0b4100d50 2024-09-11T00:17:46.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.747+0000 7fc0ab400700 1 --2- 172.21.15.111:0/3314120110 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc09807a6f0 0x7fc09807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:46.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.748+0000 7fc0ab400700 1 -- 172.21.15.111:0/3314120110 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fc0a0014070 con 0x7fc0b4100d50 2024-09-11T00:17:46.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.748+0000 7fc0b2800700 1 --2- 172.21.15.111:0/3314120110 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc09807a6f0 0x7fc09807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:46.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.749+0000 7fc0b2800700 1 --2- 172.21.15.111:0/3314120110 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc09807a6f0 0x7fc09807cba0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4009fd0 tx=0x7fc0a4005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:46.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:46.752+0000 7fc0ab400700 1 -- 172.21.15.111:0/3314120110 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fc0a0060c30 con 0x7fc0b4100d50 2024-09-11T00:17:47.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.032+0000 7fc0b9400700 1 -- 172.21.15.111:0/3314120110 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc0b404ea50 con 0x7fc0b4100d50 2024-09-11T00:17:47.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.033+0000 7fc0ab400700 1 -- 172.21.15.111:0/3314120110 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1922 (secure 0 0 0) 0x7fc0a0063d50 con 0x7fc0b4100d50 2024-09-11T00:17:47.036 INFO:teuthology.orchestra.run.smithi111.stdout:e17 2024-09-11T00:17:47.036 INFO:teuthology.orchestra.run.smithi111.stdout:btime 2024-09-11T00:17:37:251871+0000 2024-09-11T00:17:47.036 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T00:17:47.036 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:17:47.036 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-11T00:17:47.036 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:17:47.036 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-11T00:17:47.036 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-11T00:17:47.036 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 14 2024-09-11T00:17:47.037 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-11T00:17:47.037 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-11T00:03:47.950356+0000 2024-09-11T00:17:47.037 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-11T00:04:06.275905+0000 2024-09-11T00:17:47.037 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-11T00:17:47.037 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-11T00:17:47.037 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-11T00:17:47.037 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-11T00:17:47.038 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-11T00:17:47.038 INFO:teuthology.orchestra.run.smithi111.stdout:max_xattr_size 65536 2024-09-11T00:17:47.038 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-11T00:17:47.038 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-11T00:17:47.038 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 47 2024-09-11T00:17:47.038 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:17:47.038 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-11T00:17:47.039 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-11T00:17:47.039 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=24363} 2024-09-11T00:17:47.039 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-11T00:17:47.039 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-11T00:17:47.039 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-11T00:17:47.039 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-11T00:17:47.039 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-11T00:17:47.039 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data enabled 2024-09-11T00:17:47.039 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-11T00:17:47.039 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-11T00:17:47.039 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 1 2024-09-11T00:17:47.039 INFO:teuthology.orchestra.run.smithi111.stdout:qdb_cluster leader: 0 members: 2024-09-11T00:17:47.039 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.tcrqop{0:24363} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.203:6824/3082736449,v1:172.21.15.203:6825/3082736449] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:17:47.040 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:17:47.040 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:17:47.040 INFO:teuthology.orchestra.run.smithi111.stdout:Standby daemons: 2024-09-11T00:17:47.040 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:17:47.040 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.rucaba{-1:14554} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6828/2045133285,v1:172.21.15.111:6829/2045133285] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:17:47.040 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.uqkbkn{-1:24379} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.203:6826/695613114,v1:172.21.15.203:6827/695613114] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:17:47.040 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.gmgsay{-1:34406} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.111:6826/3970632147,v1:172.21.15.111:6827/3970632147] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:17:47.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.036+0000 7fc0b9400700 1 -- 172.21.15.111:0/3314120110 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc09807a6f0 msgr2=0x7fc09807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:47.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.036+0000 7fc0b9400700 1 --2- 172.21.15.111:0/3314120110 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc09807a6f0 0x7fc09807cba0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4009fd0 tx=0x7fc0a4005a90 comp rx=0 tx=0).stop 2024-09-11T00:17:47.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.036+0000 7fc0b9400700 1 -- 172.21.15.111:0/3314120110 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0b4100d50 msgr2=0x7fc0b4198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:47.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.036+0000 7fc0b9400700 1 --2- 172.21.15.111:0/3314120110 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0b4100d50 0x7fc0b4198460 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc0a000e8f0 tx=0x7fc0a000ec00 comp rx=0 tx=0).stop 2024-09-11T00:17:47.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.036+0000 7fc0b9400700 1 -- 172.21.15.111:0/3314120110 shutdown_connections 2024-09-11T00:17:47.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.036+0000 7fc0b9400700 1 --2- 172.21.15.111:0/3314120110 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc09807a6f0 0x7fc09807cba0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:47.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.036+0000 7fc0b9400700 1 --2- 172.21.15.111:0/3314120110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc0b41003b0 0x7fc0b4197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:47.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.036+0000 7fc0b9400700 1 --2- 172.21.15.111:0/3314120110 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc0b4100d50 0x7fc0b4198460 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:47.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.036+0000 7fc0b9400700 1 -- 172.21.15.111:0/3314120110 >> 172.21.15.111:0/3314120110 conn(0x7fc0b40fbc30 msgr2=0x7fc0b40fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:47.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.036+0000 7fc0b9400700 1 -- 172.21.15.111:0/3314120110 shutdown_connections 2024-09-11T00:17:47.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.036+0000 7fc0b9400700 1 -- 172.21.15.111:0/3314120110 wait complete. 2024-09-11T00:17:47.042 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 17 2024-09-11T00:17:47.181 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.178+0000 7f1d94a00700 1 -- 172.21.15.111:0/4249516074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d90100d70 msgr2=0x7f1d90104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:47.181 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.178+0000 7f1d94a00700 1 --2- 172.21.15.111:0/4249516074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d90100d70 0x7f1d90104d40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c009910 tx=0x7f1d7c009c20 comp rx=0 tx=0).stop 2024-09-11T00:17:47.181 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.178+0000 7f1d94a00700 1 -- 172.21.15.111:0/4249516074 shutdown_connections 2024-09-11T00:17:47.181 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.178+0000 7f1d94a00700 1 --2- 172.21.15.111:0/4249516074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d90100d70 0x7f1d90104d40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:47.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.178+0000 7f1d94a00700 1 --2- 172.21.15.111:0/4249516074 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1d901003d0 0x7f1d901007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:47.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.178+0000 7f1d94a00700 1 -- 172.21.15.111:0/4249516074 >> 172.21.15.111:0/4249516074 conn(0x7f1d900fbc90 msgr2=0x7f1d900fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:47.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.179+0000 7f1d94a00700 1 -- 172.21.15.111:0/4249516074 shutdown_connections 2024-09-11T00:17:47.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.179+0000 7f1d94a00700 1 -- 172.21.15.111:0/4249516074 wait complete. 2024-09-11T00:17:47.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.180+0000 7f1d94a00700 1 Processor -- start 2024-09-11T00:17:47.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.180+0000 7f1d94a00700 1 -- start start 2024-09-11T00:17:47.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.180+0000 7f1d94a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d901003d0 0x7f1d90197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:47.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.180+0000 7f1d94a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1d90100d70 0x7f1d90198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:47.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.180+0000 7f1d94a00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d90198b70 con 0x7f1d90100d70 2024-09-11T00:17:47.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.180+0000 7f1d94a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9019c900 con 0x7f1d901003d0 2024-09-11T00:17:47.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.180+0000 7f1d8d400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1d90100d70 0x7f1d90198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:47.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.181+0000 7f1d8d400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1d90100d70 0x7f1d90198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42228/0 (socket says 172.21.15.111:42228) 2024-09-11T00:17:47.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.181+0000 7f1d8d400700 1 -- 172.21.15.111:0/3348595888 learned_addr learned my addr 172.21.15.111:0/3348595888 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:17:47.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.181+0000 7f1d8de00700 1 --2- 172.21.15.111:0/3348595888 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d901003d0 0x7f1d90197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:47.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.181+0000 7f1d8d400700 1 -- 172.21.15.111:0/3348595888 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d901003d0 msgr2=0x7f1d90197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:47.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.181+0000 7f1d8d400700 1 --2- 172.21.15.111:0/3348595888 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d901003d0 0x7f1d90197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:47.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.181+0000 7f1d8d400700 1 -- 172.21.15.111:0/3348595888 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c0095f0 con 0x7f1d90100d70 2024-09-11T00:17:47.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.181+0000 7f1d8d400700 1 --2- 172.21.15.111:0/3348595888 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1d90100d70 0x7f1d90198490 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c005b40 tx=0x7f1d7c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:47.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.182+0000 7f1d86a00700 1 -- 172.21.15.111:0/3348595888 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d7c01d070 con 0x7f1d90100d70 2024-09-11T00:17:47.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.182+0000 7f1d86a00700 1 -- 172.21.15.111:0/3348595888 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1d7c00bed0 con 0x7f1d90100d70 2024-09-11T00:17:47.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.182+0000 7f1d86a00700 1 -- 172.21.15.111:0/3348595888 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d7c003e70 con 0x7f1d90100d70 2024-09-11T00:17:47.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.182+0000 7f1d94a00700 1 -- 172.21.15.111:0/3348595888 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d9019cb80 con 0x7f1d90100d70 2024-09-11T00:17:47.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.182+0000 7f1d94a00700 1 -- 172.21.15.111:0/3348595888 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9019d070 con 0x7f1d90100d70 2024-09-11T00:17:47.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.183+0000 7f1d94a00700 1 -- 172.21.15.111:0/3348595888 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d901044c0 con 0x7f1d90100d70 2024-09-11T00:17:47.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.184+0000 7f1d86a00700 1 -- 172.21.15.111:0/3348595888 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f1d7c0050d0 con 0x7f1d90100d70 2024-09-11T00:17:47.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.185+0000 7f1d86a00700 1 --2- 172.21.15.111:0/3348595888 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f1d7407a6f0 0x7f1d7407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:47.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.185+0000 7f1d86a00700 1 -- 172.21.15.111:0/3348595888 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f1d7c09e600 con 0x7f1d90100d70 2024-09-11T00:17:47.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.185+0000 7f1d8de00700 1 --2- 172.21.15.111:0/3348595888 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f1d7407a6f0 0x7f1d7407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:47.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.186+0000 7f1d8de00700 1 --2- 172.21.15.111:0/3348595888 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f1d7407a6f0 0x7f1d7407cba0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1d80009c60 tx=0x7f1d80009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:47.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.190+0000 7f1d86a00700 1 -- 172.21.15.111:0/3348595888 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f1d7c061d00 con 0x7f1d90100d70 2024-09-11T00:17:47.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:47 smithi111 ceph-mon[90842]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:17:47.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:47 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/3507293266' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:17:47.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:47 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/3314120110' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:17:47.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.445+0000 7f1d94a00700 1 -- 172.21.15.111:0/3348595888 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d9002cd10 con 0x7f1d7407a6f0 2024-09-11T00:17:47.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.446+0000 7f1d86a00700 1 -- 172.21.15.111:0/3348595888 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1d9002cd10 con 0x7f1d7407a6f0 2024-09-11T00:17:47.448 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:17:47.449 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e", 2024-09-11T00:17:47.449 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-11T00:17:47.449 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-11T00:17:47.449 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-11T00:17:47.449 INFO:teuthology.orchestra.run.smithi111.stdout: "crash", 2024-09-11T00:17:47.449 INFO:teuthology.orchestra.run.smithi111.stdout: "osd", 2024-09-11T00:17:47.449 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr", 2024-09-11T00:17:47.449 INFO:teuthology.orchestra.run.smithi111.stdout: "mon" 2024-09-11T00:17:47.449 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-11T00:17:47.449 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "13/23 daemons upgraded", 2024-09-11T00:17:47.449 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading mds daemons", 2024-09-11T00:17:47.449 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-11T00:17:47.449 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:17:47.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.449+0000 7f1d94a00700 1 -- 172.21.15.111:0/3348595888 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f1d7407a6f0 msgr2=0x7f1d7407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:47.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.449+0000 7f1d94a00700 1 --2- 172.21.15.111:0/3348595888 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f1d7407a6f0 0x7f1d7407cba0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1d80009c60 tx=0x7f1d80009260 comp rx=0 tx=0).stop 2024-09-11T00:17:47.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.449+0000 7f1d94a00700 1 -- 172.21.15.111:0/3348595888 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1d90100d70 msgr2=0x7f1d90198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:47.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.449+0000 7f1d94a00700 1 --2- 172.21.15.111:0/3348595888 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1d90100d70 0x7f1d90198490 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c005b40 tx=0x7f1d7c00f690 comp rx=0 tx=0).stop 2024-09-11T00:17:47.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.449+0000 7f1d94a00700 1 -- 172.21.15.111:0/3348595888 shutdown_connections 2024-09-11T00:17:47.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.449+0000 7f1d94a00700 1 --2- 172.21.15.111:0/3348595888 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f1d7407a6f0 0x7f1d7407cba0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:47.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.449+0000 7f1d94a00700 1 --2- 172.21.15.111:0/3348595888 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d901003d0 0x7f1d90197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:47.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.449+0000 7f1d94a00700 1 --2- 172.21.15.111:0/3348595888 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1d90100d70 0x7f1d90198490 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:47.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.449+0000 7f1d94a00700 1 -- 172.21.15.111:0/3348595888 >> 172.21.15.111:0/3348595888 conn(0x7f1d900fbc90 msgr2=0x7f1d900fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:47.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.449+0000 7f1d94a00700 1 -- 172.21.15.111:0/3348595888 shutdown_connections 2024-09-11T00:17:47.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.449+0000 7f1d94a00700 1 -- 172.21.15.111:0/3348595888 wait complete. 2024-09-11T00:17:47.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:47 smithi203 ceph-mon[69002]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:17:47.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:47 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/3507293266' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:17:47.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:47 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/3314120110' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:17:47.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.595+0000 7fb070c00700 1 -- 172.21.15.111:0/2992273239 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb06c1003b0 msgr2=0x7fb06c100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:47.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.595+0000 7fb070c00700 1 --2- 172.21.15.111:0/2992273239 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb06c1003b0 0x7fb06c100780 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb05c009910 tx=0x7fb05c009c20 comp rx=0 tx=0).stop 2024-09-11T00:17:47.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.595+0000 7fb070c00700 1 -- 172.21.15.111:0/2992273239 shutdown_connections 2024-09-11T00:17:47.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.595+0000 7fb070c00700 1 --2- 172.21.15.111:0/2992273239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb06c100d50 0x7fb06c104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:47.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.595+0000 7fb070c00700 1 --2- 172.21.15.111:0/2992273239 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb06c1003b0 0x7fb06c100780 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:47.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.595+0000 7fb070c00700 1 -- 172.21.15.111:0/2992273239 >> 172.21.15.111:0/2992273239 conn(0x7fb06c0fbc30 msgr2=0x7fb06c0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:47.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.595+0000 7fb070c00700 1 -- 172.21.15.111:0/2992273239 shutdown_connections 2024-09-11T00:17:47.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.595+0000 7fb070c00700 1 -- 172.21.15.111:0/2992273239 wait complete. 2024-09-11T00:17:47.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.596+0000 7fb070c00700 1 Processor -- start 2024-09-11T00:17:47.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.596+0000 7fb070c00700 1 -- start start 2024-09-11T00:17:47.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.597+0000 7fb070c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb06c1003b0 0x7fb06c195d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:47.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.597+0000 7fb070c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb06c100d50 0x7fb06c196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:47.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.597+0000 7fb070c00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c196930 con 0x7fb06c1003b0 2024-09-11T00:17:47.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.597+0000 7fb070c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c19a6c0 con 0x7fb06c100d50 2024-09-11T00:17:47.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.597+0000 7fb069e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb06c1003b0 0x7fb06c195d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:47.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.597+0000 7fb069e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb06c1003b0 0x7fb06c195d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42258/0 (socket says 172.21.15.111:42258) 2024-09-11T00:17:47.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.597+0000 7fb069e00700 1 -- 172.21.15.111:0/3352078981 learned_addr learned my addr 172.21.15.111:0/3352078981 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:17:47.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.597+0000 7fb069400700 1 --2- 172.21.15.111:0/3352078981 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb06c100d50 0x7fb06c196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:47.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.597+0000 7fb069e00700 1 -- 172.21.15.111:0/3352078981 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb06c100d50 msgr2=0x7fb06c196250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:47.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.597+0000 7fb069e00700 1 --2- 172.21.15.111:0/3352078981 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb06c100d50 0x7fb06c196250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:47.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.597+0000 7fb069e00700 1 -- 172.21.15.111:0/3352078981 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05c0095f0 con 0x7fb06c1003b0 2024-09-11T00:17:47.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.598+0000 7fb069e00700 1 --2- 172.21.15.111:0/3352078981 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb06c1003b0 0x7fb06c195d10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb05c00b5c0 tx=0x7fb05c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:47.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.598+0000 7fb062a00700 1 -- 172.21.15.111:0/3352078981 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb05c01d070 con 0x7fb06c1003b0 2024-09-11T00:17:47.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.598+0000 7fb062a00700 1 -- 172.21.15.111:0/3352078981 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb05c005e00 con 0x7fb06c1003b0 2024-09-11T00:17:47.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.598+0000 7fb070c00700 1 -- 172.21.15.111:0/3352078981 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb06c19a940 con 0x7fb06c1003b0 2024-09-11T00:17:47.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.598+0000 7fb062a00700 1 -- 172.21.15.111:0/3352078981 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb05c017400 con 0x7fb06c1003b0 2024-09-11T00:17:47.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.598+0000 7fb070c00700 1 -- 172.21.15.111:0/3352078981 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb06c19ae30 con 0x7fb06c1003b0 2024-09-11T00:17:47.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.599+0000 7fb070c00700 1 -- 172.21.15.111:0/3352078981 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb06c1086c0 con 0x7fb06c1003b0 2024-09-11T00:17:47.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.601+0000 7fb062a00700 1 -- 172.21.15.111:0/3352078981 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fb05c00f460 con 0x7fb06c1003b0 2024-09-11T00:17:47.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.602+0000 7fb062a00700 1 --2- 172.21.15.111:0/3352078981 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb05007a6f0 0x7fb05007cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:47.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.603+0000 7fb062a00700 1 -- 172.21.15.111:0/3352078981 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb05c09e6a0 con 0x7fb06c1003b0 2024-09-11T00:17:47.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.603+0000 7fb069400700 1 --2- 172.21.15.111:0/3352078981 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb05007a6f0 0x7fb05007cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:47.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.603+0000 7fb069400700 1 --2- 172.21.15.111:0/3352078981 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb05007a6f0 0x7fb05007cba0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb058005950 tx=0x7fb0580058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:47.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.607+0000 7fb062a00700 1 -- 172.21.15.111:0/3352078981 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fb05c061ec0 con 0x7fb06c1003b0 2024-09-11T00:17:47.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.950+0000 7fb070c00700 1 -- 172.21.15.111:0/3352078981 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb06c04ea50 con 0x7fb06c1003b0 2024-09-11T00:17:47.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.951+0000 7fb062a00700 1 -- 172.21.15.111:0/3352078981 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fb05c064fe0 con 0x7fb06c1003b0 2024-09-11T00:17:47.953 INFO:teuthology.orchestra.run.smithi111.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-11T00:17:47.953 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-11T00:17:47.954 INFO:teuthology.orchestra.run.smithi111.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-11T00:17:47.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.953+0000 7fb070c00700 1 -- 172.21.15.111:0/3352078981 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb05007a6f0 msgr2=0x7fb05007cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:47.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.953+0000 7fb070c00700 1 --2- 172.21.15.111:0/3352078981 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb05007a6f0 0x7fb05007cba0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb058005950 tx=0x7fb0580058e0 comp rx=0 tx=0).stop 2024-09-11T00:17:47.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.953+0000 7fb070c00700 1 -- 172.21.15.111:0/3352078981 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb06c1003b0 msgr2=0x7fb06c195d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:47.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.953+0000 7fb070c00700 1 --2- 172.21.15.111:0/3352078981 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb06c1003b0 0x7fb06c195d10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb05c00b5c0 tx=0x7fb05c00be20 comp rx=0 tx=0).stop 2024-09-11T00:17:47.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.954+0000 7fb070c00700 1 -- 172.21.15.111:0/3352078981 shutdown_connections 2024-09-11T00:17:47.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.954+0000 7fb070c00700 1 --2- 172.21.15.111:0/3352078981 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fb05007a6f0 0x7fb05007cba0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:47.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.954+0000 7fb070c00700 1 --2- 172.21.15.111:0/3352078981 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb06c1003b0 0x7fb06c195d10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:47.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.954+0000 7fb070c00700 1 --2- 172.21.15.111:0/3352078981 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb06c100d50 0x7fb06c196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:47.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.954+0000 7fb070c00700 1 -- 172.21.15.111:0/3352078981 >> 172.21.15.111:0/3352078981 conn(0x7fb06c0fbc30 msgr2=0x7fb06c0fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:47.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.954+0000 7fb070c00700 1 -- 172.21.15.111:0/3352078981 shutdown_connections 2024-09-11T00:17:47.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:17:47.954+0000 7fb070c00700 1 -- 172.21.15.111:0/3352078981 wait complete. 2024-09-11T00:17:48.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:48 smithi111 ceph-mon[90842]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:17:48.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:48 smithi111 ceph-mon[90842]: pgmap v193: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:48.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:48 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/3352078981' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-11T00:17:48.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:48 smithi203 ceph-mon[69002]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:17:48.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:48 smithi203 ceph-mon[69002]: pgmap v193: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:48.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:48 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/3352078981' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-11T00:17:49.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:49 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:49.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:49 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:49.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:49 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:17:49.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:49 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:17:49.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:49 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:49.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:49 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:17:49.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:49 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:17:49.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:49 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:17:49.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:49 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:17:49.796 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:49 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:17:49.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:49 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:49.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:49 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:49.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:49 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:17:49.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:49 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:17:49.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:49 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:49.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:49 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:17:49.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:49 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:17:49.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:49 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:17:49.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:49 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:17:49.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:49 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:17:50.789 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:50 smithi111 ceph-mon[90842]: pgmap v194: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:50.789 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:50 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:50.789 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:50 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.rucaba", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:17:50.789 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:50 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:17:50.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:50 smithi203 ceph-mon[69002]: pgmap v194: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:50.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:50 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:50.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:50 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.rucaba", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:17:50.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:50 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:17:51.750 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:51 smithi111 ceph-mon[90842]: Upgrade: Updating mds.cephfs.smithi111.rucaba 2024-09-11T00:17:51.750 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:51 smithi111 ceph-mon[90842]: Deploying daemon mds.cephfs.smithi111.rucaba on smithi111 2024-09-11T00:17:51.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:51 smithi203 ceph-mon[69002]: Upgrade: Updating mds.cephfs.smithi111.rucaba 2024-09-11T00:17:51.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:51 smithi203 ceph-mon[69002]: Deploying daemon mds.cephfs.smithi111.rucaba on smithi111 2024-09-11T00:17:52.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:52 smithi203 ceph-mon[69002]: pgmap v195: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:52.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:52 smithi111 ceph-mon[90842]: pgmap v195: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:53.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:53 smithi203 ceph-mon[69002]: osdmap e82: 6 total, 6 up, 6 in 2024-09-11T00:17:53.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:53 smithi203 ceph-mon[69002]: fsmap cephfs:1 {0=cephfs.smithi203.tcrqop=up:active} 2 up:standby 2024-09-11T00:17:53.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:53 smithi111 ceph-mon[90842]: osdmap e82: 6 total, 6 up, 6 in 2024-09-11T00:17:53.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:53 smithi111 ceph-mon[90842]: fsmap cephfs:1 {0=cephfs.smithi203.tcrqop=up:active} 2 up:standby 2024-09-11T00:17:54.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:54 smithi203 ceph-mon[69002]: pgmap v197: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:54.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:54 smithi111 ceph-mon[90842]: pgmap v197: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:55.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:55 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mds metadata", "who": "cephfs.smithi111.rucaba"} : dispatch 2024-09-11T00:17:56.027 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:55 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mds metadata", "who": "cephfs.smithi111.rucaba"} : dispatch 2024-09-11T00:17:56.722 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:56 smithi111 ceph-mon[90842]: pgmap v198: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:57.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:56 smithi203 ceph-mon[69002]: pgmap v198: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:59.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:58 smithi203 ceph-mon[69002]: pgmap v199: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:59.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:58 smithi203 ceph-mon[69002]: mds.? [v2:172.21.15.111:6828/36584465,v1:172.21.15.111:6829/36584465] up:boot 2024-09-11T00:17:59.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:58 smithi203 ceph-mon[69002]: fsmap cephfs:1 {0=cephfs.smithi203.tcrqop=up:active} 3 up:standby 2024-09-11T00:17:59.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:58 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mds metadata", "who": "cephfs.smithi111.rucaba"} : dispatch 2024-09-11T00:17:59.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:58 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:59.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:58 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:59.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:17:58 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:17:59.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:58 smithi111 ceph-mon[90842]: pgmap v199: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:17:59.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:58 smithi111 ceph-mon[90842]: mds.? [v2:172.21.15.111:6828/36584465,v1:172.21.15.111:6829/36584465] up:boot 2024-09-11T00:17:59.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:58 smithi111 ceph-mon[90842]: fsmap cephfs:1 {0=cephfs.smithi203.tcrqop=up:active} 3 up:standby 2024-09-11T00:17:59.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:58 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mds metadata", "who": "cephfs.smithi111.rucaba"} : dispatch 2024-09-11T00:17:59.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:58 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:59.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:58 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:17:59.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:17:58 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:18:00.727 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:00 smithi111 ceph-mon[90842]: pgmap v200: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:18:00.728 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:00 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:18:01.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:00 smithi203 ceph-mon[69002]: pgmap v200: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:18:01.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:00 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:18:03.005 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:02 smithi111 ceph-mon[90842]: pgmap v201: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:18:03.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:02 smithi203 ceph-mon[69002]: pgmap v201: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:18:05.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:04 smithi203 ceph-mon[69002]: pgmap v202: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:18:05.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:04 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:05.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:04 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:05.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:04 smithi111 ceph-mon[90842]: pgmap v202: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:18:05.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:04 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:05.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:04 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:06.141 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:05 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:06.141 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:05 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:06.141 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:05 smithi203 ceph-mon[69002]: pgmap v203: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:18:06.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:05 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:06.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:05 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:06.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:05 smithi111 ceph-mon[90842]: pgmap v203: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:18:08.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:08 smithi111 ceph-mon[90842]: pgmap v204: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:18:09.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:08 smithi203 ceph-mon[69002]: pgmap v204: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:18:09.975 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:09 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:09.975 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:09 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:09.975 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:09 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:18:09.975 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:09 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:18:09.976 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:09 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:09.976 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:09 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:18:09.976 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:09 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:18:09.976 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:09 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:18:09.976 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:09 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:18:09.976 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:09 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:18:09.976 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:09 smithi203 ceph-mon[69002]: pgmap v205: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:18:10.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:09 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:10.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:09 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:10.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:09 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:18:10.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:09 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:18:10.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:09 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:10.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:09 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:18:10.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:09 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:18:10.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:09 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:18:10.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:09 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:18:10.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:09 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:18:10.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:09 smithi111 ceph-mon[90842]: pgmap v205: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:18:12.144 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:11 smithi203 ceph-mon[69002]: Upgrade: Updating mds.cephfs.smithi203.tcrqop 2024-09-11T00:18:12.145 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:11 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:12.145 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:11 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.tcrqop", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:18:12.145 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:11 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:18:12.145 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:11 smithi203 ceph-mon[69002]: Deploying daemon mds.cephfs.smithi203.tcrqop on smithi203 2024-09-11T00:18:12.145 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:11 smithi203 ceph-mon[69002]: pgmap v206: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:18:12.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:11 smithi111 ceph-mon[90842]: Upgrade: Updating mds.cephfs.smithi203.tcrqop 2024-09-11T00:18:12.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:11 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:12.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:11 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.tcrqop", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:18:12.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:11 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:18:12.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:11 smithi111 ceph-mon[90842]: Deploying daemon mds.cephfs.smithi203.tcrqop on smithi203 2024-09-11T00:18:12.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:11 smithi111 ceph-mon[90842]: pgmap v206: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:18:13.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:13 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi111[90838]: 2024-09-11T00:18:13.237+0000 7f2864200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T00:18:13.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:13 smithi111 ceph-mon[90842]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T00:18:13.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:13 smithi111 ceph-mon[90842]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T00:18:13.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:13 smithi111 ceph-mon[90842]: osdmap e83: 6 total, 6 up, 6 in 2024-09-11T00:18:13.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:13 smithi111 ceph-mon[90842]: Standby daemon mds.cephfs.smithi203.uqkbkn assigned to filesystem cephfs as rank 0 2024-09-11T00:18:13.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:13 smithi111 ceph-mon[90842]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T00:18:13.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:13 smithi111 ceph-mon[90842]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-11T00:18:13.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:13 smithi111 ceph-mon[90842]: fsmap cephfs:1/1 {0=cephfs.smithi203.uqkbkn=up:replay} 2 up:standby 2024-09-11T00:18:13.505 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:13 smithi203 ceph-mon[69002]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T00:18:13.505 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:13 smithi203 ceph-mon[69002]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T00:18:13.505 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:13 smithi203 ceph-mon[69002]: osdmap e83: 6 total, 6 up, 6 in 2024-09-11T00:18:13.505 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:13 smithi203 ceph-mon[69002]: Standby daemon mds.cephfs.smithi203.uqkbkn assigned to filesystem cephfs as rank 0 2024-09-11T00:18:13.505 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:13 smithi203 ceph-mon[69002]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T00:18:13.505 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:13 smithi203 ceph-mon[69002]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-11T00:18:13.505 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:13 smithi203 ceph-mon[69002]: fsmap cephfs:1/1 {0=cephfs.smithi203.uqkbkn=up:replay} 2 up:standby 2024-09-11T00:18:14.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:14 smithi111 ceph-mon[90842]: pgmap v208: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 410 KiB/s rd, 0 op/s 2024-09-11T00:18:14.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:14 smithi203 ceph-mon[69002]: pgmap v208: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 410 KiB/s rd, 0 op/s 2024-09-11T00:18:16.257 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:15 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:16.258 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:15 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:18:16.258 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:15 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mds metadata", "who": "cephfs.smithi203.tcrqop"} : dispatch 2024-09-11T00:18:16.258 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:15 smithi203 ceph-mon[69002]: pgmap v209: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.0 MiB/s rd, 2 op/s 2024-09-11T00:18:16.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:15 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:16.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:15 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:18:16.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:15 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mds metadata", "who": "cephfs.smithi203.tcrqop"} : dispatch 2024-09-11T00:18:16.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:15 smithi111 ceph-mon[90842]: pgmap v209: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.0 MiB/s rd, 2 op/s 2024-09-11T00:18:18.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.133+0000 7fdbb2e00700 1 -- 172.21.15.111:0/2110067994 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdbac1003b0 msgr2=0x7fdbac100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:18.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.133+0000 7fdbb2e00700 1 --2- 172.21.15.111:0/2110067994 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdbac1003b0 0x7fdbac100780 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009910 tx=0x7fdb9c009c20 comp rx=0 tx=0).stop 2024-09-11T00:18:18.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.133+0000 7fdbb2e00700 1 -- 172.21.15.111:0/2110067994 shutdown_connections 2024-09-11T00:18:18.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.133+0000 7fdbb2e00700 1 --2- 172.21.15.111:0/2110067994 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdbac100d50 0x7fdbac104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:18.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.133+0000 7fdbb2e00700 1 --2- 172.21.15.111:0/2110067994 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdbac1003b0 0x7fdbac100780 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:18.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.133+0000 7fdbb2e00700 1 -- 172.21.15.111:0/2110067994 >> 172.21.15.111:0/2110067994 conn(0x7fdbac0fbc30 msgr2=0x7fdbac0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:18.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.133+0000 7fdbb2e00700 1 -- 172.21.15.111:0/2110067994 shutdown_connections 2024-09-11T00:18:18.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.134+0000 7fdbb2e00700 1 -- 172.21.15.111:0/2110067994 wait complete. 2024-09-11T00:18:18.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.134+0000 7fdbb2e00700 1 Processor -- start 2024-09-11T00:18:18.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.135+0000 7fdbb2e00700 1 -- start start 2024-09-11T00:18:18.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.135+0000 7fdbb2e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdbac1003b0 0x7fdbac197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:18.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.135+0000 7fdbb2e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdbac100d50 0x7fdbac1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:18.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.135+0000 7fdbb2e00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac198bc0 con 0x7fdbac100d50 2024-09-11T00:18:18.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.135+0000 7fdbb2e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac19c950 con 0x7fdbac1003b0 2024-09-11T00:18:18.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.135+0000 7fdbab400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdbac100d50 0x7fdbac1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:18.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.135+0000 7fdbab400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdbac100d50 0x7fdbac1984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:34728/0 (socket says 172.21.15.111:34728) 2024-09-11T00:18:18.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.135+0000 7fdbabe00700 1 --2- 172.21.15.111:0/2561908205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdbac1003b0 0x7fdbac197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:18.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.135+0000 7fdbab400700 1 -- 172.21.15.111:0/2561908205 learned_addr learned my addr 172.21.15.111:0/2561908205 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:18:18.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.136+0000 7fdbab400700 1 -- 172.21.15.111:0/2561908205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdbac1003b0 msgr2=0x7fdbac197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:18.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.136+0000 7fdbab400700 1 --2- 172.21.15.111:0/2561908205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdbac1003b0 0x7fdbac197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:18.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.136+0000 7fdbab400700 1 -- 172.21.15.111:0/2561908205 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9c0095f0 con 0x7fdbac100d50 2024-09-11T00:18:18.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.136+0000 7fdbabe00700 1 --2- 172.21.15.111:0/2561908205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdbac1003b0 0x7fdbac197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:18:18.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.136+0000 7fdbab400700 1 --2- 172.21.15.111:0/2561908205 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdbac100d50 0x7fdbac1984e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdb9800e8f0 tx=0x7fdb9800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:18.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.136+0000 7fdba8c00700 1 -- 172.21.15.111:0/2561908205 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb98009790 con 0x7fdbac100d50 2024-09-11T00:18:18.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.136+0000 7fdba8c00700 1 -- 172.21.15.111:0/2561908205 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdb9800c810 con 0x7fdbac100d50 2024-09-11T00:18:18.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.136+0000 7fdbb2e00700 1 -- 172.21.15.111:0/2561908205 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbac19cc30 con 0x7fdbac100d50 2024-09-11T00:18:18.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.136+0000 7fdba8c00700 1 -- 172.21.15.111:0/2561908205 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb98005580 con 0x7fdbac100d50 2024-09-11T00:18:18.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.136+0000 7fdbb2e00700 1 -- 172.21.15.111:0/2561908205 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbac19d180 con 0x7fdbac100d50 2024-09-11T00:18:18.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.138+0000 7fdbb2e00700 1 -- 172.21.15.111:0/2561908205 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbac1044a0 con 0x7fdbac100d50 2024-09-11T00:18:18.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.139+0000 7fdba8c00700 1 -- 172.21.15.111:0/2561908205 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fdb9800c980 con 0x7fdbac100d50 2024-09-11T00:18:18.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.140+0000 7fdba8c00700 1 --2- 172.21.15.111:0/2561908205 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fdb9007a6f0 0x7fdb9007cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:18.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.140+0000 7fdba8c00700 1 -- 172.21.15.111:0/2561908205 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fdb98014070 con 0x7fdbac100d50 2024-09-11T00:18:18.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.140+0000 7fdbabe00700 1 --2- 172.21.15.111:0/2561908205 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fdb9007a6f0 0x7fdb9007cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:18.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.141+0000 7fdbabe00700 1 --2- 172.21.15.111:0/2561908205 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fdb9007a6f0 0x7fdb9007cba0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c00b760 tx=0x7fdb9c005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:18.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.145+0000 7fdba8c00700 1 -- 172.21.15.111:0/2561908205 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fdb98060c70 con 0x7fdbac100d50 2024-09-11T00:18:18.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.401+0000 7fdbb2e00700 1 -- 172.21.15.111:0/2561908205 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdbac19d4c0 con 0x7fdb9007a6f0 2024-09-11T00:18:18.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.403+0000 7fdba8c00700 1 -- 172.21.15.111:0/2561908205 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fdbac19d4c0 con 0x7fdb9007a6f0 2024-09-11T00:18:18.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.405+0000 7fdbb2e00700 1 -- 172.21.15.111:0/2561908205 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fdb9007a6f0 msgr2=0x7fdb9007cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:18.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.405+0000 7fdbb2e00700 1 --2- 172.21.15.111:0/2561908205 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fdb9007a6f0 0x7fdb9007cba0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c00b760 tx=0x7fdb9c005a90 comp rx=0 tx=0).stop 2024-09-11T00:18:18.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.405+0000 7fdbb2e00700 1 -- 172.21.15.111:0/2561908205 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdbac100d50 msgr2=0x7fdbac1984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:18.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.405+0000 7fdbb2e00700 1 --2- 172.21.15.111:0/2561908205 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdbac100d50 0x7fdbac1984e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdb9800e8f0 tx=0x7fdb9800ec00 comp rx=0 tx=0).stop 2024-09-11T00:18:18.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.405+0000 7fdbb2e00700 1 -- 172.21.15.111:0/2561908205 shutdown_connections 2024-09-11T00:18:18.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.405+0000 7fdbb2e00700 1 --2- 172.21.15.111:0/2561908205 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fdb9007a6f0 0x7fdb9007cba0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:18.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.405+0000 7fdbb2e00700 1 --2- 172.21.15.111:0/2561908205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdbac1003b0 0x7fdbac197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:18.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.405+0000 7fdbb2e00700 1 --2- 172.21.15.111:0/2561908205 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdbac100d50 0x7fdbac1984e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:18.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.405+0000 7fdbb2e00700 1 -- 172.21.15.111:0/2561908205 >> 172.21.15.111:0/2561908205 conn(0x7fdbac0fbc30 msgr2=0x7fdbac0fd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:18.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.405+0000 7fdbb2e00700 1 -- 172.21.15.111:0/2561908205 shutdown_connections 2024-09-11T00:18:18.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.406+0000 7fdbb2e00700 1 -- 172.21.15.111:0/2561908205 wait complete. 2024-09-11T00:18:18.421 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:18:18.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.547+0000 7f3f7b600700 1 -- 172.21.15.111:0/470261886 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3f74102fa0 msgr2=0x7f3f74106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:18.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.547+0000 7f3f7b600700 1 --2- 172.21.15.111:0/470261886 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3f74102fa0 0x7f3f74106f70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3f60009910 tx=0x7f3f60009c20 comp rx=0 tx=0).stop 2024-09-11T00:18:18.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.547+0000 7f3f7b600700 1 -- 172.21.15.111:0/470261886 shutdown_connections 2024-09-11T00:18:18.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.547+0000 7f3f7b600700 1 --2- 172.21.15.111:0/470261886 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3f74102fa0 0x7f3f74106f70 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:18.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.547+0000 7f3f7b600700 1 --2- 172.21.15.111:0/470261886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3f74102600 0x7f3f741029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:18.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.547+0000 7f3f7b600700 1 -- 172.21.15.111:0/470261886 >> 172.21.15.111:0/470261886 conn(0x7f3f740fdec0 msgr2=0x7f3f741002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:18.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.547+0000 7f3f7b600700 1 -- 172.21.15.111:0/470261886 shutdown_connections 2024-09-11T00:18:18.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.547+0000 7f3f7b600700 1 -- 172.21.15.111:0/470261886 wait complete. 2024-09-11T00:18:18.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.548+0000 7f3f7b600700 1 Processor -- start 2024-09-11T00:18:18.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.548+0000 7f3f7b600700 1 -- start start 2024-09-11T00:18:18.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.548+0000 7f3f7b600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3f74102600 0x7f3f74197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:18.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.548+0000 7f3f7b600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3f74102fa0 0x7f3f74198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:18.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.548+0000 7f3f7b600700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f74198c10 con 0x7f3f74102fa0 2024-09-11T00:18:18.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.548+0000 7f3f7b600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7419c9a0 con 0x7f3f74102600 2024-09-11T00:18:18.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.549+0000 7f3f78c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3f74102600 0x7f3f74197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:18.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.549+0000 7f3f73e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3f74102fa0 0x7f3f74198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:18.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.549+0000 7f3f78c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3f74102600 0x7f3f74197ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.111:38052/0 (socket says 172.21.15.111:38052) 2024-09-11T00:18:18.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.549+0000 7f3f78c00700 1 -- 172.21.15.111:0/2578312399 learned_addr learned my addr 172.21.15.111:0/2578312399 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:18:18.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.549+0000 7f3f73e00700 1 -- 172.21.15.111:0/2578312399 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3f74102600 msgr2=0x7f3f74197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:18.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.549+0000 7f3f73e00700 1 --2- 172.21.15.111:0/2578312399 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3f74102600 0x7f3f74197ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:18.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.549+0000 7f3f73e00700 1 -- 172.21.15.111:0/2578312399 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f600095f0 con 0x7f3f74102fa0 2024-09-11T00:18:18.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.549+0000 7f3f73e00700 1 --2- 172.21.15.111:0/2578312399 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3f74102fa0 0x7f3f74198530 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3f74074a50 tx=0x7f3f6000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:18.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.550+0000 7f3f71600700 1 -- 172.21.15.111:0/2578312399 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f6001d070 con 0x7f3f74102fa0 2024-09-11T00:18:18.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.550+0000 7f3f71600700 1 -- 172.21.15.111:0/2578312399 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3f60005dc0 con 0x7f3f74102fa0 2024-09-11T00:18:18.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.550+0000 7f3f7b600700 1 -- 172.21.15.111:0/2578312399 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f7419cc20 con 0x7f3f74102fa0 2024-09-11T00:18:18.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.550+0000 7f3f71600700 1 -- 172.21.15.111:0/2578312399 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f6000fe80 con 0x7f3f74102fa0 2024-09-11T00:18:18.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.550+0000 7f3f7b600700 1 -- 172.21.15.111:0/2578312399 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f7419d110 con 0x7f3f74102fa0 2024-09-11T00:18:18.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.551+0000 7f3f7b600700 1 -- 172.21.15.111:0/2578312399 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f7404ea50 con 0x7f3f74102fa0 2024-09-11T00:18:18.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.552+0000 7f3f71600700 1 -- 172.21.15.111:0/2578312399 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f3f6000f6f0 con 0x7f3f74102fa0 2024-09-11T00:18:18.554 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.553+0000 7f3f71600700 1 --2- 172.21.15.111:0/2578312399 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f3f5c07a6f0 0x7f3f5c07cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:18.554 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.553+0000 7f3f71600700 1 -- 172.21.15.111:0/2578312399 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f3f6009e5e0 con 0x7f3f74102fa0 2024-09-11T00:18:18.554 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.553+0000 7f3f78c00700 1 --2- 172.21.15.111:0/2578312399 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f3f5c07a6f0 0x7f3f5c07cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:18.554 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.554+0000 7f3f78c00700 1 --2- 172.21.15.111:0/2578312399 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f3f5c07a6f0 0x7f3f5c07cba0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3f68005950 tx=0x7f3f6800b500 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:18.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.557+0000 7f3f71600700 1 -- 172.21.15.111:0/2578312399 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f3f60061d00 con 0x7f3f74102fa0 2024-09-11T00:18:18.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.801+0000 7f3f7b600700 1 -- 172.21.15.111:0/2578312399 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f7419d5f0 con 0x7f3f5c07a6f0 2024-09-11T00:18:18.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.803+0000 7f3f71600700 1 -- 172.21.15.111:0/2578312399 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3f7419d5f0 con 0x7f3f5c07a6f0 2024-09-11T00:18:18.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.806+0000 7f3f7b600700 1 -- 172.21.15.111:0/2578312399 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f3f5c07a6f0 msgr2=0x7f3f5c07cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:18.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.806+0000 7f3f7b600700 1 --2- 172.21.15.111:0/2578312399 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f3f5c07a6f0 0x7f3f5c07cba0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3f68005950 tx=0x7f3f6800b500 comp rx=0 tx=0).stop 2024-09-11T00:18:18.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.806+0000 7f3f7b600700 1 -- 172.21.15.111:0/2578312399 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3f74102fa0 msgr2=0x7f3f74198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:18.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.806+0000 7f3f7b600700 1 --2- 172.21.15.111:0/2578312399 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3f74102fa0 0x7f3f74198530 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3f74074a50 tx=0x7f3f6000bd70 comp rx=0 tx=0).stop 2024-09-11T00:18:18.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.806+0000 7f3f7b600700 1 -- 172.21.15.111:0/2578312399 shutdown_connections 2024-09-11T00:18:18.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.806+0000 7f3f7b600700 1 --2- 172.21.15.111:0/2578312399 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f3f5c07a6f0 0x7f3f5c07cba0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:18.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.806+0000 7f3f7b600700 1 --2- 172.21.15.111:0/2578312399 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3f74102600 0x7f3f74197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:18.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.806+0000 7f3f7b600700 1 --2- 172.21.15.111:0/2578312399 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3f74102fa0 0x7f3f74198530 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:18.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.806+0000 7f3f7b600700 1 -- 172.21.15.111:0/2578312399 >> 172.21.15.111:0/2578312399 conn(0x7f3f740fdec0 msgr2=0x7f3f740ff4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:18.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.806+0000 7f3f7b600700 1 -- 172.21.15.111:0/2578312399 shutdown_connections 2024-09-11T00:18:18.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.806+0000 7f3f7b600700 1 -- 172.21.15.111:0/2578312399 wait complete. 2024-09-11T00:18:18.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.943+0000 7f7b26000700 1 -- 172.21.15.111:0/1531991451 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b20102df0 msgr2=0x7f7b20106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:18.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.943+0000 7f7b26000700 1 --2- 172.21.15.111:0/1531991451 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b20102df0 0x7f7b20106dc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c009910 tx=0x7f7b0c009c20 comp rx=0 tx=0).stop 2024-09-11T00:18:18.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.943+0000 7f7b26000700 1 -- 172.21.15.111:0/1531991451 shutdown_connections 2024-09-11T00:18:18.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.943+0000 7f7b26000700 1 --2- 172.21.15.111:0/1531991451 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b20102df0 0x7f7b20106dc0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:18.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.943+0000 7f7b26000700 1 --2- 172.21.15.111:0/1531991451 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b20102450 0x7f7b20102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:18.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.943+0000 7f7b26000700 1 -- 172.21.15.111:0/1531991451 >> 172.21.15.111:0/1531991451 conn(0x7f7b200fdd30 msgr2=0x7f7b20100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:18.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.943+0000 7f7b26000700 1 -- 172.21.15.111:0/1531991451 shutdown_connections 2024-09-11T00:18:18.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.943+0000 7f7b26000700 1 -- 172.21.15.111:0/1531991451 wait complete. 2024-09-11T00:18:18.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.944+0000 7f7b26000700 1 Processor -- start 2024-09-11T00:18:18.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.944+0000 7f7b26000700 1 -- start start 2024-09-11T00:18:18.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.944+0000 7f7b26000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b20102450 0x7f7b20197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:18.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.944+0000 7f7b26000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b20102df0 0x7f7b201982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:18.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.944+0000 7f7b26000700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b201989a0 con 0x7f7b20102df0 2024-09-11T00:18:18.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.944+0000 7f7b26000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2019c730 con 0x7f7b20102450 2024-09-11T00:18:18.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.945+0000 7f7b24c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b20102450 0x7f7b20197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:18.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.945+0000 7f7b1fe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b20102df0 0x7f7b201982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:18.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.945+0000 7f7b24c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b20102450 0x7f7b20197d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.111:38072/0 (socket says 172.21.15.111:38072) 2024-09-11T00:18:18.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.945+0000 7f7b24c00700 1 -- 172.21.15.111:0/1352032700 learned_addr learned my addr 172.21.15.111:0/1352032700 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:18:18.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.945+0000 7f7b1fe00700 1 -- 172.21.15.111:0/1352032700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b20102450 msgr2=0x7f7b20197d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:18.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.945+0000 7f7b1fe00700 1 --2- 172.21.15.111:0/1352032700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b20102450 0x7f7b20197d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:18.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.945+0000 7f7b1fe00700 1 -- 172.21.15.111:0/1352032700 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0c0095f0 con 0x7f7b20102df0 2024-09-11T00:18:18.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.946+0000 7f7b1fe00700 1 --2- 172.21.15.111:0/1352032700 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b20102df0 0x7f7b201982c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c006010 tx=0x7f7b0c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:18.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.946+0000 7f7b1d600700 1 -- 172.21.15.111:0/1352032700 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b0c01d070 con 0x7f7b20102df0 2024-09-11T00:18:18.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.946+0000 7f7b1d600700 1 -- 172.21.15.111:0/1352032700 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7b0c00b610 con 0x7f7b20102df0 2024-09-11T00:18:18.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.946+0000 7f7b26000700 1 -- 172.21.15.111:0/1352032700 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b2019c9b0 con 0x7f7b20102df0 2024-09-11T00:18:18.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.946+0000 7f7b1d600700 1 -- 172.21.15.111:0/1352032700 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b0c022470 con 0x7f7b20102df0 2024-09-11T00:18:18.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.946+0000 7f7b26000700 1 -- 172.21.15.111:0/1352032700 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b2019ce70 con 0x7f7b20102df0 2024-09-11T00:18:18.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.947+0000 7f7b26000700 1 -- 172.21.15.111:0/1352032700 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b2004f2a0 con 0x7f7b20102df0 2024-09-11T00:18:18.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.948+0000 7f7b1d600700 1 -- 172.21.15.111:0/1352032700 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f7b0c0050d0 con 0x7f7b20102df0 2024-09-11T00:18:18.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.949+0000 7f7b1d600700 1 --2- 172.21.15.111:0/1352032700 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f7b0807a6f0 0x7f7b0807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:18.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.949+0000 7f7b1d600700 1 -- 172.21.15.111:0/1352032700 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f7b0c09e7a0 con 0x7f7b20102df0 2024-09-11T00:18:18.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.950+0000 7f7b24c00700 1 --2- 172.21.15.111:0/1352032700 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f7b0807a6f0 0x7f7b0807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:18.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.950+0000 7f7b24c00700 1 --2- 172.21.15.111:0/1352032700 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f7b0807a6f0 0x7f7b0807cba0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009d20 tx=0x7f7b14009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:18.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:18.953+0000 7f7b1d600700 1 -- 172.21.15.111:0/1352032700 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f7b0c061ec0 con 0x7f7b20102df0 2024-09-11T00:18:19.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:18 smithi203 ceph-mon[69002]: pgmap v210: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 8.4 MiB/s rd, 3 op/s 2024-09-11T00:18:19.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:18 smithi111 ceph-mon[90842]: pgmap v210: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 8.4 MiB/s rd, 3 op/s 2024-09-11T00:18:19.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.186+0000 7f7b26000700 1 -- 172.21.15.111:0/1352032700 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b2019d370 con 0x7f7b0807a6f0 2024-09-11T00:18:19.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.195+0000 7f7b1d600700 1 -- 172.21.15.111:0/1352032700 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f7b2019d370 con 0x7f7b0807a6f0 2024-09-11T00:18:19.197 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:18:19.197 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (7m) 15s ago 21m 15.5M - 0.27.0 11f11916f8cd d6d3253e881f 2024-09-11T00:18:19.197 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (10m) 15s ago 21m 8644k - 18.2.0 dc2bc1663786 7c40af85314c 2024-09-11T00:18:19.197 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi203 smithi203 running (10m) 56s ago 20m 8682k - 18.2.0 dc2bc1663786 922e3261ff70 2024-09-11T00:18:19.197 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (4m) 15s ago 21m 6899k - 19.3.0-4854-g8f219c47 589dd18248e4 a9cacdb9a638 2024-09-11T00:18:19.197 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi203 smithi203 running (4m) 56s ago 20m 6899k - 19.3.0-4854-g8f219c47 589dd18248e4 d452d9dfa04b 2024-09-11T00:18:19.197 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (7m) 15s ago 21m 68.1M - c8b91775d855 7d3b50b5b59f 2024-09-11T00:18:19.197 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.gmgsay smithi111 running (42s) 15s ago 14m 12.4M - 19.3.0-4854-g8f219c47 589dd18248e4 a8cff96fcbbe 2024-09-11T00:18:19.197 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.rucaba smithi111 running (21s) 15s ago 14m 11.9M - 19.3.0-4854-g8f219c47 589dd18248e4 63a1d760686d 2024-09-11T00:18:19.197 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.tcrqop smithi203 running (14m) 56s ago 14m 150M - 18.2.0 dc2bc1663786 4df492159bb4 2024-09-11T00:18:19.197 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.uqkbkn smithi203 running (14m) 56s ago 14m 19.1M - 18.2.0 dc2bc1663786 619aa58ea314 2024-09-11T00:18:19.198 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.ypucji smithi111 *:8443,9283,8765 running (10m) 15s ago 23m 518M - 19.3.0-4854-g8f219c47 589dd18248e4 07fa31f49618 2024-09-11T00:18:19.198 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi203.smuspl smithi203 *:8443,9283,8765 running (9m) 56s ago 20m 456M - 19.3.0-4854-g8f219c47 589dd18248e4 7e5a93a5ffa7 2024-09-11T00:18:19.198 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (5m) 15s ago 23m 55.2M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 3c29c070a612 2024-09-11T00:18:19.198 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi203 smithi203 running (5m) 56s ago 20m 43.2M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 45e8285e4b4d 2024-09-11T00:18:19.198 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (8m) 15s ago 21m 8418k - 1.7.0 72c9c2088986 ec478ea14488 2024-09-11T00:18:19.198 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi203 smithi203 *:9100 running (8m) 56s ago 20m 8132k - 1.7.0 72c9c2088986 54d461cde1bc 2024-09-11T00:18:19.198 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (4m) 15s ago 18m 94.0M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 d2f1a2312736 2024-09-11T00:18:19.198 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (3m) 15s ago 18m 94.9M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 19cf95ecca7d 2024-09-11T00:18:19.198 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (2m) 15s ago 17m 77.0M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 3a3b318b337a 2024-09-11T00:18:19.198 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi203 running (2m) 56s ago 17m 93.1M 2240M 19.3.0-4854-g8f219c47 589dd18248e4 288c7e8ae34b 2024-09-11T00:18:19.198 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi203 running (97s) 56s ago 16m 90.4M 2240M 19.3.0-4854-g8f219c47 589dd18248e4 485f82d3eafb 2024-09-11T00:18:19.198 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi203 running (60s) 56s ago 16m 10.4M 2240M 19.3.0-4854-g8f219c47 589dd18248e4 ef4834f3adf1 2024-09-11T00:18:19.198 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (8m) 15s ago 20m 63.6M - 2.51.0 1d3b7f56885b 3e72ac10983d 2024-09-11T00:18:19.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.198+0000 7f7b26000700 1 -- 172.21.15.111:0/1352032700 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f7b0807a6f0 msgr2=0x7f7b0807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:19.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.198+0000 7f7b26000700 1 --2- 172.21.15.111:0/1352032700 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f7b0807a6f0 0x7f7b0807cba0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009d20 tx=0x7f7b14009260 comp rx=0 tx=0).stop 2024-09-11T00:18:19.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.198+0000 7f7b26000700 1 -- 172.21.15.111:0/1352032700 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b20102df0 msgr2=0x7f7b201982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:19.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.198+0000 7f7b26000700 1 --2- 172.21.15.111:0/1352032700 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b20102df0 0x7f7b201982c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c006010 tx=0x7f7b0c00f690 comp rx=0 tx=0).stop 2024-09-11T00:18:19.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.198+0000 7f7b26000700 1 -- 172.21.15.111:0/1352032700 shutdown_connections 2024-09-11T00:18:19.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.198+0000 7f7b26000700 1 --2- 172.21.15.111:0/1352032700 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f7b0807a6f0 0x7f7b0807cba0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:19.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.198+0000 7f7b26000700 1 --2- 172.21.15.111:0/1352032700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b20102450 0x7f7b20197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:19.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.198+0000 7f7b26000700 1 --2- 172.21.15.111:0/1352032700 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b20102df0 0x7f7b201982c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:19.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.198+0000 7f7b26000700 1 -- 172.21.15.111:0/1352032700 >> 172.21.15.111:0/1352032700 conn(0x7f7b200fdd30 msgr2=0x7f7b200ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:19.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.198+0000 7f7b26000700 1 -- 172.21.15.111:0/1352032700 shutdown_connections 2024-09-11T00:18:19.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.198+0000 7f7b26000700 1 -- 172.21.15.111:0/1352032700 wait complete. 2024-09-11T00:18:19.334 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.333+0000 7fc315600700 1 -- 172.21.15.111:0/394537908 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc310102fb0 msgr2=0x7fc310106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:19.334 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.333+0000 7fc315600700 1 --2- 172.21.15.111:0/394537908 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc310102fb0 0x7fc310106f80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc009910 tx=0x7fc2fc009c20 comp rx=0 tx=0).stop 2024-09-11T00:18:19.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.333+0000 7fc315600700 1 -- 172.21.15.111:0/394537908 shutdown_connections 2024-09-11T00:18:19.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.333+0000 7fc315600700 1 --2- 172.21.15.111:0/394537908 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc310102fb0 0x7fc310106f80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:19.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.333+0000 7fc315600700 1 --2- 172.21.15.111:0/394537908 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc310102610 0x7fc3101029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:19.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.333+0000 7fc315600700 1 -- 172.21.15.111:0/394537908 >> 172.21.15.111:0/394537908 conn(0x7fc3100fde90 msgr2=0x7fc3101002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:19.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.333+0000 7fc315600700 1 -- 172.21.15.111:0/394537908 shutdown_connections 2024-09-11T00:18:19.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.333+0000 7fc315600700 1 -- 172.21.15.111:0/394537908 wait complete. 2024-09-11T00:18:19.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.334+0000 7fc315600700 1 Processor -- start 2024-09-11T00:18:19.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.334+0000 7fc315600700 1 -- start start 2024-09-11T00:18:19.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.335+0000 7fc315600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc310102610 0x7fc310197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:19.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.335+0000 7fc315600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc310102fb0 0x7fc310198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:19.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.335+0000 7fc315600700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc310198c00 con 0x7fc310102fb0 2024-09-11T00:18:19.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.335+0000 7fc315600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31019c990 con 0x7fc310102610 2024-09-11T00:18:19.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.335+0000 7fc30e000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc310102fb0 0x7fc310198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:19.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.335+0000 7fc30ea00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc310102610 0x7fc310197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:19.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.335+0000 7fc30e000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc310102fb0 0x7fc310198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:34810/0 (socket says 172.21.15.111:34810) 2024-09-11T00:18:19.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.335+0000 7fc30e000700 1 -- 172.21.15.111:0/3953077713 learned_addr learned my addr 172.21.15.111:0/3953077713 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:18:19.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.335+0000 7fc30e000700 1 -- 172.21.15.111:0/3953077713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc310102610 msgr2=0x7fc310197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:19.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.335+0000 7fc30e000700 1 --2- 172.21.15.111:0/3953077713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc310102610 0x7fc310197fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:19.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.335+0000 7fc30e000700 1 -- 172.21.15.111:0/3953077713 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2fc0095f0 con 0x7fc310102fb0 2024-09-11T00:18:19.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.336+0000 7fc30e000700 1 --2- 172.21.15.111:0/3953077713 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc310102fb0 0x7fc310198520 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc005b40 tx=0x7fc2fc00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:19.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.336+0000 7fc307400700 1 -- 172.21.15.111:0/3953077713 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2fc01d070 con 0x7fc310102fb0 2024-09-11T00:18:19.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.336+0000 7fc307400700 1 -- 172.21.15.111:0/3953077713 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc2fc00bed0 con 0x7fc310102fb0 2024-09-11T00:18:19.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.336+0000 7fc315600700 1 -- 172.21.15.111:0/3953077713 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc31019cc10 con 0x7fc310102fb0 2024-09-11T00:18:19.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.336+0000 7fc307400700 1 -- 172.21.15.111:0/3953077713 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2fc003e70 con 0x7fc310102fb0 2024-09-11T00:18:19.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.336+0000 7fc315600700 1 -- 172.21.15.111:0/3953077713 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31019d100 con 0x7fc310102fb0 2024-09-11T00:18:19.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.337+0000 7fc315600700 1 -- 172.21.15.111:0/3953077713 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc31004ea50 con 0x7fc310102fb0 2024-09-11T00:18:19.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.339+0000 7fc307400700 1 -- 172.21.15.111:0/3953077713 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fc2fc0050d0 con 0x7fc310102fb0 2024-09-11T00:18:19.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.340+0000 7fc307400700 1 --2- 172.21.15.111:0/3953077713 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc2f407a6f0 0x7fc2f407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:19.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.340+0000 7fc307400700 1 -- 172.21.15.111:0/3953077713 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fc2fc09e4f0 con 0x7fc310102fb0 2024-09-11T00:18:19.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.340+0000 7fc30ea00700 1 --2- 172.21.15.111:0/3953077713 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc2f407a6f0 0x7fc2f407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:19.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.341+0000 7fc30ea00700 1 --2- 172.21.15.111:0/3953077713 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc2f407a6f0 0x7fc2f407cba0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc300009c60 tx=0x7fc300009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:19.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.344+0000 7fc307400700 1 -- 172.21.15.111:0/3953077713 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fc2fc061cb0 con 0x7fc310102fb0 2024-09-11T00:18:19.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.661+0000 7fc315600700 1 -- 172.21.15.111:0/3953077713 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc310199340 con 0x7fc310102fb0 2024-09-11T00:18:19.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.662+0000 7fc307400700 1 -- 172.21.15.111:0/3953077713 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+805 (secure 0 0 0) 0x7fc2fc064dd0 con 0x7fc310102fb0 2024-09-11T00:18:19.663 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:18:19.664 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-11T00:18:19.664 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:18:19.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:18:19.664 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-11T00:18:19.664 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:18:19.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:18:19.665 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-11T00:18:19.665 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 6 2024-09-11T00:18:19.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:18:19.665 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-11T00:18:19.665 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-09-11T00:18:19.665 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:18:19.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:18:19.665 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-11T00:18:19.665 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-09-11T00:18:19.665 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 12 2024-09-11T00:18:19.665 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-11T00:18:19.665 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:18:19.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.665+0000 7fc315600700 1 -- 172.21.15.111:0/3953077713 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc2f407a6f0 msgr2=0x7fc2f407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:19.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.665+0000 7fc315600700 1 --2- 172.21.15.111:0/3953077713 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc2f407a6f0 0x7fc2f407cba0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc300009c60 tx=0x7fc300009260 comp rx=0 tx=0).stop 2024-09-11T00:18:19.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.665+0000 7fc315600700 1 -- 172.21.15.111:0/3953077713 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc310102fb0 msgr2=0x7fc310198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:19.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.665+0000 7fc315600700 1 --2- 172.21.15.111:0/3953077713 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc310102fb0 0x7fc310198520 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc005b40 tx=0x7fc2fc00f690 comp rx=0 tx=0).stop 2024-09-11T00:18:19.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.665+0000 7fc315600700 1 -- 172.21.15.111:0/3953077713 shutdown_connections 2024-09-11T00:18:19.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.665+0000 7fc315600700 1 --2- 172.21.15.111:0/3953077713 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc2f407a6f0 0x7fc2f407cba0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:19.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.665+0000 7fc315600700 1 --2- 172.21.15.111:0/3953077713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc310102610 0x7fc310197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:19.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.665+0000 7fc315600700 1 --2- 172.21.15.111:0/3953077713 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc310102fb0 0x7fc310198520 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:19.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.665+0000 7fc315600700 1 -- 172.21.15.111:0/3953077713 >> 172.21.15.111:0/3953077713 conn(0x7fc3100fde90 msgr2=0x7fc3100ff460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:19.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.665+0000 7fc315600700 1 -- 172.21.15.111:0/3953077713 shutdown_connections 2024-09-11T00:18:19.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.665+0000 7fc315600700 1 -- 172.21.15.111:0/3953077713 wait complete. 2024-09-11T00:18:19.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.809+0000 7f9d5fe00700 1 -- 172.21.15.111:0/2427552426 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d60100ba0 msgr2=0x7f9d60104b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:19.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.809+0000 7f9d5fe00700 1 --2- 172.21.15.111:0/2427552426 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d60100ba0 0x7f9d60104b70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c009910 tx=0x7f9d4c009c20 comp rx=0 tx=0).stop 2024-09-11T00:18:19.811 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:19 smithi111 ceph-mon[90842]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:18:19.811 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:19 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/3953077713' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:18:19.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.809+0000 7f9d5fe00700 1 -- 172.21.15.111:0/2427552426 shutdown_connections 2024-09-11T00:18:19.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.809+0000 7f9d5fe00700 1 --2- 172.21.15.111:0/2427552426 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d60100ba0 0x7f9d60104b70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:19.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.809+0000 7f9d5fe00700 1 --2- 172.21.15.111:0/2427552426 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d60100200 0x7f9d601005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:19.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.809+0000 7f9d5fe00700 1 -- 172.21.15.111:0/2427552426 >> 172.21.15.111:0/2427552426 conn(0x7f9d600fba80 msgr2=0x7f9d600fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:19.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.809+0000 7f9d5fe00700 1 -- 172.21.15.111:0/2427552426 shutdown_connections 2024-09-11T00:18:19.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.810+0000 7f9d5fe00700 1 -- 172.21.15.111:0/2427552426 wait complete. 2024-09-11T00:18:19.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.810+0000 7f9d5fe00700 1 Processor -- start 2024-09-11T00:18:19.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.811+0000 7f9d5fe00700 1 -- start start 2024-09-11T00:18:19.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.811+0000 7f9d5fe00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d60100200 0x7f9d6019b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:19.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.811+0000 7f9d5fe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d60100ba0 0x7f9d6019bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:19.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.811+0000 7f9d5fe00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6019c590 con 0x7f9d60100ba0 2024-09-11T00:18:19.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.811+0000 7f9d5fe00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d60195a40 con 0x7f9d60100200 2024-09-11T00:18:19.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.811+0000 7f9d5e000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d60100ba0 0x7f9d6019bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:19.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.811+0000 7f9d5ea00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d60100200 0x7f9d6019b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:19.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.811+0000 7f9d5e000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d60100ba0 0x7f9d6019bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:34824/0 (socket says 172.21.15.111:34824) 2024-09-11T00:18:19.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.811+0000 7f9d5e000700 1 -- 172.21.15.111:0/1415158922 learned_addr learned my addr 172.21.15.111:0/1415158922 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:18:19.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.812+0000 7f9d5e000700 1 -- 172.21.15.111:0/1415158922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d60100200 msgr2=0x7f9d6019b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:19.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.812+0000 7f9d5e000700 1 --2- 172.21.15.111:0/1415158922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d60100200 0x7f9d6019b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:19.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.812+0000 7f9d5e000700 1 -- 172.21.15.111:0/1415158922 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4c0095f0 con 0x7f9d60100ba0 2024-09-11T00:18:19.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.812+0000 7f9d5e000700 1 --2- 172.21.15.111:0/1415158922 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d60100ba0 0x7f9d6019bf00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00bda0 tx=0x7f9d4c00bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:19.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.812+0000 7f9d57400700 1 -- 172.21.15.111:0/1415158922 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d4c01d070 con 0x7f9d60100ba0 2024-09-11T00:18:19.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.812+0000 7f9d57400700 1 -- 172.21.15.111:0/1415158922 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9d4c005dc0 con 0x7f9d60100ba0 2024-09-11T00:18:19.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.812+0000 7f9d5fe00700 1 -- 172.21.15.111:0/1415158922 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d60195cc0 con 0x7f9d60100ba0 2024-09-11T00:18:19.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.813+0000 7f9d57400700 1 -- 172.21.15.111:0/1415158922 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d4c017400 con 0x7f9d60100ba0 2024-09-11T00:18:19.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.813+0000 7f9d5fe00700 1 -- 172.21.15.111:0/1415158922 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d601961b0 con 0x7f9d60100ba0 2024-09-11T00:18:19.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.814+0000 7f9d5fe00700 1 -- 172.21.15.111:0/1415158922 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d6004f2a0 con 0x7f9d60100ba0 2024-09-11T00:18:19.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.816+0000 7f9d57400700 1 -- 172.21.15.111:0/1415158922 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f9d4c00f6f0 con 0x7f9d60100ba0 2024-09-11T00:18:19.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.817+0000 7f9d57400700 1 --2- 172.21.15.111:0/1415158922 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f9d4407a6f0 0x7f9d4407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:19.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.817+0000 7f9d57400700 1 -- 172.21.15.111:0/1415158922 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f9d4c09e7c0 con 0x7f9d60100ba0 2024-09-11T00:18:19.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.817+0000 7f9d5ea00700 1 --2- 172.21.15.111:0/1415158922 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f9d4407a6f0 0x7f9d4407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:19.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.818+0000 7f9d5ea00700 1 --2- 172.21.15.111:0/1415158922 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f9d4407a6f0 0x7f9d4407cba0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9d50005950 tx=0x7f9d5000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:19.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:19.819+0000 7f9d57400700 1 -- 172.21.15.111:0/1415158922 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f9d4c061f60 con 0x7f9d60100ba0 2024-09-11T00:18:20.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:19 smithi203 ceph-mon[69002]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:18:20.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:19 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/3953077713' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:18:20.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.089+0000 7f9d5fe00700 1 -- 172.21.15.111:0/1415158922 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9d60196f50 con 0x7f9d60100ba0 2024-09-11T00:18:20.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.090+0000 7f9d57400700 1 -- 172.21.15.111:0/1415158922 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1741 (secure 0 0 0) 0x7f9d4c065080 con 0x7f9d60100ba0 2024-09-11T00:18:20.091 INFO:teuthology.orchestra.run.smithi111.stdout:e21 2024-09-11T00:18:20.091 INFO:teuthology.orchestra.run.smithi111.stdout:btime 2024-09-11T00:18:13:246206+0000 2024-09-11T00:18:20.091 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T00:18:20.091 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:18:20.091 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-11T00:18:20.092 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:18:20.092 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-11T00:18:20.092 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-11T00:18:20.092 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 21 2024-09-11T00:18:20.092 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-11T00:18:20.092 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-11T00:03:47.950356+0000 2024-09-11T00:18:20.092 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-11T00:18:13.246187+0000 2024-09-11T00:18:20.092 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-11T00:18:20.092 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-11T00:18:20.092 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-11T00:18:20.092 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-11T00:18:20.092 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-11T00:18:20.092 INFO:teuthology.orchestra.run.smithi111.stdout:max_xattr_size 65536 2024-09-11T00:18:20.092 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-11T00:18:20.092 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-11T00:18:20.093 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 83 2024-09-11T00:18:20.093 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:18:20.093 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-11T00:18:20.093 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-11T00:18:20.093 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=24379} 2024-09-11T00:18:20.093 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-11T00:18:20.093 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-11T00:18:20.093 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-11T00:18:20.093 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-11T00:18:20.093 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-11T00:18:20.093 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data enabled 2024-09-11T00:18:20.093 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-11T00:18:20.093 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-11T00:18:20.093 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 1 2024-09-11T00:18:20.094 INFO:teuthology.orchestra.run.smithi111.stdout:qdb_cluster leader: 0 members: 2024-09-11T00:18:20.094 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.uqkbkn{0:24379} state up:replay seq 2 join_fscid=1 addr [v2:172.21.15.203:6826/695613114,v1:172.21.15.203:6827/695613114] compat {c=[1],r=[1],i=[7ff]}] 2024-09-11T00:18:20.094 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:18:20.094 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:18:20.094 INFO:teuthology.orchestra.run.smithi111.stdout:Standby daemons: 2024-09-11T00:18:20.094 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:18:20.094 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.gmgsay{-1:34406} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.111:6826/3970632147,v1:172.21.15.111:6827/3970632147] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:18:20.094 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.rucaba{-1:34438} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.111:6828/36584465,v1:172.21.15.111:6829/36584465] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:18:20.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.093+0000 7f9d5fe00700 1 -- 172.21.15.111:0/1415158922 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f9d4407a6f0 msgr2=0x7f9d4407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:20.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.093+0000 7f9d5fe00700 1 --2- 172.21.15.111:0/1415158922 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f9d4407a6f0 0x7f9d4407cba0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9d50005950 tx=0x7f9d5000b410 comp rx=0 tx=0).stop 2024-09-11T00:18:20.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.093+0000 7f9d5fe00700 1 -- 172.21.15.111:0/1415158922 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d60100ba0 msgr2=0x7f9d6019bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:20.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.093+0000 7f9d5fe00700 1 --2- 172.21.15.111:0/1415158922 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d60100ba0 0x7f9d6019bf00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00bda0 tx=0x7f9d4c00bdd0 comp rx=0 tx=0).stop 2024-09-11T00:18:20.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.093+0000 7f9d5fe00700 1 -- 172.21.15.111:0/1415158922 shutdown_connections 2024-09-11T00:18:20.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.093+0000 7f9d5fe00700 1 --2- 172.21.15.111:0/1415158922 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f9d4407a6f0 0x7f9d4407cba0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:20.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.093+0000 7f9d5fe00700 1 --2- 172.21.15.111:0/1415158922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d60100200 0x7f9d6019b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:20.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.093+0000 7f9d5fe00700 1 --2- 172.21.15.111:0/1415158922 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d60100ba0 0x7f9d6019bf00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:20.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.093+0000 7f9d5fe00700 1 -- 172.21.15.111:0/1415158922 >> 172.21.15.111:0/1415158922 conn(0x7f9d600fba80 msgr2=0x7f9d600fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:20.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.093+0000 7f9d5fe00700 1 -- 172.21.15.111:0/1415158922 shutdown_connections 2024-09-11T00:18:20.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.093+0000 7f9d5fe00700 1 -- 172.21.15.111:0/1415158922 wait complete. 2024-09-11T00:18:20.096 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 21 2024-09-11T00:18:20.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.237+0000 7fd4d1800700 1 -- 172.21.15.111:0/776409790 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd4cc073070 msgr2=0x7fd4cc073440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:20.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.237+0000 7fd4d1800700 1 --2- 172.21.15.111:0/776409790 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd4cc073070 0x7fd4cc073440 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009940 tx=0x7fd4bc009c50 comp rx=0 tx=0).stop 2024-09-11T00:18:20.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.237+0000 7fd4d1800700 1 -- 172.21.15.111:0/776409790 shutdown_connections 2024-09-11T00:18:20.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.237+0000 7fd4d1800700 1 --2- 172.21.15.111:0/776409790 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4cc073980 0x7fd4cc10c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:20.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.237+0000 7fd4d1800700 1 --2- 172.21.15.111:0/776409790 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd4cc073070 0x7fd4cc073440 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:20.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.237+0000 7fd4d1800700 1 -- 172.21.15.111:0/776409790 >> 172.21.15.111:0/776409790 conn(0x7fd4cc0fbc90 msgr2=0x7fd4cc0fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:20.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.237+0000 7fd4d1800700 1 -- 172.21.15.111:0/776409790 shutdown_connections 2024-09-11T00:18:20.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.237+0000 7fd4d1800700 1 -- 172.21.15.111:0/776409790 wait complete. 2024-09-11T00:18:20.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.238+0000 7fd4d1800700 1 Processor -- start 2024-09-11T00:18:20.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.238+0000 7fd4d1800700 1 -- start start 2024-09-11T00:18:20.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.238+0000 7fd4d1800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4cc073070 0x7fd4cc197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:20.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.238+0000 7fd4d1800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd4cc073980 0x7fd4cc1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:20.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.238+0000 7fd4d1800700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4cc198b80 con 0x7fd4cc073980 2024-09-11T00:18:20.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.238+0000 7fd4d1800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4cc19c910 con 0x7fd4cc073070 2024-09-11T00:18:20.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.239+0000 7fd4c3e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd4cc073980 0x7fd4cc1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:20.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.239+0000 7fd4caa00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4cc073070 0x7fd4cc197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:20.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.239+0000 7fd4caa00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4cc073070 0x7fd4cc197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.111:38128/0 (socket says 172.21.15.111:38128) 2024-09-11T00:18:20.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.239+0000 7fd4c3e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd4cc073980 0x7fd4cc1984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:34836/0 (socket says 172.21.15.111:34836) 2024-09-11T00:18:20.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.239+0000 7fd4caa00700 1 -- 172.21.15.111:0/986384612 learned_addr learned my addr 172.21.15.111:0/986384612 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:18:20.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.239+0000 7fd4c3e00700 1 -- 172.21.15.111:0/986384612 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4cc073070 msgr2=0x7fd4cc197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:20.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.239+0000 7fd4c3e00700 1 --2- 172.21.15.111:0/986384612 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4cc073070 0x7fd4cc197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:20.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.239+0000 7fd4c3e00700 1 -- 172.21.15.111:0/986384612 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc0095f0 con 0x7fd4cc073980 2024-09-11T00:18:20.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.240+0000 7fd4c3e00700 1 --2- 172.21.15.111:0/986384612 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd4cc073980 0x7fd4cc1984a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd4b400d6d0 tx=0x7fd4b400d9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:20.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.240+0000 7fd4c3400700 1 -- 172.21.15.111:0/986384612 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4b40041f0 con 0x7fd4cc073980 2024-09-11T00:18:20.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.240+0000 7fd4c3400700 1 -- 172.21.15.111:0/986384612 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd4b4004cf0 con 0x7fd4cc073980 2024-09-11T00:18:20.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.240+0000 7fd4c3400700 1 -- 172.21.15.111:0/986384612 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4b400f690 con 0x7fd4cc073980 2024-09-11T00:18:20.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.240+0000 7fd4d1800700 1 -- 172.21.15.111:0/986384612 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4cc19cbf0 con 0x7fd4cc073980 2024-09-11T00:18:20.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.240+0000 7fd4d1800700 1 -- 172.21.15.111:0/986384612 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4cc19d140 con 0x7fd4cc073980 2024-09-11T00:18:20.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.241+0000 7fd4d1800700 1 -- 172.21.15.111:0/986384612 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4cc109bf0 con 0x7fd4cc073980 2024-09-11T00:18:20.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.242+0000 7fd4c3400700 1 -- 172.21.15.111:0/986384612 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fd4b4004350 con 0x7fd4cc073980 2024-09-11T00:18:20.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.243+0000 7fd4c3400700 1 --2- 172.21.15.111:0/986384612 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd4b007a6f0 0x7fd4b007cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:20.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.243+0000 7fd4c3400700 1 -- 172.21.15.111:0/986384612 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fd4b409cdb0 con 0x7fd4cc073980 2024-09-11T00:18:20.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.243+0000 7fd4caa00700 1 --2- 172.21.15.111:0/986384612 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd4b007a6f0 0x7fd4b007cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:20.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.244+0000 7fd4caa00700 1 --2- 172.21.15.111:0/986384612 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd4b007a6f0 0x7fd4b007cba0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc00b870 tx=0x7fd4bc005ad0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:20.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.247+0000 7fd4c3400700 1 -- 172.21.15.111:0/986384612 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fd4b40604d0 con 0x7fd4cc073980 2024-09-11T00:18:20.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.490+0000 7fd4d1800700 1 -- 172.21.15.111:0/986384612 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4cc19d4f0 con 0x7fd4b007a6f0 2024-09-11T00:18:20.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.492+0000 7fd4c3400700 1 -- 172.21.15.111:0/986384612 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd4cc19d4f0 con 0x7fd4b007a6f0 2024-09-11T00:18:20.493 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:18:20.493 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e", 2024-09-11T00:18:20.493 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-11T00:18:20.494 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-11T00:18:20.494 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-11T00:18:20.494 INFO:teuthology.orchestra.run.smithi111.stdout: "crash", 2024-09-11T00:18:20.494 INFO:teuthology.orchestra.run.smithi111.stdout: "osd", 2024-09-11T00:18:20.494 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr", 2024-09-11T00:18:20.494 INFO:teuthology.orchestra.run.smithi111.stdout: "mon" 2024-09-11T00:18:20.495 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-11T00:18:20.495 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "14/23 daemons upgraded", 2024-09-11T00:18:20.495 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading mds daemons", 2024-09-11T00:18:20.495 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-11T00:18:20.495 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:18:20.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.494+0000 7fd4d1800700 1 -- 172.21.15.111:0/986384612 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd4b007a6f0 msgr2=0x7fd4b007cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:20.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.494+0000 7fd4d1800700 1 --2- 172.21.15.111:0/986384612 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd4b007a6f0 0x7fd4b007cba0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc00b870 tx=0x7fd4bc005ad0 comp rx=0 tx=0).stop 2024-09-11T00:18:20.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.494+0000 7fd4d1800700 1 -- 172.21.15.111:0/986384612 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd4cc073980 msgr2=0x7fd4cc1984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:20.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.494+0000 7fd4d1800700 1 --2- 172.21.15.111:0/986384612 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd4cc073980 0x7fd4cc1984a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd4b400d6d0 tx=0x7fd4b400d9e0 comp rx=0 tx=0).stop 2024-09-11T00:18:20.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.495+0000 7fd4d1800700 1 -- 172.21.15.111:0/986384612 shutdown_connections 2024-09-11T00:18:20.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.495+0000 7fd4d1800700 1 --2- 172.21.15.111:0/986384612 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd4b007a6f0 0x7fd4b007cba0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:20.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.495+0000 7fd4d1800700 1 --2- 172.21.15.111:0/986384612 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4cc073070 0x7fd4cc197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:20.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.495+0000 7fd4d1800700 1 --2- 172.21.15.111:0/986384612 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd4cc073980 0x7fd4cc1984a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:20.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.495+0000 7fd4d1800700 1 -- 172.21.15.111:0/986384612 >> 172.21.15.111:0/986384612 conn(0x7fd4cc0fbc90 msgr2=0x7fd4cc106d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:20.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.495+0000 7fd4d1800700 1 -- 172.21.15.111:0/986384612 shutdown_connections 2024-09-11T00:18:20.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.495+0000 7fd4d1800700 1 -- 172.21.15.111:0/986384612 wait complete. 2024-09-11T00:18:20.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.632+0000 7fe9d2c00700 1 -- 172.21.15.111:0/15732157 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9cc100bb0 msgr2=0x7fe9cc104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:20.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.632+0000 7fe9d2c00700 1 --2- 172.21.15.111:0/15732157 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9cc100bb0 0x7fe9cc104b80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009910 tx=0x7fe9b8009c20 comp rx=0 tx=0).stop 2024-09-11T00:18:20.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.632+0000 7fe9d2c00700 1 -- 172.21.15.111:0/15732157 shutdown_connections 2024-09-11T00:18:20.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.632+0000 7fe9d2c00700 1 --2- 172.21.15.111:0/15732157 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9cc100bb0 0x7fe9cc104b80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:20.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.632+0000 7fe9d2c00700 1 --2- 172.21.15.111:0/15732157 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9cc100210 0x7fe9cc1005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:20.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.632+0000 7fe9d2c00700 1 -- 172.21.15.111:0/15732157 >> 172.21.15.111:0/15732157 conn(0x7fe9cc0fbab0 msgr2=0x7fe9cc0fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:20.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.632+0000 7fe9d2c00700 1 -- 172.21.15.111:0/15732157 shutdown_connections 2024-09-11T00:18:20.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.632+0000 7fe9d2c00700 1 -- 172.21.15.111:0/15732157 wait complete. 2024-09-11T00:18:20.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.633+0000 7fe9d2c00700 1 Processor -- start 2024-09-11T00:18:20.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.634+0000 7fe9d2c00700 1 -- start start 2024-09-11T00:18:20.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.634+0000 7fe9d2c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9cc100210 0x7fe9cc197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:20.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.634+0000 7fe9d2c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9cc100bb0 0x7fe9cc198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:20.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.634+0000 7fe9d2c00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc198a40 con 0x7fe9cc100bb0 2024-09-11T00:18:20.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.634+0000 7fe9d2c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc19c7d0 con 0x7fe9cc100210 2024-09-11T00:18:20.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.634+0000 7fe9d0e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9cc100bb0 0x7fe9cc198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:20.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.634+0000 7fe9d0e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9cc100bb0 0x7fe9cc198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:34848/0 (socket says 172.21.15.111:34848) 2024-09-11T00:18:20.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.634+0000 7fe9d1800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9cc100210 0x7fe9cc197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:20.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.634+0000 7fe9d0e00700 1 -- 172.21.15.111:0/102214225 learned_addr learned my addr 172.21.15.111:0/102214225 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:18:20.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.635+0000 7fe9d0e00700 1 -- 172.21.15.111:0/102214225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9cc100210 msgr2=0x7fe9cc197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:20.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.635+0000 7fe9d0e00700 1 --2- 172.21.15.111:0/102214225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9cc100210 0x7fe9cc197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:20.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.635+0000 7fe9d0e00700 1 -- 172.21.15.111:0/102214225 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b80095f0 con 0x7fe9cc100bb0 2024-09-11T00:18:20.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.635+0000 7fe9d0e00700 1 --2- 172.21.15.111:0/102214225 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9cc100bb0 0x7fe9cc198360 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009fd0 tx=0x7fe9b800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:20.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.635+0000 7fe9ca000700 1 -- 172.21.15.111:0/102214225 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9b801d070 con 0x7fe9cc100bb0 2024-09-11T00:18:20.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.635+0000 7fe9ca000700 1 -- 172.21.15.111:0/102214225 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe9b8022470 con 0x7fe9cc100bb0 2024-09-11T00:18:20.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.635+0000 7fe9d2c00700 1 -- 172.21.15.111:0/102214225 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9cc19ca50 con 0x7fe9cc100bb0 2024-09-11T00:18:20.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.635+0000 7fe9ca000700 1 -- 172.21.15.111:0/102214225 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9b8017650 con 0x7fe9cc100bb0 2024-09-11T00:18:20.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.635+0000 7fe9d2c00700 1 -- 172.21.15.111:0/102214225 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9cc19cee0 con 0x7fe9cc100bb0 2024-09-11T00:18:20.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.637+0000 7fe9d2c00700 1 -- 172.21.15.111:0/102214225 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9cc104300 con 0x7fe9cc100bb0 2024-09-11T00:18:20.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.638+0000 7fe9ca000700 1 -- 172.21.15.111:0/102214225 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fe9b80225e0 con 0x7fe9cc100bb0 2024-09-11T00:18:20.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.639+0000 7fe9ca000700 1 --2- 172.21.15.111:0/102214225 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe9b407a6f0 0x7fe9b407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:20.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.639+0000 7fe9ca000700 1 -- 172.21.15.111:0/102214225 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fe9b809e850 con 0x7fe9cc100bb0 2024-09-11T00:18:20.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.639+0000 7fe9d1800700 1 --2- 172.21.15.111:0/102214225 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe9b407a6f0 0x7fe9b407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:20.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.640+0000 7fe9d1800700 1 --2- 172.21.15.111:0/102214225 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe9b407a6f0 0x7fe9b407cba0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0009c60 tx=0x7fe9c0009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:20.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.643+0000 7fe9ca000700 1 -- 172.21.15.111:0/102214225 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fe9b8061ef0 con 0x7fe9cc100bb0 2024-09-11T00:18:20.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:20 smithi111 ceph-mon[90842]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:18:20.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:20 smithi111 ceph-mon[90842]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:18:20.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:20 smithi111 ceph-mon[90842]: pgmap v211: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-11T00:18:20.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:20 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/1415158922' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:18:20.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.954+0000 7fe9d2c00700 1 -- 172.21.15.111:0/102214225 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe9cc04f2a0 con 0x7fe9cc100bb0 2024-09-11T00:18:20.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.954+0000 7fe9ca000700 1 -- 172.21.15.111:0/102214225 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+297 (secure 0 0 0) 0x7fe9b8065010 con 0x7fe9cc100bb0 2024-09-11T00:18:20.955 INFO:teuthology.orchestra.run.smithi111.stdout:HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-09-11T00:18:20.956 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-11T00:18:20.956 INFO:teuthology.orchestra.run.smithi111.stdout: fs cephfs is degraded 2024-09-11T00:18:20.956 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-11T00:18:20.956 INFO:teuthology.orchestra.run.smithi111.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-11T00:18:20.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.957+0000 7fe9d2c00700 1 -- 172.21.15.111:0/102214225 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe9b407a6f0 msgr2=0x7fe9b407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:20.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.957+0000 7fe9d2c00700 1 --2- 172.21.15.111:0/102214225 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe9b407a6f0 0x7fe9b407cba0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0009c60 tx=0x7fe9c0009260 comp rx=0 tx=0).stop 2024-09-11T00:18:20.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.957+0000 7fe9d2c00700 1 -- 172.21.15.111:0/102214225 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9cc100bb0 msgr2=0x7fe9cc198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:20.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.957+0000 7fe9d2c00700 1 --2- 172.21.15.111:0/102214225 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9cc100bb0 0x7fe9cc198360 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009fd0 tx=0x7fe9b800f690 comp rx=0 tx=0).stop 2024-09-11T00:18:20.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.957+0000 7fe9d2c00700 1 -- 172.21.15.111:0/102214225 shutdown_connections 2024-09-11T00:18:20.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.957+0000 7fe9d2c00700 1 --2- 172.21.15.111:0/102214225 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe9b407a6f0 0x7fe9b407cba0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:20.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.957+0000 7fe9d2c00700 1 --2- 172.21.15.111:0/102214225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9cc100210 0x7fe9cc197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:20.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.957+0000 7fe9d2c00700 1 --2- 172.21.15.111:0/102214225 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe9cc100bb0 0x7fe9cc198360 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:20.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.957+0000 7fe9d2c00700 1 -- 172.21.15.111:0/102214225 >> 172.21.15.111:0/102214225 conn(0x7fe9cc0fbab0 msgr2=0x7fe9cc0fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:20.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.958+0000 7fe9d2c00700 1 -- 172.21.15.111:0/102214225 shutdown_connections 2024-09-11T00:18:20.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:20.958+0000 7fe9d2c00700 1 -- 172.21.15.111:0/102214225 wait complete. 2024-09-11T00:18:21.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:20 smithi203 ceph-mon[69002]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:18:21.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:20 smithi203 ceph-mon[69002]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:18:21.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:20 smithi203 ceph-mon[69002]: pgmap v211: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-11T00:18:21.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:20 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/1415158922' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:18:22.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:21 smithi203 ceph-mon[69002]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:18:22.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:21 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/102214225' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-11T00:18:22.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:21 smithi111 ceph-mon[90842]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:18:22.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:21 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/102214225' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-11T00:18:23.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:22 smithi203 ceph-mon[69002]: pgmap v212: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-11T00:18:23.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:22 smithi111 ceph-mon[90842]: pgmap v212: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-11T00:18:24.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:23 smithi203 ceph-mon[69002]: reconnect by client.24415 192.168.0.1:0/3848893757 after 0.000999974 2024-09-11T00:18:24.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:23 smithi203 ceph-mon[69002]: reconnect by client.14594 192.168.0.1:0/3937520575 after 0.000999974 2024-09-11T00:18:24.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:23 smithi203 ceph-mon[69002]: mds.? [v2:172.21.15.203:6826/695613114,v1:172.21.15.203:6827/695613114] up:reconnect 2024-09-11T00:18:24.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:23 smithi203 ceph-mon[69002]: fsmap cephfs:1/1 {0=cephfs.smithi203.uqkbkn=up:reconnect} 2 up:standby 2024-09-11T00:18:24.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:23 smithi203 ceph-mon[69002]: pgmap v213: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-09-11T00:18:24.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:23 smithi111 ceph-mon[90842]: reconnect by client.24415 192.168.0.1:0/3848893757 after 0.000999974 2024-09-11T00:18:24.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:23 smithi111 ceph-mon[90842]: reconnect by client.14594 192.168.0.1:0/3937520575 after 0.000999974 2024-09-11T00:18:24.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:23 smithi111 ceph-mon[90842]: mds.? [v2:172.21.15.203:6826/695613114,v1:172.21.15.203:6827/695613114] up:reconnect 2024-09-11T00:18:24.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:23 smithi111 ceph-mon[90842]: fsmap cephfs:1/1 {0=cephfs.smithi203.uqkbkn=up:reconnect} 2 up:standby 2024-09-11T00:18:24.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:23 smithi111 ceph-mon[90842]: pgmap v213: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-09-11T00:18:25.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:24 smithi203 ceph-mon[69002]: mds.? [v2:172.21.15.203:6826/695613114,v1:172.21.15.203:6827/695613114] up:rejoin 2024-09-11T00:18:25.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:24 smithi203 ceph-mon[69002]: fsmap cephfs:1/1 {0=cephfs.smithi203.uqkbkn=up:rejoin} 2 up:standby 2024-09-11T00:18:25.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:24 smithi203 ceph-mon[69002]: daemon mds.cephfs.smithi203.uqkbkn is now active in filesystem cephfs as rank 0 2024-09-11T00:18:25.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:24 smithi111 ceph-mon[90842]: mds.? [v2:172.21.15.203:6826/695613114,v1:172.21.15.203:6827/695613114] up:rejoin 2024-09-11T00:18:25.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:24 smithi111 ceph-mon[90842]: fsmap cephfs:1/1 {0=cephfs.smithi203.uqkbkn=up:rejoin} 2 up:standby 2024-09-11T00:18:25.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:24 smithi111 ceph-mon[90842]: daemon mds.cephfs.smithi203.uqkbkn is now active in filesystem cephfs as rank 0 2024-09-11T00:18:26.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:25 smithi203 ceph-mon[69002]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T00:18:26.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:25 smithi203 ceph-mon[69002]: mds.? [v2:172.21.15.203:6826/695613114,v1:172.21.15.203:6827/695613114] up:active 2024-09-11T00:18:26.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:25 smithi203 ceph-mon[69002]: fsmap cephfs:1 {0=cephfs.smithi203.uqkbkn=up:active} 2 up:standby 2024-09-11T00:18:26.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:25 smithi203 ceph-mon[69002]: pgmap v214: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 85 B/s wr, 6 op/s 2024-09-11T00:18:26.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:25 smithi111 ceph-mon[90842]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T00:18:26.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:25 smithi111 ceph-mon[90842]: mds.? [v2:172.21.15.203:6826/695613114,v1:172.21.15.203:6827/695613114] up:active 2024-09-11T00:18:26.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:25 smithi111 ceph-mon[90842]: fsmap cephfs:1 {0=cephfs.smithi203.uqkbkn=up:active} 2 up:standby 2024-09-11T00:18:26.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:25 smithi111 ceph-mon[90842]: pgmap v214: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 85 B/s wr, 6 op/s 2024-09-11T00:18:29.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:28 smithi203 ceph-mon[69002]: pgmap v215: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 85 B/s wr, 5 op/s 2024-09-11T00:18:29.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:29.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:29.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:18:29.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:28 smithi111 ceph-mon[90842]: pgmap v215: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 85 B/s wr, 5 op/s 2024-09-11T00:18:29.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:29.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:29.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:18:29.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:29 smithi111 ceph-mon[90842]: mds.? [v2:172.21.15.203:6824/4221647525,v1:172.21.15.203:6825/4221647525] up:boot 2024-09-11T00:18:29.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:29 smithi111 ceph-mon[90842]: fsmap cephfs:1 {0=cephfs.smithi203.uqkbkn=up:active} 3 up:standby 2024-09-11T00:18:29.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:29 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mds metadata", "who": "cephfs.smithi203.tcrqop"} : dispatch 2024-09-11T00:18:29.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:29 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:29.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:29 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:30.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:29 smithi203 ceph-mon[69002]: mds.? [v2:172.21.15.203:6824/4221647525,v1:172.21.15.203:6825/4221647525] up:boot 2024-09-11T00:18:30.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:29 smithi203 ceph-mon[69002]: fsmap cephfs:1 {0=cephfs.smithi203.uqkbkn=up:active} 3 up:standby 2024-09-11T00:18:30.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:29 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mds metadata", "who": "cephfs.smithi203.tcrqop"} : dispatch 2024-09-11T00:18:30.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:29 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:30.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:29 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:30.794 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:30 smithi111 ceph-mon[90842]: pgmap v216: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-11T00:18:30.794 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:30.794 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:18:31.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:30 smithi203 ceph-mon[69002]: pgmap v216: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-11T00:18:31.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:31.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:18:33.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:32 smithi203 ceph-mon[69002]: pgmap v217: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.9 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-09-11T00:18:33.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:32 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:33.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:32 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:33.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:32 smithi111 ceph-mon[90842]: pgmap v217: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.9 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-09-11T00:18:33.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:32 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:33.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:32 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:34.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:34 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:34.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:34 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:34.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:34 smithi203 ceph-mon[69002]: pgmap v218: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.2 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-09-11T00:18:34.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:34 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:34.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:34 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:34.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:34 smithi111 ceph-mon[90842]: pgmap v218: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.2 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-09-11T00:18:36.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:36 smithi203 ceph-mon[69002]: pgmap v219: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-11T00:18:37.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:36 smithi111 ceph-mon[90842]: pgmap v219: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-11T00:18:38.548 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:38 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:38.548 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:38 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:38.548 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:38 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:18:38.548 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:38 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:18:38.548 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:38 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:38.548 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:38 smithi203 ceph-mon[69002]: pgmap v220: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-09-11T00:18:38.548 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:38 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:18:38.549 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:38 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:18:38.549 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:38 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:18:38.549 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:38 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:18:38.549 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:38 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:18:38.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:38 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:38.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:38 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:38.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:38 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:18:38.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:38 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:18:38.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:38 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:38.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:38 smithi111 ceph-mon[90842]: pgmap v220: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-09-11T00:18:38.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:38 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:18:38.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:38 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:18:38.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:38 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:18:38.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:38 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:18:38.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:38 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:18:40.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:40 smithi203 ceph-mon[69002]: Upgrade: Updating mds.cephfs.smithi203.uqkbkn 2024-09-11T00:18:40.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:40 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:40.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:40 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.uqkbkn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:18:40.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:40 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:18:40.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:40 smithi203 ceph-mon[69002]: Deploying daemon mds.cephfs.smithi203.uqkbkn on smithi203 2024-09-11T00:18:40.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:40 smithi203 ceph-mon[69002]: pgmap v221: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-09-11T00:18:40.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:40 smithi111 ceph-mon[90842]: Upgrade: Updating mds.cephfs.smithi203.uqkbkn 2024-09-11T00:18:40.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:40 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:40.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:40 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.uqkbkn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:18:40.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:40 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:18:40.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:40 smithi111 ceph-mon[90842]: Deploying daemon mds.cephfs.smithi203.uqkbkn on smithi203 2024-09-11T00:18:40.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:40 smithi111 ceph-mon[90842]: pgmap v221: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-09-11T00:18:42.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:42 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi111[90838]: 2024-09-11T00:18:42.026+0000 7f2864200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T00:18:43.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:42 smithi203 ceph-mon[69002]: pgmap v222: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-09-11T00:18:43.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:42 smithi203 ceph-mon[69002]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T00:18:43.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:42 smithi203 ceph-mon[69002]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T00:18:43.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:42 smithi203 ceph-mon[69002]: osdmap e84: 6 total, 6 up, 6 in 2024-09-11T00:18:43.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:42 smithi203 ceph-mon[69002]: Standby daemon mds.cephfs.smithi111.gmgsay assigned to filesystem cephfs as rank 0 2024-09-11T00:18:43.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:42 smithi203 ceph-mon[69002]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T00:18:43.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:42 smithi203 ceph-mon[69002]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-11T00:18:43.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:42 smithi203 ceph-mon[69002]: fsmap cephfs:1/1 {0=cephfs.smithi111.gmgsay=up:replay} 2 up:standby 2024-09-11T00:18:43.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:42 smithi111 ceph-mon[90842]: pgmap v222: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-09-11T00:18:43.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:42 smithi111 ceph-mon[90842]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T00:18:43.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:42 smithi111 ceph-mon[90842]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T00:18:43.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:42 smithi111 ceph-mon[90842]: osdmap e84: 6 total, 6 up, 6 in 2024-09-11T00:18:43.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:42 smithi111 ceph-mon[90842]: Standby daemon mds.cephfs.smithi111.gmgsay assigned to filesystem cephfs as rank 0 2024-09-11T00:18:43.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:42 smithi111 ceph-mon[90842]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T00:18:43.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:42 smithi111 ceph-mon[90842]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-11T00:18:43.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:42 smithi111 ceph-mon[90842]: fsmap cephfs:1/1 {0=cephfs.smithi111.gmgsay=up:replay} 2 up:standby 2024-09-11T00:18:45.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:44 smithi203 ceph-mon[69002]: pgmap v224: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 0 op/s 2024-09-11T00:18:45.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:44 smithi111 ceph-mon[90842]: pgmap v224: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 0 op/s 2024-09-11T00:18:46.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:45 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:46.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:45 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:18:46.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:45 smithi203 ceph-mon[69002]: pgmap v225: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 8.4 MiB/s rd, 3 op/s 2024-09-11T00:18:46.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:45 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:46.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:45 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:18:46.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:45 smithi111 ceph-mon[90842]: pgmap v225: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 8.4 MiB/s rd, 3 op/s 2024-09-11T00:18:48.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:48 smithi111 ceph-mon[90842]: pgmap v226: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-11T00:18:49.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:48 smithi203 ceph-mon[69002]: pgmap v226: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-11T00:18:50.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:50 smithi203 ceph-mon[69002]: pgmap v227: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s 2024-09-11T00:18:50.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:50 smithi203 ceph-mon[69002]: reconnect by client.14594 192.168.0.1:0/3937520575 after 0.000999983 2024-09-11T00:18:50.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:50 smithi203 ceph-mon[69002]: mds.? [v2:172.21.15.111:6826/3970632147,v1:172.21.15.111:6827/3970632147] up:reconnect 2024-09-11T00:18:50.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:50 smithi203 ceph-mon[69002]: fsmap cephfs:1/1 {0=cephfs.smithi111.gmgsay=up:reconnect} 2 up:standby 2024-09-11T00:18:50.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:50 smithi203 ceph-mon[69002]: reconnect by client.24415 192.168.0.1:0/3848893757 after 0.00199996 2024-09-11T00:18:51.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:50 smithi111 ceph-mon[90842]: pgmap v227: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s 2024-09-11T00:18:51.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:50 smithi111 ceph-mon[90842]: reconnect by client.14594 192.168.0.1:0/3937520575 after 0.000999983 2024-09-11T00:18:51.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:50 smithi111 ceph-mon[90842]: mds.? [v2:172.21.15.111:6826/3970632147,v1:172.21.15.111:6827/3970632147] up:reconnect 2024-09-11T00:18:51.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:50 smithi111 ceph-mon[90842]: fsmap cephfs:1/1 {0=cephfs.smithi111.gmgsay=up:reconnect} 2 up:standby 2024-09-11T00:18:51.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:50 smithi111 ceph-mon[90842]: reconnect by client.24415 192.168.0.1:0/3848893757 after 0.00199996 2024-09-11T00:18:51.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.102+0000 7fae7f200700 1 -- 172.21.15.111:0/2891006206 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fae781003d0 msgr2=0x7fae781007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:51.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.102+0000 7fae7f200700 1 --2- 172.21.15.111:0/2891006206 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fae781003d0 0x7fae781007a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fae68009910 tx=0x7fae68009c20 comp rx=0 tx=0).stop 2024-09-11T00:18:51.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.102+0000 7fae7f200700 1 -- 172.21.15.111:0/2891006206 shutdown_connections 2024-09-11T00:18:51.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.102+0000 7fae7f200700 1 --2- 172.21.15.111:0/2891006206 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae78100d70 0x7fae78104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:51.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.102+0000 7fae7f200700 1 --2- 172.21.15.111:0/2891006206 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fae781003d0 0x7fae781007a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:51.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.102+0000 7fae7f200700 1 -- 172.21.15.111:0/2891006206 >> 172.21.15.111:0/2891006206 conn(0x7fae780fbc50 msgr2=0x7fae780fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:51.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.102+0000 7fae7f200700 1 -- 172.21.15.111:0/2891006206 shutdown_connections 2024-09-11T00:18:51.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.102+0000 7fae7f200700 1 -- 172.21.15.111:0/2891006206 wait complete. 2024-09-11T00:18:51.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.103+0000 7fae7f200700 1 Processor -- start 2024-09-11T00:18:51.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.103+0000 7fae7f200700 1 -- start start 2024-09-11T00:18:51.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.104+0000 7fae7f200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fae781003d0 0x7fae78073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:51.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.104+0000 7fae7f200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae78100d70 0x7fae78073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:51.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.104+0000 7fae7f200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae78073ad0 con 0x7fae781003d0 2024-09-11T00:18:51.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.104+0000 7fae7f200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae78073c10 con 0x7fae78100d70 2024-09-11T00:18:51.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.104+0000 7fae77e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fae781003d0 0x7fae78073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:51.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.104+0000 7fae77e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fae781003d0 0x7fae78073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52044/0 (socket says 172.21.15.111:52044) 2024-09-11T00:18:51.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.104+0000 7fae77e00700 1 -- 172.21.15.111:0/3570804568 learned_addr learned my addr 172.21.15.111:0/3570804568 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:18:51.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.104+0000 7fae77e00700 1 -- 172.21.15.111:0/3570804568 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae78100d70 msgr2=0x7fae78073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:51.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.104+0000 7fae77e00700 1 --2- 172.21.15.111:0/3570804568 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae78100d70 0x7fae78073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:51.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.104+0000 7fae77e00700 1 -- 172.21.15.111:0/3570804568 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae680095f0 con 0x7fae781003d0 2024-09-11T00:18:51.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.105+0000 7fae77e00700 1 --2- 172.21.15.111:0/3570804568 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fae781003d0 0x7fae78073050 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fae6800f690 tx=0x7fae6800f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:51.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.105+0000 7fae75600700 1 -- 172.21.15.111:0/3570804568 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae6801d070 con 0x7fae781003d0 2024-09-11T00:18:51.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.105+0000 7fae75600700 1 -- 172.21.15.111:0/3570804568 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fae680050d0 con 0x7fae781003d0 2024-09-11T00:18:51.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.105+0000 7fae75600700 1 -- 172.21.15.111:0/3570804568 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae68022470 con 0x7fae781003d0 2024-09-11T00:18:51.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.105+0000 7fae7f200700 1 -- 172.21.15.111:0/3570804568 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae78073e90 con 0x7fae781003d0 2024-09-11T00:18:51.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.105+0000 7fae7f200700 1 -- 172.21.15.111:0/3570804568 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae781a22b0 con 0x7fae781003d0 2024-09-11T00:18:51.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.106+0000 7fae7f200700 1 -- 172.21.15.111:0/3570804568 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae781086e0 con 0x7fae781003d0 2024-09-11T00:18:51.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.108+0000 7fae75600700 1 -- 172.21.15.111:0/3570804568 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fae68003680 con 0x7fae781003d0 2024-09-11T00:18:51.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.108+0000 7fae75600700 1 --2- 172.21.15.111:0/3570804568 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fae5c07a6f0 0x7fae5c07cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:51.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.109+0000 7fae75600700 1 -- 172.21.15.111:0/3570804568 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fae6809e6e0 con 0x7fae781003d0 2024-09-11T00:18:51.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.109+0000 7fae6fe00700 1 --2- 172.21.15.111:0/3570804568 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fae5c07a6f0 0x7fae5c07cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:51.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.109+0000 7fae6fe00700 1 --2- 172.21.15.111:0/3570804568 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fae5c07a6f0 0x7fae5c07cba0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fae60005950 tx=0x7fae600058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:51.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.113+0000 7fae75600700 1 -- 172.21.15.111:0/3570804568 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fae68061e60 con 0x7fae781003d0 2024-09-11T00:18:51.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.354+0000 7fae7f200700 1 -- 172.21.15.111:0/3570804568 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fae7802cca0 con 0x7fae5c07a6f0 2024-09-11T00:18:51.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.355+0000 7fae75600700 1 -- 172.21.15.111:0/3570804568 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fae7802cca0 con 0x7fae5c07a6f0 2024-09-11T00:18:51.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.358+0000 7fae7f200700 1 -- 172.21.15.111:0/3570804568 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fae5c07a6f0 msgr2=0x7fae5c07cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:51.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.358+0000 7fae7f200700 1 --2- 172.21.15.111:0/3570804568 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fae5c07a6f0 0x7fae5c07cba0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fae60005950 tx=0x7fae600058e0 comp rx=0 tx=0).stop 2024-09-11T00:18:51.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.358+0000 7fae7f200700 1 -- 172.21.15.111:0/3570804568 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fae781003d0 msgr2=0x7fae78073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:51.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.358+0000 7fae7f200700 1 --2- 172.21.15.111:0/3570804568 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fae781003d0 0x7fae78073050 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fae6800f690 tx=0x7fae6800f770 comp rx=0 tx=0).stop 2024-09-11T00:18:51.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.358+0000 7fae7f200700 1 -- 172.21.15.111:0/3570804568 shutdown_connections 2024-09-11T00:18:51.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.358+0000 7fae7f200700 1 --2- 172.21.15.111:0/3570804568 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fae5c07a6f0 0x7fae5c07cba0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:51.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.358+0000 7fae7f200700 1 --2- 172.21.15.111:0/3570804568 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fae781003d0 0x7fae78073050 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:51.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.358+0000 7fae7f200700 1 --2- 172.21.15.111:0/3570804568 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae78100d70 0x7fae78073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:51.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.358+0000 7fae7f200700 1 -- 172.21.15.111:0/3570804568 >> 172.21.15.111:0/3570804568 conn(0x7fae780fbc50 msgr2=0x7fae780fd260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:51.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.358+0000 7fae7f200700 1 -- 172.21.15.111:0/3570804568 shutdown_connections 2024-09-11T00:18:51.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.359+0000 7fae7f200700 1 -- 172.21.15.111:0/3570804568 wait complete. 2024-09-11T00:18:51.375 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:18:51.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.496+0000 7f46e4a00700 1 -- 172.21.15.111:0/2750479761 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46e0102610 msgr2=0x7f46e01029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:51.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.496+0000 7f46e4a00700 1 --2- 172.21.15.111:0/2750479761 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46e0102610 0x7f46e01029e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f46d0009910 tx=0x7f46d0009c20 comp rx=0 tx=0).stop 2024-09-11T00:18:51.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.496+0000 7f46e4a00700 1 -- 172.21.15.111:0/2750479761 shutdown_connections 2024-09-11T00:18:51.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.496+0000 7f46e4a00700 1 --2- 172.21.15.111:0/2750479761 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46e0102fb0 0x7f46e0106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:51.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.496+0000 7f46e4a00700 1 --2- 172.21.15.111:0/2750479761 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46e0102610 0x7f46e01029e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:51.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.496+0000 7f46e4a00700 1 -- 172.21.15.111:0/2750479761 >> 172.21.15.111:0/2750479761 conn(0x7f46e00fde90 msgr2=0x7f46e01002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:51.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.496+0000 7f46e4a00700 1 -- 172.21.15.111:0/2750479761 shutdown_connections 2024-09-11T00:18:51.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.496+0000 7f46e4a00700 1 -- 172.21.15.111:0/2750479761 wait complete. 2024-09-11T00:18:51.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.497+0000 7f46e4a00700 1 Processor -- start 2024-09-11T00:18:51.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.497+0000 7f46e4a00700 1 -- start start 2024-09-11T00:18:51.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.497+0000 7f46e4a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46e0102610 0x7f46e0197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:51.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.497+0000 7f46e4a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46e0102fb0 0x7f46e0198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:51.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.497+0000 7f46e4a00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e0198be0 con 0x7f46e0102fb0 2024-09-11T00:18:51.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.497+0000 7f46e4a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e019c970 con 0x7f46e0102610 2024-09-11T00:18:51.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.498+0000 7f46d7e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46e0102fb0 0x7f46e0198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:51.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.498+0000 7f46dde00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46e0102610 0x7f46e0197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:51.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.498+0000 7f46d7e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46e0102fb0 0x7f46e0198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52062/0 (socket says 172.21.15.111:52062) 2024-09-11T00:18:51.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.498+0000 7f46d7e00700 1 -- 172.21.15.111:0/3724825476 learned_addr learned my addr 172.21.15.111:0/3724825476 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:18:51.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.498+0000 7f46d7e00700 1 -- 172.21.15.111:0/3724825476 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46e0102610 msgr2=0x7f46e0197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:51.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.498+0000 7f46d7e00700 1 --2- 172.21.15.111:0/3724825476 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46e0102610 0x7f46e0197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:51.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.498+0000 7f46d7e00700 1 -- 172.21.15.111:0/3724825476 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d00095f0 con 0x7f46e0102fb0 2024-09-11T00:18:51.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.498+0000 7f46d7e00700 1 --2- 172.21.15.111:0/3724825476 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46e0102fb0 0x7f46e0198500 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f46c800e8f0 tx=0x7f46c800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:51.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.499+0000 7f46d6a00700 1 -- 172.21.15.111:0/3724825476 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46c8009790 con 0x7f46e0102fb0 2024-09-11T00:18:51.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.499+0000 7f46d6a00700 1 -- 172.21.15.111:0/3724825476 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f46c800c810 con 0x7f46e0102fb0 2024-09-11T00:18:51.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.499+0000 7f46e4a00700 1 -- 172.21.15.111:0/3724825476 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e019cc50 con 0x7f46e0102fb0 2024-09-11T00:18:51.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.499+0000 7f46d6a00700 1 -- 172.21.15.111:0/3724825476 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46c8005580 con 0x7f46e0102fb0 2024-09-11T00:18:51.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.499+0000 7f46e4a00700 1 -- 172.21.15.111:0/3724825476 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e019d1a0 con 0x7f46e0102fb0 2024-09-11T00:18:51.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.500+0000 7f46e4a00700 1 -- 172.21.15.111:0/3724825476 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e004ea50 con 0x7f46e0102fb0 2024-09-11T00:18:51.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.501+0000 7f46d6a00700 1 -- 172.21.15.111:0/3724825476 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f46c800c980 con 0x7f46e0102fb0 2024-09-11T00:18:51.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.502+0000 7f46d6a00700 1 --2- 172.21.15.111:0/3724825476 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f46c407a6f0 0x7f46c407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:51.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.502+0000 7f46d6a00700 1 -- 172.21.15.111:0/3724825476 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f46c8014070 con 0x7f46e0102fb0 2024-09-11T00:18:51.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.503+0000 7f46dde00700 1 --2- 172.21.15.111:0/3724825476 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f46c407a6f0 0x7f46c407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:51.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.503+0000 7f46dde00700 1 --2- 172.21.15.111:0/3724825476 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f46c407a6f0 0x7f46c407cba0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f46d00059d0 tx=0x7f46d0005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:51.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.507+0000 7f46d6a00700 1 -- 172.21.15.111:0/3724825476 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f46c8060c70 con 0x7f46e0102fb0 2024-09-11T00:18:51.758 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.756+0000 7f46e4a00700 1 -- 172.21.15.111:0/3724825476 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f46e019d730 con 0x7f46c407a6f0 2024-09-11T00:18:51.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.757+0000 7f46d6a00700 1 -- 172.21.15.111:0/3724825476 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f46e019d730 con 0x7f46c407a6f0 2024-09-11T00:18:51.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.760+0000 7f46e4a00700 1 -- 172.21.15.111:0/3724825476 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f46c407a6f0 msgr2=0x7f46c407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:51.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.760+0000 7f46e4a00700 1 --2- 172.21.15.111:0/3724825476 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f46c407a6f0 0x7f46c407cba0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f46d00059d0 tx=0x7f46d0005940 comp rx=0 tx=0).stop 2024-09-11T00:18:51.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.760+0000 7f46e4a00700 1 -- 172.21.15.111:0/3724825476 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46e0102fb0 msgr2=0x7f46e0198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:51.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.760+0000 7f46e4a00700 1 --2- 172.21.15.111:0/3724825476 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46e0102fb0 0x7f46e0198500 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f46c800e8f0 tx=0x7f46c800ec00 comp rx=0 tx=0).stop 2024-09-11T00:18:51.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.760+0000 7f46e4a00700 1 -- 172.21.15.111:0/3724825476 shutdown_connections 2024-09-11T00:18:51.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.760+0000 7f46e4a00700 1 --2- 172.21.15.111:0/3724825476 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f46c407a6f0 0x7f46c407cba0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:51.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.760+0000 7f46e4a00700 1 --2- 172.21.15.111:0/3724825476 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46e0102610 0x7f46e0197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:51.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.760+0000 7f46e4a00700 1 --2- 172.21.15.111:0/3724825476 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46e0102fb0 0x7f46e0198500 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:51.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.760+0000 7f46e4a00700 1 -- 172.21.15.111:0/3724825476 >> 172.21.15.111:0/3724825476 conn(0x7f46e00fde90 msgr2=0x7f46e00ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:51.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.760+0000 7f46e4a00700 1 -- 172.21.15.111:0/3724825476 shutdown_connections 2024-09-11T00:18:51.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.760+0000 7f46e4a00700 1 -- 172.21.15.111:0/3724825476 wait complete. 2024-09-11T00:18:51.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.897+0000 7f316cc00700 1 -- 172.21.15.111:0/483973557 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3168102fa0 msgr2=0x7f3168106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:51.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.897+0000 7f316cc00700 1 --2- 172.21.15.111:0/483973557 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3168102fa0 0x7f3168106f70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3154009910 tx=0x7f3154009c20 comp rx=0 tx=0).stop 2024-09-11T00:18:51.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.897+0000 7f316cc00700 1 -- 172.21.15.111:0/483973557 shutdown_connections 2024-09-11T00:18:51.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.897+0000 7f316cc00700 1 --2- 172.21.15.111:0/483973557 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3168102fa0 0x7f3168106f70 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:51.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.897+0000 7f316cc00700 1 --2- 172.21.15.111:0/483973557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3168102600 0x7f31681029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:51.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.897+0000 7f316cc00700 1 -- 172.21.15.111:0/483973557 >> 172.21.15.111:0/483973557 conn(0x7f31680fdec0 msgr2=0x7f31681002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:51.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.897+0000 7f316cc00700 1 -- 172.21.15.111:0/483973557 shutdown_connections 2024-09-11T00:18:51.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.897+0000 7f316cc00700 1 -- 172.21.15.111:0/483973557 wait complete. 2024-09-11T00:18:51.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.898+0000 7f316cc00700 1 Processor -- start 2024-09-11T00:18:51.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.898+0000 7f316cc00700 1 -- start start 2024-09-11T00:18:51.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.898+0000 7f316cc00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3168102600 0x7f3168197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:51.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.898+0000 7f316cc00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3168102fa0 0x7f3168198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:51.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.898+0000 7f316cc00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3168198c10 con 0x7f3168102fa0 2024-09-11T00:18:51.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.898+0000 7f316cc00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316819c9a0 con 0x7f3168102600 2024-09-11T00:18:51.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.898+0000 7f3165400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3168102fa0 0x7f3168198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:51.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.899+0000 7f3165400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3168102fa0 0x7f3168198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52070/0 (socket says 172.21.15.111:52070) 2024-09-11T00:18:51.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.899+0000 7f3165400700 1 -- 172.21.15.111:0/2060834046 learned_addr learned my addr 172.21.15.111:0/2060834046 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:18:51.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.899+0000 7f3165e00700 1 --2- 172.21.15.111:0/2060834046 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3168102600 0x7f3168197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:51.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.899+0000 7f3165400700 1 -- 172.21.15.111:0/2060834046 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3168102600 msgr2=0x7f3168197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:51.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.899+0000 7f3165400700 1 --2- 172.21.15.111:0/2060834046 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3168102600 0x7f3168197ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:51.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.899+0000 7f3165400700 1 -- 172.21.15.111:0/2060834046 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31540095f0 con 0x7f3168102fa0 2024-09-11T00:18:51.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.899+0000 7f3165400700 1 --2- 172.21.15.111:0/2060834046 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3168102fa0 0x7f3168198530 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f31540092e0 tx=0x7f315400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:51.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.899+0000 7f315ea00700 1 -- 172.21.15.111:0/2060834046 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f315401d070 con 0x7f3168102fa0 2024-09-11T00:18:51.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.900+0000 7f315ea00700 1 -- 172.21.15.111:0/2060834046 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3154005dc0 con 0x7f3168102fa0 2024-09-11T00:18:51.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.900+0000 7f316cc00700 1 -- 172.21.15.111:0/2060834046 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f316819cc20 con 0x7f3168102fa0 2024-09-11T00:18:51.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.900+0000 7f315ea00700 1 -- 172.21.15.111:0/2060834046 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3154017400 con 0x7f3168102fa0 2024-09-11T00:18:51.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.900+0000 7f316cc00700 1 -- 172.21.15.111:0/2060834046 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f316819d110 con 0x7f3168102fa0 2024-09-11T00:18:51.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.901+0000 7f316cc00700 1 -- 172.21.15.111:0/2060834046 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f316804ea50 con 0x7f3168102fa0 2024-09-11T00:18:51.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.902+0000 7f315ea00700 1 -- 172.21.15.111:0/2060834046 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f315400f6f0 con 0x7f3168102fa0 2024-09-11T00:18:51.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.903+0000 7f315ea00700 1 --2- 172.21.15.111:0/2060834046 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f314c07a6f0 0x7f314c07cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:51.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.903+0000 7f315ea00700 1 -- 172.21.15.111:0/2060834046 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f315409e780 con 0x7f3168102fa0 2024-09-11T00:18:51.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.903+0000 7f3165e00700 1 --2- 172.21.15.111:0/2060834046 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f314c07a6f0 0x7f314c07cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:51.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.904+0000 7f3165e00700 1 --2- 172.21.15.111:0/2060834046 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f314c07a6f0 0x7f314c07cba0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3158005950 tx=0x7f315800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:51.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:51.907+0000 7f315ea00700 1 -- 172.21.15.111:0/2060834046 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f3154061dd0 con 0x7f3168102fa0 2024-09-11T00:18:51.946 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:51 smithi203 ceph-mon[69002]: mds.? [v2:172.21.15.111:6826/3970632147,v1:172.21.15.111:6827/3970632147] up:rejoin 2024-09-11T00:18:51.946 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:51 smithi203 ceph-mon[69002]: fsmap cephfs:1/1 {0=cephfs.smithi111.gmgsay=up:rejoin} 2 up:standby 2024-09-11T00:18:51.946 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:51 smithi203 ceph-mon[69002]: daemon mds.cephfs.smithi111.gmgsay is now active in filesystem cephfs as rank 0 2024-09-11T00:18:52.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.140+0000 7f316cc00700 1 -- 172.21.15.111:0/2060834046 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f316819d5f0 con 0x7f314c07a6f0 2024-09-11T00:18:52.143 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:51 smithi111 ceph-mon[90842]: mds.? [v2:172.21.15.111:6826/3970632147,v1:172.21.15.111:6827/3970632147] up:rejoin 2024-09-11T00:18:52.143 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:51 smithi111 ceph-mon[90842]: fsmap cephfs:1/1 {0=cephfs.smithi111.gmgsay=up:rejoin} 2 up:standby 2024-09-11T00:18:52.143 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:51 smithi111 ceph-mon[90842]: daemon mds.cephfs.smithi111.gmgsay is now active in filesystem cephfs as rank 0 2024-09-11T00:18:52.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.150+0000 7f315ea00700 1 -- 172.21.15.111:0/2060834046 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f316819d5f0 con 0x7f314c07a6f0 2024-09-11T00:18:52.152 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:18:52.152 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (8m) 48s ago 21m 15.5M - 0.27.0 11f11916f8cd d6d3253e881f 2024-09-11T00:18:52.152 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (11m) 48s ago 22m 8644k - 18.2.0 dc2bc1663786 7c40af85314c 2024-09-11T00:18:52.152 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi203 smithi203 running (10m) 19s ago 21m 9013k - 18.2.0 dc2bc1663786 922e3261ff70 2024-09-11T00:18:52.153 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (5m) 48s ago 22m 6899k - 19.3.0-4854-g8f219c47 589dd18248e4 a9cacdb9a638 2024-09-11T00:18:52.153 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi203 smithi203 running (5m) 19s ago 21m 6899k - 19.3.0-4854-g8f219c47 589dd18248e4 d452d9dfa04b 2024-09-11T00:18:52.153 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (7m) 48s ago 21m 68.1M - c8b91775d855 7d3b50b5b59f 2024-09-11T00:18:52.153 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.gmgsay smithi111 running (75s) 48s ago 15m 12.4M - 19.3.0-4854-g8f219c47 589dd18248e4 a8cff96fcbbe 2024-09-11T00:18:52.153 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.rucaba smithi111 running (54s) 48s ago 14m 11.9M - 19.3.0-4854-g8f219c47 589dd18248e4 63a1d760686d 2024-09-11T00:18:52.153 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.tcrqop smithi203 running (24s) 19s ago 14m 11.5M - 19.3.0-4854-g8f219c47 589dd18248e4 f9cc4db8b461 2024-09-11T00:18:52.153 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.uqkbkn smithi203 starting - - - - 2024-09-11T00:18:52.153 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.ypucji smithi111 *:8443,9283,8765 running (10m) 48s ago 23m 518M - 19.3.0-4854-g8f219c47 589dd18248e4 07fa31f49618 2024-09-11T00:18:52.153 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi203.smuspl smithi203 *:8443,9283,8765 running (9m) 19s ago 20m 457M - 19.3.0-4854-g8f219c47 589dd18248e4 7e5a93a5ffa7 2024-09-11T00:18:52.153 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (6m) 48s ago 23m 55.2M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 3c29c070a612 2024-09-11T00:18:52.153 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi203 smithi203 running (6m) 19s ago 20m 45.4M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 45e8285e4b4d 2024-09-11T00:18:52.153 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (9m) 48s ago 22m 8418k - 1.7.0 72c9c2088986 ec478ea14488 2024-09-11T00:18:52.153 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi203 smithi203 *:9100 running (9m) 19s ago 20m 7780k - 1.7.0 72c9c2088986 54d461cde1bc 2024-09-11T00:18:52.153 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (4m) 48s ago 19m 94.0M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 d2f1a2312736 2024-09-11T00:18:52.154 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (4m) 48s ago 18m 94.9M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 19cf95ecca7d 2024-09-11T00:18:52.154 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (3m) 48s ago 18m 77.0M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 3a3b318b337a 2024-09-11T00:18:52.154 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi203 running (2m) 19s ago 17m 104M 2240M 19.3.0-4854-g8f219c47 589dd18248e4 288c7e8ae34b 2024-09-11T00:18:52.154 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi203 running (2m) 19s ago 17m 95.0M 2240M 19.3.0-4854-g8f219c47 589dd18248e4 485f82d3eafb 2024-09-11T00:18:52.154 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi203 running (93s) 19s ago 16m 94.2M 2240M 19.3.0-4854-g8f219c47 589dd18248e4 ef4834f3adf1 2024-09-11T00:18:52.154 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (8m) 48s ago 21m 63.6M - 2.51.0 1d3b7f56885b 3e72ac10983d 2024-09-11T00:18:52.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.155+0000 7f316cc00700 1 -- 172.21.15.111:0/2060834046 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f314c07a6f0 msgr2=0x7f314c07cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:52.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.155+0000 7f316cc00700 1 --2- 172.21.15.111:0/2060834046 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f314c07a6f0 0x7f314c07cba0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3158005950 tx=0x7f315800b410 comp rx=0 tx=0).stop 2024-09-11T00:18:52.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.155+0000 7f316cc00700 1 -- 172.21.15.111:0/2060834046 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3168102fa0 msgr2=0x7f3168198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:52.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.155+0000 7f316cc00700 1 --2- 172.21.15.111:0/2060834046 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3168102fa0 0x7f3168198530 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f31540092e0 tx=0x7f315400bd70 comp rx=0 tx=0).stop 2024-09-11T00:18:52.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.155+0000 7f316cc00700 1 -- 172.21.15.111:0/2060834046 shutdown_connections 2024-09-11T00:18:52.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.155+0000 7f316cc00700 1 --2- 172.21.15.111:0/2060834046 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f314c07a6f0 0x7f314c07cba0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.155+0000 7f316cc00700 1 --2- 172.21.15.111:0/2060834046 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3168102600 0x7f3168197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.155+0000 7f316cc00700 1 --2- 172.21.15.111:0/2060834046 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3168102fa0 0x7f3168198530 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.155+0000 7f316cc00700 1 -- 172.21.15.111:0/2060834046 >> 172.21.15.111:0/2060834046 conn(0x7f31680fdec0 msgr2=0x7f31680ff4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:52.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.155+0000 7f316cc00700 1 -- 172.21.15.111:0/2060834046 shutdown_connections 2024-09-11T00:18:52.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.155+0000 7f316cc00700 1 -- 172.21.15.111:0/2060834046 wait complete. 2024-09-11T00:18:52.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.301+0000 7f3888400700 1 -- 172.21.15.111:0/2531039001 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f38801003d0 msgr2=0x7f38801007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:52.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.301+0000 7f3888400700 1 --2- 172.21.15.111:0/2531039001 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f38801003d0 0x7f38801007a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3874009910 tx=0x7f3874009c20 comp rx=0 tx=0).stop 2024-09-11T00:18:52.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.301+0000 7f3888400700 1 -- 172.21.15.111:0/2531039001 shutdown_connections 2024-09-11T00:18:52.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.301+0000 7f3888400700 1 --2- 172.21.15.111:0/2531039001 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3880100d70 0x7f3880104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.301+0000 7f3888400700 1 --2- 172.21.15.111:0/2531039001 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f38801003d0 0x7f38801007a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.301+0000 7f3888400700 1 -- 172.21.15.111:0/2531039001 >> 172.21.15.111:0/2531039001 conn(0x7f38800fbc50 msgr2=0x7f38800fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:52.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.301+0000 7f3888400700 1 -- 172.21.15.111:0/2531039001 shutdown_connections 2024-09-11T00:18:52.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.301+0000 7f3888400700 1 -- 172.21.15.111:0/2531039001 wait complete. 2024-09-11T00:18:52.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.302+0000 7f3888400700 1 Processor -- start 2024-09-11T00:18:52.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.302+0000 7f3888400700 1 -- start start 2024-09-11T00:18:52.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.302+0000 7f3888400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38801003d0 0x7f3880073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:52.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.302+0000 7f3888400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3880100d70 0x7f3880073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:52.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.302+0000 7f3888400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3880073ad0 con 0x7f3880100d70 2024-09-11T00:18:52.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.302+0000 7f3888400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3880073c10 con 0x7f38801003d0 2024-09-11T00:18:52.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.303+0000 7f3885000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3880100d70 0x7f3880073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:52.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.303+0000 7f3885a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38801003d0 0x7f3880073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:52.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.303+0000 7f3885a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38801003d0 0x7f3880073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.111:41278/0 (socket says 172.21.15.111:41278) 2024-09-11T00:18:52.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.303+0000 7f3885a00700 1 -- 172.21.15.111:0/703492846 learned_addr learned my addr 172.21.15.111:0/703492846 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:18:52.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.303+0000 7f3885a00700 1 -- 172.21.15.111:0/703492846 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3880100d70 msgr2=0x7f3880073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:52.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.303+0000 7f3885a00700 1 --2- 172.21.15.111:0/703492846 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3880100d70 0x7f3880073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.303+0000 7f3885a00700 1 -- 172.21.15.111:0/703492846 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38740095f0 con 0x7f38801003d0 2024-09-11T00:18:52.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.303+0000 7f3885a00700 1 --2- 172.21.15.111:0/703492846 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38801003d0 0x7f3880073050 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3874005f50 tx=0x7f387400f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:52.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.304+0000 7f387e000700 1 -- 172.21.15.111:0/703492846 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f387401d070 con 0x7f38801003d0 2024-09-11T00:18:52.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.304+0000 7f3888400700 1 -- 172.21.15.111:0/703492846 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3880073e90 con 0x7f38801003d0 2024-09-11T00:18:52.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.304+0000 7f387e000700 1 -- 172.21.15.111:0/703492846 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f387400b610 con 0x7f38801003d0 2024-09-11T00:18:52.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.304+0000 7f387e000700 1 -- 172.21.15.111:0/703492846 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3874022470 con 0x7f38801003d0 2024-09-11T00:18:52.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.304+0000 7f3888400700 1 -- 172.21.15.111:0/703492846 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38801a22b0 con 0x7f38801003d0 2024-09-11T00:18:52.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.305+0000 7f3888400700 1 -- 172.21.15.111:0/703492846 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38801086e0 con 0x7f38801003d0 2024-09-11T00:18:52.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.306+0000 7f387e000700 1 -- 172.21.15.111:0/703492846 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f3874003780 con 0x7f38801003d0 2024-09-11T00:18:52.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.307+0000 7f387e000700 1 --2- 172.21.15.111:0/703492846 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f386807a6f0 0x7f386807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:52.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.307+0000 7f387e000700 1 -- 172.21.15.111:0/703492846 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f387409e730 con 0x7f38801003d0 2024-09-11T00:18:52.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.307+0000 7f3885000700 1 --2- 172.21.15.111:0/703492846 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f386807a6f0 0x7f386807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:52.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.308+0000 7f3885000700 1 --2- 172.21.15.111:0/703492846 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f386807a6f0 0x7f386807cba0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3880074840 tx=0x7f386c009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:52.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.316+0000 7f387e000700 1 -- 172.21.15.111:0/703492846 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f3874061d80 con 0x7f38801003d0 2024-09-11T00:18:52.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.630+0000 7f3888400700 1 -- 172.21.15.111:0/703492846 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f388004ea50 con 0x7f38801003d0 2024-09-11T00:18:52.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.631+0000 7f387e000700 1 -- 172.21.15.111:0/703492846 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f3874064ea0 con 0x7f38801003d0 2024-09-11T00:18:52.633 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:18:52.633 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-11T00:18:52.633 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:18:52.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:18:52.633 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-11T00:18:52.633 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:18:52.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:18:52.633 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-11T00:18:52.633 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 6 2024-09-11T00:18:52.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:18:52.633 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-11T00:18:52.634 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 4 2024-09-11T00:18:52.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:18:52.634 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-11T00:18:52.634 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 14 2024-09-11T00:18:52.634 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-11T00:18:52.634 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:18:52.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.633+0000 7f3888400700 1 -- 172.21.15.111:0/703492846 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f386807a6f0 msgr2=0x7f386807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:52.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.633+0000 7f3888400700 1 --2- 172.21.15.111:0/703492846 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f386807a6f0 0x7f386807cba0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3880074840 tx=0x7f386c009260 comp rx=0 tx=0).stop 2024-09-11T00:18:52.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.633+0000 7f3888400700 1 -- 172.21.15.111:0/703492846 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38801003d0 msgr2=0x7f3880073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:52.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.633+0000 7f3888400700 1 --2- 172.21.15.111:0/703492846 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38801003d0 0x7f3880073050 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3874005f50 tx=0x7f387400f690 comp rx=0 tx=0).stop 2024-09-11T00:18:52.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.633+0000 7f3888400700 1 -- 172.21.15.111:0/703492846 shutdown_connections 2024-09-11T00:18:52.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.633+0000 7f3888400700 1 --2- 172.21.15.111:0/703492846 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f386807a6f0 0x7f386807cba0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.633+0000 7f3888400700 1 --2- 172.21.15.111:0/703492846 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38801003d0 0x7f3880073050 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.633+0000 7f3888400700 1 --2- 172.21.15.111:0/703492846 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3880100d70 0x7f3880073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.633+0000 7f3888400700 1 -- 172.21.15.111:0/703492846 >> 172.21.15.111:0/703492846 conn(0x7f38800fbc50 msgr2=0x7f38800fd260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:52.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.633+0000 7f3888400700 1 -- 172.21.15.111:0/703492846 shutdown_connections 2024-09-11T00:18:52.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.633+0000 7f3888400700 1 -- 172.21.15.111:0/703492846 wait complete. 2024-09-11T00:18:52.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.773+0000 7fa202400700 1 -- 172.21.15.111:0/3075894238 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1fc102600 msgr2=0x7fa1fc1029d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:52.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.773+0000 7fa202400700 1 --2- 172.21.15.111:0/3075894238 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1fc102600 0x7fa1fc1029d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec009910 tx=0x7fa1ec009c20 comp rx=0 tx=0).stop 2024-09-11T00:18:52.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.773+0000 7fa202400700 1 -- 172.21.15.111:0/3075894238 shutdown_connections 2024-09-11T00:18:52.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.773+0000 7fa202400700 1 --2- 172.21.15.111:0/3075894238 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1fc102fa0 0x7fa1fc106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.773+0000 7fa202400700 1 --2- 172.21.15.111:0/3075894238 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1fc102600 0x7fa1fc1029d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.773+0000 7fa202400700 1 -- 172.21.15.111:0/3075894238 >> 172.21.15.111:0/3075894238 conn(0x7fa1fc0fdec0 msgr2=0x7fa1fc1002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:52.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.773+0000 7fa202400700 1 -- 172.21.15.111:0/3075894238 shutdown_connections 2024-09-11T00:18:52.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.773+0000 7fa202400700 1 -- 172.21.15.111:0/3075894238 wait complete. 2024-09-11T00:18:52.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.774+0000 7fa202400700 1 Processor -- start 2024-09-11T00:18:52.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.774+0000 7fa202400700 1 -- start start 2024-09-11T00:18:52.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.774+0000 7fa202400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1fc102600 0x7fa1fc198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:52.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.774+0000 7fa202400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1fc102fa0 0x7fa1fc198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:52.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.774+0000 7fa202400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc198c50 con 0x7fa1fc102600 2024-09-11T00:18:52.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.774+0000 7fa202400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc19c9e0 con 0x7fa1fc102fa0 2024-09-11T00:18:52.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.775+0000 7fa1fb400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1fc102600 0x7fa1fc198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:52.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.775+0000 7fa1fb400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1fc102600 0x7fa1fc198030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52104/0 (socket says 172.21.15.111:52104) 2024-09-11T00:18:52.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.775+0000 7fa1fb400700 1 -- 172.21.15.111:0/2194510704 learned_addr learned my addr 172.21.15.111:0/2194510704 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:18:52.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.775+0000 7fa1fb400700 1 -- 172.21.15.111:0/2194510704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1fc102fa0 msgr2=0x7fa1fc198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:52.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.775+0000 7fa1fb400700 1 --2- 172.21.15.111:0/2194510704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1fc102fa0 0x7fa1fc198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.775+0000 7fa1fb400700 1 -- 172.21.15.111:0/2194510704 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ec0095f0 con 0x7fa1fc102600 2024-09-11T00:18:52.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.775+0000 7fa1fb400700 1 --2- 172.21.15.111:0/2194510704 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1fc102600 0x7fa1fc198030 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00b5c0 tx=0x7fa1ec00be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:52.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.776+0000 7fa1f3e00700 1 -- 172.21.15.111:0/2194510704 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1ec01d070 con 0x7fa1fc102600 2024-09-11T00:18:52.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.776+0000 7fa1f3e00700 1 -- 172.21.15.111:0/2194510704 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa1ec00f460 con 0x7fa1fc102600 2024-09-11T00:18:52.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.776+0000 7fa202400700 1 -- 172.21.15.111:0/2194510704 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1fc19cc60 con 0x7fa1fc102600 2024-09-11T00:18:52.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.776+0000 7fa1f3e00700 1 -- 172.21.15.111:0/2194510704 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1ec017610 con 0x7fa1fc102600 2024-09-11T00:18:52.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.776+0000 7fa202400700 1 -- 172.21.15.111:0/2194510704 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1fc19d150 con 0x7fa1fc102600 2024-09-11T00:18:52.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.777+0000 7fa202400700 1 -- 172.21.15.111:0/2194510704 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1fc10a910 con 0x7fa1fc102600 2024-09-11T00:18:52.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.778+0000 7fa1f3e00700 1 -- 172.21.15.111:0/2194510704 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fa1ec00f5d0 con 0x7fa1fc102600 2024-09-11T00:18:52.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.779+0000 7fa1f3e00700 1 --2- 172.21.15.111:0/2194510704 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa1e007a6f0 0x7fa1e007cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:52.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.779+0000 7fa1f3e00700 1 -- 172.21.15.111:0/2194510704 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa1ec09e990 con 0x7fa1fc102600 2024-09-11T00:18:52.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.779+0000 7fa1faa00700 1 --2- 172.21.15.111:0/2194510704 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa1e007a6f0 0x7fa1e007cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:52.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.780+0000 7fa1faa00700 1 --2- 172.21.15.111:0/2194510704 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa1e007a6f0 0x7fa1e007cba0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc199650 tx=0x7fa1e8006d20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:52.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:52.784+0000 7fa1f3e00700 1 -- 172.21.15.111:0/2194510704 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fa1ec061fe0 con 0x7fa1fc102600 2024-09-11T00:18:52.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:52 smithi111 ceph-mon[90842]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:18:52.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:52 smithi111 ceph-mon[90842]: pgmap v228: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 7 op/s 2024-09-11T00:18:52.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:52 smithi111 ceph-mon[90842]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T00:18:52.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:52 smithi111 ceph-mon[90842]: mds.? [v2:172.21.15.111:6826/3970632147,v1:172.21.15.111:6827/3970632147] up:active 2024-09-11T00:18:52.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:52 smithi111 ceph-mon[90842]: fsmap cephfs:1 {0=cephfs.smithi111.gmgsay=up:active} 2 up:standby 2024-09-11T00:18:52.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:52 smithi111 ceph-mon[90842]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:18:52.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:52 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:52.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:52 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:52.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:52 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:18:52.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:52 smithi111 ceph-mon[90842]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:18:52.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:52 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/703492846' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:18:53.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:52 smithi203 ceph-mon[69002]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:18:53.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:52 smithi203 ceph-mon[69002]: pgmap v228: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 7 op/s 2024-09-11T00:18:53.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:52 smithi203 ceph-mon[69002]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T00:18:53.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:52 smithi203 ceph-mon[69002]: mds.? [v2:172.21.15.111:6826/3970632147,v1:172.21.15.111:6827/3970632147] up:active 2024-09-11T00:18:53.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:52 smithi203 ceph-mon[69002]: fsmap cephfs:1 {0=cephfs.smithi111.gmgsay=up:active} 2 up:standby 2024-09-11T00:18:53.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:52 smithi203 ceph-mon[69002]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:18:53.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:52 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:53.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:52 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:53.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:52 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:18:53.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:52 smithi203 ceph-mon[69002]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:18:53.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:52 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/703492846' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:18:53.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.055+0000 7fa202400700 1 -- 172.21.15.111:0/2194510704 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa1fc04ea50 con 0x7fa1fc102600 2024-09-11T00:18:53.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.056+0000 7fa1f3e00700 1 -- 172.21.15.111:0/2194510704 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) v1 ==== 76+0+1977 (secure 0 0 0) 0x7fa1ec065100 con 0x7fa1fc102600 2024-09-11T00:18:53.058 INFO:teuthology.orchestra.run.smithi111.stdout:e31 2024-09-11T00:18:53.058 INFO:teuthology.orchestra.run.smithi111.stdout:btime 2024-09-11T00:18:52:741769+0000 2024-09-11T00:18:53.058 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T00:18:53.058 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:18:53.058 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-11T00:18:53.058 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:18:53.058 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-11T00:18:53.058 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-11T00:18:53.058 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 30 2024-09-11T00:18:53.058 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-11T00:18:53.058 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-11T00:03:47.950356+0000 2024-09-11T00:18:53.059 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-11T00:18:51.735036+0000 2024-09-11T00:18:53.059 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-11T00:18:53.059 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-11T00:18:53.059 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-11T00:18:53.059 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-11T00:18:53.059 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-11T00:18:53.059 INFO:teuthology.orchestra.run.smithi111.stdout:max_xattr_size 65536 2024-09-11T00:18:53.059 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-11T00:18:53.059 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-11T00:18:53.059 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 84 2024-09-11T00:18:53.059 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T00:18:53.059 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-11T00:18:53.059 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-11T00:18:53.059 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=34406} 2024-09-11T00:18:53.059 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-11T00:18:53.060 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-11T00:18:53.060 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-11T00:18:53.060 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-11T00:18:53.060 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-11T00:18:53.060 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data enabled 2024-09-11T00:18:53.060 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-11T00:18:53.060 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-11T00:18:53.060 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 1 2024-09-11T00:18:53.060 INFO:teuthology.orchestra.run.smithi111.stdout:qdb_cluster leader: 34406 members: 34406 2024-09-11T00:18:53.060 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.gmgsay{0:34406} state up:active seq 22 join_fscid=1 addr [v2:172.21.15.111:6826/3970632147,v1:172.21.15.111:6827/3970632147] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:18:53.060 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:18:53.060 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:18:53.060 INFO:teuthology.orchestra.run.smithi111.stdout:Standby daemons: 2024-09-11T00:18:53.060 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:18:53.060 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.rucaba{-1:34438} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.111:6828/36584465,v1:172.21.15.111:6829/36584465] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:18:53.061 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.tcrqop{-1:44379} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.203:6824/4221647525,v1:172.21.15.203:6825/4221647525] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:18:53.061 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.uqkbkn{-1:44393} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.203:6826/1792805040,v1:172.21.15.203:6827/1792805040] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:18:53.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.058+0000 7fa202400700 1 -- 172.21.15.111:0/2194510704 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa1e007a6f0 msgr2=0x7fa1e007cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:53.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.058+0000 7fa202400700 1 --2- 172.21.15.111:0/2194510704 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa1e007a6f0 0x7fa1e007cba0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc199650 tx=0x7fa1e8006d20 comp rx=0 tx=0).stop 2024-09-11T00:18:53.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.058+0000 7fa202400700 1 -- 172.21.15.111:0/2194510704 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1fc102600 msgr2=0x7fa1fc198030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:53.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.058+0000 7fa202400700 1 --2- 172.21.15.111:0/2194510704 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1fc102600 0x7fa1fc198030 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00b5c0 tx=0x7fa1ec00be00 comp rx=0 tx=0).stop 2024-09-11T00:18:53.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.059+0000 7fa202400700 1 -- 172.21.15.111:0/2194510704 shutdown_connections 2024-09-11T00:18:53.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.059+0000 7fa202400700 1 --2- 172.21.15.111:0/2194510704 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa1e007a6f0 0x7fa1e007cba0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:53.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.059+0000 7fa202400700 1 --2- 172.21.15.111:0/2194510704 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1fc102600 0x7fa1fc198030 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:53.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.059+0000 7fa202400700 1 --2- 172.21.15.111:0/2194510704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1fc102fa0 0x7fa1fc198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:53.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.059+0000 7fa202400700 1 -- 172.21.15.111:0/2194510704 >> 172.21.15.111:0/2194510704 conn(0x7fa1fc0fdec0 msgr2=0x7fa1fc1002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:53.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.059+0000 7fa202400700 1 -- 172.21.15.111:0/2194510704 shutdown_connections 2024-09-11T00:18:53.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.059+0000 7fa202400700 1 -- 172.21.15.111:0/2194510704 wait complete. 2024-09-11T00:18:53.062 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 31 2024-09-11T00:18:53.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.197+0000 7faff7400700 1 -- 172.21.15.111:0/4142162870 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faff00730f0 msgr2=0x7faff00734c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:53.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.197+0000 7faff7400700 1 --2- 172.21.15.111:0/4142162870 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faff00730f0 0x7faff00734c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fafe4009910 tx=0x7fafe4009c20 comp rx=0 tx=0).stop 2024-09-11T00:18:53.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.197+0000 7faff7400700 1 -- 172.21.15.111:0/4142162870 shutdown_connections 2024-09-11T00:18:53.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.197+0000 7faff7400700 1 --2- 172.21.15.111:0/4142162870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faff0073a00 0x7faff0110c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:53.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.197+0000 7faff7400700 1 --2- 172.21.15.111:0/4142162870 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faff00730f0 0x7faff00734c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:53.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.197+0000 7faff7400700 1 -- 172.21.15.111:0/4142162870 >> 172.21.15.111:0/4142162870 conn(0x7faff00fbc30 msgr2=0x7faff00fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:53.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.197+0000 7faff7400700 1 -- 172.21.15.111:0/4142162870 shutdown_connections 2024-09-11T00:18:53.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.197+0000 7faff7400700 1 -- 172.21.15.111:0/4142162870 wait complete. 2024-09-11T00:18:53.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.198+0000 7faff7400700 1 Processor -- start 2024-09-11T00:18:53.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.198+0000 7faff7400700 1 -- start start 2024-09-11T00:18:53.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.198+0000 7faff7400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faff00730f0 0x7faff019c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:53.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.198+0000 7faff7400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faff0073a00 0x7faff019c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:53.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.199+0000 7faff7400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff019cea0 con 0x7faff0073a00 2024-09-11T00:18:53.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.199+0000 7faff7400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff01a0c30 con 0x7faff00730f0 2024-09-11T00:18:53.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.199+0000 7fafefe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faff0073a00 0x7faff019c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:53.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.199+0000 7faff4a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faff00730f0 0x7faff019c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:53.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.199+0000 7faff4a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faff00730f0 0x7faff019c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.111:41330/0 (socket says 172.21.15.111:41330) 2024-09-11T00:18:53.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.199+0000 7fafefe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faff0073a00 0x7faff019c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52122/0 (socket says 172.21.15.111:52122) 2024-09-11T00:18:53.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.199+0000 7faff4a00700 1 -- 172.21.15.111:0/4087498185 learned_addr learned my addr 172.21.15.111:0/4087498185 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:18:53.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.199+0000 7fafefe00700 1 -- 172.21.15.111:0/4087498185 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faff00730f0 msgr2=0x7faff019c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:53.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.199+0000 7fafefe00700 1 --2- 172.21.15.111:0/4087498185 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faff00730f0 0x7faff019c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:53.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.199+0000 7fafefe00700 1 -- 172.21.15.111:0/4087498185 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe40095f0 con 0x7faff0073a00 2024-09-11T00:18:53.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.200+0000 7fafefe00700 1 --2- 172.21.15.111:0/4087498185 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faff0073a00 0x7faff019c7c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fafdc00e970 tx=0x7fafdc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:53.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.200+0000 7fafed600700 1 -- 172.21.15.111:0/4087498185 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafdc00c9d0 con 0x7faff0073a00 2024-09-11T00:18:53.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.200+0000 7fafed600700 1 -- 172.21.15.111:0/4087498185 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fafdc010430 con 0x7faff0073a00 2024-09-11T00:18:53.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.200+0000 7faff7400700 1 -- 172.21.15.111:0/4087498185 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff01a0f10 con 0x7faff0073a00 2024-09-11T00:18:53.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.200+0000 7fafed600700 1 -- 172.21.15.111:0/4087498185 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafdc018630 con 0x7faff0073a00 2024-09-11T00:18:53.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.200+0000 7faff7400700 1 -- 172.21.15.111:0/4087498185 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff01a1460 con 0x7faff0073a00 2024-09-11T00:18:53.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.201+0000 7faff7400700 1 -- 172.21.15.111:0/4087498185 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff010e3a0 con 0x7faff0073a00 2024-09-11T00:18:53.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.202+0000 7fafed600700 1 -- 172.21.15.111:0/4087498185 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fafdc0105a0 con 0x7faff0073a00 2024-09-11T00:18:53.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.203+0000 7fafed600700 1 --2- 172.21.15.111:0/4087498185 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fafd807a6f0 0x7fafd807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:53.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.203+0000 7fafed600700 1 -- 172.21.15.111:0/4087498185 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fafdc014070 con 0x7faff0073a00 2024-09-11T00:18:53.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.203+0000 7faff4a00700 1 --2- 172.21.15.111:0/4087498185 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fafd807a6f0 0x7fafd807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:53.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.204+0000 7faff4a00700 1 --2- 172.21.15.111:0/4087498185 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fafd807a6f0 0x7fafd807cba0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fafe400b760 tx=0x7fafe4005ad0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:53.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.207+0000 7fafed600700 1 -- 172.21.15.111:0/4087498185 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fafdc060ba0 con 0x7faff0073a00 2024-09-11T00:18:53.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.450+0000 7faff7400700 1 -- 172.21.15.111:0/4087498185 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faff01a1810 con 0x7fafd807a6f0 2024-09-11T00:18:53.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.452+0000 7fafed600700 1 -- 172.21.15.111:0/4087498185 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7faff01a1810 con 0x7fafd807a6f0 2024-09-11T00:18:53.454 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:18:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e", 2024-09-11T00:18:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-11T00:18:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-11T00:18:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-11T00:18:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "crash", 2024-09-11T00:18:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "osd", 2024-09-11T00:18:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr", 2024-09-11T00:18:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "mon" 2024-09-11T00:18:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-11T00:18:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "15/23 daemons upgraded", 2024-09-11T00:18:53.454 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading mds daemons", 2024-09-11T00:18:53.455 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-11T00:18:53.455 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:18:53.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.454+0000 7faff7400700 1 -- 172.21.15.111:0/4087498185 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fafd807a6f0 msgr2=0x7fafd807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:53.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.454+0000 7faff7400700 1 --2- 172.21.15.111:0/4087498185 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fafd807a6f0 0x7fafd807cba0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fafe400b760 tx=0x7fafe4005ad0 comp rx=0 tx=0).stop 2024-09-11T00:18:53.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.454+0000 7faff7400700 1 -- 172.21.15.111:0/4087498185 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faff0073a00 msgr2=0x7faff019c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:53.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.454+0000 7faff7400700 1 --2- 172.21.15.111:0/4087498185 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faff0073a00 0x7faff019c7c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fafdc00e970 tx=0x7fafdc00ec80 comp rx=0 tx=0).stop 2024-09-11T00:18:53.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.454+0000 7faff7400700 1 -- 172.21.15.111:0/4087498185 shutdown_connections 2024-09-11T00:18:53.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.454+0000 7faff7400700 1 --2- 172.21.15.111:0/4087498185 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fafd807a6f0 0x7fafd807cba0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:53.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.454+0000 7faff7400700 1 --2- 172.21.15.111:0/4087498185 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faff00730f0 0x7faff019c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:53.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.454+0000 7faff7400700 1 --2- 172.21.15.111:0/4087498185 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faff0073a00 0x7faff019c7c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:53.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.454+0000 7faff7400700 1 -- 172.21.15.111:0/4087498185 >> 172.21.15.111:0/4087498185 conn(0x7faff00fbc30 msgr2=0x7faff0102730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:53.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.454+0000 7faff7400700 1 -- 172.21.15.111:0/4087498185 shutdown_connections 2024-09-11T00:18:53.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.455+0000 7faff7400700 1 -- 172.21.15.111:0/4087498185 wait complete. 2024-09-11T00:18:53.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.595+0000 7f3743200700 1 -- 172.21.15.111:0/1721704832 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f373c102610 msgr2=0x7f373c1029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:53.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.595+0000 7f3743200700 1 --2- 172.21.15.111:0/1721704832 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f373c102610 0x7f373c1029e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f372c009910 tx=0x7f372c009c20 comp rx=0 tx=0).stop 2024-09-11T00:18:53.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.595+0000 7f3743200700 1 -- 172.21.15.111:0/1721704832 shutdown_connections 2024-09-11T00:18:53.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.595+0000 7f3743200700 1 --2- 172.21.15.111:0/1721704832 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f373c102fb0 0x7f373c106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:53.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.595+0000 7f3743200700 1 --2- 172.21.15.111:0/1721704832 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f373c102610 0x7f373c1029e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:53.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.595+0000 7f3743200700 1 -- 172.21.15.111:0/1721704832 >> 172.21.15.111:0/1721704832 conn(0x7f373c0fde90 msgr2=0x7f373c1002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:53.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.595+0000 7f3743200700 1 -- 172.21.15.111:0/1721704832 shutdown_connections 2024-09-11T00:18:53.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.595+0000 7f3743200700 1 -- 172.21.15.111:0/1721704832 wait complete. 2024-09-11T00:18:53.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.596+0000 7f3743200700 1 Processor -- start 2024-09-11T00:18:53.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.597+0000 7f3743200700 1 -- start start 2024-09-11T00:18:53.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.597+0000 7f3743200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f373c102610 0x7f373c197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:53.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.597+0000 7f3743200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f373c102fb0 0x7f373c198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:53.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.597+0000 7f3743200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c198be0 con 0x7f373c102fb0 2024-09-11T00:18:53.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.597+0000 7f3743200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c19c970 con 0x7f373c102610 2024-09-11T00:18:53.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.597+0000 7f373b400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f373c102fb0 0x7f373c198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:53.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.597+0000 7f373be00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f373c102610 0x7f373c197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:53.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.597+0000 7f373b400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f373c102fb0 0x7f373c198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52154/0 (socket says 172.21.15.111:52154) 2024-09-11T00:18:53.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.597+0000 7f373b400700 1 -- 172.21.15.111:0/2975384156 learned_addr learned my addr 172.21.15.111:0/2975384156 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:18:53.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.598+0000 7f373b400700 1 -- 172.21.15.111:0/2975384156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f373c102610 msgr2=0x7f373c197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:53.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.598+0000 7f373b400700 1 --2- 172.21.15.111:0/2975384156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f373c102610 0x7f373c197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:53.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.598+0000 7f373b400700 1 -- 172.21.15.111:0/2975384156 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372c0095f0 con 0x7f373c102fb0 2024-09-11T00:18:53.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.598+0000 7f373be00700 1 --2- 172.21.15.111:0/2975384156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f373c102610 0x7f373c197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:18:53.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.598+0000 7f373b400700 1 --2- 172.21.15.111:0/2975384156 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f373c102fb0 0x7f373c198500 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f372800e8f0 tx=0x7f372800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:53.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.598+0000 7f3738c00700 1 -- 172.21.15.111:0/2975384156 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3728009790 con 0x7f373c102fb0 2024-09-11T00:18:53.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.598+0000 7f3738c00700 1 -- 172.21.15.111:0/2975384156 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f372800c810 con 0x7f373c102fb0 2024-09-11T00:18:53.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.598+0000 7f3743200700 1 -- 172.21.15.111:0/2975384156 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f373c19cc50 con 0x7f373c102fb0 2024-09-11T00:18:53.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.598+0000 7f3738c00700 1 -- 172.21.15.111:0/2975384156 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3728005580 con 0x7f373c102fb0 2024-09-11T00:18:53.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.598+0000 7f3743200700 1 -- 172.21.15.111:0/2975384156 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f373c19d1a0 con 0x7f373c102fb0 2024-09-11T00:18:53.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.600+0000 7f3743200700 1 -- 172.21.15.111:0/2975384156 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f373c04ea50 con 0x7f373c102fb0 2024-09-11T00:18:53.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.601+0000 7f3738c00700 1 -- 172.21.15.111:0/2975384156 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f372800c980 con 0x7f373c102fb0 2024-09-11T00:18:53.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.603+0000 7f3738c00700 1 --2- 172.21.15.111:0/2975384156 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f372007a6f0 0x7f372007cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:53.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.603+0000 7f3738c00700 1 -- 172.21.15.111:0/2975384156 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f3728014070 con 0x7f373c102fb0 2024-09-11T00:18:53.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.603+0000 7f373be00700 1 --2- 172.21.15.111:0/2975384156 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f372007a6f0 0x7f372007cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:53.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.604+0000 7f373be00700 1 --2- 172.21.15.111:0/2975384156 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f372007a6f0 0x7f372007cba0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f372c005b40 tx=0x7f372c005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:53.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.607+0000 7f3738c00700 1 -- 172.21.15.111:0/2975384156 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f3728060c30 con 0x7f373c102fb0 2024-09-11T00:18:53.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.930+0000 7f3743200700 1 -- 172.21.15.111:0/2975384156 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f373c199320 con 0x7f373c102fb0 2024-09-11T00:18:53.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.930+0000 7f3738c00700 1 -- 172.21.15.111:0/2975384156 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f3728063d50 con 0x7f373c102fb0 2024-09-11T00:18:53.933 INFO:teuthology.orchestra.run.smithi111.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-11T00:18:53.933 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-11T00:18:53.933 INFO:teuthology.orchestra.run.smithi111.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-11T00:18:53.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.933+0000 7f3743200700 1 -- 172.21.15.111:0/2975384156 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f372007a6f0 msgr2=0x7f372007cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:53.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.933+0000 7f3743200700 1 --2- 172.21.15.111:0/2975384156 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f372007a6f0 0x7f372007cba0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f372c005b40 tx=0x7f372c005a90 comp rx=0 tx=0).stop 2024-09-11T00:18:53.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.933+0000 7f3743200700 1 -- 172.21.15.111:0/2975384156 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f373c102fb0 msgr2=0x7f373c198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:53.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.933+0000 7f3743200700 1 --2- 172.21.15.111:0/2975384156 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f373c102fb0 0x7f373c198500 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f372800e8f0 tx=0x7f372800ec00 comp rx=0 tx=0).stop 2024-09-11T00:18:53.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.933+0000 7f3743200700 1 -- 172.21.15.111:0/2975384156 shutdown_connections 2024-09-11T00:18:53.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.933+0000 7f3743200700 1 --2- 172.21.15.111:0/2975384156 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f372007a6f0 0x7f372007cba0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:53.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.933+0000 7f3743200700 1 --2- 172.21.15.111:0/2975384156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f373c102610 0x7f373c197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:53.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.933+0000 7f3743200700 1 --2- 172.21.15.111:0/2975384156 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f373c102fb0 0x7f373c198500 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:53.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.933+0000 7f3743200700 1 -- 172.21.15.111:0/2975384156 >> 172.21.15.111:0/2975384156 conn(0x7f373c0fde90 msgr2=0x7f373c0ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:53.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.933+0000 7f3743200700 1 -- 172.21.15.111:0/2975384156 shutdown_connections 2024-09-11T00:18:53.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:18:53.933+0000 7f3743200700 1 -- 172.21.15.111:0/2975384156 wait complete. 2024-09-11T00:18:54.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:53 smithi203 ceph-mon[69002]: mds.? [v2:172.21.15.203:6826/1792805040,v1:172.21.15.203:6827/1792805040] up:boot 2024-09-11T00:18:54.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:53 smithi203 ceph-mon[69002]: fsmap cephfs:1 {0=cephfs.smithi111.gmgsay=up:active} 3 up:standby 2024-09-11T00:18:54.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:53 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mds metadata", "who": "cephfs.smithi203.uqkbkn"} : dispatch 2024-09-11T00:18:54.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:53 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/2194510704' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:18:54.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:53 smithi203 ceph-mon[69002]: from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:18:54.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:53 smithi203 ceph-mon[69002]: pgmap v229: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 7 op/s 2024-09-11T00:18:54.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:53 smithi111 ceph-mon[90842]: mds.? [v2:172.21.15.203:6826/1792805040,v1:172.21.15.203:6827/1792805040] up:boot 2024-09-11T00:18:54.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:53 smithi111 ceph-mon[90842]: fsmap cephfs:1 {0=cephfs.smithi111.gmgsay=up:active} 3 up:standby 2024-09-11T00:18:54.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:53 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "mds metadata", "who": "cephfs.smithi203.uqkbkn"} : dispatch 2024-09-11T00:18:54.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:53 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/2194510704' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:18:54.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:53 smithi111 ceph-mon[90842]: from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:18:54.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:53 smithi111 ceph-mon[90842]: pgmap v229: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 7 op/s 2024-09-11T00:18:54.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:54 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/2975384156' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-11T00:18:55.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:54 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/2975384156' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-11T00:18:56.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:56 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:56.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:56 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:56.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:56 smithi111 ceph-mon[90842]: pgmap v230: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 4.3 KiB/s wr, 10 op/s 2024-09-11T00:18:57.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:56 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:57.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:56 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:57.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:56 smithi203 ceph-mon[69002]: pgmap v230: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 4.3 KiB/s wr, 10 op/s 2024-09-11T00:18:58.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:57 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:58.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:57 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:58.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:18:57 smithi203 ceph-mon[69002]: pgmap v231: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-09-11T00:18:58.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:57 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:58.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:57 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:18:58.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:18:57 smithi111 ceph-mon[90842]: pgmap v231: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-09-11T00:19:01.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:00 smithi203 ceph-mon[69002]: pgmap v232: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9.9 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-09-11T00:19:01.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:00 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:01.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:00 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:19:01.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:00 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:01.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:00 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:01.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:00 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:19:01.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:00 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:19:01.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:00 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:01.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:00 smithi111 ceph-mon[90842]: pgmap v232: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9.9 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-09-11T00:19:01.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:00 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:01.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:00 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:19:01.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:00 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:01.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:00 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:01.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:00 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:19:01.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:00 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:19:01.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:00 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:02.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:01 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:19:02.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:01 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:02.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:01 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:02.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:01 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:02.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:01 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:02.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:01 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:02.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:01 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:02.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:01 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi111.gmgsay"} : dispatch 2024-09-11T00:19:02.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:01 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi111.gmgsay"}]': finished 2024-09-11T00:19:02.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:01 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi111.rucaba"} : dispatch 2024-09-11T00:19:02.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:01 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi111.rucaba"}]': finished 2024-09-11T00:19:02.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:01 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi203.tcrqop"} : dispatch 2024-09-11T00:19:02.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:01 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi203.tcrqop"}]': finished 2024-09-11T00:19:02.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:01 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi203.uqkbkn"} : dispatch 2024-09-11T00:19:02.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:01 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi203.uqkbkn"}]': finished 2024-09-11T00:19:02.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:01 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-11T00:19:02.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:01 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:19:02.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:01 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:02.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:01 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:02.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:01 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:02.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:01 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:02.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:01 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:02.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:01 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:02.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:01 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi111.gmgsay"} : dispatch 2024-09-11T00:19:02.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:01 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi111.gmgsay"}]': finished 2024-09-11T00:19:02.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:01 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi111.rucaba"} : dispatch 2024-09-11T00:19:02.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:01 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi111.rucaba"}]': finished 2024-09-11T00:19:02.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:01 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi203.tcrqop"} : dispatch 2024-09-11T00:19:02.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:01 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi203.tcrqop"}]': finished 2024-09-11T00:19:02.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:01 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi203.uqkbkn"} : dispatch 2024-09-11T00:19:02.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:01 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi203.uqkbkn"}]': finished 2024-09-11T00:19:02.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:01 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-11T00:19:02.853 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:02 smithi111 ceph-mon[90842]: Upgrade: Setting container_image for all mds 2024-09-11T00:19:02.853 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:02 smithi111 ceph-mon[90842]: Upgrade: Setting filesystem cephfs Joinable 2024-09-11T00:19:02.853 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:02 smithi111 ceph-mon[90842]: pgmap v233: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 935 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-11T00:19:02.853 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:02 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-11T00:19:02.854 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:02 smithi111 ceph-mon[90842]: fsmap cephfs:1 {0=cephfs.smithi111.gmgsay=up:active} 3 up:standby 2024-09-11T00:19:02.854 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:02 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:02.854 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:02 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:02.854 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:02 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:02.854 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:02 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:02.854 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:02 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:03.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:02 smithi203 ceph-mon[69002]: Upgrade: Setting container_image for all mds 2024-09-11T00:19:03.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:02 smithi203 ceph-mon[69002]: Upgrade: Setting filesystem cephfs Joinable 2024-09-11T00:19:03.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:02 smithi203 ceph-mon[69002]: pgmap v233: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 935 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-11T00:19:03.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:02 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-11T00:19:03.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:02 smithi203 ceph-mon[69002]: fsmap cephfs:1 {0=cephfs.smithi111.gmgsay=up:active} 3 up:standby 2024-09-11T00:19:03.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:02 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:03.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:02 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:03.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:02 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:03.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:02 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:03.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:02 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:03.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:03 smithi111 ceph-mon[90842]: Upgrade: Setting container_image for all rgw 2024-09-11T00:19:03.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:03 smithi111 ceph-mon[90842]: Upgrade: Setting container_image for all rbd-mirror 2024-09-11T00:19:03.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:03 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:03.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:03 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi111", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-11T00:19:03.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:03 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:19:04.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:03 smithi203 ceph-mon[69002]: Upgrade: Setting container_image for all rgw 2024-09-11T00:19:04.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:03 smithi203 ceph-mon[69002]: Upgrade: Setting container_image for all rbd-mirror 2024-09-11T00:19:04.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:03 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:04.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:03 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi111", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-11T00:19:04.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:03 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:19:05.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:04 smithi203 ceph-mon[69002]: Upgrade: Updating ceph-exporter.smithi111 (1/2) 2024-09-11T00:19:05.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:04 smithi203 ceph-mon[69002]: Deploying daemon ceph-exporter.smithi111 on smithi111 2024-09-11T00:19:05.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:04 smithi203 ceph-mon[69002]: pgmap v234: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 345 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-11T00:19:05.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:04 smithi111 ceph-mon[90842]: Upgrade: Updating ceph-exporter.smithi111 (1/2) 2024-09-11T00:19:05.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:04 smithi111 ceph-mon[90842]: Deploying daemon ceph-exporter.smithi111 on smithi111 2024-09-11T00:19:05.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:04 smithi111 ceph-mon[90842]: pgmap v234: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 345 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-11T00:19:07.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:06 smithi203 ceph-mon[69002]: pgmap v235: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4.3 KiB/s wr, 3 op/s 2024-09-11T00:19:07.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:06 smithi111 ceph-mon[90842]: pgmap v235: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4.3 KiB/s wr, 3 op/s 2024-09-11T00:19:08.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:07 smithi203 ceph-mon[69002]: pgmap v236: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 0 op/s 2024-09-11T00:19:08.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:07 smithi111 ceph-mon[90842]: pgmap v236: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 0 op/s 2024-09-11T00:19:09.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:08 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:09.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:08 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:09.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:08 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:09.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:08 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:10.781 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:10 smithi203 ceph-mon[69002]: Upgrade: Updating ceph-exporter.smithi203 (2/2) 2024-09-11T00:19:10.781 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:10 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:10.781 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:10 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi203", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-11T00:19:10.781 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:10 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:19:10.781 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:10 smithi203 ceph-mon[69002]: Deploying daemon ceph-exporter.smithi203 on smithi203 2024-09-11T00:19:10.781 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:10 smithi203 ceph-mon[69002]: pgmap v237: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:10.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:10 smithi111 ceph-mon[90842]: Upgrade: Updating ceph-exporter.smithi203 (2/2) 2024-09-11T00:19:10.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:10 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:10.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:10 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi203", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-11T00:19:10.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:10 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:19:10.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:10 smithi111 ceph-mon[90842]: Deploying daemon ceph-exporter.smithi203 on smithi203 2024-09-11T00:19:10.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:10 smithi111 ceph-mon[90842]: pgmap v237: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:13.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:12 smithi203 ceph-mon[69002]: pgmap v238: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:13.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:12 smithi111 ceph-mon[90842]: pgmap v238: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:15.014 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:14 smithi111 ceph-mon[90842]: pgmap v239: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:15.014 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:14 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:15.014 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:14 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:15.014 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:14 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:19:15.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:14 smithi203 ceph-mon[69002]: pgmap v239: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:15.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:14 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:15.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:14 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:15.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:14 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:19:15.998 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:15 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:19:16.018 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:15 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:19:17.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:16 smithi203 ceph-mon[69002]: pgmap v240: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:17.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:16 smithi111 ceph-mon[90842]: pgmap v240: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:18.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:17 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:18.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:17 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:18.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:17 smithi203 ceph-mon[69002]: pgmap v241: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:18.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:17 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:18.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:17 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:18.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:17 smithi111 ceph-mon[90842]: pgmap v241: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:19.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:19 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:19.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:19 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:19.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:19 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:19.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:19 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:20.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:20 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:20.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:20 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:20.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:20 smithi203 ceph-mon[69002]: pgmap v242: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:20.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:20 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:20.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:20 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:20.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:20 smithi111 ceph-mon[90842]: pgmap v242: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:21.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:21 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:21.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:21 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:21.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:21 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:21.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:21 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:22.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:22 smithi111 ceph-mon[90842]: pgmap v243: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:22.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:22 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:22.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:22 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:22.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:22 smithi203 ceph-mon[69002]: pgmap v243: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:22.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:22 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:22.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:22 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:24.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.077+0000 7f4eda800700 1 -- 172.21.15.111:0/2355234975 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ed4102fb0 msgr2=0x7f4ed4106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:24.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.077+0000 7f4eda800700 1 --2- 172.21.15.111:0/2355234975 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ed4102fb0 0x7f4ed4106f80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0009910 tx=0x7f4ec0009c20 comp rx=0 tx=0).stop 2024-09-11T00:19:24.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.078+0000 7f4eda800700 1 -- 172.21.15.111:0/2355234975 shutdown_connections 2024-09-11T00:19:24.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.078+0000 7f4eda800700 1 --2- 172.21.15.111:0/2355234975 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ed4102fb0 0x7f4ed4106f80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:24.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.078+0000 7f4eda800700 1 --2- 172.21.15.111:0/2355234975 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4ed4102610 0x7f4ed41029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:24.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.078+0000 7f4eda800700 1 -- 172.21.15.111:0/2355234975 >> 172.21.15.111:0/2355234975 conn(0x7f4ed40fde90 msgr2=0x7f4ed41002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:24.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.078+0000 7f4eda800700 1 -- 172.21.15.111:0/2355234975 shutdown_connections 2024-09-11T00:19:24.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.078+0000 7f4eda800700 1 -- 172.21.15.111:0/2355234975 wait complete. 2024-09-11T00:19:24.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.079+0000 7f4eda800700 1 Processor -- start 2024-09-11T00:19:24.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.079+0000 7f4eda800700 1 -- start start 2024-09-11T00:19:24.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.080+0000 7f4eda800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ed4102610 0x7f4ed4197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:24.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.080+0000 7f4eda800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4ed4102fb0 0x7f4ed4198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:24.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.080+0000 7f4eda800700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed4198c00 con 0x7f4ed4102610 2024-09-11T00:19:24.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.080+0000 7f4eda800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed419c990 con 0x7f4ed4102fb0 2024-09-11T00:19:24.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.080+0000 7f4ed3400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ed4102610 0x7f4ed4197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:24.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.080+0000 7f4ed3400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ed4102610 0x7f4ed4197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:34570/0 (socket says 172.21.15.111:34570) 2024-09-11T00:19:24.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.080+0000 7f4ed3400700 1 -- 172.21.15.111:0/1757130147 learned_addr learned my addr 172.21.15.111:0/1757130147 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:19:24.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.080+0000 7f4ed2a00700 1 --2- 172.21.15.111:0/1757130147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4ed4102fb0 0x7f4ed4198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:24.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.080+0000 7f4ed3400700 1 -- 172.21.15.111:0/1757130147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4ed4102fb0 msgr2=0x7f4ed4198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:24.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.080+0000 7f4ed3400700 1 --2- 172.21.15.111:0/1757130147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4ed4102fb0 0x7f4ed4198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:24.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.080+0000 7f4ed3400700 1 -- 172.21.15.111:0/1757130147 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec00095f0 con 0x7f4ed4102610 2024-09-11T00:19:24.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.081+0000 7f4ed3400700 1 --2- 172.21.15.111:0/1757130147 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ed4102610 0x7f4ed4197fe0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400d8d0 tx=0x7f4ec400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:24.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.081+0000 7f4ecbe00700 1 -- 172.21.15.111:0/1757130147 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ec40098a0 con 0x7f4ed4102610 2024-09-11T00:19:24.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.081+0000 7f4ecbe00700 1 -- 172.21.15.111:0/1757130147 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ec4010460 con 0x7f4ed4102610 2024-09-11T00:19:24.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.081+0000 7f4ecbe00700 1 -- 172.21.15.111:0/1757130147 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ec400f5f0 con 0x7f4ed4102610 2024-09-11T00:19:24.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.081+0000 7f4eda800700 1 -- 172.21.15.111:0/1757130147 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed419cc70 con 0x7f4ed4102610 2024-09-11T00:19:24.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.081+0000 7f4eda800700 1 -- 172.21.15.111:0/1757130147 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed419d1c0 con 0x7f4ed4102610 2024-09-11T00:19:24.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.082+0000 7f4eda800700 1 -- 172.21.15.111:0/1757130147 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed404ea50 con 0x7f4ed4102610 2024-09-11T00:19:24.085 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.083+0000 7f4ecbe00700 1 -- 172.21.15.111:0/1757130147 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f4ec4009a00 con 0x7f4ed4102610 2024-09-11T00:19:24.086 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.084+0000 7f4ecbe00700 1 --2- 172.21.15.111:0/1757130147 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4eb807a6f0 0x7f4eb807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:24.087 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.084+0000 7f4ecbe00700 1 -- 172.21.15.111:0/1757130147 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f4ec409d240 con 0x7f4ed4102610 2024-09-11T00:19:24.087 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.085+0000 7f4ed2a00700 1 --2- 172.21.15.111:0/1757130147 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4eb807a6f0 0x7f4eb807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:24.087 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.085+0000 7f4ed2a00700 1 --2- 172.21.15.111:0/1757130147 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4eb807a6f0 0x7f4eb807cba0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4ed4199600 tx=0x7f4ec001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:24.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.089+0000 7f4ecbe00700 1 -- 172.21.15.111:0/1757130147 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f4ec4060890 con 0x7f4ed4102610 2024-09-11T00:19:24.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.342+0000 7f4eda800700 1 -- 172.21.15.111:0/1757130147 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ed419d6c0 con 0x7f4eb807a6f0 2024-09-11T00:19:24.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.344+0000 7f4ecbe00700 1 -- 172.21.15.111:0/1757130147 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7f4ed419d6c0 con 0x7f4eb807a6f0 2024-09-11T00:19:24.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.347+0000 7f4eda800700 1 -- 172.21.15.111:0/1757130147 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4eb807a6f0 msgr2=0x7f4eb807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:24.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.347+0000 7f4eda800700 1 --2- 172.21.15.111:0/1757130147 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4eb807a6f0 0x7f4eb807cba0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4ed4199600 tx=0x7f4ec001a040 comp rx=0 tx=0).stop 2024-09-11T00:19:24.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.347+0000 7f4eda800700 1 -- 172.21.15.111:0/1757130147 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ed4102610 msgr2=0x7f4ed4197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:24.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.347+0000 7f4eda800700 1 --2- 172.21.15.111:0/1757130147 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ed4102610 0x7f4ed4197fe0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400d8d0 tx=0x7f4ec400dbe0 comp rx=0 tx=0).stop 2024-09-11T00:19:24.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.347+0000 7f4eda800700 1 -- 172.21.15.111:0/1757130147 shutdown_connections 2024-09-11T00:19:24.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.347+0000 7f4eda800700 1 --2- 172.21.15.111:0/1757130147 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4eb807a6f0 0x7f4eb807cba0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:24.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.347+0000 7f4eda800700 1 --2- 172.21.15.111:0/1757130147 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4ed4102610 0x7f4ed4197fe0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:24.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.347+0000 7f4eda800700 1 --2- 172.21.15.111:0/1757130147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4ed4102fb0 0x7f4ed4198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:24.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.347+0000 7f4eda800700 1 -- 172.21.15.111:0/1757130147 >> 172.21.15.111:0/1757130147 conn(0x7f4ed40fde90 msgr2=0x7f4ed40ff460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:24.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.347+0000 7f4eda800700 1 -- 172.21.15.111:0/1757130147 shutdown_connections 2024-09-11T00:19:24.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.347+0000 7f4eda800700 1 -- 172.21.15.111:0/1757130147 wait complete. 2024-09-11T00:19:24.364 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:19:24.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.494+0000 7fdae8000700 1 -- 172.21.15.111:0/869065460 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdae0073a00 msgr2=0x7fdae010c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:24.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.494+0000 7fdae8000700 1 --2- 172.21.15.111:0/869065460 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdae0073a00 0x7fdae010c450 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdacc009910 tx=0x7fdacc009c20 comp rx=0 tx=0).stop 2024-09-11T00:19:24.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.494+0000 7fdae8000700 1 -- 172.21.15.111:0/869065460 shutdown_connections 2024-09-11T00:19:24.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.494+0000 7fdae8000700 1 --2- 172.21.15.111:0/869065460 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdae0073a00 0x7fdae010c450 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:24.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.494+0000 7fdae8000700 1 --2- 172.21.15.111:0/869065460 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdae00730f0 0x7fdae00734c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:24.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.494+0000 7fdae8000700 1 -- 172.21.15.111:0/869065460 >> 172.21.15.111:0/869065460 conn(0x7fdae00fbc30 msgr2=0x7fdae00fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:24.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.494+0000 7fdae8000700 1 -- 172.21.15.111:0/869065460 shutdown_connections 2024-09-11T00:19:24.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.494+0000 7fdae8000700 1 -- 172.21.15.111:0/869065460 wait complete. 2024-09-11T00:19:24.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.495+0000 7fdae8000700 1 Processor -- start 2024-09-11T00:19:24.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.495+0000 7fdae8000700 1 -- start start 2024-09-11T00:19:24.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.496+0000 7fdae8000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdae00730f0 0x7fdae0197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:24.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.496+0000 7fdae8000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdae0073a00 0x7fdae0198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:24.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.496+0000 7fdae8000700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae019c7c0 con 0x7fdae0073a00 2024-09-11T00:19:24.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.496+0000 7fdae8000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae019c930 con 0x7fdae00730f0 2024-09-11T00:19:24.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.496+0000 7fdae4c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdae0073a00 0x7fdae0198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:24.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.496+0000 7fdae4c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdae0073a00 0x7fdae0198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:34594/0 (socket says 172.21.15.111:34594) 2024-09-11T00:19:24.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.496+0000 7fdae5600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdae00730f0 0x7fdae0197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:24.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.496+0000 7fdae4c00700 1 -- 172.21.15.111:0/3007903301 learned_addr learned my addr 172.21.15.111:0/3007903301 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:19:24.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.496+0000 7fdae4c00700 1 -- 172.21.15.111:0/3007903301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdae00730f0 msgr2=0x7fdae0197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:24.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.496+0000 7fdae4c00700 1 --2- 172.21.15.111:0/3007903301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdae00730f0 0x7fdae0197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:24.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.496+0000 7fdae4c00700 1 -- 172.21.15.111:0/3007903301 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc0095f0 con 0x7fdae0073a00 2024-09-11T00:19:24.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.497+0000 7fdae4c00700 1 --2- 172.21.15.111:0/3007903301 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdae0073a00 0x7fdae0198480 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdacc0092e0 tx=0x7fdacc00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:24.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.497+0000 7fdade000700 1 -- 172.21.15.111:0/3007903301 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdacc01d070 con 0x7fdae0073a00 2024-09-11T00:19:24.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.497+0000 7fdade000700 1 -- 172.21.15.111:0/3007903301 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdacc0052a0 con 0x7fdae0073a00 2024-09-11T00:19:24.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.497+0000 7fdae8000700 1 -- 172.21.15.111:0/3007903301 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae019cbb0 con 0x7fdae0073a00 2024-09-11T00:19:24.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.497+0000 7fdade000700 1 -- 172.21.15.111:0/3007903301 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdacc017400 con 0x7fdae0073a00 2024-09-11T00:19:24.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.497+0000 7fdae8000700 1 -- 172.21.15.111:0/3007903301 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae019d100 con 0x7fdae0073a00 2024-09-11T00:19:24.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.498+0000 7fdae8000700 1 -- 172.21.15.111:0/3007903301 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae0109b50 con 0x7fdae0073a00 2024-09-11T00:19:24.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.499+0000 7fdade000700 1 -- 172.21.15.111:0/3007903301 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fdacc00f820 con 0x7fdae0073a00 2024-09-11T00:19:24.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.500+0000 7fdade000700 1 --2- 172.21.15.111:0/3007903301 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fdac807a6f0 0x7fdac807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:24.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.501+0000 7fdade000700 1 -- 172.21.15.111:0/3007903301 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fdacc09e600 con 0x7fdae0073a00 2024-09-11T00:19:24.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.501+0000 7fdae5600700 1 --2- 172.21.15.111:0/3007903301 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fdac807a6f0 0x7fdac807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:24.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.501+0000 7fdae5600700 1 --2- 172.21.15.111:0/3007903301 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fdac807a6f0 0x7fdac807cba0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009c60 tx=0x7fdad4009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:24.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.507+0000 7fdade000700 1 -- 172.21.15.111:0/3007903301 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fdacc061cd0 con 0x7fdae0073a00 2024-09-11T00:19:24.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.759+0000 7fdae8000700 1 -- 172.21.15.111:0/3007903301 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdae010f460 con 0x7fdac807a6f0 2024-09-11T00:19:24.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.760+0000 7fdade000700 1 -- 172.21.15.111:0/3007903301 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7fdae010f460 con 0x7fdac807a6f0 2024-09-11T00:19:24.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.763+0000 7fdae8000700 1 -- 172.21.15.111:0/3007903301 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fdac807a6f0 msgr2=0x7fdac807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:24.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.763+0000 7fdae8000700 1 --2- 172.21.15.111:0/3007903301 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fdac807a6f0 0x7fdac807cba0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009c60 tx=0x7fdad4009260 comp rx=0 tx=0).stop 2024-09-11T00:19:24.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.763+0000 7fdae8000700 1 -- 172.21.15.111:0/3007903301 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdae0073a00 msgr2=0x7fdae0198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:24.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.763+0000 7fdae8000700 1 --2- 172.21.15.111:0/3007903301 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdae0073a00 0x7fdae0198480 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdacc0092e0 tx=0x7fdacc00b6c0 comp rx=0 tx=0).stop 2024-09-11T00:19:24.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.763+0000 7fdae8000700 1 -- 172.21.15.111:0/3007903301 shutdown_connections 2024-09-11T00:19:24.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.763+0000 7fdae8000700 1 --2- 172.21.15.111:0/3007903301 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fdac807a6f0 0x7fdac807cba0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:24.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.763+0000 7fdae8000700 1 --2- 172.21.15.111:0/3007903301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdae00730f0 0x7fdae0197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:24.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.763+0000 7fdae8000700 1 --2- 172.21.15.111:0/3007903301 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdae0073a00 0x7fdae0198480 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:24.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.763+0000 7fdae8000700 1 -- 172.21.15.111:0/3007903301 >> 172.21.15.111:0/3007903301 conn(0x7fdae00fbc30 msgr2=0x7fdae0106c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:24.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.763+0000 7fdae8000700 1 -- 172.21.15.111:0/3007903301 shutdown_connections 2024-09-11T00:19:24.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.763+0000 7fdae8000700 1 -- 172.21.15.111:0/3007903301 wait complete. 2024-09-11T00:19:24.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.899+0000 7fab1f200700 1 -- 172.21.15.111:0/588036759 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab200730f0 msgr2=0x7fab200734c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:24.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.899+0000 7fab1f200700 1 --2- 172.21.15.111:0/588036759 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab200730f0 0x7fab200734c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fab10009910 tx=0x7fab10009c20 comp rx=0 tx=0).stop 2024-09-11T00:19:24.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.899+0000 7fab1f200700 1 -- 172.21.15.111:0/588036759 shutdown_connections 2024-09-11T00:19:24.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.899+0000 7fab1f200700 1 --2- 172.21.15.111:0/588036759 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab20073a00 0x7fab2010c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:24.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.899+0000 7fab1f200700 1 --2- 172.21.15.111:0/588036759 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab200730f0 0x7fab200734c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:24.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.899+0000 7fab1f200700 1 -- 172.21.15.111:0/588036759 >> 172.21.15.111:0/588036759 conn(0x7fab200fba30 msgr2=0x7fab200fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:24.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.899+0000 7fab1f200700 1 -- 172.21.15.111:0/588036759 shutdown_connections 2024-09-11T00:19:24.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.899+0000 7fab1f200700 1 -- 172.21.15.111:0/588036759 wait complete. 2024-09-11T00:19:24.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.900+0000 7fab1f200700 1 Processor -- start 2024-09-11T00:19:24.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.900+0000 7fab1f200700 1 -- start start 2024-09-11T00:19:24.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.901+0000 7fab1f200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab200730f0 0x7fab2019d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:24.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.901+0000 7fab1f200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab20073a00 0x7fab2019e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:24.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.901+0000 7fab1f200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab20197a30 con 0x7fab20073a00 2024-09-11T00:19:24.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.901+0000 7fab1f200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab20197ba0 con 0x7fab200730f0 2024-09-11T00:19:24.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.901+0000 7fab1d400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab20073a00 0x7fab2019e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:24.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.901+0000 7fab1d400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab20073a00 0x7fab2019e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:34626/0 (socket says 172.21.15.111:34626) 2024-09-11T00:19:24.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.901+0000 7fab1d400700 1 -- 172.21.15.111:0/2653232073 learned_addr learned my addr 172.21.15.111:0/2653232073 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:19:24.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.901+0000 7fab1de00700 1 --2- 172.21.15.111:0/2653232073 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab200730f0 0x7fab2019d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:24.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.901+0000 7fab1d400700 1 -- 172.21.15.111:0/2653232073 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab200730f0 msgr2=0x7fab2019d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:24.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.901+0000 7fab1d400700 1 --2- 172.21.15.111:0/2653232073 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab200730f0 0x7fab2019d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:24.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.901+0000 7fab1d400700 1 -- 172.21.15.111:0/2653232073 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab100095f0 con 0x7fab20073a00 2024-09-11T00:19:24.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.902+0000 7fab1d400700 1 --2- 172.21.15.111:0/2653232073 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab20073a00 0x7fab2019e020 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fab0c00e920 tx=0x7fab0c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:24.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.902+0000 7fab16a00700 1 -- 172.21.15.111:0/2653232073 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab0c009790 con 0x7fab20073a00 2024-09-11T00:19:24.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.902+0000 7fab1f200700 1 -- 172.21.15.111:0/2653232073 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab20197e80 con 0x7fab20073a00 2024-09-11T00:19:24.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.902+0000 7fab16a00700 1 -- 172.21.15.111:0/2653232073 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fab0c00cba0 con 0x7fab20073a00 2024-09-11T00:19:24.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.902+0000 7fab16a00700 1 -- 172.21.15.111:0/2653232073 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab0c018650 con 0x7fab20073a00 2024-09-11T00:19:24.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.902+0000 7fab1f200700 1 -- 172.21.15.111:0/2653232073 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab201983d0 con 0x7fab20073a00 2024-09-11T00:19:24.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.903+0000 7fab1f200700 1 -- 172.21.15.111:0/2653232073 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab20109950 con 0x7fab20073a00 2024-09-11T00:19:24.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.905+0000 7fab16a00700 1 -- 172.21.15.111:0/2653232073 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fab0c00cd10 con 0x7fab20073a00 2024-09-11T00:19:24.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.906+0000 7fab16a00700 1 --2- 172.21.15.111:0/2653232073 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fab0407a6f0 0x7fab0407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:24.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.906+0000 7fab16a00700 1 -- 172.21.15.111:0/2653232073 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fab0c014070 con 0x7fab20073a00 2024-09-11T00:19:24.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.906+0000 7fab1de00700 1 --2- 172.21.15.111:0/2653232073 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fab0407a6f0 0x7fab0407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:24.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.907+0000 7fab1de00700 1 --2- 172.21.15.111:0/2653232073 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fab0407a6f0 0x7fab0407cba0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fab1000b760 tx=0x7fab10009f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:24.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:24.910+0000 7fab16a00700 1 -- 172.21.15.111:0/2653232073 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fab0c064560 con 0x7fab20073a00 2024-09-11T00:19:25.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:24 smithi203 ceph-mon[69002]: pgmap v244: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:25.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:24 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:25.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:24 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:25.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:24 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:19:25.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:24 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:19:25.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:24 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:25.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:24 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:19:25.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:24 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:25.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:24 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:25.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:24 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:25.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:24 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:25.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:24 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:25.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:24 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-11T00:19:25.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.142+0000 7fab1f200700 1 -- 172.21.15.111:0/2653232073 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fab201986b0 con 0x7fab0407a6f0 2024-09-11T00:19:25.145 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:24 smithi111 ceph-mon[90842]: pgmap v244: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:25.145 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:24 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:25.145 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:24 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:25.145 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:24 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:19:25.145 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:24 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:19:25.145 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:24 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:25.145 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:24 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:19:25.145 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:24 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:25.145 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:24 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:25.145 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:24 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:25.145 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:24 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:25.145 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:24 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:25.146 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:24 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-11T00:19:25.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.152+0000 7fab16a00700 1 -- 172.21.15.111:0/2653232073 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fab201986b0 con 0x7fab0407a6f0 2024-09-11T00:19:25.154 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:19:25.154 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (8m) 5s ago 22m 15.7M - 0.27.0 11f11916f8cd d6d3253e881f 2024-09-11T00:19:25.154 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (17s) 5s ago 22m 7805k - 19.3.0-4854-g8f219c47 589dd18248e4 583f61b2aa1e 2024-09-11T00:19:25.154 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi203 smithi203 running (11s) 8s ago 21m 7348k - 19.3.0-4854-g8f219c47 589dd18248e4 2ca5e58a2d0c 2024-09-11T00:19:25.154 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (5m) 5s ago 22m 6899k - 19.3.0-4854-g8f219c47 589dd18248e4 a9cacdb9a638 2024-09-11T00:19:25.154 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi203 smithi203 running (5m) 8s ago 21m 6899k - 19.3.0-4854-g8f219c47 589dd18248e4 d452d9dfa04b 2024-09-11T00:19:25.155 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (8m) 5s ago 22m 68.1M - c8b91775d855 7d3b50b5b59f 2024-09-11T00:19:25.155 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.gmgsay smithi111 running (108s) 5s ago 15m 86.5M - 19.3.0-4854-g8f219c47 589dd18248e4 a8cff96fcbbe 2024-09-11T00:19:25.155 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.rucaba smithi111 running (87s) 5s ago 15m 12.5M - 19.3.0-4854-g8f219c47 589dd18248e4 63a1d760686d 2024-09-11T00:19:25.155 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.tcrqop smithi203 running (57s) 8s ago 15m 12.3M - 19.3.0-4854-g8f219c47 589dd18248e4 f9cc4db8b461 2024-09-11T00:19:25.155 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.uqkbkn smithi203 running (33s) 8s ago 15m 12.2M - 19.3.0-4854-g8f219c47 589dd18248e4 8c20ffa3e7ee 2024-09-11T00:19:25.155 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.ypucji smithi111 *:8443,9283,8765 running (11m) 5s ago 24m 520M - 19.3.0-4854-g8f219c47 589dd18248e4 07fa31f49618 2024-09-11T00:19:25.155 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi203.smuspl smithi203 *:8443,9283,8765 running (10m) 8s ago 21m 457M - 19.3.0-4854-g8f219c47 589dd18248e4 7e5a93a5ffa7 2024-09-11T00:19:25.155 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (7m) 5s ago 24m 58.2M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 3c29c070a612 2024-09-11T00:19:25.155 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi203 smithi203 running (6m) 8s ago 21m 47.6M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 45e8285e4b4d 2024-09-11T00:19:25.155 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (9m) 5s ago 22m 7625k - 1.7.0 72c9c2088986 ec478ea14488 2024-09-11T00:19:25.155 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi203 smithi203 *:9100 running (9m) 8s ago 21m 8170k - 1.7.0 72c9c2088986 54d461cde1bc 2024-09-11T00:19:25.155 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (5m) 5s ago 19m 99.8M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 d2f1a2312736 2024-09-11T00:19:25.155 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (4m) 5s ago 19m 104M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 19cf95ecca7d 2024-09-11T00:19:25.156 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (4m) 5s ago 18m 86.4M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 3a3b318b337a 2024-09-11T00:19:25.156 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi203 running (3m) 8s ago 18m 105M 2240M 19.3.0-4854-g8f219c47 589dd18248e4 288c7e8ae34b 2024-09-11T00:19:25.156 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi203 running (2m) 8s ago 17m 96.0M 2240M 19.3.0-4854-g8f219c47 589dd18248e4 485f82d3eafb 2024-09-11T00:19:25.156 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi203 running (2m) 8s ago 17m 94.9M 2240M 19.3.0-4854-g8f219c47 589dd18248e4 ef4834f3adf1 2024-09-11T00:19:25.156 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (9m) 5s ago 22m 64.3M - 2.51.0 1d3b7f56885b 3e72ac10983d 2024-09-11T00:19:25.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.154+0000 7fab1f200700 1 -- 172.21.15.111:0/2653232073 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fab0407a6f0 msgr2=0x7fab0407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:25.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.154+0000 7fab1f200700 1 --2- 172.21.15.111:0/2653232073 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fab0407a6f0 0x7fab0407cba0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fab1000b760 tx=0x7fab10009f90 comp rx=0 tx=0).stop 2024-09-11T00:19:25.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.154+0000 7fab1f200700 1 -- 172.21.15.111:0/2653232073 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab20073a00 msgr2=0x7fab2019e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:25.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.154+0000 7fab1f200700 1 --2- 172.21.15.111:0/2653232073 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab20073a00 0x7fab2019e020 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fab0c00e920 tx=0x7fab0c00ece0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.154+0000 7fab1f200700 1 -- 172.21.15.111:0/2653232073 shutdown_connections 2024-09-11T00:19:25.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.154+0000 7fab1f200700 1 --2- 172.21.15.111:0/2653232073 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fab0407a6f0 0x7fab0407cba0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.154+0000 7fab1f200700 1 --2- 172.21.15.111:0/2653232073 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab200730f0 0x7fab2019d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.154+0000 7fab1f200700 1 --2- 172.21.15.111:0/2653232073 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab20073a00 0x7fab2019e020 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.155+0000 7fab1f200700 1 -- 172.21.15.111:0/2653232073 >> 172.21.15.111:0/2653232073 conn(0x7fab200fba30 msgr2=0x7fab20106a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:25.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.155+0000 7fab1f200700 1 -- 172.21.15.111:0/2653232073 shutdown_connections 2024-09-11T00:19:25.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.155+0000 7fab1f200700 1 -- 172.21.15.111:0/2653232073 wait complete. 2024-09-11T00:19:25.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.288+0000 7f07ba800700 1 -- 172.21.15.111:0/723504886 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f07b4102610 msgr2=0x7f07b41029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:25.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.288+0000 7f07ba800700 1 --2- 172.21.15.111:0/723504886 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f07b4102610 0x7f07b41029e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f07a400b0a0 tx=0x7f07a400b3b0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.288+0000 7f07ba800700 1 -- 172.21.15.111:0/723504886 shutdown_connections 2024-09-11T00:19:25.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.289+0000 7f07ba800700 1 --2- 172.21.15.111:0/723504886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07b4102fb0 0x7f07b4106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.289+0000 7f07ba800700 1 --2- 172.21.15.111:0/723504886 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f07b4102610 0x7f07b41029e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.289+0000 7f07ba800700 1 -- 172.21.15.111:0/723504886 >> 172.21.15.111:0/723504886 conn(0x7f07b40fde90 msgr2=0x7f07b41002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:25.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.289+0000 7f07ba800700 1 -- 172.21.15.111:0/723504886 shutdown_connections 2024-09-11T00:19:25.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.289+0000 7f07ba800700 1 -- 172.21.15.111:0/723504886 wait complete. 2024-09-11T00:19:25.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.290+0000 7f07ba800700 1 Processor -- start 2024-09-11T00:19:25.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.290+0000 7f07ba800700 1 -- start start 2024-09-11T00:19:25.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.290+0000 7f07ba800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f07b4102610 0x7f07b4198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:25.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.290+0000 7f07ba800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07b4102fb0 0x7f07b4198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:25.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.290+0000 7f07ba800700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b4198c40 con 0x7f07b4102610 2024-09-11T00:19:25.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.290+0000 7f07ba800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b419c9d0 con 0x7f07b4102fb0 2024-09-11T00:19:25.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.290+0000 7f07b3400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f07b4102610 0x7f07b4198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:25.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.290+0000 7f07b3400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f07b4102610 0x7f07b4198020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:34646/0 (socket says 172.21.15.111:34646) 2024-09-11T00:19:25.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.290+0000 7f07b3400700 1 -- 172.21.15.111:0/3126634096 learned_addr learned my addr 172.21.15.111:0/3126634096 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:19:25.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.291+0000 7f07b2a00700 1 --2- 172.21.15.111:0/3126634096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07b4102fb0 0x7f07b4198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:25.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.291+0000 7f07b3400700 1 -- 172.21.15.111:0/3126634096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07b4102fb0 msgr2=0x7f07b4198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:25.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.291+0000 7f07b3400700 1 --2- 172.21.15.111:0/3126634096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07b4102fb0 0x7f07b4198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.291+0000 7f07b3400700 1 -- 172.21.15.111:0/3126634096 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a4009d00 con 0x7f07b4102610 2024-09-11T00:19:25.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.291+0000 7f07b2a00700 1 --2- 172.21.15.111:0/3126634096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07b4102fb0 0x7f07b4198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:19:25.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.291+0000 7f07b3400700 1 --2- 172.21.15.111:0/3126634096 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f07b4102610 0x7f07b4198020 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f07a400b070 tx=0x7f07a400cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:25.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.291+0000 7f07abe00700 1 -- 172.21.15.111:0/3126634096 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07a400e040 con 0x7f07b4102610 2024-09-11T00:19:25.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.291+0000 7f07abe00700 1 -- 172.21.15.111:0/3126634096 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f07a4003de0 con 0x7f07b4102610 2024-09-11T00:19:25.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.291+0000 7f07ba800700 1 -- 172.21.15.111:0/3126634096 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b419cc50 con 0x7f07b4102610 2024-09-11T00:19:25.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.291+0000 7f07abe00700 1 -- 172.21.15.111:0/3126634096 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07a401d8e0 con 0x7f07b4102610 2024-09-11T00:19:25.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.291+0000 7f07ba800700 1 -- 172.21.15.111:0/3126634096 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b419d140 con 0x7f07b4102610 2024-09-11T00:19:25.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.292+0000 7f07ba800700 1 -- 172.21.15.111:0/3126634096 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b410a920 con 0x7f07b4102610 2024-09-11T00:19:25.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.294+0000 7f07abe00700 1 -- 172.21.15.111:0/3126634096 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f07a4004040 con 0x7f07b4102610 2024-09-11T00:19:25.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.295+0000 7f07abe00700 1 --2- 172.21.15.111:0/3126634096 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f079807a6f0 0x7f079807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:25.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.295+0000 7f07abe00700 1 -- 172.21.15.111:0/3126634096 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f07a409eae0 con 0x7f07b4102610 2024-09-11T00:19:25.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.295+0000 7f07b2a00700 1 --2- 172.21.15.111:0/3126634096 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f079807a6f0 0x7f079807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:25.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.295+0000 7f07b2a00700 1 --2- 172.21.15.111:0/3126634096 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f079807a6f0 0x7f079807cba0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f07a0005d90 tx=0x7f07a0005d00 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:25.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.299+0000 7f07abe00700 1 -- 172.21.15.111:0/3126634096 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f07a40621b0 con 0x7f07b4102610 2024-09-11T00:19:25.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.657+0000 7f07ba800700 1 -- 172.21.15.111:0/3126634096 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f07b419d470 con 0x7f07b4102610 2024-09-11T00:19:25.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.657+0000 7f07abe00700 1 -- 172.21.15.111:0/3126634096 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f07a40652d0 con 0x7f07b4102610 2024-09-11T00:19:25.660 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:19:25.660 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-11T00:19:25.660 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:19:25.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:19:25.660 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-11T00:19:25.660 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:19:25.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:19:25.660 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-11T00:19:25.660 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 6 2024-09-11T00:19:25.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:19:25.660 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-11T00:19:25.661 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 4 2024-09-11T00:19:25.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:19:25.661 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-11T00:19:25.661 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 14 2024-09-11T00:19:25.661 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-11T00:19:25.661 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:19:25.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.660+0000 7f07ba800700 1 -- 172.21.15.111:0/3126634096 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f079807a6f0 msgr2=0x7f079807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:25.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.660+0000 7f07ba800700 1 --2- 172.21.15.111:0/3126634096 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f079807a6f0 0x7f079807cba0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f07a0005d90 tx=0x7f07a0005d00 comp rx=0 tx=0).stop 2024-09-11T00:19:25.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.660+0000 7f07ba800700 1 -- 172.21.15.111:0/3126634096 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f07b4102610 msgr2=0x7f07b4198020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:25.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.660+0000 7f07ba800700 1 --2- 172.21.15.111:0/3126634096 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f07b4102610 0x7f07b4198020 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f07a400b070 tx=0x7f07a400cdd0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.660+0000 7f07ba800700 1 -- 172.21.15.111:0/3126634096 shutdown_connections 2024-09-11T00:19:25.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.660+0000 7f07ba800700 1 --2- 172.21.15.111:0/3126634096 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f079807a6f0 0x7f079807cba0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.660+0000 7f07ba800700 1 --2- 172.21.15.111:0/3126634096 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f07b4102610 0x7f07b4198020 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.660+0000 7f07ba800700 1 --2- 172.21.15.111:0/3126634096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07b4102fb0 0x7f07b4198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.660+0000 7f07ba800700 1 -- 172.21.15.111:0/3126634096 >> 172.21.15.111:0/3126634096 conn(0x7f07b40fde90 msgr2=0x7f07b41002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:25.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.661+0000 7f07ba800700 1 -- 172.21.15.111:0/3126634096 shutdown_connections 2024-09-11T00:19:25.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.661+0000 7f07ba800700 1 -- 172.21.15.111:0/3126634096 wait complete. 2024-09-11T00:19:25.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.810+0000 7fd3a7200700 1 -- 172.21.15.111:0/3965242130 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3a8100200 msgr2=0x7fd3a81005d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:25.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.810+0000 7fd3a7200700 1 --2- 172.21.15.111:0/3965242130 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3a8100200 0x7fd3a81005d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd398009910 tx=0x7fd398009c20 comp rx=0 tx=0).stop 2024-09-11T00:19:25.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.810+0000 7fd3a7200700 1 -- 172.21.15.111:0/3965242130 shutdown_connections 2024-09-11T00:19:25.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.810+0000 7fd3a7200700 1 --2- 172.21.15.111:0/3965242130 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3a8100ba0 0x7fd3a8104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.811+0000 7fd3a7200700 1 --2- 172.21.15.111:0/3965242130 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3a8100200 0x7fd3a81005d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.811+0000 7fd3a7200700 1 -- 172.21.15.111:0/3965242130 >> 172.21.15.111:0/3965242130 conn(0x7fd3a80fba80 msgr2=0x7fd3a80fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:25.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.811+0000 7fd3a7200700 1 -- 172.21.15.111:0/3965242130 shutdown_connections 2024-09-11T00:19:25.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.811+0000 7fd3a7200700 1 -- 172.21.15.111:0/3965242130 wait complete. 2024-09-11T00:19:25.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.812+0000 7fd3a7200700 1 Processor -- start 2024-09-11T00:19:25.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.812+0000 7fd3a7200700 1 -- start start 2024-09-11T00:19:25.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.812+0000 7fd3a7200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3a8100200 0x7fd3a8197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:25.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.812+0000 7fd3a7200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3a8100ba0 0x7fd3a8198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:25.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.813+0000 7fd3a7200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a8198a10 con 0x7fd3a8100ba0 2024-09-11T00:19:25.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.813+0000 7fd3a7200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a819c7a0 con 0x7fd3a8100200 2024-09-11T00:19:25.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.813+0000 7fd3a5400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3a8100ba0 0x7fd3a8198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:25.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.813+0000 7fd3a5e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3a8100200 0x7fd3a8197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:25.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.813+0000 7fd3a5400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3a8100ba0 0x7fd3a8198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:34656/0 (socket says 172.21.15.111:34656) 2024-09-11T00:19:25.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.813+0000 7fd3a5400700 1 -- 172.21.15.111:0/4049917938 learned_addr learned my addr 172.21.15.111:0/4049917938 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:19:25.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.813+0000 7fd3a5400700 1 -- 172.21.15.111:0/4049917938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3a8100200 msgr2=0x7fd3a8197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:25.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.813+0000 7fd3a5400700 1 --2- 172.21.15.111:0/4049917938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3a8100200 0x7fd3a8197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.813+0000 7fd3a5400700 1 -- 172.21.15.111:0/4049917938 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3980095f0 con 0x7fd3a8100ba0 2024-09-11T00:19:25.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.814+0000 7fd3a5400700 1 --2- 172.21.15.111:0/4049917938 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3a8100ba0 0x7fd3a8198330 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd39400d900 tx=0x7fd39400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:25.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.816+0000 7fd39ea00700 1 -- 172.21.15.111:0/4049917938 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd394009900 con 0x7fd3a8100ba0 2024-09-11T00:19:25.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.816+0000 7fd39ea00700 1 -- 172.21.15.111:0/4049917938 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd394010460 con 0x7fd3a8100ba0 2024-09-11T00:19:25.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.816+0000 7fd3a7200700 1 -- 172.21.15.111:0/4049917938 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a819ca80 con 0x7fd3a8100ba0 2024-09-11T00:19:25.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.816+0000 7fd39ea00700 1 -- 172.21.15.111:0/4049917938 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd39400f5f0 con 0x7fd3a8100ba0 2024-09-11T00:19:25.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.816+0000 7fd3a7200700 1 -- 172.21.15.111:0/4049917938 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a819cfd0 con 0x7fd3a8100ba0 2024-09-11T00:19:25.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.817+0000 7fd3a7200700 1 -- 172.21.15.111:0/4049917938 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd388005320 con 0x7fd3a8100ba0 2024-09-11T00:19:25.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.819+0000 7fd39ea00700 1 -- 172.21.15.111:0/4049917938 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fd394009a60 con 0x7fd3a8100ba0 2024-09-11T00:19:25.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.820+0000 7fd39ea00700 1 --2- 172.21.15.111:0/4049917938 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd38c07a6f0 0x7fd38c07cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:25.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.820+0000 7fd39ea00700 1 -- 172.21.15.111:0/4049917938 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fd39409ce80 con 0x7fd3a8100ba0 2024-09-11T00:19:25.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.820+0000 7fd3a5e00700 1 --2- 172.21.15.111:0/4049917938 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd38c07a6f0 0x7fd38c07cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:25.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.821+0000 7fd3a5e00700 1 --2- 172.21.15.111:0/4049917938 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd38c07a6f0 0x7fd38c07cba0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd39800b5c0 tx=0x7fd39801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:25.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:25.824+0000 7fd39ea00700 1 -- 172.21.15.111:0/4049917938 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fd3940604d0 con 0x7fd3a8100ba0 2024-09-11T00:19:26.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='client.34508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:19:26.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: Upgrade: Setting filesystem cephfs Joinable 2024-09-11T00:19:26.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-11T00:19:26.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: fsmap cephfs:1 {0=cephfs.smithi111.gmgsay=up:active} 3 up:standby 2024-09-11T00:19:26.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:26.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:26.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:26.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:26.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:26.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi111"} : dispatch 2024-09-11T00:19:26.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi111"}]': finished 2024-09-11T00:19:26.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi203"} : dispatch 2024-09-11T00:19:26.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi203"}]': finished 2024-09-11T00:19:26.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:26.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:26.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:26.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:26.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:26.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:26.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:26.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:26.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:26.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:26.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:26.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:26.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-11T00:19:26.047 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-11T00:19:26.048 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-11T00:19:26.048 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-11T00:19:26.048 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-11T00:19:26.048 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-11T00:19:26.048 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-11T00:19:26.048 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-11T00:19:26.048 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-11T00:19:26.048 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-11T00:19:26.048 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-11T00:19:26.048 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-11T00:19:26.048 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-11T00:19:26.048 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-11T00:19:26.048 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-11T00:19:26.048 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-11T00:19:26.049 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-11T00:19:26.049 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-11T00:19:26.049 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-11T00:19:26.049 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-11T00:19:26.049 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-11T00:19:26.049 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-11T00:19:26.049 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-11T00:19:26.049 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-11T00:19:26.049 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-11T00:19:26.049 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-11T00:19:26.049 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-11T00:19:26.049 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-11T00:19:26.049 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-11T00:19:26.049 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-11T00:19:26.050 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-11T00:19:26.050 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:19:26.050 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:19:26.050 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:19:26.050 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:26.050 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:25 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/3126634096' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:26.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.102+0000 7fd3a7200700 1 -- 172.21.15.111:0/4049917938 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd388006200 con 0x7fd3a8100ba0 2024-09-11T00:19:26.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.103+0000 7fd39ea00700 1 -- 172.21.15.111:0/4049917938 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 33 v33) v1 ==== 76+0+1977 (secure 0 0 0) 0x7fd3940635f0 con 0x7fd3a8100ba0 2024-09-11T00:19:26.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='client.34508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:19:26.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: Upgrade: Setting filesystem cephfs Joinable 2024-09-11T00:19:26.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-11T00:19:26.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: fsmap cephfs:1 {0=cephfs.smithi111.gmgsay=up:active} 3 up:standby 2024-09-11T00:19:26.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:26.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:26.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:26.106 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:26.106 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:26.106 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi111"} : dispatch 2024-09-11T00:19:26.106 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi111"}]': finished 2024-09-11T00:19:26.106 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi203"} : dispatch 2024-09-11T00:19:26.106 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi203"}]': finished 2024-09-11T00:19:26.106 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:26.106 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:26.106 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:26.106 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:26.106 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:26.106 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:26.106 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:26.106 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:26.107 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:26.107 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:26.107 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:26.107 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:26.107 INFO:teuthology.orchestra.run.smithi111.stdout:e33 2024-09-11T00:19:26.107 INFO:teuthology.orchestra.run.smithi111.stdout:btime 2024-09-11T00:19:25:459235+0000 2024-09-11T00:19:26.107 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T00:19:26.107 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:19:26.107 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-11T00:19:26.107 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:19:26.107 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-11T00:19:26.108 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-11T00:19:26.108 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 33 2024-09-11T00:19:26.108 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-11T00:19:26.108 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-11T00:03:47.950356+0000 2024-09-11T00:19:26.108 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-11T00:19:24.665221+0000 2024-09-11T00:19:26.108 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-11T00:19:26.108 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-11T00:19:26.108 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-11T00:19:26.108 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-11T00:19:26.108 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-11T00:19:26.108 INFO:teuthology.orchestra.run.smithi111.stdout:max_xattr_size 65536 2024-09-11T00:19:26.108 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-11T00:19:26.108 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-11T00:19:26.109 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 84 2024-09-11T00:19:26.109 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T00:19:26.109 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-11T00:19:26.109 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-11T00:19:26.109 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=34406} 2024-09-11T00:19:26.109 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-11T00:19:26.109 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-11T00:19:26.109 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-11T00:19:26.109 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-11T00:19:26.109 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-11T00:19:26.109 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data enabled 2024-09-11T00:19:26.109 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-11T00:19:26.109 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-11T00:19:26.110 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 1 2024-09-11T00:19:26.110 INFO:teuthology.orchestra.run.smithi111.stdout:qdb_cluster leader: 34406 members: 34406 2024-09-11T00:19:26.110 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.gmgsay{0:34406} state up:active seq 22 join_fscid=1 addr [v2:172.21.15.111:6826/3970632147,v1:172.21.15.111:6827/3970632147] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:19:26.110 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:19:26.110 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:19:26.110 INFO:teuthology.orchestra.run.smithi111.stdout:Standby daemons: 2024-09-11T00:19:26.110 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:19:26.110 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.rucaba{-1:34438} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.111:6828/36584465,v1:172.21.15.111:6829/36584465] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:19:26.110 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.tcrqop{-1:44379} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.203:6824/4221647525,v1:172.21.15.203:6825/4221647525] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:19:26.110 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.uqkbkn{-1:44393} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.203:6826/1792805040,v1:172.21.15.203:6827/1792805040] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:19:26.111 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-11T00:19:26.111 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-11T00:19:26.111 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-11T00:19:26.111 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-11T00:19:26.111 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-11T00:19:26.111 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-11T00:19:26.111 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-11T00:19:26.111 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-11T00:19:26.111 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-11T00:19:26.111 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-11T00:19:26.111 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-11T00:19:26.111 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-11T00:19:26.111 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-11T00:19:26.112 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-11T00:19:26.112 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-11T00:19:26.112 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-11T00:19:26.112 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-11T00:19:26.112 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-11T00:19:26.112 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-11T00:19:26.112 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-11T00:19:26.112 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-11T00:19:26.112 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-11T00:19:26.112 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-11T00:19:26.112 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-11T00:19:26.112 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-11T00:19:26.112 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-11T00:19:26.113 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-11T00:19:26.113 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-11T00:19:26.113 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-11T00:19:26.113 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-11T00:19:26.113 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-11T00:19:26.113 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:19:26.113 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:19:26.113 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:19:26.113 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:26.113 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:25 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/3126634096' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:19:26.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.106+0000 7fd3a7200700 1 -- 172.21.15.111:0/4049917938 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd38c07a6f0 msgr2=0x7fd38c07cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:26.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.106+0000 7fd3a7200700 1 --2- 172.21.15.111:0/4049917938 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd38c07a6f0 0x7fd38c07cba0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd39800b5c0 tx=0x7fd39801a040 comp rx=0 tx=0).stop 2024-09-11T00:19:26.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.106+0000 7fd3a7200700 1 -- 172.21.15.111:0/4049917938 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3a8100ba0 msgr2=0x7fd3a8198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:26.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.106+0000 7fd3a7200700 1 --2- 172.21.15.111:0/4049917938 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3a8100ba0 0x7fd3a8198330 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd39400d900 tx=0x7fd39400dc10 comp rx=0 tx=0).stop 2024-09-11T00:19:26.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.106+0000 7fd3a7200700 1 -- 172.21.15.111:0/4049917938 shutdown_connections 2024-09-11T00:19:26.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.106+0000 7fd3a7200700 1 --2- 172.21.15.111:0/4049917938 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd38c07a6f0 0x7fd38c07cba0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:26.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.106+0000 7fd3a7200700 1 --2- 172.21.15.111:0/4049917938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3a8100200 0x7fd3a8197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:26.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.106+0000 7fd3a7200700 1 --2- 172.21.15.111:0/4049917938 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3a8100ba0 0x7fd3a8198330 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:26.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.106+0000 7fd3a7200700 1 -- 172.21.15.111:0/4049917938 >> 172.21.15.111:0/4049917938 conn(0x7fd3a80fba80 msgr2=0x7fd3a80fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:26.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.106+0000 7fd3a7200700 1 -- 172.21.15.111:0/4049917938 shutdown_connections 2024-09-11T00:19:26.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.106+0000 7fd3a7200700 1 -- 172.21.15.111:0/4049917938 wait complete. 2024-09-11T00:19:26.115 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 33 2024-09-11T00:19:26.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.244+0000 7f12ae400700 1 -- 172.21.15.111:0/1408691847 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f12a8102610 msgr2=0x7f12a81029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:26.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.244+0000 7f12ae400700 1 --2- 172.21.15.111:0/1408691847 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f12a8102610 0x7f12a81029e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1298009910 tx=0x7f1298009c20 comp rx=0 tx=0).stop 2024-09-11T00:19:26.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.245+0000 7f12ae400700 1 -- 172.21.15.111:0/1408691847 shutdown_connections 2024-09-11T00:19:26.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.245+0000 7f12ae400700 1 --2- 172.21.15.111:0/1408691847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12a8102fb0 0x7f12a8106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:26.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.245+0000 7f12ae400700 1 --2- 172.21.15.111:0/1408691847 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f12a8102610 0x7f12a81029e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:26.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.245+0000 7f12ae400700 1 -- 172.21.15.111:0/1408691847 >> 172.21.15.111:0/1408691847 conn(0x7f12a80fde90 msgr2=0x7f12a81002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:26.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.245+0000 7f12ae400700 1 -- 172.21.15.111:0/1408691847 shutdown_connections 2024-09-11T00:19:26.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.245+0000 7f12ae400700 1 -- 172.21.15.111:0/1408691847 wait complete. 2024-09-11T00:19:26.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.246+0000 7f12ae400700 1 Processor -- start 2024-09-11T00:19:26.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.246+0000 7f12ae400700 1 -- start start 2024-09-11T00:19:26.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.246+0000 7f12ae400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f12a8102610 0x7f12a8198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:26.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.246+0000 7f12ae400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12a8102fb0 0x7f12a81985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:26.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.246+0000 7f12ae400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a8198c80 con 0x7f12a8102610 2024-09-11T00:19:26.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.246+0000 7f12ae400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a819ca10 con 0x7f12a8102fb0 2024-09-11T00:19:26.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.246+0000 7f12a7400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f12a8102610 0x7f12a8198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:26.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.246+0000 7f12a7400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f12a8102610 0x7f12a8198060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:34678/0 (socket says 172.21.15.111:34678) 2024-09-11T00:19:26.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.246+0000 7f12a7400700 1 -- 172.21.15.111:0/890649102 learned_addr learned my addr 172.21.15.111:0/890649102 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:19:26.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.247+0000 7f129fe00700 1 --2- 172.21.15.111:0/890649102 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12a8102fb0 0x7f12a81985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:26.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.247+0000 7f12a7400700 1 -- 172.21.15.111:0/890649102 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12a8102fb0 msgr2=0x7f12a81985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:26.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.247+0000 7f12a7400700 1 --2- 172.21.15.111:0/890649102 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12a8102fb0 0x7f12a81985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:26.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.247+0000 7f12a7400700 1 -- 172.21.15.111:0/890649102 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12980095f0 con 0x7f12a8102610 2024-09-11T00:19:26.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.247+0000 7f12a7400700 1 --2- 172.21.15.111:0/890649102 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f12a8102610 0x7f12a8198060 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f129800b5c0 tx=0x7f129800bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:26.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.247+0000 7f12a4c00700 1 -- 172.21.15.111:0/890649102 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f129801d070 con 0x7f12a8102610 2024-09-11T00:19:26.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.247+0000 7f12a4c00700 1 -- 172.21.15.111:0/890649102 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f129800f460 con 0x7f12a8102610 2024-09-11T00:19:26.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.247+0000 7f12a4c00700 1 -- 172.21.15.111:0/890649102 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1298017630 con 0x7f12a8102610 2024-09-11T00:19:26.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.247+0000 7f12ae400700 1 -- 172.21.15.111:0/890649102 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a819cc90 con 0x7f12a8102610 2024-09-11T00:19:26.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.248+0000 7f12ae400700 1 -- 172.21.15.111:0/890649102 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a819d180 con 0x7f12a8102610 2024-09-11T00:19:26.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.249+0000 7f12ae400700 1 -- 172.21.15.111:0/890649102 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a810a920 con 0x7f12a8102610 2024-09-11T00:19:26.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.250+0000 7f12a4c00700 1 -- 172.21.15.111:0/890649102 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f129800f5d0 con 0x7f12a8102610 2024-09-11T00:19:26.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.251+0000 7f12a4c00700 1 --2- 172.21.15.111:0/890649102 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f128c07a6f0 0x7f128c07cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:26.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.251+0000 7f12a4c00700 1 -- 172.21.15.111:0/890649102 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f129809e800 con 0x7f12a8102610 2024-09-11T00:19:26.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.251+0000 7f129fe00700 1 --2- 172.21.15.111:0/890649102 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f128c07a6f0 0x7f128c07cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:26.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.252+0000 7f129fe00700 1 --2- 172.21.15.111:0/890649102 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f128c07a6f0 0x7f128c07cba0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f12a8199680 tx=0x7f1290009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:26.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.255+0000 7f12a4c00700 1 -- 172.21.15.111:0/890649102 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f1298061ed0 con 0x7f12a8102610 2024-09-11T00:19:26.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.495+0000 7f12ae400700 1 -- 172.21.15.111:0/890649102 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f12a819d520 con 0x7f128c07a6f0 2024-09-11T00:19:26.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.496+0000 7f12a4c00700 1 -- 172.21.15.111:0/890649102 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f12a819d520 con 0x7f128c07a6f0 2024-09-11T00:19:26.498 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:19:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": null, 2024-09-11T00:19:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": false, 2024-09-11T00:19:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "", 2024-09-11T00:19:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [], 2024-09-11T00:19:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": null, 2024-09-11T00:19:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "", 2024-09-11T00:19:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-11T00:19:26.499 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:19:26.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.499+0000 7f12ae400700 1 -- 172.21.15.111:0/890649102 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f128c07a6f0 msgr2=0x7f128c07cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:26.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.499+0000 7f12ae400700 1 --2- 172.21.15.111:0/890649102 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f128c07a6f0 0x7f128c07cba0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f12a8199680 tx=0x7f1290009190 comp rx=0 tx=0).stop 2024-09-11T00:19:26.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.499+0000 7f12ae400700 1 -- 172.21.15.111:0/890649102 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f12a8102610 msgr2=0x7f12a8198060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:26.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.499+0000 7f12ae400700 1 --2- 172.21.15.111:0/890649102 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f12a8102610 0x7f12a8198060 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f129800b5c0 tx=0x7f129800bd50 comp rx=0 tx=0).stop 2024-09-11T00:19:26.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.499+0000 7f12ae400700 1 -- 172.21.15.111:0/890649102 shutdown_connections 2024-09-11T00:19:26.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.499+0000 7f12ae400700 1 --2- 172.21.15.111:0/890649102 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f128c07a6f0 0x7f128c07cba0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:26.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.499+0000 7f12ae400700 1 --2- 172.21.15.111:0/890649102 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f12a8102610 0x7f12a8198060 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:26.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.499+0000 7f12ae400700 1 --2- 172.21.15.111:0/890649102 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12a8102fb0 0x7f12a81985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:26.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.499+0000 7f12ae400700 1 -- 172.21.15.111:0/890649102 >> 172.21.15.111:0/890649102 conn(0x7f12a80fde90 msgr2=0x7f12a80ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:26.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.499+0000 7f12ae400700 1 -- 172.21.15.111:0/890649102 shutdown_connections 2024-09-11T00:19:26.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.499+0000 7f12ae400700 1 -- 172.21.15.111:0/890649102 wait complete. 2024-09-11T00:19:26.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.637+0000 7f4b27e00700 1 -- 172.21.15.111:0/2188540366 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b28100200 msgr2=0x7f4b281005d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:26.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.637+0000 7f4b27e00700 1 --2- 172.21.15.111:0/2188540366 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b28100200 0x7f4b281005d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4b18009910 tx=0x7f4b18009c20 comp rx=0 tx=0).stop 2024-09-11T00:19:26.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.637+0000 7f4b27e00700 1 -- 172.21.15.111:0/2188540366 shutdown_connections 2024-09-11T00:19:26.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.637+0000 7f4b27e00700 1 --2- 172.21.15.111:0/2188540366 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b28100ba0 0x7f4b28104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:26.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.637+0000 7f4b27e00700 1 --2- 172.21.15.111:0/2188540366 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b28100200 0x7f4b281005d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:26.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.637+0000 7f4b27e00700 1 -- 172.21.15.111:0/2188540366 >> 172.21.15.111:0/2188540366 conn(0x7f4b280fba80 msgr2=0x7f4b280fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:26.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.637+0000 7f4b27e00700 1 -- 172.21.15.111:0/2188540366 shutdown_connections 2024-09-11T00:19:26.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.637+0000 7f4b27e00700 1 -- 172.21.15.111:0/2188540366 wait complete. 2024-09-11T00:19:26.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.638+0000 7f4b27e00700 1 Processor -- start 2024-09-11T00:19:26.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.638+0000 7f4b27e00700 1 -- start start 2024-09-11T00:19:26.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.639+0000 7f4b27e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b28100200 0x7f4b2819b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:26.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.639+0000 7f4b27e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b28100ba0 0x7f4b2819bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:26.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.639+0000 7f4b27e00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2819c5a0 con 0x7f4b28100ba0 2024-09-11T00:19:26.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.639+0000 7f4b27e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b28195a50 con 0x7f4b28100200 2024-09-11T00:19:26.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.639+0000 7f4b26000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b28100ba0 0x7f4b2819bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:26.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.639+0000 7f4b26000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b28100ba0 0x7f4b2819bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:34706/0 (socket says 172.21.15.111:34706) 2024-09-11T00:19:26.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.639+0000 7f4b26000700 1 -- 172.21.15.111:0/260811850 learned_addr learned my addr 172.21.15.111:0/260811850 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:19:26.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.639+0000 7f4b26a00700 1 --2- 172.21.15.111:0/260811850 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b28100200 0x7f4b2819b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:26.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.639+0000 7f4b26000700 1 -- 172.21.15.111:0/260811850 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b28100200 msgr2=0x7f4b2819b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:26.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.639+0000 7f4b26000700 1 --2- 172.21.15.111:0/260811850 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b28100200 0x7f4b2819b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:26.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.639+0000 7f4b26000700 1 -- 172.21.15.111:0/260811850 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b180095f0 con 0x7f4b28100ba0 2024-09-11T00:19:26.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.640+0000 7f4b26000700 1 --2- 172.21.15.111:0/260811850 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b28100ba0 0x7f4b2819bf10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400d900 tx=0x7f4b1400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:26.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.640+0000 7f4b1f400700 1 -- 172.21.15.111:0/260811850 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b14009900 con 0x7f4b28100ba0 2024-09-11T00:19:26.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.640+0000 7f4b1f400700 1 -- 172.21.15.111:0/260811850 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4b14010460 con 0x7f4b28100ba0 2024-09-11T00:19:26.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.640+0000 7f4b27e00700 1 -- 172.21.15.111:0/260811850 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b28195d30 con 0x7f4b28100ba0 2024-09-11T00:19:26.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.640+0000 7f4b1f400700 1 -- 172.21.15.111:0/260811850 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b1400f5f0 con 0x7f4b28100ba0 2024-09-11T00:19:26.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.640+0000 7f4b27e00700 1 -- 172.21.15.111:0/260811850 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b28196280 con 0x7f4b28100ba0 2024-09-11T00:19:26.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.641+0000 7f4b27e00700 1 -- 172.21.15.111:0/260811850 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b28108510 con 0x7f4b28100ba0 2024-09-11T00:19:26.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.643+0000 7f4b1f400700 1 -- 172.21.15.111:0/260811850 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f4b140105d0 con 0x7f4b28100ba0 2024-09-11T00:19:26.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.644+0000 7f4b1f400700 1 --2- 172.21.15.111:0/260811850 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4b0c07a6f0 0x7f4b0c07cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:26.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.644+0000 7f4b1f400700 1 -- 172.21.15.111:0/260811850 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f4b1409ce50 con 0x7f4b28100ba0 2024-09-11T00:19:26.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.644+0000 7f4b26a00700 1 --2- 172.21.15.111:0/260811850 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4b0c07a6f0 0x7f4b0c07cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:26.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.645+0000 7f4b26a00700 1 --2- 172.21.15.111:0/260811850 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4b0c07a6f0 0x7f4b0c07cba0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4b18006010 tx=0x7f4b1801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:26.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.649+0000 7f4b1f400700 1 -- 172.21.15.111:0/260811850 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f4b14060520 con 0x7f4b28100ba0 2024-09-11T00:19:26.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:26 smithi111 ceph-mon[90842]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:19:26.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:26 smithi111 ceph-mon[90842]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:19:26.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:26 smithi111 ceph-mon[90842]: Upgrade: Setting container_image for all ceph-exporter 2024-09-11T00:19:26.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:26 smithi111 ceph-mon[90842]: Upgrade: Setting container_image for all iscsi 2024-09-11T00:19:26.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:26 smithi111 ceph-mon[90842]: Upgrade: Setting container_image for all nfs 2024-09-11T00:19:26.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:26 smithi111 ceph-mon[90842]: Upgrade: Setting container_image for all nvmeof 2024-09-11T00:19:26.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:26 smithi111 ceph-mon[90842]: Upgrade: Finalizing container_image settings 2024-09-11T00:19:26.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:26 smithi111 ceph-mon[90842]: Upgrade: Complete! 2024-09-11T00:19:26.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:26 smithi111 ceph-mon[90842]: pgmap v245: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:26.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:26 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:19:26.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:26 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:19:26.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:26 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:19:26.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:26 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:26.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:26 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/4049917938' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:19:26.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.960+0000 7f4b27e00700 1 -- 172.21.15.111:0/260811850 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4b2804f2a0 con 0x7f4b28100ba0 2024-09-11T00:19:26.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.961+0000 7f4b1f400700 1 -- 172.21.15.111:0/260811850 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f4b140170e0 con 0x7f4b28100ba0 2024-09-11T00:19:26.963 INFO:teuthology.orchestra.run.smithi111.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-11T00:19:26.963 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-11T00:19:26.963 INFO:teuthology.orchestra.run.smithi111.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-11T00:19:26.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.963+0000 7f4b27e00700 1 -- 172.21.15.111:0/260811850 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4b0c07a6f0 msgr2=0x7f4b0c07cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:26.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.963+0000 7f4b27e00700 1 --2- 172.21.15.111:0/260811850 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4b0c07a6f0 0x7f4b0c07cba0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4b18006010 tx=0x7f4b1801a040 comp rx=0 tx=0).stop 2024-09-11T00:19:26.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.963+0000 7f4b27e00700 1 -- 172.21.15.111:0/260811850 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b28100ba0 msgr2=0x7f4b2819bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:26.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.963+0000 7f4b27e00700 1 --2- 172.21.15.111:0/260811850 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b28100ba0 0x7f4b2819bf10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400d900 tx=0x7f4b1400dc10 comp rx=0 tx=0).stop 2024-09-11T00:19:26.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.964+0000 7f4b27e00700 1 -- 172.21.15.111:0/260811850 shutdown_connections 2024-09-11T00:19:26.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.964+0000 7f4b27e00700 1 --2- 172.21.15.111:0/260811850 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f4b0c07a6f0 0x7f4b0c07cba0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:26.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.964+0000 7f4b27e00700 1 --2- 172.21.15.111:0/260811850 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b28100200 0x7f4b2819b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:26.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.964+0000 7f4b27e00700 1 --2- 172.21.15.111:0/260811850 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b28100ba0 0x7f4b2819bf10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:26.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.964+0000 7f4b27e00700 1 -- 172.21.15.111:0/260811850 >> 172.21.15.111:0/260811850 conn(0x7f4b280fba80 msgr2=0x7f4b280fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:26.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.964+0000 7f4b27e00700 1 -- 172.21.15.111:0/260811850 shutdown_connections 2024-09-11T00:19:26.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:26.964+0000 7f4b27e00700 1 -- 172.21.15.111:0/260811850 wait complete. 2024-09-11T00:19:27.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:26 smithi203 ceph-mon[69002]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:19:27.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:26 smithi203 ceph-mon[69002]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:19:27.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:26 smithi203 ceph-mon[69002]: Upgrade: Setting container_image for all ceph-exporter 2024-09-11T00:19:27.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:26 smithi203 ceph-mon[69002]: Upgrade: Setting container_image for all iscsi 2024-09-11T00:19:27.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:26 smithi203 ceph-mon[69002]: Upgrade: Setting container_image for all nfs 2024-09-11T00:19:27.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:26 smithi203 ceph-mon[69002]: Upgrade: Setting container_image for all nvmeof 2024-09-11T00:19:27.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:26 smithi203 ceph-mon[69002]: Upgrade: Finalizing container_image settings 2024-09-11T00:19:27.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:26 smithi203 ceph-mon[69002]: Upgrade: Complete! 2024-09-11T00:19:27.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:26 smithi203 ceph-mon[69002]: pgmap v245: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:27.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:26 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:19:27.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:26 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:19:27.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:26 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:19:27.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:26 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:27.046 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:26 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/4049917938' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:19:28.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:27 smithi203 ceph-mon[69002]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:19:28.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:27 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/260811850' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-11T00:19:28.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:27 smithi111 ceph-mon[90842]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:19:28.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:27 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/260811850' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-11T00:19:29.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:28 smithi203 ceph-mon[69002]: pgmap v246: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:29.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:28 smithi111 ceph-mon[90842]: pgmap v246: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:30.048 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:29 smithi203 ceph-mon[69002]: pgmap v247: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:30.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:29 smithi111 ceph-mon[90842]: pgmap v247: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:19:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:31.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:19:31.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:19:32.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:31 smithi203 ceph-mon[69002]: pgmap v248: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:32.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:31 smithi111 ceph-mon[90842]: pgmap v248: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:35.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:34 smithi203 ceph-mon[69002]: pgmap v249: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:35.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:34 smithi111 ceph-mon[90842]: pgmap v249: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:37.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:36 smithi203 ceph-mon[69002]: pgmap v250: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:37.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:36 smithi111 ceph-mon[90842]: pgmap v250: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:39.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:38 smithi203 ceph-mon[69002]: pgmap v251: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:39.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:38 smithi111 ceph-mon[90842]: pgmap v251: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:40.099 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:39 smithi111 ceph-mon[90842]: pgmap v252: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:40.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:39 smithi203 ceph-mon[69002]: pgmap v252: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:43.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:42 smithi203 ceph-mon[69002]: pgmap v253: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:43.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:42 smithi111 ceph-mon[90842]: pgmap v253: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:44.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:44 smithi203 ceph-mon[69002]: pgmap v254: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:45.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:44 smithi111 ceph-mon[90842]: pgmap v254: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:46.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:45 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:19:46.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:45 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:19:47.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:46 smithi203 ceph-mon[69002]: pgmap v255: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:47.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:46 smithi111 ceph-mon[90842]: pgmap v255: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:48.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:47 smithi203 ceph-mon[69002]: pgmap v256: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:48.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:47 smithi111 ceph-mon[90842]: pgmap v256: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:51.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:50 smithi203 ceph-mon[69002]: pgmap v257: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:51.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:50 smithi111 ceph-mon[90842]: pgmap v257: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:53.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:52 smithi203 ceph-mon[69002]: pgmap v258: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:53.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:52 smithi111 ceph-mon[90842]: pgmap v258: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:55.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:54 smithi203 ceph-mon[69002]: pgmap v259: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:55.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:54 smithi111 ceph-mon[90842]: pgmap v259: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:56.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:55 smithi203 ceph-mon[69002]: pgmap v260: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:56.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:55 smithi111 ceph-mon[90842]: pgmap v260: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:57.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.117+0000 7fbf8b600700 1 -- 172.21.15.111:0/672047698 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbf84075b90 msgr2=0x7fbf84110b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:57.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.117+0000 7fbf8b600700 1 --2- 172.21.15.111:0/672047698 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbf84075b90 0x7fbf84110b10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbf70009910 tx=0x7fbf70009c20 comp rx=0 tx=0).stop 2024-09-11T00:19:57.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.117+0000 7fbf8b600700 1 -- 172.21.15.111:0/672047698 shutdown_connections 2024-09-11T00:19:57.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.117+0000 7fbf8b600700 1 --2- 172.21.15.111:0/672047698 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbf84075b90 0x7fbf84110b10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:57.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.117+0000 7fbf8b600700 1 --2- 172.21.15.111:0/672047698 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf84075280 0x7fbf84075650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:57.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.117+0000 7fbf8b600700 1 -- 172.21.15.111:0/672047698 >> 172.21.15.111:0/672047698 conn(0x7fbf840fde90 msgr2=0x7fbf841002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:57.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.117+0000 7fbf8b600700 1 -- 172.21.15.111:0/672047698 shutdown_connections 2024-09-11T00:19:57.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.117+0000 7fbf8b600700 1 -- 172.21.15.111:0/672047698 wait complete. 2024-09-11T00:19:57.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.118+0000 7fbf8b600700 1 Processor -- start 2024-09-11T00:19:57.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.118+0000 7fbf8b600700 1 -- start start 2024-09-11T00:19:57.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.119+0000 7fbf8b600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbf84075280 0x7fbf8419c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:57.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.119+0000 7fbf8b600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf84075b90 0x7fbf8419c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:57.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.119+0000 7fbf8b600700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8419ceb0 con 0x7fbf84075280 2024-09-11T00:19:57.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.119+0000 7fbf8b600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8419cff0 con 0x7fbf84075b90 2024-09-11T00:19:57.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.119+0000 7fbf88c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbf84075280 0x7fbf8419c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:57.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.119+0000 7fbf88c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbf84075280 0x7fbf8419c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42158/0 (socket says 172.21.15.111:42158) 2024-09-11T00:19:57.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.119+0000 7fbf88c00700 1 -- 172.21.15.111:0/3960149802 learned_addr learned my addr 172.21.15.111:0/3960149802 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:19:57.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.119+0000 7fbf83e00700 1 --2- 172.21.15.111:0/3960149802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf84075b90 0x7fbf8419c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:57.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.119+0000 7fbf88c00700 1 -- 172.21.15.111:0/3960149802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf84075b90 msgr2=0x7fbf8419c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:57.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.119+0000 7fbf88c00700 1 --2- 172.21.15.111:0/3960149802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf84075b90 0x7fbf8419c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:57.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.119+0000 7fbf88c00700 1 -- 172.21.15.111:0/3960149802 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf700095f0 con 0x7fbf84075280 2024-09-11T00:19:57.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.119+0000 7fbf83e00700 1 --2- 172.21.15.111:0/3960149802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf84075b90 0x7fbf8419c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:19:57.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.120+0000 7fbf88c00700 1 --2- 172.21.15.111:0/3960149802 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbf84075280 0x7fbf8419c320 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbf7800c930 tx=0x7fbf7800ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:57.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.120+0000 7fbf81600700 1 -- 172.21.15.111:0/3960149802 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf78007ad0 con 0x7fbf84075280 2024-09-11T00:19:57.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.120+0000 7fbf81600700 1 -- 172.21.15.111:0/3960149802 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbf78007c30 con 0x7fbf84075280 2024-09-11T00:19:57.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.120+0000 7fbf81600700 1 -- 172.21.15.111:0/3960149802 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf78018610 con 0x7fbf84075280 2024-09-11T00:19:57.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.120+0000 7fbf8b600700 1 -- 172.21.15.111:0/3960149802 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf841a0e40 con 0x7fbf84075280 2024-09-11T00:19:57.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.120+0000 7fbf8b600700 1 -- 172.21.15.111:0/3960149802 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf841a1340 con 0x7fbf84075280 2024-09-11T00:19:57.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.121+0000 7fbf8b600700 1 -- 172.21.15.111:0/3960149802 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf8410e280 con 0x7fbf84075280 2024-09-11T00:19:57.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.122+0000 7fbf81600700 1 -- 172.21.15.111:0/3960149802 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fbf7800f450 con 0x7fbf84075280 2024-09-11T00:19:57.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.123+0000 7fbf81600700 1 --2- 172.21.15.111:0/3960149802 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fbf6c07a6f0 0x7fbf6c07cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:57.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.123+0000 7fbf81600700 1 -- 172.21.15.111:0/3960149802 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fbf7809d5a0 con 0x7fbf84075280 2024-09-11T00:19:57.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.124+0000 7fbf83e00700 1 --2- 172.21.15.111:0/3960149802 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fbf6c07a6f0 0x7fbf6c07cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:57.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.124+0000 7fbf83e00700 1 --2- 172.21.15.111:0/3960149802 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fbf6c07a6f0 0x7fbf6c07cba0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbf8419d940 tx=0x7fbf70005ab0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:57.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.128+0000 7fbf81600700 1 -- 172.21.15.111:0/3960149802 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fbf78060bf0 con 0x7fbf84075280 2024-09-11T00:19:57.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.366+0000 7fbf8b600700 1 -- 172.21.15.111:0/3960149802 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf8402cd10 con 0x7fbf6c07a6f0 2024-09-11T00:19:57.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.367+0000 7fbf81600700 1 -- 172.21.15.111:0/3960149802 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fbf8402cd10 con 0x7fbf6c07a6f0 2024-09-11T00:19:57.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.370+0000 7fbf8b600700 1 -- 172.21.15.111:0/3960149802 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fbf6c07a6f0 msgr2=0x7fbf6c07cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:57.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.370+0000 7fbf8b600700 1 --2- 172.21.15.111:0/3960149802 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fbf6c07a6f0 0x7fbf6c07cba0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbf8419d940 tx=0x7fbf70005ab0 comp rx=0 tx=0).stop 2024-09-11T00:19:57.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.370+0000 7fbf8b600700 1 -- 172.21.15.111:0/3960149802 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbf84075280 msgr2=0x7fbf8419c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:57.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.370+0000 7fbf8b600700 1 --2- 172.21.15.111:0/3960149802 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbf84075280 0x7fbf8419c320 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbf7800c930 tx=0x7fbf7800ccf0 comp rx=0 tx=0).stop 2024-09-11T00:19:57.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.370+0000 7fbf8b600700 1 -- 172.21.15.111:0/3960149802 shutdown_connections 2024-09-11T00:19:57.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.370+0000 7fbf8b600700 1 --2- 172.21.15.111:0/3960149802 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fbf6c07a6f0 0x7fbf6c07cba0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:57.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.370+0000 7fbf8b600700 1 --2- 172.21.15.111:0/3960149802 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbf84075280 0x7fbf8419c320 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:57.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.370+0000 7fbf8b600700 1 --2- 172.21.15.111:0/3960149802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf84075b90 0x7fbf8419c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:57.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.370+0000 7fbf8b600700 1 -- 172.21.15.111:0/3960149802 >> 172.21.15.111:0/3960149802 conn(0x7fbf840fde90 msgr2=0x7fbf840feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:57.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.370+0000 7fbf8b600700 1 -- 172.21.15.111:0/3960149802 shutdown_connections 2024-09-11T00:19:57.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:19:57.370+0000 7fbf8b600700 1 -- 172.21.15.111:0/3960149802 wait complete. 2024-09-11T00:19:58.153 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -e sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 -- bash -c 'ceph orch ps' 2024-09-11T00:19:58.519 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:19:58.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:58 smithi111 ceph-mon[90842]: from='client.34536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:19:58.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:19:58 smithi111 ceph-mon[90842]: pgmap v261: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:19:59.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:58 smithi203 ceph-mon[69002]: from='client.34536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:19:59.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:19:58 smithi203 ceph-mon[69002]: pgmap v261: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:00.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.423+0000 7fad90c00700 1 -- 172.21.15.111:0/3372957857 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad8c100ba0 msgr2=0x7fad8c104b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:00.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.423+0000 7fad90c00700 1 --2- 172.21.15.111:0/3372957857 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad8c100ba0 0x7fad8c104b70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fad78009910 tx=0x7fad78009c20 comp rx=0 tx=0).stop 2024-09-11T00:20:00.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.423+0000 7fad90c00700 1 -- 172.21.15.111:0/3372957857 shutdown_connections 2024-09-11T00:20:00.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.423+0000 7fad90c00700 1 --2- 172.21.15.111:0/3372957857 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad8c100ba0 0x7fad8c104b70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:00.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.423+0000 7fad90c00700 1 --2- 172.21.15.111:0/3372957857 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad8c100200 0x7fad8c1005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:00.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.423+0000 7fad90c00700 1 -- 172.21.15.111:0/3372957857 >> 172.21.15.111:0/3372957857 conn(0x7fad8c0fba80 msgr2=0x7fad8c0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:00.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.423+0000 7fad90c00700 1 -- 172.21.15.111:0/3372957857 shutdown_connections 2024-09-11T00:20:00.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.423+0000 7fad90c00700 1 -- 172.21.15.111:0/3372957857 wait complete. 2024-09-11T00:20:00.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.424+0000 7fad90c00700 1 Processor -- start 2024-09-11T00:20:00.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.424+0000 7fad90c00700 1 -- start start 2024-09-11T00:20:00.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.424+0000 7fad90c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad8c100200 0x7fad8c073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:00.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.424+0000 7fad90c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad8c100ba0 0x7fad8c073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:00.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.424+0000 7fad90c00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c073ad0 con 0x7fad8c100200 2024-09-11T00:20:00.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.424+0000 7fad90c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c073c10 con 0x7fad8c100ba0 2024-09-11T00:20:00.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.425+0000 7fad8b400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad8c100200 0x7fad8c073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:00.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.425+0000 7fad8b400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad8c100200 0x7fad8c073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:59422/0 (socket says 172.21.15.111:59422) 2024-09-11T00:20:00.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.425+0000 7fad8b400700 1 -- 172.21.15.111:0/47111170 learned_addr learned my addr 172.21.15.111:0/47111170 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:20:00.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.425+0000 7fad8aa00700 1 --2- 172.21.15.111:0/47111170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad8c100ba0 0x7fad8c073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:00.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.425+0000 7fad8b400700 1 -- 172.21.15.111:0/47111170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad8c100ba0 msgr2=0x7fad8c073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:00.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.425+0000 7fad8b400700 1 --2- 172.21.15.111:0/47111170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad8c100ba0 0x7fad8c073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:00.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.425+0000 7fad8b400700 1 -- 172.21.15.111:0/47111170 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad780095f0 con 0x7fad8c100200 2024-09-11T00:20:00.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.425+0000 7fad8b400700 1 --2- 172.21.15.111:0/47111170 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad8c100200 0x7fad8c073050 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fad7c00d900 tx=0x7fad7c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:00.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.426+0000 7fad83e00700 1 -- 172.21.15.111:0/47111170 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad7c0041f0 con 0x7fad8c100200 2024-09-11T00:20:00.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.426+0000 7fad83e00700 1 -- 172.21.15.111:0/47111170 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad7c004cf0 con 0x7fad8c100200 2024-09-11T00:20:00.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.426+0000 7fad90c00700 1 -- 172.21.15.111:0/47111170 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad8c1a1dc0 con 0x7fad8c100200 2024-09-11T00:20:00.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.426+0000 7fad83e00700 1 -- 172.21.15.111:0/47111170 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad7c00b750 con 0x7fad8c100200 2024-09-11T00:20:00.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.426+0000 7fad90c00700 1 -- 172.21.15.111:0/47111170 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad8c1a21d0 con 0x7fad8c100200 2024-09-11T00:20:00.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.427+0000 7fad90c00700 1 -- 172.21.15.111:0/47111170 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad8c04f2a0 con 0x7fad8c100200 2024-09-11T00:20:00.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.429+0000 7fad83e00700 1 -- 172.21.15.111:0/47111170 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fad7c004750 con 0x7fad8c100200 2024-09-11T00:20:00.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.430+0000 7fad83e00700 1 --2- 172.21.15.111:0/47111170 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fad7007a6f0 0x7fad7007cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:00.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.430+0000 7fad83e00700 1 -- 172.21.15.111:0/47111170 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fad7c09d240 con 0x7fad8c100200 2024-09-11T00:20:00.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.430+0000 7fad8aa00700 1 --2- 172.21.15.111:0/47111170 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fad7007a6f0 0x7fad7007cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:00.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.431+0000 7fad8aa00700 1 --2- 172.21.15.111:0/47111170 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fad7007a6f0 0x7fad7007cba0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fad8c074840 tx=0x7fad7801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:00.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.435+0000 7fad83e00700 1 -- 172.21.15.111:0/47111170 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fad7c060890 con 0x7fad8c100200 2024-09-11T00:20:00.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.681+0000 7fad90c00700 1 -- 172.21.15.111:0/47111170 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fad8c0fddd0 con 0x7fad7007a6f0 2024-09-11T00:20:00.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.691+0000 7fad83e00700 1 -- 172.21.15.111:0/47111170 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fad8c0fddd0 con 0x7fad7007a6f0 2024-09-11T00:20:00.693 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:20:00.693 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (9m) 41s ago 23m 15.7M - 0.27.0 11f11916f8cd d6d3253e881f 2024-09-11T00:20:00.693 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (53s) 41s ago 23m 7805k - 19.3.0-4854-g8f219c47 589dd18248e4 583f61b2aa1e 2024-09-11T00:20:00.693 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi203 smithi203 running (47s) 43s ago 22m 7348k - 19.3.0-4854-g8f219c47 589dd18248e4 2ca5e58a2d0c 2024-09-11T00:20:00.693 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (6m) 41s ago 23m 6899k - 19.3.0-4854-g8f219c47 589dd18248e4 a9cacdb9a638 2024-09-11T00:20:00.693 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi203 smithi203 running (6m) 43s ago 22m 6899k - 19.3.0-4854-g8f219c47 589dd18248e4 d452d9dfa04b 2024-09-11T00:20:00.694 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (9m) 41s ago 22m 68.1M - c8b91775d855 7d3b50b5b59f 2024-09-11T00:20:00.694 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.gmgsay smithi111 running (2m) 41s ago 16m 86.5M - 19.3.0-4854-g8f219c47 589dd18248e4 a8cff96fcbbe 2024-09-11T00:20:00.694 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.rucaba smithi111 running (2m) 41s ago 16m 12.5M - 19.3.0-4854-g8f219c47 589dd18248e4 63a1d760686d 2024-09-11T00:20:00.694 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.tcrqop smithi203 running (92s) 43s ago 16m 12.3M - 19.3.0-4854-g8f219c47 589dd18248e4 f9cc4db8b461 2024-09-11T00:20:00.694 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.uqkbkn smithi203 running (69s) 43s ago 15m 12.2M - 19.3.0-4854-g8f219c47 589dd18248e4 8c20ffa3e7ee 2024-09-11T00:20:00.694 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.ypucji smithi111 *:8443,9283,8765 running (11m) 41s ago 24m 520M - 19.3.0-4854-g8f219c47 589dd18248e4 07fa31f49618 2024-09-11T00:20:00.694 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi203.smuspl smithi203 *:8443,9283,8765 running (10m) 43s ago 21m 457M - 19.3.0-4854-g8f219c47 589dd18248e4 7e5a93a5ffa7 2024-09-11T00:20:00.694 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (7m) 41s ago 25m 58.2M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 3c29c070a612 2024-09-11T00:20:00.694 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi203 smithi203 running (7m) 43s ago 21m 47.6M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 45e8285e4b4d 2024-09-11T00:20:00.694 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (10m) 41s ago 23m 7625k - 1.7.0 72c9c2088986 ec478ea14488 2024-09-11T00:20:00.694 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi203 smithi203 *:9100 running (10m) 43s ago 22m 8170k - 1.7.0 72c9c2088986 54d461cde1bc 2024-09-11T00:20:00.694 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (5m) 41s ago 20m 99.8M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 d2f1a2312736 2024-09-11T00:20:00.694 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (5m) 41s ago 19m 104M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 19cf95ecca7d 2024-09-11T00:20:00.695 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (4m) 41s ago 19m 86.4M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 3a3b318b337a 2024-09-11T00:20:00.695 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi203 running (3m) 43s ago 18m 105M 2240M 19.3.0-4854-g8f219c47 589dd18248e4 288c7e8ae34b 2024-09-11T00:20:00.695 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi203 running (3m) 43s ago 18m 96.0M 2240M 19.3.0-4854-g8f219c47 589dd18248e4 485f82d3eafb 2024-09-11T00:20:00.695 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi203 running (2m) 43s ago 17m 94.9M 2240M 19.3.0-4854-g8f219c47 589dd18248e4 ef4834f3adf1 2024-09-11T00:20:00.695 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (9m) 41s ago 22m 64.3M - 2.51.0 1d3b7f56885b 3e72ac10983d 2024-09-11T00:20:00.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.693+0000 7fad90c00700 1 -- 172.21.15.111:0/47111170 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fad7007a6f0 msgr2=0x7fad7007cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:00.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.693+0000 7fad90c00700 1 --2- 172.21.15.111:0/47111170 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fad7007a6f0 0x7fad7007cba0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fad8c074840 tx=0x7fad7801a040 comp rx=0 tx=0).stop 2024-09-11T00:20:00.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.693+0000 7fad90c00700 1 -- 172.21.15.111:0/47111170 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad8c100200 msgr2=0x7fad8c073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:00.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.693+0000 7fad90c00700 1 --2- 172.21.15.111:0/47111170 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad8c100200 0x7fad8c073050 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fad7c00d900 tx=0x7fad7c00dc10 comp rx=0 tx=0).stop 2024-09-11T00:20:00.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.694+0000 7fad90c00700 1 -- 172.21.15.111:0/47111170 shutdown_connections 2024-09-11T00:20:00.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.694+0000 7fad90c00700 1 --2- 172.21.15.111:0/47111170 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fad7007a6f0 0x7fad7007cba0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:00.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.694+0000 7fad90c00700 1 --2- 172.21.15.111:0/47111170 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad8c100200 0x7fad8c073050 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:00.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.694+0000 7fad90c00700 1 --2- 172.21.15.111:0/47111170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad8c100ba0 0x7fad8c073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:00.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.694+0000 7fad90c00700 1 -- 172.21.15.111:0/47111170 >> 172.21.15.111:0/47111170 conn(0x7fad8c0fba80 msgr2=0x7fad8c0fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:00.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.694+0000 7fad90c00700 1 -- 172.21.15.111:0/47111170 shutdown_connections 2024-09-11T00:20:00.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:00.694+0000 7fad90c00700 1 -- 172.21.15.111:0/47111170 wait complete. 2024-09-11T00:20:01.033 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:00 smithi111 ceph-mon[90842]: pgmap v262: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:01.033 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:00 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:20:01.033 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:00 smithi111 ceph-mon[90842]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-11T00:20:01.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:00 smithi203 ceph-mon[69002]: pgmap v262: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:01.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:00 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:20:01.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:00 smithi203 ceph-mon[69002]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-11T00:20:01.363 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -e sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 -- bash -c 'ceph orch upgrade status' 2024-09-11T00:20:01.691 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:20:02.010 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:01 smithi111 ceph-mon[90842]: from='client.34540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:20:02.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:01 smithi203 ceph-mon[69002]: from='client.34540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:20:02.894 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:02 smithi111 ceph-mon[90842]: pgmap v263: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:03.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:02 smithi203 ceph-mon[69002]: pgmap v263: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:03.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.587+0000 7fe238600700 1 -- 172.21.15.111:0/2824914229 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe2301003d0 msgr2=0x7fe2301007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:03.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.587+0000 7fe238600700 1 --2- 172.21.15.111:0/2824914229 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe2301003d0 0x7fe2301007a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe224009910 tx=0x7fe224009c20 comp rx=0 tx=0).stop 2024-09-11T00:20:03.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.587+0000 7fe238600700 1 -- 172.21.15.111:0/2824914229 shutdown_connections 2024-09-11T00:20:03.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.587+0000 7fe238600700 1 --2- 172.21.15.111:0/2824914229 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe230100d70 0x7fe230104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:03.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.587+0000 7fe238600700 1 --2- 172.21.15.111:0/2824914229 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe2301003d0 0x7fe2301007a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:03.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.587+0000 7fe238600700 1 -- 172.21.15.111:0/2824914229 >> 172.21.15.111:0/2824914229 conn(0x7fe2300fbc90 msgr2=0x7fe2300fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:03.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.587+0000 7fe238600700 1 -- 172.21.15.111:0/2824914229 shutdown_connections 2024-09-11T00:20:03.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.587+0000 7fe238600700 1 -- 172.21.15.111:0/2824914229 wait complete. 2024-09-11T00:20:03.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.588+0000 7fe238600700 1 Processor -- start 2024-09-11T00:20:03.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.588+0000 7fe238600700 1 -- start start 2024-09-11T00:20:03.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.588+0000 7fe238600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2301003d0 0x7fe230197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:03.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.588+0000 7fe238600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe230100d70 0x7fe230198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:03.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.588+0000 7fe238600700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe230198b40 con 0x7fe230100d70 2024-09-11T00:20:03.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.588+0000 7fe238600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23019c8d0 con 0x7fe2301003d0 2024-09-11T00:20:03.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.589+0000 7fe235200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe230100d70 0x7fe230198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:03.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.589+0000 7fe235200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe230100d70 0x7fe230198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:59436/0 (socket says 172.21.15.111:59436) 2024-09-11T00:20:03.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.589+0000 7fe235200700 1 -- 172.21.15.111:0/2326844387 learned_addr learned my addr 172.21.15.111:0/2326844387 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:20:03.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.589+0000 7fe235c00700 1 --2- 172.21.15.111:0/2326844387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2301003d0 0x7fe230197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:03.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.589+0000 7fe235200700 1 -- 172.21.15.111:0/2326844387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2301003d0 msgr2=0x7fe230197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:03.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.589+0000 7fe235200700 1 --2- 172.21.15.111:0/2326844387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2301003d0 0x7fe230197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:03.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.589+0000 7fe235200700 1 -- 172.21.15.111:0/2326844387 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2240095f0 con 0x7fe230100d70 2024-09-11T00:20:03.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.589+0000 7fe235200700 1 --2- 172.21.15.111:0/2326844387 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe230100d70 0x7fe230198460 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00d900 tx=0x7fe21c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:03.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.590+0000 7fe22e000700 1 -- 172.21.15.111:0/2326844387 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe21c009900 con 0x7fe230100d70 2024-09-11T00:20:03.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.590+0000 7fe22e000700 1 -- 172.21.15.111:0/2326844387 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe21c010460 con 0x7fe230100d70 2024-09-11T00:20:03.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.590+0000 7fe238600700 1 -- 172.21.15.111:0/2326844387 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe23019cbb0 con 0x7fe230100d70 2024-09-11T00:20:03.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.590+0000 7fe22e000700 1 -- 172.21.15.111:0/2326844387 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe21c00f5f0 con 0x7fe230100d70 2024-09-11T00:20:03.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.590+0000 7fe238600700 1 -- 172.21.15.111:0/2326844387 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe23019d100 con 0x7fe230100d70 2024-09-11T00:20:03.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.591+0000 7fe238600700 1 -- 172.21.15.111:0/2326844387 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2301044c0 con 0x7fe230100d70 2024-09-11T00:20:03.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.592+0000 7fe22e000700 1 -- 172.21.15.111:0/2326844387 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fe21c0105d0 con 0x7fe230100d70 2024-09-11T00:20:03.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.593+0000 7fe22e000700 1 --2- 172.21.15.111:0/2326844387 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe21807a6f0 0x7fe21807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:03.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.593+0000 7fe22e000700 1 -- 172.21.15.111:0/2326844387 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fe21c09cf40 con 0x7fe230100d70 2024-09-11T00:20:03.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.593+0000 7fe235c00700 1 --2- 172.21.15.111:0/2326844387 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe21807a6f0 0x7fe21807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:03.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.594+0000 7fe235c00700 1 --2- 172.21.15.111:0/2326844387 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe21807a6f0 0x7fe21807cba0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe224006010 tx=0x7fe22401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:03.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.597+0000 7fe22e000700 1 -- 172.21.15.111:0/2326844387 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fe21c060590 con 0x7fe230100d70 2024-09-11T00:20:03.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.850+0000 7fe238600700 1 -- 172.21.15.111:0/2326844387 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe23019d3e0 con 0x7fe21807a6f0 2024-09-11T00:20:03.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.851+0000 7fe22e000700 1 -- 172.21.15.111:0/2326844387 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fe23019d3e0 con 0x7fe21807a6f0 2024-09-11T00:20:03.853 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:20:03.853 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": null, 2024-09-11T00:20:03.853 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": false, 2024-09-11T00:20:03.853 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "", 2024-09-11T00:20:03.854 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [], 2024-09-11T00:20:03.854 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": null, 2024-09-11T00:20:03.854 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "", 2024-09-11T00:20:03.854 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-11T00:20:03.854 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:20:03.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.854+0000 7fe238600700 1 -- 172.21.15.111:0/2326844387 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe21807a6f0 msgr2=0x7fe21807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:03.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.854+0000 7fe238600700 1 --2- 172.21.15.111:0/2326844387 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe21807a6f0 0x7fe21807cba0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe224006010 tx=0x7fe22401a040 comp rx=0 tx=0).stop 2024-09-11T00:20:03.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.854+0000 7fe238600700 1 -- 172.21.15.111:0/2326844387 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe230100d70 msgr2=0x7fe230198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:03.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.854+0000 7fe238600700 1 --2- 172.21.15.111:0/2326844387 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe230100d70 0x7fe230198460 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00d900 tx=0x7fe21c00dc10 comp rx=0 tx=0).stop 2024-09-11T00:20:03.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.854+0000 7fe238600700 1 -- 172.21.15.111:0/2326844387 shutdown_connections 2024-09-11T00:20:03.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.854+0000 7fe238600700 1 --2- 172.21.15.111:0/2326844387 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe21807a6f0 0x7fe21807cba0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:03.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.854+0000 7fe238600700 1 --2- 172.21.15.111:0/2326844387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2301003d0 0x7fe230197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:03.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.854+0000 7fe238600700 1 --2- 172.21.15.111:0/2326844387 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe230100d70 0x7fe230198460 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:03.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.854+0000 7fe238600700 1 -- 172.21.15.111:0/2326844387 >> 172.21.15.111:0/2326844387 conn(0x7fe2300fbc90 msgr2=0x7fe2300fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:03.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.855+0000 7fe238600700 1 -- 172.21.15.111:0/2326844387 shutdown_connections 2024-09-11T00:20:03.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:03.855+0000 7fe238600700 1 -- 172.21.15.111:0/2326844387 wait complete. 2024-09-11T00:20:04.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:03 smithi203 ceph-mon[69002]: pgmap v264: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:04.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:03 smithi111 ceph-mon[90842]: pgmap v264: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:04.566 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -e sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 -- bash -c 'ceph health detail' 2024-09-11T00:20:04.888 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:20:04.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:04 smithi111 ceph-mon[90842]: from='client.34544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:20:05.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:04 smithi203 ceph-mon[69002]: from='client.34544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:20:06.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:05 smithi203 ceph-mon[69002]: pgmap v265: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:06.068 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:05 smithi111 ceph-mon[90842]: pgmap v265: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:06.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.692+0000 7f6cf7600700 1 -- 172.21.15.111:0/1267608688 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6cf01003d0 msgr2=0x7f6cf01007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:06.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.692+0000 7f6cf7600700 1 --2- 172.21.15.111:0/1267608688 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6cf01003d0 0x7f6cf01007a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4009910 tx=0x7f6ce4009c20 comp rx=0 tx=0).stop 2024-09-11T00:20:06.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.692+0000 7f6cf7600700 1 -- 172.21.15.111:0/1267608688 shutdown_connections 2024-09-11T00:20:06.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.692+0000 7f6cf7600700 1 --2- 172.21.15.111:0/1267608688 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cf0100d70 0x7f6cf0104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:06.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.692+0000 7f6cf7600700 1 --2- 172.21.15.111:0/1267608688 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6cf01003d0 0x7f6cf01007a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:06.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.692+0000 7f6cf7600700 1 -- 172.21.15.111:0/1267608688 >> 172.21.15.111:0/1267608688 conn(0x7f6cf00fbc90 msgr2=0x7f6cf00fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:06.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.692+0000 7f6cf7600700 1 -- 172.21.15.111:0/1267608688 shutdown_connections 2024-09-11T00:20:06.695 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.692+0000 7f6cf7600700 1 -- 172.21.15.111:0/1267608688 wait complete. 2024-09-11T00:20:06.695 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.693+0000 7f6cf7600700 1 Processor -- start 2024-09-11T00:20:06.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.693+0000 7f6cf7600700 1 -- start start 2024-09-11T00:20:06.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.693+0000 7f6cf7600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6cf01003d0 0x7f6cf0197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:06.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.693+0000 7f6cf7600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cf0100d70 0x7f6cf0198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:06.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.693+0000 7f6cf7600700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf0198b40 con 0x7f6cf01003d0 2024-09-11T00:20:06.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.693+0000 7f6cf7600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf019c8d0 con 0x7f6cf0100d70 2024-09-11T00:20:06.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.694+0000 7f6cf4c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6cf01003d0 0x7f6cf0197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:06.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.694+0000 7f6cf4c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6cf01003d0 0x7f6cf0197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:59458/0 (socket says 172.21.15.111:59458) 2024-09-11T00:20:06.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.694+0000 7f6cefe00700 1 --2- 172.21.15.111:0/1148879796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cf0100d70 0x7f6cf0198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:06.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.694+0000 7f6cf4c00700 1 -- 172.21.15.111:0/1148879796 learned_addr learned my addr 172.21.15.111:0/1148879796 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:20:06.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.694+0000 7f6cf4c00700 1 -- 172.21.15.111:0/1148879796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cf0100d70 msgr2=0x7f6cf0198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:06.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.694+0000 7f6cf4c00700 1 --2- 172.21.15.111:0/1148879796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cf0100d70 0x7f6cf0198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:06.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.694+0000 7f6cf4c00700 1 -- 172.21.15.111:0/1148879796 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce40095f0 con 0x7f6cf01003d0 2024-09-11T00:20:06.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.694+0000 7f6cefe00700 1 --2- 172.21.15.111:0/1148879796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cf0100d70 0x7f6cf0198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:20:06.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.694+0000 7f6cf4c00700 1 --2- 172.21.15.111:0/1148879796 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6cf01003d0 0x7f6cf0197f20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40092e0 tx=0x7f6ce400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:06.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.695+0000 7f6ced600700 1 -- 172.21.15.111:0/1148879796 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ce401d070 con 0x7f6cf01003d0 2024-09-11T00:20:06.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.695+0000 7f6ced600700 1 -- 172.21.15.111:0/1148879796 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6ce40052a0 con 0x7f6cf01003d0 2024-09-11T00:20:06.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.695+0000 7f6cf7600700 1 -- 172.21.15.111:0/1148879796 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf019cb50 con 0x7f6cf01003d0 2024-09-11T00:20:06.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.695+0000 7f6ced600700 1 -- 172.21.15.111:0/1148879796 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ce4017400 con 0x7f6cf01003d0 2024-09-11T00:20:06.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.695+0000 7f6cf7600700 1 -- 172.21.15.111:0/1148879796 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf019d040 con 0x7f6cf01003d0 2024-09-11T00:20:06.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.696+0000 7f6cf7600700 1 -- 172.21.15.111:0/1148879796 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cf01044c0 con 0x7f6cf01003d0 2024-09-11T00:20:06.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.697+0000 7f6ced600700 1 -- 172.21.15.111:0/1148879796 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f6ce400f820 con 0x7f6cf01003d0 2024-09-11T00:20:06.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.698+0000 7f6ced600700 1 --2- 172.21.15.111:0/1148879796 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f6cd807a6f0 0x7f6cd807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:06.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.698+0000 7f6ced600700 1 -- 172.21.15.111:0/1148879796 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f6ce409e6b0 con 0x7f6cf01003d0 2024-09-11T00:20:06.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.698+0000 7f6cefe00700 1 --2- 172.21.15.111:0/1148879796 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f6cd807a6f0 0x7f6cd807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:06.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.699+0000 7f6cefe00700 1 --2- 172.21.15.111:0/1148879796 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f6cd807a6f0 0x7f6cd807cba0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0199540 tx=0x7f6cdc009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:06.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:06.702+0000 7f6ced600700 1 -- 172.21.15.111:0/1148879796 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f6ce4061d00 con 0x7f6cf01003d0 2024-09-11T00:20:07.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:07.013+0000 7f6cf7600700 1 -- 172.21.15.111:0/1148879796 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6cf002ccf0 con 0x7f6cf01003d0 2024-09-11T00:20:07.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:07.014+0000 7f6ced600700 1 -- 172.21.15.111:0/1148879796 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f6ce4064e20 con 0x7f6cf01003d0 2024-09-11T00:20:07.016 INFO:teuthology.orchestra.run.smithi111.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-11T00:20:07.016 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-11T00:20:07.016 INFO:teuthology.orchestra.run.smithi111.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-11T00:20:07.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:07.018+0000 7f6cf7600700 1 -- 172.21.15.111:0/1148879796 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f6cd807a6f0 msgr2=0x7f6cd807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:07.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:07.018+0000 7f6cf7600700 1 --2- 172.21.15.111:0/1148879796 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f6cd807a6f0 0x7f6cd807cba0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0199540 tx=0x7f6cdc009260 comp rx=0 tx=0).stop 2024-09-11T00:20:07.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:07.018+0000 7f6cf7600700 1 -- 172.21.15.111:0/1148879796 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6cf01003d0 msgr2=0x7f6cf0197f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:07.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:07.018+0000 7f6cf7600700 1 --2- 172.21.15.111:0/1148879796 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6cf01003d0 0x7f6cf0197f20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40092e0 tx=0x7f6ce400b6c0 comp rx=0 tx=0).stop 2024-09-11T00:20:07.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:07.018+0000 7f6cf7600700 1 -- 172.21.15.111:0/1148879796 shutdown_connections 2024-09-11T00:20:07.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:07.018+0000 7f6cf7600700 1 --2- 172.21.15.111:0/1148879796 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f6cd807a6f0 0x7f6cd807cba0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:07.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:07.018+0000 7f6cf7600700 1 --2- 172.21.15.111:0/1148879796 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6cf01003d0 0x7f6cf0197f20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:07.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:07.018+0000 7f6cf7600700 1 --2- 172.21.15.111:0/1148879796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cf0100d70 0x7f6cf0198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:07.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:07.018+0000 7f6cf7600700 1 -- 172.21.15.111:0/1148879796 >> 172.21.15.111:0/1148879796 conn(0x7f6cf00fbc90 msgr2=0x7f6cf00fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:07.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:07.018+0000 7f6cf7600700 1 -- 172.21.15.111:0/1148879796 shutdown_connections 2024-09-11T00:20:07.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:07.018+0000 7f6cf7600700 1 -- 172.21.15.111:0/1148879796 wait complete. 2024-09-11T00:20:07.302 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:07 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/1148879796' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-11T00:20:07.408 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:07 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/1148879796' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-11T00:20:07.650 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -e sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 -- bash -c 'ceph versions' 2024-09-11T00:20:07.979 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:20:08.370 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:08 smithi111 ceph-mon[90842]: pgmap v266: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:08.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:08 smithi203 ceph-mon[69002]: pgmap v266: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:09.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.708+0000 7f855e800700 1 -- 172.21.15.111:0/2031902147 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8558105f90 msgr2=0x7f8558106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:09.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.708+0000 7f855e800700 1 --2- 172.21.15.111:0/2031902147 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8558105f90 0x7f8558106360 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f854c00b0a0 tx=0x7f854c00b3b0 comp rx=0 tx=0).stop 2024-09-11T00:20:09.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.708+0000 7f855e800700 1 -- 172.21.15.111:0/2031902147 shutdown_connections 2024-09-11T00:20:09.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.708+0000 7f855e800700 1 --2- 172.21.15.111:0/2031902147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f85580683d0 0x7f8558068840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:09.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.708+0000 7f855e800700 1 --2- 172.21.15.111:0/2031902147 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8558105f90 0x7f8558106360 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:09.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.708+0000 7f855e800700 1 -- 172.21.15.111:0/2031902147 >> 172.21.15.111:0/2031902147 conn(0x7f8558074d00 msgr2=0x7f8558075100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:09.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.708+0000 7f855e800700 1 -- 172.21.15.111:0/2031902147 shutdown_connections 2024-09-11T00:20:09.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.708+0000 7f855e800700 1 -- 172.21.15.111:0/2031902147 wait complete. 2024-09-11T00:20:09.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.709+0000 7f855e800700 1 Processor -- start 2024-09-11T00:20:09.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.709+0000 7f855e800700 1 -- start start 2024-09-11T00:20:09.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.710+0000 7f855e800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85580683d0 0x7f8558197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:09.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.710+0000 7f855e800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8558105f90 0x7f85581982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:09.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.710+0000 7f855e800700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85581989c0 con 0x7f85580683d0 2024-09-11T00:20:09.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.710+0000 7f855e800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855819c750 con 0x7f8558105f90 2024-09-11T00:20:09.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.710+0000 7f855d400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85580683d0 0x7f8558197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:09.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.710+0000 7f855d400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85580683d0 0x7f8558197da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:43632/0 (socket says 172.21.15.111:43632) 2024-09-11T00:20:09.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.710+0000 7f855d400700 1 -- 172.21.15.111:0/4189190094 learned_addr learned my addr 172.21.15.111:0/4189190094 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:20:09.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.710+0000 7f855ca00700 1 --2- 172.21.15.111:0/4189190094 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8558105f90 0x7f85581982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:09.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.711+0000 7f855d400700 1 -- 172.21.15.111:0/4189190094 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8558105f90 msgr2=0x7f85581982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:09.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.711+0000 7f855d400700 1 --2- 172.21.15.111:0/4189190094 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8558105f90 0x7f85581982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:09.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.711+0000 7f855d400700 1 -- 172.21.15.111:0/4189190094 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854c009d00 con 0x7f85580683d0 2024-09-11T00:20:09.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.711+0000 7f855ca00700 1 --2- 172.21.15.111:0/4189190094 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8558105f90 0x7f85581982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:20:09.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.711+0000 7f855d400700 1 --2- 172.21.15.111:0/4189190094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85580683d0 0x7f8558197da0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f854c00b070 tx=0x7f854c00cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:09.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.711+0000 7f8556000700 1 -- 172.21.15.111:0/4189190094 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f854c00e040 con 0x7f85580683d0 2024-09-11T00:20:09.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.711+0000 7f8556000700 1 -- 172.21.15.111:0/4189190094 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f854c003de0 con 0x7f85580683d0 2024-09-11T00:20:09.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.711+0000 7f8556000700 1 -- 172.21.15.111:0/4189190094 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f854c01d8e0 con 0x7f85580683d0 2024-09-11T00:20:09.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.711+0000 7f855e800700 1 -- 172.21.15.111:0/4189190094 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855819c9d0 con 0x7f85580683d0 2024-09-11T00:20:09.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.711+0000 7f855e800700 1 -- 172.21.15.111:0/4189190094 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855819ce70 con 0x7f85580683d0 2024-09-11T00:20:09.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.712+0000 7f855e800700 1 -- 172.21.15.111:0/4189190094 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855804f2a0 con 0x7f85580683d0 2024-09-11T00:20:09.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.713+0000 7f8556000700 1 -- 172.21.15.111:0/4189190094 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f854c004040 con 0x7f85580683d0 2024-09-11T00:20:09.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.714+0000 7f8556000700 1 --2- 172.21.15.111:0/4189190094 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f854007a6f0 0x7f854007cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:09.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.715+0000 7f8556000700 1 -- 172.21.15.111:0/4189190094 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f854c09ebe0 con 0x7f85580683d0 2024-09-11T00:20:09.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.715+0000 7f855ca00700 1 --2- 172.21.15.111:0/4189190094 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f854007a6f0 0x7f854007cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:09.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.715+0000 7f855ca00700 1 --2- 172.21.15.111:0/4189190094 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f854007a6f0 0x7f854007cba0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8544005950 tx=0x7f85440058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:09.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:09.719+0000 7f8556000700 1 -- 172.21.15.111:0/4189190094 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f854c062230 con 0x7f85580683d0 2024-09-11T00:20:10.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:10.033+0000 7f855e800700 1 -- 172.21.15.111:0/4189190094 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f855819d320 con 0x7f85580683d0 2024-09-11T00:20:10.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:10.034+0000 7f8556000700 1 -- 172.21.15.111:0/4189190094 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f854c065350 con 0x7f85580683d0 2024-09-11T00:20:10.035 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:20:10.035 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-11T00:20:10.035 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:20:10.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:20:10.036 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-11T00:20:10.036 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:20:10.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:20:10.036 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-11T00:20:10.036 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 6 2024-09-11T00:20:10.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:20:10.036 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-11T00:20:10.036 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 4 2024-09-11T00:20:10.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:20:10.036 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-11T00:20:10.036 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 14 2024-09-11T00:20:10.036 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-11T00:20:10.037 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:20:10.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:10.037+0000 7f855e800700 1 -- 172.21.15.111:0/4189190094 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f854007a6f0 msgr2=0x7f854007cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:10.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:10.037+0000 7f855e800700 1 --2- 172.21.15.111:0/4189190094 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f854007a6f0 0x7f854007cba0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8544005950 tx=0x7f85440058e0 comp rx=0 tx=0).stop 2024-09-11T00:20:10.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:10.037+0000 7f855e800700 1 -- 172.21.15.111:0/4189190094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85580683d0 msgr2=0x7f8558197da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:10.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:10.037+0000 7f855e800700 1 --2- 172.21.15.111:0/4189190094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85580683d0 0x7f8558197da0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f854c00b070 tx=0x7f854c00cdd0 comp rx=0 tx=0).stop 2024-09-11T00:20:10.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:10.037+0000 7f855e800700 1 -- 172.21.15.111:0/4189190094 shutdown_connections 2024-09-11T00:20:10.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:10.037+0000 7f855e800700 1 --2- 172.21.15.111:0/4189190094 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f854007a6f0 0x7f854007cba0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:10.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:10.037+0000 7f855e800700 1 --2- 172.21.15.111:0/4189190094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85580683d0 0x7f8558197da0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:10.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:10.037+0000 7f855e800700 1 --2- 172.21.15.111:0/4189190094 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8558105f90 0x7f85581982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:10.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:10.037+0000 7f855e800700 1 -- 172.21.15.111:0/4189190094 >> 172.21.15.111:0/4189190094 conn(0x7f8558074d00 msgr2=0x7f85580fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:10.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:10.037+0000 7f855e800700 1 -- 172.21.15.111:0/4189190094 shutdown_connections 2024-09-11T00:20:10.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:20:10.037+0000 7f855e800700 1 -- 172.21.15.111:0/4189190094 wait complete. 2024-09-11T00:20:10.810 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -e sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-11T00:20:11.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:10 smithi203 ceph-mon[69002]: pgmap v267: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:11.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:10 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/4189190094' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:20:11.146 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:20:11.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:10 smithi111 ceph-mon[90842]: pgmap v267: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:11.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:10 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/4189190094' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:20:13.016 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:12 smithi111 ceph-mon[90842]: pgmap v268: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:13.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:12 smithi203 ceph-mon[69002]: pgmap v268: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:13.115 INFO:teuthology.orchestra.run.smithi111.stdout:wait for servicemap items w/ changing names to refresh 2024-09-11T00:20:13.952 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -e sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 -- bash -c 'sleep 60' 2024-09-11T00:20:14.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:13 smithi111 ceph-mon[90842]: pgmap v269: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:14.277 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:20:14.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:13 smithi203 ceph-mon[69002]: pgmap v269: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:15.223 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:14 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:20:15.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:14 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:20:16.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:15 smithi111 ceph-mon[90842]: pgmap v270: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:16.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:15 smithi203 ceph-mon[69002]: pgmap v270: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:19.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:18 smithi203 ceph-mon[69002]: pgmap v271: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:19.097 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:18 smithi111 ceph-mon[90842]: pgmap v271: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:21.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:20 smithi203 ceph-mon[69002]: pgmap v272: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:21.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:20 smithi111 ceph-mon[90842]: pgmap v272: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:22.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:21 smithi203 ceph-mon[69002]: pgmap v273: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:22.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:21 smithi111 ceph-mon[90842]: pgmap v273: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:25.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:24 smithi203 ceph-mon[69002]: pgmap v274: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:25.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:24 smithi111 ceph-mon[90842]: pgmap v274: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:27.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:26 smithi203 ceph-mon[69002]: pgmap v275: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:27.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:26 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:20:27.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:26 smithi111 ceph-mon[90842]: pgmap v275: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:27.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:26 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:20:28.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:27 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:20:28.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:27 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:20:28.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:27 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:20:28.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:27 smithi203 ceph-mon[69002]: pgmap v276: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:28.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:27 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:20:28.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:27 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:20:28.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:27 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:20:28.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:27 smithi111 ceph-mon[90842]: pgmap v276: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:31.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:30 smithi203 ceph-mon[69002]: pgmap v277: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:31.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:20:31.093 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:30 smithi111 ceph-mon[90842]: pgmap v277: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:31.093 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:20:33.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:32 smithi203 ceph-mon[69002]: pgmap v278: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:33.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:32 smithi111 ceph-mon[90842]: pgmap v278: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:34.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:33 smithi203 ceph-mon[69002]: pgmap v279: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:34.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:33 smithi111 ceph-mon[90842]: pgmap v279: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:37.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:36 smithi203 ceph-mon[69002]: pgmap v280: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:37.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:36 smithi111 ceph-mon[90842]: pgmap v280: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:38.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:37 smithi111 ceph-mon[90842]: pgmap v281: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:38.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:37 smithi203 ceph-mon[69002]: pgmap v281: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:40.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:40 smithi111 ceph-mon[90842]: pgmap v282: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:41.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:40 smithi203 ceph-mon[69002]: pgmap v282: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:42.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:41 smithi111 ceph-mon[90842]: pgmap v283: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:42.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:41 smithi203 ceph-mon[69002]: pgmap v283: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:44.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:44 smithi111 ceph-mon[90842]: pgmap v284: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:45.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:44 smithi203 ceph-mon[69002]: pgmap v284: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:45.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:45 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:20:46.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:45 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:20:47.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:46 smithi203 ceph-mon[69002]: pgmap v285: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:47.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:46 smithi111 ceph-mon[90842]: pgmap v285: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:48.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:47 smithi203 ceph-mon[69002]: pgmap v286: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:48.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:47 smithi111 ceph-mon[90842]: pgmap v286: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:51.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:50 smithi203 ceph-mon[69002]: pgmap v287: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:51.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:50 smithi111 ceph-mon[90842]: pgmap v287: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:52.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:51 smithi203 ceph-mon[69002]: pgmap v288: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:52.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:51 smithi111 ceph-mon[90842]: pgmap v288: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:55.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:54 smithi203 ceph-mon[69002]: pgmap v289: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:55.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:54 smithi111 ceph-mon[90842]: pgmap v289: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:56.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:55 smithi203 ceph-mon[69002]: pgmap v290: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:56.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:55 smithi111 ceph-mon[90842]: pgmap v290: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:59.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:58 smithi203 ceph-mon[69002]: pgmap v291: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:20:59.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:58 smithi111 ceph-mon[90842]: pgmap v291: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:00.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:20:59 smithi203 ceph-mon[69002]: pgmap v292: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:00.097 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:20:59 smithi111 ceph-mon[90842]: pgmap v292: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:01.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:00 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:21:01.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:00 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:21:02.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:01 smithi203 ceph-mon[69002]: pgmap v293: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:02.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:01 smithi111 ceph-mon[90842]: pgmap v293: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:04.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:03 smithi111 ceph-mon[90842]: pgmap v294: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:04.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:03 smithi203 ceph-mon[69002]: pgmap v294: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:06.097 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:05 smithi203 ceph-mon[69002]: pgmap v295: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:06.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:05 smithi111 ceph-mon[90842]: pgmap v295: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:08.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:07 smithi111 ceph-mon[90842]: pgmap v296: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:08.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:07 smithi203 ceph-mon[69002]: pgmap v296: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:10.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:09 smithi111 ceph-mon[90842]: pgmap v297: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:10.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:09 smithi203 ceph-mon[69002]: pgmap v297: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:12.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:11 smithi111 ceph-mon[90842]: pgmap v298: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:12.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:11 smithi203 ceph-mon[69002]: pgmap v298: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:14.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:13 smithi111 ceph-mon[90842]: pgmap v299: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:14.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:13 smithi203 ceph-mon[69002]: pgmap v299: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:15.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:14 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:21:15.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:14 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:21:16.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:15 smithi203 ceph-mon[69002]: pgmap v300: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:16.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:15 smithi111 ceph-mon[90842]: pgmap v300: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:16.905 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -e sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 -- bash -c 'ceph orch ps' 2024-09-11T00:21:17.237 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:21:18.094 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:17 smithi111 ceph-mon[90842]: pgmap v301: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:18.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:17 smithi203 ceph-mon[69002]: pgmap v301: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:19.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.046+0000 7f662fa00700 1 -- 172.21.15.111:0/1964932674 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6628068630 msgr2=0x7f6628068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:19.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.046+0000 7f662fa00700 1 --2- 172.21.15.111:0/1964932674 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6628068630 0x7f6628068a00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f661c00b0a0 tx=0x7f661c00b3b0 comp rx=0 tx=0).stop 2024-09-11T00:21:19.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.046+0000 7f662fa00700 1 -- 172.21.15.111:0/1964932674 shutdown_connections 2024-09-11T00:21:19.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.046+0000 7f662fa00700 1 --2- 172.21.15.111:0/1964932674 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6628068fd0 0x7f6628104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:19.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.046+0000 7f662fa00700 1 --2- 172.21.15.111:0/1964932674 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6628068630 0x7f6628068a00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:19.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.046+0000 7f662fa00700 1 -- 172.21.15.111:0/1964932674 >> 172.21.15.111:0/1964932674 conn(0x7f6628074f50 msgr2=0x7f6628075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:19.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.047+0000 7f662fa00700 1 -- 172.21.15.111:0/1964932674 shutdown_connections 2024-09-11T00:21:19.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.047+0000 7f662fa00700 1 -- 172.21.15.111:0/1964932674 wait complete. 2024-09-11T00:21:19.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.048+0000 7f662fa00700 1 Processor -- start 2024-09-11T00:21:19.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.048+0000 7f662fa00700 1 -- start start 2024-09-11T00:21:19.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.048+0000 7f662fa00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6628068630 0x7f6628195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:19.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.048+0000 7f662fa00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6628068fd0 0x7f66281962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:19.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.048+0000 7f662fa00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66281969c0 con 0x7f6628068630 2024-09-11T00:21:19.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.048+0000 7f662fa00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662819a750 con 0x7f6628068fd0 2024-09-11T00:21:19.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.048+0000 7f662d000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6628068630 0x7f6628195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:19.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.048+0000 7f662d000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6628068630 0x7f6628195da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:55868/0 (socket says 172.21.15.111:55868) 2024-09-11T00:21:19.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.048+0000 7f662d000700 1 -- 172.21.15.111:0/3545159814 learned_addr learned my addr 172.21.15.111:0/3545159814 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:21:19.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.048+0000 7f6627e00700 1 --2- 172.21.15.111:0/3545159814 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6628068fd0 0x7f66281962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:19.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.049+0000 7f662d000700 1 -- 172.21.15.111:0/3545159814 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6628068fd0 msgr2=0x7f66281962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:19.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.049+0000 7f662d000700 1 --2- 172.21.15.111:0/3545159814 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6628068fd0 0x7f66281962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:19.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.049+0000 7f662d000700 1 -- 172.21.15.111:0/3545159814 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661c009d00 con 0x7f6628068630 2024-09-11T00:21:19.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.049+0000 7f662d000700 1 --2- 172.21.15.111:0/3545159814 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6628068630 0x7f6628195da0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f661c00b070 tx=0x7f661c00cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:19.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.049+0000 7f6625600700 1 -- 172.21.15.111:0/3545159814 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f661c00e040 con 0x7f6628068630 2024-09-11T00:21:19.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.049+0000 7f6625600700 1 -- 172.21.15.111:0/3545159814 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f661c003c10 con 0x7f6628068630 2024-09-11T00:21:19.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.049+0000 7f662fa00700 1 -- 172.21.15.111:0/3545159814 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f662819a9d0 con 0x7f6628068630 2024-09-11T00:21:19.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.049+0000 7f6625600700 1 -- 172.21.15.111:0/3545159814 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f661c01d740 con 0x7f6628068630 2024-09-11T00:21:19.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.050+0000 7f662fa00700 1 -- 172.21.15.111:0/3545159814 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f662819aec0 con 0x7f6628068630 2024-09-11T00:21:19.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.051+0000 7f662fa00700 1 -- 172.21.15.111:0/3545159814 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66281086d0 con 0x7f6628068630 2024-09-11T00:21:19.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.052+0000 7f6625600700 1 -- 172.21.15.111:0/3545159814 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f661c004040 con 0x7f6628068630 2024-09-11T00:21:19.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.053+0000 7f6625600700 1 --2- 172.21.15.111:0/3545159814 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f661007a6f0 0x7f661007cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:19.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.053+0000 7f6625600700 1 -- 172.21.15.111:0/3545159814 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f661c09eb30 con 0x7f6628068630 2024-09-11T00:21:19.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.054+0000 7f6627e00700 1 --2- 172.21.15.111:0/3545159814 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f661007a6f0 0x7f661007cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:19.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.054+0000 7f6627e00700 1 --2- 172.21.15.111:0/3545159814 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f661007a6f0 0x7f661007cba0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f66281973c0 tx=0x7f661400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:19.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.058+0000 7f6625600700 1 -- 172.21.15.111:0/3545159814 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f661c062180 con 0x7f6628068630 2024-09-11T00:21:19.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.286+0000 7f662fa00700 1 -- 172.21.15.111:0/3545159814 --> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f662802cd40 con 0x7f661007a6f0 2024-09-11T00:21:19.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.297+0000 7f6625600700 1 -- 172.21.15.111:0/3545159814 <== mgr.34104 v2:172.21.15.111:6800/3423099047 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f662802cd40 con 0x7f661007a6f0 2024-09-11T00:21:19.299 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:21:19.299 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (10m) 2m ago 24m 15.7M - 0.27.0 11f11916f8cd d6d3253e881f 2024-09-11T00:21:19.299 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (2m) 2m ago 24m 7805k - 19.3.0-4854-g8f219c47 589dd18248e4 583f61b2aa1e 2024-09-11T00:21:19.299 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi203 smithi203 running (2m) 2m ago 23m 7348k - 19.3.0-4854-g8f219c47 589dd18248e4 2ca5e58a2d0c 2024-09-11T00:21:19.299 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (7m) 2m ago 24m 6899k - 19.3.0-4854-g8f219c47 589dd18248e4 a9cacdb9a638 2024-09-11T00:21:19.299 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi203 smithi203 running (7m) 2m ago 23m 6899k - 19.3.0-4854-g8f219c47 589dd18248e4 d452d9dfa04b 2024-09-11T00:21:19.300 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (10m) 2m ago 24m 68.1M - c8b91775d855 7d3b50b5b59f 2024-09-11T00:21:19.300 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.gmgsay smithi111 running (3m) 2m ago 17m 86.5M - 19.3.0-4854-g8f219c47 589dd18248e4 a8cff96fcbbe 2024-09-11T00:21:19.300 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.rucaba smithi111 running (3m) 2m ago 17m 12.5M - 19.3.0-4854-g8f219c47 589dd18248e4 63a1d760686d 2024-09-11T00:21:19.300 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.tcrqop smithi203 running (2m) 2m ago 17m 12.3M - 19.3.0-4854-g8f219c47 589dd18248e4 f9cc4db8b461 2024-09-11T00:21:19.300 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi203.uqkbkn smithi203 running (2m) 2m ago 17m 12.2M - 19.3.0-4854-g8f219c47 589dd18248e4 8c20ffa3e7ee 2024-09-11T00:21:19.300 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.ypucji smithi111 *:8443,9283,8765 running (13m) 2m ago 26m 520M - 19.3.0-4854-g8f219c47 589dd18248e4 07fa31f49618 2024-09-11T00:21:19.300 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi203.smuspl smithi203 *:8443,9283,8765 running (12m) 2m ago 23m 457M - 19.3.0-4854-g8f219c47 589dd18248e4 7e5a93a5ffa7 2024-09-11T00:21:19.300 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (8m) 2m ago 26m 58.2M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 3c29c070a612 2024-09-11T00:21:19.300 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi203 smithi203 running (8m) 2m ago 23m 47.6M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 45e8285e4b4d 2024-09-11T00:21:19.300 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (11m) 2m ago 24m 7625k - 1.7.0 72c9c2088986 ec478ea14488 2024-09-11T00:21:19.300 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi203 smithi203 *:9100 running (11m) 2m ago 23m 8170k - 1.7.0 72c9c2088986 54d461cde1bc 2024-09-11T00:21:19.300 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (7m) 2m ago 21m 99.8M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 d2f1a2312736 2024-09-11T00:21:19.301 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (6m) 2m ago 21m 104M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 19cf95ecca7d 2024-09-11T00:21:19.301 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (5m) 2m ago 20m 86.4M 1216M 19.3.0-4854-g8f219c47 589dd18248e4 3a3b318b337a 2024-09-11T00:21:19.301 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi203 running (5m) 2m ago 20m 105M 2240M 19.3.0-4854-g8f219c47 589dd18248e4 288c7e8ae34b 2024-09-11T00:21:19.301 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi203 running (4m) 2m ago 19m 96.0M 2240M 19.3.0-4854-g8f219c47 589dd18248e4 485f82d3eafb 2024-09-11T00:21:19.301 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi203 running (4m) 2m ago 19m 94.9M 2240M 19.3.0-4854-g8f219c47 589dd18248e4 ef4834f3adf1 2024-09-11T00:21:19.301 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (11m) 2m ago 23m 64.3M - 2.51.0 1d3b7f56885b 3e72ac10983d 2024-09-11T00:21:19.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.299+0000 7f662fa00700 1 -- 172.21.15.111:0/3545159814 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f661007a6f0 msgr2=0x7f661007cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:19.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.299+0000 7f662fa00700 1 --2- 172.21.15.111:0/3545159814 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f661007a6f0 0x7f661007cba0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f66281973c0 tx=0x7f661400b410 comp rx=0 tx=0).stop 2024-09-11T00:21:19.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.299+0000 7f662fa00700 1 -- 172.21.15.111:0/3545159814 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6628068630 msgr2=0x7f6628195da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:19.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.299+0000 7f662fa00700 1 --2- 172.21.15.111:0/3545159814 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6628068630 0x7f6628195da0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f661c00b070 tx=0x7f661c00cd20 comp rx=0 tx=0).stop 2024-09-11T00:21:19.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.299+0000 7f662fa00700 1 -- 172.21.15.111:0/3545159814 shutdown_connections 2024-09-11T00:21:19.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.299+0000 7f662fa00700 1 --2- 172.21.15.111:0/3545159814 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f661007a6f0 0x7f661007cba0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:19.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.299+0000 7f662fa00700 1 --2- 172.21.15.111:0/3545159814 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6628068630 0x7f6628195da0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:19.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.299+0000 7f662fa00700 1 --2- 172.21.15.111:0/3545159814 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6628068fd0 0x7f66281962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:19.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.299+0000 7f662fa00700 1 -- 172.21.15.111:0/3545159814 >> 172.21.15.111:0/3545159814 conn(0x7f6628074f50 msgr2=0x7f66280fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:19.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.300+0000 7f662fa00700 1 -- 172.21.15.111:0/3545159814 shutdown_connections 2024-09-11T00:21:19.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:19.300+0000 7f662fa00700 1 -- 172.21.15.111:0/3545159814 wait complete. 2024-09-11T00:21:19.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:19 smithi111 ceph-mon[90842]: from='client.34556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:21:19.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:19 smithi111 ceph-mon[90842]: pgmap v302: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:19.984 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -e sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 -- bash -c 'ceph versions' 2024-09-11T00:21:20.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:19 smithi203 ceph-mon[69002]: from='client.34556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:21:20.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:19 smithi203 ceph-mon[69002]: pgmap v302: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:20.314 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:21:22.064 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:21 smithi111 ceph-mon[90842]: pgmap v303: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:22.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.092+0000 7fa7b1400700 1 -- 172.21.15.111:0/3220450883 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7ac1003b0 msgr2=0x7fa7ac100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:22.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.092+0000 7fa7b1400700 1 --2- 172.21.15.111:0/3220450883 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7ac1003b0 0x7fa7ac100780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa79c009910 tx=0x7fa79c009c20 comp rx=0 tx=0).stop 2024-09-11T00:21:22.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.092+0000 7fa7b1400700 1 -- 172.21.15.111:0/3220450883 shutdown_connections 2024-09-11T00:21:22.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.092+0000 7fa7b1400700 1 --2- 172.21.15.111:0/3220450883 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7ac100d50 0x7fa7ac104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:22.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.092+0000 7fa7b1400700 1 --2- 172.21.15.111:0/3220450883 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7ac1003b0 0x7fa7ac100780 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:22.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.092+0000 7fa7b1400700 1 -- 172.21.15.111:0/3220450883 >> 172.21.15.111:0/3220450883 conn(0x7fa7ac0fbc30 msgr2=0x7fa7ac0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:22.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.092+0000 7fa7b1400700 1 -- 172.21.15.111:0/3220450883 shutdown_connections 2024-09-11T00:21:22.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.092+0000 7fa7b1400700 1 -- 172.21.15.111:0/3220450883 wait complete. 2024-09-11T00:21:22.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.093+0000 7fa7b1400700 1 Processor -- start 2024-09-11T00:21:22.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.094+0000 7fa7b1400700 1 -- start start 2024-09-11T00:21:22.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.094+0000 7fa7b1400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7ac1003b0 0x7fa7ac073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:22.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.094+0000 7fa7b1400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7ac100d50 0x7fa7ac073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:22.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.094+0000 7fa7b1400700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac073ad0 con 0x7fa7ac1003b0 2024-09-11T00:21:22.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.094+0000 7fa7b1400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac073c10 con 0x7fa7ac100d50 2024-09-11T00:21:22.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.094+0000 7fa7aa800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7ac1003b0 0x7fa7ac073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:22.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.094+0000 7fa7aa800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7ac1003b0 0x7fa7ac073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:55896/0 (socket says 172.21.15.111:55896) 2024-09-11T00:21:22.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.094+0000 7fa7aa800700 1 -- 172.21.15.111:0/3331356189 learned_addr learned my addr 172.21.15.111:0/3331356189 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:21:22.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.094+0000 7fa7a9e00700 1 --2- 172.21.15.111:0/3331356189 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7ac100d50 0x7fa7ac073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:22.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.095+0000 7fa7aa800700 1 -- 172.21.15.111:0/3331356189 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7ac100d50 msgr2=0x7fa7ac073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:22.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.095+0000 7fa7aa800700 1 --2- 172.21.15.111:0/3331356189 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7ac100d50 0x7fa7ac073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:22.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.095+0000 7fa7aa800700 1 -- 172.21.15.111:0/3331356189 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c0095f0 con 0x7fa7ac1003b0 2024-09-11T00:21:22.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.095+0000 7fa7aa800700 1 --2- 172.21.15.111:0/3331356189 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7ac1003b0 0x7fa7ac073050 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa79c00b5c0 tx=0x7fa79c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:22.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.095+0000 7fa7a3400700 1 -- 172.21.15.111:0/3331356189 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa79c01d070 con 0x7fa7ac1003b0 2024-09-11T00:21:22.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.095+0000 7fa7a3400700 1 -- 172.21.15.111:0/3331356189 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa79c005e00 con 0x7fa7ac1003b0 2024-09-11T00:21:22.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.095+0000 7fa7b1400700 1 -- 172.21.15.111:0/3331356189 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ac073e90 con 0x7fa7ac1003b0 2024-09-11T00:21:22.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.095+0000 7fa7a3400700 1 -- 172.21.15.111:0/3331356189 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa79c017400 con 0x7fa7ac1003b0 2024-09-11T00:21:22.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.095+0000 7fa7b1400700 1 -- 172.21.15.111:0/3331356189 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7ac1a2210 con 0x7fa7ac1003b0 2024-09-11T00:21:22.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.096+0000 7fa7b1400700 1 -- 172.21.15.111:0/3331356189 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7ac1086c0 con 0x7fa7ac1003b0 2024-09-11T00:21:22.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.098+0000 7fa7a3400700 1 -- 172.21.15.111:0/3331356189 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fa79c00f6f0 con 0x7fa7ac1003b0 2024-09-11T00:21:22.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.099+0000 7fa7a3400700 1 --2- 172.21.15.111:0/3331356189 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa79007a6f0 0x7fa79007cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:22.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.099+0000 7fa7a3400700 1 -- 172.21.15.111:0/3331356189 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa79c09e770 con 0x7fa7ac1003b0 2024-09-11T00:21:22.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.099+0000 7fa7a9e00700 1 --2- 172.21.15.111:0/3331356189 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa79007a6f0 0x7fa79007cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:22.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.099+0000 7fa7a9e00700 1 --2- 172.21.15.111:0/3331356189 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa79007a6f0 0x7fa79007cba0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac074840 tx=0x7fa79800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:22.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.103+0000 7fa7a3400700 1 -- 172.21.15.111:0/3331356189 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fa79c061e40 con 0x7fa7ac1003b0 2024-09-11T00:21:22.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:21 smithi203 ceph-mon[69002]: pgmap v303: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:22.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.416+0000 7fa7b1400700 1 -- 172.21.15.111:0/3331356189 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa7ac04ea50 con 0x7fa7ac1003b0 2024-09-11T00:21:22.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.416+0000 7fa7a3400700 1 -- 172.21.15.111:0/3331356189 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fa79c064f60 con 0x7fa7ac1003b0 2024-09-11T00:21:22.419 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-11T00:21:22.419 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-11T00:21:22.419 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:21:22.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:21:22.419 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-11T00:21:22.419 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 2 2024-09-11T00:21:22.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:21:22.419 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-11T00:21:22.419 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 6 2024-09-11T00:21:22.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:21:22.420 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-11T00:21:22.420 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 4 2024-09-11T00:21:22.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-11T00:21:22.420 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-11T00:21:22.420 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)": 14 2024-09-11T00:21:22.420 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-11T00:21:22.420 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-11T00:21:22.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.419+0000 7fa7b1400700 1 -- 172.21.15.111:0/3331356189 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa79007a6f0 msgr2=0x7fa79007cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:22.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.419+0000 7fa7b1400700 1 --2- 172.21.15.111:0/3331356189 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa79007a6f0 0x7fa79007cba0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac074840 tx=0x7fa79800b410 comp rx=0 tx=0).stop 2024-09-11T00:21:22.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.419+0000 7fa7b1400700 1 -- 172.21.15.111:0/3331356189 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7ac1003b0 msgr2=0x7fa7ac073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:22.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.419+0000 7fa7b1400700 1 --2- 172.21.15.111:0/3331356189 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7ac1003b0 0x7fa7ac073050 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa79c00b5c0 tx=0x7fa79c00bd70 comp rx=0 tx=0).stop 2024-09-11T00:21:22.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.420+0000 7fa7b1400700 1 -- 172.21.15.111:0/3331356189 shutdown_connections 2024-09-11T00:21:22.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.420+0000 7fa7b1400700 1 --2- 172.21.15.111:0/3331356189 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa79007a6f0 0x7fa79007cba0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:22.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.420+0000 7fa7b1400700 1 --2- 172.21.15.111:0/3331356189 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7ac1003b0 0x7fa7ac073050 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:22.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.420+0000 7fa7b1400700 1 --2- 172.21.15.111:0/3331356189 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7ac100d50 0x7fa7ac073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:22.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.420+0000 7fa7b1400700 1 -- 172.21.15.111:0/3331356189 >> 172.21.15.111:0/3331356189 conn(0x7fa7ac0fbc30 msgr2=0x7fa7ac0fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:22.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.420+0000 7fa7b1400700 1 -- 172.21.15.111:0/3331356189 shutdown_connections 2024-09-11T00:21:22.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:22.420+0000 7fa7b1400700 1 -- 172.21.15.111:0/3331356189 wait complete. 2024-09-11T00:21:23.034 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:22 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/3331356189' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:21:23.065 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -e sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-11T00:21:23.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:22 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/3331356189' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:21:23.387 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:21:24.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:23 smithi111 ceph-mon[90842]: pgmap v304: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:24.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:23 smithi203 ceph-mon[69002]: pgmap v304: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:25.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.255+0000 7ffaf3e00700 1 -- 172.21.15.111:0/2562698691 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaf4102df0 msgr2=0x7ffaf4106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:25.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.255+0000 7ffaf3e00700 1 --2- 172.21.15.111:0/2562698691 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaf4102df0 0x7ffaf4106dc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009910 tx=0x7ffae0009c20 comp rx=0 tx=0).stop 2024-09-11T00:21:25.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.255+0000 7ffaf3e00700 1 -- 172.21.15.111:0/2562698691 shutdown_connections 2024-09-11T00:21:25.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.255+0000 7ffaf3e00700 1 --2- 172.21.15.111:0/2562698691 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaf4102df0 0x7ffaf4106dc0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:25.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.255+0000 7ffaf3e00700 1 --2- 172.21.15.111:0/2562698691 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffaf4102450 0x7ffaf4102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:25.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.255+0000 7ffaf3e00700 1 -- 172.21.15.111:0/2562698691 >> 172.21.15.111:0/2562698691 conn(0x7ffaf40fdd30 msgr2=0x7ffaf4100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:25.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.255+0000 7ffaf3e00700 1 -- 172.21.15.111:0/2562698691 shutdown_connections 2024-09-11T00:21:25.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.255+0000 7ffaf3e00700 1 -- 172.21.15.111:0/2562698691 wait complete. 2024-09-11T00:21:25.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.256+0000 7ffaf3e00700 1 Processor -- start 2024-09-11T00:21:25.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.256+0000 7ffaf3e00700 1 -- start start 2024-09-11T00:21:25.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.257+0000 7ffaf3e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffaf4102450 0x7ffaf4197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:25.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.257+0000 7ffaf3e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaf4102df0 0x7ffaf41982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:25.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.257+0000 7ffaf3e00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf41989a0 con 0x7ffaf4102df0 2024-09-11T00:21:25.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.257+0000 7ffaf3e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf419c730 con 0x7ffaf4102450 2024-09-11T00:21:25.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.257+0000 7ffaf2000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaf4102df0 0x7ffaf41982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:25.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.257+0000 7ffaf2000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaf4102df0 0x7ffaf41982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:55918/0 (socket says 172.21.15.111:55918) 2024-09-11T00:21:25.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.257+0000 7ffaf2a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffaf4102450 0x7ffaf4197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:25.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.257+0000 7ffaf2000700 1 -- 172.21.15.111:0/3415861056 learned_addr learned my addr 172.21.15.111:0/3415861056 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:21:25.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.258+0000 7ffaf2000700 1 -- 172.21.15.111:0/3415861056 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffaf4102450 msgr2=0x7ffaf4197d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:25.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.258+0000 7ffaf2000700 1 --2- 172.21.15.111:0/3415861056 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffaf4102450 0x7ffaf4197d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:25.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.258+0000 7ffaf2000700 1 -- 172.21.15.111:0/3415861056 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae00095f0 con 0x7ffaf4102df0 2024-09-11T00:21:25.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.258+0000 7ffaf2000700 1 --2- 172.21.15.111:0/3415861056 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaf4102df0 0x7ffaf41982c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ffae000bda0 tx=0x7ffae000bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:25.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.258+0000 7ffaeb400700 1 -- 172.21.15.111:0/3415861056 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffae001d070 con 0x7ffaf4102df0 2024-09-11T00:21:25.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.258+0000 7ffaeb400700 1 -- 172.21.15.111:0/3415861056 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffae0005dc0 con 0x7ffaf4102df0 2024-09-11T00:21:25.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.258+0000 7ffaf3e00700 1 -- 172.21.15.111:0/3415861056 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf419c9b0 con 0x7ffaf4102df0 2024-09-11T00:21:25.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.258+0000 7ffaeb400700 1 -- 172.21.15.111:0/3415861056 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffae0017400 con 0x7ffaf4102df0 2024-09-11T00:21:25.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.258+0000 7ffaf3e00700 1 -- 172.21.15.111:0/3415861056 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf419cea0 con 0x7ffaf4102df0 2024-09-11T00:21:25.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.260+0000 7ffaf3e00700 1 -- 172.21.15.111:0/3415861056 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf404f2a0 con 0x7ffaf4102df0 2024-09-11T00:21:25.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.261+0000 7ffaeb400700 1 -- 172.21.15.111:0/3415861056 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7ffae000f6f0 con 0x7ffaf4102df0 2024-09-11T00:21:25.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.262+0000 7ffaeb400700 1 --2- 172.21.15.111:0/3415861056 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7ffad807a6f0 0x7ffad807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:25.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.262+0000 7ffaeb400700 1 -- 172.21.15.111:0/3415861056 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7ffae009e670 con 0x7ffaf4102df0 2024-09-11T00:21:25.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.262+0000 7ffaf2a00700 1 --2- 172.21.15.111:0/3415861056 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7ffad807a6f0 0x7ffad807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:25.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.263+0000 7ffaf2a00700 1 --2- 172.21.15.111:0/3415861056 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7ffad807a6f0 0x7ffad807cba0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ffae4005950 tx=0x7ffae400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:25.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.266+0000 7ffaeb400700 1 -- 172.21.15.111:0/3415861056 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7ffae0061d40 con 0x7ffaf4102df0 2024-09-11T00:21:25.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.588+0000 7ffaf3e00700 1 -- 172.21.15.111:0/3415861056 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffaf41990e0 con 0x7ffaf4102df0 2024-09-11T00:21:25.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.589+0000 7ffaeb400700 1 -- 172.21.15.111:0/3415861056 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7ffae0064e60 con 0x7ffaf4102df0 2024-09-11T00:21:25.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.591+0000 7ffaf3e00700 1 -- 172.21.15.111:0/3415861056 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7ffad807a6f0 msgr2=0x7ffad807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:25.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.591+0000 7ffaf3e00700 1 --2- 172.21.15.111:0/3415861056 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7ffad807a6f0 0x7ffad807cba0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ffae4005950 tx=0x7ffae400b410 comp rx=0 tx=0).stop 2024-09-11T00:21:25.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.591+0000 7ffaf3e00700 1 -- 172.21.15.111:0/3415861056 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaf4102df0 msgr2=0x7ffaf41982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:25.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.591+0000 7ffaf3e00700 1 --2- 172.21.15.111:0/3415861056 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaf4102df0 0x7ffaf41982c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ffae000bda0 tx=0x7ffae000bdd0 comp rx=0 tx=0).stop 2024-09-11T00:21:25.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.591+0000 7ffaf3e00700 1 -- 172.21.15.111:0/3415861056 shutdown_connections 2024-09-11T00:21:25.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.591+0000 7ffaf3e00700 1 --2- 172.21.15.111:0/3415861056 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7ffad807a6f0 0x7ffad807cba0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:25.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.591+0000 7ffaf3e00700 1 --2- 172.21.15.111:0/3415861056 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffaf4102450 0x7ffaf4197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:25.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.591+0000 7ffaf3e00700 1 --2- 172.21.15.111:0/3415861056 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaf4102df0 0x7ffaf41982c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:25.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.591+0000 7ffaf3e00700 1 -- 172.21.15.111:0/3415861056 >> 172.21.15.111:0/3415861056 conn(0x7ffaf40fdd30 msgr2=0x7ffaf40ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:25.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.592+0000 7ffaf3e00700 1 -- 172.21.15.111:0/3415861056 shutdown_connections 2024-09-11T00:21:25.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:25.592+0000 7ffaf3e00700 1 -- 172.21.15.111:0/3415861056 wait complete. 2024-09-11T00:21:25.609 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-11T00:21:25.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:25 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/3415861056' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:21:26.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:25 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/3415861056' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:21:26.470 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -e sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-11T00:21:26.792 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:21:26.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:26 smithi111 ceph-mon[90842]: pgmap v305: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:27.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:26 smithi203 ceph-mon[69002]: pgmap v305: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:27.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:27 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:21:28.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:27 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:21:28.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.763+0000 7f24bb200700 1 -- 172.21.15.111:0/3970432923 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f24b41003b0 msgr2=0x7f24b4100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:28.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.763+0000 7f24bb200700 1 --2- 172.21.15.111:0/3970432923 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f24b41003b0 0x7f24b4100780 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009910 tx=0x7f24a4009c20 comp rx=0 tx=0).stop 2024-09-11T00:21:28.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.763+0000 7f24bb200700 1 -- 172.21.15.111:0/3970432923 shutdown_connections 2024-09-11T00:21:28.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.763+0000 7f24bb200700 1 --2- 172.21.15.111:0/3970432923 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24b4100d50 0x7f24b4104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:28.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.763+0000 7f24bb200700 1 --2- 172.21.15.111:0/3970432923 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f24b41003b0 0x7f24b4100780 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:28.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.763+0000 7f24bb200700 1 -- 172.21.15.111:0/3970432923 >> 172.21.15.111:0/3970432923 conn(0x7f24b40fbc30 msgr2=0x7f24b40fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:28.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.763+0000 7f24bb200700 1 -- 172.21.15.111:0/3970432923 shutdown_connections 2024-09-11T00:21:28.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.763+0000 7f24bb200700 1 -- 172.21.15.111:0/3970432923 wait complete. 2024-09-11T00:21:28.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.764+0000 7f24bb200700 1 Processor -- start 2024-09-11T00:21:28.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.764+0000 7f24bb200700 1 -- start start 2024-09-11T00:21:28.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.765+0000 7f24bb200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24b41003b0 0x7f24b4195d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:28.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.765+0000 7f24bb200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f24b4100d50 0x7f24b4196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:28.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.765+0000 7f24bb200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b4196930 con 0x7f24b4100d50 2024-09-11T00:21:28.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.765+0000 7f24bb200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b419a6c0 con 0x7f24b41003b0 2024-09-11T00:21:28.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.765+0000 7f24b3400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f24b4100d50 0x7f24b4196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:28.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.765+0000 7f24b3400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f24b4100d50 0x7f24b4196250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:59278/0 (socket says 172.21.15.111:59278) 2024-09-11T00:21:28.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.765+0000 7f24b3400700 1 -- 172.21.15.111:0/1606200297 learned_addr learned my addr 172.21.15.111:0/1606200297 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:21:28.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.765+0000 7f24b3e00700 1 --2- 172.21.15.111:0/1606200297 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24b41003b0 0x7f24b4195d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:28.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.766+0000 7f24b3400700 1 -- 172.21.15.111:0/1606200297 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24b41003b0 msgr2=0x7f24b4195d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:28.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.766+0000 7f24b3400700 1 --2- 172.21.15.111:0/1606200297 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24b41003b0 0x7f24b4195d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:28.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.766+0000 7f24b3400700 1 -- 172.21.15.111:0/1606200297 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a40095f0 con 0x7f24b4100d50 2024-09-11T00:21:28.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.766+0000 7f24b3400700 1 --2- 172.21.15.111:0/1606200297 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f24b4100d50 0x7f24b4196250 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f24a000d900 tx=0x7f24a000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:28.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.766+0000 7f24b0c00700 1 -- 172.21.15.111:0/1606200297 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24a0009900 con 0x7f24b4100d50 2024-09-11T00:21:28.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.766+0000 7f24b0c00700 1 -- 172.21.15.111:0/1606200297 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f24a0010460 con 0x7f24b4100d50 2024-09-11T00:21:28.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.766+0000 7f24bb200700 1 -- 172.21.15.111:0/1606200297 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b419a9a0 con 0x7f24b4100d50 2024-09-11T00:21:28.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.766+0000 7f24b0c00700 1 -- 172.21.15.111:0/1606200297 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24a000f5f0 con 0x7f24b4100d50 2024-09-11T00:21:28.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.766+0000 7f24bb200700 1 -- 172.21.15.111:0/1606200297 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b419aef0 con 0x7f24b4100d50 2024-09-11T00:21:28.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.767+0000 7f24bb200700 1 -- 172.21.15.111:0/1606200297 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b41086c0 con 0x7f24b4100d50 2024-09-11T00:21:28.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.769+0000 7f24b0c00700 1 -- 172.21.15.111:0/1606200297 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f24a00105d0 con 0x7f24b4100d50 2024-09-11T00:21:28.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.770+0000 7f24b0c00700 1 --2- 172.21.15.111:0/1606200297 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f249807a6f0 0x7f249807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:28.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.770+0000 7f24b0c00700 1 -- 172.21.15.111:0/1606200297 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f24a009ce50 con 0x7f24b4100d50 2024-09-11T00:21:28.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.770+0000 7f24b3e00700 1 --2- 172.21.15.111:0/1606200297 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f249807a6f0 0x7f249807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:28.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.771+0000 7f24b3e00700 1 --2- 172.21.15.111:0/1606200297 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f249807a6f0 0x7f249807cba0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f24a400b5c0 tx=0x7f24a401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:28.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:28.774+0000 7f24b0c00700 1 -- 172.21.15.111:0/1606200297 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f24a0060520 con 0x7f24b4100d50 2024-09-11T00:21:28.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:28 smithi111 ceph-mon[90842]: pgmap v306: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:28.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:21:28.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:21:28.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:21:29.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:28 smithi203 ceph-mon[69002]: pgmap v306: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:29.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:21:29.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:21:29.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:21:29.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:29.090+0000 7f24bb200700 1 -- 172.21.15.111:0/1606200297 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f24b404ea50 con 0x7f24b4100d50 2024-09-11T00:21:29.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:29.091+0000 7f24b0c00700 1 -- 172.21.15.111:0/1606200297 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f24a0063640 con 0x7f24b4100d50 2024-09-11T00:21:29.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:29.093+0000 7f24bb200700 1 -- 172.21.15.111:0/1606200297 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f249807a6f0 msgr2=0x7f249807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:29.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:29.093+0000 7f24bb200700 1 --2- 172.21.15.111:0/1606200297 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f249807a6f0 0x7f249807cba0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f24a400b5c0 tx=0x7f24a401a040 comp rx=0 tx=0).stop 2024-09-11T00:21:29.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:29.093+0000 7f24bb200700 1 -- 172.21.15.111:0/1606200297 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f24b4100d50 msgr2=0x7f24b4196250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:29.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:29.093+0000 7f24bb200700 1 --2- 172.21.15.111:0/1606200297 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f24b4100d50 0x7f24b4196250 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f24a000d900 tx=0x7f24a000dc10 comp rx=0 tx=0).stop 2024-09-11T00:21:29.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:29.093+0000 7f24bb200700 1 -- 172.21.15.111:0/1606200297 shutdown_connections 2024-09-11T00:21:29.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:29.093+0000 7f24bb200700 1 --2- 172.21.15.111:0/1606200297 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f249807a6f0 0x7f249807cba0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:29.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:29.093+0000 7f24bb200700 1 --2- 172.21.15.111:0/1606200297 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24b41003b0 0x7f24b4195d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:29.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:29.093+0000 7f24bb200700 1 --2- 172.21.15.111:0/1606200297 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f24b4100d50 0x7f24b4196250 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:29.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:29.093+0000 7f24bb200700 1 -- 172.21.15.111:0/1606200297 >> 172.21.15.111:0/1606200297 conn(0x7f24b40fbc30 msgr2=0x7f24b40fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:29.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:29.093+0000 7f24bb200700 1 -- 172.21.15.111:0/1606200297 shutdown_connections 2024-09-11T00:21:29.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:29.093+0000 7f24bb200700 1 -- 172.21.15.111:0/1606200297 wait complete. 2024-09-11T00:21:29.112 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)" 2024-09-11T00:21:29.821 DEBUG:teuthology.parallel:result is None 2024-09-11T00:21:29.821 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-11T00:21:29.842 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi111.front.sepia.ceph.com 2024-09-11T00:21:29.842 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-11T00:21:30.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:29 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/1606200297' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:21:30.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:29 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/1606200297' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-11T00:21:30.167 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:21:30.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:30 smithi111 ceph-mon[90842]: pgmap v307: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:21:31.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:30 smithi203 ceph-mon[69002]: pgmap v307: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:31.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:21:31.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:31 smithi111 ceph-mon[90842]: pgmap v308: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:31.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:31.993+0000 7fccf6c00700 1 -- 172.21.15.111:0/434435964 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fccf0073a00 msgr2=0x7fccf0110a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:31.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:31.993+0000 7fccf6c00700 1 --2- 172.21.15.111:0/434435964 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fccf0073a00 0x7fccf0110a80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fccdc009910 tx=0x7fccdc009c20 comp rx=0 tx=0).stop 2024-09-11T00:21:31.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:31.993+0000 7fccf6c00700 1 -- 172.21.15.111:0/434435964 shutdown_connections 2024-09-11T00:21:31.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:31.993+0000 7fccf6c00700 1 --2- 172.21.15.111:0/434435964 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fccf0073a00 0x7fccf0110a80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:31.993+0000 7fccf6c00700 1 --2- 172.21.15.111:0/434435964 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccf00730f0 0x7fccf00734c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:31.993+0000 7fccf6c00700 1 -- 172.21.15.111:0/434435964 >> 172.21.15.111:0/434435964 conn(0x7fccf00fbab0 msgr2=0x7fccf00fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:31.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:31.993+0000 7fccf6c00700 1 -- 172.21.15.111:0/434435964 shutdown_connections 2024-09-11T00:21:31.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:31.993+0000 7fccf6c00700 1 -- 172.21.15.111:0/434435964 wait complete. 2024-09-11T00:21:31.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:31.995+0000 7fccf6c00700 1 Processor -- start 2024-09-11T00:21:31.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:31.995+0000 7fccf6c00700 1 -- start start 2024-09-11T00:21:31.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:31.995+0000 7fccf6c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fccf00730f0 0x7fccf019c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:31.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:31.995+0000 7fccf6c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccf0073a00 0x7fccf019c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:31.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:31.995+0000 7fccf6c00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf019cd00 con 0x7fccf00730f0 2024-09-11T00:21:31.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:31.995+0000 7fccf6c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf01a0a90 con 0x7fccf0073a00 2024-09-11T00:21:31.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:31.996+0000 7fccf5800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fccf00730f0 0x7fccf019c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:31.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:31.996+0000 7fccf5800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fccf00730f0 0x7fccf019c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:59292/0 (socket says 172.21.15.111:59292) 2024-09-11T00:21:31.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:31.996+0000 7fccf5800700 1 -- 172.21.15.111:0/2233639004 learned_addr learned my addr 172.21.15.111:0/2233639004 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:21:31.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:31.996+0000 7fccf4e00700 1 --2- 172.21.15.111:0/2233639004 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccf0073a00 0x7fccf019c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:31.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:31.996+0000 7fccf5800700 1 -- 172.21.15.111:0/2233639004 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccf0073a00 msgr2=0x7fccf019c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:31.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:31.996+0000 7fccf5800700 1 --2- 172.21.15.111:0/2233639004 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccf0073a00 0x7fccf019c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:31.996+0000 7fccf5800700 1 -- 172.21.15.111:0/2233639004 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc0095f0 con 0x7fccf00730f0 2024-09-11T00:21:31.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:31.996+0000 7fccf5800700 1 --2- 172.21.15.111:0/2233639004 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fccf00730f0 0x7fccf019c0e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcce400d8d0 tx=0x7fcce400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:32.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:31.997+0000 7fccee000700 1 -- 172.21.15.111:0/2233639004 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcce40098a0 con 0x7fccf00730f0 2024-09-11T00:21:32.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:31.997+0000 7fccee000700 1 -- 172.21.15.111:0/2233639004 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcce4010460 con 0x7fccf00730f0 2024-09-11T00:21:32.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:31.997+0000 7fccee000700 1 -- 172.21.15.111:0/2233639004 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcce400f5f0 con 0x7fccf00730f0 2024-09-11T00:21:32.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:31.997+0000 7fccf6c00700 1 -- 172.21.15.111:0/2233639004 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf01a0d70 con 0x7fccf00730f0 2024-09-11T00:21:32.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:31.997+0000 7fccf6c00700 1 -- 172.21.15.111:0/2233639004 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf01a12c0 con 0x7fccf00730f0 2024-09-11T00:21:32.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:31.998+0000 7fccf6c00700 1 -- 172.21.15.111:0/2233639004 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccf010e200 con 0x7fccf00730f0 2024-09-11T00:21:32.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:31.999+0000 7fccee000700 1 -- 172.21.15.111:0/2233639004 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fcce4009a00 con 0x7fccf00730f0 2024-09-11T00:21:32.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:32.000+0000 7fccee000700 1 --2- 172.21.15.111:0/2233639004 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fccd807a6f0 0x7fccd807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:32.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:32.000+0000 7fccee000700 1 -- 172.21.15.111:0/2233639004 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fcce409d180 con 0x7fccf00730f0 2024-09-11T00:21:32.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:32.001+0000 7fccf4e00700 1 --2- 172.21.15.111:0/2233639004 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fccd807a6f0 0x7fccd807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:32.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:32.001+0000 7fccf4e00700 1 --2- 172.21.15.111:0/2233639004 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fccd807a6f0 0x7fccd807cba0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fccf019d700 tx=0x7fccdc01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:32.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:32.005+0000 7fccee000700 1 -- 172.21.15.111:0/2233639004 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fcce4060850 con 0x7fccf00730f0 2024-09-11T00:21:32.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:32.286+0000 7fccf6c00700 1 -- 172.21.15.111:0/2233639004 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fccf01a15f0 con 0x7fccf00730f0 2024-09-11T00:21:32.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:32.287+0000 7fccee000700 1 -- 172.21.15.111:0/2233639004 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 33 v33) v1 ==== 76+0+1977 (secure 0 0 0) 0x7fcce4063970 con 0x7fccf00730f0 2024-09-11T00:21:32.290 INFO:teuthology.orchestra.run.smithi111.stdout:e33 2024-09-11T00:21:32.290 INFO:teuthology.orchestra.run.smithi111.stdout:btime 2024-09-11T00:19:25:459235+0000 2024-09-11T00:21:32.290 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T00:21:32.290 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-11T00:21:32.290 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-11T00:21:32.290 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:21:32.290 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-11T00:21:32.290 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-11T00:21:32.291 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 33 2024-09-11T00:21:32.291 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-11T00:21:32.291 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-11T00:03:47.950356+0000 2024-09-11T00:21:32.291 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-11T00:19:24.665221+0000 2024-09-11T00:21:32.291 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-11T00:21:32.291 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-11T00:21:32.291 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-11T00:21:32.291 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-11T00:21:32.291 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-11T00:21:32.292 INFO:teuthology.orchestra.run.smithi111.stdout:max_xattr_size 65536 2024-09-11T00:21:32.292 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-11T00:21:32.292 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-11T00:21:32.292 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 84 2024-09-11T00:21:32.292 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T00:21:32.292 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-11T00:21:32.292 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-11T00:21:32.292 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=34406} 2024-09-11T00:21:32.292 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-11T00:21:32.292 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-11T00:21:32.293 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-11T00:21:32.293 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-11T00:21:32.293 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-11T00:21:32.293 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data enabled 2024-09-11T00:21:32.293 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-11T00:21:32.293 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-11T00:21:32.293 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 1 2024-09-11T00:21:32.293 INFO:teuthology.orchestra.run.smithi111.stdout:qdb_cluster leader: 34406 members: 34406 2024-09-11T00:21:32.293 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.gmgsay{0:34406} state up:active seq 22 join_fscid=1 addr [v2:172.21.15.111:6826/3970632147,v1:172.21.15.111:6827/3970632147] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:21:32.293 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:21:32.293 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:21:32.293 INFO:teuthology.orchestra.run.smithi111.stdout:Standby daemons: 2024-09-11T00:21:32.293 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:21:32.294 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.rucaba{-1:34438} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.111:6828/36584465,v1:172.21.15.111:6829/36584465] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:21:32.294 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.tcrqop{-1:44379} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.203:6824/4221647525,v1:172.21.15.203:6825/4221647525] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:21:32.294 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi203.uqkbkn{-1:44393} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.203:6826/1792805040,v1:172.21.15.203:6827/1792805040] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:21:32.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:32.291+0000 7fccf6c00700 1 -- 172.21.15.111:0/2233639004 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fccd807a6f0 msgr2=0x7fccd807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:32.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:32.291+0000 7fccf6c00700 1 --2- 172.21.15.111:0/2233639004 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fccd807a6f0 0x7fccd807cba0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fccf019d700 tx=0x7fccdc01a040 comp rx=0 tx=0).stop 2024-09-11T00:21:32.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:32.291+0000 7fccf6c00700 1 -- 172.21.15.111:0/2233639004 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fccf00730f0 msgr2=0x7fccf019c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:32.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:32.291+0000 7fccf6c00700 1 --2- 172.21.15.111:0/2233639004 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fccf00730f0 0x7fccf019c0e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcce400d8d0 tx=0x7fcce400dbe0 comp rx=0 tx=0).stop 2024-09-11T00:21:32.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:32.291+0000 7fccf6c00700 1 -- 172.21.15.111:0/2233639004 shutdown_connections 2024-09-11T00:21:32.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:32.291+0000 7fccf6c00700 1 --2- 172.21.15.111:0/2233639004 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fccd807a6f0 0x7fccd807cba0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:32.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:32.291+0000 7fccf6c00700 1 --2- 172.21.15.111:0/2233639004 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fccf00730f0 0x7fccf019c0e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:32.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:32.291+0000 7fccf6c00700 1 --2- 172.21.15.111:0/2233639004 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccf0073a00 0x7fccf019c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:32.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:32.291+0000 7fccf6c00700 1 -- 172.21.15.111:0/2233639004 >> 172.21.15.111:0/2233639004 conn(0x7fccf00fbab0 msgr2=0x7fccf0102590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:32.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:32.291+0000 7fccf6c00700 1 -- 172.21.15.111:0/2233639004 shutdown_connections 2024-09-11T00:21:32.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:32.291+0000 7fccf6c00700 1 -- 172.21.15.111:0/2233639004 wait complete. 2024-09-11T00:21:32.296 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 33 2024-09-11T00:21:32.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:31 smithi203 ceph-mon[69002]: pgmap v308: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:32.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:32 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/2233639004' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:21:33.001 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-11T00:21:33.012 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:21:33.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:32 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/2233639004' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:21:33.344 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:21:34.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:33 smithi111 ceph-mon[90842]: pgmap v309: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:34.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:33 smithi203 ceph-mon[69002]: pgmap v309: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:35.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.107+0000 7fc901a00700 1 -- 172.21.15.111:0/3301249442 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8fc100d50 msgr2=0x7fc8fc104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:35.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.107+0000 7fc901a00700 1 --2- 172.21.15.111:0/3301249442 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8fc100d50 0x7fc8fc104d20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8009910 tx=0x7fc8e8009c20 comp rx=0 tx=0).stop 2024-09-11T00:21:35.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.107+0000 7fc901a00700 1 -- 172.21.15.111:0/3301249442 shutdown_connections 2024-09-11T00:21:35.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.107+0000 7fc901a00700 1 --2- 172.21.15.111:0/3301249442 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8fc100d50 0x7fc8fc104d20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:35.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.107+0000 7fc901a00700 1 --2- 172.21.15.111:0/3301249442 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8fc1003b0 0x7fc8fc100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:35.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.107+0000 7fc901a00700 1 -- 172.21.15.111:0/3301249442 >> 172.21.15.111:0/3301249442 conn(0x7fc8fc0fbc30 msgr2=0x7fc8fc0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:35.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.107+0000 7fc901a00700 1 -- 172.21.15.111:0/3301249442 shutdown_connections 2024-09-11T00:21:35.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.107+0000 7fc901a00700 1 -- 172.21.15.111:0/3301249442 wait complete. 2024-09-11T00:21:35.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.109+0000 7fc901a00700 1 Processor -- start 2024-09-11T00:21:35.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.109+0000 7fc901a00700 1 -- start start 2024-09-11T00:21:35.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.109+0000 7fc901a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8fc1003b0 0x7fc8fc195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:35.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.109+0000 7fc901a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8fc100d50 0x7fc8fc196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:35.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.109+0000 7fc901a00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc1969e0 con 0x7fc8fc100d50 2024-09-11T00:21:35.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.109+0000 7fc901a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc19a770 con 0x7fc8fc1003b0 2024-09-11T00:21:35.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.110+0000 7fc8fa000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8fc100d50 0x7fc8fc196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:35.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.110+0000 7fc8fa000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8fc100d50 0x7fc8fc196300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:59322/0 (socket says 172.21.15.111:59322) 2024-09-11T00:21:35.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.110+0000 7fc8fa000700 1 -- 172.21.15.111:0/3629481767 learned_addr learned my addr 172.21.15.111:0/3629481767 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:21:35.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.110+0000 7fc8faa00700 1 --2- 172.21.15.111:0/3629481767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8fc1003b0 0x7fc8fc195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:35.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.110+0000 7fc8fa000700 1 -- 172.21.15.111:0/3629481767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8fc1003b0 msgr2=0x7fc8fc195dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:35.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.110+0000 7fc8fa000700 1 --2- 172.21.15.111:0/3629481767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8fc1003b0 0x7fc8fc195dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:35.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.110+0000 7fc8fa000700 1 -- 172.21.15.111:0/3629481767 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e80095f0 con 0x7fc8fc100d50 2024-09-11T00:21:35.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.110+0000 7fc8fa000700 1 --2- 172.21.15.111:0/3629481767 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8fc100d50 0x7fc8fc196300 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc8e800bd70 tx=0x7fc8e800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:35.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.111+0000 7fc8f3400700 1 -- 172.21.15.111:0/3629481767 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8e801d070 con 0x7fc8fc100d50 2024-09-11T00:21:35.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.111+0000 7fc8f3400700 1 -- 172.21.15.111:0/3629481767 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc8e8005dc0 con 0x7fc8fc100d50 2024-09-11T00:21:35.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.111+0000 7fc901a00700 1 -- 172.21.15.111:0/3629481767 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8fc19a9f0 con 0x7fc8fc100d50 2024-09-11T00:21:35.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.111+0000 7fc8f3400700 1 -- 172.21.15.111:0/3629481767 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8e8017400 con 0x7fc8fc100d50 2024-09-11T00:21:35.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.111+0000 7fc901a00700 1 -- 172.21.15.111:0/3629481767 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8fc19aee0 con 0x7fc8fc100d50 2024-09-11T00:21:35.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.112+0000 7fc901a00700 1 -- 172.21.15.111:0/3629481767 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8fc108720 con 0x7fc8fc100d50 2024-09-11T00:21:35.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.113+0000 7fc8f3400700 1 -- 172.21.15.111:0/3629481767 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fc8e800f7f0 con 0x7fc8fc100d50 2024-09-11T00:21:35.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.114+0000 7fc8f3400700 1 --2- 172.21.15.111:0/3629481767 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc8e007a6f0 0x7fc8e007cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:35.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.114+0000 7fc8f3400700 1 -- 172.21.15.111:0/3629481767 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fc8e809e7c0 con 0x7fc8fc100d50 2024-09-11T00:21:35.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.114+0000 7fc8faa00700 1 --2- 172.21.15.111:0/3629481767 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc8e007a6f0 0x7fc8e007cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:35.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.115+0000 7fc8faa00700 1 --2- 172.21.15.111:0/3629481767 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc8e007a6f0 0x7fc8e007cba0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec005950 tx=0x7fc8ec0058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:35.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.119+0000 7fc8f3400700 1 -- 172.21.15.111:0/3629481767 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fc8e8061e90 con 0x7fc8fc100d50 2024-09-11T00:21:35.385 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.382+0000 7fc901a00700 1 -- 172.21.15.111:0/3629481767 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8fc04ea50 con 0x7fc8fc100d50 2024-09-11T00:21:35.385 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.383+0000 7fc8f3400700 1 -- 172.21.15.111:0/3629481767 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+5255 (secure 0 0 0) 0x7fc8e8064fb0 con 0x7fc8fc100d50 2024-09-11T00:21:35.386 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:21:35.386 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":33,"btime":"2024-09-11T00:19:25:459235+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34438,"name":"cephfs.smithi111.rucaba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/36584465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":36584465},{"type":"v1","addr":"172.21.15.111:6829","nonce":36584465}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44379,"name":"cephfs.smithi203.tcrqop","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6825/4221647525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4221647525},{"type":"v1","addr":"172.21.15.203:6825","nonce":4221647525}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44393,"name":"cephfs.smithi203.uqkbkn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6827/1792805040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1792805040},{"type":"v1","addr":"172.21.15.203:6827","nonce":1792805040}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:03:47.950356+0000","modified":"2024-09-11T00:19:24.665221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34406":{"gid":34406,"name":"cephfs.smithi111.gmgsay","rank":0,"incarnation":27,"state":"up:active","state_seq":22,"addr":"172.21.15.111:6827/3970632147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3970632147},{"type":"v1","addr":"172.21.15.111:6827","nonce":3970632147}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34406,"qdb_cluster":[34406]},"id":1}]} 2024-09-11T00:21:35.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.386+0000 7fc901a00700 1 -- 172.21.15.111:0/3629481767 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc8e007a6f0 msgr2=0x7fc8e007cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:35.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.386+0000 7fc901a00700 1 --2- 172.21.15.111:0/3629481767 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc8e007a6f0 0x7fc8e007cba0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec005950 tx=0x7fc8ec0058e0 comp rx=0 tx=0).stop 2024-09-11T00:21:35.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.386+0000 7fc901a00700 1 -- 172.21.15.111:0/3629481767 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8fc100d50 msgr2=0x7fc8fc196300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:35.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.386+0000 7fc901a00700 1 --2- 172.21.15.111:0/3629481767 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8fc100d50 0x7fc8fc196300 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc8e800bd70 tx=0x7fc8e800be50 comp rx=0 tx=0).stop 2024-09-11T00:21:35.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.386+0000 7fc901a00700 1 -- 172.21.15.111:0/3629481767 shutdown_connections 2024-09-11T00:21:35.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.386+0000 7fc901a00700 1 --2- 172.21.15.111:0/3629481767 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fc8e007a6f0 0x7fc8e007cba0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:35.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.386+0000 7fc901a00700 1 --2- 172.21.15.111:0/3629481767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8fc1003b0 0x7fc8fc195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:35.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.386+0000 7fc901a00700 1 --2- 172.21.15.111:0/3629481767 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc8fc100d50 0x7fc8fc196300 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:35.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.386+0000 7fc901a00700 1 -- 172.21.15.111:0/3629481767 >> 172.21.15.111:0/3629481767 conn(0x7fc8fc0fbc30 msgr2=0x7fc8fc0fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:35.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.386+0000 7fc901a00700 1 -- 172.21.15.111:0/3629481767 shutdown_connections 2024-09-11T00:21:35.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:35.386+0000 7fc901a00700 1 -- 172.21.15.111:0/3629481767 wait complete. 2024-09-11T00:21:35.390 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 33 2024-09-11T00:21:35.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:35 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/3629481767' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:21:35.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:35 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/3629481767' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:21:36.037 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 14, 'max_mds': 1, 'flags': 18} 2024-09-11T00:21:36.037 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 15 2024-09-11T00:21:36.360 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:21:36.696 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:36 smithi203 ceph-mon[69002]: pgmap v310: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:36.777 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:36 smithi111 ceph-mon[90842]: pgmap v310: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:37.958 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:37 smithi111 ceph-mon[90842]: pgmap v311: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:38.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:37 smithi203 ceph-mon[69002]: pgmap v311: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:38.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.372+0000 7feae4c00700 1 -- 172.21.15.111:0/2774309137 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feae0102fb0 msgr2=0x7feae0106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:38.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.372+0000 7feae4c00700 1 --2- 172.21.15.111:0/2774309137 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feae0102fb0 0x7feae0106f80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7feacc009910 tx=0x7feacc009c20 comp rx=0 tx=0).stop 2024-09-11T00:21:38.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.372+0000 7feae4c00700 1 -- 172.21.15.111:0/2774309137 shutdown_connections 2024-09-11T00:21:38.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.372+0000 7feae4c00700 1 --2- 172.21.15.111:0/2774309137 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feae0102fb0 0x7feae0106f80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.372+0000 7feae4c00700 1 --2- 172.21.15.111:0/2774309137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feae0102610 0x7feae01029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.372+0000 7feae4c00700 1 -- 172.21.15.111:0/2774309137 >> 172.21.15.111:0/2774309137 conn(0x7feae00fde90 msgr2=0x7feae01002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:38.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.372+0000 7feae4c00700 1 -- 172.21.15.111:0/2774309137 shutdown_connections 2024-09-11T00:21:38.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.372+0000 7feae4c00700 1 -- 172.21.15.111:0/2774309137 wait complete. 2024-09-11T00:21:38.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.373+0000 7feae4c00700 1 Processor -- start 2024-09-11T00:21:38.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.373+0000 7feae4c00700 1 -- start start 2024-09-11T00:21:38.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.373+0000 7feae4c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feae0102610 0x7feae0197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:38.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.373+0000 7feae4c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feae0102fb0 0x7feae0198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:38.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.373+0000 7feae4c00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae0198c00 con 0x7feae0102610 2024-09-11T00:21:38.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.373+0000 7feae4c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae019c990 con 0x7feae0102fb0 2024-09-11T00:21:38.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.373+0000 7feadde00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feae0102610 0x7feae0197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:38.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.373+0000 7feadde00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feae0102610 0x7feae0197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60706/0 (socket says 172.21.15.111:60706) 2024-09-11T00:21:38.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.374+0000 7feadde00700 1 -- 172.21.15.111:0/2286412127 learned_addr learned my addr 172.21.15.111:0/2286412127 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:21:38.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.374+0000 7feadd400700 1 --2- 172.21.15.111:0/2286412127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feae0102fb0 0x7feae0198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:38.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.374+0000 7feadde00700 1 -- 172.21.15.111:0/2286412127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feae0102fb0 msgr2=0x7feae0198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:38.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.374+0000 7feadde00700 1 --2- 172.21.15.111:0/2286412127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feae0102fb0 0x7feae0198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.374+0000 7feadde00700 1 -- 172.21.15.111:0/2286412127 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feacc0095f0 con 0x7feae0102610 2024-09-11T00:21:38.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.374+0000 7feadde00700 1 --2- 172.21.15.111:0/2286412127 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feae0102610 0x7feae0197fe0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fead000d8d0 tx=0x7fead000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:38.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.374+0000 7fead6a00700 1 -- 172.21.15.111:0/2286412127 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fead0009940 con 0x7feae0102610 2024-09-11T00:21:38.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.374+0000 7fead6a00700 1 -- 172.21.15.111:0/2286412127 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fead0010460 con 0x7feae0102610 2024-09-11T00:21:38.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.374+0000 7feae4c00700 1 -- 172.21.15.111:0/2286412127 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae019cc70 con 0x7feae0102610 2024-09-11T00:21:38.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.375+0000 7fead6a00700 1 -- 172.21.15.111:0/2286412127 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fead000f5f0 con 0x7feae0102610 2024-09-11T00:21:38.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.375+0000 7feae4c00700 1 -- 172.21.15.111:0/2286412127 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae019d1c0 con 0x7feae0102610 2024-09-11T00:21:38.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.376+0000 7feae4c00700 1 -- 172.21.15.111:0/2286412127 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae004ea50 con 0x7feae0102610 2024-09-11T00:21:38.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.377+0000 7fead6a00700 1 -- 172.21.15.111:0/2286412127 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fead00105d0 con 0x7feae0102610 2024-09-11T00:21:38.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.378+0000 7fead6a00700 1 --2- 172.21.15.111:0/2286412127 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7feac407a6f0 0x7feac407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:38.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.378+0000 7fead6a00700 1 -- 172.21.15.111:0/2286412127 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fead009d2c0 con 0x7feae0102610 2024-09-11T00:21:38.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.378+0000 7feadd400700 1 --2- 172.21.15.111:0/2286412127 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7feac407a6f0 0x7feac407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:38.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.379+0000 7feadd400700 1 --2- 172.21.15.111:0/2286412127 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7feac407a6f0 0x7feac407cba0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feae0199600 tx=0x7feacc01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:38.384 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.382+0000 7fead6a00700 1 -- 172.21.15.111:0/2286412127 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fead0060990 con 0x7feae0102610 2024-09-11T00:21:38.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.650+0000 7feae4c00700 1 -- 172.21.15.111:0/2286412127 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 15, "format": "json"} v 0) v1 -- 0x7feae0199340 con 0x7feae0102610 2024-09-11T00:21:38.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.651+0000 7fead6a00700 1 -- 172.21.15.111:0/2286412127 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 15, "format": "json"}]=0 dumped fsmap epoch 15 v33) v1 ==== 107+0+4908 (secure 0 0 0) 0x7fead0063ab0 con 0x7feae0102610 2024-09-11T00:21:38.653 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:21:38.654 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":15,"btime":"1970-01-01T00:00:00:000000+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14554,"name":"cephfs.smithi111.rucaba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.111:6829/2045133285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":2045133285},{"type":"v1","addr":"172.21.15.111:6829","nonce":2045133285}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":14566,"name":"cephfs.smithi111.gmgsay","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6827/1122545830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":1122545830},{"type":"v1","addr":"172.21.15.111:6827","nonce":1122545830}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24379,"name":"cephfs.smithi203.uqkbkn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.203:6827/695613114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":695613114},{"type":"v1","addr":"172.21.15.203:6827","nonce":695613114}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:03:47.950356+0000","modified":"2024-09-11T00:04:06.275905+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24363":{"gid":24363,"name":"cephfs.smithi203.tcrqop","rank":0,"incarnation":11,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6825/3082736449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3082736449},{"type":"v1","addr":"172.21.15.203:6825","nonce":3082736449}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-11T00:21:38.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.654+0000 7feae4c00700 1 -- 172.21.15.111:0/2286412127 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7feac407a6f0 msgr2=0x7feac407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:38.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.654+0000 7feae4c00700 1 --2- 172.21.15.111:0/2286412127 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7feac407a6f0 0x7feac407cba0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feae0199600 tx=0x7feacc01a040 comp rx=0 tx=0).stop 2024-09-11T00:21:38.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.654+0000 7feae4c00700 1 -- 172.21.15.111:0/2286412127 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feae0102610 msgr2=0x7feae0197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:38.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.654+0000 7feae4c00700 1 --2- 172.21.15.111:0/2286412127 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feae0102610 0x7feae0197fe0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fead000d8d0 tx=0x7fead000dc90 comp rx=0 tx=0).stop 2024-09-11T00:21:38.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.654+0000 7feae4c00700 1 -- 172.21.15.111:0/2286412127 shutdown_connections 2024-09-11T00:21:38.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.654+0000 7feae4c00700 1 --2- 172.21.15.111:0/2286412127 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7feac407a6f0 0x7feac407cba0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.654+0000 7feae4c00700 1 --2- 172.21.15.111:0/2286412127 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feae0102610 0x7feae0197fe0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.654+0000 7feae4c00700 1 --2- 172.21.15.111:0/2286412127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feae0102fb0 0x7feae0198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.654+0000 7feae4c00700 1 -- 172.21.15.111:0/2286412127 >> 172.21.15.111:0/2286412127 conn(0x7feae00fde90 msgr2=0x7feae00ff460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:38.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.654+0000 7feae4c00700 1 -- 172.21.15.111:0/2286412127 shutdown_connections 2024-09-11T00:21:38.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:38.654+0000 7feae4c00700 1 -- 172.21.15.111:0/2286412127 wait complete. 2024-09-11T00:21:38.657 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 15 2024-09-11T00:21:39.025 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:38 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/2286412127' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 15, "format": "json"} : dispatch 2024-09-11T00:21:39.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:38 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/2286412127' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 15, "format": "json"} : dispatch 2024-09-11T00:21:39.380 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 16 2024-09-11T00:21:39.702 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:21:40.115 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:39 smithi111 ceph-mon[90842]: pgmap v312: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:40.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:39 smithi203 ceph-mon[69002]: pgmap v312: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:41.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.661+0000 7fbbee000700 1 -- 172.21.15.111:0/1717953672 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbbe8102610 msgr2=0x7fbbe81029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:41.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.661+0000 7fbbee000700 1 --2- 172.21.15.111:0/1717953672 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbbe8102610 0x7fbbe81029e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8009910 tx=0x7fbbd8009c20 comp rx=0 tx=0).stop 2024-09-11T00:21:41.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.661+0000 7fbbee000700 1 -- 172.21.15.111:0/1717953672 shutdown_connections 2024-09-11T00:21:41.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.661+0000 7fbbee000700 1 --2- 172.21.15.111:0/1717953672 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbe8102fb0 0x7fbbe8106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:41.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.661+0000 7fbbee000700 1 --2- 172.21.15.111:0/1717953672 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbbe8102610 0x7fbbe81029e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:41.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.661+0000 7fbbee000700 1 -- 172.21.15.111:0/1717953672 >> 172.21.15.111:0/1717953672 conn(0x7fbbe80fde90 msgr2=0x7fbbe81002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:41.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.661+0000 7fbbee000700 1 -- 172.21.15.111:0/1717953672 shutdown_connections 2024-09-11T00:21:41.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.661+0000 7fbbee000700 1 -- 172.21.15.111:0/1717953672 wait complete. 2024-09-11T00:21:41.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.663+0000 7fbbee000700 1 Processor -- start 2024-09-11T00:21:41.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.663+0000 7fbbee000700 1 -- start start 2024-09-11T00:21:41.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.663+0000 7fbbee000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbe8102610 0x7fbbe8197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:41.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.663+0000 7fbbee000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbbe8102fb0 0x7fbbe8198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:41.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.663+0000 7fbbee000700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe8198be0 con 0x7fbbe8102fb0 2024-09-11T00:21:41.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.663+0000 7fbbee000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe819c970 con 0x7fbbe8102610 2024-09-11T00:21:41.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.663+0000 7fbbe6a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbbe8102fb0 0x7fbbe8198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:41.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.663+0000 7fbbe6a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbbe8102fb0 0x7fbbe8198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60726/0 (socket says 172.21.15.111:60726) 2024-09-11T00:21:41.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.663+0000 7fbbe6a00700 1 -- 172.21.15.111:0/197772745 learned_addr learned my addr 172.21.15.111:0/197772745 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:21:41.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.664+0000 7fbbe7400700 1 --2- 172.21.15.111:0/197772745 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbe8102610 0x7fbbe8197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:41.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.664+0000 7fbbe6a00700 1 -- 172.21.15.111:0/197772745 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbe8102610 msgr2=0x7fbbe8197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:41.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.664+0000 7fbbe6a00700 1 --2- 172.21.15.111:0/197772745 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbe8102610 0x7fbbe8197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:41.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.664+0000 7fbbe6a00700 1 -- 172.21.15.111:0/197772745 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd80095f0 con 0x7fbbe8102fb0 2024-09-11T00:21:41.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.664+0000 7fbbe6a00700 1 --2- 172.21.15.111:0/197772745 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbbe8102fb0 0x7fbbe8198500 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400e8f0 tx=0x7fbbd400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:41.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.664+0000 7fbbdfe00700 1 -- 172.21.15.111:0/197772745 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbd4009790 con 0x7fbbe8102fb0 2024-09-11T00:21:41.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.664+0000 7fbbdfe00700 1 -- 172.21.15.111:0/197772745 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbbd400c810 con 0x7fbbe8102fb0 2024-09-11T00:21:41.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.664+0000 7fbbdfe00700 1 -- 172.21.15.111:0/197772745 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbd4005580 con 0x7fbbe8102fb0 2024-09-11T00:21:41.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.664+0000 7fbbee000700 1 -- 172.21.15.111:0/197772745 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe819cc50 con 0x7fbbe8102fb0 2024-09-11T00:21:41.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.665+0000 7fbbee000700 1 -- 172.21.15.111:0/197772745 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe819d1a0 con 0x7fbbe8102fb0 2024-09-11T00:21:41.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.666+0000 7fbbee000700 1 -- 172.21.15.111:0/197772745 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe804ea50 con 0x7fbbe8102fb0 2024-09-11T00:21:41.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.667+0000 7fbbdfe00700 1 -- 172.21.15.111:0/197772745 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fbbd400c980 con 0x7fbbe8102fb0 2024-09-11T00:21:41.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.668+0000 7fbbdfe00700 1 --2- 172.21.15.111:0/197772745 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fbbcc07a6f0 0x7fbbcc07cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:41.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.668+0000 7fbbdfe00700 1 -- 172.21.15.111:0/197772745 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fbbd4014070 con 0x7fbbe8102fb0 2024-09-11T00:21:41.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.668+0000 7fbbe7400700 1 --2- 172.21.15.111:0/197772745 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fbbcc07a6f0 0x7fbbcc07cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:41.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.669+0000 7fbbe7400700 1 --2- 172.21.15.111:0/197772745 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fbbcc07a6f0 0x7fbbcc07cba0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbbd800b760 tx=0x7fbbd8005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:41.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.672+0000 7fbbdfe00700 1 -- 172.21.15.111:0/197772745 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fbbd4060c70 con 0x7fbbe8102fb0 2024-09-11T00:21:41.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.944+0000 7fbbee000700 1 -- 172.21.15.111:0/197772745 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7fbbe819d6c0 con 0x7fbbe8102fb0 2024-09-11T00:21:41.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.944+0000 7fbbdfe00700 1 -- 172.21.15.111:0/197772745 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v33) v1 ==== 107+0+4126 (secure 0 0 0) 0x7fbbd4063d90 con 0x7fbbe8102fb0 2024-09-11T00:21:41.947 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:21:41.947 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":16,"btime":"2024-09-11T00:17:32:890802+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14554,"name":"cephfs.smithi111.rucaba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.111:6829/2045133285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":2045133285},{"type":"v1","addr":"172.21.15.111:6829","nonce":2045133285}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24379,"name":"cephfs.smithi203.uqkbkn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.203:6827/695613114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":695613114},{"type":"v1","addr":"172.21.15.203:6827","nonce":695613114}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:03:47.950356+0000","modified":"2024-09-11T00:04:06.275905+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24363":{"gid":24363,"name":"cephfs.smithi203.tcrqop","rank":0,"incarnation":11,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6825/3082736449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3082736449},{"type":"v1","addr":"172.21.15.203:6825","nonce":3082736449}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-11T00:21:41.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.947+0000 7fbbee000700 1 -- 172.21.15.111:0/197772745 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fbbcc07a6f0 msgr2=0x7fbbcc07cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:41.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.947+0000 7fbbee000700 1 --2- 172.21.15.111:0/197772745 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fbbcc07a6f0 0x7fbbcc07cba0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbbd800b760 tx=0x7fbbd8005a90 comp rx=0 tx=0).stop 2024-09-11T00:21:41.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.947+0000 7fbbee000700 1 -- 172.21.15.111:0/197772745 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbbe8102fb0 msgr2=0x7fbbe8198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:41.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.947+0000 7fbbee000700 1 --2- 172.21.15.111:0/197772745 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbbe8102fb0 0x7fbbe8198500 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400e8f0 tx=0x7fbbd400ec00 comp rx=0 tx=0).stop 2024-09-11T00:21:41.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.947+0000 7fbbee000700 1 -- 172.21.15.111:0/197772745 shutdown_connections 2024-09-11T00:21:41.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.947+0000 7fbbee000700 1 --2- 172.21.15.111:0/197772745 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fbbcc07a6f0 0x7fbbcc07cba0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:41.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.947+0000 7fbbee000700 1 --2- 172.21.15.111:0/197772745 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbe8102610 0x7fbbe8197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:41.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.947+0000 7fbbee000700 1 --2- 172.21.15.111:0/197772745 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbbe8102fb0 0x7fbbe8198500 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:41.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.947+0000 7fbbee000700 1 -- 172.21.15.111:0/197772745 >> 172.21.15.111:0/197772745 conn(0x7fbbe80fde90 msgr2=0x7fbbe80ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:41.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.948+0000 7fbbee000700 1 -- 172.21.15.111:0/197772745 shutdown_connections 2024-09-11T00:21:41.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:41.948+0000 7fbbee000700 1 -- 172.21.15.111:0/197772745 wait complete. 2024-09-11T00:21:41.951 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 16 2024-09-11T00:21:42.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:41 smithi111 ceph-mon[90842]: pgmap v313: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:42.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:41 smithi203 ceph-mon[69002]: pgmap v313: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:42.845 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 17 2024-09-11T00:21:43.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:42 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/197772745' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 16, "format": "json"} : dispatch 2024-09-11T00:21:43.168 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:21:43.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:42 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/197772745' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 16, "format": "json"} : dispatch 2024-09-11T00:21:44.100 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:43 smithi111 ceph-mon[90842]: pgmap v314: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:44.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:43 smithi203 ceph-mon[69002]: pgmap v314: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:45.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.014+0000 7f6618600700 1 -- 172.21.15.111:0/180638616 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6610102610 msgr2=0x7f66101029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:45.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.014+0000 7f6618600700 1 --2- 172.21.15.111:0/180638616 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6610102610 0x7f66101029e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6604009910 tx=0x7f6604009c20 comp rx=0 tx=0).stop 2024-09-11T00:21:45.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.014+0000 7f6618600700 1 -- 172.21.15.111:0/180638616 shutdown_connections 2024-09-11T00:21:45.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.014+0000 7f6618600700 1 --2- 172.21.15.111:0/180638616 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6610102fb0 0x7f6610106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:45.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.014+0000 7f6618600700 1 --2- 172.21.15.111:0/180638616 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6610102610 0x7f66101029e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:45.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.014+0000 7f6618600700 1 -- 172.21.15.111:0/180638616 >> 172.21.15.111:0/180638616 conn(0x7f66100fde90 msgr2=0x7f66101002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:45.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.014+0000 7f6618600700 1 -- 172.21.15.111:0/180638616 shutdown_connections 2024-09-11T00:21:45.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.014+0000 7f6618600700 1 -- 172.21.15.111:0/180638616 wait complete. 2024-09-11T00:21:45.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.015+0000 7f6618600700 1 Processor -- start 2024-09-11T00:21:45.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.015+0000 7f6618600700 1 -- start start 2024-09-11T00:21:45.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.015+0000 7f6618600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6610102610 0x7f6610197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:45.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.015+0000 7f6618600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6610102fb0 0x7f6610198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:45.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.015+0000 7f6618600700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6610198be0 con 0x7f6610102fb0 2024-09-11T00:21:45.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.015+0000 7f6618600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661019c970 con 0x7f6610102610 2024-09-11T00:21:45.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.016+0000 7f6615200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6610102fb0 0x7f6610198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:45.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.016+0000 7f6615200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6610102fb0 0x7f6610198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60746/0 (socket says 172.21.15.111:60746) 2024-09-11T00:21:45.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.016+0000 7f6615200700 1 -- 172.21.15.111:0/1810536993 learned_addr learned my addr 172.21.15.111:0/1810536993 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:21:45.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.016+0000 7f6615c00700 1 --2- 172.21.15.111:0/1810536993 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6610102610 0x7f6610197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:45.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.016+0000 7f6615200700 1 -- 172.21.15.111:0/1810536993 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6610102610 msgr2=0x7f6610197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:45.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.016+0000 7f6615200700 1 --2- 172.21.15.111:0/1810536993 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6610102610 0x7f6610197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:45.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.016+0000 7f6615200700 1 -- 172.21.15.111:0/1810536993 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66040095f0 con 0x7f6610102fb0 2024-09-11T00:21:45.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.017+0000 7f6615200700 1 --2- 172.21.15.111:0/1810536993 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6610102fb0 0x7f6610198500 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00d900 tx=0x7f65fc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:45.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.017+0000 7f660e000700 1 -- 172.21.15.111:0/1810536993 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65fc009900 con 0x7f6610102fb0 2024-09-11T00:21:45.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.017+0000 7f660e000700 1 -- 172.21.15.111:0/1810536993 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f65fc010460 con 0x7f6610102fb0 2024-09-11T00:21:45.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.017+0000 7f660e000700 1 -- 172.21.15.111:0/1810536993 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65fc00f5f0 con 0x7f6610102fb0 2024-09-11T00:21:45.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.017+0000 7f6618600700 1 -- 172.21.15.111:0/1810536993 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f661019cc50 con 0x7f6610102fb0 2024-09-11T00:21:45.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.017+0000 7f6618600700 1 -- 172.21.15.111:0/1810536993 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f661019d1a0 con 0x7f6610102fb0 2024-09-11T00:21:45.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.018+0000 7f6618600700 1 -- 172.21.15.111:0/1810536993 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f661004ea50 con 0x7f6610102fb0 2024-09-11T00:21:45.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.019+0000 7f660e000700 1 -- 172.21.15.111:0/1810536993 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f65fc0105d0 con 0x7f6610102fb0 2024-09-11T00:21:45.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.020+0000 7f660e000700 1 --2- 172.21.15.111:0/1810536993 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f65f807a6f0 0x7f65f807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:45.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.020+0000 7f660e000700 1 -- 172.21.15.111:0/1810536993 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f65fc09cf50 con 0x7f6610102fb0 2024-09-11T00:21:45.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.021+0000 7f6615c00700 1 --2- 172.21.15.111:0/1810536993 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f65f807a6f0 0x7f65f807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:45.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.021+0000 7f6615c00700 1 --2- 172.21.15.111:0/1810536993 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f65f807a6f0 0x7f65f807cba0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6604006010 tx=0x7f660401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:45.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.025+0000 7f660e000700 1 -- 172.21.15.111:0/1810536993 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f65fc0605a0 con 0x7f6610102fb0 2024-09-11T00:21:45.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:44 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:21:45.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:44 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:21:45.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.295+0000 7f6618600700 1 -- 172.21.15.111:0/1810536993 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7f6610199320 con 0x7f6610102fb0 2024-09-11T00:21:45.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.296+0000 7f660e000700 1 -- 172.21.15.111:0/1810536993 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v33) v1 ==== 107+0+4976 (secure 0 0 0) 0x7f65fc0636c0 con 0x7f6610102fb0 2024-09-11T00:21:45.298 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:21:45.298 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":17,"btime":"2024-09-11T00:17:37:251871+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14554,"name":"cephfs.smithi111.rucaba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.111:6829/2045133285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":2045133285},{"type":"v1","addr":"172.21.15.111:6829","nonce":2045133285}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24379,"name":"cephfs.smithi203.uqkbkn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.203:6827/695613114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":695613114},{"type":"v1","addr":"172.21.15.203:6827","nonce":695613114}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34406,"name":"cephfs.smithi111.gmgsay","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6827/3970632147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3970632147},{"type":"v1","addr":"172.21.15.111:6827","nonce":3970632147}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:03:47.950356+0000","modified":"2024-09-11T00:04:06.275905+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24363":{"gid":24363,"name":"cephfs.smithi203.tcrqop","rank":0,"incarnation":11,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6825/3082736449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3082736449},{"type":"v1","addr":"172.21.15.203:6825","nonce":3082736449}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-11T00:21:45.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.298+0000 7f6618600700 1 -- 172.21.15.111:0/1810536993 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f65f807a6f0 msgr2=0x7f65f807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:45.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.298+0000 7f6618600700 1 --2- 172.21.15.111:0/1810536993 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f65f807a6f0 0x7f65f807cba0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6604006010 tx=0x7f660401a040 comp rx=0 tx=0).stop 2024-09-11T00:21:45.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.298+0000 7f6618600700 1 -- 172.21.15.111:0/1810536993 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6610102fb0 msgr2=0x7f6610198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:45.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.298+0000 7f6618600700 1 --2- 172.21.15.111:0/1810536993 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6610102fb0 0x7f6610198500 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00d900 tx=0x7f65fc00dc10 comp rx=0 tx=0).stop 2024-09-11T00:21:45.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.298+0000 7f6618600700 1 -- 172.21.15.111:0/1810536993 shutdown_connections 2024-09-11T00:21:45.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.298+0000 7f6618600700 1 --2- 172.21.15.111:0/1810536993 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f65f807a6f0 0x7f65f807cba0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:45.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.298+0000 7f6618600700 1 --2- 172.21.15.111:0/1810536993 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6610102610 0x7f6610197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:45.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.298+0000 7f6618600700 1 --2- 172.21.15.111:0/1810536993 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6610102fb0 0x7f6610198500 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:45.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.298+0000 7f6618600700 1 -- 172.21.15.111:0/1810536993 >> 172.21.15.111:0/1810536993 conn(0x7f66100fde90 msgr2=0x7f66100ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:45.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.299+0000 7f6618600700 1 -- 172.21.15.111:0/1810536993 shutdown_connections 2024-09-11T00:21:45.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:45.299+0000 7f6618600700 1 -- 172.21.15.111:0/1810536993 wait complete. 2024-09-11T00:21:45.302 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 17 2024-09-11T00:21:45.966 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 18 2024-09-11T00:21:46.290 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:21:46.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:45 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/1810536993' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 17, "format": "json"} : dispatch 2024-09-11T00:21:46.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:45 smithi203 ceph-mon[69002]: pgmap v315: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:46.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:45 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/1810536993' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 17, "format": "json"} : dispatch 2024-09-11T00:21:46.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:45 smithi111 ceph-mon[90842]: pgmap v315: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:48.070 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:47 smithi111 ceph-mon[90842]: pgmap v316: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:48.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.208+0000 7facb3800700 1 -- 172.21.15.111:0/3419599414 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7facac1003b0 msgr2=0x7facac100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:48.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.208+0000 7facb3800700 1 --2- 172.21.15.111:0/3419599414 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7facac1003b0 0x7facac100780 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faca0009910 tx=0x7faca0009c20 comp rx=0 tx=0).stop 2024-09-11T00:21:48.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.208+0000 7facb3800700 1 -- 172.21.15.111:0/3419599414 shutdown_connections 2024-09-11T00:21:48.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.208+0000 7facb3800700 1 --2- 172.21.15.111:0/3419599414 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7facac100d50 0x7facac104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:48.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.208+0000 7facb3800700 1 --2- 172.21.15.111:0/3419599414 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7facac1003b0 0x7facac100780 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:48.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.208+0000 7facb3800700 1 -- 172.21.15.111:0/3419599414 >> 172.21.15.111:0/3419599414 conn(0x7facac0fbc30 msgr2=0x7facac0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:48.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.208+0000 7facb3800700 1 -- 172.21.15.111:0/3419599414 shutdown_connections 2024-09-11T00:21:48.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.208+0000 7facb3800700 1 -- 172.21.15.111:0/3419599414 wait complete. 2024-09-11T00:21:48.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.209+0000 7facb3800700 1 Processor -- start 2024-09-11T00:21:48.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.210+0000 7facb3800700 1 -- start start 2024-09-11T00:21:48.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.210+0000 7facb3800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7facac1003b0 0x7facac195d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:48.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.210+0000 7facb3800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7facac100d50 0x7facac196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:48.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.210+0000 7facb3800700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facac196930 con 0x7facac100d50 2024-09-11T00:21:48.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.210+0000 7facb3800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facac19a6c0 con 0x7facac1003b0 2024-09-11T00:21:48.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.210+0000 7facabe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7facac100d50 0x7facac196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:48.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.210+0000 7facb0e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7facac1003b0 0x7facac195d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:48.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.210+0000 7facabe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7facac100d50 0x7facac196250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48224/0 (socket says 172.21.15.111:48224) 2024-09-11T00:21:48.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.210+0000 7facb0e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7facac1003b0 0x7facac195d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.111:47954/0 (socket says 172.21.15.111:47954) 2024-09-11T00:21:48.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.211+0000 7facabe00700 1 -- 172.21.15.111:0/2131620471 learned_addr learned my addr 172.21.15.111:0/2131620471 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:21:48.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.211+0000 7facabe00700 1 -- 172.21.15.111:0/2131620471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7facac1003b0 msgr2=0x7facac195d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:48.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.211+0000 7facabe00700 1 --2- 172.21.15.111:0/2131620471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7facac1003b0 0x7facac195d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:48.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.211+0000 7facabe00700 1 -- 172.21.15.111:0/2131620471 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca00095f0 con 0x7facac100d50 2024-09-11T00:21:48.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.211+0000 7facabe00700 1 --2- 172.21.15.111:0/2131620471 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7facac100d50 0x7facac196250 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fac9800d900 tx=0x7fac9800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:48.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.211+0000 7faca9600700 1 -- 172.21.15.111:0/2131620471 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac98009900 con 0x7facac100d50 2024-09-11T00:21:48.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.212+0000 7faca9600700 1 -- 172.21.15.111:0/2131620471 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fac98010460 con 0x7facac100d50 2024-09-11T00:21:48.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.212+0000 7faca9600700 1 -- 172.21.15.111:0/2131620471 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac9800f5f0 con 0x7facac100d50 2024-09-11T00:21:48.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.212+0000 7facb3800700 1 -- 172.21.15.111:0/2131620471 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facac19a9a0 con 0x7facac100d50 2024-09-11T00:21:48.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.212+0000 7facb3800700 1 -- 172.21.15.111:0/2131620471 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facac19aef0 con 0x7facac100d50 2024-09-11T00:21:48.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.213+0000 7facb3800700 1 -- 172.21.15.111:0/2131620471 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facac1086c0 con 0x7facac100d50 2024-09-11T00:21:48.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.214+0000 7faca9600700 1 -- 172.21.15.111:0/2131620471 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fac980105d0 con 0x7facac100d50 2024-09-11T00:21:48.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.215+0000 7faca9600700 1 --2- 172.21.15.111:0/2131620471 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fac9407a6f0 0x7fac9407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:48.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.215+0000 7faca9600700 1 -- 172.21.15.111:0/2131620471 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fac9809ce50 con 0x7facac100d50 2024-09-11T00:21:48.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.216+0000 7facb0e00700 1 --2- 172.21.15.111:0/2131620471 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fac9407a6f0 0x7fac9407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:48.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.216+0000 7facb0e00700 1 --2- 172.21.15.111:0/2131620471 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fac9407a6f0 0x7fac9407cba0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faca0006010 tx=0x7faca001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:48.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.220+0000 7faca9600700 1 -- 172.21.15.111:0/2131620471 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fac98060520 con 0x7facac100d50 2024-09-11T00:21:48.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:47 smithi203 ceph-mon[69002]: pgmap v316: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:48.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.489+0000 7facb3800700 1 -- 172.21.15.111:0/2131620471 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7facac04ea50 con 0x7facac100d50 2024-09-11T00:21:48.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.490+0000 7faca9600700 1 -- 172.21.15.111:0/2131620471 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v33) v1 ==== 107+0+4194 (secure 0 0 0) 0x7fac98063640 con 0x7facac100d50 2024-09-11T00:21:48.493 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:21:48.493 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":18,"btime":"2024-09-11T00:17:52:521510+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24379,"name":"cephfs.smithi203.uqkbkn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.203:6827/695613114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":695613114},{"type":"v1","addr":"172.21.15.203:6827","nonce":695613114}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34406,"name":"cephfs.smithi111.gmgsay","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6827/3970632147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3970632147},{"type":"v1","addr":"172.21.15.111:6827","nonce":3970632147}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:03:47.950356+0000","modified":"2024-09-11T00:04:06.275905+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24363":{"gid":24363,"name":"cephfs.smithi203.tcrqop","rank":0,"incarnation":11,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6825/3082736449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3082736449},{"type":"v1","addr":"172.21.15.203:6825","nonce":3082736449}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-11T00:21:48.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.493+0000 7facb3800700 1 -- 172.21.15.111:0/2131620471 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fac9407a6f0 msgr2=0x7fac9407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:48.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.493+0000 7facb3800700 1 --2- 172.21.15.111:0/2131620471 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fac9407a6f0 0x7fac9407cba0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faca0006010 tx=0x7faca001a040 comp rx=0 tx=0).stop 2024-09-11T00:21:48.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.493+0000 7facb3800700 1 -- 172.21.15.111:0/2131620471 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7facac100d50 msgr2=0x7facac196250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:48.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.493+0000 7facb3800700 1 --2- 172.21.15.111:0/2131620471 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7facac100d50 0x7facac196250 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fac9800d900 tx=0x7fac9800dc10 comp rx=0 tx=0).stop 2024-09-11T00:21:48.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.493+0000 7facb3800700 1 -- 172.21.15.111:0/2131620471 shutdown_connections 2024-09-11T00:21:48.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.493+0000 7facb3800700 1 --2- 172.21.15.111:0/2131620471 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fac9407a6f0 0x7fac9407cba0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:48.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.493+0000 7facb3800700 1 --2- 172.21.15.111:0/2131620471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7facac1003b0 0x7facac195d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:48.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.493+0000 7facb3800700 1 --2- 172.21.15.111:0/2131620471 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7facac100d50 0x7facac196250 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:48.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.493+0000 7facb3800700 1 -- 172.21.15.111:0/2131620471 >> 172.21.15.111:0/2131620471 conn(0x7facac0fbc30 msgr2=0x7facac0fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:48.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.493+0000 7facb3800700 1 -- 172.21.15.111:0/2131620471 shutdown_connections 2024-09-11T00:21:48.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:48.493+0000 7facb3800700 1 -- 172.21.15.111:0/2131620471 wait complete. 2024-09-11T00:21:48.498 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 18 2024-09-11T00:21:49.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:48 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/2131620471' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 18, "format": "json"} : dispatch 2024-09-11T00:21:49.194 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 19 2024-09-11T00:21:49.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:48 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/2131620471' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 18, "format": "json"} : dispatch 2024-09-11T00:21:49.529 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:21:50.086 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:49 smithi111 ceph-mon[90842]: pgmap v317: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:50.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:49 smithi203 ceph-mon[69002]: pgmap v317: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:51.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.437+0000 7f662d800700 1 -- 172.21.15.111:0/4017368565 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66281003d0 msgr2=0x7f66281007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:51.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.437+0000 7f662d800700 1 --2- 172.21.15.111:0/4017368565 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66281003d0 0x7f66281007a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6618009910 tx=0x7f6618009c20 comp rx=0 tx=0).stop 2024-09-11T00:21:51.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.437+0000 7f662d800700 1 -- 172.21.15.111:0/4017368565 shutdown_connections 2024-09-11T00:21:51.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.437+0000 7f662d800700 1 --2- 172.21.15.111:0/4017368565 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6628100d70 0x7f6628104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:51.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.437+0000 7f662d800700 1 --2- 172.21.15.111:0/4017368565 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66281003d0 0x7f66281007a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:51.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.437+0000 7f662d800700 1 -- 172.21.15.111:0/4017368565 >> 172.21.15.111:0/4017368565 conn(0x7f66280fbc90 msgr2=0x7f66280fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:51.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.437+0000 7f662d800700 1 -- 172.21.15.111:0/4017368565 shutdown_connections 2024-09-11T00:21:51.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.437+0000 7f662d800700 1 -- 172.21.15.111:0/4017368565 wait complete. 2024-09-11T00:21:51.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.438+0000 7f662d800700 1 Processor -- start 2024-09-11T00:21:51.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.438+0000 7f662d800700 1 -- start start 2024-09-11T00:21:51.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.438+0000 7f662d800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f66281003d0 0x7f6628195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:51.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.438+0000 7f662d800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6628100d70 0x7f66281962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:51.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.438+0000 7f662d800700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66281968f0 con 0x7f6628100d70 2024-09-11T00:21:51.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.438+0000 7f662d800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6628196a30 con 0x7f66281003d0 2024-09-11T00:21:51.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.439+0000 7f6626000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6628100d70 0x7f66281962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:51.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.439+0000 7f6626000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6628100d70 0x7f66281962a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48252/0 (socket says 172.21.15.111:48252) 2024-09-11T00:21:51.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.439+0000 7f6626000700 1 -- 172.21.15.111:0/3578152975 learned_addr learned my addr 172.21.15.111:0/3578152975 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:21:51.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.439+0000 7f6626a00700 1 --2- 172.21.15.111:0/3578152975 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f66281003d0 0x7f6628195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:51.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.439+0000 7f6626000700 1 -- 172.21.15.111:0/3578152975 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f66281003d0 msgr2=0x7f6628195d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:51.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.439+0000 7f6626000700 1 --2- 172.21.15.111:0/3578152975 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f66281003d0 0x7f6628195d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:51.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.439+0000 7f6626000700 1 -- 172.21.15.111:0/3578152975 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66180095f0 con 0x7f6628100d70 2024-09-11T00:21:51.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.439+0000 7f6626000700 1 --2- 172.21.15.111:0/3578152975 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6628100d70 0x7f66281962a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f661400c960 tx=0x7f661400cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:51.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.440+0000 7f661f400700 1 -- 172.21.15.111:0/3578152975 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6614007a70 con 0x7f6628100d70 2024-09-11T00:21:51.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.440+0000 7f661f400700 1 -- 172.21.15.111:0/3578152975 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6614007bd0 con 0x7f6628100d70 2024-09-11T00:21:51.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.440+0000 7f662d800700 1 -- 172.21.15.111:0/3578152975 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f662819a880 con 0x7f6628100d70 2024-09-11T00:21:51.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.440+0000 7f661f400700 1 -- 172.21.15.111:0/3578152975 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66140186c0 con 0x7f6628100d70 2024-09-11T00:21:51.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.440+0000 7f662d800700 1 -- 172.21.15.111:0/3578152975 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f662819add0 con 0x7f6628100d70 2024-09-11T00:21:51.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.441+0000 7f662d800700 1 -- 172.21.15.111:0/3578152975 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66281086e0 con 0x7f6628100d70 2024-09-11T00:21:51.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.443+0000 7f661f400700 1 -- 172.21.15.111:0/3578152975 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f661400faa0 con 0x7f6628100d70 2024-09-11T00:21:51.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.444+0000 7f661f400700 1 --2- 172.21.15.111:0/3578152975 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f660c07a6f0 0x7f660c07cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:51.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.444+0000 7f661f400700 1 -- 172.21.15.111:0/3578152975 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f661409d370 con 0x7f6628100d70 2024-09-11T00:21:51.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.444+0000 7f6626a00700 1 --2- 172.21.15.111:0/3578152975 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f660c07a6f0 0x7f660c07cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:51.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.444+0000 7f6626a00700 1 --2- 172.21.15.111:0/3578152975 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f660c07a6f0 0x7f660c07cba0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f661800b5c0 tx=0x7f661801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:51.450 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.448+0000 7f661f400700 1 -- 172.21.15.111:0/3578152975 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f6614064140 con 0x7f6628100d70 2024-09-11T00:21:51.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.716+0000 7f662d800700 1 -- 172.21.15.111:0/3578152975 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f662802ccd0 con 0x7f6628100d70 2024-09-11T00:21:51.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.717+0000 7f661f400700 1 -- 172.21.15.111:0/3578152975 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v33) v1 ==== 107+0+5038 (secure 0 0 0) 0x7f6614063ae0 con 0x7f6628100d70 2024-09-11T00:21:51.719 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:21:51.719 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":19,"btime":"2024-09-11T00:17:57:654946+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24379,"name":"cephfs.smithi203.uqkbkn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.203:6827/695613114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":695613114},{"type":"v1","addr":"172.21.15.203:6827","nonce":695613114}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34406,"name":"cephfs.smithi111.gmgsay","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6827/3970632147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3970632147},{"type":"v1","addr":"172.21.15.111:6827","nonce":3970632147}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34438,"name":"cephfs.smithi111.rucaba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/36584465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":36584465},{"type":"v1","addr":"172.21.15.111:6829","nonce":36584465}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:03:47.950356+0000","modified":"2024-09-11T00:04:06.275905+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24363":{"gid":24363,"name":"cephfs.smithi203.tcrqop","rank":0,"incarnation":11,"state":"up:active","state_seq":6,"addr":"172.21.15.203:6825/3082736449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3082736449},{"type":"v1","addr":"172.21.15.203:6825","nonce":3082736449}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-11T00:21:51.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.719+0000 7f662d800700 1 -- 172.21.15.111:0/3578152975 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f660c07a6f0 msgr2=0x7f660c07cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:51.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.719+0000 7f662d800700 1 --2- 172.21.15.111:0/3578152975 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f660c07a6f0 0x7f660c07cba0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f661800b5c0 tx=0x7f661801a040 comp rx=0 tx=0).stop 2024-09-11T00:21:51.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.719+0000 7f662d800700 1 -- 172.21.15.111:0/3578152975 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6628100d70 msgr2=0x7f66281962a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:51.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.719+0000 7f662d800700 1 --2- 172.21.15.111:0/3578152975 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6628100d70 0x7f66281962a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f661400c960 tx=0x7f661400cd20 comp rx=0 tx=0).stop 2024-09-11T00:21:51.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.720+0000 7f662d800700 1 -- 172.21.15.111:0/3578152975 shutdown_connections 2024-09-11T00:21:51.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.720+0000 7f662d800700 1 --2- 172.21.15.111:0/3578152975 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f660c07a6f0 0x7f660c07cba0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:51.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.720+0000 7f662d800700 1 --2- 172.21.15.111:0/3578152975 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f66281003d0 0x7f6628195d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:51.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.720+0000 7f662d800700 1 --2- 172.21.15.111:0/3578152975 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6628100d70 0x7f66281962a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:51.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.720+0000 7f662d800700 1 -- 172.21.15.111:0/3578152975 >> 172.21.15.111:0/3578152975 conn(0x7f66280fbc90 msgr2=0x7f66280fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:51.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.720+0000 7f662d800700 1 -- 172.21.15.111:0/3578152975 shutdown_connections 2024-09-11T00:21:51.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:51.720+0000 7f662d800700 1 -- 172.21.15.111:0/3578152975 wait complete. 2024-09-11T00:21:51.723 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 19 2024-09-11T00:21:52.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:51 smithi203 ceph-mon[69002]: pgmap v318: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:52.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:51 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/3578152975' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-09-11T00:21:52.048 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:51 smithi111 ceph-mon[90842]: pgmap v318: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:52.048 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:51 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/3578152975' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-09-11T00:21:52.379 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 20 2024-09-11T00:21:52.701 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:21:54.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:53 smithi111 ceph-mon[90842]: pgmap v319: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:54.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:53 smithi203 ceph-mon[69002]: pgmap v319: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:54.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.671+0000 7f1355000700 1 -- 172.21.15.111:0/527451178 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1350100d70 msgr2=0x7f1350104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:54.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.671+0000 7f1355000700 1 --2- 172.21.15.111:0/527451178 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1350100d70 0x7f1350104d40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f133c009910 tx=0x7f133c009c20 comp rx=0 tx=0).stop 2024-09-11T00:21:54.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.671+0000 7f1355000700 1 -- 172.21.15.111:0/527451178 shutdown_connections 2024-09-11T00:21:54.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.671+0000 7f1355000700 1 --2- 172.21.15.111:0/527451178 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1350100d70 0x7f1350104d40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:54.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.671+0000 7f1355000700 1 --2- 172.21.15.111:0/527451178 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f13501003d0 0x7f13501007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:54.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.671+0000 7f1355000700 1 -- 172.21.15.111:0/527451178 >> 172.21.15.111:0/527451178 conn(0x7f13500fbc90 msgr2=0x7f13500fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:54.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.671+0000 7f1355000700 1 -- 172.21.15.111:0/527451178 shutdown_connections 2024-09-11T00:21:54.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.671+0000 7f1355000700 1 -- 172.21.15.111:0/527451178 wait complete. 2024-09-11T00:21:54.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.672+0000 7f1355000700 1 Processor -- start 2024-09-11T00:21:54.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.672+0000 7f1355000700 1 -- start start 2024-09-11T00:21:54.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.672+0000 7f1355000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f13501003d0 0x7f1350195d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:54.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.672+0000 7f1355000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1350100d70 0x7f1350196280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:54.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.672+0000 7f1355000700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1350196960 con 0x7f1350100d70 2024-09-11T00:21:54.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.672+0000 7f1355000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135019a680 con 0x7f13501003d0 2024-09-11T00:21:54.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.673+0000 7f134d400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1350100d70 0x7f1350196280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:54.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.673+0000 7f134d400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1350100d70 0x7f1350196280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48260/0 (socket says 172.21.15.111:48260) 2024-09-11T00:21:54.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.673+0000 7f134d400700 1 -- 172.21.15.111:0/1634681494 learned_addr learned my addr 172.21.15.111:0/1634681494 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:21:54.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.673+0000 7f134de00700 1 --2- 172.21.15.111:0/1634681494 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f13501003d0 0x7f1350195d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:54.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.673+0000 7f134d400700 1 -- 172.21.15.111:0/1634681494 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f13501003d0 msgr2=0x7f1350195d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:54.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.673+0000 7f134d400700 1 --2- 172.21.15.111:0/1634681494 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f13501003d0 0x7f1350195d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:54.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.673+0000 7f134d400700 1 -- 172.21.15.111:0/1634681494 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133c0095f0 con 0x7f1350100d70 2024-09-11T00:21:54.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.673+0000 7f134d400700 1 --2- 172.21.15.111:0/1634681494 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1350100d70 0x7f1350196280 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f133c0092e0 tx=0x7f133c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:54.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.674+0000 7f1346a00700 1 -- 172.21.15.111:0/1634681494 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f133c01d070 con 0x7f1350100d70 2024-09-11T00:21:54.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.674+0000 7f1346a00700 1 -- 172.21.15.111:0/1634681494 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f133c005dc0 con 0x7f1350100d70 2024-09-11T00:21:54.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.674+0000 7f1355000700 1 -- 172.21.15.111:0/1634681494 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135019a900 con 0x7f1350100d70 2024-09-11T00:21:54.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.674+0000 7f1346a00700 1 -- 172.21.15.111:0/1634681494 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f133c017400 con 0x7f1350100d70 2024-09-11T00:21:54.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.674+0000 7f1355000700 1 -- 172.21.15.111:0/1634681494 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135019adf0 con 0x7f1350100d70 2024-09-11T00:21:54.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.675+0000 7f1355000700 1 -- 172.21.15.111:0/1634681494 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1350108740 con 0x7f1350100d70 2024-09-11T00:21:54.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.676+0000 7f1346a00700 1 -- 172.21.15.111:0/1634681494 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f133c00f6f0 con 0x7f1350100d70 2024-09-11T00:21:54.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.677+0000 7f1346a00700 1 --2- 172.21.15.111:0/1634681494 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f133407a6f0 0x7f133407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:54.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.677+0000 7f1346a00700 1 -- 172.21.15.111:0/1634681494 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f133c09e6b0 con 0x7f1350100d70 2024-09-11T00:21:54.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.677+0000 7f134de00700 1 --2- 172.21.15.111:0/1634681494 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f133407a6f0 0x7f133407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:54.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.678+0000 7f134de00700 1 --2- 172.21.15.111:0/1634681494 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f133407a6f0 0x7f133407cba0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1340005950 tx=0x7f134000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:54.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.682+0000 7f1346a00700 1 -- 172.21.15.111:0/1634681494 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f133c061d80 con 0x7f1350100d70 2024-09-11T00:21:54.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.952+0000 7f1355000700 1 -- 172.21.15.111:0/1634681494 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f135019b120 con 0x7f1350100d70 2024-09-11T00:21:54.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.953+0000 7f1346a00700 1 -- 172.21.15.111:0/1634681494 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v33) v1 ==== 107+0+4245 (secure 0 0 0) 0x7f133c064ea0 con 0x7f1350100d70 2024-09-11T00:21:54.955 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:21:54.955 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":20,"btime":"2024-09-11T00:18:13:238451+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24379,"name":"cephfs.smithi203.uqkbkn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.203:6827/695613114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":695613114},{"type":"v1","addr":"172.21.15.203:6827","nonce":695613114}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34406,"name":"cephfs.smithi111.gmgsay","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6827/3970632147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3970632147},{"type":"v1","addr":"172.21.15.111:6827","nonce":3970632147}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34438,"name":"cephfs.smithi111.rucaba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/36584465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":36584465},{"type":"v1","addr":"172.21.15.111:6829","nonce":36584465}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:03:47.950356+0000","modified":"2024-09-11T00:18:13.238080+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-11T00:21:54.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.956+0000 7f1355000700 1 -- 172.21.15.111:0/1634681494 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f133407a6f0 msgr2=0x7f133407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:54.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.956+0000 7f1355000700 1 --2- 172.21.15.111:0/1634681494 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f133407a6f0 0x7f133407cba0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1340005950 tx=0x7f134000b410 comp rx=0 tx=0).stop 2024-09-11T00:21:54.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.956+0000 7f1355000700 1 -- 172.21.15.111:0/1634681494 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1350100d70 msgr2=0x7f1350196280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:54.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.956+0000 7f1355000700 1 --2- 172.21.15.111:0/1634681494 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1350100d70 0x7f1350196280 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f133c0092e0 tx=0x7f133c00bd70 comp rx=0 tx=0).stop 2024-09-11T00:21:54.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.956+0000 7f1355000700 1 -- 172.21.15.111:0/1634681494 shutdown_connections 2024-09-11T00:21:54.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.956+0000 7f1355000700 1 --2- 172.21.15.111:0/1634681494 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f133407a6f0 0x7f133407cba0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:54.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.956+0000 7f1355000700 1 --2- 172.21.15.111:0/1634681494 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f13501003d0 0x7f1350195d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:54.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.956+0000 7f1355000700 1 --2- 172.21.15.111:0/1634681494 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1350100d70 0x7f1350196280 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:54.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.956+0000 7f1355000700 1 -- 172.21.15.111:0/1634681494 >> 172.21.15.111:0/1634681494 conn(0x7f13500fbc90 msgr2=0x7f13500fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:54.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.956+0000 7f1355000700 1 -- 172.21.15.111:0/1634681494 shutdown_connections 2024-09-11T00:21:54.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:54.956+0000 7f1355000700 1 -- 172.21.15.111:0/1634681494 wait complete. 2024-09-11T00:21:54.959 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 20 2024-09-11T00:21:55.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:55 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/1634681494' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-11T00:21:55.312 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:55 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/1634681494' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-11T00:21:55.608 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 21 2024-09-11T00:21:55.939 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:21:56.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:56 smithi111 ceph-mon[90842]: pgmap v320: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:56.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:56 smithi203 ceph-mon[69002]: pgmap v320: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:57.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.773+0000 7f5f07200700 1 -- 172.21.15.111:0/1017665952 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5f00100d70 msgr2=0x7f5f00104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:57.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.773+0000 7f5f07200700 1 --2- 172.21.15.111:0/1017665952 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5f00100d70 0x7f5f00104d40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5eec009910 tx=0x7f5eec009c20 comp rx=0 tx=0).stop 2024-09-11T00:21:57.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.774+0000 7f5f07200700 1 -- 172.21.15.111:0/1017665952 shutdown_connections 2024-09-11T00:21:57.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.774+0000 7f5f07200700 1 --2- 172.21.15.111:0/1017665952 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5f00100d70 0x7f5f00104d40 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:57.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.774+0000 7f5f07200700 1 --2- 172.21.15.111:0/1017665952 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f001003d0 0x7f5f001007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:57.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.774+0000 7f5f07200700 1 -- 172.21.15.111:0/1017665952 >> 172.21.15.111:0/1017665952 conn(0x7f5f000fbc90 msgr2=0x7f5f000fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:57.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.774+0000 7f5f07200700 1 -- 172.21.15.111:0/1017665952 shutdown_connections 2024-09-11T00:21:57.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.774+0000 7f5f07200700 1 -- 172.21.15.111:0/1017665952 wait complete. 2024-09-11T00:21:57.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.775+0000 7f5f07200700 1 Processor -- start 2024-09-11T00:21:57.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.775+0000 7f5f07200700 1 -- start start 2024-09-11T00:21:57.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.776+0000 7f5f07200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f001003d0 0x7f5f00073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:57.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.776+0000 7f5f07200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5f00100d70 0x7f5f00073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:57.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.776+0000 7f5f07200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f00073ad0 con 0x7f5f00100d70 2024-09-11T00:21:57.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.776+0000 7f5f07200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f00073c10 con 0x7f5f001003d0 2024-09-11T00:21:57.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.776+0000 7f5eff400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5f00100d70 0x7f5f00073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:57.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.776+0000 7f5eff400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5f00100d70 0x7f5f00073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48284/0 (socket says 172.21.15.111:48284) 2024-09-11T00:21:57.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.776+0000 7f5eff400700 1 -- 172.21.15.111:0/555420806 learned_addr learned my addr 172.21.15.111:0/555420806 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:21:57.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.776+0000 7f5effe00700 1 --2- 172.21.15.111:0/555420806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f001003d0 0x7f5f00073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:57.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.776+0000 7f5eff400700 1 -- 172.21.15.111:0/555420806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f001003d0 msgr2=0x7f5f00073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:57.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.776+0000 7f5eff400700 1 --2- 172.21.15.111:0/555420806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f001003d0 0x7f5f00073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:57.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.776+0000 7f5eff400700 1 -- 172.21.15.111:0/555420806 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eec0095f0 con 0x7f5f00100d70 2024-09-11T00:21:57.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.777+0000 7f5eff400700 1 --2- 172.21.15.111:0/555420806 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5f00100d70 0x7f5f00073590 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00bda0 tx=0x7f5eec00bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:57.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.777+0000 7f5efcc00700 1 -- 172.21.15.111:0/555420806 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5eec01d070 con 0x7f5f00100d70 2024-09-11T00:21:57.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.777+0000 7f5efcc00700 1 -- 172.21.15.111:0/555420806 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5eec005dc0 con 0x7f5f00100d70 2024-09-11T00:21:57.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.777+0000 7f5f07200700 1 -- 172.21.15.111:0/555420806 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f00073e90 con 0x7f5f00100d70 2024-09-11T00:21:57.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.777+0000 7f5efcc00700 1 -- 172.21.15.111:0/555420806 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5eec017400 con 0x7f5f00100d70 2024-09-11T00:21:57.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.777+0000 7f5f07200700 1 -- 172.21.15.111:0/555420806 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f001a2240 con 0x7f5f00100d70 2024-09-11T00:21:57.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.778+0000 7f5f07200700 1 -- 172.21.15.111:0/555420806 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f00108740 con 0x7f5f00100d70 2024-09-11T00:21:57.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.780+0000 7f5efcc00700 1 -- 172.21.15.111:0/555420806 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f5eec00f460 con 0x7f5f00100d70 2024-09-11T00:21:57.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.781+0000 7f5efcc00700 1 --2- 172.21.15.111:0/555420806 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f5ee407a6f0 0x7f5ee407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:57.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.781+0000 7f5efcc00700 1 -- 172.21.15.111:0/555420806 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f5eec09e670 con 0x7f5f00100d70 2024-09-11T00:21:57.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.781+0000 7f5effe00700 1 --2- 172.21.15.111:0/555420806 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f5ee407a6f0 0x7f5ee407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:57.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.782+0000 7f5effe00700 1 --2- 172.21.15.111:0/555420806 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f5ee407a6f0 0x7f5ee407cba0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0005950 tx=0x7f5ef000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:57.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:57.785+0000 7f5efcc00700 1 -- 172.21.15.111:0/555420806 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f5eec061d40 con 0x7f5f00100d70 2024-09-11T00:21:57.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:57 smithi111 ceph-mon[90842]: pgmap v321: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:58.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:58.051+0000 7f5f07200700 1 -- 172.21.15.111:0/555420806 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f5f0004ea50 con 0x7f5f00100d70 2024-09-11T00:21:58.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:58.052+0000 7f5efcc00700 1 -- 172.21.15.111:0/555420806 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v33) v1 ==== 107+0+4256 (secure 0 0 0) 0x7f5eec064e60 con 0x7f5f00100d70 2024-09-11T00:21:58.054 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:21:58.054 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":21,"btime":"2024-09-11T00:18:13:246206+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34406,"name":"cephfs.smithi111.gmgsay","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6827/3970632147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3970632147},{"type":"v1","addr":"172.21.15.111:6827","nonce":3970632147}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34438,"name":"cephfs.smithi111.rucaba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/36584465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":36584465},{"type":"v1","addr":"172.21.15.111:6829","nonce":36584465}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:03:47.950356+0000","modified":"2024-09-11T00:18:13.246187+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24379":{"gid":24379,"name":"cephfs.smithi203.uqkbkn","rank":0,"incarnation":21,"state":"up:replay","state_seq":2,"addr":"172.21.15.203:6827/695613114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":695613114},{"type":"v1","addr":"172.21.15.203:6827","nonce":695613114}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-11T00:21:58.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:58.054+0000 7f5f07200700 1 -- 172.21.15.111:0/555420806 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f5ee407a6f0 msgr2=0x7f5ee407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:58.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:58.054+0000 7f5f07200700 1 --2- 172.21.15.111:0/555420806 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f5ee407a6f0 0x7f5ee407cba0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0005950 tx=0x7f5ef000b410 comp rx=0 tx=0).stop 2024-09-11T00:21:58.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:58.054+0000 7f5f07200700 1 -- 172.21.15.111:0/555420806 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5f00100d70 msgr2=0x7f5f00073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:58.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:58.054+0000 7f5f07200700 1 --2- 172.21.15.111:0/555420806 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5f00100d70 0x7f5f00073590 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00bda0 tx=0x7f5eec00bdd0 comp rx=0 tx=0).stop 2024-09-11T00:21:58.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:58.054+0000 7f5f07200700 1 -- 172.21.15.111:0/555420806 shutdown_connections 2024-09-11T00:21:58.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:58.054+0000 7f5f07200700 1 --2- 172.21.15.111:0/555420806 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f5ee407a6f0 0x7f5ee407cba0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:58.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:58.054+0000 7f5f07200700 1 --2- 172.21.15.111:0/555420806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f001003d0 0x7f5f00073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:58.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:58.054+0000 7f5f07200700 1 --2- 172.21.15.111:0/555420806 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5f00100d70 0x7f5f00073590 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:58.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:58.054+0000 7f5f07200700 1 -- 172.21.15.111:0/555420806 >> 172.21.15.111:0/555420806 conn(0x7f5f000fbc90 msgr2=0x7f5f000fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:58.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:58.055+0000 7f5f07200700 1 -- 172.21.15.111:0/555420806 shutdown_connections 2024-09-11T00:21:58.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:21:58.055+0000 7f5f07200700 1 -- 172.21.15.111:0/555420806 wait complete. 2024-09-11T00:21:58.058 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 21 2024-09-11T00:21:58.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:57 smithi203 ceph-mon[69002]: pgmap v321: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:21:58.866 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 22 2024-09-11T00:21:59.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:58 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/555420806' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-11T00:21:59.190 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:21:59.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:58 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/555420806' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-11T00:22:00.073 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:21:59 smithi111 ceph-mon[90842]: pgmap v322: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:00.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:21:59 smithi203 ceph-mon[69002]: pgmap v322: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:00.878 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:00 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:22:01.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.012+0000 7f6a2f200700 1 -- 172.21.15.111:0/3673875875 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6a300ff1d0 msgr2=0x7f6a300ff5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:01.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.012+0000 7f6a2f200700 1 --2- 172.21.15.111:0/3673875875 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6a300ff1d0 0x7f6a300ff5a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6a20009910 tx=0x7f6a20009c20 comp rx=0 tx=0).stop 2024-09-11T00:22:01.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.012+0000 7f6a2f200700 1 -- 172.21.15.111:0/3673875875 shutdown_connections 2024-09-11T00:22:01.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.012+0000 7f6a2f200700 1 --2- 172.21.15.111:0/3673875875 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a300ffb70 0x7f6a30103a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:01.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.012+0000 7f6a2f200700 1 --2- 172.21.15.111:0/3673875875 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6a300ff1d0 0x7f6a300ff5a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:01.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.012+0000 7f6a2f200700 1 -- 172.21.15.111:0/3673875875 >> 172.21.15.111:0/3673875875 conn(0x7f6a30074d00 msgr2=0x7f6a30075100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:01.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.012+0000 7f6a2f200700 1 -- 172.21.15.111:0/3673875875 shutdown_connections 2024-09-11T00:22:01.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.012+0000 7f6a2f200700 1 -- 172.21.15.111:0/3673875875 wait complete. 2024-09-11T00:22:01.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.013+0000 7f6a2f200700 1 Processor -- start 2024-09-11T00:22:01.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.013+0000 7f6a2f200700 1 -- start start 2024-09-11T00:22:01.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.013+0000 7f6a2f200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6a300ff1d0 0x7f6a30197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:01.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.013+0000 7f6a2f200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a300ffb70 0x7f6a301983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:01.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.013+0000 7f6a2f200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a30198a80 con 0x7f6a300ff1d0 2024-09-11T00:22:01.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.013+0000 7f6a2f200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3019c810 con 0x7f6a300ffb70 2024-09-11T00:22:01.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.014+0000 7f6a2de00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6a300ff1d0 0x7f6a30197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:01.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.014+0000 7f6a2de00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6a300ff1d0 0x7f6a30197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44948/0 (socket says 172.21.15.111:44948) 2024-09-11T00:22:01.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.014+0000 7f6a2de00700 1 -- 172.21.15.111:0/1932423450 learned_addr learned my addr 172.21.15.111:0/1932423450 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:22:01.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.014+0000 7f6a2d400700 1 --2- 172.21.15.111:0/1932423450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a300ffb70 0x7f6a301983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:01.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.014+0000 7f6a2de00700 1 -- 172.21.15.111:0/1932423450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a300ffb70 msgr2=0x7f6a301983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:01.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.014+0000 7f6a2de00700 1 --2- 172.21.15.111:0/1932423450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a300ffb70 0x7f6a301983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:01.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.014+0000 7f6a2de00700 1 -- 172.21.15.111:0/1932423450 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a200095f0 con 0x7f6a300ff1d0 2024-09-11T00:22:01.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.015+0000 7f6a2de00700 1 --2- 172.21.15.111:0/1932423450 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6a300ff1d0 0x7f6a30197e60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6a200092e0 tx=0x7f6a2000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:01.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.015+0000 7f6a26a00700 1 -- 172.21.15.111:0/1932423450 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a2001d070 con 0x7f6a300ff1d0 2024-09-11T00:22:01.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.015+0000 7f6a2f200700 1 -- 172.21.15.111:0/1932423450 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a3019ca90 con 0x7f6a300ff1d0 2024-09-11T00:22:01.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.015+0000 7f6a26a00700 1 -- 172.21.15.111:0/1932423450 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6a200052a0 con 0x7f6a300ff1d0 2024-09-11T00:22:01.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.015+0000 7f6a26a00700 1 -- 172.21.15.111:0/1932423450 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a20017400 con 0x7f6a300ff1d0 2024-09-11T00:22:01.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.015+0000 7f6a2f200700 1 -- 172.21.15.111:0/1932423450 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a3019cf80 con 0x7f6a300ff1d0 2024-09-11T00:22:01.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.016+0000 7f6a2f200700 1 -- 172.21.15.111:0/1932423450 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a3004f2a0 con 0x7f6a300ff1d0 2024-09-11T00:22:01.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.018+0000 7f6a26a00700 1 -- 172.21.15.111:0/1932423450 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f6a2000f820 con 0x7f6a300ff1d0 2024-09-11T00:22:01.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.019+0000 7f6a26a00700 1 --2- 172.21.15.111:0/1932423450 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f6a1407a6f0 0x7f6a1407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:01.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.020+0000 7f6a26a00700 1 -- 172.21.15.111:0/1932423450 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f6a2009e7c0 con 0x7f6a300ff1d0 2024-09-11T00:22:01.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.020+0000 7f6a2d400700 1 --2- 172.21.15.111:0/1932423450 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f6a1407a6f0 0x7f6a1407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:01.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.021+0000 7f6a2d400700 1 --2- 172.21.15.111:0/1932423450 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f6a1407a6f0 0x7f6a1407cba0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6a30199480 tx=0x7f6a1c009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:01.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.023+0000 7f6a26a00700 1 -- 172.21.15.111:0/1932423450 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f6a20061e90 con 0x7f6a300ff1d0 2024-09-11T00:22:01.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:00 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:22:01.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.302+0000 7f6a2f200700 1 -- 172.21.15.111:0/1932423450 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f6a301991c0 con 0x7f6a300ff1d0 2024-09-11T00:22:01.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.302+0000 7f6a26a00700 1 -- 172.21.15.111:0/1932423450 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v33) v1 ==== 107+0+4261 (secure 0 0 0) 0x7f6a20064fb0 con 0x7f6a300ff1d0 2024-09-11T00:22:01.305 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:22:01.305 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":22,"btime":"2024-09-11T00:18:22:728138+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34406,"name":"cephfs.smithi111.gmgsay","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6827/3970632147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3970632147},{"type":"v1","addr":"172.21.15.111:6827","nonce":3970632147}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34438,"name":"cephfs.smithi111.rucaba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/36584465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":36584465},{"type":"v1","addr":"172.21.15.111:6829","nonce":36584465}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:03:47.950356+0000","modified":"2024-09-11T00:18:22.453450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24379":{"gid":24379,"name":"cephfs.smithi203.uqkbkn","rank":0,"incarnation":21,"state":"up:reconnect","state_seq":216,"addr":"172.21.15.203:6827/695613114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":695613114},{"type":"v1","addr":"172.21.15.203:6827","nonce":695613114}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-11T00:22:01.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.305+0000 7f6a2f200700 1 -- 172.21.15.111:0/1932423450 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f6a1407a6f0 msgr2=0x7f6a1407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:01.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.305+0000 7f6a2f200700 1 --2- 172.21.15.111:0/1932423450 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f6a1407a6f0 0x7f6a1407cba0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6a30199480 tx=0x7f6a1c009260 comp rx=0 tx=0).stop 2024-09-11T00:22:01.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.305+0000 7f6a2f200700 1 -- 172.21.15.111:0/1932423450 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6a300ff1d0 msgr2=0x7f6a30197e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:01.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.305+0000 7f6a2f200700 1 --2- 172.21.15.111:0/1932423450 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6a300ff1d0 0x7f6a30197e60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6a200092e0 tx=0x7f6a2000b6c0 comp rx=0 tx=0).stop 2024-09-11T00:22:01.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.305+0000 7f6a2f200700 1 -- 172.21.15.111:0/1932423450 shutdown_connections 2024-09-11T00:22:01.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.305+0000 7f6a2f200700 1 --2- 172.21.15.111:0/1932423450 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f6a1407a6f0 0x7f6a1407cba0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:01.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.305+0000 7f6a2f200700 1 --2- 172.21.15.111:0/1932423450 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6a300ff1d0 0x7f6a30197e60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:01.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.305+0000 7f6a2f200700 1 --2- 172.21.15.111:0/1932423450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a300ffb70 0x7f6a301983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:01.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.305+0000 7f6a2f200700 1 -- 172.21.15.111:0/1932423450 >> 172.21.15.111:0/1932423450 conn(0x7f6a30074d00 msgr2=0x7f6a30068c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:01.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.306+0000 7f6a2f200700 1 -- 172.21.15.111:0/1932423450 shutdown_connections 2024-09-11T00:22:01.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:01.306+0000 7f6a2f200700 1 -- 172.21.15.111:0/1932423450 wait complete. 2024-09-11T00:22:01.309 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 22 2024-09-11T00:22:01.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:01 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/1932423450' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-11T00:22:01.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:01 smithi111 ceph-mon[90842]: pgmap v323: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:02.024 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 23 2024-09-11T00:22:02.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:01 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/1932423450' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-11T00:22:02.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:01 smithi203 ceph-mon[69002]: pgmap v323: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:02.347 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:22:04.118 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:03 smithi111 ceph-mon[90842]: pgmap v324: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:04.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.148+0000 7f532be00700 1 -- 172.21.15.111:0/2662092129 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f532c102450 msgr2=0x7f532c102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:04.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.148+0000 7f532be00700 1 --2- 172.21.15.111:0/2662092129 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f532c102450 0x7f532c102820 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f531c009910 tx=0x7f531c009c20 comp rx=0 tx=0).stop 2024-09-11T00:22:04.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.148+0000 7f532be00700 1 -- 172.21.15.111:0/2662092129 shutdown_connections 2024-09-11T00:22:04.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.148+0000 7f532be00700 1 --2- 172.21.15.111:0/2662092129 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f532c102df0 0x7f532c106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:04.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.148+0000 7f532be00700 1 --2- 172.21.15.111:0/2662092129 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f532c102450 0x7f532c102820 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:04.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.148+0000 7f532be00700 1 -- 172.21.15.111:0/2662092129 >> 172.21.15.111:0/2662092129 conn(0x7f532c0fdd30 msgr2=0x7f532c100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:04.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.148+0000 7f532be00700 1 -- 172.21.15.111:0/2662092129 shutdown_connections 2024-09-11T00:22:04.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.148+0000 7f532be00700 1 -- 172.21.15.111:0/2662092129 wait complete. 2024-09-11T00:22:04.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.149+0000 7f532be00700 1 Processor -- start 2024-09-11T00:22:04.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.149+0000 7f532be00700 1 -- start start 2024-09-11T00:22:04.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.150+0000 7f532be00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f532c102450 0x7f532c197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:04.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.150+0000 7f532be00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f532c102df0 0x7f532c1982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:04.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.150+0000 7f532be00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532c1989a0 con 0x7f532c102df0 2024-09-11T00:22:04.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.150+0000 7f532be00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532c19c730 con 0x7f532c102450 2024-09-11T00:22:04.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.150+0000 7f5323e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f532c102df0 0x7f532c1982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:04.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.150+0000 7f5323e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f532c102df0 0x7f532c1982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44968/0 (socket says 172.21.15.111:44968) 2024-09-11T00:22:04.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.150+0000 7f5323e00700 1 -- 172.21.15.111:0/3771457616 learned_addr learned my addr 172.21.15.111:0/3771457616 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:22:04.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.150+0000 7f532aa00700 1 --2- 172.21.15.111:0/3771457616 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f532c102450 0x7f532c197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:04.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.151+0000 7f5323e00700 1 -- 172.21.15.111:0/3771457616 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f532c102450 msgr2=0x7f532c197d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:04.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.151+0000 7f5323e00700 1 --2- 172.21.15.111:0/3771457616 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f532c102450 0x7f532c197d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:04.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.151+0000 7f5323e00700 1 -- 172.21.15.111:0/3771457616 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c0095f0 con 0x7f532c102df0 2024-09-11T00:22:04.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.151+0000 7f5323e00700 1 --2- 172.21.15.111:0/3771457616 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f532c102df0 0x7f532c1982c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f531400d900 tx=0x7f531400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:04.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.151+0000 7f5323400700 1 -- 172.21.15.111:0/3771457616 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5314009900 con 0x7f532c102df0 2024-09-11T00:22:04.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.151+0000 7f5323400700 1 -- 172.21.15.111:0/3771457616 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5314010460 con 0x7f532c102df0 2024-09-11T00:22:04.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.151+0000 7f532be00700 1 -- 172.21.15.111:0/3771457616 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f532c19ca10 con 0x7f532c102df0 2024-09-11T00:22:04.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.151+0000 7f5323400700 1 -- 172.21.15.111:0/3771457616 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f531400f5f0 con 0x7f532c102df0 2024-09-11T00:22:04.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.151+0000 7f532be00700 1 -- 172.21.15.111:0/3771457616 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f532c19cf60 con 0x7f532c102df0 2024-09-11T00:22:04.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.152+0000 7f532be00700 1 -- 172.21.15.111:0/3771457616 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f532c10a760 con 0x7f532c102df0 2024-09-11T00:22:04.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.153+0000 7f5323400700 1 -- 172.21.15.111:0/3771457616 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f53140105d0 con 0x7f532c102df0 2024-09-11T00:22:04.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.154+0000 7f5323400700 1 --2- 172.21.15.111:0/3771457616 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f531007a6f0 0x7f531007cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:04.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.155+0000 7f5323400700 1 -- 172.21.15.111:0/3771457616 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f531409d1f0 con 0x7f532c102df0 2024-09-11T00:22:04.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.155+0000 7f532aa00700 1 --2- 172.21.15.111:0/3771457616 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f531007a6f0 0x7f531007cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:04.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.155+0000 7f532aa00700 1 --2- 172.21.15.111:0/3771457616 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f531007a6f0 0x7f531007cba0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f531c00b5c0 tx=0x7f531c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:04.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.159+0000 7f5323400700 1 -- 172.21.15.111:0/3771457616 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f5314060840 con 0x7f532c102df0 2024-09-11T00:22:04.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:03 smithi203 ceph-mon[69002]: pgmap v324: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:04.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.425+0000 7f532be00700 1 -- 172.21.15.111:0/3771457616 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f532c04f2a0 con 0x7f532c102df0 2024-09-11T00:22:04.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.426+0000 7f5323400700 1 -- 172.21.15.111:0/3771457616 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v33) v1 ==== 107+0+4258 (secure 0 0 0) 0x7f5314069e60 con 0x7f532c102df0 2024-09-11T00:22:04.427 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:22:04.427 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":23,"btime":"2024-09-11T00:18:23:734929+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34406,"name":"cephfs.smithi111.gmgsay","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6827/3970632147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3970632147},{"type":"v1","addr":"172.21.15.111:6827","nonce":3970632147}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34438,"name":"cephfs.smithi111.rucaba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/36584465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":36584465},{"type":"v1","addr":"172.21.15.111:6829","nonce":36584465}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:03:47.950356+0000","modified":"2024-09-11T00:18:22.736889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24379":{"gid":24379,"name":"cephfs.smithi203.uqkbkn","rank":0,"incarnation":21,"state":"up:rejoin","state_seq":217,"addr":"172.21.15.203:6827/695613114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":695613114},{"type":"v1","addr":"172.21.15.203:6827","nonce":695613114}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-11T00:22:04.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.428+0000 7f532be00700 1 -- 172.21.15.111:0/3771457616 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f531007a6f0 msgr2=0x7f531007cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:04.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.428+0000 7f532be00700 1 --2- 172.21.15.111:0/3771457616 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f531007a6f0 0x7f531007cba0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f531c00b5c0 tx=0x7f531c01a040 comp rx=0 tx=0).stop 2024-09-11T00:22:04.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.428+0000 7f532be00700 1 -- 172.21.15.111:0/3771457616 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f532c102df0 msgr2=0x7f532c1982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:04.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.428+0000 7f532be00700 1 --2- 172.21.15.111:0/3771457616 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f532c102df0 0x7f532c1982c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f531400d900 tx=0x7f531400dcc0 comp rx=0 tx=0).stop 2024-09-11T00:22:04.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.429+0000 7f532be00700 1 -- 172.21.15.111:0/3771457616 shutdown_connections 2024-09-11T00:22:04.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.429+0000 7f532be00700 1 --2- 172.21.15.111:0/3771457616 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f531007a6f0 0x7f531007cba0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:04.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.429+0000 7f532be00700 1 --2- 172.21.15.111:0/3771457616 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f532c102450 0x7f532c197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:04.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.429+0000 7f532be00700 1 --2- 172.21.15.111:0/3771457616 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f532c102df0 0x7f532c1982c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:04.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.429+0000 7f532be00700 1 -- 172.21.15.111:0/3771457616 >> 172.21.15.111:0/3771457616 conn(0x7f532c0fdd30 msgr2=0x7f532c100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:04.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.429+0000 7f532be00700 1 -- 172.21.15.111:0/3771457616 shutdown_connections 2024-09-11T00:22:04.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:04.429+0000 7f532be00700 1 -- 172.21.15.111:0/3771457616 wait complete. 2024-09-11T00:22:04.431 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 23 2024-09-11T00:22:05.073 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:04 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/3771457616' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-11T00:22:05.104 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 24 2024-09-11T00:22:05.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:04 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/3771457616' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-11T00:22:05.426 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:22:06.092 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:05 smithi111 ceph-mon[90842]: pgmap v325: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:06.205 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:05 smithi203 ceph-mon[69002]: pgmap v325: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:07.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.184+0000 7fa3b6600700 1 -- 172.21.15.111:0/2235012694 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa3b0101330 msgr2=0x7fa3b0101700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:07.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.184+0000 7fa3b6600700 1 --2- 172.21.15.111:0/2235012694 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa3b0101330 0x7fa3b0101700 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0009940 tx=0x7fa3a0009c50 comp rx=0 tx=0).stop 2024-09-11T00:22:07.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.184+0000 7fa3b6600700 1 -- 172.21.15.111:0/2235012694 shutdown_connections 2024-09-11T00:22:07.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.184+0000 7fa3b6600700 1 --2- 172.21.15.111:0/2235012694 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa3b0101c40 0x7fa3b010a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:07.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.184+0000 7fa3b6600700 1 --2- 172.21.15.111:0/2235012694 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa3b0101330 0x7fa3b0101700 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:07.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.184+0000 7fa3b6600700 1 -- 172.21.15.111:0/2235012694 >> 172.21.15.111:0/2235012694 conn(0x7fa3b00fabb0 msgr2=0x7fa3b00fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:07.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.184+0000 7fa3b6600700 1 -- 172.21.15.111:0/2235012694 shutdown_connections 2024-09-11T00:22:07.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.184+0000 7fa3b6600700 1 -- 172.21.15.111:0/2235012694 wait complete. 2024-09-11T00:22:07.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.185+0000 7fa3b6600700 1 Processor -- start 2024-09-11T00:22:07.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.185+0000 7fa3b6600700 1 -- start start 2024-09-11T00:22:07.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.185+0000 7fa3b6600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa3b0101330 0x7fa3b0197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:07.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.185+0000 7fa3b6600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa3b0101c40 0x7fa3b0198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:07.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.185+0000 7fa3b6600700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b0198b20 con 0x7fa3b0101330 2024-09-11T00:22:07.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.185+0000 7fa3b6600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b019c8b0 con 0x7fa3b0101c40 2024-09-11T00:22:07.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.186+0000 7fa3af400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa3b0101330 0x7fa3b0197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:07.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.186+0000 7fa3af400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa3b0101330 0x7fa3b0197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44988/0 (socket says 172.21.15.111:44988) 2024-09-11T00:22:07.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.186+0000 7fa3af400700 1 -- 172.21.15.111:0/914354249 learned_addr learned my addr 172.21.15.111:0/914354249 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:22:07.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.186+0000 7fa3a6a00700 1 --2- 172.21.15.111:0/914354249 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa3b0101c40 0x7fa3b0198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:07.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.186+0000 7fa3af400700 1 -- 172.21.15.111:0/914354249 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa3b0101c40 msgr2=0x7fa3b0198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:07.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.186+0000 7fa3af400700 1 --2- 172.21.15.111:0/914354249 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa3b0101c40 0x7fa3b0198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:07.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.186+0000 7fa3af400700 1 -- 172.21.15.111:0/914354249 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a00095f0 con 0x7fa3b0101330 2024-09-11T00:22:07.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.186+0000 7fa3a6a00700 1 --2- 172.21.15.111:0/914354249 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa3b0101c40 0x7fa3b0198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:22:07.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.187+0000 7fa3af400700 1 --2- 172.21.15.111:0/914354249 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa3b0101330 0x7fa3b0197f00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00055f0 tx=0x7fa3a00056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:07.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.187+0000 7fa3acc00700 1 -- 172.21.15.111:0/914354249 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3a001d070 con 0x7fa3b0101330 2024-09-11T00:22:07.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.187+0000 7fa3acc00700 1 -- 172.21.15.111:0/914354249 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa3a000f460 con 0x7fa3b0101330 2024-09-11T00:22:07.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.187+0000 7fa3b6600700 1 -- 172.21.15.111:0/914354249 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b019cb30 con 0x7fa3b0101330 2024-09-11T00:22:07.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.187+0000 7fa3acc00700 1 -- 172.21.15.111:0/914354249 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3a0021640 con 0x7fa3b0101330 2024-09-11T00:22:07.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.187+0000 7fa3b6600700 1 -- 172.21.15.111:0/914354249 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b019d020 con 0x7fa3b0101330 2024-09-11T00:22:07.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.188+0000 7fa3b6600700 1 -- 172.21.15.111:0/914354249 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b0109c10 con 0x7fa3b0101330 2024-09-11T00:22:07.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.189+0000 7fa3acc00700 1 -- 172.21.15.111:0/914354249 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fa3a000fa20 con 0x7fa3b0101330 2024-09-11T00:22:07.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.190+0000 7fa3acc00700 1 --2- 172.21.15.111:0/914354249 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa39407a6f0 0x7fa39407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:07.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.190+0000 7fa3acc00700 1 -- 172.21.15.111:0/914354249 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa3a009e660 con 0x7fa3b0101330 2024-09-11T00:22:07.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.190+0000 7fa3a6a00700 1 --2- 172.21.15.111:0/914354249 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa39407a6f0 0x7fa39407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:07.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.191+0000 7fa3a6a00700 1 --2- 172.21.15.111:0/914354249 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa39407a6f0 0x7fa39407cba0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa398005950 tx=0x7fa3980058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:07.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.194+0000 7fa3acc00700 1 -- 172.21.15.111:0/914354249 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fa3a0061cb0 con 0x7fa3b0101330 2024-09-11T00:22:07.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.460+0000 7fa3b6600700 1 -- 172.21.15.111:0/914354249 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7fa3b01095f0 con 0x7fa3b0101330 2024-09-11T00:22:07.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.461+0000 7fa3acc00700 1 -- 172.21.15.111:0/914354249 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v33) v1 ==== 107+0+4267 (secure 0 0 0) 0x7fa3a0064dd0 con 0x7fa3b0101330 2024-09-11T00:22:07.462 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:22:07.462 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":24,"btime":"2024-09-11T00:18:24:740929+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34406,"name":"cephfs.smithi111.gmgsay","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6827/3970632147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3970632147},{"type":"v1","addr":"172.21.15.111:6827","nonce":3970632147}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34438,"name":"cephfs.smithi111.rucaba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/36584465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":36584465},{"type":"v1","addr":"172.21.15.111:6829","nonce":36584465}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:03:47.950356+0000","modified":"2024-09-11T00:18:24.740925+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24379":{"gid":24379,"name":"cephfs.smithi203.uqkbkn","rank":0,"incarnation":21,"state":"up:active","state_seq":218,"addr":"172.21.15.203:6827/695613114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":695613114},{"type":"v1","addr":"172.21.15.203:6827","nonce":695613114}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24379,"qdb_cluster":[24379]},"id":1}]} 2024-09-11T00:22:07.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.463+0000 7fa3b6600700 1 -- 172.21.15.111:0/914354249 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa39407a6f0 msgr2=0x7fa39407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:07.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.463+0000 7fa3b6600700 1 --2- 172.21.15.111:0/914354249 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa39407a6f0 0x7fa39407cba0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa398005950 tx=0x7fa3980058e0 comp rx=0 tx=0).stop 2024-09-11T00:22:07.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.463+0000 7fa3b6600700 1 -- 172.21.15.111:0/914354249 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa3b0101330 msgr2=0x7fa3b0197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:07.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.463+0000 7fa3b6600700 1 --2- 172.21.15.111:0/914354249 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa3b0101330 0x7fa3b0197f00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00055f0 tx=0x7fa3a00056d0 comp rx=0 tx=0).stop 2024-09-11T00:22:07.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.463+0000 7fa3b6600700 1 -- 172.21.15.111:0/914354249 shutdown_connections 2024-09-11T00:22:07.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.463+0000 7fa3b6600700 1 --2- 172.21.15.111:0/914354249 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fa39407a6f0 0x7fa39407cba0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:07.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.463+0000 7fa3b6600700 1 --2- 172.21.15.111:0/914354249 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa3b0101330 0x7fa3b0197f00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:07.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.463+0000 7fa3b6600700 1 --2- 172.21.15.111:0/914354249 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa3b0101c40 0x7fa3b0198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:07.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.463+0000 7fa3b6600700 1 -- 172.21.15.111:0/914354249 >> 172.21.15.111:0/914354249 conn(0x7fa3b00fabb0 msgr2=0x7fa3b0106d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:07.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.464+0000 7fa3b6600700 1 -- 172.21.15.111:0/914354249 shutdown_connections 2024-09-11T00:22:07.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:07.464+0000 7fa3b6600700 1 -- 172.21.15.111:0/914354249 wait complete. 2024-09-11T00:22:07.465 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 24 2024-09-11T00:22:07.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:07 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/914354249' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-11T00:22:07.805 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:07 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/914354249' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-11T00:22:08.134 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 25 2024-09-11T00:22:08.453 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:22:08.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:08 smithi203 ceph-mon[69002]: pgmap v326: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:08.839 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:08 smithi111 ceph-mon[90842]: pgmap v326: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:10.103 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:09 smithi111 ceph-mon[90842]: pgmap v327: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:10.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:09 smithi203 ceph-mon[69002]: pgmap v327: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:10.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.502+0000 7fbeb7c00700 1 -- 172.21.15.111:0/1023004324 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbeb00730f0 msgr2=0x7fbeb00734c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:10.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.502+0000 7fbeb7c00700 1 --2- 172.21.15.111:0/1023004324 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbeb00730f0 0x7fbeb00734c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbea4009910 tx=0x7fbea4009c20 comp rx=0 tx=0).stop 2024-09-11T00:22:10.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.502+0000 7fbeb7c00700 1 -- 172.21.15.111:0/1023004324 shutdown_connections 2024-09-11T00:22:10.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.503+0000 7fbeb7c00700 1 --2- 172.21.15.111:0/1023004324 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbeb0073a00 0x7fbeb0110c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.503+0000 7fbeb7c00700 1 --2- 172.21.15.111:0/1023004324 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbeb00730f0 0x7fbeb00734c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.503+0000 7fbeb7c00700 1 -- 172.21.15.111:0/1023004324 >> 172.21.15.111:0/1023004324 conn(0x7fbeb00fbc30 msgr2=0x7fbeb00fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:10.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.503+0000 7fbeb7c00700 1 -- 172.21.15.111:0/1023004324 shutdown_connections 2024-09-11T00:22:10.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.503+0000 7fbeb7c00700 1 -- 172.21.15.111:0/1023004324 wait complete. 2024-09-11T00:22:10.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.504+0000 7fbeb7c00700 1 Processor -- start 2024-09-11T00:22:10.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.504+0000 7fbeb7c00700 1 -- start start 2024-09-11T00:22:10.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.504+0000 7fbeb7c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbeb00730f0 0x7fbeb019c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:10.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.504+0000 7fbeb7c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbeb0073a00 0x7fbeb019c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:10.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.504+0000 7fbeb7c00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb019cea0 con 0x7fbeb0073a00 2024-09-11T00:22:10.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.504+0000 7fbeb7c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb01a0c30 con 0x7fbeb00730f0 2024-09-11T00:22:10.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.505+0000 7fbeafe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbeb0073a00 0x7fbeb019c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:10.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.505+0000 7fbeafe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbeb0073a00 0x7fbeb019c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:35382/0 (socket says 172.21.15.111:35382) 2024-09-11T00:22:10.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.505+0000 7fbeafe00700 1 -- 172.21.15.111:0/567918492 learned_addr learned my addr 172.21.15.111:0/567918492 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:22:10.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.505+0000 7fbeb5200700 1 --2- 172.21.15.111:0/567918492 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbeb00730f0 0x7fbeb019c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:10.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.505+0000 7fbeafe00700 1 -- 172.21.15.111:0/567918492 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbeb00730f0 msgr2=0x7fbeb019c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:10.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.505+0000 7fbeafe00700 1 --2- 172.21.15.111:0/567918492 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbeb00730f0 0x7fbeb019c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.505+0000 7fbeafe00700 1 -- 172.21.15.111:0/567918492 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea40095f0 con 0x7fbeb0073a00 2024-09-11T00:22:10.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.505+0000 7fbeafe00700 1 --2- 172.21.15.111:0/567918492 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbeb0073a00 0x7fbeb019c7c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c00d8d0 tx=0x7fbe9c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:10.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.506+0000 7fbead600700 1 -- 172.21.15.111:0/567918492 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe9c0098a0 con 0x7fbeb0073a00 2024-09-11T00:22:10.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.506+0000 7fbeb7c00700 1 -- 172.21.15.111:0/567918492 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeb01a0f10 con 0x7fbeb0073a00 2024-09-11T00:22:10.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.506+0000 7fbead600700 1 -- 172.21.15.111:0/567918492 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbe9c010460 con 0x7fbeb0073a00 2024-09-11T00:22:10.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.506+0000 7fbead600700 1 -- 172.21.15.111:0/567918492 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe9c00f5f0 con 0x7fbeb0073a00 2024-09-11T00:22:10.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.506+0000 7fbeb7c00700 1 -- 172.21.15.111:0/567918492 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeb01a1460 con 0x7fbeb0073a00 2024-09-11T00:22:10.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.507+0000 7fbeb7c00700 1 -- 172.21.15.111:0/567918492 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeb010e3a0 con 0x7fbeb0073a00 2024-09-11T00:22:10.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.508+0000 7fbead600700 1 -- 172.21.15.111:0/567918492 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fbe9c009a00 con 0x7fbeb0073a00 2024-09-11T00:22:10.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.509+0000 7fbead600700 1 --2- 172.21.15.111:0/567918492 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fbe9807a6f0 0x7fbe9807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:10.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.509+0000 7fbead600700 1 -- 172.21.15.111:0/567918492 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fbe9c09d240 con 0x7fbeb0073a00 2024-09-11T00:22:10.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.510+0000 7fbeb5200700 1 --2- 172.21.15.111:0/567918492 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fbe9807a6f0 0x7fbe9807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:10.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.510+0000 7fbeb5200700 1 --2- 172.21.15.111:0/567918492 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fbe9807a6f0 0x7fbe9807cba0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbea4006010 tx=0x7fbea401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:10.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.514+0000 7fbead600700 1 -- 172.21.15.111:0/567918492 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fbe9c060890 con 0x7fbeb0073a00 2024-09-11T00:22:10.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.783+0000 7fbeb7c00700 1 -- 172.21.15.111:0/567918492 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7fbeb01a1680 con 0x7fbeb0073a00 2024-09-11T00:22:10.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.784+0000 7fbead600700 1 -- 172.21.15.111:0/567918492 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v33) v1 ==== 107+0+5117 (secure 0 0 0) 0x7fbe9c0639b0 con 0x7fbeb0073a00 2024-09-11T00:22:10.785 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:22:10.785 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":25,"btime":"2024-09-11T00:18:28:716031+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34406,"name":"cephfs.smithi111.gmgsay","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6827/3970632147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3970632147},{"type":"v1","addr":"172.21.15.111:6827","nonce":3970632147}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34438,"name":"cephfs.smithi111.rucaba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/36584465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":36584465},{"type":"v1","addr":"172.21.15.111:6829","nonce":36584465}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44379,"name":"cephfs.smithi203.tcrqop","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6825/4221647525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4221647525},{"type":"v1","addr":"172.21.15.203:6825","nonce":4221647525}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:03:47.950356+0000","modified":"2024-09-11T00:18:24.740925+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24379":{"gid":24379,"name":"cephfs.smithi203.uqkbkn","rank":0,"incarnation":21,"state":"up:active","state_seq":218,"addr":"172.21.15.203:6827/695613114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":695613114},{"type":"v1","addr":"172.21.15.203:6827","nonce":695613114}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24379,"qdb_cluster":[24379]},"id":1}]} 2024-09-11T00:22:10.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.786+0000 7fbeb7c00700 1 -- 172.21.15.111:0/567918492 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fbe9807a6f0 msgr2=0x7fbe9807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:10.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.786+0000 7fbeb7c00700 1 --2- 172.21.15.111:0/567918492 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fbe9807a6f0 0x7fbe9807cba0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbea4006010 tx=0x7fbea401a040 comp rx=0 tx=0).stop 2024-09-11T00:22:10.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.787+0000 7fbeb7c00700 1 -- 172.21.15.111:0/567918492 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbeb0073a00 msgr2=0x7fbeb019c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:10.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.787+0000 7fbeb7c00700 1 --2- 172.21.15.111:0/567918492 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbeb0073a00 0x7fbeb019c7c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c00d8d0 tx=0x7fbe9c00dbe0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.787+0000 7fbeb7c00700 1 -- 172.21.15.111:0/567918492 shutdown_connections 2024-09-11T00:22:10.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.787+0000 7fbeb7c00700 1 --2- 172.21.15.111:0/567918492 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fbe9807a6f0 0x7fbe9807cba0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.787+0000 7fbeb7c00700 1 --2- 172.21.15.111:0/567918492 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbeb00730f0 0x7fbeb019c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.787+0000 7fbeb7c00700 1 --2- 172.21.15.111:0/567918492 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbeb0073a00 0x7fbeb019c7c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.787+0000 7fbeb7c00700 1 -- 172.21.15.111:0/567918492 >> 172.21.15.111:0/567918492 conn(0x7fbeb00fbc30 msgr2=0x7fbeb0102730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:10.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.787+0000 7fbeb7c00700 1 -- 172.21.15.111:0/567918492 shutdown_connections 2024-09-11T00:22:10.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:10.787+0000 7fbeb7c00700 1 -- 172.21.15.111:0/567918492 wait complete. 2024-09-11T00:22:10.789 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 25 2024-09-11T00:22:11.095 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:10 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/567918492' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-11T00:22:11.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:10 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/567918492' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-11T00:22:11.474 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 26 2024-09-11T00:22:11.810 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:22:11.993 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:11 smithi111 ceph-mon[90842]: pgmap v328: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:12.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:11 smithi203 ceph-mon[69002]: pgmap v328: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:13.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.723+0000 7fe979800700 1 -- 172.21.15.111:0/4004641018 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe974100ba0 msgr2=0x7fe974104b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:13.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.723+0000 7fe979800700 1 --2- 172.21.15.111:0/4004641018 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe974100ba0 0x7fe974104b70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe960009910 tx=0x7fe960009c20 comp rx=0 tx=0).stop 2024-09-11T00:22:13.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.723+0000 7fe979800700 1 -- 172.21.15.111:0/4004641018 shutdown_connections 2024-09-11T00:22:13.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.723+0000 7fe979800700 1 --2- 172.21.15.111:0/4004641018 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe974100ba0 0x7fe974104b70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.723+0000 7fe979800700 1 --2- 172.21.15.111:0/4004641018 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe974100200 0x7fe9741005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.723+0000 7fe979800700 1 -- 172.21.15.111:0/4004641018 >> 172.21.15.111:0/4004641018 conn(0x7fe9740fba80 msgr2=0x7fe9740fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:13.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.723+0000 7fe979800700 1 -- 172.21.15.111:0/4004641018 shutdown_connections 2024-09-11T00:22:13.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.723+0000 7fe979800700 1 -- 172.21.15.111:0/4004641018 wait complete. 2024-09-11T00:22:13.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.724+0000 7fe979800700 1 Processor -- start 2024-09-11T00:22:13.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.725+0000 7fe979800700 1 -- start start 2024-09-11T00:22:13.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.725+0000 7fe979800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe974100200 0x7fe974197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:13.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.725+0000 7fe979800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe974100ba0 0x7fe974198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:13.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.725+0000 7fe979800700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe974198a00 con 0x7fe974100ba0 2024-09-11T00:22:13.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.725+0000 7fe979800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97419c790 con 0x7fe974100200 2024-09-11T00:22:13.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.725+0000 7fe973400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe974100ba0 0x7fe974198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:13.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.725+0000 7fe973400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe974100ba0 0x7fe974198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:35400/0 (socket says 172.21.15.111:35400) 2024-09-11T00:22:13.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.725+0000 7fe973400700 1 -- 172.21.15.111:0/1366858921 learned_addr learned my addr 172.21.15.111:0/1366858921 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:22:13.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.725+0000 7fe973e00700 1 --2- 172.21.15.111:0/1366858921 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe974100200 0x7fe974197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:13.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.726+0000 7fe973400700 1 -- 172.21.15.111:0/1366858921 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe974100200 msgr2=0x7fe974197de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:13.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.726+0000 7fe973400700 1 --2- 172.21.15.111:0/1366858921 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe974100200 0x7fe974197de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.726+0000 7fe973400700 1 -- 172.21.15.111:0/1366858921 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9600095f0 con 0x7fe974100ba0 2024-09-11T00:22:13.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.726+0000 7fe973400700 1 --2- 172.21.15.111:0/1366858921 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe974100ba0 0x7fe974198320 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe96000bda0 tx=0x7fe96000bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:13.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.726+0000 7fe970c00700 1 -- 172.21.15.111:0/1366858921 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe96001d070 con 0x7fe974100ba0 2024-09-11T00:22:13.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.726+0000 7fe970c00700 1 -- 172.21.15.111:0/1366858921 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe960005dc0 con 0x7fe974100ba0 2024-09-11T00:22:13.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.726+0000 7fe979800700 1 -- 172.21.15.111:0/1366858921 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe97419ca10 con 0x7fe974100ba0 2024-09-11T00:22:13.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.726+0000 7fe970c00700 1 -- 172.21.15.111:0/1366858921 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe960017400 con 0x7fe974100ba0 2024-09-11T00:22:13.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.726+0000 7fe979800700 1 -- 172.21.15.111:0/1366858921 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe97419cf00 con 0x7fe974100ba0 2024-09-11T00:22:13.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.728+0000 7fe979800700 1 -- 172.21.15.111:0/1366858921 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe97404f2a0 con 0x7fe974100ba0 2024-09-11T00:22:13.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.729+0000 7fe970c00700 1 -- 172.21.15.111:0/1366858921 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fe960003a60 con 0x7fe974100ba0 2024-09-11T00:22:13.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.730+0000 7fe970c00700 1 --2- 172.21.15.111:0/1366858921 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe95807a6f0 0x7fe95807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:13.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.730+0000 7fe970c00700 1 -- 172.21.15.111:0/1366858921 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fe96009e760 con 0x7fe974100ba0 2024-09-11T00:22:13.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.730+0000 7fe973e00700 1 --2- 172.21.15.111:0/1366858921 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe95807a6f0 0x7fe95807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:13.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.731+0000 7fe973e00700 1 --2- 172.21.15.111:0/1366858921 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe95807a6f0 0x7fe95807cba0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe964005950 tx=0x7fe96400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:13.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:13.734+0000 7fe970c00700 1 -- 172.21.15.111:0/1366858921 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fe960061db0 con 0x7fe974100ba0 2024-09-11T00:22:13.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:13 smithi111 ceph-mon[90842]: pgmap v329: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:14.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:14.004+0000 7fe979800700 1 -- 172.21.15.111:0/1366858921 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7fe974199140 con 0x7fe974100ba0 2024-09-11T00:22:14.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:14.005+0000 7fe970c00700 1 -- 172.21.15.111:0/1366858921 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v33) v1 ==== 107+0+4316 (secure 0 0 0) 0x7fe96005fe60 con 0x7fe974100ba0 2024-09-11T00:22:14.007 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:22:14.007 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":26,"btime":"2024-09-11T00:18:42:027357+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34406,"name":"cephfs.smithi111.gmgsay","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6827/3970632147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3970632147},{"type":"v1","addr":"172.21.15.111:6827","nonce":3970632147}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34438,"name":"cephfs.smithi111.rucaba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/36584465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":36584465},{"type":"v1","addr":"172.21.15.111:6829","nonce":36584465}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44379,"name":"cephfs.smithi203.tcrqop","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6825/4221647525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4221647525},{"type":"v1","addr":"172.21.15.203:6825","nonce":4221647525}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:03:47.950356+0000","modified":"2024-09-11T00:18:42.027355+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-11T00:22:14.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:14.007+0000 7fe979800700 1 -- 172.21.15.111:0/1366858921 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe95807a6f0 msgr2=0x7fe95807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:14.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:14.007+0000 7fe979800700 1 --2- 172.21.15.111:0/1366858921 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe95807a6f0 0x7fe95807cba0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe964005950 tx=0x7fe96400b410 comp rx=0 tx=0).stop 2024-09-11T00:22:14.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:14.007+0000 7fe979800700 1 -- 172.21.15.111:0/1366858921 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe974100ba0 msgr2=0x7fe974198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:14.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:14.007+0000 7fe979800700 1 --2- 172.21.15.111:0/1366858921 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe974100ba0 0x7fe974198320 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe96000bda0 tx=0x7fe96000bdd0 comp rx=0 tx=0).stop 2024-09-11T00:22:14.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:14.008+0000 7fe979800700 1 -- 172.21.15.111:0/1366858921 shutdown_connections 2024-09-11T00:22:14.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:14.008+0000 7fe979800700 1 --2- 172.21.15.111:0/1366858921 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fe95807a6f0 0x7fe95807cba0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:14.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:14.008+0000 7fe979800700 1 --2- 172.21.15.111:0/1366858921 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe974100200 0x7fe974197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:14.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:14.008+0000 7fe979800700 1 --2- 172.21.15.111:0/1366858921 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe974100ba0 0x7fe974198320 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:14.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:14.008+0000 7fe979800700 1 -- 172.21.15.111:0/1366858921 >> 172.21.15.111:0/1366858921 conn(0x7fe9740fba80 msgr2=0x7fe9740fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:14.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:14.008+0000 7fe979800700 1 -- 172.21.15.111:0/1366858921 shutdown_connections 2024-09-11T00:22:14.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:14.008+0000 7fe979800700 1 -- 172.21.15.111:0/1366858921 wait complete. 2024-09-11T00:22:14.011 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 26 2024-09-11T00:22:14.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:13 smithi203 ceph-mon[69002]: pgmap v329: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:14.732 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 27 2024-09-11T00:22:15.060 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:22:15.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:14 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/1366858921' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-11T00:22:15.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:14 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/1366858921' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-11T00:22:15.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:15 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:22:15.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:15 smithi111 ceph-mon[90842]: pgmap v330: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:16.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:15 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:22:16.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:15 smithi203 ceph-mon[69002]: pgmap v330: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:16.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.864+0000 7f69f8200700 1 -- 172.21.15.111:0/2321698895 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69f0075280 msgr2=0x7f69f0075650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:16.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.864+0000 7f69f8200700 1 --2- 172.21.15.111:0/2321698895 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69f0075280 0x7f69f0075650 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f69e4009910 tx=0x7f69e4009c20 comp rx=0 tx=0).stop 2024-09-11T00:22:16.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.864+0000 7f69f8200700 1 -- 172.21.15.111:0/2321698895 shutdown_connections 2024-09-11T00:22:16.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.864+0000 7f69f8200700 1 --2- 172.21.15.111:0/2321698895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f69f0075b90 0x7f69f0110b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.864+0000 7f69f8200700 1 --2- 172.21.15.111:0/2321698895 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69f0075280 0x7f69f0075650 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.864+0000 7f69f8200700 1 -- 172.21.15.111:0/2321698895 >> 172.21.15.111:0/2321698895 conn(0x7f69f00fde90 msgr2=0x7f69f01002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:16.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.864+0000 7f69f8200700 1 -- 172.21.15.111:0/2321698895 shutdown_connections 2024-09-11T00:22:16.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.864+0000 7f69f8200700 1 -- 172.21.15.111:0/2321698895 wait complete. 2024-09-11T00:22:16.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.865+0000 7f69f8200700 1 Processor -- start 2024-09-11T00:22:16.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.865+0000 7f69f8200700 1 -- start start 2024-09-11T00:22:16.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.865+0000 7f69f8200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f69f0075280 0x7f69f019c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:16.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.865+0000 7f69f8200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69f0075b90 0x7f69f019c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:16.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.865+0000 7f69f8200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f019cfc0 con 0x7f69f0075b90 2024-09-11T00:22:16.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.866+0000 7f69f8200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f01a0d50 con 0x7f69f0075280 2024-09-11T00:22:16.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.866+0000 7f69f4e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69f0075b90 0x7f69f019c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:16.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.866+0000 7f69f4e00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69f0075b90 0x7f69f019c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:35410/0 (socket says 172.21.15.111:35410) 2024-09-11T00:22:16.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.866+0000 7f69f4e00700 1 -- 172.21.15.111:0/4151718586 learned_addr learned my addr 172.21.15.111:0/4151718586 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:22:16.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.866+0000 7f69f5800700 1 --2- 172.21.15.111:0/4151718586 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f69f0075280 0x7f69f019c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:16.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.866+0000 7f69f4e00700 1 -- 172.21.15.111:0/4151718586 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f69f0075280 msgr2=0x7f69f019c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:16.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.866+0000 7f69f4e00700 1 --2- 172.21.15.111:0/4151718586 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f69f0075280 0x7f69f019c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.866+0000 7f69f4e00700 1 -- 172.21.15.111:0/4151718586 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e40095f0 con 0x7f69f0075b90 2024-09-11T00:22:16.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.867+0000 7f69f4e00700 1 --2- 172.21.15.111:0/4151718586 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69f0075b90 0x7f69f019c8e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f69dc00d8d0 tx=0x7f69dc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:16.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.867+0000 7f69ee000700 1 -- 172.21.15.111:0/4151718586 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69dc0098a0 con 0x7f69f0075b90 2024-09-11T00:22:16.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.867+0000 7f69ee000700 1 -- 172.21.15.111:0/4151718586 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f69dc010460 con 0x7f69f0075b90 2024-09-11T00:22:16.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.867+0000 7f69f8200700 1 -- 172.21.15.111:0/4151718586 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f01a1030 con 0x7f69f0075b90 2024-09-11T00:22:16.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.867+0000 7f69ee000700 1 -- 172.21.15.111:0/4151718586 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69dc00f5f0 con 0x7f69f0075b90 2024-09-11T00:22:16.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.867+0000 7f69f8200700 1 -- 172.21.15.111:0/4151718586 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f01a1580 con 0x7f69f0075b90 2024-09-11T00:22:16.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.868+0000 7f69f8200700 1 -- 172.21.15.111:0/4151718586 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f010e280 con 0x7f69f0075b90 2024-09-11T00:22:16.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.869+0000 7f69ee000700 1 -- 172.21.15.111:0/4151718586 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f69dc009a00 con 0x7f69f0075b90 2024-09-11T00:22:16.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.870+0000 7f69ee000700 1 --2- 172.21.15.111:0/4151718586 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f69d807a6f0 0x7f69d807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:16.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.870+0000 7f69ee000700 1 -- 172.21.15.111:0/4151718586 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f69dc09d180 con 0x7f69f0075b90 2024-09-11T00:22:16.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.870+0000 7f69f5800700 1 --2- 172.21.15.111:0/4151718586 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f69d807a6f0 0x7f69d807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:16.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.871+0000 7f69f5800700 1 --2- 172.21.15.111:0/4151718586 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f69d807a6f0 0x7f69d807cba0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f69e400b850 tx=0x7f69e400b580 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:16.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:16.874+0000 7f69ee000700 1 -- 172.21.15.111:0/4151718586 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f69dc060850 con 0x7f69f0075b90 2024-09-11T00:22:17.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:17.142+0000 7f69f8200700 1 -- 172.21.15.111:0/4151718586 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f69f01a17f0 con 0x7f69f0075b90 2024-09-11T00:22:17.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:17.142+0000 7f69ee000700 1 -- 172.21.15.111:0/4151718586 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v33) v1 ==== 107+0+4395 (secure 0 0 0) 0x7f69dc063970 con 0x7f69f0075b90 2024-09-11T00:22:17.145 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:22:17.145 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":27,"btime":"2024-09-11T00:18:42:033119+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34438,"name":"cephfs.smithi111.rucaba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/36584465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":36584465},{"type":"v1","addr":"172.21.15.111:6829","nonce":36584465}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44379,"name":"cephfs.smithi203.tcrqop","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6825/4221647525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4221647525},{"type":"v1","addr":"172.21.15.203:6825","nonce":4221647525}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:03:47.950356+0000","modified":"2024-09-11T00:18:42.033097+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34406":{"gid":34406,"name":"cephfs.smithi111.gmgsay","rank":0,"incarnation":27,"state":"up:replay","state_seq":1,"addr":"172.21.15.111:6827/3970632147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3970632147},{"type":"v1","addr":"172.21.15.111:6827","nonce":3970632147}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-11T00:22:17.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:17.145+0000 7f69f8200700 1 -- 172.21.15.111:0/4151718586 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f69d807a6f0 msgr2=0x7f69d807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:17.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:17.145+0000 7f69f8200700 1 --2- 172.21.15.111:0/4151718586 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f69d807a6f0 0x7f69d807cba0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f69e400b850 tx=0x7f69e400b580 comp rx=0 tx=0).stop 2024-09-11T00:22:17.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:17.145+0000 7f69f8200700 1 -- 172.21.15.111:0/4151718586 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69f0075b90 msgr2=0x7f69f019c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:17.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:17.145+0000 7f69f8200700 1 --2- 172.21.15.111:0/4151718586 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69f0075b90 0x7f69f019c8e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f69dc00d8d0 tx=0x7f69dc00dbe0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:17.145+0000 7f69f8200700 1 -- 172.21.15.111:0/4151718586 shutdown_connections 2024-09-11T00:22:17.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:17.145+0000 7f69f8200700 1 --2- 172.21.15.111:0/4151718586 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f69d807a6f0 0x7f69d807cba0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:17.145+0000 7f69f8200700 1 --2- 172.21.15.111:0/4151718586 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f69f0075280 0x7f69f019c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:17.145+0000 7f69f8200700 1 --2- 172.21.15.111:0/4151718586 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69f0075b90 0x7f69f019c8e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:17.145+0000 7f69f8200700 1 -- 172.21.15.111:0/4151718586 >> 172.21.15.111:0/4151718586 conn(0x7f69f00fde90 msgr2=0x7f69f00feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:17.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:17.145+0000 7f69f8200700 1 -- 172.21.15.111:0/4151718586 shutdown_connections 2024-09-11T00:22:17.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:17.145+0000 7f69f8200700 1 -- 172.21.15.111:0/4151718586 wait complete. 2024-09-11T00:22:17.148 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 27 2024-09-11T00:22:17.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:17 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/4151718586' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-11T00:22:17.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:17 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/4151718586' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-11T00:22:17.836 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 28 2024-09-11T00:22:18.157 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:22:18.525 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:18 smithi111 ceph-mon[90842]: pgmap v331: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:18.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:18 smithi203 ceph-mon[69002]: pgmap v331: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:19.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.806+0000 7f9e27000700 1 -- 172.21.15.111:0/3217814065 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e20100bb0 msgr2=0x7f9e20104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:19.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.806+0000 7f9e27000700 1 --2- 172.21.15.111:0/3217814065 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e20100bb0 0x7f9e20104b80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c009910 tx=0x7f9e0c009c20 comp rx=0 tx=0).stop 2024-09-11T00:22:19.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.807+0000 7f9e27000700 1 -- 172.21.15.111:0/3217814065 shutdown_connections 2024-09-11T00:22:19.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.807+0000 7f9e27000700 1 --2- 172.21.15.111:0/3217814065 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e20100bb0 0x7f9e20104b80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:19.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.807+0000 7f9e27000700 1 --2- 172.21.15.111:0/3217814065 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e20100210 0x7f9e201005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:19.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.807+0000 7f9e27000700 1 -- 172.21.15.111:0/3217814065 >> 172.21.15.111:0/3217814065 conn(0x7f9e200fbab0 msgr2=0x7f9e200fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:19.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.807+0000 7f9e27000700 1 -- 172.21.15.111:0/3217814065 shutdown_connections 2024-09-11T00:22:19.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.807+0000 7f9e27000700 1 -- 172.21.15.111:0/3217814065 wait complete. 2024-09-11T00:22:19.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.808+0000 7f9e27000700 1 Processor -- start 2024-09-11T00:22:19.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.808+0000 7f9e27000700 1 -- start start 2024-09-11T00:22:19.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.808+0000 7f9e27000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e20100210 0x7f9e2019b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:19.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.808+0000 7f9e27000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e20100bb0 0x7f9e2019bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:19.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.808+0000 7f9e27000700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2019c5c0 con 0x7f9e20100210 2024-09-11T00:22:19.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.808+0000 7f9e27000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e20195a70 con 0x7f9e20100bb0 2024-09-11T00:22:19.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.809+0000 7f9e25c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e20100210 0x7f9e2019b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:19.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.809+0000 7f9e25c00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e20100210 0x7f9e2019b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42848/0 (socket says 172.21.15.111:42848) 2024-09-11T00:22:19.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.809+0000 7f9e25c00700 1 -- 172.21.15.111:0/174415674 learned_addr learned my addr 172.21.15.111:0/174415674 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:22:19.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.809+0000 7f9e25200700 1 --2- 172.21.15.111:0/174415674 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e20100bb0 0x7f9e2019bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:19.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.809+0000 7f9e25c00700 1 -- 172.21.15.111:0/174415674 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e20100bb0 msgr2=0x7f9e2019bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:19.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.809+0000 7f9e25c00700 1 --2- 172.21.15.111:0/174415674 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e20100bb0 0x7f9e2019bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:19.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.809+0000 7f9e25c00700 1 -- 172.21.15.111:0/174415674 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c0095f0 con 0x7f9e20100210 2024-09-11T00:22:19.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.809+0000 7f9e25200700 1 --2- 172.21.15.111:0/174415674 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e20100bb0 0x7f9e2019bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:22:19.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.809+0000 7f9e25c00700 1 --2- 172.21.15.111:0/174415674 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e20100210 0x7f9e2019b9f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9e1400d8d0 tx=0x7f9e1400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:19.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.810+0000 7f9e1e000700 1 -- 172.21.15.111:0/174415674 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e14009940 con 0x7f9e20100210 2024-09-11T00:22:19.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.810+0000 7f9e1e000700 1 -- 172.21.15.111:0/174415674 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e14010460 con 0x7f9e20100210 2024-09-11T00:22:19.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.810+0000 7f9e1e000700 1 -- 172.21.15.111:0/174415674 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e1400f5f0 con 0x7f9e20100210 2024-09-11T00:22:19.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.810+0000 7f9e27000700 1 -- 172.21.15.111:0/174415674 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e20195d50 con 0x7f9e20100210 2024-09-11T00:22:19.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.810+0000 7f9e27000700 1 -- 172.21.15.111:0/174415674 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e201962a0 con 0x7f9e20100210 2024-09-11T00:22:19.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.811+0000 7f9e27000700 1 -- 172.21.15.111:0/174415674 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e20108580 con 0x7f9e20100210 2024-09-11T00:22:19.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.812+0000 7f9e1e000700 1 -- 172.21.15.111:0/174415674 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f9e140105d0 con 0x7f9e20100210 2024-09-11T00:22:19.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.814+0000 7f9e1e000700 1 --2- 172.21.15.111:0/174415674 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f9e0807a6f0 0x7f9e0807cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:19.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.814+0000 7f9e1e000700 1 -- 172.21.15.111:0/174415674 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f9e1409d2c0 con 0x7f9e20100210 2024-09-11T00:22:19.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.814+0000 7f9e25200700 1 --2- 172.21.15.111:0/174415674 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f9e0807a6f0 0x7f9e0807cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:19.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.815+0000 7f9e25200700 1 --2- 172.21.15.111:0/174415674 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f9e0807a6f0 0x7f9e0807cba0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9e200fc220 tx=0x7f9e0c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:19.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:19.818+0000 7f9e1e000700 1 -- 172.21.15.111:0/174415674 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f9e14060990 con 0x7f9e20100210 2024-09-11T00:22:20.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:20.098+0000 7f9e27000700 1 -- 172.21.15.111:0/174415674 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f9e20196510 con 0x7f9e20100210 2024-09-11T00:22:20.101 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:19 smithi111 ceph-mon[90842]: pgmap v332: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:20.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:20.098+0000 7f9e1e000700 1 -- 172.21.15.111:0/174415674 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v33) v1 ==== 107+0+4399 (secure 0 0 0) 0x7f9e14063ab0 con 0x7f9e20100210 2024-09-11T00:22:20.101 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:22:20.101 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":28,"btime":"2024-09-11T00:18:49:722902+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34438,"name":"cephfs.smithi111.rucaba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/36584465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":36584465},{"type":"v1","addr":"172.21.15.111:6829","nonce":36584465}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44379,"name":"cephfs.smithi203.tcrqop","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6825/4221647525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4221647525},{"type":"v1","addr":"172.21.15.203:6825","nonce":4221647525}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:03:47.950356+0000","modified":"2024-09-11T00:18:49.668172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34406":{"gid":34406,"name":"cephfs.smithi111.gmgsay","rank":0,"incarnation":27,"state":"up:reconnect","state_seq":20,"addr":"172.21.15.111:6827/3970632147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3970632147},{"type":"v1","addr":"172.21.15.111:6827","nonce":3970632147}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-11T00:22:20.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:20.102+0000 7f9e27000700 1 -- 172.21.15.111:0/174415674 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f9e0807a6f0 msgr2=0x7f9e0807cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:20.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:20.102+0000 7f9e27000700 1 --2- 172.21.15.111:0/174415674 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f9e0807a6f0 0x7f9e0807cba0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9e200fc220 tx=0x7f9e0c01a040 comp rx=0 tx=0).stop 2024-09-11T00:22:20.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:20.102+0000 7f9e27000700 1 -- 172.21.15.111:0/174415674 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e20100210 msgr2=0x7f9e2019b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:20.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:20.102+0000 7f9e27000700 1 --2- 172.21.15.111:0/174415674 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e20100210 0x7f9e2019b9f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9e1400d8d0 tx=0x7f9e1400dc90 comp rx=0 tx=0).stop 2024-09-11T00:22:20.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:20.102+0000 7f9e27000700 1 -- 172.21.15.111:0/174415674 shutdown_connections 2024-09-11T00:22:20.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:20.102+0000 7f9e27000700 1 --2- 172.21.15.111:0/174415674 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f9e0807a6f0 0x7f9e0807cba0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:20.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:20.102+0000 7f9e27000700 1 --2- 172.21.15.111:0/174415674 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e20100210 0x7f9e2019b9f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:20.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:20.102+0000 7f9e27000700 1 --2- 172.21.15.111:0/174415674 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e20100bb0 0x7f9e2019bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:20.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:20.102+0000 7f9e27000700 1 -- 172.21.15.111:0/174415674 >> 172.21.15.111:0/174415674 conn(0x7f9e200fbab0 msgr2=0x7f9e200fd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:20.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:20.102+0000 7f9e27000700 1 -- 172.21.15.111:0/174415674 shutdown_connections 2024-09-11T00:22:20.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:20.102+0000 7f9e27000700 1 -- 172.21.15.111:0/174415674 wait complete. 2024-09-11T00:22:20.105 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 28 2024-09-11T00:22:20.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:19 smithi203 ceph-mon[69002]: pgmap v332: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:21.011 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 29 2024-09-11T00:22:21.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:20 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/174415674' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-11T00:22:21.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:20 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/174415674' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-11T00:22:21.333 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:22:22.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:21 smithi111 ceph-mon[90842]: pgmap v333: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:22.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:21 smithi203 ceph-mon[69002]: pgmap v333: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:23.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.197+0000 7f72c5a00700 1 -- 172.21.15.111:0/3104758524 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f72c01025d0 msgr2=0x7f72c01029a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:23.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.197+0000 7f72c5a00700 1 --2- 172.21.15.111:0/3104758524 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f72c01025d0 0x7f72c01029a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009910 tx=0x7f72b0009c20 comp rx=0 tx=0).stop 2024-09-11T00:22:23.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.197+0000 7f72c5a00700 1 -- 172.21.15.111:0/3104758524 shutdown_connections 2024-09-11T00:22:23.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.197+0000 7f72c5a00700 1 --2- 172.21.15.111:0/3104758524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72c0102f70 0x7f72c0106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:23.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.197+0000 7f72c5a00700 1 --2- 172.21.15.111:0/3104758524 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f72c01025d0 0x7f72c01029a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:23.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.197+0000 7f72c5a00700 1 -- 172.21.15.111:0/3104758524 >> 172.21.15.111:0/3104758524 conn(0x7f72c00fde50 msgr2=0x7f72c0100260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:23.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.198+0000 7f72c5a00700 1 -- 172.21.15.111:0/3104758524 shutdown_connections 2024-09-11T00:22:23.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.198+0000 7f72c5a00700 1 -- 172.21.15.111:0/3104758524 wait complete. 2024-09-11T00:22:23.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.199+0000 7f72c5a00700 1 Processor -- start 2024-09-11T00:22:23.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.199+0000 7f72c5a00700 1 -- start start 2024-09-11T00:22:23.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.199+0000 7f72c5a00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f72c01025d0 0x7f72c0198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:23.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.199+0000 7f72c5a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72c0102f70 0x7f72c01985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:23.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.199+0000 7f72c5a00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c0198c80 con 0x7f72c01025d0 2024-09-11T00:22:23.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.199+0000 7f72c5a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c019ca10 con 0x7f72c0102f70 2024-09-11T00:22:23.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.199+0000 7f72bea00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f72c01025d0 0x7f72c0198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:23.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.200+0000 7f72bea00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f72c01025d0 0x7f72c0198060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42860/0 (socket says 172.21.15.111:42860) 2024-09-11T00:22:23.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.200+0000 7f72bea00700 1 -- 172.21.15.111:0/139720404 learned_addr learned my addr 172.21.15.111:0/139720404 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:22:23.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.200+0000 7f72b7e00700 1 --2- 172.21.15.111:0/139720404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72c0102f70 0x7f72c01985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:23.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.200+0000 7f72bea00700 1 -- 172.21.15.111:0/139720404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72c0102f70 msgr2=0x7f72c01985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:23.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.200+0000 7f72bea00700 1 --2- 172.21.15.111:0/139720404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72c0102f70 0x7f72c01985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:23.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.200+0000 7f72bea00700 1 -- 172.21.15.111:0/139720404 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b00095f0 con 0x7f72c01025d0 2024-09-11T00:22:23.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.200+0000 7f72b7e00700 1 --2- 172.21.15.111:0/139720404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72c0102f70 0x7f72c01985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:22:23.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.200+0000 7f72bea00700 1 --2- 172.21.15.111:0/139720404 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f72c01025d0 0x7f72c0198060 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f72b000b5c0 tx=0x7f72b000be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:23.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.200+0000 7f72b7400700 1 -- 172.21.15.111:0/139720404 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72b001d070 con 0x7f72c01025d0 2024-09-11T00:22:23.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.201+0000 7f72b7400700 1 -- 172.21.15.111:0/139720404 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f72b000f460 con 0x7f72c01025d0 2024-09-11T00:22:23.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.201+0000 7f72c5a00700 1 -- 172.21.15.111:0/139720404 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c019cc90 con 0x7f72c01025d0 2024-09-11T00:22:23.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.201+0000 7f72b7400700 1 -- 172.21.15.111:0/139720404 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72b0017610 con 0x7f72c01025d0 2024-09-11T00:22:23.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.201+0000 7f72c5a00700 1 -- 172.21.15.111:0/139720404 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c019d180 con 0x7f72c01025d0 2024-09-11T00:22:23.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.202+0000 7f72c5a00700 1 -- 172.21.15.111:0/139720404 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c010a8e0 con 0x7f72c01025d0 2024-09-11T00:22:23.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.203+0000 7f72b7400700 1 -- 172.21.15.111:0/139720404 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f72b000f5d0 con 0x7f72c01025d0 2024-09-11T00:22:23.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.204+0000 7f72b7400700 1 --2- 172.21.15.111:0/139720404 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f72a407a6f0 0x7f72a407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:23.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.204+0000 7f72b7400700 1 -- 172.21.15.111:0/139720404 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f72b009e8f0 con 0x7f72c01025d0 2024-09-11T00:22:23.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.204+0000 7f72b7e00700 1 --2- 172.21.15.111:0/139720404 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f72a407a6f0 0x7f72a407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:23.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.205+0000 7f72b7e00700 1 --2- 172.21.15.111:0/139720404 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f72a407a6f0 0x7f72a407cba0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f72c0199680 tx=0x7f72a8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:23.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.208+0000 7f72b7400700 1 -- 172.21.15.111:0/139720404 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f72b0061fc0 con 0x7f72c01025d0 2024-09-11T00:22:23.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.473+0000 7f72c5a00700 1 -- 172.21.15.111:0/139720404 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f72c004ea50 con 0x7f72c01025d0 2024-09-11T00:22:23.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.474+0000 7f72b7400700 1 -- 172.21.15.111:0/139720404 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v33) v1 ==== 107+0+4396 (secure 0 0 0) 0x7f72b00650e0 con 0x7f72c01025d0 2024-09-11T00:22:23.476 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:22:23.476 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":29,"btime":"2024-09-11T00:18:50:728279+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34438,"name":"cephfs.smithi111.rucaba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/36584465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":36584465},{"type":"v1","addr":"172.21.15.111:6829","nonce":36584465}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44379,"name":"cephfs.smithi203.tcrqop","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6825/4221647525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4221647525},{"type":"v1","addr":"172.21.15.203:6825","nonce":4221647525}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:03:47.950356+0000","modified":"2024-09-11T00:18:49.730780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34406":{"gid":34406,"name":"cephfs.smithi111.gmgsay","rank":0,"incarnation":27,"state":"up:rejoin","state_seq":21,"addr":"172.21.15.111:6827/3970632147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3970632147},{"type":"v1","addr":"172.21.15.111:6827","nonce":3970632147}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-11T00:22:23.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.476+0000 7f72c5a00700 1 -- 172.21.15.111:0/139720404 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f72a407a6f0 msgr2=0x7f72a407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:23.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.476+0000 7f72c5a00700 1 --2- 172.21.15.111:0/139720404 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f72a407a6f0 0x7f72a407cba0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f72c0199680 tx=0x7f72a8008040 comp rx=0 tx=0).stop 2024-09-11T00:22:23.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.477+0000 7f72c5a00700 1 -- 172.21.15.111:0/139720404 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f72c01025d0 msgr2=0x7f72c0198060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:23.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.477+0000 7f72c5a00700 1 --2- 172.21.15.111:0/139720404 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f72c01025d0 0x7f72c0198060 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f72b000b5c0 tx=0x7f72b000be00 comp rx=0 tx=0).stop 2024-09-11T00:22:23.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.477+0000 7f72c5a00700 1 -- 172.21.15.111:0/139720404 shutdown_connections 2024-09-11T00:22:23.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.477+0000 7f72c5a00700 1 --2- 172.21.15.111:0/139720404 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f72a407a6f0 0x7f72a407cba0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:23.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.477+0000 7f72c5a00700 1 --2- 172.21.15.111:0/139720404 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f72c01025d0 0x7f72c0198060 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:23.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.477+0000 7f72c5a00700 1 --2- 172.21.15.111:0/139720404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72c0102f70 0x7f72c01985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:23.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.477+0000 7f72c5a00700 1 -- 172.21.15.111:0/139720404 >> 172.21.15.111:0/139720404 conn(0x7f72c00fde50 msgr2=0x7f72c00ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:23.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.477+0000 7f72c5a00700 1 -- 172.21.15.111:0/139720404 shutdown_connections 2024-09-11T00:22:23.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:23.477+0000 7f72c5a00700 1 -- 172.21.15.111:0/139720404 wait complete. 2024-09-11T00:22:23.480 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 29 2024-09-11T00:22:23.769 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:23 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/139720404' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-11T00:22:23.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:23 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/139720404' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-11T00:22:24.030 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 30 2024-09-11T00:22:24.353 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:22:24.763 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:24 smithi111 ceph-mon[90842]: pgmap v334: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:24.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:24 smithi203 ceph-mon[69002]: pgmap v334: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:25.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:25 smithi111 ceph-mon[90842]: pgmap v335: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:26.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.289+0000 7f84dd600700 1 -- 172.21.15.111:0/3585583549 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84d8100d50 msgr2=0x7f84d8104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:26.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.289+0000 7f84dd600700 1 --2- 172.21.15.111:0/3585583549 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84d8100d50 0x7f84d8104d20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f84c4009910 tx=0x7f84c4009c20 comp rx=0 tx=0).stop 2024-09-11T00:22:26.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.289+0000 7f84dd600700 1 -- 172.21.15.111:0/3585583549 shutdown_connections 2024-09-11T00:22:26.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.289+0000 7f84dd600700 1 --2- 172.21.15.111:0/3585583549 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84d8100d50 0x7f84d8104d20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:26.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.289+0000 7f84dd600700 1 --2- 172.21.15.111:0/3585583549 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84d81003b0 0x7f84d8100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:26.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.289+0000 7f84dd600700 1 -- 172.21.15.111:0/3585583549 >> 172.21.15.111:0/3585583549 conn(0x7f84d80fbc30 msgr2=0x7f84d80fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:26.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.290+0000 7f84dd600700 1 -- 172.21.15.111:0/3585583549 shutdown_connections 2024-09-11T00:22:26.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.290+0000 7f84dd600700 1 -- 172.21.15.111:0/3585583549 wait complete. 2024-09-11T00:22:26.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.291+0000 7f84dd600700 1 Processor -- start 2024-09-11T00:22:26.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.291+0000 7f84dd600700 1 -- start start 2024-09-11T00:22:26.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.291+0000 7f84dd600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84d81003b0 0x7f84d8073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:26.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.291+0000 7f84dd600700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84d8100d50 0x7f84d8073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:26.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.291+0000 7f84dd600700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d8073ad0 con 0x7f84d8100d50 2024-09-11T00:22:26.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.291+0000 7f84dd600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d8073c10 con 0x7f84d81003b0 2024-09-11T00:22:26.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.291+0000 7f84d6000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84d8100d50 0x7f84d8073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:26.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.291+0000 7f84d6000700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84d8100d50 0x7f84d8073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42878/0 (socket says 172.21.15.111:42878) 2024-09-11T00:22:26.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.291+0000 7f84d6000700 1 -- 172.21.15.111:0/1253226188 learned_addr learned my addr 172.21.15.111:0/1253226188 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:22:26.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.292+0000 7f84d6a00700 1 --2- 172.21.15.111:0/1253226188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84d81003b0 0x7f84d8073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:26.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.292+0000 7f84d6000700 1 -- 172.21.15.111:0/1253226188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84d81003b0 msgr2=0x7f84d8073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:26.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.292+0000 7f84d6000700 1 --2- 172.21.15.111:0/1253226188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84d81003b0 0x7f84d8073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:26.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.292+0000 7f84d6000700 1 -- 172.21.15.111:0/1253226188 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c40095f0 con 0x7f84d8100d50 2024-09-11T00:22:26.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.292+0000 7f84d6a00700 1 --2- 172.21.15.111:0/1253226188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84d81003b0 0x7f84d8073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:22:26.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.292+0000 7f84d6000700 1 --2- 172.21.15.111:0/1253226188 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84d8100d50 0x7f84d8073590 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f84c4009fd0 tx=0x7f84c400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:26.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:25 smithi203 ceph-mon[69002]: pgmap v335: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:26.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.292+0000 7f84cf400700 1 -- 172.21.15.111:0/1253226188 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84c401d070 con 0x7f84d8100d50 2024-09-11T00:22:26.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.293+0000 7f84cf400700 1 -- 172.21.15.111:0/1253226188 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f84c4022470 con 0x7f84d8100d50 2024-09-11T00:22:26.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.293+0000 7f84dd600700 1 -- 172.21.15.111:0/1253226188 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d8073e90 con 0x7f84d8100d50 2024-09-11T00:22:26.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.293+0000 7f84cf400700 1 -- 172.21.15.111:0/1253226188 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84c4017610 con 0x7f84d8100d50 2024-09-11T00:22:26.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.293+0000 7f84dd600700 1 -- 172.21.15.111:0/1253226188 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d81a2260 con 0x7f84d8100d50 2024-09-11T00:22:26.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.294+0000 7f84dd600700 1 -- 172.21.15.111:0/1253226188 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d8108720 con 0x7f84d8100d50 2024-09-11T00:22:26.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.295+0000 7f84cf400700 1 -- 172.21.15.111:0/1253226188 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f84c4005080 con 0x7f84d8100d50 2024-09-11T00:22:26.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.296+0000 7f84cf400700 1 --2- 172.21.15.111:0/1253226188 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f84bc07a6f0 0x7f84bc07cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:26.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.296+0000 7f84cf400700 1 -- 172.21.15.111:0/1253226188 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f84c409ea20 con 0x7f84d8100d50 2024-09-11T00:22:26.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.296+0000 7f84d6a00700 1 --2- 172.21.15.111:0/1253226188 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f84bc07a6f0 0x7f84bc07cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:26.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.297+0000 7f84d6a00700 1 --2- 172.21.15.111:0/1253226188 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f84bc07a6f0 0x7f84bc07cba0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f84c8009cb0 tx=0x7f84c8009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:26.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.300+0000 7f84cf400700 1 -- 172.21.15.111:0/1253226188 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f84c4062070 con 0x7f84d8100d50 2024-09-11T00:22:26.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.578+0000 7f84dd600700 1 -- 172.21.15.111:0/1253226188 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f84d802cd90 con 0x7f84d8100d50 2024-09-11T00:22:26.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.579+0000 7f84cf400700 1 -- 172.21.15.111:0/1253226188 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v33) v1 ==== 107+0+4405 (secure 0 0 0) 0x7f84c4065190 con 0x7f84d8100d50 2024-09-11T00:22:26.581 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:22:26.581 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":30,"btime":"2024-09-11T00:18:51:735037+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34438,"name":"cephfs.smithi111.rucaba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/36584465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":36584465},{"type":"v1","addr":"172.21.15.111:6829","nonce":36584465}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44379,"name":"cephfs.smithi203.tcrqop","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6825/4221647525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4221647525},{"type":"v1","addr":"172.21.15.203:6825","nonce":4221647525}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:03:47.950356+0000","modified":"2024-09-11T00:18:51.735036+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34406":{"gid":34406,"name":"cephfs.smithi111.gmgsay","rank":0,"incarnation":27,"state":"up:active","state_seq":22,"addr":"172.21.15.111:6827/3970632147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3970632147},{"type":"v1","addr":"172.21.15.111:6827","nonce":3970632147}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34406,"qdb_cluster":[34406]},"id":1}]} 2024-09-11T00:22:26.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.582+0000 7f84dd600700 1 -- 172.21.15.111:0/1253226188 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f84bc07a6f0 msgr2=0x7f84bc07cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:26.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.582+0000 7f84dd600700 1 --2- 172.21.15.111:0/1253226188 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f84bc07a6f0 0x7f84bc07cba0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f84c8009cb0 tx=0x7f84c8009260 comp rx=0 tx=0).stop 2024-09-11T00:22:26.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.582+0000 7f84dd600700 1 -- 172.21.15.111:0/1253226188 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84d8100d50 msgr2=0x7f84d8073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:26.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.582+0000 7f84dd600700 1 --2- 172.21.15.111:0/1253226188 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84d8100d50 0x7f84d8073590 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f84c4009fd0 tx=0x7f84c400f690 comp rx=0 tx=0).stop 2024-09-11T00:22:26.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.582+0000 7f84dd600700 1 -- 172.21.15.111:0/1253226188 shutdown_connections 2024-09-11T00:22:26.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.582+0000 7f84dd600700 1 --2- 172.21.15.111:0/1253226188 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f84bc07a6f0 0x7f84bc07cba0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:26.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.582+0000 7f84dd600700 1 --2- 172.21.15.111:0/1253226188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84d81003b0 0x7f84d8073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:26.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.582+0000 7f84dd600700 1 --2- 172.21.15.111:0/1253226188 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84d8100d50 0x7f84d8073590 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:26.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.582+0000 7f84dd600700 1 -- 172.21.15.111:0/1253226188 >> 172.21.15.111:0/1253226188 conn(0x7f84d80fbc30 msgr2=0x7f84d80fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:26.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.582+0000 7f84dd600700 1 -- 172.21.15.111:0/1253226188 shutdown_connections 2024-09-11T00:22:26.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:26.582+0000 7f84dd600700 1 -- 172.21.15.111:0/1253226188 wait complete. 2024-09-11T00:22:26.585 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 30 2024-09-11T00:22:26.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:26 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/1253226188' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-11T00:22:27.148 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:26 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/1253226188' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-11T00:22:27.236 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 31 2024-09-11T00:22:27.555 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:22:27.967 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:27 smithi111 ceph-mon[90842]: pgmap v336: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:28.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:27 smithi203 ceph-mon[69002]: pgmap v336: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:28.999 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:28 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:22:29.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:28 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:22:29.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.415+0000 7f39efc00700 1 -- 172.21.15.111:0/3388532913 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39e8100d50 msgr2=0x7f39e8104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:29.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.416+0000 7f39efc00700 1 --2- 172.21.15.111:0/3388532913 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39e8100d50 0x7f39e8104d20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f39d4009910 tx=0x7f39d4009c20 comp rx=0 tx=0).stop 2024-09-11T00:22:29.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.416+0000 7f39efc00700 1 -- 172.21.15.111:0/3388532913 shutdown_connections 2024-09-11T00:22:29.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.416+0000 7f39efc00700 1 --2- 172.21.15.111:0/3388532913 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39e8100d50 0x7f39e8104d20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:29.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.416+0000 7f39efc00700 1 --2- 172.21.15.111:0/3388532913 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39e81003b0 0x7f39e8100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:29.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.416+0000 7f39efc00700 1 -- 172.21.15.111:0/3388532913 >> 172.21.15.111:0/3388532913 conn(0x7f39e80fbc30 msgr2=0x7f39e80fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:29.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.416+0000 7f39efc00700 1 -- 172.21.15.111:0/3388532913 shutdown_connections 2024-09-11T00:22:29.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.416+0000 7f39efc00700 1 -- 172.21.15.111:0/3388532913 wait complete. 2024-09-11T00:22:29.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.417+0000 7f39efc00700 1 Processor -- start 2024-09-11T00:22:29.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.417+0000 7f39efc00700 1 -- start start 2024-09-11T00:22:29.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.417+0000 7f39efc00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39e81003b0 0x7f39e8073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:29.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.417+0000 7f39efc00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39e8100d50 0x7f39e8073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:29.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.417+0000 7f39efc00700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e8073ad0 con 0x7f39e81003b0 2024-09-11T00:22:29.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.417+0000 7f39efc00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e8073c10 con 0x7f39e8100d50 2024-09-11T00:22:29.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.418+0000 7f39ed200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39e81003b0 0x7f39e8073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:29.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.418+0000 7f39ed200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39e81003b0 0x7f39e8073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:47386/0 (socket says 172.21.15.111:47386) 2024-09-11T00:22:29.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.418+0000 7f39ed200700 1 -- 172.21.15.111:0/491824289 learned_addr learned my addr 172.21.15.111:0/491824289 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:22:29.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.418+0000 7f39e7e00700 1 --2- 172.21.15.111:0/491824289 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39e8100d50 0x7f39e8073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:29.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.418+0000 7f39ed200700 1 -- 172.21.15.111:0/491824289 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39e8100d50 msgr2=0x7f39e8073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:29.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.418+0000 7f39ed200700 1 --2- 172.21.15.111:0/491824289 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39e8100d50 0x7f39e8073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:29.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.418+0000 7f39ed200700 1 -- 172.21.15.111:0/491824289 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d40095f0 con 0x7f39e81003b0 2024-09-11T00:22:29.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.418+0000 7f39e7e00700 1 --2- 172.21.15.111:0/491824289 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39e8100d50 0x7f39e8073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:22:29.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.418+0000 7f39ed200700 1 --2- 172.21.15.111:0/491824289 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39e81003b0 0x7f39e8073050 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f39dc00d8d0 tx=0x7f39dc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:29.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.419+0000 7f39e5600700 1 -- 172.21.15.111:0/491824289 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39dc009940 con 0x7f39e81003b0 2024-09-11T00:22:29.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.419+0000 7f39e5600700 1 -- 172.21.15.111:0/491824289 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f39dc010460 con 0x7f39e81003b0 2024-09-11T00:22:29.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.419+0000 7f39e5600700 1 -- 172.21.15.111:0/491824289 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39dc00f5f0 con 0x7f39e81003b0 2024-09-11T00:22:29.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.419+0000 7f39efc00700 1 -- 172.21.15.111:0/491824289 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e81a1f90 con 0x7f39e81003b0 2024-09-11T00:22:29.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.419+0000 7f39efc00700 1 -- 172.21.15.111:0/491824289 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e81a23a0 con 0x7f39e81003b0 2024-09-11T00:22:29.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.420+0000 7f39efc00700 1 -- 172.21.15.111:0/491824289 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39e8108720 con 0x7f39e81003b0 2024-09-11T00:22:29.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.421+0000 7f39e5600700 1 -- 172.21.15.111:0/491824289 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f39dc0105d0 con 0x7f39e81003b0 2024-09-11T00:22:29.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.422+0000 7f39e5600700 1 --2- 172.21.15.111:0/491824289 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f39d007a6f0 0x7f39d007cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:29.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.422+0000 7f39e5600700 1 -- 172.21.15.111:0/491824289 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f39dc09d2c0 con 0x7f39e81003b0 2024-09-11T00:22:29.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.422+0000 7f39e7e00700 1 --2- 172.21.15.111:0/491824289 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f39d007a6f0 0x7f39d007cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:29.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.423+0000 7f39e7e00700 1 --2- 172.21.15.111:0/491824289 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f39d007a6f0 0x7f39d007cba0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f39d4006010 tx=0x7f39d400b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:29.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.426+0000 7f39e5600700 1 -- 172.21.15.111:0/491824289 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f39dc060990 con 0x7f39e81003b0 2024-09-11T00:22:29.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.699+0000 7f39efc00700 1 -- 172.21.15.111:0/491824289 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f39e804ea50 con 0x7f39e81003b0 2024-09-11T00:22:29.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.699+0000 7f39e5600700 1 -- 172.21.15.111:0/491824289 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v33) v1 ==== 107+0+5255 (secure 0 0 0) 0x7f39dc063ab0 con 0x7f39e81003b0 2024-09-11T00:22:29.702 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:22:29.702 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":31,"btime":"2024-09-11T00:18:52:741769+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34438,"name":"cephfs.smithi111.rucaba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/36584465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":36584465},{"type":"v1","addr":"172.21.15.111:6829","nonce":36584465}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44379,"name":"cephfs.smithi203.tcrqop","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6825/4221647525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4221647525},{"type":"v1","addr":"172.21.15.203:6825","nonce":4221647525}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44393,"name":"cephfs.smithi203.uqkbkn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6827/1792805040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1792805040},{"type":"v1","addr":"172.21.15.203:6827","nonce":1792805040}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:03:47.950356+0000","modified":"2024-09-11T00:18:51.735036+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34406":{"gid":34406,"name":"cephfs.smithi111.gmgsay","rank":0,"incarnation":27,"state":"up:active","state_seq":22,"addr":"172.21.15.111:6827/3970632147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3970632147},{"type":"v1","addr":"172.21.15.111:6827","nonce":3970632147}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34406,"qdb_cluster":[34406]},"id":1}]} 2024-09-11T00:22:29.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.702+0000 7f39efc00700 1 -- 172.21.15.111:0/491824289 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f39d007a6f0 msgr2=0x7f39d007cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:29.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.702+0000 7f39efc00700 1 --2- 172.21.15.111:0/491824289 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f39d007a6f0 0x7f39d007cba0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f39d4006010 tx=0x7f39d400b540 comp rx=0 tx=0).stop 2024-09-11T00:22:29.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.702+0000 7f39efc00700 1 -- 172.21.15.111:0/491824289 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39e81003b0 msgr2=0x7f39e8073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:29.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.702+0000 7f39efc00700 1 --2- 172.21.15.111:0/491824289 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39e81003b0 0x7f39e8073050 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f39dc00d8d0 tx=0x7f39dc00dc90 comp rx=0 tx=0).stop 2024-09-11T00:22:29.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.702+0000 7f39efc00700 1 -- 172.21.15.111:0/491824289 shutdown_connections 2024-09-11T00:22:29.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.702+0000 7f39efc00700 1 --2- 172.21.15.111:0/491824289 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f39d007a6f0 0x7f39d007cba0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:29.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.702+0000 7f39efc00700 1 --2- 172.21.15.111:0/491824289 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39e81003b0 0x7f39e8073050 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:29.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.702+0000 7f39efc00700 1 --2- 172.21.15.111:0/491824289 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39e8100d50 0x7f39e8073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:29.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.702+0000 7f39efc00700 1 -- 172.21.15.111:0/491824289 >> 172.21.15.111:0/491824289 conn(0x7f39e80fbc30 msgr2=0x7f39e80fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:29.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.702+0000 7f39efc00700 1 -- 172.21.15.111:0/491824289 shutdown_connections 2024-09-11T00:22:29.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:29.702+0000 7f39efc00700 1 -- 172.21.15.111:0/491824289 wait complete. 2024-09-11T00:22:29.706 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 31 2024-09-11T00:22:30.055 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:29 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:22:30.056 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:29 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:22:30.056 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:29 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:22:30.056 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:29 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/491824289' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-11T00:22:30.056 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:29 smithi111 ceph-mon[90842]: pgmap v337: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:30.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:29 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:22:30.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:29 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:22:30.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:29 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:22:30.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:29 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/491824289' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-11T00:22:30.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:29 smithi203 ceph-mon[69002]: pgmap v337: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:30.563 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 32 2024-09-11T00:22:30.884 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:22:31.097 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:22:31.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:22:32.102 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:31 smithi111 ceph-mon[90842]: pgmap v338: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:32.230 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:31 smithi203 ceph-mon[69002]: pgmap v338: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:32.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.910+0000 7fd3f4200700 1 -- 172.21.15.111:0/1544466927 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3ec102fb0 msgr2=0x7fd3ec106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:32.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.910+0000 7fd3f4200700 1 --2- 172.21.15.111:0/1544466927 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3ec102fb0 0x7fd3ec106f80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8009910 tx=0x7fd3d8009c20 comp rx=0 tx=0).stop 2024-09-11T00:22:32.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.911+0000 7fd3f4200700 1 -- 172.21.15.111:0/1544466927 shutdown_connections 2024-09-11T00:22:32.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.911+0000 7fd3f4200700 1 --2- 172.21.15.111:0/1544466927 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3ec102fb0 0x7fd3ec106f80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:32.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.911+0000 7fd3f4200700 1 --2- 172.21.15.111:0/1544466927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3ec102610 0x7fd3ec1029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:32.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.911+0000 7fd3f4200700 1 -- 172.21.15.111:0/1544466927 >> 172.21.15.111:0/1544466927 conn(0x7fd3ec0fde90 msgr2=0x7fd3ec1002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:32.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.911+0000 7fd3f4200700 1 -- 172.21.15.111:0/1544466927 shutdown_connections 2024-09-11T00:22:32.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.911+0000 7fd3f4200700 1 -- 172.21.15.111:0/1544466927 wait complete. 2024-09-11T00:22:32.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.912+0000 7fd3f4200700 1 Processor -- start 2024-09-11T00:22:32.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.912+0000 7fd3f4200700 1 -- start start 2024-09-11T00:22:32.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.913+0000 7fd3f4200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3ec102610 0x7fd3ec197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:32.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.913+0000 7fd3f4200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3ec102fb0 0x7fd3ec198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:32.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.913+0000 7fd3f4200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec198c00 con 0x7fd3ec102610 2024-09-11T00:22:32.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.913+0000 7fd3f4200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec19c990 con 0x7fd3ec102fb0 2024-09-11T00:22:32.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.913+0000 7fd3f1800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3ec102610 0x7fd3ec197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:32.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.913+0000 7fd3f1800700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3ec102610 0x7fd3ec197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:47404/0 (socket says 172.21.15.111:47404) 2024-09-11T00:22:32.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.913+0000 7fd3f1800700 1 -- 172.21.15.111:0/1039805611 learned_addr learned my addr 172.21.15.111:0/1039805611 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:22:32.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.913+0000 7fd3f0e00700 1 --2- 172.21.15.111:0/1039805611 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3ec102fb0 0x7fd3ec198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:32.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.913+0000 7fd3f1800700 1 -- 172.21.15.111:0/1039805611 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3ec102fb0 msgr2=0x7fd3ec198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:32.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.913+0000 7fd3f1800700 1 --2- 172.21.15.111:0/1039805611 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3ec102fb0 0x7fd3ec198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:32.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.913+0000 7fd3f1800700 1 -- 172.21.15.111:0/1039805611 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d80095f0 con 0x7fd3ec102610 2024-09-11T00:22:32.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.914+0000 7fd3f1800700 1 --2- 172.21.15.111:0/1039805611 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3ec102610 0x7fd3ec197fe0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd3e000d8d0 tx=0x7fd3e000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:32.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.914+0000 7fd3ea000700 1 -- 172.21.15.111:0/1039805611 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3e00098a0 con 0x7fd3ec102610 2024-09-11T00:22:32.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.914+0000 7fd3ea000700 1 -- 172.21.15.111:0/1039805611 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd3e0010460 con 0x7fd3ec102610 2024-09-11T00:22:32.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.914+0000 7fd3f4200700 1 -- 172.21.15.111:0/1039805611 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3ec19cc70 con 0x7fd3ec102610 2024-09-11T00:22:32.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.914+0000 7fd3ea000700 1 -- 172.21.15.111:0/1039805611 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3e000f5f0 con 0x7fd3ec102610 2024-09-11T00:22:32.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.914+0000 7fd3f4200700 1 -- 172.21.15.111:0/1039805611 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3ec19d190 con 0x7fd3ec102610 2024-09-11T00:22:32.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.915+0000 7fd3f4200700 1 -- 172.21.15.111:0/1039805611 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3ec04ea50 con 0x7fd3ec102610 2024-09-11T00:22:32.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.916+0000 7fd3ea000700 1 -- 172.21.15.111:0/1039805611 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7fd3e0009a00 con 0x7fd3ec102610 2024-09-11T00:22:32.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.917+0000 7fd3ea000700 1 --2- 172.21.15.111:0/1039805611 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd3d407a6f0 0x7fd3d407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:32.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.917+0000 7fd3ea000700 1 -- 172.21.15.111:0/1039805611 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fd3e009d180 con 0x7fd3ec102610 2024-09-11T00:22:32.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.918+0000 7fd3f0e00700 1 --2- 172.21.15.111:0/1039805611 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd3d407a6f0 0x7fd3d407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:32.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.918+0000 7fd3f0e00700 1 --2- 172.21.15.111:0/1039805611 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd3d407a6f0 0x7fd3d407cba0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8006010 tx=0x7fd3d801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:32.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:32.922+0000 7fd3ea000700 1 -- 172.21.15.111:0/1039805611 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7fd3e0060850 con 0x7fd3ec102610 2024-09-11T00:22:33.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:33.190+0000 7fd3f4200700 1 -- 172.21.15.111:0/1039805611 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7fd3ec199340 con 0x7fd3ec102610 2024-09-11T00:22:33.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:33.191+0000 7fd3ea000700 1 -- 172.21.15.111:0/1039805611 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v33) v1 ==== 107+0+5255 (secure 0 0 0) 0x7fd3e0063970 con 0x7fd3ec102610 2024-09-11T00:22:33.193 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-11T00:22:33.193 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":32,"btime":"2024-09-11T00:19:01:946560+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34438,"name":"cephfs.smithi111.rucaba","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/36584465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":36584465},{"type":"v1","addr":"172.21.15.111:6829","nonce":36584465}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44379,"name":"cephfs.smithi203.tcrqop","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6825/4221647525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":4221647525},{"type":"v1","addr":"172.21.15.203:6825","nonce":4221647525}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44393,"name":"cephfs.smithi203.uqkbkn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6827/1792805040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":1792805040},{"type":"v1","addr":"172.21.15.203:6827","nonce":1792805040}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T00:03:47.950356+0000","modified":"2024-09-11T00:19:00.949024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34406":{"gid":34406,"name":"cephfs.smithi111.gmgsay","rank":0,"incarnation":27,"state":"up:active","state_seq":22,"addr":"172.21.15.111:6827/3970632147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3970632147},{"type":"v1","addr":"172.21.15.111:6827","nonce":3970632147}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34406,"qdb_cluster":[34406]},"id":1}]} 2024-09-11T00:22:33.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:33.193+0000 7fd3f4200700 1 -- 172.21.15.111:0/1039805611 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd3d407a6f0 msgr2=0x7fd3d407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:33.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:33.193+0000 7fd3f4200700 1 --2- 172.21.15.111:0/1039805611 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd3d407a6f0 0x7fd3d407cba0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8006010 tx=0x7fd3d801a040 comp rx=0 tx=0).stop 2024-09-11T00:22:33.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:33.194+0000 7fd3f4200700 1 -- 172.21.15.111:0/1039805611 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3ec102610 msgr2=0x7fd3ec197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:33.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:33.194+0000 7fd3f4200700 1 --2- 172.21.15.111:0/1039805611 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3ec102610 0x7fd3ec197fe0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd3e000d8d0 tx=0x7fd3e000dbe0 comp rx=0 tx=0).stop 2024-09-11T00:22:33.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:33.194+0000 7fd3f4200700 1 -- 172.21.15.111:0/1039805611 shutdown_connections 2024-09-11T00:22:33.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:33.194+0000 7fd3f4200700 1 --2- 172.21.15.111:0/1039805611 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7fd3d407a6f0 0x7fd3d407cba0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:33.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:33.194+0000 7fd3f4200700 1 --2- 172.21.15.111:0/1039805611 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3ec102610 0x7fd3ec197fe0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:33.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:33.194+0000 7fd3f4200700 1 --2- 172.21.15.111:0/1039805611 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3ec102fb0 0x7fd3ec198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:33.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:33.194+0000 7fd3f4200700 1 -- 172.21.15.111:0/1039805611 >> 172.21.15.111:0/1039805611 conn(0x7fd3ec0fde90 msgr2=0x7fd3ec0ff460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:33.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:33.194+0000 7fd3f4200700 1 -- 172.21.15.111:0/1039805611 shutdown_connections 2024-09-11T00:22:33.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:33.194+0000 7fd3f4200700 1 -- 172.21.15.111:0/1039805611 wait complete. 2024-09-11T00:22:33.198 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 32 2024-09-11T00:22:33.453 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:33 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/1039805611' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-11T00:22:33.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:33 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/1039805611' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-11T00:22:33.793 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-11T00:22:33.806 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-11T00:22:33.806 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-11T00:22:33.807 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:22:33.846 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-11T00:22:33.846 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:22:33.923 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-11T00:22:34.283 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:22:34.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:34 smithi111 ceph-mon[90842]: pgmap v339: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:34.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:34 smithi203 ceph-mon[69002]: pgmap v339: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:35.835 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:35 smithi111 ceph-mon[90842]: pgmap v340: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:36.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.240+0000 7f1637200700 1 -- 172.21.15.111:0/2590852123 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1638100250 msgr2=0x7f1638100620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:36.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.240+0000 7f1637200700 1 --2- 172.21.15.111:0/2590852123 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1638100250 0x7f1638100620 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1628009910 tx=0x7f1628009c20 comp rx=0 tx=0).stop 2024-09-11T00:22:36.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.240+0000 7f1637200700 1 -- 172.21.15.111:0/2590852123 shutdown_connections 2024-09-11T00:22:36.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.240+0000 7f1637200700 1 --2- 172.21.15.111:0/2590852123 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1638100bf0 0x7f1638104bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:36.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.240+0000 7f1637200700 1 --2- 172.21.15.111:0/2590852123 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1638100250 0x7f1638100620 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:36.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.240+0000 7f1637200700 1 -- 172.21.15.111:0/2590852123 >> 172.21.15.111:0/2590852123 conn(0x7f16380fbb10 msgr2=0x7f16380fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:36.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.240+0000 7f1637200700 1 -- 172.21.15.111:0/2590852123 shutdown_connections 2024-09-11T00:22:36.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.240+0000 7f1637200700 1 -- 172.21.15.111:0/2590852123 wait complete. 2024-09-11T00:22:36.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.242+0000 7f1637200700 1 Processor -- start 2024-09-11T00:22:36.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.242+0000 7f1637200700 1 -- start start 2024-09-11T00:22:36.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.242+0000 7f1637200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1638100250 0x7f163819ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:36.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.242+0000 7f1637200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1638100bf0 0x7f163819bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:36.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.242+0000 7f1637200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163819c5d0 con 0x7f1638100bf0 2024-09-11T00:22:36.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.242+0000 7f1637200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1638195a80 con 0x7f1638100250 2024-09-11T00:22:36.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.242+0000 7f1635400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1638100bf0 0x7f163819bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:36.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.242+0000 7f1635400700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1638100bf0 0x7f163819bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:47422/0 (socket says 172.21.15.111:47422) 2024-09-11T00:22:36.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.242+0000 7f1635400700 1 -- 172.21.15.111:0/1824208845 learned_addr learned my addr 172.21.15.111:0/1824208845 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:22:36.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.243+0000 7f1635e00700 1 --2- 172.21.15.111:0/1824208845 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1638100250 0x7f163819ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:36.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.243+0000 7f1635400700 1 -- 172.21.15.111:0/1824208845 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1638100250 msgr2=0x7f163819ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:36.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.243+0000 7f1635400700 1 --2- 172.21.15.111:0/1824208845 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1638100250 0x7f163819ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:36.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.243+0000 7f1635400700 1 -- 172.21.15.111:0/1824208845 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16280095f0 con 0x7f1638100bf0 2024-09-11T00:22:36.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.243+0000 7f1635400700 1 --2- 172.21.15.111:0/1824208845 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1638100bf0 0x7f163819bf40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f162400e8f0 tx=0x7f162400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:36.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.243+0000 7f162ea00700 1 -- 172.21.15.111:0/1824208845 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1624009790 con 0x7f1638100bf0 2024-09-11T00:22:36.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.243+0000 7f162ea00700 1 -- 172.21.15.111:0/1824208845 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1624004cf0 con 0x7f1638100bf0 2024-09-11T00:22:36.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.243+0000 7f1637200700 1 -- 172.21.15.111:0/1824208845 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1638195d60 con 0x7f1638100bf0 2024-09-11T00:22:36.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.244+0000 7f162ea00700 1 -- 172.21.15.111:0/1824208845 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1624005690 con 0x7f1638100bf0 2024-09-11T00:22:36.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.244+0000 7f1637200700 1 -- 172.21.15.111:0/1824208845 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16381962b0 con 0x7f1638100bf0 2024-09-11T00:22:36.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.245+0000 7f1637200700 1 -- 172.21.15.111:0/1824208845 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1638108560 con 0x7f1638100bf0 2024-09-11T00:22:36.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.246+0000 7f162ea00700 1 -- 172.21.15.111:0/1824208845 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f1624004750 con 0x7f1638100bf0 2024-09-11T00:22:36.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.247+0000 7f162ea00700 1 --2- 172.21.15.111:0/1824208845 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f161c07a6f0 0x7f161c07cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:36.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.247+0000 7f162ea00700 1 -- 172.21.15.111:0/1824208845 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f1624014070 con 0x7f1638100bf0 2024-09-11T00:22:36.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.247+0000 7f1635e00700 1 --2- 172.21.15.111:0/1824208845 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f161c07a6f0 0x7f161c07cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:36.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.248+0000 7f1635e00700 1 --2- 172.21.15.111:0/1824208845 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f161c07a6f0 0x7f161c07cba0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f162800b760 tx=0x7f1628005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:36.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.251+0000 7f162ea00700 1 -- 172.21.15.111:0/1824208845 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f1624060dc0 con 0x7f1638100bf0 2024-09-11T00:22:36.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:35 smithi203 ceph-mon[69002]: pgmap v340: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:36.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.492+0000 7f1637200700 1 -- 172.21.15.111:0/1824208845 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f163804f2a0 con 0x7f1638100bf0 2024-09-11T00:22:36.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.492+0000 7f162ea00700 1 -- 172.21.15.111:0/1824208845 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v84) v1 ==== 81+0+2072 (secure 0 0 0) 0x7f1624063ee0 con 0x7f1638100bf0 2024-09-11T00:22:36.495 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.203:6826/695613114 2024-09-12T00:18:42.027049+0000 2024-09-11T00:22:36.495 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.203:6825/3082736449 2024-09-12T00:18:13.238065+0000 2024-09-11T00:22:36.495 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.203:6824/3082736449 2024-09-12T00:18:13.238065+0000 2024-09-11T00:22:36.495 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6801/3952658086 2024-09-12T00:12:29.560169+0000 2024-09-11T00:22:36.495 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/92336389 2024-09-11T23:56:15.498737+0000 2024-09-11T00:22:36.495 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/1012099414 2024-09-12T00:07:09.177090+0000 2024-09-11T00:22:36.495 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.203:0/4035698505 2024-09-12T00:08:35.117790+0000 2024-09-11T00:22:36.495 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/353472070 2024-09-11T23:55:34.617670+0000 2024-09-11T00:22:36.495 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6800/3952658086 2024-09-12T00:12:29.560169+0000 2024-09-11T00:22:36.496 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/3527343662 2024-09-12T00:07:09.177090+0000 2024-09-11T00:22:36.496 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6826/3294522638 2024-09-12T00:04:03.266398+0000 2024-09-11T00:22:36.496 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/4232639257 2024-09-11T23:56:15.498737+0000 2024-09-11T00:22:36.496 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.203:6829/1203435425 2024-09-12T00:08:35.117790+0000 2024-09-11T00:22:36.496 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.203:0/1460957714 2024-09-12T00:08:35.117790+0000 2024-09-11T00:22:36.496 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6827/3294522638 2024-09-12T00:04:03.266398+0000 2024-09-11T00:22:36.496 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.203:0/369392535 2024-09-12T00:08:35.117790+0000 2024-09-11T00:22:36.496 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/113012487 2024-09-11T23:55:34.617670+0000 2024-09-11T00:22:36.496 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.203:0/1307567675 2024-09-12T00:08:35.117790+0000 2024-09-11T00:22:36.496 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.203:6827/695613114 2024-09-12T00:18:42.027049+0000 2024-09-11T00:22:36.496 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.203:0/1312026030 2024-09-12T00:08:35.117790+0000 2024-09-11T00:22:36.496 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/3316998166 2024-09-12T00:12:29.560169+0000 2024-09-11T00:22:36.497 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6801/2 2024-09-11T23:55:34.617670+0000 2024-09-11T00:22:36.497 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6800/2 2024-09-11T23:55:34.617670+0000 2024-09-11T00:22:36.497 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/118783074 2024-09-11T23:56:15.498737+0000 2024-09-11T00:22:36.497 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/745179268 2024-09-11T23:57:30.610091+0000 2024-09-11T00:22:36.497 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/204109822 2024-09-11T23:57:30.610091+0000 2024-09-11T00:22:36.497 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/4097088644 2024-09-11T23:55:34.617670+0000 2024-09-11T00:22:36.497 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.203:6828/1203435425 2024-09-12T00:08:35.117790+0000 2024-09-11T00:22:36.497 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/2851283125 2024-09-11T23:57:30.610091+0000 2024-09-11T00:22:36.497 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/3001861837 2024-09-12T00:07:09.177090+0000 2024-09-11T00:22:36.497 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.203:0/4272095475 2024-09-12T00:08:35.117790+0000 2024-09-11T00:22:36.497 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/1598851402 2024-09-12T00:12:29.560169+0000 2024-09-11T00:22:36.497 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/785935192 2024-09-12T00:12:29.560169+0000 2024-09-11T00:22:36.497 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/3305093032 2024-09-12T00:07:09.177090+0000 2024-09-11T00:22:36.497 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/1804659337 2024-09-12T00:12:29.560169+0000 2024-09-11T00:22:36.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.495+0000 7f1637200700 1 -- 172.21.15.111:0/1824208845 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f161c07a6f0 msgr2=0x7f161c07cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:36.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.495+0000 7f1637200700 1 --2- 172.21.15.111:0/1824208845 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f161c07a6f0 0x7f161c07cba0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f162800b760 tx=0x7f1628005fd0 comp rx=0 tx=0).stop 2024-09-11T00:22:36.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.495+0000 7f1637200700 1 -- 172.21.15.111:0/1824208845 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1638100bf0 msgr2=0x7f163819bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:36.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.495+0000 7f1637200700 1 --2- 172.21.15.111:0/1824208845 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1638100bf0 0x7f163819bf40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f162400e8f0 tx=0x7f162400ecb0 comp rx=0 tx=0).stop 2024-09-11T00:22:36.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.495+0000 7f1637200700 1 -- 172.21.15.111:0/1824208845 shutdown_connections 2024-09-11T00:22:36.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.495+0000 7f1637200700 1 --2- 172.21.15.111:0/1824208845 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f161c07a6f0 0x7f161c07cba0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:36.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.495+0000 7f1637200700 1 --2- 172.21.15.111:0/1824208845 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1638100250 0x7f163819ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:36.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.495+0000 7f1637200700 1 --2- 172.21.15.111:0/1824208845 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1638100bf0 0x7f163819bf40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:36.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.495+0000 7f1637200700 1 -- 172.21.15.111:0/1824208845 >> 172.21.15.111:0/1824208845 conn(0x7f16380fbb10 msgr2=0x7f16380fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:36.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.495+0000 7f1637200700 1 -- 172.21.15.111:0/1824208845 shutdown_connections 2024-09-11T00:22:36.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:36.495+0000 7f1637200700 1 -- 172.21.15.111:0/1824208845 wait complete. 2024-09-11T00:22:36.499 INFO:teuthology.orchestra.run.smithi111.stderr:listed 35 entries 2024-09-11T00:22:37.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:36 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/1824208845' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-11T00:22:37.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:36 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/1824208845' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-11T00:22:37.314 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-11T00:22:37.314 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:22:37.351 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-11T00:22:37.714 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/mon.smithi111/config 2024-09-11T00:22:38.145 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:37 smithi111 ceph-mon[90842]: pgmap v341: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:38.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:37 smithi203 ceph-mon[69002]: pgmap v341: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:39.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.493+0000 7f4417200700 1 -- 172.21.15.111:0/1676265920 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4410073070 msgr2=0x7f4410073440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:39.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.493+0000 7f4417200700 1 --2- 172.21.15.111:0/1676265920 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4410073070 0x7f4410073440 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4400009940 tx=0x7f4400009c50 comp rx=0 tx=0).stop 2024-09-11T00:22:39.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.493+0000 7f4417200700 1 -- 172.21.15.111:0/1676265920 shutdown_connections 2024-09-11T00:22:39.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.493+0000 7f4417200700 1 --2- 172.21.15.111:0/1676265920 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4410073980 0x7f441010c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:39.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.493+0000 7f4417200700 1 --2- 172.21.15.111:0/1676265920 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4410073070 0x7f4410073440 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:39.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.493+0000 7f4417200700 1 -- 172.21.15.111:0/1676265920 >> 172.21.15.111:0/1676265920 conn(0x7f44100fbc90 msgr2=0x7f44100fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:39.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.493+0000 7f4417200700 1 -- 172.21.15.111:0/1676265920 shutdown_connections 2024-09-11T00:22:39.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.493+0000 7f4417200700 1 -- 172.21.15.111:0/1676265920 wait complete. 2024-09-11T00:22:39.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.494+0000 7f4417200700 1 Processor -- start 2024-09-11T00:22:39.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.494+0000 7f4417200700 1 -- start start 2024-09-11T00:22:39.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.495+0000 7f4417200700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4410073070 0x7f4410197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:39.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.495+0000 7f4417200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4410073980 0x7f44101984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:39.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.495+0000 7f4417200700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4410198af0 con 0x7f4410073070 2024-09-11T00:22:39.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.495+0000 7f4417200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4410198c30 con 0x7f4410073980 2024-09-11T00:22:39.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.495+0000 7f440fe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4410073070 0x7f4410197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:39.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.495+0000 7f440fe00700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4410073070 0x7f4410197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40192/0 (socket says 172.21.15.111:40192) 2024-09-11T00:22:39.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.495+0000 7f440fe00700 1 -- 172.21.15.111:0/2742157384 learned_addr learned my addr 172.21.15.111:0/2742157384 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-11T00:22:39.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.495+0000 7f440fe00700 1 -- 172.21.15.111:0/2742157384 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4410073980 msgr2=0x7f44101984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:39.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.495+0000 7f440fe00700 1 --2- 172.21.15.111:0/2742157384 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4410073980 0x7f44101984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:39.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.495+0000 7f440fe00700 1 -- 172.21.15.111:0/2742157384 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44000095f0 con 0x7f4410073070 2024-09-11T00:22:39.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.496+0000 7f440fe00700 1 --2- 172.21.15.111:0/2742157384 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4410073070 0x7f4410197f60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f440000b870 tx=0x7f44000056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:39.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.496+0000 7f440cc00700 1 -- 172.21.15.111:0/2742157384 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f440001d070 con 0x7f4410073070 2024-09-11T00:22:39.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.496+0000 7f440cc00700 1 -- 172.21.15.111:0/2742157384 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f440000f460 con 0x7f4410073070 2024-09-11T00:22:39.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.496+0000 7f4417200700 1 -- 172.21.15.111:0/2742157384 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f441019ca20 con 0x7f4410073070 2024-09-11T00:22:39.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.496+0000 7f440cc00700 1 -- 172.21.15.111:0/2742157384 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4400021640 con 0x7f4410073070 2024-09-11T00:22:39.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.496+0000 7f4417200700 1 -- 172.21.15.111:0/2742157384 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441019cf10 con 0x7f4410073070 2024-09-11T00:22:39.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.497+0000 7f4417200700 1 -- 172.21.15.111:0/2742157384 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f441004ea50 con 0x7f4410073070 2024-09-11T00:22:39.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.498+0000 7f440cc00700 1 -- 172.21.15.111:0/2742157384 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 41) v1 ==== 102482+0+0 (secure 0 0 0) 0x7f440000fa40 con 0x7f4410073070 2024-09-11T00:22:39.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.499+0000 7f440cc00700 1 --2- 172.21.15.111:0/2742157384 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f43f407a6f0 0x7f43f407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:39.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.499+0000 7f440cc00700 1 -- 172.21.15.111:0/2742157384 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f440009e610 con 0x7f4410073070 2024-09-11T00:22:39.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.499+0000 7f440f400700 1 --2- 172.21.15.111:0/2742157384 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f43f407a6f0 0x7f43f407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:39.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.500+0000 7f440f400700 1 --2- 172.21.15.111:0/2742157384 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f43f407a6f0 0x7f43f407cba0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f43fc005fd0 tx=0x7f43fc005d00 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:39.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.503+0000 7f440cc00700 1 -- 172.21.15.111:0/2742157384 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+197130 (secure 0 0 0) 0x7f4400061d00 con 0x7f4410073070 2024-09-11T00:22:39.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.740+0000 7f4417200700 1 -- 172.21.15.111:0/2742157384 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f44101992c0 con 0x7f4410073070 2024-09-11T00:22:39.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.741+0000 7f440cc00700 1 -- 172.21.15.111:0/2742157384 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v84) v1 ==== 81+0+2072 (secure 0 0 0) 0x7f4400064e20 con 0x7f4410073070 2024-09-11T00:22:39.743 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.203:6826/695613114 2024-09-12T00:18:42.027049+0000 2024-09-11T00:22:39.743 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.203:6825/3082736449 2024-09-12T00:18:13.238065+0000 2024-09-11T00:22:39.743 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.203:6824/3082736449 2024-09-12T00:18:13.238065+0000 2024-09-11T00:22:39.743 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6801/3952658086 2024-09-12T00:12:29.560169+0000 2024-09-11T00:22:39.743 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/92336389 2024-09-11T23:56:15.498737+0000 2024-09-11T00:22:39.743 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/1012099414 2024-09-12T00:07:09.177090+0000 2024-09-11T00:22:39.743 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.203:0/4035698505 2024-09-12T00:08:35.117790+0000 2024-09-11T00:22:39.744 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/353472070 2024-09-11T23:55:34.617670+0000 2024-09-11T00:22:39.744 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6800/3952658086 2024-09-12T00:12:29.560169+0000 2024-09-11T00:22:39.744 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/3527343662 2024-09-12T00:07:09.177090+0000 2024-09-11T00:22:39.744 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6826/3294522638 2024-09-12T00:04:03.266398+0000 2024-09-11T00:22:39.744 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/4232639257 2024-09-11T23:56:15.498737+0000 2024-09-11T00:22:39.744 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.203:6829/1203435425 2024-09-12T00:08:35.117790+0000 2024-09-11T00:22:39.744 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.203:0/1460957714 2024-09-12T00:08:35.117790+0000 2024-09-11T00:22:39.744 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6827/3294522638 2024-09-12T00:04:03.266398+0000 2024-09-11T00:22:39.744 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.203:0/369392535 2024-09-12T00:08:35.117790+0000 2024-09-11T00:22:39.744 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/113012487 2024-09-11T23:55:34.617670+0000 2024-09-11T00:22:39.744 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.203:0/1307567675 2024-09-12T00:08:35.117790+0000 2024-09-11T00:22:39.744 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.203:6827/695613114 2024-09-12T00:18:42.027049+0000 2024-09-11T00:22:39.744 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.203:0/1312026030 2024-09-12T00:08:35.117790+0000 2024-09-11T00:22:39.745 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/3316998166 2024-09-12T00:12:29.560169+0000 2024-09-11T00:22:39.745 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6801/2 2024-09-11T23:55:34.617670+0000 2024-09-11T00:22:39.745 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6800/2 2024-09-11T23:55:34.617670+0000 2024-09-11T00:22:39.745 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/118783074 2024-09-11T23:56:15.498737+0000 2024-09-11T00:22:39.745 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/745179268 2024-09-11T23:57:30.610091+0000 2024-09-11T00:22:39.745 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/204109822 2024-09-11T23:57:30.610091+0000 2024-09-11T00:22:39.745 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/4097088644 2024-09-11T23:55:34.617670+0000 2024-09-11T00:22:39.745 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.203:6828/1203435425 2024-09-12T00:08:35.117790+0000 2024-09-11T00:22:39.745 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/2851283125 2024-09-11T23:57:30.610091+0000 2024-09-11T00:22:39.745 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/3001861837 2024-09-12T00:07:09.177090+0000 2024-09-11T00:22:39.745 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.203:0/4272095475 2024-09-12T00:08:35.117790+0000 2024-09-11T00:22:39.745 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/1598851402 2024-09-12T00:12:29.560169+0000 2024-09-11T00:22:39.745 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/785935192 2024-09-12T00:12:29.560169+0000 2024-09-11T00:22:39.745 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/3305093032 2024-09-12T00:07:09.177090+0000 2024-09-11T00:22:39.745 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/1804659337 2024-09-12T00:12:29.560169+0000 2024-09-11T00:22:39.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.743+0000 7f4417200700 1 -- 172.21.15.111:0/2742157384 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f43f407a6f0 msgr2=0x7f43f407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:39.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.743+0000 7f4417200700 1 --2- 172.21.15.111:0/2742157384 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f43f407a6f0 0x7f43f407cba0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f43fc005fd0 tx=0x7f43fc005d00 comp rx=0 tx=0).stop 2024-09-11T00:22:39.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.743+0000 7f4417200700 1 -- 172.21.15.111:0/2742157384 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4410073070 msgr2=0x7f4410197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:39.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.743+0000 7f4417200700 1 --2- 172.21.15.111:0/2742157384 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4410073070 0x7f4410197f60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f440000b870 tx=0x7f44000056a0 comp rx=0 tx=0).stop 2024-09-11T00:22:39.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.744+0000 7f4417200700 1 -- 172.21.15.111:0/2742157384 shutdown_connections 2024-09-11T00:22:39.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.744+0000 7f4417200700 1 --2- 172.21.15.111:0/2742157384 >> [v2:172.21.15.111:6800/3423099047,v1:172.21.15.111:6801/3423099047] conn(0x7f43f407a6f0 0x7f43f407cba0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:39.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.744+0000 7f4417200700 1 --2- 172.21.15.111:0/2742157384 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4410073070 0x7f4410197f60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:39.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.744+0000 7f4417200700 1 --2- 172.21.15.111:0/2742157384 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4410073980 0x7f44101984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:39.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.744+0000 7f4417200700 1 -- 172.21.15.111:0/2742157384 >> 172.21.15.111:0/2742157384 conn(0x7f44100fbc90 msgr2=0x7f4410106d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:39.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.744+0000 7f4417200700 1 -- 172.21.15.111:0/2742157384 shutdown_connections 2024-09-11T00:22:39.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-11T00:22:39.744+0000 7f4417200700 1 -- 172.21.15.111:0/2742157384 wait complete. 2024-09-11T00:22:39.747 INFO:teuthology.orchestra.run.smithi111.stderr:listed 35 entries 2024-09-11T00:22:40.093 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:39 smithi111 ceph-mon[90842]: pgmap v342: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:40.094 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:39 smithi111 ceph-mon[90842]: from='client.? 172.21.15.111:0/2742157384' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-11T00:22:40.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:39 smithi203 ceph-mon[69002]: pgmap v342: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:40.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:39 smithi203 ceph-mon[69002]: from='client.? 172.21.15.111:0/2742157384' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-11T00:22:40.414 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi111.front.sepia.ceph.com... 2024-09-11T00:22:40.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:22:40.414 DEBUG:teuthology.orchestra.run.smithi111:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-11T00:22:40.474 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T00:22:42.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:41 smithi111 ceph-mon[90842]: pgmap v343: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:42.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:41 smithi203 ceph-mon[69002]: pgmap v343: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:44.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:43 smithi111 ceph-mon[90842]: pgmap v344: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:44.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:43 smithi203 ceph-mon[69002]: pgmap v344: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:45.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:44 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:22:45.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:44 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:22:46.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:45 smithi203 ceph-mon[69002]: pgmap v345: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:46.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:45 smithi111 ceph-mon[90842]: pgmap v345: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:48.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:47 smithi111 ceph-mon[90842]: pgmap v346: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:48.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:47 smithi203 ceph-mon[69002]: pgmap v346: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:50.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:49 smithi111 ceph-mon[90842]: pgmap v347: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:50.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:49 smithi203 ceph-mon[69002]: pgmap v347: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:52.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:51 smithi111 ceph-mon[90842]: pgmap v348: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:52.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:51 smithi203 ceph-mon[69002]: pgmap v348: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:54.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:53 smithi111 ceph-mon[90842]: pgmap v349: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:54.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:53 smithi203 ceph-mon[69002]: pgmap v349: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:56.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:55 smithi111 ceph-mon[90842]: pgmap v350: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:56.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:55 smithi203 ceph-mon[69002]: pgmap v350: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:58.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:57 smithi203 ceph-mon[69002]: pgmap v351: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:22:58.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:57 smithi111 ceph-mon[90842]: pgmap v351: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:00.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:22:59 smithi111 ceph-mon[90842]: pgmap v352: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:00.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:22:59 smithi203 ceph-mon[69002]: pgmap v352: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:01.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:00 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:23:01.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:00 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:23:02.110 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:01 smithi111 ceph-mon[90842]: pgmap v353: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:02.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:01 smithi203 ceph-mon[69002]: pgmap v353: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:04.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:03 smithi111 ceph-mon[90842]: pgmap v354: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:04.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:03 smithi203 ceph-mon[69002]: pgmap v354: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:06.097 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:05 smithi203 ceph-mon[69002]: pgmap v355: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:06.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:05 smithi111 ceph-mon[90842]: pgmap v355: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:08.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:07 smithi111 ceph-mon[90842]: pgmap v356: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:08.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:07 smithi203 ceph-mon[69002]: pgmap v356: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:10.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:09 smithi111 ceph-mon[90842]: pgmap v357: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:10.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:09 smithi203 ceph-mon[69002]: pgmap v357: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:12.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:11 smithi111 ceph-mon[90842]: pgmap v358: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:12.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:11 smithi203 ceph-mon[69002]: pgmap v358: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:14.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:13 smithi111 ceph-mon[90842]: pgmap v359: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:14.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:13 smithi203 ceph-mon[69002]: pgmap v359: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:15.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:14 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:23:15.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:14 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:23:16.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:15 smithi203 ceph-mon[69002]: pgmap v360: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:16.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:15 smithi111 ceph-mon[90842]: pgmap v360: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:18.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:17 smithi111 ceph-mon[90842]: pgmap v361: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:18.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:17 smithi203 ceph-mon[69002]: pgmap v361: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:20.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:19 smithi111 ceph-mon[90842]: pgmap v362: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:20.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:19 smithi203 ceph-mon[69002]: pgmap v362: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:22.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:21 smithi111 ceph-mon[90842]: pgmap v363: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:22.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:21 smithi203 ceph-mon[69002]: pgmap v363: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:24.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:23 smithi111 ceph-mon[90842]: pgmap v364: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:24.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:23 smithi203 ceph-mon[69002]: pgmap v364: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:26.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:25 smithi111 ceph-mon[90842]: pgmap v365: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:26.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:25 smithi203 ceph-mon[69002]: pgmap v365: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:28.130 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:27 smithi203 ceph-mon[69002]: pgmap v366: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:28.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:27 smithi111 ceph-mon[90842]: pgmap v366: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:29.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:29 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:23:29.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:29 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:23:30.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:30 smithi203 ceph-mon[69002]: pgmap v367: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:30.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:23:30.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:23:30.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:23:30.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:23:30.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:30 smithi111 ceph-mon[90842]: pgmap v367: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:23:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:23:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:23:30.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:23:32.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:31 smithi111 ceph-mon[90842]: pgmap v368: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:32.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:31 smithi203 ceph-mon[69002]: pgmap v368: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:34.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:33 smithi111 ceph-mon[90842]: pgmap v369: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:34.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:33 smithi203 ceph-mon[69002]: pgmap v369: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:36.097 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:35 smithi203 ceph-mon[69002]: pgmap v370: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:36.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:35 smithi111 ceph-mon[90842]: pgmap v370: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:38.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:37 smithi111 ceph-mon[90842]: pgmap v371: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:38.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:37 smithi203 ceph-mon[69002]: pgmap v371: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:40.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:39 smithi111 ceph-mon[90842]: pgmap v372: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:40.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:39 smithi203 ceph-mon[69002]: pgmap v372: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:42.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:41 smithi111 ceph-mon[90842]: pgmap v373: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:42.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:41 smithi203 ceph-mon[69002]: pgmap v373: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:44.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:43 smithi111 ceph-mon[90842]: pgmap v374: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:44.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:43 smithi203 ceph-mon[69002]: pgmap v374: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:45.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:44 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:23:45.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:44 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:23:46.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:45 smithi203 ceph-mon[69002]: pgmap v375: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:46.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:45 smithi111 ceph-mon[90842]: pgmap v375: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:48.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:47 smithi111 ceph-mon[90842]: pgmap v376: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:48.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:47 smithi203 ceph-mon[69002]: pgmap v376: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:50.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:49 smithi111 ceph-mon[90842]: pgmap v377: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:50.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:49 smithi203 ceph-mon[69002]: pgmap v377: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:52.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:51 smithi111 ceph-mon[90842]: pgmap v378: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:52.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:51 smithi203 ceph-mon[69002]: pgmap v378: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:54.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:53 smithi111 ceph-mon[90842]: pgmap v379: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:54.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:53 smithi203 ceph-mon[69002]: pgmap v379: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:56.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:55 smithi111 ceph-mon[90842]: pgmap v380: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:56.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:55 smithi203 ceph-mon[69002]: pgmap v380: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:58.123 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:57 smithi111 ceph-mon[90842]: pgmap v381: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:23:58.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:57 smithi203 ceph-mon[69002]: pgmap v381: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:00.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:23:59 smithi111 ceph-mon[90842]: pgmap v382: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:00.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:23:59 smithi203 ceph-mon[69002]: pgmap v382: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:01.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:00 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:24:01.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:00 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:24:02.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:01 smithi111 ceph-mon[90842]: pgmap v383: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:02.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:01 smithi203 ceph-mon[69002]: pgmap v383: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:04.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:03 smithi203 ceph-mon[69002]: pgmap v384: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:04.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:03 smithi111 ceph-mon[90842]: pgmap v384: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:06.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:05 smithi111 ceph-mon[90842]: pgmap v385: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:06.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:05 smithi203 ceph-mon[69002]: pgmap v385: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:08.097 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:07 smithi203 ceph-mon[69002]: pgmap v386: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:08.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:07 smithi111 ceph-mon[90842]: pgmap v386: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:10.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:09 smithi111 ceph-mon[90842]: pgmap v387: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:10.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:09 smithi203 ceph-mon[69002]: pgmap v387: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:12.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:11 smithi111 ceph-mon[90842]: pgmap v388: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:12.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:11 smithi203 ceph-mon[69002]: pgmap v388: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:14.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:13 smithi111 ceph-mon[90842]: pgmap v389: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:14.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:13 smithi203 ceph-mon[69002]: pgmap v389: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:15.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:14 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:24:15.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:14 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:24:16.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:15 smithi203 ceph-mon[69002]: pgmap v390: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:16.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:15 smithi111 ceph-mon[90842]: pgmap v390: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:18.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:17 smithi111 ceph-mon[90842]: pgmap v391: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:18.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:17 smithi203 ceph-mon[69002]: pgmap v391: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:20.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:19 smithi111 ceph-mon[90842]: pgmap v392: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:20.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:19 smithi203 ceph-mon[69002]: pgmap v392: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:22.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:21 smithi111 ceph-mon[90842]: pgmap v393: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:22.297 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:21 smithi203 ceph-mon[69002]: pgmap v393: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:24.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:23 smithi111 ceph-mon[90842]: pgmap v394: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:24.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:23 smithi203 ceph-mon[69002]: pgmap v394: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:26.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:25 smithi111 ceph-mon[90842]: pgmap v395: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:26.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:25 smithi203 ceph-mon[69002]: pgmap v395: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:28.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:27 smithi111 ceph-mon[90842]: pgmap v396: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:28.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:27 smithi203 ceph-mon[69002]: pgmap v396: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:30.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:29 smithi111 ceph-mon[90842]: pgmap v397: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:30.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:29 smithi203 ceph-mon[69002]: pgmap v397: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:31.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:24:31.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:24:31.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:24:31.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:24:32.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:31 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:24:32.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:31 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:24:32.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:31 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:24:32.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:31 smithi111 ceph-mon[90842]: pgmap v398: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:32.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:31 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:24:32.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:31 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:24:32.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:31 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:24:32.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:31 smithi203 ceph-mon[69002]: pgmap v398: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:34.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:33 smithi111 ceph-mon[90842]: pgmap v399: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:34.193 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:33 smithi203 ceph-mon[69002]: pgmap v399: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:36.165 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:35 smithi111 ceph-mon[90842]: pgmap v400: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:36.303 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:35 smithi203 ceph-mon[69002]: pgmap v400: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:38.096 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:37 smithi203 ceph-mon[69002]: pgmap v401: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:38.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:37 smithi111 ceph-mon[90842]: pgmap v401: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:40.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:39 smithi111 ceph-mon[90842]: pgmap v402: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:40.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:39 smithi203 ceph-mon[69002]: pgmap v402: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:42.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:41 smithi111 ceph-mon[90842]: pgmap v403: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:42.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:41 smithi203 ceph-mon[69002]: pgmap v403: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:44.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:43 smithi111 ceph-mon[90842]: pgmap v404: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:44.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:43 smithi203 ceph-mon[69002]: pgmap v404: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:45.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:44 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:24:45.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:44 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:24:46.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:45 smithi203 ceph-mon[69002]: pgmap v405: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:46.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:45 smithi111 ceph-mon[90842]: pgmap v405: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:48.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:47 smithi111 ceph-mon[90842]: pgmap v406: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:48.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:47 smithi203 ceph-mon[69002]: pgmap v406: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:50.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:49 smithi111 ceph-mon[90842]: pgmap v407: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:50.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:49 smithi203 ceph-mon[69002]: pgmap v407: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:52.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:51 smithi111 ceph-mon[90842]: pgmap v408: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:52.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:51 smithi203 ceph-mon[69002]: pgmap v408: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:54.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:53 smithi111 ceph-mon[90842]: pgmap v409: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:54.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:53 smithi203 ceph-mon[69002]: pgmap v409: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:56.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:55 smithi111 ceph-mon[90842]: pgmap v410: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:56.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:55 smithi203 ceph-mon[69002]: pgmap v410: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:58.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:57 smithi111 ceph-mon[90842]: pgmap v411: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:24:58.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:57 smithi203 ceph-mon[69002]: pgmap v411: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:00.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:24:59 smithi203 ceph-mon[69002]: pgmap v412: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:00.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:24:59 smithi111 ceph-mon[90842]: pgmap v412: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:01.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:00 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:25:01.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:00 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:25:02.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:01 smithi111 ceph-mon[90842]: pgmap v413: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:02.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:01 smithi203 ceph-mon[69002]: pgmap v413: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:04.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:03 smithi111 ceph-mon[90842]: pgmap v414: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:04.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:03 smithi203 ceph-mon[69002]: pgmap v414: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:06.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:05 smithi111 ceph-mon[90842]: pgmap v415: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:06.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:05 smithi203 ceph-mon[69002]: pgmap v415: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:08.098 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:07 smithi203 ceph-mon[69002]: pgmap v416: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:08.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:07 smithi111 ceph-mon[90842]: pgmap v416: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:10.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:09 smithi203 ceph-mon[69002]: pgmap v417: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:10.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:09 smithi111 ceph-mon[90842]: pgmap v417: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:12.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:11 smithi111 ceph-mon[90842]: pgmap v418: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:12.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:11 smithi203 ceph-mon[69002]: pgmap v418: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:14.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:13 smithi111 ceph-mon[90842]: pgmap v419: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:14.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:13 smithi203 ceph-mon[69002]: pgmap v419: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:15.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:14 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:25:15.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:14 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:25:16.304 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:15 smithi203 ceph-mon[69002]: pgmap v420: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:16.636 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:15 smithi111 ceph-mon[90842]: pgmap v420: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:18.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:17 smithi111 ceph-mon[90842]: pgmap v421: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:18.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:17 smithi203 ceph-mon[69002]: pgmap v421: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:20.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:19 smithi111 ceph-mon[90842]: pgmap v422: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:20.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:19 smithi203 ceph-mon[69002]: pgmap v422: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:22.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:21 smithi111 ceph-mon[90842]: pgmap v423: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:22.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:21 smithi203 ceph-mon[69002]: pgmap v423: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:24.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:23 smithi111 ceph-mon[90842]: pgmap v424: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:24.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:23 smithi203 ceph-mon[69002]: pgmap v424: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:26.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:25 smithi111 ceph-mon[90842]: pgmap v425: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:26.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:25 smithi203 ceph-mon[69002]: pgmap v425: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:28.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:27 smithi111 ceph-mon[90842]: pgmap v426: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:28.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:27 smithi203 ceph-mon[69002]: pgmap v426: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:30.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:29 smithi111 ceph-mon[90842]: pgmap v427: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:30.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:29 smithi203 ceph-mon[69002]: pgmap v427: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:31.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:25:31.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:25:32.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:31 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:25:32.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:31 smithi111 ceph-mon[90842]: pgmap v428: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:32.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:31 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:25:32.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:31 smithi203 ceph-mon[69002]: pgmap v428: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:33.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:32 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:25:33.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:32 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:25:33.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:32 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:25:33.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:32 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:25:33.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:32 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:25:33.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:32 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:25:34.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:33 smithi111 ceph-mon[90842]: pgmap v429: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:34.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:33 smithi203 ceph-mon[69002]: pgmap v429: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:36.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:35 smithi111 ceph-mon[90842]: pgmap v430: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:36.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:35 smithi203 ceph-mon[69002]: pgmap v430: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:38.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:37 smithi111 ceph-mon[90842]: pgmap v431: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:38.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:37 smithi203 ceph-mon[69002]: pgmap v431: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:40.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:39 smithi111 ceph-mon[90842]: pgmap v432: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:40.263 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:39 smithi203 ceph-mon[69002]: pgmap v432: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:42.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:41 smithi111 ceph-mon[90842]: pgmap v433: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:42.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:41 smithi203 ceph-mon[69002]: pgmap v433: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:44.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:43 smithi111 ceph-mon[90842]: pgmap v434: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:44.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:43 smithi203 ceph-mon[69002]: pgmap v434: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:45.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:44 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:25:45.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:44 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:25:46.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:45 smithi203 ceph-mon[69002]: pgmap v435: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:46.403 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:45 smithi111 ceph-mon[90842]: pgmap v435: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:48.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:47 smithi111 ceph-mon[90842]: pgmap v436: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:48.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:47 smithi203 ceph-mon[69002]: pgmap v436: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:50.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:49 smithi111 ceph-mon[90842]: pgmap v437: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:50.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:49 smithi203 ceph-mon[69002]: pgmap v437: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:52.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:51 smithi111 ceph-mon[90842]: pgmap v438: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:52.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:51 smithi203 ceph-mon[69002]: pgmap v438: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:54.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:53 smithi111 ceph-mon[90842]: pgmap v439: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:54.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:53 smithi203 ceph-mon[69002]: pgmap v439: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:56.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:55 smithi111 ceph-mon[90842]: pgmap v440: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:56.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:55 smithi203 ceph-mon[69002]: pgmap v440: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:58.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:57 smithi111 ceph-mon[90842]: pgmap v441: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:25:58.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:57 smithi203 ceph-mon[69002]: pgmap v441: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:00.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:25:59 smithi111 ceph-mon[90842]: pgmap v442: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:00.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:25:59 smithi203 ceph-mon[69002]: pgmap v442: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:01.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:00 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:26:01.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:00 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:26:02.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:01 smithi111 ceph-mon[90842]: pgmap v443: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:02.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:01 smithi203 ceph-mon[69002]: pgmap v443: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:04.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:03 smithi111 ceph-mon[90842]: pgmap v444: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:04.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:03 smithi203 ceph-mon[69002]: pgmap v444: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:06.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:05 smithi203 ceph-mon[69002]: pgmap v445: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:06.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:05 smithi111 ceph-mon[90842]: pgmap v445: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:08.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:07 smithi111 ceph-mon[90842]: pgmap v446: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:08.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:07 smithi203 ceph-mon[69002]: pgmap v446: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:10.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:09 smithi111 ceph-mon[90842]: pgmap v447: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:10.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:09 smithi203 ceph-mon[69002]: pgmap v447: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:12.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:11 smithi111 ceph-mon[90842]: pgmap v448: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:12.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:11 smithi203 ceph-mon[69002]: pgmap v448: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:14.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:13 smithi111 ceph-mon[90842]: pgmap v449: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:14.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:13 smithi203 ceph-mon[69002]: pgmap v449: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:15.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:14 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:26:15.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:14 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:26:16.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:15 smithi203 ceph-mon[69002]: pgmap v450: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:16.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:15 smithi111 ceph-mon[90842]: pgmap v450: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:18.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:17 smithi111 ceph-mon[90842]: pgmap v451: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:18.296 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:17 smithi203 ceph-mon[69002]: pgmap v451: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:20.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:19 smithi111 ceph-mon[90842]: pgmap v452: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:20.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:19 smithi203 ceph-mon[69002]: pgmap v452: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:22.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:21 smithi111 ceph-mon[90842]: pgmap v453: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:22.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:21 smithi203 ceph-mon[69002]: pgmap v453: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:24.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:23 smithi111 ceph-mon[90842]: pgmap v454: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:24.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:23 smithi203 ceph-mon[69002]: pgmap v454: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:26.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:25 smithi111 ceph-mon[90842]: pgmap v455: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:26.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:25 smithi203 ceph-mon[69002]: pgmap v455: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:28.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:27 smithi111 ceph-mon[90842]: pgmap v456: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:28.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:27 smithi203 ceph-mon[69002]: pgmap v456: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:30.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:29 smithi111 ceph-mon[90842]: pgmap v457: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:30.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:29 smithi203 ceph-mon[69002]: pgmap v457: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:31.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:26:31.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:26:32.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:31 smithi111 ceph-mon[90842]: pgmap v458: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:32.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:31 smithi203 ceph-mon[69002]: pgmap v458: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:33.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:32 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:26:33.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:32 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:26:34.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:33 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:26:34.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:33 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:26:34.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:33 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:26:34.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:33 smithi111 ceph-mon[90842]: pgmap v459: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:34.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:33 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:26:34.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:33 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:26:34.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:33 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:26:34.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:33 smithi203 ceph-mon[69002]: pgmap v459: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:36.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:35 smithi111 ceph-mon[90842]: pgmap v460: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:36.164 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:35 smithi203 ceph-mon[69002]: pgmap v460: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:38.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:37 smithi111 ceph-mon[90842]: pgmap v461: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:38.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:37 smithi203 ceph-mon[69002]: pgmap v461: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:40.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:39 smithi111 ceph-mon[90842]: pgmap v462: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:40.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:39 smithi203 ceph-mon[69002]: pgmap v462: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:42.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:41 smithi111 ceph-mon[90842]: pgmap v463: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:42.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:41 smithi203 ceph-mon[69002]: pgmap v463: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:44.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:43 smithi111 ceph-mon[90842]: pgmap v464: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:44.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:43 smithi203 ceph-mon[69002]: pgmap v464: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:45.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:44 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:26:45.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:44 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:26:46.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:45 smithi203 ceph-mon[69002]: pgmap v465: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:46.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:45 smithi111 ceph-mon[90842]: pgmap v465: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:48.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:47 smithi111 ceph-mon[90842]: pgmap v466: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:48.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:47 smithi203 ceph-mon[69002]: pgmap v466: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:50.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:49 smithi111 ceph-mon[90842]: pgmap v467: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:50.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:49 smithi203 ceph-mon[69002]: pgmap v467: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:52.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:51 smithi111 ceph-mon[90842]: pgmap v468: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:52.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:51 smithi203 ceph-mon[69002]: pgmap v468: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:54.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:53 smithi111 ceph-mon[90842]: pgmap v469: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:54.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:53 smithi203 ceph-mon[69002]: pgmap v469: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:56.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:55 smithi111 ceph-mon[90842]: pgmap v470: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:56.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:55 smithi203 ceph-mon[69002]: pgmap v470: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:58.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:57 smithi111 ceph-mon[90842]: pgmap v471: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:26:58.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:57 smithi203 ceph-mon[69002]: pgmap v471: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:00.154 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:26:59 smithi111 ceph-mon[90842]: pgmap v472: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:00.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:26:59 smithi203 ceph-mon[69002]: pgmap v472: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:01.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:00 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:27:01.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:00 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:27:02.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:01 smithi111 ceph-mon[90842]: pgmap v473: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:02.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:01 smithi203 ceph-mon[69002]: pgmap v473: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:04.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:03 smithi111 ceph-mon[90842]: pgmap v474: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:04.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:03 smithi203 ceph-mon[69002]: pgmap v474: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:06.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:05 smithi111 ceph-mon[90842]: pgmap v475: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:06.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:05 smithi203 ceph-mon[69002]: pgmap v475: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:08.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:08 smithi111 ceph-mon[90842]: pgmap v476: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:08.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:08 smithi203 ceph-mon[69002]: pgmap v476: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:10.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:09 smithi111 ceph-mon[90842]: pgmap v477: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:10.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:09 smithi203 ceph-mon[69002]: pgmap v477: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:11.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:11 smithi111 ceph-mon[90842]: pgmap v478: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:12.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:11 smithi203 ceph-mon[69002]: pgmap v478: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:14.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:13 smithi111 ceph-mon[90842]: pgmap v479: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:14.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:13 smithi203 ceph-mon[69002]: pgmap v479: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:15.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:14 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:27:15.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:14 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:27:16.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:15 smithi203 ceph-mon[69002]: pgmap v480: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:16.402 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:15 smithi111 ceph-mon[90842]: pgmap v480: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:18.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:17 smithi111 ceph-mon[90842]: pgmap v481: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:18.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:17 smithi203 ceph-mon[69002]: pgmap v481: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:20.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:19 smithi111 ceph-mon[90842]: pgmap v482: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:20.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:19 smithi203 ceph-mon[69002]: pgmap v482: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:22.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:21 smithi111 ceph-mon[90842]: pgmap v483: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:22.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:21 smithi203 ceph-mon[69002]: pgmap v483: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:24.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:23 smithi111 ceph-mon[90842]: pgmap v484: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:24.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:23 smithi203 ceph-mon[69002]: pgmap v484: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:26.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:25 smithi111 ceph-mon[90842]: pgmap v485: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:26.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:25 smithi203 ceph-mon[69002]: pgmap v485: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:28.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:27 smithi111 ceph-mon[90842]: pgmap v486: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:28.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:27 smithi203 ceph-mon[69002]: pgmap v486: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:30.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:29 smithi111 ceph-mon[90842]: pgmap v487: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:30.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:29 smithi203 ceph-mon[69002]: pgmap v487: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:31.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:30 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:27:31.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:30 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-11T00:27:32.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:31 smithi111 ceph-mon[90842]: pgmap v488: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:32.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:31 smithi203 ceph-mon[69002]: pgmap v488: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:33.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:33 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:27:33.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:33 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:27:35.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:34 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:27:35.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:34 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:27:35.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:34 smithi203 ceph-mon[69002]: pgmap v489: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:35.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:34 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:27:35.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:34 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:27:35.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:34 smithi203 ceph-mon[69002]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:27:35.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:34 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:27:35.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:34 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:27:35.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:34 smithi111 ceph-mon[90842]: pgmap v489: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:35.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:34 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:27:35.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:34 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:27:35.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:34 smithi111 ceph-mon[90842]: from='mgr.34104 172.21.15.111:0/1448731983' entity='mgr.smithi111.ypucji' 2024-09-11T00:27:36.152 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:35 smithi111 ceph-mon[90842]: pgmap v490: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:36.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:35 smithi203 ceph-mon[69002]: pgmap v490: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:38.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:37 smithi111 ceph-mon[90842]: pgmap v491: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:38.295 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:37 smithi203 ceph-mon[69002]: pgmap v491: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:39.550 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-09-11T00:27:39.551 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-11T00:27:39.553 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-11T00:27:39.565 INFO:tasks.cephadm:Teardown begin 2024-09-11T00:27:39.565 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/cephadm.py", line 2374, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-11T00:27:39.568 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T00:27:39.634 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T00:27:39.700 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-11T00:27:39.701 DEBUG:teuthology.orchestra.run.smithi111:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T00:27:39.739 DEBUG:teuthology.orchestra.run.smithi203:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T00:27:39.776 INFO:tasks.cephadm:Stopping all daemons... 2024-09-11T00:27:39.776 INFO:tasks.cephadm.mon.smithi111:Stopping mon.smithi111... 2024-09-11T00:27:39.776 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@mon.smithi111 2024-09-11T00:27:40.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:39 smithi203 ceph-mon[69002]: pgmap v492: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:40.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:39 smithi111 systemd[1]: Stopping Ceph mon.smithi111 for 03107fbe-6fd0-11ef-bcea-c7b262605968... 2024-09-11T00:27:40.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:39 smithi111 ceph-mon[90842]: pgmap v492: 65 pgs: 65 active+clean; 258 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-11T00:27:40.486 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:40 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi111[90838]: 2024-09-11T00:27:40.194+0000 7f286b000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi111 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:27:40.486 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:40 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi111[90838]: 2024-09-11T00:27:40.194+0000 7f286b000640 -1 mon.smithi111@0(leader) e3 *** Got Signal Terminated *** 2024-09-11T00:27:40.486 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:40 smithi111 podman[139188]: 2024-09-11 00:27:40.256443869 +0000 UTC m=+0.192661879 container died 3c29c070a612fa5bacaa84d5b13e4acaba33e812f503dab77fd20141913f5a6a (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi111, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True) 2024-09-11T00:27:41.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:40 smithi111 podman[139188]: 2024-09-11 00:27:40.758518462 +0000 UTC m=+0.694736468 container cleanup 3c29c070a612fa5bacaa84d5b13e4acaba33e812f503dab77fd20141913f5a6a (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi111, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-11T00:27:41.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:40 smithi111 bash[139188]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi111 2024-09-11T00:27:41.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 11 00:27:41 smithi111 podman[139199]: 2024-09-11 00:27:41.002033231 +0000 UTC m=+0.737646492 container remove 3c29c070a612fa5bacaa84d5b13e4acaba33e812f503dab77fd20141913f5a6a (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi111, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-11T00:27:41.184 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@mon.smithi111.service' 2024-09-11T00:27:41.271 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:27:41.272 INFO:tasks.cephadm.mon.smithi111:Stopped mon.smithi111 2024-09-11T00:27:41.272 INFO:tasks.cephadm.mon.smithi203:Stopping mon.smithi203... 2024-09-11T00:27:41.272 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@mon.smithi203 2024-09-11T00:27:41.728 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:41 smithi203 systemd[1]: Stopping Ceph mon.smithi203 for 03107fbe-6fd0-11ef-bcea-c7b262605968... 2024-09-11T00:27:42.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:41 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi203[68998]: 2024-09-11T00:27:41.726+0000 7fb7b8e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi203 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:27:42.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:41 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi203[68998]: 2024-09-11T00:27:41.726+0000 7fb7b8e00640 -1 mon.smithi203@1(peon) e3 *** Got Signal Terminated *** 2024-09-11T00:27:42.045 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:41 smithi203 podman[105729]: 2024-09-11 00:27:41.952248958 +0000 UTC m=+0.385796899 container died 45e8285e4b4dbc8497c2c1a054aea33a8768d4b88f3a0afc76880c3338fc12cc (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi203, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:27:42.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:42 smithi203 podman[105729]: 2024-09-11 00:27:42.490290615 +0000 UTC m=+0.923838554 container cleanup 45e8285e4b4dbc8497c2c1a054aea33a8768d4b88f3a0afc76880c3338fc12cc (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi203, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:27:42.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:42 smithi203 bash[105729]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi203 2024-09-11T00:27:42.795 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Sep 11 00:27:42 smithi203 podman[105743]: 2024-09-11 00:27:42.725562987 +0000 UTC m=+0.763747527 container remove 45e8285e4b4dbc8497c2c1a054aea33a8768d4b88f3a0afc76880c3338fc12cc (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-mon-smithi203, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True) 2024-09-11T00:27:42.985 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@mon.smithi203.service' 2024-09-11T00:27:43.084 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:27:43.084 INFO:tasks.cephadm.mon.smithi203:Stopped mon.smithi203 2024-09-11T00:27:43.084 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-11T00:27:43.084 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.0 2024-09-11T00:27:43.402 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:27:43 smithi111 systemd[1]: Stopping Ceph osd.0 for 03107fbe-6fd0-11ef-bcea-c7b262605968... 2024-09-11T00:27:43.766 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:27:43 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0[102351]: 2024-09-11T00:27:43.491+0000 7f4267000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:27:43.766 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:27:43 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0[102351]: 2024-09-11T00:27:43.491+0000 7f4267000640 -1 osd.0 84 *** Got signal Terminated *** 2024-09-11T00:27:43.766 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:27:43 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0[102351]: 2024-09-11T00:27:43.491+0000 7f4267000640 -1 osd.0 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:27:49.335 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:27:49 smithi111 podman[139329]: 2024-09-11 00:27:49.043268989 +0000 UTC m=+5.682016107 container died d2f1a23127364f27a720063e69704fa78afee83f8722b15bc7c924739f65d817 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-11T00:27:49.652 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:27:49 smithi111 podman[139329]: 2024-09-11 00:27:49.462937199 +0000 UTC m=+6.101684317 container cleanup d2f1a23127364f27a720063e69704fa78afee83f8722b15bc7c924739f65d817 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:27:49.653 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:27:49 smithi111 bash[139329]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0 2024-09-11T00:27:50.152 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:27:49 smithi111 podman[139348]: 2024-09-11 00:27:49.675455118 +0000 UTC m=+0.620250351 container remove d2f1a23127364f27a720063e69704fa78afee83f8722b15bc7c924739f65d817 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS) 2024-09-11T00:27:50.486 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:27:50 smithi111 podman[139437]: 2024-09-11 00:27:50.135676811 +0000 UTC m=+0.027356576 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:27:50.486 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:27:50 smithi111 podman[139437]: 2024-09-11 00:27:50.240253435 +0000 UTC m=+0.131933193 container create bb414f7f1cc3b92ca7a08d9d0f6ae1cd2a3dc14bd7ed09da008d65df93f60f17 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:27:50.486 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:27:50 smithi111 podman[139437]: 2024-09-11 00:27:50.484825268 +0000 UTC m=+0.376505026 container init bb414f7f1cc3b92ca7a08d9d0f6ae1cd2a3dc14bd7ed09da008d65df93f60f17 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-11T00:27:50.753 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:27:50 smithi111 podman[139437]: 2024-09-11 00:27:50.491756577 +0000 UTC m=+0.383436338 container start bb414f7f1cc3b92ca7a08d9d0f6ae1cd2a3dc14bd7ed09da008d65df93f60f17 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0) 2024-09-11T00:27:50.753 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:27:50 smithi111 podman[139437]: 2024-09-11 00:27:50.567644168 +0000 UTC m=+0.459323934 container attach bb414f7f1cc3b92ca7a08d9d0f6ae1cd2a3dc14bd7ed09da008d65df93f60f17 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-11T00:27:51.138 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 11 00:27:50 smithi111 podman[139437]: 2024-09-11 00:27:50.752751124 +0000 UTC m=+0.644430894 container died bb414f7f1cc3b92ca7a08d9d0f6ae1cd2a3dc14bd7ed09da008d65df93f60f17 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux ) 2024-09-11T00:27:51.478 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.0.service' 2024-09-11T00:27:51.556 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:27:51.556 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-11T00:27:51.557 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-11T00:27:51.557 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.1 2024-09-11T00:27:51.902 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:27:51 smithi111 systemd[1]: Stopping Ceph osd.1 for 03107fbe-6fd0-11ef-bcea-c7b262605968... 2024-09-11T00:27:52.341 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:27:51 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1[108181]: 2024-09-11T00:27:51.986+0000 7f514de00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:27:52.341 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:27:51 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1[108181]: 2024-09-11T00:27:51.986+0000 7f514de00640 -1 osd.1 84 *** Got signal Terminated *** 2024-09-11T00:27:52.341 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:27:51 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1[108181]: 2024-09-11T00:27:51.986+0000 7f514de00640 -1 osd.1 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:27:57.653 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:27:57 smithi111 podman[139541]: 2024-09-11 00:27:57.449746769 +0000 UTC m=+5.601638640 container died 19cf95ecca7d1f063b47c18bb705fa974976936bae6fb0831d19d8bf49f74a96 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:27:58.152 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:27:57 smithi111 podman[139541]: 2024-09-11 00:27:57.849582344 +0000 UTC m=+6.001474212 container cleanup 19cf95ecca7d1f063b47c18bb705fa974976936bae6fb0831d19d8bf49f74a96 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-11T00:27:58.153 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:27:57 smithi111 bash[139541]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1 2024-09-11T00:27:58.652 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:27:58 smithi111 podman[139560]: 2024-09-11 00:27:58.250816963 +0000 UTC m=+0.791373355 container remove 19cf95ecca7d1f063b47c18bb705fa974976936bae6fb0831d19d8bf49f74a96 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-11T00:27:59.047 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:27:58 smithi111 podman[139649]: 2024-09-11 00:27:58.67377868 +0000 UTC m=+0.027908384 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:27:59.047 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:27:58 smithi111 podman[139649]: 2024-09-11 00:27:58.785171945 +0000 UTC m=+0.139301664 container create b5062d6871ae08b04f1e148efd4d81713af4cf2bc23b4cff00cc006d3ed13856 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-11T00:27:59.047 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:27:59 smithi111 podman[139649]: 2024-09-11 00:27:59.046545301 +0000 UTC m=+0.400675006 container init b5062d6871ae08b04f1e148efd4d81713af4cf2bc23b4cff00cc006d3ed13856 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:27:59.314 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:27:59 smithi111 podman[139649]: 2024-09-11 00:27:59.054562632 +0000 UTC m=+0.408692340 container start b5062d6871ae08b04f1e148efd4d81713af4cf2bc23b4cff00cc006d3ed13856 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-11T00:27:59.314 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:27:59 smithi111 podman[139649]: 2024-09-11 00:27:59.162992981 +0000 UTC m=+0.517122714 container attach b5062d6871ae08b04f1e148efd4d81713af4cf2bc23b4cff00cc006d3ed13856 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-11T00:27:59.652 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 11 00:27:59 smithi111 podman[139649]: 2024-09-11 00:27:59.313357894 +0000 UTC m=+0.667487612 container died b5062d6871ae08b04f1e148efd4d81713af4cf2bc23b4cff00cc006d3ed13856 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:28:00.039 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.1.service' 2024-09-11T00:28:00.117 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:28:00.117 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-11T00:28:00.117 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-11T00:28:00.117 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.2 2024-09-11T00:28:00.402 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:28:00 smithi111 systemd[1]: Stopping Ceph osd.2 for 03107fbe-6fd0-11ef-bcea-c7b262605968... 2024-09-11T00:28:00.902 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:28:00 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2[113580]: 2024-09-11T00:28:00.522+0000 7fdd53e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:28:00.903 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:28:00 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2[113580]: 2024-09-11T00:28:00.522+0000 7fdd53e00640 -1 osd.2 84 *** Got signal Terminated *** 2024-09-11T00:28:00.903 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:28:00 smithi111 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2[113580]: 2024-09-11T00:28:00.522+0000 7fdd53e00640 -1 osd.2 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:28:06.153 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:28:05 smithi111 podman[139761]: 2024-09-11 00:28:05.862447036 +0000 UTC m=+5.466422926 container died 3a3b318b337a827490ba55dcbccbc66e31c82fabb28fd615a7325eec49d524b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True) 2024-09-11T00:28:06.505 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:28:06 smithi111 podman[139761]: 2024-09-11 00:28:06.311659392 +0000 UTC m=+5.915635289 container cleanup 3a3b318b337a827490ba55dcbccbc66e31c82fabb28fd615a7325eec49d524b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-11T00:28:06.505 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:28:06 smithi111 bash[139761]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2 2024-09-11T00:28:06.902 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:28:06 smithi111 podman[139781]: 2024-09-11 00:28:06.50429901 +0000 UTC m=+0.631795694 container remove 3a3b318b337a827490ba55dcbccbc66e31c82fabb28fd615a7325eec49d524b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-11T00:28:07.359 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:28:07 smithi111 podman[139869]: 2024-09-11 00:28:07.063504144 +0000 UTC m=+0.116477439 container create 9ee90362dfd56d785aaca0a1a3a5d3de8c0d2823bc4696f171587d4ab91dce02 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-11T00:28:07.359 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:28:07 smithi111 podman[139869]: 2024-09-11 00:28:06.978065485 +0000 UTC m=+0.031038781 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:28:07.632 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:28:07 smithi111 podman[139869]: 2024-09-11 00:28:07.357972154 +0000 UTC m=+0.410945450 container init 9ee90362dfd56d785aaca0a1a3a5d3de8c0d2823bc4696f171587d4ab91dce02 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-11T00:28:07.632 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:28:07 smithi111 podman[139869]: 2024-09-11 00:28:07.364773397 +0000 UTC m=+0.417746693 container start 9ee90362dfd56d785aaca0a1a3a5d3de8c0d2823bc4696f171587d4ab91dce02 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:28:07.632 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:28:07 smithi111 podman[139869]: 2024-09-11 00:28:07.440926228 +0000 UTC m=+0.493899525 container attach 9ee90362dfd56d785aaca0a1a3a5d3de8c0d2823bc4696f171587d4ab91dce02 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-11T00:28:07.902 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 11 00:28:07 smithi111 podman[139869]: 2024-09-11 00:28:07.631036502 +0000 UTC m=+0.684009815 container died 9ee90362dfd56d785aaca0a1a3a5d3de8c0d2823bc4696f171587d4ab91dce02 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-11T00:28:08.252 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.2.service' 2024-09-11T00:28:08.329 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:28:08.329 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-11T00:28:08.329 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-11T00:28:08.329 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.3 2024-09-11T00:28:08.732 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:28:08 smithi203 systemd[1]: Stopping Ceph osd.3 for 03107fbe-6fd0-11ef-bcea-c7b262605968... 2024-09-11T00:28:09.045 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:28:08 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3[78746]: 2024-09-11T00:28:08.730+0000 7f7efa000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:28:09.045 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:28:08 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3[78746]: 2024-09-11T00:28:08.730+0000 7f7efa000640 -1 osd.3 84 *** Got signal Terminated *** 2024-09-11T00:28:09.045 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:28:08 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3[78746]: 2024-09-11T00:28:08.730+0000 7f7efa000640 -1 osd.3 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:28:10.795 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:28:10 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3[78746]: 2024-09-11T00:28:10.392+0000 7f7ef5a00640 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:44.489296+0000 front 2024-09-11T00:27:44.489303+0000 (oldest deadline 2024-09-11T00:28:09.789266+0000) 2024-09-11T00:28:11.295 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:10 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:10.827+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:45.818183+0000 front 2024-09-11T00:27:45.818219+0000 (oldest deadline 2024-09-11T00:28:10.517911+0000) 2024-09-11T00:28:11.795 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:28:11 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3[78746]: 2024-09-11T00:28:11.439+0000 7f7ef5a00640 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:44.489296+0000 front 2024-09-11T00:27:44.489303+0000 (oldest deadline 2024-09-11T00:28:09.789266+0000) 2024-09-11T00:28:12.295 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:11 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:11.835+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:45.818183+0000 front 2024-09-11T00:27:45.818219+0000 (oldest deadline 2024-09-11T00:28:10.517911+0000) 2024-09-11T00:28:12.678 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:28:12 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3[78746]: 2024-09-11T00:28:12.408+0000 7f7ef5a00640 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:44.489296+0000 front 2024-09-11T00:27:44.489303+0000 (oldest deadline 2024-09-11T00:28:09.789266+0000) 2024-09-11T00:28:13.045 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:12 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:12.848+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:45.818183+0000 front 2024-09-11T00:27:45.818219+0000 (oldest deadline 2024-09-11T00:28:10.517911+0000) 2024-09-11T00:28:13.795 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:28:13 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3[78746]: 2024-09-11T00:28:13.457+0000 7f7ef5a00640 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:44.489296+0000 front 2024-09-11T00:27:44.489303+0000 (oldest deadline 2024-09-11T00:28:09.789266+0000) 2024-09-11T00:28:13.795 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:28:13 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4[83616]: 2024-09-11T00:28:13.536+0000 7f274ae00640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:48.212703+0000 front 2024-09-11T00:27:48.212651+0000 (oldest deadline 2024-09-11T00:28:12.912415+0000) 2024-09-11T00:28:14.295 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:28:14 smithi203 podman[105866]: 2024-09-11 00:28:14.062353705 +0000 UTC m=+5.440463444 container died 288c7e8ae34bb71214d6e7ab9184b150c0d0da9ed59b92f6be0133d3ad959132 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-11T00:28:14.296 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:13 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:13.879+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:45.818183+0000 front 2024-09-11T00:27:45.818219+0000 (oldest deadline 2024-09-11T00:28:10.517911+0000) 2024-09-11T00:28:14.647 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:28:14 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4[83616]: 2024-09-11T00:28:14.552+0000 7f274ae00640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:48.212703+0000 front 2024-09-11T00:27:48.212651+0000 (oldest deadline 2024-09-11T00:28:12.912415+0000) 2024-09-11T00:28:14.647 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:28:14 smithi203 podman[105866]: 2024-09-11 00:28:14.478007961 +0000 UTC m=+5.856117701 container cleanup 288c7e8ae34bb71214d6e7ab9184b150c0d0da9ed59b92f6be0133d3ad959132 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-11T00:28:14.647 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:28:14 smithi203 bash[105866]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3 2024-09-11T00:28:15.045 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:28:14 smithi203 podman[105881]: 2024-09-11 00:28:14.646144535 +0000 UTC m=+0.576714891 container remove 288c7e8ae34bb71214d6e7ab9184b150c0d0da9ed59b92f6be0133d3ad959132 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-11T00:28:15.045 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:14 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:14.883+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:45.818183+0000 front 2024-09-11T00:27:45.818219+0000 (oldest deadline 2024-09-11T00:28:10.517911+0000) 2024-09-11T00:28:15.501 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:28:15 smithi203 podman[105968]: 2024-09-11 00:28:15.094856592 +0000 UTC m=+0.027447508 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:28:15.501 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:28:15 smithi203 podman[105968]: 2024-09-11 00:28:15.197022399 +0000 UTC m=+0.129613312 container create 0847c989a96543ed55d53317c3d0ba3295bd538978af812d4e4dae9e9dc5f1d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-11T00:28:15.501 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:28:15 smithi203 podman[105968]: 2024-09-11 00:28:15.40846287 +0000 UTC m=+0.341053784 container init 0847c989a96543ed55d53317c3d0ba3295bd538978af812d4e4dae9e9dc5f1d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:28:15.501 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:28:15 smithi203 podman[105968]: 2024-09-11 00:28:15.416279532 +0000 UTC m=+0.348870451 container start 0847c989a96543ed55d53317c3d0ba3295bd538978af812d4e4dae9e9dc5f1d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True) 2024-09-11T00:28:15.501 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:28:15 smithi203 podman[105968]: 2024-09-11 00:28:15.499714552 +0000 UTC m=+0.432305475 container attach 0847c989a96543ed55d53317c3d0ba3295bd538978af812d4e4dae9e9dc5f1d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3-deactivate, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:28:15.795 INFO:journalctl@ceph.osd.3.smithi203.stdout:Sep 11 00:28:15 smithi203 podman[105968]: 2024-09-11 00:28:15.682323728 +0000 UTC m=+0.614914643 container died 0847c989a96543ed55d53317c3d0ba3295bd538978af812d4e4dae9e9dc5f1d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:28:15.796 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:28:15 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4[83616]: 2024-09-11T00:28:15.553+0000 7f274ae00640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:48.212703+0000 front 2024-09-11T00:27:48.212651+0000 (oldest deadline 2024-09-11T00:28:12.912415+0000) 2024-09-11T00:28:16.295 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:15 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:15.931+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:45.818183+0000 front 2024-09-11T00:27:45.818219+0000 (oldest deadline 2024-09-11T00:28:10.517911+0000) 2024-09-11T00:28:16.425 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.3.service' 2024-09-11T00:28:16.501 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:28:16.502 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-11T00:28:16.502 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-11T00:28:16.502 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.4 2024-09-11T00:28:16.954 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:28:16 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4[83616]: 2024-09-11T00:28:16.558+0000 7f274ae00640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:48.212703+0000 front 2024-09-11T00:27:48.212651+0000 (oldest deadline 2024-09-11T00:28:12.912415+0000) 2024-09-11T00:28:16.954 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:28:16 smithi203 systemd[1]: Stopping Ceph osd.4 for 03107fbe-6fd0-11ef-bcea-c7b262605968... 2024-09-11T00:28:16.954 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:28:16 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4[83616]: 2024-09-11T00:28:16.951+0000 7f2754400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:28:16.954 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:28:16 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4[83616]: 2024-09-11T00:28:16.951+0000 7f2754400640 -1 osd.4 84 *** Got signal Terminated *** 2024-09-11T00:28:16.954 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:28:16 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4[83616]: 2024-09-11T00:28:16.951+0000 7f2754400640 -1 osd.4 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:28:17.295 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:16 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:16.953+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:45.818183+0000 front 2024-09-11T00:27:45.818219+0000 (oldest deadline 2024-09-11T00:28:10.517911+0000) 2024-09-11T00:28:17.912 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:28:17 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4[83616]: 2024-09-11T00:28:17.554+0000 7f274ae00640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:48.212703+0000 front 2024-09-11T00:27:48.212651+0000 (oldest deadline 2024-09-11T00:28:12.912415+0000) 2024-09-11T00:28:18.295 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:17 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:17.911+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:45.818183+0000 front 2024-09-11T00:27:45.818219+0000 (oldest deadline 2024-09-11T00:28:10.517911+0000) 2024-09-11T00:28:18.947 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:28:18 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4[83616]: 2024-09-11T00:28:18.574+0000 7f274ae00640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:48.212703+0000 front 2024-09-11T00:27:48.212651+0000 (oldest deadline 2024-09-11T00:28:12.912415+0000) 2024-09-11T00:28:19.295 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:18 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:18.945+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:45.818183+0000 front 2024-09-11T00:27:45.818219+0000 (oldest deadline 2024-09-11T00:28:10.517911+0000) 2024-09-11T00:28:19.295 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:18 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:18.945+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6814 osd.1 since back 2024-09-11T00:27:53.419031+0000 front 2024-09-11T00:27:53.419052+0000 (oldest deadline 2024-09-11T00:28:18.718735+0000) 2024-09-11T00:28:19.897 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:28:19 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4[83616]: 2024-09-11T00:28:19.592+0000 7f274ae00640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:48.212703+0000 front 2024-09-11T00:27:48.212651+0000 (oldest deadline 2024-09-11T00:28:12.912415+0000) 2024-09-11T00:28:19.897 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:28:19 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4[83616]: 2024-09-11T00:28:19.592+0000 7f274ae00640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.111:6814 osd.1 since back 2024-09-11T00:27:55.113709+0000 front 2024-09-11T00:27:55.113723+0000 (oldest deadline 2024-09-11T00:28:19.213602+0000) 2024-09-11T00:28:20.295 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:19 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:19.896+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:45.818183+0000 front 2024-09-11T00:27:45.818219+0000 (oldest deadline 2024-09-11T00:28:10.517911+0000) 2024-09-11T00:28:20.295 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:19 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:19.896+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6814 osd.1 since back 2024-09-11T00:27:53.419031+0000 front 2024-09-11T00:27:53.419052+0000 (oldest deadline 2024-09-11T00:28:18.718735+0000) 2024-09-11T00:28:20.880 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:28:20 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4[83616]: 2024-09-11T00:28:20.597+0000 7f274ae00640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:48.212703+0000 front 2024-09-11T00:27:48.212651+0000 (oldest deadline 2024-09-11T00:28:12.912415+0000) 2024-09-11T00:28:20.880 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:28:20 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4[83616]: 2024-09-11T00:28:20.597+0000 7f274ae00640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.111:6814 osd.1 since back 2024-09-11T00:27:55.113709+0000 front 2024-09-11T00:27:55.113723+0000 (oldest deadline 2024-09-11T00:28:19.213602+0000) 2024-09-11T00:28:21.295 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:20 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:20.878+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:45.818183+0000 front 2024-09-11T00:27:45.818219+0000 (oldest deadline 2024-09-11T00:28:10.517911+0000) 2024-09-11T00:28:21.295 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:20 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:20.878+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6814 osd.1 since back 2024-09-11T00:27:53.419031+0000 front 2024-09-11T00:27:53.419052+0000 (oldest deadline 2024-09-11T00:28:18.718735+0000) 2024-09-11T00:28:22.045 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:28:21 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4[83616]: 2024-09-11T00:28:21.604+0000 7f274ae00640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:48.212703+0000 front 2024-09-11T00:27:48.212651+0000 (oldest deadline 2024-09-11T00:28:12.912415+0000) 2024-09-11T00:28:22.045 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:28:21 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4[83616]: 2024-09-11T00:28:21.604+0000 7f274ae00640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.111:6814 osd.1 since back 2024-09-11T00:27:55.113709+0000 front 2024-09-11T00:27:55.113723+0000 (oldest deadline 2024-09-11T00:28:19.213602+0000) 2024-09-11T00:28:22.046 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:21 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:21.848+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:45.818183+0000 front 2024-09-11T00:27:45.818219+0000 (oldest deadline 2024-09-11T00:28:10.517911+0000) 2024-09-11T00:28:22.046 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:21 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:21.848+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6814 osd.1 since back 2024-09-11T00:27:53.419031+0000 front 2024-09-11T00:27:53.419052+0000 (oldest deadline 2024-09-11T00:28:18.718735+0000) 2024-09-11T00:28:22.631 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:28:22 smithi203 podman[106071]: 2024-09-11 00:28:22.327017796 +0000 UTC m=+5.536473773 container died 485f82d3eafba2123f8e5b4605d2f3cb7b8ae4d45cf9e0e729b7549d7045c44a (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-11T00:28:23.018 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:28:22 smithi203 podman[106071]: 2024-09-11 00:28:22.75712897 +0000 UTC m=+5.966584944 container cleanup 485f82d3eafba2123f8e5b4605d2f3cb7b8ae4d45cf9e0e729b7549d7045c44a (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-11T00:28:23.051 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:28:22 smithi203 bash[106071]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4 2024-09-11T00:28:23.052 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:22 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:22.832+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:45.818183+0000 front 2024-09-11T00:27:45.818219+0000 (oldest deadline 2024-09-11T00:28:10.517911+0000) 2024-09-11T00:28:23.052 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:22 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:22.832+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6814 osd.1 since back 2024-09-11T00:27:53.419031+0000 front 2024-09-11T00:27:53.419052+0000 (oldest deadline 2024-09-11T00:28:18.718735+0000) 2024-09-11T00:28:23.295 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:28:23 smithi203 podman[106089]: 2024-09-11 00:28:23.017174098 +0000 UTC m=+0.682346755 container remove 485f82d3eafba2123f8e5b4605d2f3cb7b8ae4d45cf9e0e729b7549d7045c44a (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-11T00:28:23.875 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:28:23 smithi203 podman[106175]: 2024-09-11 00:28:23.576514646 +0000 UTC m=+0.122573799 container create a61193e9e06c4b7d4bc016fda5c1dfc615bcdf78be6d586b92234eee05017f9f (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-11T00:28:23.875 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:28:23 smithi203 podman[106175]: 2024-09-11 00:28:23.481841612 +0000 UTC m=+0.027900764 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:28:23.875 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:28:23 smithi203 podman[106175]: 2024-09-11 00:28:23.804270581 +0000 UTC m=+0.350329755 container init a61193e9e06c4b7d4bc016fda5c1dfc615bcdf78be6d586b92234eee05017f9f (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:28:23.875 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:28:23 smithi203 podman[106175]: 2024-09-11 00:28:23.81098047 +0000 UTC m=+0.357039627 container start a61193e9e06c4b7d4bc016fda5c1dfc615bcdf78be6d586b92234eee05017f9f (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-11T00:28:24.295 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:28:23 smithi203 podman[106175]: 2024-09-11 00:28:23.939002873 +0000 UTC m=+0.485062026 container attach a61193e9e06c4b7d4bc016fda5c1dfc615bcdf78be6d586b92234eee05017f9f (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-11T00:28:24.295 INFO:journalctl@ceph.osd.4.smithi203.stdout:Sep 11 00:28:24 smithi203 podman[106175]: 2024-09-11 00:28:24.075337185 +0000 UTC m=+0.621396339 container died a61193e9e06c4b7d4bc016fda5c1dfc615bcdf78be6d586b92234eee05017f9f (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-4-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-11T00:28:24.295 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:23 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:23.872+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:45.818183+0000 front 2024-09-11T00:27:45.818219+0000 (oldest deadline 2024-09-11T00:28:10.517911+0000) 2024-09-11T00:28:24.295 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:23 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:23.872+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6814 osd.1 since back 2024-09-11T00:27:53.419031+0000 front 2024-09-11T00:27:53.419052+0000 (oldest deadline 2024-09-11T00:28:18.718735+0000) 2024-09-11T00:28:24.744 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.4.service' 2024-09-11T00:28:24.819 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:28:24.820 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-11T00:28:24.820 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-11T00:28:24.820 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.5 2024-09-11T00:28:25.045 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:24 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:24.838+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:45.818183+0000 front 2024-09-11T00:27:45.818219+0000 (oldest deadline 2024-09-11T00:28:10.517911+0000) 2024-09-11T00:28:25.045 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:24 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:24.838+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6814 osd.1 since back 2024-09-11T00:27:53.419031+0000 front 2024-09-11T00:27:53.419052+0000 (oldest deadline 2024-09-11T00:28:18.718735+0000) 2024-09-11T00:28:25.045 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:24 smithi203 systemd[1]: Stopping Ceph osd.5 for 03107fbe-6fd0-11ef-bcea-c7b262605968... 2024-09-11T00:28:25.545 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:25 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:25.263+0000 7fc5e6400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:28:25.545 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:25 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:25.263+0000 7fc5e6400640 -1 osd.5 84 *** Got signal Terminated *** 2024-09-11T00:28:25.545 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:25 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:25.263+0000 7fc5e6400640 -1 osd.5 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:28:26.295 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:25 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:25.838+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:45.818183+0000 front 2024-09-11T00:27:45.818219+0000 (oldest deadline 2024-09-11T00:28:10.517911+0000) 2024-09-11T00:28:26.295 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:25 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:25.838+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6814 osd.1 since back 2024-09-11T00:27:53.419031+0000 front 2024-09-11T00:27:53.419052+0000 (oldest deadline 2024-09-11T00:28:18.718735+0000) 2024-09-11T00:28:27.295 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:26 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:26.830+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:45.818183+0000 front 2024-09-11T00:27:45.818219+0000 (oldest deadline 2024-09-11T00:28:10.517911+0000) 2024-09-11T00:28:27.295 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:26 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:26.830+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6814 osd.1 since back 2024-09-11T00:27:53.419031+0000 front 2024-09-11T00:27:53.419052+0000 (oldest deadline 2024-09-11T00:28:18.718735+0000) 2024-09-11T00:28:28.295 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:27 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:27.799+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:45.818183+0000 front 2024-09-11T00:27:45.818219+0000 (oldest deadline 2024-09-11T00:28:10.517911+0000) 2024-09-11T00:28:28.295 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:27 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:27.799+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6814 osd.1 since back 2024-09-11T00:27:53.419031+0000 front 2024-09-11T00:27:53.419052+0000 (oldest deadline 2024-09-11T00:28:18.718735+0000) 2024-09-11T00:28:29.045 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:28 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:28.762+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:45.818183+0000 front 2024-09-11T00:27:45.818219+0000 (oldest deadline 2024-09-11T00:28:10.517911+0000) 2024-09-11T00:28:29.045 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:28 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:28.762+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6814 osd.1 since back 2024-09-11T00:27:53.419031+0000 front 2024-09-11T00:27:53.419052+0000 (oldest deadline 2024-09-11T00:28:18.718735+0000) 2024-09-11T00:28:29.045 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:28 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:28.762+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6822 osd.2 since back 2024-09-11T00:28:05.120307+0000 front 2024-09-11T00:28:05.120235+0000 (oldest deadline 2024-09-11T00:28:28.019921+0000) 2024-09-11T00:28:30.045 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:29 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:29.760+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-11T00:27:45.818183+0000 front 2024-09-11T00:27:45.818219+0000 (oldest deadline 2024-09-11T00:28:10.517911+0000) 2024-09-11T00:28:30.045 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:29 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:29.760+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6814 osd.1 since back 2024-09-11T00:27:53.419031+0000 front 2024-09-11T00:27:53.419052+0000 (oldest deadline 2024-09-11T00:28:18.718735+0000) 2024-09-11T00:28:30.045 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:29 smithi203 ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5[88633]: 2024-09-11T00:28:29.760+0000 7fc5dce00640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.111:6822 osd.2 since back 2024-09-11T00:28:05.120307+0000 front 2024-09-11T00:28:05.120235+0000 (oldest deadline 2024-09-11T00:28:28.019921+0000) 2024-09-11T00:28:31.040 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:30 smithi203 podman[106278]: 2024-09-11 00:28:30.727967234 +0000 UTC m=+5.635885380 container died ef4834f3adf195bab61c4b49ce0a0822d735494459c6d15a6a28f9c7165d4c7c (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-11T00:28:31.295 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:31 smithi203 podman[106278]: 2024-09-11 00:28:31.144437125 +0000 UTC m=+6.052355268 container cleanup ef4834f3adf195bab61c4b49ce0a0822d735494459c6d15a6a28f9c7165d4c7c (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-11T00:28:31.295 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:31 smithi203 bash[106278]: ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5 2024-09-11T00:28:31.795 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:31 smithi203 podman[106295]: 2024-09-11 00:28:31.404160822 +0000 UTC m=+0.663404483 container remove ef4834f3adf195bab61c4b49ce0a0822d735494459c6d15a6a28f9c7165d4c7c (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:28:32.232 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:31 smithi203 podman[106385]: 2024-09-11 00:28:31.847075474 +0000 UTC m=+0.027787903 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:28:32.232 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:31 smithi203 podman[106385]: 2024-09-11 00:28:31.979918 +0000 UTC m=+0.160630415 container create 5a81e42bce2a1d0917da8b9f1648cdececc205d8f068adb119f061228cf5d75d (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-11T00:28:32.232 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:32 smithi203 podman[106385]: 2024-09-11 00:28:32.231244057 +0000 UTC m=+0.411956473 container init 5a81e42bce2a1d0917da8b9f1648cdececc205d8f068adb119f061228cf5d75d (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-11T00:28:32.500 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:32 smithi203 podman[106385]: 2024-09-11 00:28:32.23799288 +0000 UTC m=+0.418705301 container start 5a81e42bce2a1d0917da8b9f1648cdececc205d8f068adb119f061228cf5d75d (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-11T00:28:32.500 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:32 smithi203 podman[106385]: 2024-09-11 00:28:32.357544278 +0000 UTC m=+0.538256709 container attach 5a81e42bce2a1d0917da8b9f1648cdececc205d8f068adb119f061228cf5d75d (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-11T00:28:32.795 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 11 00:28:32 smithi203 podman[106385]: 2024-09-11 00:28:32.4992844 +0000 UTC m=+0.679996816 container died 5a81e42bce2a1d0917da8b9f1648cdececc205d8f068adb119f061228cf5d75d (image=quay.ceph.io/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-03107fbe-6fd0-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-11T00:28:33.153 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-03107fbe-6fd0-11ef-bcea-c7b262605968@osd.5.service' 2024-09-11T00:28:33.227 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:28:33.227 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-11T00:28:33.227 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T00:28:33.449 INFO:teuthology.orchestra.run.smithi111.stdout:Deleting cluster with fsid: 03107fbe-6fd0-11ef-bcea-c7b262605968 2024-09-11T00:28:38.833 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi111.stderr:ceph-fuse[68079]: fuse finished with error 0 and tester_r 0 2024-09-11T00:29:03.534 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T00:29:03.754 INFO:teuthology.orchestra.run.smithi203.stdout:Deleting cluster with fsid: 03107fbe-6fd0-11ef-bcea-c7b262605968 2024-09-11T00:29:22.069 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T00:29:22.134 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T00:29:22.192 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-11T00:29:22.193 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899810/remote/smithi111/crash 2024-09-11T00:29:22.194 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/crash -- . 2024-09-11T00:29:22.265 INFO:teuthology.orchestra.run.smithi111.stderr:tar: /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T00:29:22.265 INFO:teuthology.orchestra.run.smithi111.stderr:tar: Error is not recoverable: exiting now 2024-09-11T00:29:22.268 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899810/remote/smithi203/crash 2024-09-11T00:29:22.269 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/crash -- . 2024-09-11T00:29:22.337 INFO:teuthology.orchestra.run.smithi203.stderr:tar: /var/lib/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T00:29:22.337 INFO:teuthology.orchestra.run.smithi203.stderr:tar: Error is not recoverable: exiting now 2024-09-11T00:29:22.339 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-11T00:29:22.340 DEBUG:teuthology.orchestra.run.smithi111:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-11T00:29:22.422 INFO:tasks.cephadm:Compressing logs... 2024-09-11T00:29:22.423 DEBUG:teuthology.orchestra.run.smithi111:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T00:29:22.427 DEBUG:teuthology.orchestra.run.smithi203:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T00:29:22.478 INFO:teuthology.orchestra.run.smithi111.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-11T00:29:22.478 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-11T00:29:22.478 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-11T00:29:22.479 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T00:29:22.480 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-11T00:29:22.481 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-client.ceph-exporter.smithi111.log 2024-09-11T00:29:22.481 INFO:teuthology.orchestra.run.smithi203.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose --: No such file or directory 2024-09-11T00:29:22.482 INFO:teuthology.orchestra.run.smithi203.stderr: /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-mgr.smithi203.smuspl.log 2024-09-11T00:29:22.482 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-mgr.smithi111.ypucji.log 2024-09-11T00:29:22.483 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-mon.smithi203.log 2024-09-11T00:29:22.484 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-client.ceph-exporter.smithi111.log: gzip -5 --verbose -- /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi111.gmgsay.log 2024-09-11T00:29:22.484 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-mgr.smithi203.smuspl.log: gzip -5 --verbose -- /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T00:29:22.484 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-mon.smithi203.log: gzip -5 --verbose -- /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-client.ceph-exporter.smithi203.log 2024-09-11T00:29:22.485 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-mgr.smithi111.ypucji.log: gzip -5 --verbose -- /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-11T00:29:22.485 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-11T00:29:22.486 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-client.ceph-exporter.smithi203.log: gzip -5 --verbose -- /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-11T00:29:22.487 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi203.tcrqop.log 2024-09-11T00:29:22.488 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi111.gmgsay.log: /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph.cephadm.log: 94.3% -- replaced with /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-client.ceph-exporter.smithi111.log.gz 2024-09-11T00:29:22.488 INFO:teuthology.orchestra.run.smithi111.stderr: 91.4% -- replaced with /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-11T00:29:22.488 INFO:teuthology.orchestra.run.smithi111.stderr: 85.9% -- replaced with /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-11T00:29:22.488 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-mon.smithi111.log 2024-09-11T00:29:22.489 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-11T00:29:22.489 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi111.rucaba.log 2024-09-11T00:29:22.490 INFO:teuthology.orchestra.run.smithi203.stderr: 94.2% -- replaced with /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-client.ceph-exporter.smithi203.log.gz 2024-09-11T00:29:22.490 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi203.tcrqop.log: gzip -5 --verbose -- /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi203.uqkbkn.log 2024-09-11T00:29:22.492 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph.cephadm.log: /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi203.uqkbkn.log: gzip 86.0% -- replaced with /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-11T00:29:22.492 INFO:teuthology.orchestra.run.smithi203.stderr: -5 --verbose -- /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-11T00:29:22.492 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-mon.smithi111.log: gzip -5 --verbose -- /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-11T00:29:22.493 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph.log 2024-09-11T00:29:22.494 INFO:teuthology.orchestra.run.smithi203.stderr: 91.5% -- replaced with /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-11T00:29:22.495 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi111.rucaba.log: /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph.log 2024-09-11T00:29:22.496 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-11T00:29:22.496 INFO:teuthology.orchestra.run.smithi111.stderr: 91.6% -- replaced with /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T00:29:22.498 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-osd.5.log: /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-11T00:29:22.500 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T00:29:22.502 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-09-11T00:29:22.502 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-osd.3.log: 91.4% -- replaced with /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T00:29:22.503 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.log: 94.6% -- replaced with /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi111.rucaba.log.gz 2024-09-11T00:29:22.504 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T00:29:22.505 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.1.log: /var/log/ceph/cephadm.log: 88.8% -- replaced with /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-11T00:29:22.509 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/cephadm.log: 88.7% -- replaced with /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-11T00:29:22.511 INFO:teuthology.orchestra.run.smithi203.stderr: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T00:29:22.542 INFO:teuthology.orchestra.run.smithi111.stderr: 91.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T00:29:22.547 INFO:teuthology.orchestra.run.smithi203.stderr: 89.1% -- replaced with /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-mgr.smithi203.smuspl.log.gz 2024-09-11T00:29:22.966 INFO:teuthology.orchestra.run.smithi111.stderr: 89.0% -- replaced with /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-mgr.smithi111.ypucji.log.gz 2024-09-11T00:29:23.071 INFO:teuthology.orchestra.run.smithi203.stderr: 92.5% -- replaced with /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-mon.smithi203.log.gz 2024-09-11T00:29:23.841 INFO:teuthology.orchestra.run.smithi111.stderr: 90.4% -- replaced with /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-mon.smithi111.log.gz 2024-09-11T00:29:26.785 INFO:teuthology.orchestra.run.smithi111.stderr: 93.8% -- replaced with /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-11T00:29:26.849 INFO:teuthology.orchestra.run.smithi111.stderr: 93.7% -- replaced with /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-11T00:29:27.889 INFO:teuthology.orchestra.run.smithi203.stderr: 93.7% -- replaced with /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-11T00:29:27.931 INFO:teuthology.orchestra.run.smithi203.stderr: 93.8% -- replaced with /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-11T00:29:28.699 INFO:teuthology.orchestra.run.smithi111.stderr: 93.8% -- replaced with /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-11T00:29:29.078 INFO:teuthology.orchestra.run.smithi203.stderr: 93.8% -- replaced with /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-11T00:29:30.400 INFO:teuthology.orchestra.run.smithi111.stderr: 94.7% -- replaced with /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi111.gmgsay.log.gz 2024-09-11T00:29:30.742 INFO:teuthology.orchestra.run.smithi203.stderr: 94.8% -- replaced with /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi203.uqkbkn.log.gz 2024-09-11T00:29:37.329 INFO:teuthology.orchestra.run.smithi111.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-11T00:29:37.332 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-09-11T00:29:37.332 INFO:teuthology.orchestra.run.smithi111.stderr:real 0m14.877s 2024-09-11T00:29:37.333 INFO:teuthology.orchestra.run.smithi111.stderr:user 0m36.394s 2024-09-11T00:29:37.333 INFO:teuthology.orchestra.run.smithi111.stderr:sys 0m3.171s 2024-09-11T00:29:38.650 INFO:teuthology.orchestra.run.smithi203.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-09-11T00:29:38.650 INFO:teuthology.orchestra.run.smithi203.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-09-11T00:30:52.881 INFO:teuthology.orchestra.run.smithi203.stderr: 92.7% -- replaced with /var/log/ceph/03107fbe-6fd0-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi203.tcrqop.log.gz 2024-09-11T00:30:52.883 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T00:30:52.883 INFO:teuthology.orchestra.run.smithi203.stderr:real 1m30.423s 2024-09-11T00:30:52.883 INFO:teuthology.orchestra.run.smithi203.stderr:user 2m3.114s 2024-09-11T00:30:52.884 INFO:teuthology.orchestra.run.smithi203.stderr:sys 0m9.652s 2024-09-11T00:30:52.885 INFO:tasks.cephadm:Archiving logs... 2024-09-11T00:30:52.886 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899810/remote/smithi111/log 2024-09-11T00:30:52.887 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T00:30:57.711 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899810/remote/smithi203/log 2024-09-11T00:30:57.712 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T00:31:15.985 INFO:tasks.cephadm:Removing cluster... 2024-09-11T00:31:15.985 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 --force 2024-09-11T00:31:16.204 INFO:teuthology.orchestra.run.smithi111.stdout:Deleting cluster with fsid: 03107fbe-6fd0-11ef-bcea-c7b262605968 2024-09-11T00:31:16.738 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 03107fbe-6fd0-11ef-bcea-c7b262605968 --force 2024-09-11T00:31:16.958 INFO:teuthology.orchestra.run.smithi203.stdout:Deleting cluster with fsid: 03107fbe-6fd0-11ef-bcea-c7b262605968 2024-09-11T00:31:17.779 INFO:tasks.cephadm:Removing cephadm ... 2024-09-11T00:31:17.779 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T00:31:17.818 DEBUG:teuthology.orchestra.run.smithi203:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T00:31:17.854 INFO:tasks.cephadm:Teardown complete 2024-09-11T00:31:17.854 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-11T00:31:18.163 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-11T00:31:18.164 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-11T00:31:18.165 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T00:31:18.169 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T00:31:18.289 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-11T00:31:18.299 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-11T00:31:18.299 DEBUG:teuthology.orchestra.run.smithi111:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T00:31:18.304 DEBUG:teuthology.orchestra.run.smithi203:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T00:31:18.334 INFO:teuthology.orchestra.run.smithi111.stderr:bash: line 1: ntpq: command not found 2024-09-11T00:31:18.337 INFO:teuthology.orchestra.run.smithi203.stderr:bash: line 1: ntpq: command not found 2024-09-11T00:31:18.341 INFO:teuthology.orchestra.run.smithi111.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T00:31:18.341 INFO:teuthology.orchestra.run.smithi111.stdout:=============================================================================== 2024-09-11T00:31:18.342 INFO:teuthology.orchestra.run.smithi111.stdout:^* hv01.front.sepia.ceph.com 3 6 377 8 -669us[ -656us] +/- 49ms 2024-09-11T00:31:18.342 INFO:teuthology.orchestra.run.smithi111.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 79 +924us[ +941us] +/- 61ms 2024-09-11T00:31:18.342 INFO:teuthology.orchestra.run.smithi111.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 -229us[ -216us] +/- 91ms 2024-09-11T00:31:18.342 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:31:18.343 INFO:teuthology.orchestra.run.smithi203.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T00:31:18.344 INFO:teuthology.orchestra.run.smithi203.stdout:=============================================================================== 2024-09-11T00:31:18.344 INFO:teuthology.orchestra.run.smithi203.stdout:^* hv01.front.sepia.ceph.com 3 6 377 8 -735us[ -721us] +/- 49ms 2024-09-11T00:31:18.344 INFO:teuthology.orchestra.run.smithi203.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 7 +922us[ +922us] +/- 62ms 2024-09-11T00:31:18.344 INFO:teuthology.orchestra.run.smithi203.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 -192us[ -178us] +/- 91ms 2024-09-11T00:31:18.344 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:31:18.345 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-11T00:31:18.355 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-11T00:31:18.355 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-11T00:31:18.377 DEBUG:teuthology.orchestra.run.smithi111:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T00:31:18.522 DEBUG:teuthology.orchestra.run.smithi203:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T00:31:18.651 DEBUG:teuthology.orchestra.run.smithi111:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-11T00:31:18.713 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:31:18.714 DEBUG:teuthology.orchestra.run.smithi203:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-11T00:31:18.774 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:31:18.774 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-11T00:31:18.786 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-11T00:31:18.815 INFO:teuthology.task.internal:Duration was 2627.955317 seconds 2024-09-11T00:31:18.815 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-11T00:31:18.845 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-11T00:31:18.846 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T00:31:18.851 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T00:31:18.933 INFO:teuthology.orchestra.run.smithi111.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T00:31:18.938 INFO:teuthology.orchestra.run.smithi203.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T00:31:19.363 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-11T00:31:19.363 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi111.front.sepia.ceph.com 2024-09-11T00:31:19.363 DEBUG:teuthology.orchestra.run.smithi111:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T00:31:19.413 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi203.front.sepia.ceph.com 2024-09-11T00:31:19.413 DEBUG:teuthology.orchestra.run.smithi203:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T00:31:19.462 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-11T00:31:19.463 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T00:31:19.467 DEBUG:teuthology.orchestra.run.smithi203:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T00:31:19.525 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-11T00:31:19.526 DEBUG:teuthology.orchestra.run.smithi111:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T00:31:19.529 DEBUG:teuthology.orchestra.run.smithi203:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T00:31:20.306 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-11T00:31:20.318 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-11T00:31:20.319 DEBUG:teuthology.orchestra.run.smithi111:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T00:31:20.375 DEBUG:teuthology.orchestra.run.smithi203:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T00:31:20.432 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-11T00:31:20.444 DEBUG:teuthology.orchestra.run.smithi111:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T00:31:20.448 DEBUG:teuthology.orchestra.run.smithi203:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T00:31:20.515 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = core 2024-09-11T00:31:20.519 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern = core 2024-09-11T00:31:20.562 DEBUG:teuthology.orchestra.run.smithi111:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T00:31:20.595 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:31:20.596 DEBUG:teuthology.orchestra.run.smithi203:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T00:31:20.629 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:31:20.629 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-11T00:31:20.642 INFO:teuthology.task.internal:Transferring archived files... 2024-09-11T00:31:20.643 DEBUG:teuthology.misc:Transferring archived files from smithi111:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899810/remote/smithi111 2024-09-11T00:31:20.643 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T00:31:20.723 DEBUG:teuthology.misc:Transferring archived files from smithi203:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899810/remote/smithi203 2024-09-11T00:31:20.723 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T00:31:20.792 INFO:teuthology.task.internal:Removing archive directory... 2024-09-11T00:31:20.792 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T00:31:20.797 DEBUG:teuthology.orchestra.run.smithi203:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T00:31:20.831 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-11T00:31:20.845 INFO:teuthology.task.internal:Not uploading archives. 2024-09-11T00:31:20.845 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-11T00:31:20.912 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-11T00:31:20.912 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T00:31:20.917 DEBUG:teuthology.orchestra.run.smithi203:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T00:31:20.947 INFO:teuthology.orchestra.run.smithi111.stdout: 393253 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 11 00:31 /home/ubuntu/cephtest 2024-09-11T00:31:20.947 INFO:teuthology.orchestra.run.smithi111.stdout: 656522 4 d--------- 2 ubuntu ubuntu 4096 Sep 11 00:04 /home/ubuntu/cephtest/mnt.0 2024-09-11T00:31:20.948 INFO:teuthology.orchestra.run.smithi111.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-09-11T00:31:20.949 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:31:20.949 INFO:teuthology.orchestra.run.smithi111.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-11T00:31:20.950 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi111 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-11T00:31:20.950 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-11T00:31:20.962 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-11T00:31:20.989 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-11T00:31:20.992 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2627.955316543579 failure_reason: reached maximum tries (50) after waiting for 300 seconds flavor: default host.a-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a host.b-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a owner: scheduled_hyelloji@teuthology status: fail success: false 2024-09-11T00:31:20.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T00:31:21.087 INFO:teuthology.run:FAIL